KR102822783B1 - Composing system based on body movement - Google Patents

Abstract

According to one embodiment, the body movement-based music composition system of the present invention may include a wearable suit part worn on the user's body, which includes a plurality of sensors arranged at predetermined positions based on the user's body, a control part which obtains sensing data including force of the user's body part, acceleration of the user's body part, and xyz-axis positions of the user's body part from the plurality of sensors, and generates an acoustic signal by digitizing the sensing data, and an acoustic part which obtains the acoustic signal from the control part and outputs sound.

Description

COMPOSING SYSTEM BASED ON BODY MOVEMENT

The present invention relates to a composition system based on body movements.

In the past, composing mainly meant the act of creating musical scores. However, recently, the meaning of composition has expanded to include all the accompaniments or sound effects that make up a song or a piece of music. If you can repeat the same notes to a certain degree, the public will remember that song or piece and sing along. Therefore, composing music is now considered something that anyone can do, and if you compose a song or piece that is popular with the general public, you can expect high profits.

Normally, music composition can be done using an instrument or piano, but recently, with the popularization of digital data, music composition can be done using programs or applications even without an instrument or piano.

Nowadays, most compositions are done using digital data using digital devices rather than directly writing sheet music.

Recently, devices that generate and record sound sources using machine learning have also appeared.

If a person can remember the music that comes to mind and record it in various ways, then composing can begin. If such music is played using an instrument or digital device and harmony and melody are added, a song or a piece can be completed.

In this way, since anyone can compose music, a system or device that can help even those without background knowledge in composition to easily approach composition is required.

Republic of Korea Patent Publication No. 10-2007-0110054 (November 15, 2007)

The purpose of the present invention is to provide a system or device that allows even ordinary people without background knowledge of composition to understand the changing sound forms through simple movements or gestures and to repeatedly reproduce a song or a piece of music. In addition, the purpose of the present invention is to provide a system or device that allows ordinary people to easily compose music and popularize composition by utilizing video data of the user's movements or gestures for composition.

The problems to be solved by the present invention are not limited to those mentioned above, and other problems not mentioned can be clearly understood by a person having ordinary skill in the relevant technical field from the description of the invention.

A body movement-based composition system according to one embodiment comprises a plurality of sensors positioned at predetermined locations based on a user's body, and a wearable suit part worn on the user's body;

The apparatus may include a control unit that obtains sensing data including force of the user's body part, acceleration of the user's body part, and xyz-axis positions of the user's body part from the plurality of sensors, digitizes the sensing data to generate an acoustic signal, and an acoustic unit that obtains the acoustic signal from the control unit and outputs sound.

Additionally, the acoustic unit may be characterized by being placed at the user's ear.

delete

delete

According to the composition system based on body movement of the present invention, a user can recognize a sound source that changes due to his/her own movement, action or gesture, and the control unit can store the generated sound source. The user can perform another movement, gesture or action by referring to the recognized sound source or the stored sound source, so that he/she can perform composition based on his/her own body movement, and therefore even a person without background knowledge of composition can perform composition.

FIG. 1 is a block diagram of a body movement-based composition system according to the present invention.
FIG. 2 is a conceptual diagram illustrating mounting of a composition system according to one embodiment of the present invention.
FIG. 3 is a conceptual diagram illustrating mounting of a composition system according to another embodiment of the present invention.
Figure 4 is a block diagram of a control unit according to one embodiment of the present invention.

In describing embodiments of the present invention, if it is judged that a detailed description of a known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. In addition, the terms described below are terms defined in consideration of their functions in the present invention, and may vary depending on the intention or custom of the user or operator. Therefore, the definitions should be made based on the contents throughout this specification. The terms used in the detailed description are only for describing embodiments of the present invention, and should never be construed as limiting. Unless clearly used otherwise, the singular form includes the plural form. In this description, expressions such as "comprises" or "comprising" are intended to indicate certain features, numbers, steps, operations, elements, parts or combinations thereof, and should not be construed as excluding the presence or possibility of one or more other features, numbers, steps, operations, elements, parts or combinations thereof other than those described.

In each system depicted in the drawings, elements in some cases may have the same reference number or different reference numbers to indicate that the represented elements may be different or similar. However, the elements may have different implementations and may operate with any or all of the systems shown or described herein. Various elements depicted in the drawings may be the same or different. It is arbitrary which one is referred to as a first element and which one is referred to as a second element.

In this specification, the phrase “transmitting” or “providing” data or a signal from one component to another component includes not only the component directly transmitting data or a signal to another component, but also the component transmitting data or a signal to another component via at least one other component.

All or part of the steps of the body movement-based composition method according to an embodiment of the present invention may be implemented by one physical or logical computing device or may be implemented in a distributed manner by two or more physical or logical computing devices.

According to one embodiment, a control unit, which is a computing device capable of executing a composition method based on body movement of the present invention, may be implemented with a processor, a memory, and a communication module. However, it is not limited thereto, and an example of an implementation device may be a server.

The 'server' may include a DB, which means a functional and structural combination of software and hardware that stores information corresponding to each database, and the DB may be implemented with at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. In addition, it may be implemented in various ways, such as in the form of a linked list, a tree, and a relational database, and includes all data storage media and data structures that can store information corresponding to the database. In the following description, if the subject is not specified separately, the processor or server is exemplified as the subject.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. The following detailed description is provided to help a comprehensive understanding of the methods, devices, and/or systems described herein. However, this is only an example and the present invention is not limited thereto.

Fig. 1 is a block diagram of a composition system based on body movement according to the present invention. Fig. 2 is a conceptual diagram illustrating installation of a composition system according to one embodiment of the present invention.

Referring to FIG. 1, the body movement-based composition system of the present invention may include a wearable suit part (100), a control part (200), and an audio part (300). According to one embodiment of the present invention, the wearable suit part (100) may further include a head suit (110).

The wearable suit (100) may include a plurality of sensors capable of sensing various physical changes generated by the user's movements, gestures, or actions.

According to one embodiment, the plurality of sensors may include an encoder sensor, a motion sensor, and an inertial measurement unit (IMU) sensor to obtain sensing data on movements of a user wearing the wearable suit (100) or unit.

The above-described encoder sensor, motion sensor, and imu sensor are exemplary, and the plurality of sensors of the present invention may include various sensors that can convert information acquired from the sensor into an electrical signal and transmit it to a processor or control unit (200).

The encoder sensor is a sensor that can measure the arm angle or leg angle of a user wearing the wearable suit part (100) or the unit, and the motion sensor and IMU sensor are configured as an integrated unit including an acceleration sensor, an angular velocity sensor, etc., and can measure the xyz axis movement, force, acceleration, etc. of a user wearing the wearable suit part (100) or the unit.

According to one embodiment, at least a plurality of sensors may include flex sensors to obtain sensing data regarding the bending of fingers of a user wearing the wearable suit portion (100) or unit.

The control unit (200) may include a processor capable of analyzing frequency, force, acceleration, etc. of sensing data signals acquired from the plurality of sensors described above.

According to one embodiment, the control unit (200) may include a memory storing data on a scale corresponding to frequency, force or acceleration.

According to one embodiment, the control unit (200) can analyze frequency, force, or acceleration acquired from multiple sensors and generate an acoustic signal using data on a pre-stored musical scale.

According to one embodiment, the control unit (200) can convert a frequency, force, or acceleration obtained according to a preset standard or mathematical formula into a pre-stored sound scale, and generate an acoustic signal based on the converted signal.

According to one embodiment, the control unit (200) can convert acquired sensing data on frequency, force or acceleration into a numerical value having a certain range or calculate a numerical value, and generate an acoustic signal by corresponding the converted or calculated numerical value to a pre-designated musical scale.

delete

According to one embodiment, the control unit (200) can transmit the generated acoustic signal to the acoustic unit (300).

The sound unit (300) can receive an audio signal from the control unit (200) and output voice or sound.

Referring to FIG. 2, the sound unit (300) may be a Bluetooth earphone. However, the sound unit (300) is not limited thereto, and various devices capable of receiving an audio signal from the control unit (200) and outputting voice or sound may be the sound unit (300) of the present invention.

According to the embodiment shown in Fig. 2, a user can hear sounds that change according to his/her movements, gestures or actions through Bluetooth earphones. Accordingly, the user can hear sounds that change according to his/her movements by using the composition system based on body movements of the present invention even in a space where there are other people besides himself/herself, and there is an effect of being able to compose music without being restricted by time or space.

FIG. 3 is a conceptual diagram illustrating mounting of a composition system according to another embodiment of the present invention.

Referring to FIG. 3, the wearable suit part (100) may further include a head suit (110).

The head suit (110) may include a display device (module) and a communication module, and may obtain a user's motion image from an external server or control unit (200) and display the user's motion image through the display device.

Users can visually confirm their own movements, gestures or actions through the display device included in the head suit (110) and hear sounds that change according to their movements, gestures or actions, thereby enabling more effective composition.

According to the embodiment shown in Fig. 3, a user can compose music in a place such as a studio or workroom where he or she can check his or her own movement video, and thus can more effectively understand the sound that changes according to his or her movement, thereby performing more effective music composition.

Figure 4 is a block diagram of a control unit according to one embodiment of the present invention.

A control unit (200) according to one embodiment of the present invention may include a processor (220), a memory (230), and/or a communication module (240).

The processor (220) according to one embodiment may include a single processor core or may include a plurality of processor cores. For example, the processor (220) may include a multi-core such as a dual-core, a quad-core, a hexa-core, etc. According to embodiments, the processor (220) may further include a cache memory located inside or outside the memory.

According to one embodiment, the processor (220) may analyze frequency, force, or acceleration acquired from multiple sensors and generate an acoustic signal using data on a pre-stored musical scale.

According to one embodiment, the processor (220) may convert a frequency, force, or acceleration obtained according to a preset criterion or mathematical formula into a pre-stored sound scale, and generate an acoustic signal based on the converted signal.

According to one embodiment, the processor (220) may obtain sensing data including force of the user's body part, acceleration of the user's body part, and xyz-axis position of the user's body part from a plurality of sensors, and may digitize the sensing data to generate an acoustic signal.

delete

The memory (230) according to one embodiment may include a hardware component for storing data and/or instructions input and/or output to the processor (220). The memory (430) may include, for example, a volatile memory such as a random-access memory (RAM) and/or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM).

According to one embodiment, the memory (230) can store an acoustic signal generated by the processor (220) or a voice or sound output from the acoustic unit (300).

According to one embodiment, the memory (230) can store the user's motion images acquired by the control unit (200).

According to one embodiment, the communication module (240) can establish a communication channel with the processor (220) of the present invention and an external server. The communication module (240) can be functionally coupled with the processor (220) and the memory (230).

The above description of the present invention is for illustrative purposes only, and those skilled in the art will understand that the present invention can be easily modified into other specific forms without changing the technical idea or essential characteristics of the present invention. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

Claims (4)

A wearable suit part worn on a user's body, comprising a plurality of sensors arranged at predetermined locations based on the user's body;
A control unit that obtains sensing data including force of the user's body part, acceleration of the user's body part, and xyz-axis position of the user's body part from the plurality of sensors, and digitizes the sensing data to generate an acoustic signal;
A memory that digitizes the sensing data from the control unit and stores the acoustic signal generated by the control unit; and
An acoustic section that obtains an acoustic signal from the above control section and outputs sound;
Including, but not limited to,
A body movement-based composition system, characterized in that the wearable suit part includes a head suit having a display device installed therein for displaying an image of the user's movements.
In the first paragraph,
The above sound unit is characterized in that it is placed at the user's ear.
A composition system based on body movements.
delete delete