JP2022036359A - Music production device, terminal device, music production method, program, and recording medium - Google Patents

Abstract

To provide a music production device which allows a plurality of players or singers to play or sing to create one piece of music.SOLUTION: A music production device (server 1) includes: a karaoke supply part 22; a sound source acquisition part 24; a selection part 25; and a mixing execution part 26. The karaoke supply part supplies karaoke data for each part of the music to the outside (terminal devices 2 which individual users possess). The sound source acquisition part acquires and accumulates sound source data for each part, which the individual users play and corresponds to the karaoke data, from each terminal device. The selection part selects representative sound source data which represents the part from the sound source data which the sound source acquisition part acquires. The mixing execution part generates final sound source data being sound source data including the plurality of parts by mixing the representative sound source data which the selection part selects on the plurality of parts constituting the music.SELECTED DRAWING: Figure 1

Description

The present invention relates to a music production device, a terminal device, a music production method, a program, and a recording medium.

It is attempted that a singer (singer) or a musical instrument player collaborates to play a musical piece by using a mechanism using the Internet.

For example, Patent Document 1 describes a technique for creating a combined recording of a karaoke performance by combining the audio captured by a microphone and the music audio related to the karaoke performance with the captured video. In the technique described in Patent Document 1, a large number of digital download jukeboxes are connected by a network. Paragraph 882 of Patent Document 1 states, "Singer is, for example, synchronism with the beat, expected note or pitch deviation, and / or audience reaction, measured applause, KJ, or other official recognition. It is ranked or scored based on an objective evaluation from a person, a quantitative scale such as a guest's judgment, or a quantitative scale determined through an appropriate measuring device. " Is described. Further, in paragraph 805 of Patent Document 1, "Karaoke jukebox provides a real-time music mixing and operation device for superimposing inbound performance audio while rendering music music media. These two audio streams are provided. , Mixed by a mixing karaoke to generate a mixed audio file containing the original music and the audio captured at the venue. "

Japanese Unexamined Patent Publication No. 2018-136547

However, in the technique described in Patent Document 1, pre-recorded audio (“musical music media” described in paragraph 805 of Patent Document 1) and audio played in real time (described in paragraph 805 of Patent Document 1). It only mixes with the "inbound performance audio"). That is, in the background technique, for example, it is not possible for a plurality of singers or performers who are unknown to each other to perform to create one song.

The present invention has been made based on the recognition of the above-mentioned problems, and is a music production device, a terminal device, and a music production method capable of allowing a plurality of singers or performers to create one music via a network or the like. , Programs, and recording media.

[1] In order to solve the above problems, the music production device according to one aspect of the present invention has a karaoke providing unit that provides karaoke data for each part of the music to the outside, and a sound source for each part corresponding to the karaoke data. About each of a sound source acquisition unit that acquires and accumulates data, a selection unit that selects representative sound source data representing the part from the sound source data acquired by the sound source acquisition unit, and a plurality of parts that compose the music. It includes a mixing execution unit that creates final sound source data that is sound source data including the plurality of parts by mixing the representative sound source data selected by the selection unit.

[2] Further, one aspect of the present invention is that in the above-mentioned music production apparatus, the part is a musical instrument part or a singing part for composing the music.

[3] Further, in one aspect of the present invention, in the music production apparatus, the sound source acquisition unit acquires the sound source data for each part at independent timings for each part.

[4] Further, in one aspect of the present invention, the music production apparatus further includes a music score providing unit for providing music score data for each part of the music to the outside, and the sound source acquisition unit includes the music score data. Also, the sound source data for each part corresponding to the above is acquired.

[5] Further, in one aspect of the present invention, in the music production apparatus, the selection unit compares the pitch and beat of the sound source data with the correct pitch and beat of the sound source data. Machine evaluation, which is an evaluation result indicating accuracy when the correct answer is used as a reference, auditor evaluation, which is an evaluation result received from the auditor's terminal device regarding the sound source data, and user's terminal device regarding the sound source data. The user evaluation, which is the received evaluation result, the number of "likes", which is the number of "likes" transmitted from the user's terminal device regarding the sound source data, and the sound source data are played back on the user's terminal device. The part is based on at least one of the evaluation results of the number of times of reproduction based on the number of times of evaluation and the reproduction time of the total time of the sound source data being reproduced on the user's terminal device. The representative sound source data is selected.

[6] Further, in one aspect of the present invention, in the music production apparatus, the selection unit has the machine evaluation, the judge evaluation, the user evaluation, the number of "likes", and the reproduction. A comprehensive evaluation is calculated based on at least two evaluations of the number of times and the playback time, and the representative sound source data representing the part is selected based on the calculated comprehensive evaluation. ..

[7] Further, in one aspect of the present invention, in the music production device, the sound source data is sound data recording the performance or singing of the user of the terminal device to which the karaoke data is provided. The selection unit selects the representative sound source data representing the part from only the sound source data acquired from the terminal device.

[8] Further, in one aspect of the present invention, in the music production apparatus, the karaoke data includes a synchronization signal for playback synchronization between parts, and the sound source data includes the karaoke data. The mixing execution unit inherits and has the synchronization signal, and the mixing execution unit mixes a plurality of the representative sound source data while performing reproduction synchronization between the parts based on the synchronization signal of the representative sound source data. be.

[9] Further, in one aspect of the present invention, in the above-mentioned music production apparatus, the mixing execution unit enables the created final sound source data to be transmitted via the Internet.

[10] Further, one aspect of the present invention is a karaoke providing process in which the karaoke providing unit provides karaoke data for each part of the music to the outside, and a sound source acquisition unit provides a sound source for each part corresponding to the karaoke data. The sound source acquisition process of acquiring and accumulating data, the selection process of selecting the representative sound source data representing the part from the sound source data acquired by the sound source acquisition unit, and the mixing execution unit of the music. Music production including a mixing execution process of creating final sound source data which is sound source data including the plurality of parts by mixing the representative sound source data selected by the selection unit for each of the plurality of parts constituting the above. The method.

[11] Further, one aspect of the present invention is a karaoke providing unit that provides karaoke data for each part of a song to the outside, and a sound source acquisition unit that acquires and stores sound source data for each part corresponding to the karaoke data. And the selection unit that selects representative sound source data representing the part from the sound source data acquired by the sound source acquisition unit, and the representative sound source data selected by the selection unit for each of the plurality of parts constituting the music. It is a program that makes a computer function as a music production device including a mixing execution unit that creates final sound source data which is sound source data including the plurality of parts by mixing.

[12] Further, one aspect of the present invention is a karaoke providing unit that provides karaoke data for each part of a song to the outside, and a sound source acquisition unit that acquires and stores sound source data for each part corresponding to the karaoke data. The representative sound source data selected by the selection unit for each of the selection unit for selecting the representative sound source data representing the part from the sound source data acquired by the sound source acquisition unit and the plurality of parts constituting the music. A computer-readable record that records a program that causes the computer to function as a music production device, including a mixing execution unit that creates final sound source data that is sound source data including the plurality of parts by mixing. It is a medium.

[13] Further, in one aspect of the present invention, a data receiving unit that receives karaoke data and score data, the karaoke data is presented as sound, and a score based on the score data is presented on the screen as visual information. The presentation unit, a sound recording unit that records sound acquired from the outside in accordance with the presentation of the karaoke data by the presentation unit as sound source data, an evaluation unit that evaluates the sound source data and outputs machine evaluation data, and the above. It is a terminal device including a data transmission unit for transmitting sound source data and the machine evaluation data.

According to the present invention, the music production apparatus can acquire sound source data for each part and create final sound source data using only representative sound source data selected from those sound source data.

According to the present invention, the music production device can create the entire final sound source data including all the parts only by the user producing the sound source data of his / her own part and transmitting it to the music production device. .. In addition, the final sound source data produced in this way can be disclosed to the general public.

It is a block diagram which shows the schematic functional structure of the system (particularly, a server apparatus) by embodiment of this invention. It is a block diagram which shows the schematic functional structure of the terminal apparatus by the same embodiment. It is a schematic diagram which shows the example of the structure of the music management table which the management information storage part in a database by the same embodiment has. It is a schematic diagram which shows the example of the structure of the karaoke table (MR table) which the karaoke storage part in the database by the same embodiment has. It is a schematic diagram which shows the example of the structure of the musical score table which the musical score storage part in the database by the same embodiment has. It is a schematic diagram which shows the example of the structure of the acquisition sound source table which the acquisition sound source storage part in the database by the same embodiment has. It is a schematic diagram which shows the example of the structure of the sound source evaluation table which the management information storage part in a database by the same embodiment has. It is a schematic diagram which shows the example of the structure of the selection sound source table which the management information storage part in a database by the same embodiment has. It is a schematic diagram which shows the example of the structure of the final sound source table which the final sound source storage part in the database by the same embodiment has. It is a flowchart which shows the procedure of the process until the server apparatus of the same embodiment produces a final sound source. It is a block diagram which shows the example of the internal structure of each device such as a server device and a terminal device of this embodiment in the same embodiment.

Next, an embodiment of the present invention will be described with reference to the drawings.

In the embodiment described below, the server device 1 determines a schedule for a specific musical piece and solicits sound sources from users of the terminal device 2. When soliciting sound sources, the server device 1 solicits sound sources for each part. Here, the part refers to the division of performance of each instrument (including vocals). In some cases, one type of instrument has a plurality of parts (for example, a lead guitar and a side guitar). For the above recruitment, the server device 1 provides a score and karaoke for each part. The server device 1 can transmit the score data and the karaoke data to the terminal device 2. The terminal device 2 displays the score on a screen or the like based on the score data received from the server device 1. Further, the terminal device 2 reproduces karaoke (MR) based on the karaoke data received from the server device 1. The karaoke sound can be output from, for example, a speaker or earphone connected to the terminal device 2. The terminal device 2 records the sounds of the musical instrument played by the user and the song (vocal) sung by the user, and records the sound as sound source data. The terminal device 2 transmits the sound source data to the server device 1 in response to the solicitation of the server device 1. The server device 1 collects and stores sound source data sent from a large number of terminal devices 2. The server device 1 evaluates sound source data for each part of a specific musical piece. The server device 1 mixes highly evaluated sound source data to create final sound source data.

It should be noted that the users of the terminal device 2 do not need to synchronize with the users of the other terminal devices 2 when recording the performance or the like. The user of the terminal device 2 may perform a performance or the like at each independent timing or at a desired timing, and transmit the sound source data to the server device 1. As will be described later, synchronization between a plurality of parts in a musical piece is performed during the mixing process. Further, it is not necessary for the users of the terminal device 2 to post sound source data related to the same music by showing them in advance. The user of each terminal device 2 can post the sound source data of the part desired by the user of the other terminal device 2 without being conscious of which part of the music the user of the other terminal device 2 is in charge of.

The "sound source data" described above is data in which the sound of each part is recorded, is sent from the terminal device 2 to the server device 1, and is stored in the server device 1. The "final sound source data" is data created by mixing the sound source data of each of the above parts. The "final sound source data" is created by mixing the sound source data of a specific music piece, for example, all parts.

Among the terms used in this embodiment, XML means an extensible markup language. MR is an abbreviation for Music Recorded. MR is so-called karaoke. Further, sound is the content of hearing generated by the vibration of a medium such as air. Sound is also called "sound" or "voice" in Japanese. In this embodiment, the sound is mainly a musical tone. The sound in the present embodiment may include a sound produced by playing a musical instrument, a sound produced by a person singing, or a sound synthesized by using a computer (synthesizer).

FIG. 1 is a block diagram showing a schematic functional configuration of a system according to the present embodiment. As shown in the figure, this system is configured by connecting the server device 1 and the terminal device 2 by communication. The server device 1 is also referred to as a "music production device". The server device (music production device) 1 includes a terminal interface unit 10, a sound source recruitment function unit 21, a karaoke providing unit 22, a score providing unit 23, a sound source acquisition unit 24, a selection unit 25, and a mixing execution unit 26. And the database 30 are included. Each of these functional units can be realized by, for example, a computer and a program. In addition, each functional unit has a storage means, if necessary. The storage means is, for example, a variable on the program or a memory allocated by executing the program. Further, if necessary, a non-volatile storage means such as a magnetic hard disk device or a solid state drive (SSD) may be used. Further, at least a part of the functions of each functional unit may be realized not as a program but as a dedicated electronic circuit.

The terminal interface unit 10 has a function of an interface to the terminal device 2. Specifically, the terminal interface unit 10 transmits various data (including karaoke data and score data) to the terminal device 2, and receives various data (sound source data and related data) from the terminal device 2. Or something.

The sound source solicitation function unit 21 presents information to the terminal device 2 to solicit hands and sound sources. Specifically, the sound source recruitment function unit 21 transmits the recruitment information to be displayed on the terminal device 2 to the terminal device 2.

The karaoke providing unit 22 provides karaoke data for each part (musical instrument or vocal) of the music to the outside. The karaoke providing unit 22 reads the karaoke data from the karaoke storage unit 31 of the database 30 and provides the karaoke data to the outside. Specifically, the karaoke providing unit 22 transmits the karaoke data to the terminal device 2. As described above, a part is a musical instrument part or a singing part for composing a musical piece.

The score providing unit 23 provides score data for each part of the music to the outside. Specifically, the score providing unit 23 reads the score data from the score storage unit 32 of the database 30. Further, the score providing unit 23 can transmit the score data to the terminal device 2.

The sound source acquisition unit 24 acquires and stores sound source data for each part corresponding to the karaoke data. The sound source data acquired by the sound source acquisition unit 24 also corresponds to the musical score data. Specifically, the sound source acquisition unit 24 receives the sound source data from the terminal device 2. Further, the sound source acquisition unit 24 writes the acquired sound source data in the acquisition sound source storage unit 33 of the database 30. Further, the sound source acquisition unit 24 can receive the result of machine evaluation of the sound source data from the terminal device and write it in the management information storage unit 35 of the database 30.

The sound source acquisition unit 24 can acquire sound source data for each part at independent timings for each part. Further, the sound source acquisition unit 24 can acquire sound source data from each terminal device 2 at independent timings for each terminal device 2. That is, the user on the terminal device 2 side does not need to synchronize or adjust the timing of creating the sound source data and the timing of posting the sound source data with the user of the other terminal device 2.

The selection unit 25 selects sound source data to be captured in the final sound source for each song and each part. Specifically, the selection unit 25 collects evaluation information for each sound source data and writes it in the management information storage unit 35 in the database 30. In addition, the selection unit 25 calculates points for comprehensive evaluation based on the collected evaluation information. For example, the selection unit 25 calculates a weighted sum (or weighted average) of numerical values of a plurality of evaluation items and uses them as points for comprehensive evaluation. The weight value for each evaluation item at this time is set in advance. Alternatively, a set of weight values may be optimized in advance by using a method such as machine learning. The selection unit 25 writes the calculated comprehensive evaluation points in the management information storage unit 35.

The selection unit 25 selects representative sound source data that is representative of each part used by the mixing execution unit 26. That is, the sound source data selected by the selection unit 25 is called representative sound source data. The selection unit 25 selects representative sound source data for each part of the music.

An example of the calculation formula when the selection unit 25 calculates the comprehensive evaluation is as follows.
a formula:
Comprehensive evaluation points = 100 ×
(W1 x machine evaluation point / machine evaluation standard value + W2 x judge evaluation point / judge evaluation standard value + W3 x user evaluation point / user evaluation standard value + W4 x number of likes / like number standard Value + W5 x number of playbacks / reference value for number of playbacks + W6 x reference value for playback time (number of seconds) / playback time (number of seconds))

In the above formula, for example, the points of machine evaluation, the points of judge evaluation, and the points of user evaluation are set to numerical values of 0 or more and 100 or less, respectively.
Further, the reference value of the machine evaluation, the reference value of the judge evaluation, and the reference value of the user evaluation are set to 100, respectively. Further, the reference value of the number of likes and the reference value of the number of reproductions are set to appropriately determined numerical values (for example, 1000). Further, the reference value of the reproduction time (seconds) is set to an appropriately determined numerical value (for example, 72000 [seconds] or the like). Further, W1, W2, W3, W4, W5, and W6 are weight coefficients, respectively, and for example, W1 + W2 + W3 + W4 + W5 + W6 = 1.

The calculation method of the comprehensive evaluation is not limited to the method exemplified here. For example, the overall evaluation does not have to be a weighted average value. Further, for example, the comprehensive evaluation does not have to be obtained by arithmetic calculation.

That is, the selection unit 25
(1) Machine evaluation, which is an evaluation result showing accuracy when the correct answer of the sound source data is used as a reference by comparing the pitch and time signature of the sound source data with the pitch and time signature of the correct answer.
(2) Judge's evaluation, which is the evaluation result received from the judge's terminal device regarding the sound source data.
(3) User evaluation, which is an evaluation result received from the user's terminal device regarding sound source data.
(4) The number of "likes", which is the evaluation result of the number of "likes" transmitted from the user's terminal device regarding the sound source data.
(5) The number of playbacks, which is the evaluation result of the number of times the sound source data has been played back on the user's terminal device.
(6) Playback time based on the total time that the sound source data was played back on the user's terminal device as the evaluation result.
The representative sound source data representing the part is selected based on the evaluation result of at least one of the above.

In addition, the selection unit 25 calculates the overall evaluation based on at least two evaluations of the machine evaluation, the judge evaluation, the user evaluation, the number of "likes", the number of playbacks, and the playback time. It's okay. The selection unit 25 selects representative sound source data representing the part based on the calculated comprehensive evaluation.

The sound source data may be sound data recording the performance or singing of the user of the terminal device 2 to which the karaoke data is provided. The selection unit 25 may select the representative sound source data representing each part from only the sound source data acquired from the terminal device 2.

The mixing execution unit 26 creates final sound source data that is sound source data including the plurality of parts by mixing the representative sound source data selected by the selection unit 25 for each of the plurality of parts constituting the music. The mixing execution unit 26 may enable the created final sound source data to be transmitted via the Internet.

The database 30 has a function of storing and managing data. The database 30 can be realized, for example, by using a database management system (DBMS) that employs a relational data model. The structure of the data held by the database 30 will be described later with reference to another figure.

As shown in FIG. 1, the database 30 includes a karaoke storage unit 31, a score storage unit 32, an acquisition sound source storage unit 33, a final sound source storage unit 34, and a management information storage unit 35. Will be done.

The karaoke storage unit 31 stores karaoke data. The karaoke data is the sound data of the karaoke performance for a specific part of a specific music. That is, the karaoke data is data that records the sounds of performances other than the relevant part (musical instrument or vocal). The sound data is data expressed in a format such as a WAV format or an MPEG format. The karaoke storage unit 31 stores the karaoke data in association with the song ID and the part ID. Karaoke is also called MR (music recorded, music recorded).

The karaoke data for each part of one song is data that can be played back synchronously. For example, the sampling frequency of the karaoke data for each part completely matches the sampling frequency of the other parts. Further, the karaoke data for each part may have a synchronization signal inside. The sound source data recorded based on the performance of the karaoke data may be similarly playable in synchronization. The sound source data of each part may also have a synchronization signal internally. As a result, the sound source data (data transmitted from the terminal device 2 to the server device 1) of each part of one song can be played back in synchronization with the other parts. Therefore, even when the mixing execution unit 26 mixes the sound source data of a plurality of parts, it is possible to synchronize the parts.

That is, the karaoke data includes a synchronization signal for playback synchronization between parts. The sound source data may take over the synchronization signal included in the karaoke data. The mixing execution unit 26 may mix a plurality of representative sound source data while maintaining reproduction synchronization between the parts based on the synchronization signal of the representative sound source data.

The score storage unit 32 stores score data. Musical score data includes information for a particular piece of music, for a particular part, scales, rhythms, rests, and other performances. Typically, a musical score has information that can be expressed in a staff notation or equivalent information. However, depending on the musical instrument or the like, the score may be represented by something other than the staff notation. The musical score storage unit 32 stores the musical score data as described above in association with the song ID and the part ID.

The acquired sound source storage unit 33 stores the sound source data acquired by the server device 1 from the terminal device 2. The sound source data is sound data recorded on the terminal device 2 side based on karaoke data and musical score data. The sound source data represents the sound of the performance or singing of each part of the music. The sound source data is a recording of a performance or singing of a specific part performed by a user or the like of the terminal device 2.

The final sound source storage unit 34 stores the data of the final sound source, which is the result of mixing processing of the representative sound source data selected by the selection unit 25. The representative sound source data selected by the selection unit 25 is sound source data representing each part of the musical piece.

The management information storage unit 35 stores management information regarding music and sound source data. The data stored in the management information storage unit 35 includes data related to the song title of the music and evaluation result data for each sound source data posted from the terminal device 2.

FIG. 2 is a block diagram showing a schematic functional configuration of the terminal device 2. As shown in the figure, the terminal device 2 includes a data transmission / reception unit 51, a presentation unit 61, a sound recording unit 62, an evaluation unit 63, a display unit 71, a sound output unit 72, and a sound input unit 73. Consists of. Each functional unit included in the terminal device 2 can also be realized by using, for example, a computer and a program. In addition, each functional unit has a storage means, if necessary. The storage means is, for example, a variable on the program or a memory allocated by executing the program. Further, if necessary, a non-volatile storage means such as a magnetic hard disk device or a solid state drive (SSD) may be used. Further, at least a part of the functions of each functional unit may be realized not as a program but as a dedicated electronic circuit. The terminal device 2 can be realized by, for example, a device such as a PC, a tablet terminal, a smartphone, or a wristwatch-type terminal, and a program running on those devices. The functions of each functional unit constituting the terminal device 2 are as follows.

The data transmission / reception unit 51 transmits / receives data to / from an external device by communication. Specifically, the data transmission / reception unit 51 receives the data transmitted from the server device 1 and transmits the data to the server device. The data received by the data transmission / reception unit 51 from the server device 1 includes karaoke data and score data. The data transmitted by the data transmission / reception unit 51 to the server device 1 includes sound source data of a specific part of the music and evaluation data related to the sound source data (evaluation result by the evaluation unit 63).

That is, the data transmission / reception unit 51 functions as a data reception unit for receiving karaoke data and musical score data. The data transmission / reception unit 51 also functions as a data transmission unit for transmitting sound source data and machine evaluation data (evaluation result by the evaluation unit 63).

The presentation unit 61 presents the karaoke data and the score data received from the server device 1 to the user. The presentation unit 61 causes the sound output unit 72 to output a sound based on the karaoke data. Further, the presentation unit 61 causes the display unit 71 to display a score or the like based on the score data. Based on the information presented by the presentation unit 61, the user of the terminal device 2 can sing, play a musical instrument, or the like. That is, the presentation unit 61 presents the karaoke data as sound and presents the score based on the score data on the screen as visual information.

The sound recording unit 62 records the sound input from the sound input unit 73. The sound recording unit 62 appropriately encodes the sound and records it as data in WAV format, MPEG format, or the like. Specifically, the sound recording unit 62 records the sound of the performance or singing of a specific part of the music as sound source data. That is, the sound recording unit 62 records the sound acquired from the outside as sound source data in accordance with the presentation of the karaoke data by the presentation unit 61.

The evaluation unit 63 performs machine evaluation of sound source data (data recording musical instrument performance, singing, etc. by the user of the terminal device 2). The evaluation unit 63 outputs data (also referred to as machine evaluation data) as a result of machine evaluation. The data of the result of the machine evaluation can be passed to the server device 1 side and stored on the server device 1 side, for example, when posting sound source data. Specifically, the evaluation unit 63 performs mechanical evaluation of the sound source data based on, for example, the accuracy of the pitch and the accuracy of the time signature. The evaluation unit 63 compares, for example, the pitch and time signature of the correct answer based on the score data with the pitch and time signature of the recorded sound source data, and evaluates based on the distance between the two. The closer the distance between the two, the higher the evaluation (indicating that the performance or singing is good) is given to the sound source data by the evaluation unit 63. On the contrary, the farther the distance between the two is, the lower the evaluation (indicating that the performance or singing is not good) is given to the sound source data by the evaluation unit 63. As an example, the evaluation unit 63 compares the pitch, time signature, etc. of the two at the timing of a predetermined evaluation point in the score data.

The display unit 71 visually displays information by using a display device (liquid crystal display or the like) possessed by the terminal device 2. The display unit 71 displays, for example, a score based on the score data.

The sound output unit 72 outputs sound from a speaker, earphones, or the like. The sound output unit 72 outputs, for example, a karaoke sound based on karaoke data.

The sound input unit 73 acquires sound from the outside. The sound input unit 73 includes a microphone. Alternatively, the sound input unit 73 is connected to an external microphone.

Next, the structure of the data held by the database 30 will be described with reference to FIGS. 3, 4, 5, 6, 6, 7, 8, and 9.

FIG. 3 is a schematic diagram showing an example of the configuration of the music management table included in the management information storage unit 35 in the database 30. As shown in the figure, the music management table is two-dimensional tabular data, and has a music ID and music title data items. The meanings of the data in the music management table are as follows.

The song ID is identification information for uniquely identifying the song. The song IDs do not overlap. The song ID is the primary key of the song management table.

The song title is the title of the song. The song titles may be duplicated.

In the illustrated data example, the song ID of the first line is "T123456", and the song name is "Midnight Distance". Similarly, for the data in the other rows, the music management table associates the music ID with the music title.

FIG. 4 is a schematic diagram showing an example of the configuration of a karaoke table (MR table) included in the karaoke storage unit 31 in the database 30. As shown in the figure, the karaoke table is two-dimensional tabular data, and has a song ID, a part ID, a part, and karaoke data items. The meanings of the karaoke table data are as follows.

The song ID is as described in the description of the song management table.

The part ID is identification information for uniquely identifying a part in a musical piece. A piece of music usually contains a plurality of parts. One part is usually for one type of instrument or vocal. There may be multiple parts of an instrument or vocal (eg lead guitar and side guitar).

A part is data that indicates the part in words. Examples of parts are "keyboard", "drums", "percussion", "bass", "guitar", "saxophone", "trumpet", "vocals" and the like.

Karaoke data is sound data recording karaoke performances. Karaoke data exists for each part. The karaoke data is usually a recording of a performance that does not include the performance of the target part. In addition to the karaoke performance of a musical instrument or the like, the karaoke data may include a sound for assisting the performance of the target part (for example, a sound representing a time signature) or the like.

In the illustrated data example, the song ID is "P123458", the part ID is "P1001", and the part name is "vocal 1" in the data of the first line. Further, the karaoke sound data for the part is stored in the karaoke item of the data in the first line. Similarly, the data in the other rows holds the karaoke data in association with the song ID, the part ID, and the part for the specific part of the specific music.

FIG. 5 is a schematic diagram showing an example of the configuration of the score table included in the score storage unit 32 in the database 30. As shown in the figure, the score table is two-dimensional tabular data, and has a song ID, a part ID, a part, and a score data item. The meanings of the data in the score table are as follows.

The song ID, the part ID, and each data item of the part are as described with respect to the karaoke table (FIG. 4).

The score data is data for displaying information such as a score on the screen of the terminal device 2. The format of the musical score data can be designed as appropriate. As an example, XML may be used to construct musical score data. The score is displayed on the screen using, for example, a staff notation. However, a score in a format other than the staff notation may be displayed. The musical score data includes scale information, rhythm information, rest information, and other information for playing.

In the illustrated data example, the song ID is "P123458", the part ID is "P1001", and the part name is "vocal 1" in the data of the first line. Further, in the item of the score of the data in the first line, data representing the information of the score for the part is stored. Similarly, the data in the other rows holds the data of the musical score in association with the song ID, the part ID, and the part for the specific part of the specific music.

FIG. 6 is a schematic diagram showing an example of the configuration of the acquired sound source table included in the acquired sound source storage unit 33 in the database 30. As shown in the figure, the acquired sound source table is two-dimensional tabular data, and has a song ID, a part ID, a user ID, an acquisition date and time, a sound source ID, and data items of the acquired sound source. The meanings of the data in the acquired sound source table are as follows.

The song ID and part ID are as described above.

The user ID is the ID of the user who posted the sound source data. The user ID is identification information for uniquely identifying each of a large number of users who use the terminal device 2. Different users have different user IDs.

The acquisition date and time is the date and time when the server device 1 acquired the sound source data. The acquisition date and time may be the same as the date and time when the user posted the sound source data. The acquisition date and time is expressed in the format of, for example, "YYYY / MM / DD hh: mm: ss" (year / month / day, hour / minute / second).

The sound source ID is identification information for uniquely identifying the sound source data. When the user posts the sound source data, the sound source ID is assigned to the sound source data.

The acquired sound source is the sound source data itself surrendered by the user. In the item of the acquired sound source, sound data encoded in a format such as an MPEG format or a WAV format is stored.

In the illustrated data example, the song ID is "T123458", the part ID is "P1001", the user ID is "U980001", and the acquisition date and time is "2020/06/25 16:01:38" in the data of the first line. , The assigned sound source ID is "D112901". Further, in the column of the acquired sound source of the data in the first line, the sound source data associated with these song IDs, part IDs, user IDs, acquisition dates and times, and sound source IDs are stored. This sound source data is data in a format such as a WAV format or an MPEG format. The data in the other rows also holds the sound source data posted by the user and the related data with respect to a specific part of a specific music.

FIG. 7 is a schematic diagram showing an example of the configuration of the sound source evaluation table included in the management information storage unit 35 in the database 30. As shown in the figure, the sound source evaluation table is two-dimensional tabular data, and includes sound source ID, machine evaluation, judge evaluation, user evaluation, number of likes, number of playbacks, and playback time. Has data items for comprehensive evaluation. The meanings of the data in the sound source evaluation table are as follows.

The sound source ID is as described above. The sound source evaluation table is associated with other tables by the sound source ID. The sound source evaluation table holds data about the evaluation of each sound source posted by the user.

Machine evaluation, judge evaluation, user evaluation, number of likes, number of playbacks, playback time, and comprehensive evaluation items are areas for storing data for each evaluation item, respectively. Machine evaluation represents evaluation by a machine (computer and program). Specifically, the machine evaluation may store the evaluation data output by the evaluation unit 63 of the terminal device 2. The machine evaluation may store the result of the machine evaluation calculated in the server device 1 instead of the evaluation unit 63 of the terminal device 2. The auditor evaluation stores the evaluation result data transmitted by the auditor from his / her own terminal device or the like to the server device 1. The user evaluation stores the evaluation result data transmitted from the terminal device 2 to the server device 1 by a general user, not a judge. The item of the number of likes (number of FAVs) stores data representing the total number of times a general user presses the "like" button, for example, when the sound source data is played back on the terminal device 2. The item of the number of times of reproduction stores data representing the total number of times that general users have reproduced the sound source data on, for example, the terminal device 2. The reproduction time item stores data representing the total reproduction time (for example, expressed in seconds or the like) when a general user reproduces the sound source data on the terminal device 2, for example. For the items of the comprehensive evaluation, for example, the selection unit 25 calculates based on the data of other evaluation items (machine evaluation, judge evaluation, user evaluation, number of likes, number of views, playback time, etc.). Stores the data of the points of the comprehensive evaluation.

The data of the machine evaluation, the judge evaluation, the user evaluation, the number of likes, the number of reproductions, the reproduction time, and the comprehensive evaluation may be, for example, numerical data. The machine evaluation, the judge evaluation, the user evaluation, the number of likes, the number of playbacks, the playback time, and the comprehensive evaluation data are the data or signals received by the server device 1 and statistically processed them. It may be the resulting data.

In the illustrated data example, the sound source ID of the data in the first row is "D112901". The data in the first row has evaluation information of the sound source data of this "D112901". As shown in the figure, in the data in the first row, the machine evaluation is 70, the judge evaluation is 73, the user evaluation is 81, the number of likes is 808, the number of playbacks is 1123, and the total playback time is 20:04:34 ( 20 hours 04 minutes 34 seconds). The value of the comprehensive evaluation calculated by the selection unit 25 with respect to the data in the first row is 69.66. Similarly, evaluation information for each sound source data is held in the other rows.

FIG. 8 is a schematic diagram showing an example of the configuration of the selected sound source table included in the management information storage unit 35 in the database 30. As shown in the figure, the selected sound source table is two-dimensional tabular data, and has data items of a song ID, a part ID, a user ID, and a sound source ID. The meanings of the data in the selected sound source table are as follows. The selected sound source table holds information about the sound source data selected by the selection unit 25 from the sound source data collected by the server device 1.

The song ID and the part ID are as described above. By combining the song ID and the part ID, a specific part of a specific song is represented.

The sound source ID is associated with the combination of the song ID and the part ID. The sound source ID in the selected sound source table is information for specifying the sound source data selected by the selection unit 25 from the sound source data of the specific part of the specific music. The sound source ID in the selected sound source table can be associated with the sound source ID in the acquired sound source table (FIG. 6) and the sound source ID in the sound source evaluation table (FIG. 7).

The user ID is identification information for uniquely identifying the user who posted the sound source data.

In the illustrated data example, the song IDs of the data from the first row to the fourth row are all "T123458". Further, regarding the data in the first row, the part ID is "P1001", the user ID is "U980123", and the sound source ID is "D112923". Similarly, the data in the other rows holds information related to the song ID, the part ID, the user ID, and the sound source ID.

FIG. 9 is a schematic diagram showing an example of the configuration of the final sound source table of the final sound source storage unit 34 in the database 30. As shown in the figure, the final sound source table is two-dimensional tabular data, and has a song ID, a production date and time, and data items of the final sound source. The meanings of the data in the final sound source table are as follows.

The song ID is identification information for uniquely identifying the song, as described above.

The production date and time represents the date and time when the final sound source related to the music of the d was produced. The production date and time is expressed in the format of, for example, "YYYY / MM / DD hh: mm: ss" (year, month, day, hour, minute, second).

The final sound source is an item for storing the data of the sound source produced for the music. The data of the final sound source is represented by a predetermined coding method such as WAV format or MPEG format. The data of the final sound source is created by the mixing execution unit 26 by mixing a plurality of sound source data. That is, the mixing execution unit 26 mixes the sound source data specified based on the sound source ID of each part recorded in the selected sound source table (FIG. 8) for the target music, so that the final sound source of the final sound source is obtained. The data is created.

In the illustrated data example, the song ID of the data in the first line is "T123456", and the production date and time is "2020/06/21 19:00:00" (June 21, 2020 19:00:00). Is. Further, in the item of the final sound source, the data of the final sound source of the song is stored. The data of the final sound source is, for example, data in WAV format or MPEG format.

FIG. 10 is a flowchart showing a processing procedure until the server device 1 produces a final sound source. Hereinafter, it will be described according to this flowchart.

In step S11, the server device 1 prepares musical score data and karaoke data for a specific musical piece. Specifically, the sound source recruitment function unit 21 writes the karaoke data of the music into the karaoke storage unit 31 in the database 30 by the operation of the administrator or the like. Further, the sound source recruitment function unit 21 writes the musical score data of the music into the musical score storage unit 32 in the database 30.

In step S12, the sound source recruitment function unit 21 starts recruiting sound sources. Specifically, the sound source recruitment function unit 21 waits for a pre-scheduled date and time to arrive. When that date and time arrives, the sound source recruitment function unit 21 makes it possible to send a web page containing information on sound source recruitment. Information such as the song title, the part to be recruited, and the deadline date and time of the sound source is posted on the web page. It is set so that karaoke data and score data for each part can be downloaded from the web page. When the web page is published, the terminal device 2 can refer to the web page and download the karaoke data and the score data. Actually, the karaoke providing unit 22 can transmit the karaoke data read from the karaoke storage unit 31 in the database 30 to the terminal device 2. Further, the score providing unit 23 can transmit the score data read from the score storage unit 32 in the database 30 to the terminal device 2.

The terminal device 2 presents the karaoke data and the score data for a specific part of the specific music acquired from the server device 1 to the user. The terminal device 2 records the sound of the part of the music and creates sound source data. Specifically, the user of the terminal device 2 plays a musical instrument or sings a song as a vocal while watching the score data and playing the karaoke data, and the microphone connected to the terminal device 2 or the like. Record the sound using. The terminal device 2 transmits the created sound source data to the server device 1. The sound source acquisition unit 24 on the server device 1 side acquires the sound source sent from the terminal device 2 and writes it in the acquisition sound source storage unit 33 in the database 30. The sound source acquisition unit 24 writes the data of the acquired sound source in the acquisition sound source storage unit 33 in a form in which the acquired sound source is associated with the song ID, the part ID, the user ID, and the acquisition date and time. Further, the sound source acquisition unit 24 assigns a unique ID (sound source ID) to the sound source data, and writes the sound source ID in the acquisition sound source storage unit 33.

The evaluation unit 63 of the terminal device 2 evaluates the recorded sound source data. The evaluation unit 63 calculates the result of machine evaluation in association with each sound source data. The points of machine evaluation are expressed, for example, numerically. The terminal device 2 transmits the data of the point of machine evaluation to the server device 1 in association with the above sound source data. The sound source acquisition unit 24 on the server device 1 side receives the data of the point of this machine evaluation. The sound source acquisition unit 24 writes the above-mentioned machine evaluation points (numerical values) in the management information storage unit 35 in a form associated with the sound source ID of the sound source data.

In step S13, the sound source recruitment function unit 21 ends the recruitment of sound sources. Specifically, the sound source recruitment function unit 21 waits for a pre-scheduled date and time to arrive. When the date and time arrives, the sound source recruitment function unit 21 posts information indicating that the deadline has passed on the web page containing the sound source recruitment information. As a result, the terminal device 2 cannot transmit the sound source data of the application for the recruitment. Further, the sound source acquisition unit 24 on the server device 1 side stops the acquisition of the sound source data related to the recruitment.

After the sound source recruitment is completed, the selection unit 25 starts the evaluation of the sound source data acquired by the server device 1 in connection with the recruitment. The selection unit 25 receives the evaluation points by the auditor from, for example, the terminal device of the auditor and writes them in the auditor evaluation column in the management information storage unit 35. Further, the selection unit 25 receives the evaluation points by the general user from, for example, the terminal device of the general user, and writes the evaluation points in the user evaluation column in the management information storage unit 35. Further, the selection unit 25 counts the number of "likes" given by general users, and writes the "likes" in the "likes" column in the management information storage unit 35. For example, each time the information to give a "like" arrives at the server device 1 from the terminal device of a general user, the selection unit 25 counts up the value of the "like number" in the management information storage unit 35. Further, the selection unit 25 counts the number of times each sound source data has been reproduced. Specifically, for example, each time information indicating that specific sound source data has been reproduced from a terminal device of a general user reaches the server device 1, the selection unit 25 counts the value of the number of reproductions in the management information storage unit 35. Up. Further, the selection unit 25 measures the total time during which each sound source data is reproduced. Specifically, for example, when information indicating that specific sound source data has been reproduced arrives at the server device 1 from a terminal device of a general user or the like, the selection unit 25 displays information on the length of the reproduction time in each reproduction. Obtained from the terminal device 2. The selection unit 25 adds and updates the current reproduction time to the value of the reproduction time in the management information storage unit 35. In this way, the information for evaluating the sound source data is accumulated in the database 30.

Even before the evaluation is closed, the selection unit 25 may calculate the progress of the points of the comprehensive evaluation based on the latest data at that time. Further, the selection unit 25 may appropriately create ranking information of the sound source data and transmit it to the terminal device 2 side even before the evaluation is closed. Further, the selection unit 25 may transmit the information of the sound source data created by the popular user to the terminal device 2 side.

The above ranking information is, for example, a ranking based on points for each evaluation item or points for comprehensive evaluation for each song, or for each song and part. The points for each evaluation item are numerical values of points for each item such as machine evaluation, judge evaluation, user evaluation, number of likes, number of plays, and play time. By sending the ranking information generated by the selection unit 25 from the server device 1 to the terminal device 2, the ranking information is displayed on the screen of the terminal device 2. Further, the selection unit 25 has information on the user ID belonging to the "popular user" in advance. In addition, the information of the user ID belonging to the "popular user" may be updated as appropriate. The selection unit 25 creates screen information for introducing the sound source data by such a popular user based on the information of the user ID associated with the sound source data. By sending the information for introducing the sound source data by the popular user created by the selection unit 25 from the server device 1 to the terminal device 2, the information for introducing the posting of the sound source data by the popular user is displayed on the screen of the terminal device 2. Is displayed. The user of the terminal device 2 can play back specific sound source data by looking at such ranking information and information on sound source data of popular users. The terminal device 2 counts "like" information, evaluation information of the sound source data (evaluation by the user of the terminal device 2), and the number of playbacks when such specific sound source data is played. Information and information for adding the reproduction time can be transmitted to the server device 1.

In step S14, the selection unit 25 closes the evaluation of the specific music. Specifically, the selection unit 25 waits for a pre-scheduled date and time to arrive. When that date and time arrives, the selection unit 25 closes the new evaluation. This freezes the data for evaluation at least once. That is, the data such as the machine evaluation, the judge evaluation, the user evaluation, the number of likes, the number of reproductions, and the reproduction time in the management information storage unit 35 of the database 30 are not updated at least once. The selection unit 25 controls the database 30 so that these data are not updated.

In step S15, the selection unit 25 carries out a comprehensive evaluation of sound source data for a specific musical piece. Specifically, the selection unit 25 is a point of comprehensive evaluation for each sound source data based on numerical values of points for each evaluation item such as machine evaluation, judge evaluation, user evaluation, number of likes, number of playbacks, and playback time. Is calculated. The selection unit 25 calculates a weighted sum (or weighted average) of the point values of these plurality of evaluation items and uses them as points for comprehensive evaluation. The weight values for each evaluation item at this time are as described above. The selection unit 25 creates ranking information of points for comprehensive evaluation for each part of the music to be produced. The selection unit 25 selects and adopts the sound source data of the music having a higher overall evaluation for each part. For example, the selection unit 25 may select the sound source data at the highest level of the comprehensive evaluation for each part. Alternatively, the selection unit 25 may select sound source data other than the highest level of the comprehensive evaluation for each part.

In step S16, the mixing execution unit 26 performs mixing processing of the sound source data of each part of the music to be produced. As described above, the sound source data is configured to be synchronized between the parts. The mixing execution unit 26 reproduces the sound source data of each part and performs the mixing process while synchronizing the parts. At this time, the mixing execution unit 26 may mix the sound source data of a plurality of parts to obtain the sound source data (final sound source data) of one channel. Further, the mixing execution unit 26 has a multi-channel sound source data (2 channels, 5.1 channels, 22.2 channels, etc.) while ensuring that the sound source data of each part is arranged at a predetermined position in the sound image space. It may be the final sound source data). Further, the mixing execution unit 26 may create multi-channel sound source data (final sound source data) so that the sound source data of each part becomes the data of independent channels. The process itself of mixing a plurality of sound source data can be executed by the existing technique.

As described above, the mixing execution unit 26 creates the final sound source data by the mixing process and writes it in the final sound source storage unit 34 of the database 30. The final sound source data is created based on the sound source data selected by the selection unit 25. In other words, the final sound source data is created by mixing sound source data with a high evaluation value (comprehensive evaluation value).

In step S17, the mixing execution unit 26 starts distribution of the final sound source. Specifically, the mixing execution unit 26 waits for a predetermined date and time to arrive. When that date and time arrives, the mixing execution unit 26 makes the final sound source data available for transmission. As a result, the terminal device 2 can download the final sound source data or receive and play the final sound source data by stream distribution, for example, based on a link from a web page for listening to a predetermined final sound source data. can. In this way, the user of the terminal device 2 can enjoy the final sound source by the highly evaluated performance (including vocals).

In the above processing procedure, the procedure up to the generation of the final sound source data for one musical piece has been described. However, the server device 1 may simultaneously proceed with solicitation of sound source data, selection of sound source data, mixing processing, provision of final sound source data, and the like for a plurality of songs.

FIG. 11 is a block diagram showing an example of the internal configuration of each device such as the server device 1 and the terminal device 2 of the present embodiment. Each device can be realized using a computer. As shown in the figure, the computer includes a central processing unit 901, a RAM 902, an input / output port 903, input / output devices 904 and 905, and a bus 906. The computer itself can be realized using existing technology. The central processing unit 901 executes an instruction included in a program read from RAM 902 or the like. The central processing unit 901 writes data to RAM 902, reads data from RAM 902, and performs arithmetic operations and logical operations according to each instruction. The RAM 902 stores data and programs. Each element contained in the RAM 902 has an address and can be accessed using the address. RAM is an abbreviation for "random access memory". The input / output port 903 is a port for the central processing unit 901 to exchange data with an external input / output device or the like. The input / output devices 904 and 905 are input / output devices. The input / output devices 904 and 905 exchange data with the central processing unit 901 via the input / output ports 903. Bus 906 is a common communication path used inside a computer. For example, the central processing unit 901 reads and writes data in the RAM 902 via the bus 906. Further, for example, the central processing unit 901 accesses the input / output port via the bus 906.

It should be noted that at least a part of the functions of the server device 1 and the terminal device 2 in the above-described embodiment can be realized by a computer program. In that case, a program for realizing this function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by a computer system and executed. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. The "computer-readable recording medium" is a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, a DVD-ROM, or a USB memory, or a storage device such as a hard disk built in a computer system. That means. Furthermore, a "computer-readable recording medium" is a device that temporarily and dynamically holds a program, such as a communication line when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In that case, it may include a program that holds a program for a certain period of time, such as a volatile memory inside a computer system that is a server or a client. Further, the above-mentioned program may be for realizing a part of the above-mentioned functions, and may be further realized for realizing the above-mentioned functions in combination with a program already recorded in the computer system.

Although the embodiments have been described above, the present invention can be further implemented in the following modifications.

First modification: In the above embodiment, the evaluation unit 63 in the terminal device 2 is performing the machine evaluation of the sound source data. As a modification, the machine evaluation of the sound source data may be performed in the server device 1. In this case, the sound source data transmitted from the terminal device 2 is received by the sound source acquisition unit 24 and stored in the acquisition sound source storage unit 33 of the database 30. The evaluation unit in the server device 1 performs machine evaluation of the sound source data written in the acquired sound source storage unit 33. Then, the evaluation unit writes the data of the result of the machine evaluation in the sound source evaluation table (FIG. 7) of the management information storage unit 35.

Second variant example: In the above embodiment, the server device 1 solicits sound source data for each musical instrument or vocal part. Further, the terminal device 2 posted the sound source data for each musical instrument or vocal part. In other words, one part corresponded to one kind of instrument or vocal. In this modification, one part may include the performance of a plurality of types of musical instruments. Also, one part may include both playing an instrument and singing vocals.

Third modification: In the above embodiment, the sound source acquisition unit 24 of the server device 1 acquires a plurality of sound source data for each part at mutually independent timings. In this modification, the sound source acquisition unit 24 acquires sound source data from a plurality of terminal devices 2 all at once for a specific musical piece or a specific part.

Fourth Modification Example: In the above embodiment, the selection unit 25 of the server device 1 selects the representative sound source data representing the part from only the sound source data acquired from the terminal device 2. In this modification, the selection unit 25 performs not only the sound source data posted from the terminal device 2 but also the sound source data (posted) prepared in advance on the server device 1 side for at least one part in the music. The sound source data of a professional performance prepared in advance may be selected as the representative sound source data instead of the prepared sound source data. Further, the server device 1 may use the terminal device 2 for at least one part in the music. The sound source data prepared in advance (for example, the sound source data of a professional performance) may be selected as the representative sound source data without soliciting the sound source data from.

Fifth modification: The karaoke data and the sound source data do not have to include information for playback synchronization between parts. Karaoke data and sound source data are sampled and recorded at a predetermined sampling frequency, and if the sampling frequency can be reproduced in the playback situation, it is possible to synchronize the parts with a sufficiently small error. ..

Although the embodiments of the present invention have been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs and the like within a range that does not deviate from the gist of the present invention.

The present invention can be used, for example, in a system for a large number of users to enjoy playing music via a communication network such as the Internet. However, the scope of use of the present invention is not limited to those exemplified here.

1 Server device (music production device)
2 Terminal device 10 Terminal interface section 21 Sound source recruitment function section 22 Karaoke provider section 23 Score provider section 24 Sound source acquisition section 25 Selection section 26 Mixing execution section 30 Database 31 Karaoke storage section 32 Score storage section 33 Acquisition sound source storage section 34 Final sound source storage Unit 35 Management information storage unit 51 Data transmission / reception unit (data reception unit, data transmission unit)
61 Presentation unit 62 Sound recording unit 63 Evaluation unit 71 Display unit 72 Sound output unit 73 Sound input unit 901 Central processing unit 902 RAM
903 I / O ports 904,905 I / O devices 906 buses

The sound source recruitment function unit 21 presents information to the terminal device 2 to the effect that a sound source is recruited. Specifically, the sound source recruitment function unit 21 transmits the recruitment information to be displayed on the terminal device 2 to the terminal device 2.

The acquired sound source is the sound source data itself posted by the user. In the item of the acquired sound source, sound data encoded in a format such as an MPEG format or a WAV format is stored.

The production date and time represents the date and time when the final sound source related to the music was produced. The production date and time is expressed in the format of, for example, "YYYY / MM / DD hh: mm: ss" (year, month, day, hour, minute, second).

Claims (13)

The karaoke provider that provides karaoke data for each part of the song to the outside,
A sound source acquisition unit that acquires and stores sound source data for each part corresponding to the karaoke data, and
A selection unit that selects representative sound source data representing the part from the sound source data acquired by the sound source acquisition unit, and a selection unit.
A mixing execution unit that creates final sound source data that is sound source data including the plurality of parts by mixing the representative sound source data selected by the selection unit for each of the plurality of parts constituting the music.
A music production device equipped with. The part is a musical instrument part or a singing part for composing the music.
The music production device according to claim 1. The sound source acquisition unit acquires the sound source data for each part at independent timings for each part.
The music production device according to claim 1 or 2. A score providing unit that provides score data for each part of the music to the outside.
Further prepare
The sound source acquisition unit acquires the sound source data for each part corresponding to the score data.
The music production device according to any one of claims 1 to 3. The selection unit is
Machine evaluation, which is an evaluation result showing the accuracy of the sound source data when the correct answer is used as a reference, by comparing the pitch and time signature of the sound source data with the pitch and time signature of the correct answer.
The judge's evaluation, which is the evaluation result received from the judge's terminal device regarding the sound source data,
The user evaluation, which is the evaluation result received from the user's terminal device with respect to the sound source data,
The number of "likes" based on the number of "likes" transmitted from the user's terminal device regarding the sound source data, and the number of "likes"
The number of times the sound source data has been played back on the user's terminal device as the evaluation result, and the number of times the sound source data has been played back.
The playback time based on the total time that the sound source data was played back on the user's terminal device as the evaluation result, and
The representative sound source data representing the part is selected based on the evaluation result of at least one of the above.
The music production device according to any one of claims 1 to 4. The selection unit is comprehensive based on at least two evaluations of the machine evaluation, the judge evaluation, the user evaluation, the number of "likes", the number of reproductions, and the reproduction time. The evaluation is calculated, and the representative sound source data representing the part is selected based on the calculated comprehensive evaluation.
The music production device according to claim 5. The sound source data is sound data recording the performance or singing of the user of the terminal device to which the karaoke data is provided.
The selection unit selects the representative sound source data representing the part from only the sound source data acquired from the terminal device.
The music production device according to any one of claims 1 to 6. The karaoke data includes a synchronization signal for playback synchronization between parts.
The sound source data inherits and has the synchronization signal included in the karaoke data.
The mixing execution unit mixes a plurality of the representative sound source data while maintaining reproduction synchronization between the parts based on the synchronization signal of the representative sound source data.
The music production device according to any one of claims 1 to 7. The mixing execution unit makes it possible to transmit the created final sound source data via the Internet.
The music production device according to any one of claims 1 to 8. The karaoke provision process in which the karaoke provision department provides karaoke data for each part of the music to the outside,
The sound source acquisition process in which the sound source acquisition unit acquires and accumulates the sound source data for each part corresponding to the karaoke data, and
A selection process in which the selection unit selects representative sound source data representing the part from the sound source data acquired by the sound source acquisition unit.
The mixing execution unit mixes the representative sound source data selected by the selection unit for each of the plurality of parts constituting the music, thereby creating the final sound source data which is the sound source data including the plurality of parts. Execution process and
Music production method including. The karaoke provider that provides karaoke data for each part of the song to the outside,
A sound source acquisition unit that acquires and stores sound source data for each part corresponding to the karaoke data, and
A selection unit that selects representative sound source data representing the part from the sound source data acquired by the sound source acquisition unit, and a selection unit.
A mixing execution unit that creates final sound source data that is sound source data including the plurality of parts by mixing the representative sound source data selected by the selection unit for each of the plurality of parts constituting the music.
A program that makes a computer function as a music production device equipped with. The karaoke provider that provides karaoke data for each part of the song to the outside,
A sound source acquisition unit that acquires and stores sound source data for each part corresponding to the karaoke data, and
A selection unit that selects representative sound source data representing the part from the sound source data acquired by the sound source acquisition unit, and a selection unit.
A mixing execution unit that creates final sound source data that is sound source data including the plurality of parts by mixing the representative sound source data selected by the selection unit for each of the plurality of parts constituting the music.
A computer-readable recording medium that records a program that makes the computer function as a music production device. A data receiver that receives karaoke data and score data,
A presentation unit that presents the karaoke data as sound and presents a score based on the score data as visual information on the screen.
A sound recording unit that records sound acquired from the outside as sound source data in accordance with the presentation of the karaoke data by the presentation unit, and a sound recording unit.
An evaluation unit that evaluates the sound source data and outputs machine evaluation data,
A data transmission unit that transmits the sound source data and the machine evaluation data,
A terminal device comprising.

Images