KR920007206B1 - Automatic Receiving Method and Apparatus - Google Patents

Abstract

No content.

Description

Automatic Receiving Method and Apparatus

1 is an input processing flowchart of an acoustic signal processed by one of the embodiments of the present invention.

2 is a block diagram of the automatic receivable method applying the present invention.

3 is a flow chart of automatic receivable processing.

4 is a flowchart of segmentation processing based on measure information and power information generated by the automatic receiving method.

5 is a flowchart showing in more detail the segmentation process based on the measure information and the power information.

6 is a characteristic curve diagram showing an example of segmentation.

7 is a block diagram of another embodiment of the automatic receivable method.

* Explanation of symbols for main parts of the drawings

1: CPU 2: Bus

3: main memory 4: key board

5: display device 6: auxiliary storage device

7: A / D converter 8: Sound signal input device

9: speaker drive unit 10: speaker

11 amplification circuit 12 pre-filter

13: A / D Converter 14: Signal Processing Processor

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention generally relates to automatic voting, and more particularly, to an automatic voting method (method and apparatus) for producing sheet music data from sound signals.

These sound signals may include singing voices, humming voices, and musical instrument sounds. Automatic collection method converts acoustic signals such as singing voice, humming voice and instrument sound into sheet music data.

Such a method requires that basic information such as, for example, sound field, pitch, tone, beat and tempo can be detected from the sound signal. Since the sound signal is only a signal that contains a waveform in which the basic waveform is repeated continuously, it is not possible to directly obtain the basic information necessary for producing the sheet music data from the sound signal.

In the conventional automatic receiving method, each piece of information is obtained by the following series of steps.

In the conventional automatic receiving method, each piece of information is obtained by the following series of steps.

(a) information on repetition of the fundamental waveform representing the pitch of the acoustic signal (hereinafter referred to as pitch information) and power information of the signal are extracted at each branch period, and (b) thereafter, extracted as such. On the basis of the pitch information and the power information, the sound signal is divided into segments (segments) which can be regarded as forming the same pitch (this process is called segmentation) (c) Next, the pitch of a specific segment Determine the pitch of each segment with respect to the absolute pitch axis based on the information, and determine the tune of the acoustic signal based on the pitch information thus determined; (d) thereafter, based on the segment the beat of the sound signal and Determine the tempo.

However, even when using a conventional auto-receiving method, the beat and tempo are determined, so the user eventually sings or plays the desired song while he / she matches the tempo with the beat. However, this behavior is difficult for users who are not accustomed to playing or singing. Moreover, there are users who like to play musical instruments or sing songs while adjusting the tempo with the metronome.

In addition, since the fluctuation in power and pitch is present in the sound signal inputted by the user playing the song or singing a song while adjusting the tempo or time signature, the power information or the pitch information is used. Again, it was difficult to perform segmentation.

The segmentation line is an important element for creating the music score data. When the segmentation degree is low, the degree of the score data finally obtained is also significantly lowered. Therefore, it is desirable to improve the degree of segmentation.

The present invention provides an automatic hiring method (method and apparatus) that is easier to use than the conventional method. In addition, the scheme according to the present invention provides a higher degree of segmentation than can be obtained in conventional schemes.

In the first aspect of the present invention, there is provided a method of capturing and storing an audio signal in a memory while notifying the input auxiliary rhythm information including at least a tempo by audio or visual processing. A process of extracting the sound signal and storing it in the memory, and then extracting power information of the sound signal, pitch information representing the repetition period of the waveform and the pitch of the sound from the sound signal stored in the memory, pitch information and Segmentation processing for dividing the acoustic signal into sections considered equal pitch on the basis of power information and pitch identification processing for identifying pitches on the absolute pitch axis as pitches of this divided section based on pitch information It is combined with an automatic recruitment method for converting an acoustic signal into sheet music data.

This method is designed to give input auxiliary information by audible or visual processing to the user, so that when the user captures, accepts and stores the sound signal in memory for the purpose of performing the processing, the sound signal is generated. Simple and easy to make.

In the second aspect of the present invention, an automatic recruitment scheme similar to that of the first aspect of the present invention is provided. However, in the present scheme, input auxiliary rhythm information is also stored on the same time axis when capturing an acoustic signal and storing it in a memory. In addition, the first process of dividing the segmentation process into sections that can be regarded as the same pitch based on the input auxiliary rhythm information stored in the memory, and the sound signal based on the pitch information and the power information The second process divided into sections which can be regarded as ", and the third process arranged into sections divided by the first process and the second process.

Since the present scheme uses input auxiliary rhythm information, the degree of segmentation processing can be improved. In other words, the present method captures and stores the sound signal in the memory and also stores the input auxiliary rhythm information in the memory.

Thereafter, the present method performs segmentation processing based on this input auxiliary rhythm information, segmentation processing based on power information and pitch information, and summarizes the result as the segmentation processing.

According to a third aspect of the present invention, there is provided a method including an input auxiliary rhythm notification device in which input auxiliary rhythm information including at least tempo information is notified by an audio processing or a visual processing when an acoustic signal is captured and stored in a memory. This method comprises a device for capturing and incorporating sound signals, a device for storing the received sound signals in a memory, pitch information indicating the repetition period and pitch of the sound signals stored in the memory, and power from the sound signals. A pitch extraction unit for extracting information, a segmentation apparatus for dividing the sound signal into sections that can be kept at the same pitch based on the pitch information and power information, and an absolute pitch on the absolute signal axis of the divided section At least a part of the pitch identification device for determining the pitch is included in the automatic recruitment method to convert the sound signal into the score data The.

This method is designed so that the input auxiliary rhythm notifying device notifies the input auxiliary rhythm information by an audio process or a visual process when an acoustic signal is captured and stored in the memory. As a result of this, the user can perform an input operation based on the input auxiliary rhythm information, thereby making it easier to input a signal.

In the fourth aspect of the present invention, when an acoustic signal is captured and processed to be stored in the memory, a storage device designed to store the degree of input auxiliary rhythm in the memory on the same time axis is also included in the input auxiliary rhythm information stored in the memory. A first division part for dividing the sound signal into sections that can be regarded as the same pitch based on a second part, a second division part for dividing the sound signal into sections that can be regarded as the same pitch based on pitch information and power information; There is provided a manner in which a segmentation device composed of a third division part for arranging sections divided by the first and second division parts is installed.

The storage device for storing the sound signal in the memory stores the input auxiliary rhythm information notified from the input auxiliary rhythm notifying device in the memory on the same time axis when the captured sound signal is stored in the memory. The division unit is designed to perform segmentation processing based on the input notification rhythm information, and the third division unit organizes the segmentation results based on the result of the segmentation processing, the pitch information and the power information performed by the second division unit.

As a result, the degree of segmentation can be improved.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

[Automatic Rewarding Method]

2 is a block diagram of an automatic receiving method to which the present invention is applied.

The central processing unit (CPU) 1 performs total control of the entire apparatus. The CPU 1 executes the sound signal input program shown in the flowchart of FIG. 1 and the chaebo processing program shown in the flowchart of FIG. The sound signal input program and the pay signal processing program are stored in the main memory device 3 connected to the CPU 1 via the bus 3. In addition, the bus 2 includes a key board 4 as an input device, a display device 5 as an output device, an auxiliary storage device 6 used as a working memory, and an analog / digital (A / D) converter 7; Connected. The A / D converter 7 is connected to an acoustic signal input device 8 composed of a microphone or the like.

The acoustic signal input device 8 captures an acoustic signal such as a singing voice, a humming voice, and an instrument sound generated by a musical instrument, converts the acoustic signal into an electrical signal, and then outputs the electrical signal to the A / D converter 7. . In addition, a speaker drive unit 9 for driving the speaker 10 is connected to the bus 2.

The speaker 10 generates a discrete input auxiliary rhythm representing a predetermined time and tempo under the control of the CPU 1 when necessary.

The CPU 1 operates to input a sound signal in accordance with the sound signal input program shown in the flowchart in FIG. 1, and this signal is stored in the main memory device 3. As shown in FIG. When a specific beat and tempo are instructed by the key board 4, and a command for inputting an acoustic signal is input, the input sound signal is sequentially stored in the auxiliary memory device 6. In addition, the input auxiliary rhythm information is temporarily stored in the auxiliary memory device 6. When the input of the sound signal is finished, the CPU 1 executes a retrieval processing program (shown in the flowchart in Fig. 3) stored in the main memory device 3 to convert the input sound signal into a music player and then needs it. The data is output to the display device 5 accordingly.

[Input of sound signal]

1 is a flowchart of a process for inputting an acoustic signal.

When the CPU 1 accepts an instruction for instructing the input mode via the key board 4, the CPU 1 starts execution to the program shown in the flowchart in FIG. First, a prompt prompting the user to input the beat information is displayed on the display device 5, and the beat information input by the user via the key board 4 is taken in the prompt.

Thereafter, the display device 5 displays a prompt port for the user to input tempo information, and the tempo information is taken in from the user according to the prompt port (steps SP1 and SP2), after which the CPU 1 transmits time signature information. The operation is performed to determine the period and intensity of the input auxiliary rhythm information based on the tempo information, and awaits the input of the input start command from the key board 4 (steps SP3 and SP4).

When an input start command is given by the user, the CPU 1 generates an input auxiliary rhythm from the speaker 10, and thereafter, which measure indicates the start of the input auxiliary rhythm. If the rhythm sound supports the start of the measure, the CPU 1 stores the sound in the auxiliary memory device 6, and then the sound signal input device 8 and the A / D converter ( A sound signal consisting of the digital signal processed through 7) is taken in. However, when the rhythm sound does not instruct the start of the measure, the CPU 1 immediately inputs an acoustic signal frame (steps 1 SP5-SP8). Thereafter, the CPU 1 stores the input sound signal in the auxiliary memory device 6 (step SP9).

When the data set of the sound signals is stored in the auxiliary memory device 6, the CPU 1 judges whether or not the input end command is given via the key board 4, and when the end command is given, the CPU ( 1) stops a series of operations. However, when no end instruction is given, the CPU 1 further determines whether or not the timing of generation of the input auxiliary rhythm sound is set (steps SP10 and SP11). If the rhythm sound is not generated timing, the CPU 1 returns to step SP8 and proceeds to a step of taking in an acoustic signal.

On the other hand, if it is a timing which generate | occur | produces an input auxiliary rhythm sound, CPU1 will return to step SP5 and will move to the next input auxiliary rhythm sound generation step.

In this way, while generating the auxiliary auxiliary rhythm, the auxiliary storage device 6 is stored in the auxiliary storage device 6 together with an indication indicating the start of the slicing of the sound signal generated by the user. Since the input auxiliary rhythm sound is generated, it is easy for the user to input the sound signal.

[Collective processing]

3 is a flow chart of automatic recruitment processing, which is not executed until after the sound signal is input. First, the CPU 1 extracts the pitch information of the sound signal at each analysis period by using autocorrelation analysis of the sound signal, and processes the sound signal to obtain a square sum, thereby processing the sound signal at each analysis period. Extract power information.

Thereafter, the CPU 1 executes various preprocessing, for example, preprocessing such as noise reduction or smoothing processing (steps SP21 and SP22). Thereafter, the CPU 1 divides the input sound signal into predetermined sections based on the indications of each cut-off time stored in the auxiliary storage device 6, and examines the sections based on the change in power. The sections are separated in order to create segments that can be regarded as representing (steps SP23, SP24). Next, the CPU 1 calculates the deviation amount of the pitch axis held by the acoustic signal with respect to the absolute pitch axis based on the distribution state of the pitch information, shifts the obtained pitch information according to the deviation amount, and bullfights. The tuning process is executed (step SP25).

That is, the CPU 1 corrects the pitch information so that the difference between the pitch axis and the absolute pitch axis of the singer or musical instrument that generated the sound signal is small.

In this way, the CPU 1 identifies the pitch of the segment based on the pitch information obtained by the above-described segmentation process, and the pitch of the segment is determined by the pitch on the absolute pitch axis determined to be closest. The segmentation process is executed again based on whether or not the pitch of the segments is the same (steps SP26 and SP27).

Thereafter, the CPU 1 calculates the product sum of the frequency of appearance of the pitch obtained by counting the pitch information after tuning and the predetermined weighting coefficient determined according to the pair, and the maximum value information of the sum of the product On the basis of the above, for example, a set of tunes of the input sound signal is determined, for example, in a major or a malleable note, and the pitch is checked in detail with respect to the pitch information in relation to the predetermined pitch on the scale in the determined set to check and correct the pitch. (Step SP28, SP29).

Next, the CPU 1 performs the final segmentation by reviewing the segmentation result based on whether or not the finally determined pitch contains the same segment continuously or whether there is a change in power in the successive segment ( Step SP30).

After the pitch and the segment (i.e., the length of the sound) are determined in this manner, the CPU 1 finally organizes the information including the beat information and tempo information input when the sound signal is input, and finally obtains the sheet music data. Write.

Segmentation Based on Measure Information and Power Information FIG. 4 is a flowchart showing segmentation processing based on the measure information and power information generated by the present method, and FIG. 5 is a flowchart showing the segmentation processing based on the measure information and power information in more detail.

Hereinafter, steps SP23 and SP24 in FIG. 3 will be described in detail with reference to the flowcharts of FIGS. 4 and 4 in the segmentation processing based on the predetermined information and power information of the acoustic signal.

Here, FIG. 4 is a flowchart illustrating such processing at the functional level, and FIG. 5 is a flowchart illustrating in more detail what is shown in FIG. The acoustic signal is squared for each sampling point in the analysis period, and the sum of these squared values is used as power information of the acoustic signal in the analysis period.

First, the outline of this segmentation is demonstrated with reference to FIG. For explanation, assume that four beats are selected as the measure of the signal. Of course, the present invention is not limited to this assumption. This assumption is only for facilitating the explanation of the present invention.

The CPU 1 extracts the measure start indications stored in the auxiliary memory device 6, divides each measure into four quarters, and attaches a beat start indication to the beginning of each equal division (step SP40). If three beats are selected rather than four beats, measure is divided into three. Next, the CPU 1 divides each obtained beat section into four equal parts and attaches a start indication of a tenth note to the head of each divided section (step SP41).

In this way, the acoustic signal is divided into 16 per measure based on the measure information. If three beats are selected instead of four beats, one subcution is divided into 12. The CPU 1 then examines these divisions based on the power information. In addition, when the user changes the pitch, that is, changes the power so as to shift to the next sound, the power information is reflected in the segmentation process.

Subsequent to the above process, the CPU 1 extracts a rising point of the power information, attaches a mark indicating the winning point to an appropriate position, and takes the indication of the start of the sixteenth note closest to each winning point. 16th note start marks are attached to the winning points (steps SP42 and SP43).

The reason for this is that even if an input auxiliary rhythm is generated and an acoustic signal is input, it is practically difficult for the user to completely change the sound in accordance with the timing. This is because the judgment of whether or not the interval of is a rest period is executed correctly.

Next, the CPU 1 counts the number of pitch information in each sixteenth note section, and attaches a mark indicating the start of rest to the beginning of the section whose number is less than the threshold value. (Step SP44)

Finally, the CPU 1 attaches a mark indicating the start of the segment to a point at which there are indications such as the start of cutting, the starting point, the stop of starting, and the like (step SP45). The indication of the start of the segment is also attached at the beginning of the measure because one note spans two measures, and in this case, the music compensation is performed by adding a note to each measure.

In this way, a plurality of segments divided based on the measure information and the power information are obtained.

Even if the segment obtained by this segmentation process is inadequate, it becomes appropriate by the above-mentioned segmentation (step SP27, SP30 of FIG. 3) performed in the next step.

Next, this processing will be described in more detail with reference to the flowchart of FIG. The CPU 1 clears the parameter i, which indicates each analysis cycle (hereinafter referred to as an analysis point because the analysis cycle is very short) to 0, and then analyzes the analysis point data (pitch information and power information to be processed). ), And it is judged whether or not a mark at the time of cutting is attached to the analysis point (steps SP50-SP52). In the case where there is no display, the CPU 1 increases the analysis point parameter i and returns to the above-described step SP51. However, in the case where there is a display, the CPU 1 is connected to the step SP54. The process proceeds to the next step (step SP53).

In this way, the CPU 1 finds the first cut-off start indication. Upon detecting the cut-off indication, the CPU 1 sets i + 1 to the parameter j, confirms that the analysis point data to be processed is not finished, and whether or not the break-in indication is attached to the analysis point. (Step SP54-SP56). In the case where there is no display, the CPU 1 increments the parameter j and returns to the above-described step SP55, but in the case where there is an indication, the CPU 1 proceeds to the process of step SP58 or less. (Step SP57)

Here, at the timing at which the affirmative result is obtained in step SP56, the parameter (i) indicates the front analysis point in the two consecutive small incision start indications, and the parameter (j) is the rear analysis point in the two consecutive small incision timetables. Is instructed.

Therefore, the CPU 1 divides the interval from the analysis point i to the analysis point ij into four quarters (or three quarters in the case of three beats), adds a time signature, and then indicates the analysis point in front of the small opening indication. J is set in the parameter i to be set, and the process returns to the above-described step SP54, and the search proceeds to the back analysis point to which the cut-off start indication is attached (steps SP58 and SP59).

By repeated execution of the looping process made up of steps SP54-SP59, the time signature is displayed in each measure section until the data for the final analysis point is taken out in order to obtain a positive result in step SP55. Are attached one by one. At this time, after completion of the series of processing for attaching the time signature to the analysis point of the parameter (i) at that time, the time signature for displaying the time signature starts, and then proceeds to the process after the step SP61 for attaching each sixteenth note ( Step SP60).

When the CPU 1 obtains the affirmative result at the step SP51 before finding the first measure-opening indication, the CPU 1 does not add a mark to the section and displays the sixteenth note start indication. Proceed to the pasting process.

The processing unit including step SP50 to step SP60 corresponds to step 40 in FIG.

Steps SP50 to 60 show details of the processing corresponding to step SP41 in FIG. 4, in which two marks indicating the time signature start and before and after each other are divided into quarters and a 16th note start notation is performed. Is almost the same as

Since the start indications of the front and rear sections are found, the sections are divided into quarters, and the time signature is displayed. Therefore, detailed description of the processing is omitted (steps SP61 to SP71).

When the processing for attaching the sixteenth note start mark is finished, the CPU 1 clears the parameter (i) of the analysis point to 0, confirms that the analysis point data to be processed is not finished, and then powers the information on the analysis point. Compute to determine the granular extraction function d (i) of (steps SP72-SP74).

The power information for the analysis point i and the granular extraction function d (i) of power (i) are determined by the following equation.

d (i) == {power (i + t) −powrer (1)} / {power (i + t) + power (i)}... … … … … … (One)

Here, t is a natural number representing a time suitable for capturing the granular change of the power information.

Then, the CPU 1 judges whether or not the value of the granular extraction function d (i) is smaller than the threshold value θd in this way, and if it is small, increases the parameter i of the analysis point and performs step SP73. ) Are returned (steps SP75, SP76).

On the other hand, when the granular extraction function d (i) is equal to or larger than the threshold value? D, the CPU 1 attaches a starting point start indication to the analysis point (step SP77). Then, the CPU 1 applies all the analysis point data. After confirming that the process has not ended, the granular extraction function d (i) is calculated to determine whether the granular extraction function d (i) is smaller than the threshold value? D (steps SP78-SP80). If the granular extraction function d (i) is smaller than the threshold value, the CPU 1 increases the parameter i and returns to the above-described step SP78.

The process of step SP78 to step SP81 is a process of finding an analysis point at which the granular extraction function d (i) which is greater than or equal to the single threshold value? D is smaller than the threshold value? D.

Since the analysis point in which the granular extraction function is prized again after the analysis point thus obtained is found, if an analysis point in which the granular extraction function is smaller than the threshold is found, that is, a positive result is obtained in the above-described step SP80, the CPU 1 ) Returns to the above-described step SP73 and resumes the process of extracting the winning point.

By repeating the above process, the CPU 1 immediately detects the end of the process for all the analysis points in step SP 73 or step SP 78, and the adjacent winning prize after step SP 82 is detected. The processing proceeds to review the winning points based on the length between the points.

In this process, after clearing the parameter (i) of the analysis point to 0, the CPU 1 confirms that the analysis point data has not finished and judges whether or not the analysis point has a starting point display indication ( Step SP 82-SP 84). If the analysis point is not a winning point, the CPU 1 returns to step SP 83 after increasing the analysis point parameter i (step SP 85). When this process is repeated and the winning point is detected, the CPU 1 sets the length parameter L to an initial value "1" in order to measure the length from this winning point to the next winning point (step SP 86).

Thereafter, the CPU 1 increases the analysis point parameter i and confirms that the analysis point data is not finished, and then judges whether the winning point start indication is attached to the analysis point (steps SP 87-SP 89). ). As a result, when it is not a winning point, the CPU 1 increases the length parameter L and also increases the analysis point parameter i, and then returns to the above-described step SP 88 (steps SP 90 and SP 91). ). By repeating the processing of step SP 88 to step SP 91, the CPU 1 soon arrives at the analysis point to which the next segment start indication is attached, and the process result is obtained at step SP 89. The length parameter L at this time is equivalent to the distance between the analysis point of the object to be marked and the analysis point to which the indication is immediately preceding, that is, the length between the standing points before and after each other.

When the positive result is obtained at step SP 89, the CPU 1 judges whether or not the length parameter L is shorter than the threshold value θ L, and displays the winning point when the value is greater than or equal to the threshold value θ L. The process returns to the above-described step SP 83 without removing, but when it is smaller than the threshold value θ L, the previous standing point start indication is removed and the process returns to the above-described step SP 83 (steps SP 92 and SP). 93, and if the analysis point data does not end when returning from step SP 92 or step SP 93 to step SP 83, an affirmative result is immediately obtained at step SP 84, and the step ( The process proceeds to SP 86) and proceeds to the operation of checking the other display following the display just found.

By repeating such a series of steps, the CPU 1 finishes examining the lengths between the winning points for all the winning points, and immediately obtains the process results at step SP 83 or SP 88. The CPU 1 ends the winning point extraction process of the series of power information. The processing of step SP 72-step SP 93 corresponds to the processing of step SP 42 shown in FIG. 4.

After the winning point was extracted by the winning extraction function d (i), the winning points were examined by the distance between the winning points before and after each other. Even if the same sound is intended, the power of the sound signal changes slightly. In addition, the acoustic signal may contain noise such as an external sound, and this is to prevent a plurality of standing points from occurring in a section shorter than the length of one sound.

When this process is repeated and the winning point extraction process of the power information is finished, the CPU 1 clears the analysis point parameter i to 0, then confirms that the data to be processed is not terminated, and determines the power information for the analysis point. It is judged whether or not the standing shop mark is attached (steps SP 94-SP 96). When the indication is not attached, the CPU 1 increases the parameter i and returns to the above-described step SP 95 (step SP 97). In this way, when one winning point is found, the CPU 1 ) Determines whether or not a sixteenth note start indication is attached to the analysis point (i) (step SP 98).

If the analysis point does not have a 16th note start indication, the CPU 1 does not need to perform the matching process between the winning point and the 16th note start point, so that the CPU 1 increases the parameter (i) and the step ( The process returns to SP 95) and proceeds to the process of investigating the next winning point (step SP 99).

On the other hand, in the case where the found winning point is not attached to the sixteenth note start indication, the CPU 1 returns to the above-described step SP 95 and proceeds to the process of investigating the winning point closest to this winning point.

First, the CPU 1 attaches the 16th note start mark to the winning point, and then sets the parameter j to the initial value "1" in order to find the analysis point with the 16th note start mark in front of the winning point (step). SP 1OO, SP 1O1).

Thereafter, it is confirmed that the section i-j is equal to or greater than zero, and the CPU 1 determines whether or not a sixteenth note start display is attached to the analysis point i-j. If there is no such indication, the CPU 1 returns to step SP 102 after increasing the parameter j (steps SP 102-SP 104). By repeating the processing of steps SP 102 and SP 104, the CPU 1 finds the analysis point ij located closest to the winning point of the winning shop with the sixteenth note start indication, In SP 103, a positive result is obtained.

In that case, the CPU 1 sets the parameter k to an initial value " 1 " to find an analysis point with a sixteenth note start indication behind the winning point (step SP 105). After that, the CPU 1 checks that the analysis point i + k is not larger than the final analysis point, that is, the analysis point i + k is an analysis point at which data exists. Determines whether or not a sixteenth note start symbol is attached to the mark.

If there is no indication, the CPU 1 increments the parameter k and returns to step SP 106 (steps SP 106-SP 108). By repeating the processing of steps SP 106 and SP 108, the CPU 1 finds the closest analysis point i + k behind the winning point with the sixteenth note start indication. In step SP107, an affirmative result is obtained.

In this way, when the analysis points before and after the sixteenth note start indication close to the winning point are found, the CPU 1 compares the two parameters (i) (k) in size to determine which analysis point is close to the analysis point. When the previous analysis point ij is close (including the same close case), the CPU 1 removes the sixteenth note start indication attached to the analysis point ij, and then increases the parameter i. The process proceeds to investigate the next winning point.

On the other hand, when the analysis point (i + k) at the rear is close, the CPU 1 removes the 16th note start indication attached to the analysis point (i + k), increases the parameter (i), and then moves on to the next winning point. The process proceeds to the step of examining the data (steps SP 109-SP 113). By repeating this process, the CPU 1 attaches a sixteenth note start mark to each winning point and removes the sixteenth note start mark from the point closest to the winning point.

Then, when such processing is finished for all analysis points, the CPU 1 finishes the matching process between the series of winning points and the sixteenth note starting point in step SP 95.

In addition, the process of step SP 94-step SP 113 corresponds to step SP 43 of FIG. In this way, when the winning point change process of the power telegram is finished, the CPU 1 clears the analysis point parameter i to 0, then confirms that the analysis point data to be processed is not finished and 16 minutes to the analysis point. It is judged whether or not a note start indication is attached (steps SP 114-SP 116). If there is no indication, the CPU 1 increments the parameter i and returns to step SP 115 described above (step SP 117). In this way, when the first sixteenth note start display is found, the CPU 1 sets the parameter j applied to the next sixteenth note start display to i-1, and then the analysis point data to be processed is not finished. Then, it is determined whether or not the analysis point j has a sixteenth note start indication (Steps SP 118-SP 120). If the display is not attached, the CPU 1 increases the parameter j and returns to the above-described step SP 119 (step SP 121). When the next sixteenth note start display is found, the CPU 1 clears the number parameter n of the pitch holding segment to 0, and then sets the end parameter k of the pitch holding segment processing to i (step SP). 122, SP 123).

Next, after confirming that the parameter k is smaller than the parameter j, the CPU 1 checks whether or not the pitch information exists for the analysis point k, that is, whether the analysis point k is a voiced sound or not. Are determined (steps SP 124 and SP 125). If an affirmative result is obtained from this process, the CPU 1 increases the number parameter n, then increases the parameter k, and returns to the above-described step SP 124.

On the other hand, if a negative result is obtained, the CPU 1 immediately increases the parameter k, and then returns to the above-described step SP 124 (steps SP 125 and SP 126). By repeating this process, an affirmative result is immediately obtained at step SP 124.

Since the parameter k varies within the range from i to j-1, when the positive result is obtained in step SP 124, the number parameter n is the analysis point i and the analysis point j-1. Indicates the number of analysis points in which the pitch information exists, i.e., the number of analysis points in which the pitch information exists between the sixteenth note starting display. The CPU 1 determines whether or not the value of the number parameter n is larger than the predetermined threshold value? N.

When the value of the parameter is smaller than the threshold value θn, the CPU 1 attaches the pause start mark to the analysis point i, which is the first analysis point, in the coefficient of the number of analysis points with the sixteenth note start indication. The parameter i is set to j and the process returns to step SP 118 described above.

On the other hand, if the parameter value is greater than or equal to the threshold value? N, the CPU 1 immediately sets the parameter i to j, then returns to the above-described step (SP 118), where the next 16th note start indication is indicated. The process proceeds to the process of examining the analysis point (steps SP 128-SP 130).

By repeating this processing, pause start indications are sequentially attached one by one to the first analysis point between the sixteenth note start indications before and after which the number of analysis points in which pitch information is present is small. In step SP 119, an affirmative result is obtained, and the series of processes of attaching the pause start indication is completed.

The process of step SP 114 to step SP 130 corresponds to the process of step SP 44 of FIG. 4. When the series of processes of attaching the pause start mark is finished, the CPU 1 clears the analysis point parameter i to 0, confirms that the analysis point data to be processed is not finished, and displays the start of the small cut at the analysis point. Is judged whether or not (step SP 131-SP 133). If no cut-off start indication is attached, the CPU 1 judges whether or not the winning point indication of power information is attached (step SP 134). In the case where the winning shop display is not attached, the CPU 1 judges whether or not the pause start display is attached thereto (step SP 135). In the case where the holding start indication is not attached, the CPU 1 increases the parameter i and returns to the above-described step SP 132, and then checks whether there is a display at the next analysis point (step SP 136). .

On the other hand, if the analysis point (i) has a cut start indication, a standing point display, or a pause start indication, the CPU 1 adds a segment start indication to the analysis point (i) and then increases the parameter (i). Then, the process returns to the above-described step (SP 132) and confirms whether or not a predetermined display is attached to the next analysis point (steps SP 137 and SP 138).

In this way, the CPU 1 sequentially attaches the segment start indications to the analysis points with indications of small cutting start, winning point or stop starting, and finally becomes final data, and a positive result is obtained at step SP 132. A series of processes for attaching the segment start mark are completed. The processing of step SP 131 to step SP 138 corresponds to the processing of step SP 45 of FIG.

In this manner, the CPU 1 ends the segmentation process based on the measure information and the power information, and then proceeds to the above-described tuning process.

6 shows the change in pitch information PIT, power information P0W, and the granularity extraction function d (i) for one measure section.

Here, "?" Is the start of the measure, "☆" is the start of the shop, "○" is the start of the beat, and "x" is the start of the sixteenth note before matching with the shop is performed. Δ " indicates a pause start indication.

Therefore, in this section, the segment start indication is attached as indicated by "# " by performing the above-described series of segmentation processes.

According to the embodiment described above, the present invention generates an input auxiliary rhythm to input a sound signal to the user, thereby simplifying the input operation of the sound signal by the user, and accurately inputting the intended sound signal rhythmically. As a result, segmentation becomes easy, and the precision of the music score data produced can be improved.

In addition, the present method records the information of the input auxiliary rhythm sound generated at the time of input on the same time axis as the sound signal, and uses it for segmentation. In this case, accurate segmentation can be executed, thereby improving the accuracy of the score data. .

Other Examples

The above preferred embodiment uses the sum of squares of the acoustic signals as the power information, but other parameters may also be used. For example, the square root of the sum of squares can be used. Furthermore, although the granular extraction function was obtained as in Equation (1), other parameters may be used.

That is, the granularity of the power information may be extracted by using a function using only the molecules of the formula (1). In the above embodiment, when the distance between the standing points before and after each other is short, the front standing point display is removed, but the rear standing point display may be removed.

In the above embodiment, the input auxiliary rhythm sounds are generated by the user so that the input of the sound signal is easy, but the rhythm information for the input auxiliary may be notified to the user by a visual method. For example, an image of the baton moving in an appropriate rhythm may be displayed on the display device 5, or an audio method and a visual method may be used in combination to instruct the user of the rhythm. Moreover, the metronome sound or the rhythm accompaniment can be applied as the input auxiliary sound.

In the above-described embodiment, the measurement start information is used in the input auxiliary rhythm information to perform the segmentation processing, but the time signature start information in the input auxiliary rhythm information may be used to perform the segmentation processing.

In the above embodiment, the display device 5 is used as the output device of the score data, but a character printing device may be used instead. In the above embodiment, all the processing is executed by the CPU 1 in accordance with the program stored in the main memory 3, but some or all of the processing may be executed by the hardware system or the subsystem.

For example, as shown in FIG. 7 with the same reference numerals as those in FIG. 2, after amplifying the sound signal input from the sound signal input device 8 through the amplifying circuit 11, the signal is free. Supplied to the A / D changer 13 via the filter 12 to convert into a digital signal, and the signal processing processor 14 autocorrelates the acoustic signal converted into the digital signal to extract pitch information, or In order to obtain the sum of squares, a signal may be processed to extract power information, and in some cases, pitch information or power information may be supplied to the CPU 1 for processing by a software system.

As the signal processing processor 14 that can be used for such hardware configuration 11-14, a processor capable of real-time processing of signals and having an interface signal with a host computer prepared ( For example, Japan Electric Co., Ltd. product (PDPD 7720) can be applied.

Although the above embodiment performs the initial segmentation process based on the input auxiliary rhythm information and the power information, it may be performed based on the input auxiliary rhythm information and the pitch information, and the input auxiliary rhythm information, the power information and the pitch information. It may be performed based on.

According to the method of the present invention, the input auxiliary rhythm information is provided to the user so as to input the acoustic signal. The operation of the acoustic signal is simplified by the user, and the intended acoustic signal can be input rhythmically and accurately. As a result, the segmentation process becomes easy, and the degree of the musical score data produced can be improved.

In addition, the present method records auxiliary rhythm information provided to the user at the time of input on the same time axis as the sound signal, and uses it for the segmentation process. Therefore, accurate segmentation can be executed and the score data can be improved. .

Although the present invention has been described with respect to what are presently considered to be the most practical and preferred embodiments, the invention is not limited to the embodiments disclosed herein but encompasses various modifications and equivalent arrangements included within the spirit and scope of the appended claims. .

Claims (12)

Acquiring the sound signal, storing the sound signal, and notifying the input auxiliary rhythm information including at least tempo information at the same time as the capturing step; Extracting pitch information representing the pitch, power information, segmenting step of dividing the sound signal into sections considered to be equal pitch based on the pitch information and power information, and pitch of each section based on the pitch information Automatic identification method comprising the steps of identifying by the pitch on the pitch axis, and displaying and notifying the results of the above-described steps. The method according to claim 1, wherein the step of notifying the above is made by an audible signal. The automatic receiving method according to claim 1, wherein the above-mentioned notification is performed by a time signal. The method of claim 1, wherein the step of notifying the above-mentioned notification is notified by an audio signal and a visual signal. The method of claim 1, wherein the auxiliary rhythm is stored on the same time axis when the sound signal is stored. The segmentation step described in claim 1, wherein the segmentation step described above comprises: a first step of dividing the sound signal into sections which are to be tempered by the same pitch based on the stored input auxiliary rhythm information; And a third step of dividing the sections divided into segments by the first and second steps described above. A device for taking in a sound signal to be taken, a device for providing auxiliary rhythm information including tempo information when a sound signal is taken in, a storage device, a device for processing and storing sound signals and rhythm information, and a stored sound Pitch information indicating the repetition period of the acoustic signal waveform and the pitch of the signal from the signal, pitch power extracting device for extracting the power information, and segmenting the acoustic signal into sections considered to be equal pitch based on the pitch information and the power information. A segmentation device and a pitch correction device for identifying the pitch of the electric sound signal with respect to the absolute pitch axis. 8. The automatic hiring device according to claim 7, comprising an apparatus for notifying the input auxiliary rhythm information in an auditory form. 8. The automatic hiring device according to claim 7, comprising a device for notifying the input auxiliary rhythm information in a visual form. 8. The automatic retainer of claim 7, comprising an apparatus for notifying the input auxiliary rhythm information in an auditory form and a visual form. 8. The auto-serving apparatus according to claim 7, wherein the processing and storage device described above comprise a device for storing the auxiliary rhythm information and the sound signal on the same time axis when the sound signal is captured and stored. 8. The segmentation apparatus according to claim 7, wherein the segmentation device comprises: a first segmentation portion that divides the sound signal into sections considered to be equal pitch based on the stored input auxiliary rhythm information, and the sound signal based on pitch information and power information. And a second segmentation portion for dividing the sections divided into segments by the aforementioned first and second segmentation portions.

Images