JP2006145681A - Keyboard instrument support device and keyboard instrument support system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To assist a player playing a keyboard musical instrument by securely transmitting information to the player in safety high instantaneously. <P>SOLUTION: When a note-ON message including a value indicating a depressed key as a key value is inputted from a MIDI keyboard (104), it is decided whether the key value of the inputted note-ON message and timing of input of the note-ON message are correct (108, 110) and when the pitch that key value of the note-ON message indicates and the pitch of sound information of melody data are different from each other or when the difference in timing between the note-ON message and the sound information of the melody data is not within a designated range, a note-ON message including a value equal to the key value of the inputted note-ON message as a key value is generated and outputted to the MIDI keyboard (114). <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a keyboard instrument support device and a keyboard instrument support system, and in particular, a keyboard instrument support apparatus that supports the performance of a keyboard instrument having a keyboard for a performer to perform, and a keyboard instrument using the keyboard instrument support apparatus. Regarding support system.

  2. Description of the Related Art Conventionally, in order to support practice of a keyboard instrument, there is known a flashing keyboard in which an LED is arranged corresponding to a key, and a key to be operated is indicated to a player by causing the LED to emit light.

Also, in order to support the practice of keyboard instruments, not only the keys that should be operated, but also a device that points out errors in the operated keys. Performance practice assisting device (Patent Document 1) that emits an LED, a device that changes the temperature of a key by a Peltier element affixed on the keyboard and transmits it to the performer (Non-Patent Document 1), an electrode attached to a living body Thus, a device (Non-Patent Document 2) that sends an electrical signal into the body is known.
JP 2000-298477 A H. Miyashita and K.M. Nishimoto, “Thermocore: A New-Type Musical Score with Temperature Sensation,” Proceedings of the 2004, Conference on New Interfaces for Mus. 104-107, 2004. Yoichi Nagashima, Masayuki Akamatsu, Masaki Teruoka, Development of Electrical Stimulation Feedback Device and Application to Music Performance, Information Processing Society of Japan Research Report, 2002-MUS-45, pp. 27-32, 2002.

  However, the performance practice assisting device described in Patent Document 1 has a problem that if a hand is placed on the keyboard, the shining portion is hidden and the LED emits light. Further, the apparatus described in Non-Patent Document 1 has a problem that it takes time to warm and cool the keyboard, and the immediacy of information transmission is low. In addition, the apparatus described in Non-Patent Document 2 has a problem that it has a great influence on the performer and may hinder the performance after an electric signal is passed through the body.

  The present invention has been made to solve the above-described problems, and is a keyboard instrument support apparatus that can safely transmit information to a performer and support the practice of a keyboard instrument with safety and high immediacy. And to provide a keyboard instrument support system

  In order to achieve the above object, a keyboard instrument support apparatus according to the present invention includes a plurality of keys, and each of the keys of the keyboard that outputs an operation signal when each key is operated is accommodated. A plurality of vibration means and a control means for controlling the predetermined vibration means to vibrate based on the operation signal are configured.

  According to the keyboard instrument support apparatus of the present invention, when each key is operated, an operation signal is output by the keyboard, and the control means controls the predetermined vibration means to vibrate based on the operation signal.

  According to the keyboard instrument support apparatus of the present invention, the key is vibrated based on the operation signal output when the key is operated, so that the information is reliably transmitted to the performer with safety and high immediacy. Can support the practice of musical instruments.

  The control means according to the present invention compares the operation signal with predetermined performance information, and controls the vibration means stored in the key corresponding to the operation signal to vibrate when the operation signal is different from the performance information. can do. Thereby, when the performer operates a key different from the predetermined performance information, the error of the operated key can be reliably transmitted to the performer safely and with high immediacy.

  Further, the control means according to the present invention calculates the appearance probability of the next operation signal based on the time-series change of the operation signal, and when the appearance probability is not equal to or greater than a predetermined value, it is used as a key corresponding to the next operation signal. The housed vibration means can be controlled to vibrate. Thereby, based on the time-series change of the operation signal, the player can reliably and safely know with high immediacy that the appearance probability of the next operation signal due to the player operating the key is not equal to or higher than a predetermined value. It can support improvisation practice.

  Further, the next operation signal according to the present invention can be an operation signal of a key having the highest pitch among a plurality of keys of the plurality of operation signals when a plurality of operation signals are output within a predetermined time. . When a plurality of operation signals are output within a predetermined time to form a chord, control is performed so that the vibration means is vibrated if the appearance probability of the operation signal of the key having the highest pitch is not greater than a predetermined value. be able to.

  A keyboard instrument support system according to the present invention includes a plurality of vibration means each including a plurality of keys and each housed in each of the keys of the keyboard that transmits an operation signal via a network when each key is operated. And a control means for controlling the predetermined vibration means to vibrate based on the operation signal when the operation signal is received via the network, and comprising a plurality of keyboard instrument support devices. .

  According to the keyboard instrument support system of the present invention, when each key of the keyboard instrument support apparatus is operated, the keyboard transmits an operation signal via the network, and the other keyboard instrument support apparatus transmits the network via the network. When the operation signal is received, the control means controls the predetermined vibration means stored in each key of the keyboard to vibrate based on the operation signal.

  In the keyboard instrument support system according to the present invention, an operation signal is transmitted / received via a network, and a predetermined vibration means is vibrated based on the operation signal, so that a remote place connected via the network can be safely In addition, information can be exchanged reliably with high immediacy, and interaction in sessions between remote locations can be supported.

  As described above, according to the keyboard instrument assisting apparatus of the present invention, information is provided to the performer safely and with high immediacy by vibrating the key based on the operation signal output when the key is operated. Can be transmitted with certainty, and the keyboard instrument practice can be supported.

  Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings. 1st Embodiment demonstrates the case where the error of the key pressed down is transmitted to a player, when the key pressed down by the player differs from model performance.

  As shown in FIG. 1, the keyboard instrument support apparatus 10 includes a computer 12 that performs various processes based on a MIDI (Digital Instruments Digital Interface) file, and a MIDI keyboard 14 that outputs a MIDI message based on an operated key. It is configured. Further, the computer 12 includes a ROM 16 in which various programs including parameters of a practice support processing routine, which will be described later, parameters, and the like are stored, a CPU 18 that executes various programs, and a RAM 20 that is used as a work area when the CPU 18 executes various programs. HDD 22 for storing MIDI files, keyboard 24, sound source 26 that emits sound based on MIDI message, display 28, MIDI interface 30 for output, MIDI interface 32 for input, and for connecting these to each other A bus 34 is provided. The MIDI interface 30 is connected to an input terminal (not shown) of the MIDI keyboard 14 via a MIDI cable 36, and the MIDI interface 32 is connected to an output terminal (not shown) of the MIDI keyboard 14 via a MIDI cable 38.

  As shown in FIG. 2, the MIDI keyboard 14 includes a plurality of keys 40, a vibration motor 42 accommodated in each key, and a PIC microcomputer (R) that analyzes the input MIDI message and controls the vibration motor. A microcomputer 44 is provided. Each of the vibration motors 42 is connected to the output terminal of the microcomputer 44 through each of a plurality of wirings 46. A MIDI cable 36 is connected to the input end of the microcomputer 44. The microcomputer 44 is composed of a CPU, a ROM, and a RAM (all not shown), and the ROM stores programs for a vibration control processing routine and an interrupt processing routine, which will be described later.

  The MIDI file is composed of accompaniment data for reproducing accompaniment and melody data composed of a plurality of sound information representing the melody of the model performance. The sound information of the melody data represents the pitch and timing. ing. A MIDI message as an operation signal is composed of a status byte value indicating the type of message and a data byte value defined for each message. In the present embodiment, note-on messages and note-off messages will be described as message types.

  The note-on message is a message indicating a case where the key 40 is pressed in the performance operation, and a value indicating note-on is assigned to the status byte value. In addition, a key value indicating the key 40 pressed and a velocity value indicating the strength of pressing the key 40 are assigned to the data byte value. The note-off message is a message indicating an operation of releasing the pressed key 40 in the performance operation, and a value indicating note-off is assigned to the status byte value.

  In the MIDI message output from the computer 12, the note-on message is a message for instructing vibration of the vibration motor 42, and the note-off message is a message for instructing vibration stop of the vibration motor 42. The key value is assigned a value indicating the key 40 in which the vibration motor 42 to be instructed is stored, and the velocity value is assigned a value indicating the vibration duration.

  Next, the operation of the first exemplary embodiment of the present invention will be described.

  First, when the performer selects a piece of music to be played by the computer 12 and instructs the start of the performance, the practice support processing routine shown in FIG. 3 is executed. In step 100, the MIDI file of the selected piece of music is read from the HDD 22, The accompaniment data of the MIDI file is reproduced. In step 102, n is set to an initial value. In step 104, it is determined whether or not a note-on message is input from the MIDI keyboard 14. When the performer presses the key 40 of the MIDI keyboard 14 while watching the score in accordance with the accompaniment being played, a note-on message whose key value is the value indicating the pressed key 40 is displayed on the MIDI keyboard 14. In step 106, the pitch and timing of the nth tone information are read from the melody data of the MIDI file.

  In the next step 108, it is determined whether or not the pitch represented by the key value of the note-on message is the same as the pitch of the n-th tone information, so that the key of the note-on message input in step 104 is determined. It is determined whether or not the value is correct. If the determination is affirmative, it is determined in step 110 whether or not the timing at which the note-on message is input is correct. If the difference between the timing of the note-on message and the timing of the nth sound information is within a predetermined range, it is determined that the timing is correct, and in step 112, the same key value as the key value of the input note-on message is used as the key value. Is generated and output to the MIDI keyboard 14.

  On the other hand, if the pitch indicated by the key value of the note-on message is different from the pitch of the n-th tone information, the determination in step 108 is negative, and in step 114, the same value as the key value of the input note-on message. A note-on message having the key value as a key value is generated and output to the MIDI keyboard 14. If the difference between the timing of the note-on message and the timing of the nth sound information is outside the predetermined range, the determination at step 110 is denied, and a note-on message is created at step 114 and output to the MIDI keyboard 14. . Note that a value indicating a predetermined duration is assigned in advance to the velocity value of the note-on message to be created.

  In the next step 116, it is determined whether or not the melody data has the (n + 1) th sound information. If the determination is affirmative, n is incremented in step 118 and the process returns to step 104. Steps 104 to 114 are executed in the same manner as described above, and when the above processing is completed for all sound information of the melody data, the determination in step 116 is denied and the practice support processing routine ends.

  When a note-on message is input, a note-on message is output to the sound source 26, the pitch of the note-on message is emitted, and when a note-off message is input, a note-off message is input to the sound source 26. Stop sound emission of note-on message pitch.

  Next, the vibration control processing routine shown in FIG. 4 executed by the microcomputer 44 will be described. First, in step 130, initialization processing is performed, and motor registers “n” (n = 1 to N) provided in the RAM of the microcomputer 44 are all set to zero. N is the number of keys 40 of the MIDI keyboard 14. In step 132, the permission flag for setting whether or not to allow interruption by the MIDI message from the computer 12 is turned on, and interruption is permitted.

  Next, the interrupt processing routine shown in FIG. 5 executed by the microcomputer 44 will be described. When a MIDI message is input from the computer 12 to the microcomputer 44, the vibration control processing routine is interrupted and an interrupt processing routine is executed. First, in step 162, the key value of the MIDI message is read, and the vibration motor 42 stored in the key 40 indicated by the key value is specified. In step 164, it is determined whether or not the MIDI message is a note-on message. When it is determined that the status byte value of the MIDI message is a value indicating note-on, in step 166, it is specified in step 164. The velocity value of the MIDI message is stored in the motor register, and the process proceeds to step 168. On the other hand, if it is determined that the status byte value of the MIDI message is a value indicating note-off, the process proceeds to step 168.

  In step 168, it is determined whether or not the input MIDI message is a note-off message. If it is determined that the status byte value of the MIDI message is a value indicating note-off, in step 170, the identification is performed in step 164. 0 is stored in the designated motor register, and the interrupt processing routine is terminated. On the other hand, if it is determined that the status byte value of the input MIDI message is a value indicating note-on, the interrupt processing routine is terminated.

  Next, in step 134 of the vibration control processing routine shown in FIG. 4, n, which is a number indicating a motor register, is set as an initial value, and in step 136, it is determined whether or not the value of the nth motor register is greater than zero. If it is determined that a value greater than 0 is stored, an ON signal is output to the nth vibration motor 42 in step 138, the nth vibration motor 42 is turned ON, and the process proceeds to step 140. On the other hand, if the value of the nth motor register is 0, the determination in step 136 is negative and the routine proceeds to step 140.

  In step 140, it is determined whether n is less than N. If it is determined that there is an (n + 1) th motor register, n is incremented in step 142 and the process returns to step 136, and step n is performed for the nth motor register. When the processes of 136 to 140 are repeated and the processes of steps 136 to 140 are completed for the Nth motor register, the determination in step 140 is negative and the process proceeds to step 144.

  In step 144, a predetermined time, for example, 5 milliseconds is waited. In step 146, n is set as an initial value, and in the next step 148, it is determined whether or not the value of the nth motor register is 0. If it is determined that it is 0, in step 150, an OFF signal is output to the nth vibration motor 42, the nth vibration motor 42 is turned OFF, and the routine proceeds to step 152. On the other hand, if it is determined that the value of the nth motor register is not 0, the value of the nth motor register is decremented in step 151 and the process proceeds to step 152.

  In step 152, it is determined whether or not n is less than N. If the determination is affirmative, in step 154, n is incremented and the process returns to step 148, and the processing of steps 148 to 152 is performed for the nth motor register. When the processes of steps 148 to 152 are completed for the Nth motor register, the determination of step 152 is denied, the process returns to step 134, and the processes of steps 134 to 154 are repeated. Then, when it is detected that the accompaniment data being reproduced by the computer 12 has been reproduced, the vibration control processing routine is terminated.

  As described above, according to the keyboard instrument support apparatus according to the first embodiment of the present invention, it differs from the melody data of the model performance based on the note-on message input when the key is pressed. When a key is pressed, by vibrating the key that has been pressed, the player can reliably transmit the error of the pressed key to the performer safely and with high immediacy. This makes it possible to effectively perform performance practice.

  Also, not only when the wrong key is pressed, but also when the key is missed or when the timing of pressing the key is significantly different from the timing of the melody data of the model performance, Performance mistakes can be reliably transmitted to the performer with safety and high immediacy.

  Since the performer feels the vibration of the key directly at the fingertip, he / she is not aware of it and can reliably transmit a performance error even during the performance. In particular, beginners sometimes misread the score, and they may not realize that they are pressing the keys by mistake, but they can transmit performance mistakes in real time, so they support keyboard instrument practice. can do.

  In addition, since the vibration duration is specified using the velocity value of the MIDI message, the vibration can be stopped after a certain time has elapsed even when a note-off message is not input from the computer.

  The case where it is determined whether or not the performance is correct based on the melody data of the MIDI file has been described as an example. However, the comparison target does not have to be a MIDI file, and may be simple musical score data. May be any data stored.

  Next, a second embodiment of the present invention will be described. In addition, about the part similar to 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted. Traditionally, the shining keyboard and piano practice software that provides support for musical instrument practice can only support uniform melody guidance and game practice, but cannot support self-study for improvisation. Therefore, in the second embodiment, a case will be described in which the practice of a keyboard instrument by improvisation is supported.

  In the first embodiment, whether or not the pitch represented by the key value of the note-on message output when the key 40 of the MIDI keyboard 14 is pressed is correct as compared with the pitch of the sound information of the melody data. However, the second embodiment is different in that it is determined whether or not the pitch of the key 40 indicated by the key value of the note-on message is natural as a melody.

  The HDD 22 stores a melody database. The melody database stores a plurality of melody composed of sounds represented by feature vectors. This feature vector is, for example, the type of sound such as chord constituent sound or key constituent sound, pitch difference from the immediately preceding sound, whether the sounding timing is the front or back of the eighth note level, and a rest immediately before Hereinafter, the sound represented by the feature vector x is represented as “sound x”. The element of the feature vector may be changed according to the number of melodies in the melody database and the genre of melody.

The melodic database stores melodic appearance probabilities, and in this embodiment, the melodic appearance probabilities composed of N−1 sounds x _{N −1} ... X ₁ are calculated in advance and stored in the melodic database. It is remembered. For example, the appearance probability of a melody is calculated in advance based on the melody of 200 jazz standards and stored in a melody database.

  Further, a melody buffer is provided in the RAM 20, and the melody buffer stores the order in which feature vectors are generated.

  In addition, since the other structure of the keyboard musical instrument assistance apparatus 10 which concerns on 2nd Embodiment is the same as 1st Embodiment, it attaches | subjects the same code | symbol and abbreviate | omits description.

  Next, the operation of the second exemplary embodiment of the present invention will be described. First, when the performer selects an accompaniment and instructs to start accompaniment playback on the computer 12, the improvisation performance support processing routine shown in FIG. 6 is executed. In step 200, the MIDI file of the accompaniment selected from the HDD 22 is obtained. The accompaniment data of the MIDI file is read and reproduced. In step 202, it is determined whether or not a note-on message is input from the MIDI keyboard 14. When it is determined that the performer presses the key 40 of the MIDI keyboard 14 and a note-on message whose key value is the value indicating the pressed key 40 is input from the MIDI keyboard 14, in step 204. In step 202, it is determined whether or not another note-on message is input within 15 milliseconds after the note-on message is input. If no note-on message is input within 15 milliseconds, the determination is negative. Then, the process proceeds to step 208. On the other hand, if a note-on message is further input within 15 seconds, the determination in step 204 is affirmed. In step 206, the pitch of the key 40 indicated by the note-on message input in steps 202 and 204 is: Since a chord is formed, the pitch that becomes the main melody is selected from those pitches. For example, the highest pitch is selected as the main melody from the pitches of the note-on message.

  In the next step 208, a feature vector is created based on the pitch selected as the main melody in step 206. If the determination in step 204 is negative, a feature vector is created based on the pitch of the note-on message received in step 202.

  In step 210, it is determined whether or not N−1 or more feature vectors are stored in the melody buffer provided in the RAM 20, and it is determined that there are less than N−1 feature vectors stored in the melody buffer. Then, based on the feature vector stored in the melody buffer in step 218, it is determined whether or not the pitch of the feature vector created in step 208 is a chord tone. If it is determined that it is a chord tone, the process proceeds to step 226. If it is determined that it is not a chord tone, in step 220, the pitch is corrected so as to be the nearest chord tone, and the process proceeds to step 212. To do.

On the other hand, if N−1 or more feature vectors are stored in the melody buffer, the determination in step 210 is affirmed, and in step 212, the melody X (= x _{n−N +)} consisting of the immediately preceding N−1 sounds. ₁ ... X _n−1 ), the appearance probability P (x _n | X) in which the feature vector x _n created in step 208 appears is calculated by the following equation for calculating the N-gram probability.

From the above formula, the melody X is based on the appearance probabilities P (x _{n−N + 1} ... X _n ) and P (x _{n−N + 1} ... X _n−1 ) stored in the melody database. Next, the appearance probability P (x _n | X) of the feature vector x _n following is calculated.

In the next step 214, it is determined whether or not the appearance probability P (x _n | X) calculated in step 212 is _equal to or greater than a predetermined threshold value, and the appearance probability P (x _n | X) is less than the threshold value. If it is determined that there is, in step 216, which pitch should be corrected is calculated. For example, the appearance probability P (x _n | X) when the pitch of x _n is changed to various pitches is calculated, and the pitch having the maximum appearance probability is set as the corrected pitch. In step 222, a note-on message having a pitch before correction is created. That is, if there is no note-on message input in step 204, the key value of the note-on message input in step 202 is the same. A note-on message is created with the value as the key value, and if there is a note-on message input at step 204, a note-on message with the same key value as the key value of the note-on message of the main melody is created, and MIDI Then, in step 224, the feature vector in which the pitch of the feature vector created in step 208 is corrected is stored in the melody buffer, and the process proceeds to step 230. At this time, a note-on message with a corrected pitch is output to the sound source 26, and the corrected pitch is emitted.

On the other hand, if the appearance probability P (x _n | X) is _{equal to} or greater than the threshold value, the determination in step 214 is affirmed, and in step 226, the note-off message input in step 202 or the note-on message input in step 204 is received. In some cases, a note-off message is created with the same value as the key value of the note-on message of the main melody and output to the MIDI keyboard 14. In step 228, the feature vector created in step 208 is stored in the melody buffer, and the process proceeds to step 230. At this time, the note-on message of the main melody is output to the sound source 26, and the pitch of the note-on message of the main melody is emitted.

  In step 230, it is determined whether or not a note-on message other than the main melody has been input. If there is no note-on message input in step 204, the process proceeds to step 234, but the note-on message input in step 204. In step 232, it is determined whether or not the pitch of the note-on message other than the main melody is a chord tone. If the chord tone is configured, a note-on message other than the main melody is output to the sound source 26. Also, a note-off message is generated with the same value as the key value of the note-on message other than the main melody, and is output to the MIDI keyboard 14. On the other hand, if the note-on message pitch other than the main melody is not a chord tone, the note-on message pitch other than the main melody is corrected to be the nearest chord tone, and the note-on message with the corrected pitch is sound source In addition, a note-on message of the pitch before correction, that is, a note-on message having the same key value as the key value of the note-on message other than the main melody is generated and output to the MIDI keyboard 14.

  In the next step 234, it is determined whether or not the accompaniment data of the MIDI file has ended. If the determination is negative, the process returns to step 202 and the processes of steps 202 to 230 are repeated, but the accompaniment data ends. Then, the determination is affirmed, and the improvisation performance support processing routine is terminated. Note that an appearance probability that can be statistically determined to be natural as a melody is set in advance as the threshold value of the appearance probability.

  When a note-off message is input, the note-off message is output to the sound source 26, and sound emission at the pitch of the note-off message is stopped.

  The microcomputer 44 executes the vibration control processing routine shown in FIG. 4 and the interrupt processing routine shown in FIG. 5, and controls the on / off of the vibration motor 42 in accordance with the MIDI message input from the computer 12, so that the melody in improvisation can be achieved. Whether it is natural or not is transmitted to the performer by the vibration of the key 40.

  As described above, according to the keyboard instrument supporting apparatus according to the second embodiment of the present invention, the key operated by the performer is based on the N-gram probability of the sound following the given melody. Since the player can surely know whether the pitch is natural as a melody with safety and high immediacy, the practice of improvisation can be supported. In addition, when a plurality of note-on messages are input within a predetermined time and a chord is formed, whether or not the appearance probability of the sound indicated by the note-on message of the key with the highest pitch is equal to or higher than a threshold value is determined. By determining, when a plurality of keys are pressed, the player can know whether or not the pitch of the operated keys is natural as a melody.

  Also, in improvisation, since the sound is intentionally removed, it is difficult to judge whether the pitch of the pressed key is natural as a melody, but it can be judged by the vibration of the key, so efficient practice is possible. Become.

  In addition, it is possible to improve the practice efficiency in improvised performance practice for a person who has already acquired improvised performance skills to acquire a wider range of styles of improvised performance. Acquiring improvised performance to some extent often results in unintentional use of a small number of melodies (called “hands”). Then, even if you try to use melodies that have never been used to broaden the improvisational performance, you often end up using a lot of melody that you have already mastered. In this case, by using a melody database that stores melodies of different genres, it is possible to know melody that is not frequently used in different genres by the vibration of the keys, so that it is possible to prevent unintentional reliance on one's own skill. it can.

  In addition, although the case where it only pointed out that the sound of the key pressed during performance is only pointed out was demonstrated, you may enable it to play back a performance after a performance. In that case, playback playback with the corrected pitch can be performed, and it is possible to know which sound is not natural as a melody when playing it, and improve the efficiency of self-study for improvisation. Can do.

  Next, a third embodiment of the present invention will be described. In addition, about the part similar to 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted. When performing a session between remote locations via a network, each performer listens to a performance by another performer, generates his own performance while being influenced by it, and transmits it to the other performers. In addition to expressing each song's excitement and signs of change during the performance, each player is not only judging from the performance, but also using gestures to have a common understanding of the progression of the song. Here, when the gesture is performed through the camera and the monitor, it is a small movement in the monitor, so the player may miss it. Therefore, in the third embodiment, a case will be described in which MIDI messages are transmitted and received between a plurality of keyboard instrument support apparatuses, and interaction in a session is supported by key vibration.

  As shown in FIG. 7, the keyboard instrument support system 50 according to the third embodiment includes a plurality of keyboard instrument support apparatuses 56, which include a computer 12, a MIDI keyboard 14, and a plurality of keyboard instrument support apparatuses 56. A foot pedal 54 having a pedal is provided. The foot pedal 54 is connected to the MIDI keyboard 14, and the computers 12 of the keyboard instrument support device 56 are connected to each other via a network 52 such as a LAN or the Internet.

  When the pedal of the foot pedal 54 is pressed, the MIDI keyboard 14 generates a note-on message in which the value corresponding to the pressed pedal is a key value, and is output to the computer 12. The note-on message generated by pressing each pedal of the foot pedal 54 corresponds to each of a plurality of messages transmitted to the keyboard instrument support device 56 connected via the network 52.

  Next, the operation of the third exemplary embodiment of the present invention will be described. First, the message transmission processing routine shown in FIG. In step 250, it is determined whether or not a note-on message is input from the MIDI keyboard 14. If it is determined that the note-on message has been input by pressing the key 40 of the MIDI keyboard 14 or the pedal of the foot pedal 54, the received note-on message is transmitted via the network 52 in step 252. To the other computer 12, and the message transmission process is terminated. When a note-on message is input by pressing the key 40 of the MIDI keyboard 14, this note-on message is output to the sound source 26, the pitch of the note-on message is emitted, and the key 40 is released. When an operation is performed and a note-off message is input, this note-off message is output to the sound source 26, and sound emission of the pitch of the note-off message is stopped.

  Next, the session support processing routine shown in FIG. First, in step 260, it is determined whether or not a note-on message has been received via the network 52. If it is determined that a note-on message from another computer 12 has been received, the received note-on message is determined in step 262. It is determined whether or not the message is a note-on message due to the foot pedal 54 being pressed. If it is determined that the key value of the note-on message is a value indicating the pedal of the foot pedal 54, a note-on message corresponding to the key value of the received note-on message is created and output to the MIDI keyboard 14 at step 264. To do. For example, when the key value corresponds to the message “switching chord progression”, the key value and the key value so as to vibrate a predetermined key 40 with a predetermined length in order to transmit this message to the performer. A note-on message with a velocity value set is created and output, and the session support processing routine is terminated.

  On the other hand, if the key value of the note-on message is a value indicating the key 40, the determination in step 262 is denied, and in step 266, the note-on message received in step 260 is output to the MIDI keyboard 14 as it is, and session support processing is performed. End the routine.

  Then, the microcomputer 44 executes the vibration control processing routine shown in FIG. 4 and the interrupt processing routine shown in FIG. 5 to control the on / off of the vibration motor 42 according to the MIDI message input from the computer 12, A message from the keyboard instrument support device 56 is transmitted to the performer, and a performance by the performer at the other keyboard instrument support device 56 is transmitted.

  As described above, according to the keyboard instrument support system according to the third embodiment, a note-on message is transmitted / received via a network, and a predetermined key is vibrated based on the note-on message, Messages and performances can be reliably transmitted between remote locations connected via a network in a safe and highly instantaneous manner, and interaction in a session can be supported.

  Moreover, if this keyboard instrument support system is applied, it can also be used for information transmission from the listener to the performer. Until now, the performer and the audience have only a one-way relationship, and it was possible to excite the performer with applause and clapping, but no more detailed information was exchanged. A network-connected switch or mini-keyboard is provided on the audience side, and a player who performs a less musical performance pushes the switch to make it booed by vibration, or the audience vibrates a specific keyboard to play the keyboard. It makes it difficult to play, creating an irregular scale, and transmitting the desired melody with vibration.

  Note that, when the computer receives a note-on message due to the foot pedal being pressed from another keyboard instrument support device, a note-on message having a predetermined key value is created and output to the MIDI keyboard. However, by associating each of the key pressing operations with each of a plurality of predetermined messages, when the foot pedal is pressed, vibration by a note-on message corresponding to the key pressing operation is started, You may make it transmit the message by the player in a remote place. In that case, the computer executes a session support processing routine shown in FIG.

  First, in step 280, it is determined whether or not a note-on message due to a key pressing operation has been received. If it is determined that a note-on message having a key value corresponding to the key has been received, At 282, it is determined whether a note-on message due to the foot pedal being pressed has been received. When it is determined that the note-on message whose key value indicates the pedal of the foot pedal has been received, in step 284, the note-on message received in step 280 is output to the MIDI keyboard 14, and the session support processing routine is terminated. To do. This makes it easier for the performer to select the timing for transmitting a message due to vibration even during performance.

  Further, in the above embodiment, the case where a message is transmitted to the performer by vibrating the key has been described as an example. However, the message may be simultaneously displayed on the computer display. In that case, the vibration of the key may be used exclusively to notify the receipt of the message.

  In addition, the case where a plurality of keyboard instrument support apparatuses are connected via a network has been described as an example. However, one keyboard instrument support apparatus can be used, and a session partner can be a virtual musician in a computer. According to this, since the message from the virtual musician is transmitted to the performer by vibration, the message from the virtual musician can be surely noticed, and the interaction in the session with the virtual musician can be supported.

It is the schematic which shows the structure of the keyboard musical instrument assistance apparatus which concerns on the 1st Embodiment of this invention. It is the schematic which shows the structure of the MIDI keyboard which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the content of the practice assistance process routine which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the content of the vibration control processing routine which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the content of the interruption processing routine which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the content of the improvisation performance support processing routine which concerns on the 2nd Embodiment of this invention. It is the schematic which shows the structure of the keyboard musical instrument assistance system which concerns on the 3rd Embodiment of this invention. It is a flowchart which shows the content of the message transmission process routine which concerns on the 3rd Embodiment of this invention. It is a flowchart which shows the content of the session assistance processing routine which concerns on the 3rd Embodiment of this invention. It is a flowchart which shows the content of another example of the session assistance processing routine which concerns on the 3rd Embodiment of this invention.

Explanation of symbols

10, 56 Keyboard instrument support device 12 Computer 14 MIDI keyboard 40 Key 42 Vibration motor 44 Microcomputer 50 Keyboard instrument support system 52 Network 54 Foot pedal

Claims (5)

A plurality of vibration means each comprising a plurality of keys, each of which is housed in each of the keys of the keyboard that outputs an operation signal when each key is operated;
Control means for controlling the predetermined vibration means to vibrate based on the operation signal;
Keyboard instrument support device including   The control means compares the operation signal with predetermined performance information, and vibrates the vibration means housed in a key corresponding to the operation signal when the operation signal is different from the performance information. The keyboard instrument support apparatus according to claim 1, wherein the keyboard instrument support apparatus is controlled.   The control means calculates the appearance probability of the next operation signal based on the time-series change of the operation signal, and when the appearance probability is not equal to or greater than a predetermined value, the control means is stored in the key corresponding to the next operation signal. The keyboard musical instrument support apparatus according to claim 1, wherein the vibration means is controlled to vibrate.   4. The keyboard according to claim 3, wherein the next operation signal is an operation signal of a key having the highest pitch among a plurality of keys of the plurality of operation signals when a plurality of operation signals are output within a predetermined time. Musical instrument support device. A plurality of keys, and a plurality of vibration means each housed in each of the keys of the keyboard that transmits an operation signal via a network when each key is operated; and the operation signal via the network , A keyboard instrument support system comprising a plurality of keyboard instrument support devices including control means for controlling the predetermined vibration means to vibrate based on the operation signal.

Images