JPS6330900A - Audio/performance information transmission method and transmitting/receiving device - Google Patents

Abstract

(57) [Abstract] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention relates to synchronous transmission of audio information and performance information, or recording and reproducing methods, and in particular to synchronous combination of digitally encoded audio information and compression-encoded performance information. This is what made it possible.

[Conventional technology] Traditionally, music lessons were collected and transmitted as electrical audio signals (recorded).
! ) There are methods of reproducing the original sound using speakers, etc., and methods of extracting performance information from a keyboard instrument such as a piano, transmitting (recording) it, and reproducing the performance by driving the instrument based on this information. However, there has been no suitable method for temporally relating these two methods and synchronously transmitting, recording and reproducing data.

Conventionally, when attempting to reproduce audio information and performance information at the same time, each must be reproduced independently using separate transmission media or recording media. It was not possible to play it.

In particular, when the time information of performance information is encoded to compress the information, synchronized playback with audio information is completely impossible because the playback uses a time relationship that is separate from the original time relationship. Further, it was expected that it would be very complicated to transmit (record and reproduce) audio information and performance information that should be reproduced simultaneously and in synchronization using separate transmission media (recording media).

[Problems to be Solved by the Invention] An object of the present invention is to eliminate the above-mentioned problems and to maintain synchronization between audio information and performance information while using a single transmission medium (
The purpose of the present invention is to provide an audio/performance information transmission method that can be transmitted (recorded/played) using a recording medium.

[Means for Solving the Problems] In order to achieve such an object, the present invention encodes audio information to extract the audio signal on the transmitting or recording side, and extracts the audio signal from the performance information collected from the musical instrument. The encoded performance signal is extracted, the encoded audio signal is delayed, the encoded performance signal is segmented at predetermined time intervals, a marker signal indicating the timing of the segmentation is added to the performance signal, and the segmentation is performed. The performance signal to which the marker signal has been added is subjected to information compression code conversion, a synchronization signal is generated based on the marker signal, and the delayed audio signal is processed.
The compressed performance signal and synchronization signal are mixed, arranged according to a predetermined format, and the audio information and performance information are transmitted in synchronization with the timing of the synchronization signal, and the receiving or reproducing side receives the transmitted signal. Separate the audio signal, performance signal, and synchronization signal from the received signal, decode the separated audio signal, and decode the separated performance signal after undergoing inverse transformation of information compression code conversion. The system is characterized in that it reproduces audio information and performance information in synchronization.

Another aspect of the present invention includes a first encoding means for encoding audio information and extracting an audio signal, a second encoding means for encoding performance information collected from a musical instrument and extracting a performance signal, A delay means for delaying the audio signal taken out from the first encoding means and a performance signal taken out from the second encoding means are segmented at predetermined time intervals, and a marker signal indicating the timing of the division is added to the performance signal. a compression means for converting the performance signal segmented by the segmentation means and to which a marker signal has been added to an information compression code; and a synchronization generation means for generating a synchronization signal based on the marker signal. and arranging means for mixing the audio signal taken out from the delay means, the performance signal taken out from the compression means, and the synchronization signal generated from the synchronization generation means, and arranging the mixture according to a predetermined format. shall be.

Here, for example, the performance information is divided into blocks, a block timing signal is added, the block number is specified based on that signal, and this is used as a synchronization signal to be transmitted in data arrangement along with the audio signal. Make it.

[Function] According to the present invention, an audio signal picked up by a microphone and a signal of performance information of an electric musical instrument can be efficiently transmitted or recorded simultaneously, and when receiving or playing back, the audio signal and the performance information signal can be simultaneously transmitted or recorded. It can be played back in synchronization with the performance information signal.

[Example] Hereinafter, the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing the configuration on the transmission (recording) side of an embodiment according to the present invention.

In Figure 1, 1 is a microphone for collecting sound, 2
is an audio PCM encoder, 3 is an electric musical instrument that can electrically extract performance information, and 4 is a MIDI encoder.
Performance information is encoded according to the Musical Instrument Digital Interface (MIDI) standard.

5 is a simultaneous recorder capable of simultaneously recording PCM signals and MIDI signals, 6 is a synchronization marker sending circuit, and 7 is a block marker adding circuit for MIDI signals.

8 is a delay circuit, 9 is a performance information compression encoding circuit, and 10 is a data array circuit.

Next, the operation of each part in this embodiment will be explained according to what is shown in FIG.

The sound picked up by the microphone 1 is manually inputted to the audio encoder 2 as an audio signal. PCM as audio encoder 2
A digital encoder of audio is used, such as an encoder, DPCM encoder, delta modulation encoder, etc.

An encoding clock is supplied to the audio encoder 2 from a timing generation circuit 8.

The musical instrument 3 is a musical instrument that is equipped with sensors such as electrical contacts, a photodetector, and a frequency detector, and can extract the pitch, length, etc. of the performance sound, and the performance information retrieved by these means is transferred to the MID.
The I encoder 4 encodes it and outputs a MIDI signal. The MIDI encoder 4 is also supplied with an encoding clock from the timing generation circuit 8.

Simultaneous recorder 5 that can record audio signals and performance information simultaneously
If necessary, the digital audio signal output from the audio encoder 2 and the MIDI signal output from the [01 encoder 4 are simultaneously recorded.

When musical instrument 3 is played, the performance sound of other musical instruments or singing voices that are played at the same time are acoustically separated from the performance sound of musical instrument 3, and the sound is collected into the microphone. However, the microphone 1 can acoustically capture other musical sounds or singing voices as audio signals.

The audio signal from the microphone 1 obtained in this way is encoded by the audio encoder 2, the output from the audio encoder 2 is sent to the delay circuit 8, and the output from the MIDI encoder 4 is sent to the block marker addition circuit 7. Supply each.

Once these output signals are recorded on the simultaneous recorder 5, the reproduced audio encoded signal and MIDIID signal are supplied to the delay circuit 8 and the block marker addition circuit 7, respectively. Further, a blocking timing signal is supplied from the timing generation circuit 8 to the synchronization marker addition circuit 6 and the block marker addition circuit 7.

The synchronization marker adding circuit 6 generates a block number based on this timing signal and supplies it to the data array circuit 10 as a synchronization marker. Further, the block marker addition circuit 7 adds a block marker signal to the 1.1IDI signal at the same timing as described above, and supplies the output to the compression encoding circuit 9.

The delay circuit 8 performs a delay operation for at least a certain period of time equal to or longer than the processing time in the compression encoding circuit 9 plus the processing time in the decompression decoding circuit 16 on the receiving side, which will be described later.

Note that if there is a delay in the operation of the musical instrument during reception or playback, add the time equivalent to the delay time.

The output of the delay circuit 8, that is, audio data delayed by a certain period of time, and performance data obtained by adding a block marker signal to a MIDI signal and compressing and encoding it are supplied to a data array circuit 10.

The data array circuit 10 performs data array to suit the transmission path or the recording medium 11.

FIG. 2 is a layout diagram showing the interrelationship between blocked timing signals, audio PCM data, and MIDI data in one embodiment of the present invention.

FIG. 2A shows a blocking timing signal (indicated by an arrow) supplied from the timing generation circuit 8 to the block marker addition circuit 7. Figure 2 (CB) shows the corresponding audio PCM data signal, and Figure 2 (CB) shows the corresponding audio PCM data signal.
C) shows a state in which a timing marker signal is added to the old DI data signal by the block marker adding circuit 7 in accordance with the blocking timing signal.

FIGS. 3A and 3B are arrangement diagrams showing an example of each data signal arrangement corresponding to block numbers according to the present invention.

FIG. 3 (^) shows the transmission data signal arrangement on the transmitting side. Corresponding to the transmission block number, the transmission audio data is given a predetermined delay time from the audio signal.
The IDI signal indicates that each block is intermittently arranged and transmitted as compressed performance data.

FIG. 4 is a block diagram showing the configuration of the receiving side in an embodiment according to the present invention.

In the figure, 11 is a data transmission path, and 12 is a data separation circuit. 13 is an audio decoder, 14 is a performance data memory, and 15 is a synchronization marker receiving circuit. 16 is a compressed performance information decompression decoding circuit, 17 is a MIDI sending circuit, 18 is a loudspeaker, and 19 is an electric musical instrument.

Data received or reproduced via a transmission path or recording medium 11 is supplied to a data separation circuit 12, where it is separated into audio data, performance data, and a synchronization marker including a block number.The audio data is sent to an audio decoder 13.
The performance data is supplied to a performance data memory 14, and the synchronization marker is supplied to a synchronization marker receiving circuit 15.

The audio decoder 13 decodes the audio signal from the audio data and supplies it to the public address system 18 . Synchronous marker receiving circuit 1
5 detects the block number and decompresses the decoding circuit 16 and M
The signal is supplied to the IDI sending circuit 17.

The performance data memory 14 temporarily stores data before the performance information is decompressed and decoded by the decompression decoding circuit 16, so that the decompression and decoding operations are carried out temporally continuously and smoothly.

The decompression/decoding circuit 16 extracts the performance data from the data memory 14 according to the block number, expands the audio data block by block, and sends it to the MIDI transmission circuit 17.
supply to The MIDI sending circuit 17 transmits MIDI in synchronization with the block number supplied from the synchronization marker receiving circuit 15.
Sends DI signal.

The audio signal decoded by the audio decoder 13 is reproduced by a public address system 18. Further, the MIDI signal from the MIDI sending circuit 17 is supplied to an electric musical instrument 19 that meets the MIDI standard for performance.

FIG. 3(8) shows an arrangement in which performance data and audio data are synchronously produced in accordance with block numbers on the receiving side according to the present invention.

In this way, it is possible to transmit the audio signal and performance information to be played back in synchronization through one transmission path or recording medium, while compressing the performance information, and to play back the two in synchronization. .

Regarding compression and decoding of performance information, as the present inventors have already proposed in patent application No. 81-129720, [
The basic method is to encode the pitch, intensity, length, and timing of each note as difference information from the performance timing of the previous note based on the performance information extracted as a DI signal. However, the block marker signal added to the MIDI signal is also handled and encoded as one piece of event information 2 similar to each performance sound. Note that this block marker signal is removed during reproduction.

As an example in which audio and performance information are transmitted through one transmission path, an example of application to satellite television broadcasting will be shown.

FIG. 5 is an arrangement diagram of each signal in the B mode of the audio transmission frame in the satellite television broadcast system.

In the figure, A is a synchronization code, B is a control code, C is a range code, E is audio data, F is unique data, G is an error control part, and D is an undefined part. Undefined part is 1
The format of the synchronization marker signal and performance data is shown in FIG. 6 when the present invention is applied to a satellite television broadcast system using 6 bits.

In the figure, ■ indicates an information bit, which is 5 bits, and P indicates a check bit, which is 11 bits.The information bit I and the check bit P form a BCH (15°5) error correction detection code. J is a synchronization marker signal channel, and K is a performance information channel.

As is well known, audio transmission frames are transmitted at a rate of 1000 frames per second, so the synchronization marker channel J is 1000 bits per second, and the performance information channel is 4 bits per second.
The transmission rate is 000 bits/second. In channel J of the synchronization marker, a block number consisting of, for example, 0N15 is represented by 4 bits, and a delimiter bit of 1 pin is added to this for transmission.

Furthermore, since these channels J, P, and P are protected by the BCH code, even if the audio transmitted by the E section shown in Figure 5 is disturbed due to C/N deterioration, the disturbance will not occur. Performance information can be reliably transmitted within a subjectively permissible range.

FIG. 7 is a data bit arrangement diagram in another embodiment of satellite television broadcasting.

In this embodiment, audio may be transmitted in either A mode or B mode, and the synchronization marker and performance information are transmitted using a data transmission method that utilizes unused bits for audio transmission on digital subcarriers of satellite television broadcasting, etc. (So-called data channel: A provisional method for this technical method was established by the Telecommunications Technology Council in March 1986).

FIG. 7 shows the data channel packet I, SI,
SI2 is a service identification, synchronization marker, and performance information transmission bit, each of which is arranged in nine pieces of 16 bits. M is an unused bit, L and M are information bits, and Q is a check bit to form a shortened difference set cyclic code (256,174). For each, synchronization markers and performance information are arranged and transmitted using the bit arrangement shown in FIG.

The packets shown in FIG. 7 are transmitted at a rate of one every 9 m5 (superframe of data channel). Therefore, the transmission speed of the synchronization marker channel and the performance information channel are each the same speed as in the previous embodiment.

As yet another embodiment, an example of application to a compact disc (CD) will be shown.

FIG. 8 is a diagram showing the arrangement of bits within a frame in the compact disc signal format.

In the CD signal format, an 8-bit user's bit (P1-) is included in a 264-bit data frame.
, Q, R...W) are available.

By using one user's bit (for example, R) per frame, a capacity of 7350 bits/second can be obtained, and this is used to transmit the synchronization marker and performance information described above.

Since the user's bits have no protection against errors, a block corresponding to the packet number M and Q shown in FIG. 7 is formed for a series of R bits in each frame, and similarly (25[i .

174) Protect against errors by applying a shortened difference set cyclic code.

Since CDs have concentrated errors caused by dust, scratches, etc., the above-mentioned blocks are interleaved with an appropriate length to prevent errors from concentrating in the blocks and improve the error correction ability. Improve.

[Effects of the Invention] As is clear from the above, according to the present invention, it is possible to easily synchronize and reproduce audio reproduction and electrical performance of a musical instrument, which has been difficult in the past.

Even if musical instrument performance information is compressed and encoded, it can be synchronously combined, so it can be applied to satellite television broadcasting and to recording media such as compact discs.

Further, according to the present invention, since performance information is encoded in blocks, it is possible to reproduce the audio and performance information without losing synchronization even if reception or reproduction is performed from the middle.

Since it can be transmitted, recorded and reproduced using one transmission path or recording medium, it is easy to handle and economical.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing the configuration of the transmitting side of an embodiment according to the present invention, FIG. 2 is an arrangement diagram of blocking timing signals of an embodiment according to the civil engineering invention, and FIG. FIG. 4 is a block diagram showing the configuration of the receiving side in an embodiment of the present invention; FIG. 5 is an audio in the satellite television broadcasting system; FIG. 6 is an explanatory diagram of the synchronization and performance data signal format in another embodiment of the present invention. FIG. 7 is another embodiment in which the present invention is applied to satellite television broadcasting. Fig. 8 is an arrangement diagram showing the signal format of a compact disc. 1...Microphone, 2...Audio PCM encoder, 3.19...Electric musical instrument, 4... MIDI encoder, 5... Simultaneous recorder, 6... Synchronous marker sending circuit, 7... Block marker addition circuit, 8... Delay circuit, 9... Compression encoding circuit, 10... Data array circuit, 11... Transmission path, 12... Data separation circuit, 13... Audio decoder, 14... Performance data memory, 15... Synchronization marker receiving circuit, 16... Decompression decoding 17... MIDI sending circuit, 18... Loudspeaker.

Claims (1)

[Claims] 1) On the transmission or recording side, encode audio information to extract an audio signal, encode performance information collected from a musical instrument to extract a performance signal, and encode the encoded audio signal. delay, segment the encoded performance signal at predetermined time intervals, add a marker signal indicating the timing of the segmentation to the performance signal, and process the segmented performance signal to which the marker signal is added. performs information compression code conversion, generates a synchronization signal based on the marker signal, mixes the delayed audio signal, the compressed performance signal, and the synchronization signal, and arranges the mixture according to a predetermined format. , the audio information and the performance information are transmitted in synchronization with the timing of the synchronization signal, and the receiving or reproducing side receives the transmitted signal and synchronizes the audio signal and the performance signal from the received signal. the separated audio signal is decoded; the separated performance signal is subjected to inverse conversion of information compression code conversion and then decoded; and the audio information and the performance information are synchronized. A voice/performance information transmission method characterized by playback. 2) a first encoding means for encoding audio information and extracting an audio signal; a second encoding means for encoding performance information collected from a musical instrument and extracting a performance signal; and the first encoding means. a delay means for delaying the audio signal extracted from the second encoding means; and segmenting the performance signal extracted from the second encoding means at predetermined time intervals, and adding a marker signal indicating the timing of the division to the performance signal. a segmentation means; a compression means for converting the performance signal segmented by the segmentation means and to which the marker signal has been added to an information compression code; and a synchronization generation means for generating a synchronization signal based on the marker signal. , arranging means for mixing the audio signal taken out from the delaying means, the performance signal taken out from the compression means, and the synchronization signal generated from the synchronization generation means, and arranging the mixture according to a predetermined format. A voice/performance information transmission system that is characterized by: