JP3172425B2 - Multimedia information transmission system, multimedia information reception system, multimedia information transmission method, and multimedia information reception method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to encoding, multiplexing, transmitting or storing digitized video, audio, and other data, receiving the transmitted signal or reading out a recorded signal, and converting the multiplexed signal. The present invention relates to a multimedia information processing system that reproduces video, audio, and other data by separating and decoding, and specific application examples include a video on demand (VOD), a digital broadcasting system, and a video conference system.

[0002]

2. Description of the Related Art FIGS. 26 and 27 show, for example, Hattori, Tanaka,
Asano, Asai, Sakado: "Satellite-based broadcast quality codec",
Mitsubishi Electric Technical Report, Vol. 67, no. 7, pp. 33-
38 is a configuration diagram showing a transmission device and a reception device of the multimedia information processing system shown in FIG. 38 (1993).

[0006] In FIG. 26 showing a transmitting apparatus, reference numeral 11 denotes a video encoding unit that performs information source encoding on a video signal 101 to generate a video encoded bit sequence 111, and 12 denotes one or more audio signals 102 related to the video signal 101. Source encoded one or more audio encoded bit strings 112
The audio encoding unit 13 generates the video signal 10
1 or various data signals 10 related to the audio signal 102
3 is subjected to various processes to obtain a data encoded bit string 1
13 is a data encoding unit that includes the video encoding unit 11, the audio encoding unit 12, and the data encoding unit 13, and 92 is a data encoding unit that generates the data encoding unit 13 from the information encoding unit 91. A conventional media multiplexing unit 93 that multiplexes the video coded bit sequence 111, one or more audio coded bit sequences 112, and one or more data coded bit sequences 113 to generate one multiplexed bit sequence 122;
Is a multiplexed bit string 12 according to the type and characteristics of the transmission path.
2, a scramble process and an error correction code are applied to the multiplexed bit sequence 122 and one or more other video and its associated audio / data multiplexed bit sequence 12.
3 is a conventional transmission processing unit that performs channel multiplexing processing and performs transmission frame configuration and modulation processing to generate a transmission signal 141.

In FIG. 27 showing a receiving apparatus, reference numeral 96 receives a transmission signal 141, demodulates, establishes and reproduces transmission frame synchronization, separates a channel multiplexed signal, selects a signal of a specific channel, and detects an error. A conventional reception processing unit for performing a correction process, a descrambling process, etc., to reproduce the multiplexed bit sequence 122 or one or more other video and the accompanying audio / data multiplexed bit sequence 123;
Reference numeral 95 denotes a conventional media separation unit that separates a video coded bit sequence 111, an audio coded bit sequence 112, and one or more data coded bit sequences 113 from a multiplexed bit sequence 122. Video decoding unit for reproducing the video signal 101, 15
Is an audio decoding unit that performs information source decoding on one or more audio encoded bit strings 112 to reproduce one or more audio signals 102 related to the video signal 101, and 16 performs various inverse processes on the data encoded bit strings 113. A data decoding unit 94 that performs and reproduces various data signals 103 related to the video signal 101 or the audio signal 102 is an information source decoding unit that includes a video decoding unit 15a, an audio decoding unit 15b, and a data decoding unit 15c.

Next, the operation of the conventional multimedia information processing system on the transmitting device side shown in FIG. 26 will be described. The information source encoding unit 91 includes a video encoding unit 11, an audio encoding unit 12, and a data encoding unit 13, and uses various encoding techniques to reduce redundant components of various signals. The video signal 101 and one or more associated audio signals 102 are encoded by a video encoding unit 11 and an audio encoding unit 12 at respective information sources, and a video encoded bit sequence 111 and an audio encoded bit sequence 112 are encoded. Becomes Various data signals 103 such as video and audio synchronization signals and control signals are subjected to information source encoding in the data encoding unit 13 in the same manner as in the case of video and audio, and the data structure is converted to one or more data encodings. Column 113 is generated.

[0006] In the conventional media multiplexing section 92, a video coded bit string 111 and an audio coded bit string 11
2 and the data encoded bit string 113 are multiplexed into one multiplexed bit string 122. Multiplexing is performed in units of a predetermined frame. FIG. 19 shows a conventional media multiplexing unit 9.
FIG. 4 is an explanatory diagram of a multiplexed frame multiplexed in 2. 80 is a multiplexed frame of a predetermined size, 81 is a synchronization information area for ensuring synchronization of the multiplexed frame 80,
82 is a video information area in the multiplexed frame 80, 83 is an audio information area in the multiplexed frame 80, and 84 is a data information area in the multiplexed frame 80. Video encoding bit string 111, audio encoding bit string 11
2. The data coded bit string 113 is stored in the video information area 82, the audio information area 83, and the data information area 84, respectively, and is read out in the order indicated by the arrow (from the upper left to the lower right) in FIG. 122 is generated. Performing multiplexing in units of such multiplexed frames is herein referred to as “structure multiplexing”.

The conventional transmission processing unit 93 has a general function of scrambling the multiplexed bit sequence 122, adding an error correction code to the multiplexed bit sequence 122, as shown in FIG. And performing a channel multiplexing process on the multiplexed bit string 122 and one or more other multiplexed bit strings 123 to form a transmission frame.
The transmission signal 141 is generated by performing a modulation process or the like.

The scramble processing will be described with reference to FIG. FIG. 30A shows a PN (Pseudo Random).
This is an example of a scrambling process called a Number (pseudo random number) signal addition method. In FIG. 30A, reference numeral 73a denotes a scramble pseudo-random number generator, and reference numeral 75 denotes an exclusive OR circuit. An initial value 72a is given to a scramble pseudo-random number generator 73a, and a pseudo-random number sequence 74
a is generated. The exclusive OR circuit 75 performs an exclusive OR operation of the original data 71 and the pseudo random number sequence 74a on a bit-by-bit basis to obtain scrambled data 76.

The configuration of an error correction frame when performing error correction coding will be described. FIG. 31 is a configuration diagram of an error correction frame when a Reed-Solomon (RS) code is used as the error correction code. In FIG. 31, 77 is an error correction frame, 78a is synchronization information for ensuring synchronization of the error correction frame 77, and 78b is M
Byte codeword (RS (M, MN) codeword), 79a
Is an information field for storing N-byte information symbols protected by error correction coding, and 79b is a check field for storing check symbols added for error detection.

A channel multiplexing method for the P channel will be described with reference to FIG. Each channel is
For example, it corresponds to an individual program (program) in a television broadcast. In FIG. 32, 90 is a channel multiplexing frame, and 90a is synchronization information for securing synchronization of the channel multiplexing frame 90. Channel (program) multiplexing is performed using a structure multiplexing method.

The transmission frame will be described with reference to FIG. The transmission frame depends on the characteristics of the transmission path. For example, each transmission frame is defined by wire transmission, satellite wave transmission, terrestrial wave transmission, or the like. FIG. 33 shows a configuration example of a transmission frame. In FIG. 33, reference numeral 92 denotes a transmission frame; 93, an additional information area in which timing information, synchronization information, information used for maintenance operation of a transmission path, and the like are entered;
4 is a transmission information area (payload). Information constituting the transmission frame 92 is read out in a predetermined order indicated by an arrow in the figure, and is transmitted as a transmission signal 141 to the transmission line via modulation.

Next, the operation of the conventional multimedia information processing system on the receiving device side shown in FIG. 27 will be described.
The operation on the receiving side is basically the reverse of the operation on the transmitting side described above. As shown in FIG. 29, the conventional reception processing section 96 demodulates a received transmission signal and then performs synchronization establishment / reproduction of a transmission frame, error detection / correction processing, and the like to reproduce a multiplexed bit string. That is, after demodulation of the received transmission signal 141, the synchronization of the transmission frame 92 (see FIG. 33) is established and reproduced using the synchronization information in the additional information area 93, and the transmission information area 94 is extracted. When the signal in the transmission information area 94 is channel-multiplexed, the synchronization information 90a (see FIG. 32) is used to establish and reproduce the synchronization of the channel multiplex frame 90 to separate the channel into individual channels. Synchronization information 78a (see FIG. 31) for the error-corrected coded signal
Is used to establish and reproduce the synchronization of the error correction frame 77 to perform error detection and correction.

Next, the descrambling process will be described with reference to FIG.
This will be described with reference to FIG. In FIG. 30B, 73
b denotes a pseudo-random number generator for descrambling, and 75 denotes an exclusive OR circuit. Pseudo random number generator 73 for descrambling
b is given an initial value 72b to generate a pseudo-random number sequence 74b. The scramble circuit shown in FIG.
In the descrambling circuit shown in (b), the scramble pseudo-random number generator 73a and the descrambling pseudo-random number generator 73b have the same configuration.
a and an initial value 72b, a pseudo random number sequence 74a and a pseudo random number sequence 74
b has the same value.

The conventional media separation unit 95 separates the multiplexed bit sequence 122 into a video coded bit sequence 111, one or more audio coded bit sequences 112, and one or more data coded bit sequences 113. The reproduction of the multiplexed frame 80 required for the separation is performed by detecting the synchronization information stored in the synchronization information area 81 in the multiplexed frame 80.

The information source decoding unit 94 includes a video coded bit sequence 111, one or more audio coded bit sequences 112, and one or more data coded bit sequences 113.
To the video decoding unit 15a and the audio decoding unit 1 respectively.
5b, the data decoding section 15c performs information source decoding or various inverse processing to perform video signal 101, video signal 1
One or more audio signals 102, video signals 101, or various data signals 103 related to the audio signal 102 according to 01 are reproduced.

[0016]

Since the conventional multimedia information processing system is configured as described above,
The processing contents of each processing unit and the interface signals between the processing units are fixedly allocated by the system, so that the versatility is poor. It was difficult to construct software and add processing functions with versatility between systems.

In the conventional multimedia information processing system, video, audio, and various data are multiplexed (structure multiplexed) by storing them in a predetermined area in a multiplexed frame. However, it has been difficult to efficiently multiplex in response to changes in the transmission speed of individual media to be multiplexed, the presence or absence of individual media, and the like. In addition, when the number of media to be multiplexed is large, the size of the multiplexed frame must be increased, and as a result, it takes a long time for the receiver to secure synchronization of the multiplexed frame.

Furthermore, in the conventional multimedia information processing system, it is difficult to exchange contents between different transmission media such as wireless and wired, and to immediately transmit the content over a plurality of transmission media. . For example, if the transmission signal is QAM (Quadrature Amplitude Modul
) or PSK (Phase Shift Keying), the general functions of the conventional transmission processing unit and reception processing unit are as shown in FIG. 29, while the conventional transmission processing unit when the transmission path is an ATM network. As shown in FIG. 34, the basic functions of the reception processing unit perform ATM physical layer processing, ATM layer processing, and ATM adaptation layer processing. Therefore, when exchanging contents between the multimedia information processing system connected to the ATM network and the multimedia information processing system connected to the transmission line by QAM modulation, some kind of adapter is required.
Even if the structure of the multiplexed stream is the same between the two systems, the adapter needs to support all the processing functions shown in FIGS. 29 and 34.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problems. A first object of the present invention is to form a hierarchical process in a series of processes from capturing of element media to transmission and recording. Specify the processing content for each layer,
Furthermore, by defining the signal format of input / output data in each layer, it is possible to make the service flexible such as mutual exchange between services such as broadcasting, communication, computer / storage, etc., while simplifying the hardware configuration And
It is another object of the present invention to provide a multimedia information processing system in which additional functions can be added and various applications can be developed.

The second object is that the number of media to be multiplexed on the transmitter side, the change in the transmission speed of each media,
Multiplexing is efficiently performed in response to the presence or absence of individual media. In addition, information that is needed immediately on the receiving side, such as control information, instruction information, and clock information, is multiplexed on the transmitter side so that the receiver side can easily and quickly access such information. It is an object of the present invention to provide a multimedia information processing system capable of transmission.

A third object is to enable efficient multiplexing by flexibly responding to changes in the transmission speed of individual media to be multiplexed, the presence / absence of individual media, and the like. It is an object of the present invention to provide a multimedia information processing system capable of easily and promptly exchanging contents between different transmission media and transmitting contents over a plurality of transmission media.

[0022]

SUMMARY OF THE INVENTION A multimedia information transmitting system according to the present invention comprises an application and a media.
Source coding for different types of signals such as
Generate each coded bit string, and
Immediately on the receiving side of control information and instruction information etc.
Other coded bit strings other than the information required for
Requirements for each media with a signal format compatible with the system
Source coding processing means for generating a raw packet sequence;
Immediately on the receiving side generated by the source coding processing means
Generated from coded bit strings other than the information necessary for
Element packet sequence for each layer to determine the signal type
Is stored in a fixed-length packet together with the
Generates fixed-length packet sequence by multiplexing per packet
Media multiplexing means and the media multiplexing means
A predetermined number of fixed-length packets are generated from the fixed-length packet sequence
Is generated by the information source coding processing means.
Along with an encoded bit string of information that is needed immediately on the receiving side,
Structure multiplexing to store in a frame of a predetermined size
Means and frames from this structure multiplexing means
A transmission with a transmission medium dependent transmission frame for the sequence
Transmission processing means for generating a transmission signal.
Also, a multimedia information receiving system according to the present invention.
Transmits a fixed number of fixed-length packets, such as control information and instruction information.
The encoding bit of information that is needed immediately on the receiving system side
Stored in a frame of a predetermined size along with the
Both transmissions have a transmission frame sequence that depends on the transmission medium.
A receiving processor that receives the transmitted signal and reproduces the multiplexed bit sequence
And a fixed length packet sequence from the multiplexed bit sequence,
Encoding video of information that is needed immediately on the book receiving system side
And the structure to be reproduced
Separated by the separation means and the above structure separation means for regeneration
The fixed-length packet from the fixed-length packet sequence
And an encoded video corresponding to the identification information for determining the type of the signal.
Media separation means for playing back a sequence of bits,
Immediately on the receiving system side reproduced by the receiver separation means
While decoding the encoded bit string of the information needed for
Reproduced from the fixed length packet sequence by the media separation means
Other than the information immediately required by the receiving system
Applications and media by decoding the coded bit sequence
Source decoding processing means for reproducing different types of signals such as
It is provided with. In addition, the multimedia according to the present invention.
The media information transmission method is based on multimedia information.
Perform source coding to generate each coded bit sequence
At the receiving end in the encoded bit string.
Other systems for encoded bit strings other than necessary information
Element pattern for each media with a signal format compatible with
Generates a packet sequence and immediately needs information on the receiving side
Element patterns for each medium generated from encoded bit strings other than
The row of packets is shared with identification information to determine the type of signal.
And store them in fixed-length packets and multiplex them in fixed-length packets.
To generate a fixed-length packet sequence,
A predetermined number of fixed-length packets are immediately transmitted from the
A predetermined size together with the encoded bit sequence of the information
Characterized by being stored in a frame of size and transmitted
It is. Further, the multimedia information receiving apparatus according to the present invention is provided.
The communication method is to send a fixed number of fixed-length packets
Predetermined information along with the encoded bit string of information needed immediately
Stored in a frame of the same size as the transmission medium.
Receiving a transmission signal having a dependent transmission frame sequence
Reproduce the multiplexed bit string and extract the fixed length
Packet sequence and immediately required for the main reception process
Separate from the coded bit string of information and reproduce each,
From the fixed-length packet sequence separated and played back,
Take out the packet and match the identification information to determine the type of signal.
The corresponding encoded bit string is reproduced, and
Of the information that is immediately required during the main reception process
While decoding the bit sequence, the fixed-length packet sequence
Information that is immediately required for the above-mentioned main reception process
Decoding encoded bit strings other than
Is reproduced .

[0023]

[0024]

[0025]

[0026]

[0027]

[0028]

[0029]

[0030]

[0031]

[0032]

[0033]

[0034]

[0035]

[0036]

[0037]

[0038]

[0039]

[0040]

[0041]

[0042]

[0043]

[0044]

[0045]

[0046]

[0047]

[0048]

[0049]

[0050]

[0051]

[0052]

[0053]

[0054]

[0055]

[0056]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiment 1 Hereinafter, an embodiment of a multimedia information processing system according to the present invention will be described with reference to the drawings. FIG. 1 is a block diagram of a transmission device in the multimedia information processing system according to Embodiment 1. In FIG. 1, reference numerals 1a, 1b and 1c denote an information source encoding processing unit, 2a and 2b denote packet multiplexing units, 3a, 3b and 3c denote transmission processing units, and 11a, 11b and 11c denote various types of video, audio and data. Media information, 12 is an element packet, 13a and 13b are multiplexed streams, 14a and 14
b and 14c are transmission signals subjected to transmission processing according to the specifications of the transmission medium.

Next, the operation will be described with reference to the drawings. In the information source encoding processing unit 1a or the information source encoding processing unit 1b or the information source encoding processing unit 1c corresponding to various applications, various media information 11a or 11b or 11c such as video, audio, and data are taken in.
Source information is encoded for media information in individual media units, an information source encoded bit sequence is generated for each media, and each information source encoded bit sequence is divided according to a predetermined frame or a predetermined time to generate a segment. Then, auxiliary information for performing media identification, packet synchronization, reproduction synchronization, etc. is added to each segment to generate an element packet 12 having a signal format compatible with other systems.

The packet multiplexing unit 2a divides the element packet 12 for each medium generated by the information source coding unit 1a or 1b or 1c and divides it into auxiliary information for performing media identification, packet synchronization, reproduction synchronization and the like. To generate a fixed-length packet, perform multiplexing in fixed-length packet units while performing speed matching, and generate a multiplexed stream 13 having a signal format compatible with other systems.
Generate a.

The packet multiplexing unit 2b multiplexes the element packets 12 for each medium generated by the information source coding means 1a or 1b or 1c in units of element packets while performing speed matching. Stream 1 with a signal format compatible with
3b is generated.

Although the transmitting apparatus in the multimedia information system according to the first embodiment includes the packet multiplexing section 2a or the packet multiplexing section 2b, it is possible to perform processing by providing either one of them. The packet multiplexed stream 13a or 13b is subjected to transmission processing according to the specifications of a transmission medium such as a wired transmission, a satellite wave transmission, and a terrestrial transmission and a storage medium by a transmission processing unit 3a or 3b or 3c, and the transmission signal is transmitted. 14a or 14b or 14c is generated and transmitted.

With the above-described configuration, the information source coding processing unit 1 generates the element packet 12, the packet multiplexing unit 2 generates the multiplexed stream 13, and the transmission processing unit 3
Outputs the transmission signal 14 depending on the transmission medium, so that a series of processes from the capture of the media information to the transmission process is hierarchized, and the processing content is defined for each hierarchy,
Furthermore, by defining the input / output data at each level, it is possible to make the service flexible, such as the exchange of mutual data between services such as broadcasting, communication, and computer / storage. At the same time, the hardware configuration has been simplified,
It is possible to add an additional function and the like, and it is possible to develop various applications.

Embodiment 2 FIG. 2 is a block diagram showing an internal configuration of a transmission device in the multimedia information processing system according to Embodiment 2. 2, the same reference numerals as those in FIG. 1 denote the same or corresponding parts, and a description thereof will be omitted.
As a new code, 230 is an element media capturing unit, 233 is a packet generation unit, 234 is a packet multiplexing unit, 235 is an error correction processing unit, 236 is a transmission framing unit, 237 is a modulation unit, 237 is packet data, 242 is packet data, 24
Reference numeral 3 denotes data after the error correction coding processing, and 244 denotes data after the transmission framing processing. In the second embodiment, as the information source encoding processing unit 1, an element media capturing unit 23 that edits and processes an element medium according to the medium.
0 is also added.

FIGS. 3 and 4 are explanatory diagrams illustrating the configuration of the element packet 12 and the multiplexing stream 13a according to the second embodiment. In FIG. 3, reference numeral 260 denotes auxiliary information in the element packet generated by the element packet generator 10 a, and reference numeral 261 denotes auxiliary information in the packet generated by the packet generator 233.

Next, the operation will be described with reference to the drawings. The element media capturing unit 230 captures element media such as video, audio, and data. The capturing method differs depending on the application. For example, in the case of FIG. The element media capturing units 230a, 230b, 2
It is assumed that 30c takes in. In the information source encoding processing section 1a, information is reduced by the encoding section 9 in order to reduce the information amount of the fetched data. This is performed by the packet generator 10a. The output data from the information source encoding unit 1a is an element packet 12.
Other information source coding processing units 1b and 1c perform the same processing.

A packet sequence is obtained by multiplexing the two types of element packets 12 output from the information source coding processing unit 1a by the packet multiplexing units 2a and 2b as a stream of the element packets 12 as one stream. A multiplexing stream 13 is generated. In the packet multiplexing unit 2a,
As shown in FIG. 3, first, the packet generator 233 generates auxiliary information 261a such as a media identifier and a packet synchronization code, and an N-bit fixed-length packet 242 so that the receiving side can extract necessary data. Further, the packet multiplexing unit 234a multiplexes the packet while performing speed matching to generate one transmission stream. The output format of the packet multiplexing unit 234a is a fixed-length packet sequence 13a. In the packet multiplexing unit 234b, as shown in FIG.
The variable length element packet 12 from the element packet generation unit 10a of each element medium is added to one or more packets with one piece of auxiliary information 261b to generate one packet.

In the transmission processing unit 3a, the packet multiplexing unit 2
The error correction processing unit 235 performs error correction encoding processing according to the transmission storage medium on the packet sequences 13a and 13b output by the transmission sequence a and the transmission framing unit 236a. After that, the signal is modulated by the modulator 237 in a form suitable for the electric signal on the transmission path.

In the transmission processing unit 3, data conversion is performed in a form depending on the transmission path.
Processing depending on the storage medium and the computer network is performed in the transmission processing units 3a, 3b, and 3c, respectively. For example, in the case of a computer network, the error correction processing unit 235d uses TCP (Transmission Control Protocol).
ocol) / UDP (User Datagram Protocol) / XTP (Xpr
The transmission framing unit 236d performs ess transport protocol (IP) processing, and further performs IP (Internet Protocol) processing, and transmits the data to a network via an internet protocol transmission path. When TCP is used, retransmission processing is performed when an error occurs during transmission, and reliable transmission without errors is guaranteed. When the reliability of the transmission path is high, UDP that is easy to process is used. XTP is used when the same data is simultaneously delivered to many IP address destinations. Here, the computer network
In the above, an example of connection to a network (for example, the Internet) has been described. However, TCP / UDP / XTP and IP
This can be performed by the data encoding unit 9c.

With the above configuration, as the information source encoding processing means, the element media capturing section 230,
An encoding unit 9 and an element packet generation unit 10 are provided to encode each piece of media information and add auxiliary information, and to generate an element packet having a signal format compatible between systems. This has the effect that the reproduction of each piece of media information is facilitated.

The packet multiplexing unit 2 includes a packet generating unit 233 and a packet multiplexing unit 234. The packet multiplexing unit 2 adds auxiliary information for performing media identification, packet reproduction synchronization, and the like corresponding to the media information. Since a multiplexed stream is generated by performing packet speed matching and multiplexing, it is possible to cope with a change in the transmission speed of each medium to be multiplexed and to easily separate the multiplexed stream into element packets. This has the effect.

As a packet multiplexing unit, auxiliary information is added so that the receiving side can extract necessary data, a fixed-length packet is generated, and multiplexing is performed while performing speed matching in units of the fixed-length packet. Since a fixed-length packet sequence is generated in this way, it is possible to cope with a change in the transmission speed of each medium to be multiplexed, and to easily separate the fixed-length packet sequence into element packets.

Further, the transmission processing unit 3 includes an error correction processing unit 2
35, a transmission framing unit 236, and a modulation unit 237, and includes error correction, transmission framing processing, and modulation processing according to the transmission storage medium such as broadcast, communication, and digital storage medium. Is performed to output a transmission signal, so that there is an effect that a transmission signal corresponding to a transmission medium, a storage medium, and the like can be output.

Further, the transmission processing unit 3 performs the TCP / UDP / XTP processing on the multiplexed stream and then performs the IP processing and sends the multiplexed stream to the Internet protocol transmission path. There is an effect that the transmitted signal can be transmitted.

Embodiment 3 FIG. 5 is a block diagram showing another aspect of the transmission device in the multimedia information processing system according to Embodiment 3. In FIG. 5, 403
Is a software processing unit on which the application program operates, 501 is an information coding processing unit whose processing content is changed by a control signal 401 from the software processing unit 403, and 502 is a processing content by a control signal 402 from the software processing unit 403. Is a packet multiplexing unit to be changed.

Next, the operation will be described with reference to the drawings. From the application program operating in the software processing unit 403, the operation mode instruction signal 401 is transmitted to the information encoding processing unit 501 by the packet multiplexing unit 50.
2, the operation mode instruction signal 402 is output. From the editing / processing application program that generates the element packet 12, the operation mode instruction signal 401 is encoded, for example, when the encoding units 9a and 9b shown in FIG. 2 are a video encoding unit and an audio encoding unit. Part 9a
The coding unit 9 includes the spatio-temporal resolution of the video to be coded, the coding algorithm, the bit rate, and the coding quality.
An audio encoding algorithm, a sampling frequency, an encoding bit rate, and the like are given to b. Also, from the program application program that generates the multiplexed stream 13,
The type, content, and number of programs composed of video, audio, data, and the like, the amount of information given to each program, and the like are given.

Here, the program is composed of a combination of video, audio, or data, such as a normal television program composed of video and stereo audio, or a character composed of only character data. There are types such as a broadcast program and an audio-only audio program. Further, among television programs, there are types of programs having different resolution formats, such as a standard television having an aspect ratio of 4: 3 and EDTV and HDTV having an aspect ratio of 16: 9. In addition, various types of program contents such as drama, sports, entertainment, shopping, etc. can be considered. An operation mode instruction signal 402 is set as the selection information by the application program and sent to the packet multiplexing unit 502.

With the above configuration, the application program of the software processing unit 403 allows
The source coding process or the packet multiplexing operation can be changed in accordance with the application, the source coding process or the packet multiplexing process can be changed flexibly, and a wider service can be provided in the same system. It becomes possible. That is, the spatio-temporal resolution, encoding algorithm, bit rate of video are edited and edited by an application program.
And the encoding quality can be freely set according to the input material of the element media, and there is an effect that an appropriate information encoding process according to the situation can be performed. Further, there is an effect that the program contents transmitted by the packet multiplexing unit can be freely changed by the program scheduling application.

Embodiment 4 FIG. 6 is a block diagram showing a part of a transmission apparatus of another aspect in the multimedia information processing apparatus according to Embodiment 4. In FIG. 6, 41
0 is an element packet storage unit, 411 is an address management unit, 4
Reference numeral 12 denotes an element packet sending unit.

Next, the operation will be described with reference to the drawings. Element packets 12 having a signal format compatible with other systems are stored in the element packet storage unit 4 in units of element packets.
10 are stored. At this time, the stored element packet 1
The address information 420 indicating the position (directory) of the element packet storage unit 410 in which the contents of No. 2, that is, information such as the media type and the packet length, is recorded is sent to the address management unit 411. At the time of reading, the read address information 4 which is the storage position of the element packet 12 is used.
20 is output from the address management unit 411 to the element packet storage unit 410, and a transmission instruction 421 is output to the element packet transmission unit 412. The element packet storage unit 410 reads the element packet 12 based on the address information 420 and outputs the element packet 12 to the element packet sending unit 412. Element packet sending unit 412
Then, the element packet 12 is output to the packet multiplexing unit 2 according to the transmission instruction 421.

With the above configuration, the order of the element packets 12 can be changed in non-real time by extracting and outputting the element packets 12 stored in the element packet storage section 410 according to the purpose. Thus, it is possible to easily change the order of the programs in units of the element packet 12. In particular, since necessary data multiplexing and transmission processing can be performed when necessary, there is no need to perform encoding processing in real time, and there is no need to perform encoding again when repeatedly transmitted. There is an effect that shortening and efficiency can be achieved. Furthermore, since various media information is stored by reducing the amount of information by information source coding, it is possible to reduce the storage capacity. In addition, since each media information is stored individually for each medium, it can be used for multiplexing. This has the effect that the selection of media can be changed.

Embodiment 5 FIG. 7 is a block diagram showing a part of a transmission apparatus of another aspect in the multimedia information processing apparatus according to Embodiment 5. In FIG. 7, 41
3 is a multiplexed stream storage unit, 414 is a program management unit that stores the address where the multiplexed stream storage unit 413 stores the multiplexed stream 13, and 415 extracts and outputs the specified multiplexed stream 13. This is a program sending unit that performs

Next, the operation will be described with reference to the drawings. The multiplexed stream 13 having a signal format compatible with other systems is stored in the multiplexed stream storage unit 413. At this time, the address information 422 indicating the position (directory) of the multiplexed stream storage unit 413 in which information such as the content and capacity of the stored program is recorded is sent to the program management unit 414. When transmitting a program, the read address information 42, which is the storage position of the multiplexed stream,
3 indicates a program transmission instruction 4 to the multiplexed stream storage unit 413.
23 is output from the program management unit 414 to the program transmission unit 415. The multiplexed stream storage unit 413 reads out the multiplexed stream 13 based on the address information 422 and outputs it to the program transmission unit 415. The program transmission unit 415 outputs the multiplexed stream 13 to the transmission processing unit 3 according to the transmission instruction 423.

With the above configuration, the multiplexed stream 13 stored in the multiplexed stream storage unit 413
Is output according to the purpose, and the order of the multiplexed stream 13 can be changed in non-real time.
3 can be easily performed. In particular,
Since necessary data transmission processing can be performed when necessary, there is no need to perform encoding processing in real time, and there is no need to re-encode and multiplex when transmitting repeatedly, thus shortening the processing.・ Efficient efficiency is achieved. Further, since various types of media information are stored after the amount of information is reduced by information source coding, there is an effect that the storage capacity can be reduced.

Embodiment 6 FIG. FIG. 8 is a block diagram showing a receiving device in the multimedia information processing system according to Embodiment 6. 8, the same reference numerals as those in FIG. 1 denote the same or corresponding parts, and a description thereof will be omitted. As new codes, 6a, 6b and 6c are information source decoding processing units, and 5a
And 5b are packet separation units, and 4a, 4b and 4c are reception processing units.

Next, the operation will be described with reference to the drawings. The reception processing unit 4a, 4b, or 4c receives a transmission medium such as a wired transmission, a satellite wave transmission, and a terrestrial transmission, and a transmission signal 14a, 14b, or 14c corresponding to the specification of the transmission medium, and receives the packet multiplexed stream 13a or 14c. 13b is played.

The packet separation unit 5a separates fixed-length packets, which are components of the multiplexed stream 13a, by using auxiliary information for performing media identification, packet synchronization, reproduction synchronization, and the like attached to the fixed-length packets. Then, the element packet 12 for each medium is reproduced.

In the packet separating section 5b, the element packet 1
2, the element packet 12 which is a component of the multiplexed stream 13b is separated by using auxiliary information for performing media identification, packet synchronization, reproduction synchronization, etc.
The element packet 12 for each medium is reproduced.

Although the receiving device in the multimedia information system according to the present embodiment includes the packet separating unit 5a or the packet separating unit 5b, it is possible to perform processing by providing either one of them.

The information source decoding processing unit 6a, the information source decoding processing unit 6b, or the information source decoding processing unit 6c captures the element packet 12 for each medium and converts the packet using the auxiliary information given to the element packet 12. Detect and separate each element packet 12 into auxiliary information and segments,
By connecting segments for each medium, an information source coded bit string is reproduced in units of media, and by decoding these coded bit strings as an information source, various types of media information 11a or 11a such as video, audio, and data are reproduced.
b or 11c is reproduced. When reproducing these various types of media information from output devices such as a display and a speaker, synchronization between media and presentation timing are secured using the above-described auxiliary information.

With the above configuration, the receiving apparatus in the multimedia information processing system receives the packet-multiplexed transmission signal 14 according to the specification of the transmission medium, and reproduces the information source coded bit string for each medium. A series of processes up to the decoding of the information source are hierarchized, the processing contents for each layer are defined, and the input / output data in each layer processing is further defined.
Data, broadcasting, communications, computer
It is possible to make the service flexible, such as mutual data exchange between services such as storage, and at the same time, the hardware configuration is simplified, and additional functions can be added. Development of various applications becomes possible.

The packet separation unit 5b separates individual element packets from the multiplexed stream in units and outputs the separated element packets to the information source decoding processing unit 6, so that the media information corresponding to each medium is converted into the element packet. This has the effect of being able to output in units. Further, the packet separating unit 5a
Is separated from the multiplexed stream in units of fixed-length packets, reconstructed into elementary packets, and
, So that high-speed processing can be performed.

Embodiment 7 FIG. FIG. 9 is a block diagram showing a receiving device in the multimedia information processing system according to Embodiment 7. 9, the same reference numerals as those in FIG. 8 denote the same or corresponding parts, and a description thereof will be omitted. 250 is a demodulation unit, 251 is a transmission deframing unit, 252 is an error correction processing unit, 253 is a packet separation unit, 254 is a packet analysis unit, and 255 is a decoded data display unit.

Next, the operation will be described with reference to the drawings. The transmission signal 14 depending on the transmission medium or the recording medium is input to the reception processing unit 4a. The input transmission signal 14 is converted by the demodulation unit 250 into digital data 24 independent of the transmission path.
4 is converted. Demodulated digital data 244
Is subjected to format inverse conversion by the transmission deframing unit 251. Further, if there is an error by the error correction unit 252, error correction is performed, and the error-free transmission stream 1
3 is decrypted. Since the reception processing unit 4 depends on communication, broadcasting, storage, a computer network, and the like,
The reception processing unit 4 is described as an example and corresponds to each transmission medium.
a, reception processing unit 4b, reception processing unit 4c, reception processing unit 4d
As shown. For example, since the reception processing unit 4d depends on a computer network or the like, the data transmitted from the Internet protocol transmission path is subjected to IP processing, and then subjected to TCP / UDP / XTP processing to be packet-multiplexed. Received stream.

The data output by the reception processing unit 4 is processed by the packet separation unit 5. When the input data is the multiplexed stream 13a, it is processed by the packet separation unit 5a. The packet separation unit 253a separates only data required by the receiving side from the multiplexing stream 13a. Necessary packets are separated based on the auxiliary information added to each. The separated packet 242 further discards the identifier and the like by the packet analysis unit 254 and decodes the element packet 12.

When the input data of the packet separating section 5 is the multiplexing stream 13b, it is processed by the packet separating section 5b. The packet separation unit 253b separates only the data required by the receiving side from the multiplexing stream 13b. Necessary packets are separated based on the auxiliary information added to each. The separated packet 242 further discards the identifier and the like by the packet analysis unit 254 and decodes the element packet 12.

In the information source decoding unit 6, the element packet 12 for each element medium inputted from the packet separation unit 5
Is decoded by the element packet separating unit 10 into information source encoded data 111 without auxiliary information. Further, the decoding unit 15 performs decoding for each element medium. The decoded data is displayed on the decoded data display unit 255.
Then, reproduction such as display is performed by synchronizing the respective element media.

With the above configuration, the information source decoding processing means includes the element packet separation unit 10, the decoding unit 15, and the decoded data display unit 255 as the decoded data reproduction means. From the auxiliary information and the encoded element media information, and also decodes and synchronizes the encoded element media information and reproduces the media information. There is an effect that reproduction becomes possible.

Further, since the reception processing unit 4 performs IP processing on data transmitted from the Internet protocol transmission path, performs TCP / UDP / XTP processing, and receives a packet-multiplexed stream. There is an effect that reception processing suitable for the Internet protocol transmission path can be performed.

Further, the reception processing unit 4 includes a demodulation unit 250,
Transmission deframing unit 251 and error correction processing unit 252
And reproduces the multiplexed stream by performing demodulation, deframing, and error correction decoding in accordance with the characteristics of the transmission medium that transmitted the packet multiplexed signal. There is an effect that a multiplexed stream can be reproduced by receiving a signal and performing error correction decoding.

Embodiment 8 FIG. FIG. 10 is a block diagram showing a part of a receiving apparatus according to Embodiment 8 including an error correction decoding unit in which the function of error correction processing unit 252 shown in FIG. 9 is changed. In FIG. 10, reference numeral 430 denotes an error correction decoding unit;
32 is a packet separation unit.

Next, the operation will be described with reference to the drawings. The error correction decoding unit 430 receives the digital data 243 that has been inversely formatted by the transmission deframing unit 251, and
The synchronization of the error correction frame is established and reproduced, and a bit or byte error in the error correction frame is corrected using a check symbol, and the multiplex stream 13 is output. Further, the error correction decoding unit 430 outputs an error generation signal 431 to the packet separation unit 432 to indicate that an error remains in the multiplexed stream 13 for the error correction frame when the error correction code exceeds the correction capability of the error correction code. I do. The packet demultiplexing unit 432 performs a process such as not demultiplexing the element packet 12 on the multiplexed stream 13 in which the error remains indicated by the error occurrence signal 431.

At the same time, the error correction decoding section 430
It is also possible to output to the packet demultiplexing unit 432 the multiplexed stream 13 in which the data of the error remaining portion is replaced with, for example, dummy data whose values are all “1”.

With the above configuration, when an uncorrectable error occurs, error correction decoding section 430
Along with the multiplexed stream to be output, an error generation signal 431 indicating that an error exists is output to the packet separation unit 432, and the packet separation unit 432 outputs the error generation signal 4
If the packet separation unit 432 receives the error signal 431 and receives the error occurrence signal 431, it does not separate the multiplexed stream 13, so that the decoding error and the reproduction error of the information source decoding processing unit 6 can be prevented. At the same time, decoding errors and transmission errors can be separated, which has the effect of facilitating system operation management.

Embodiment 9 FIG. FIG. 11 is a block diagram showing another mode of error correction decoding section 430 shown in FIG.
10 denote the same or corresponding parts, and a description thereof will be omitted. In FIG. 11, 430a is an error correction decoding unit,
An information source decoding unit 433 processes the separated erroneous element packets 12.

Next, the operation will be described with reference to the drawings. The error correction decoding unit 430a receives the digital data 243 that has been subjected to the inverse format conversion by the transmission deframing unit 251 and establishes and reproduces the synchronization of the error correction frame. Is corrected using the check symbol, and the multiplexed stream 13 is output to the packet demultiplexing unit 5, and an error occurrence signal 431 indicating that an error remains is output to the information source decoding processing unit 433. The information source decoding processing unit 433 stops the decoding of the encoded data included in the element packet 12 in which the error has been indicated by the error occurrence signal 431 during the period, and decodes the encoded data when the encoded data becomes normal. Resume. As a result, the encoded data already known to have an error is not decoded, so that the occurrence of a decoding error or a reproduction error of the decoder can be prevented. Further, it is possible to distinguish between a decoding error and a transmission error, and the operation management of the device system becomes easy.

With the above-described configuration, when an uncorrectable error occurs, error correction decoding section 430a outputs error-generated signal 431 indicating that an error exists together with the multiplexed stream to be output, to information. Source decoding processing unit 4
33, the information source decoding processing section 433, when the error occurrence signal 431 is input, does not perform the information source decoding, so that the decoding error and the reproduction error of the decoder can be prevented and the decoding error can be prevented. And transmission error.
There is an effect that the operation management of the system becomes easy.

Embodiment 10 FIG. FIG. 12 is a block diagram showing another aspect of the receiving device of the multimedia information processing system of the present invention. In FIG. 12, reference numeral 434 denotes a software processing unit on which an application program operates;
503 is a control signal 43 from the software processing unit 434
A packet separation unit whose processing content is changed by 6;
04 is a control signal 435 from the software processing unit 434
Is an information source decoding processing unit whose processing content is changed by (1).

Next, the operation will be described with reference to the drawings. The software processing unit 434 exchanges a control signal 435 with the information source decoding processing unit 504 and a control signal 436 with the packet separation unit 503 by using an application program that operates therein. First, information of a program composed of video and audio multiplexed in the multiplexing stream 13 is transmitted from the packet separation unit 503 to the control signal 436.
Is passed to the program selection (navigation) application program operating in the software processing unit 434. From the application program, an identifier number of the element packet 12 necessary for composing a program selected by the user from the received program information (program catalog) or the like is used as a control signal 436 as a control signal 436.
Give to 03. The packet separating unit 503 selects and outputs the element packet 12 from the multiplexing stream 13 based on the given identifier number.

On the other hand, the decryption application program running on the software
The information source decoding processing unit 504 performs reproduction control of the element packets 12 such as video, audio, and data selected by 35. For playback control, high-speed playback, slow playback,
In addition to reverse playback, there are a number of audio channels to be played back and a video resolution selection.

With the above configuration, the operations of the packet separation unit and the information source decoding processing unit can be appropriately switched by the application program, and a more versatile multimedia information processing system can be realized. That is, the program selection (navigation) application program allows the user to select a program that suits the purpose, thereby improving convenience and operability.
In addition, the decryption application program allows the user to instruct special reproduction such as high-speed reproduction and to select a decryption method, which has the effect of realizing more functions.

Embodiment 11 FIG. FIG. 13 is a block diagram showing another aspect of the receiving apparatus of the multimedia information processing system according to the present invention. In FIG. 13, reference numeral 416 denotes a reception element packet storage unit, 417 denotes a reception program management unit, and 418 denotes a reception element packet reading unit. These elements are further provided in the packet separation unit.

Next, the operation will be described with reference to the drawings. Element packets 12 having a signal format compatible with other systems are stored in the reception element packet storage unit 416 in units of element packets. At this time, the address information 424 indicating the location (directory) of the element packet storage unit 416 in which the content of the received element packet to be stored, that is, information such as the media type and packet length, is transmitted to the received program management unit 417. Can be At the time of reading, the read address information 4 which is the storage position of the element packet is used.
24 is output from the received program management unit 417 to the reception element packet storage unit 416 and the program read instruction 425 is output to the reception element packet read unit 418. The receiving element packet storage unit 416 reads out the element packet 12 based on the address information 424 and outputs it to the receiving element packet reading unit 418. The receiving element packet reading unit 418 outputs the element packet 12 to the information source decoding processing unit 6 in accordance with the program reading instruction 425.

With the above-described configuration, the reception element packet storage section 416, the reception program management section 417, the reception element packet reading section 41
8 is provided, and element packets required for program reproduction are output from the received element packet storage section 416 in accordance with an instruction from the received program management section 417, so that necessary data packet separation and separation can be performed when necessary. The information source decoding process and the like can be performed, so that the information source decoding process does not need to be performed in real time, and can be used repeatedly whenever the receiver wants to view the contents, thereby improving the convenience. Also, by changing the order of the element packets 12 stored in the reception element packet storage unit 416 and outputting them, even when encoding and transmission in real time is impossible or when the contents of reception cannot be immediately heard, Processing in non-real time becomes possible. Furthermore, since each piece of media information is not accumulated after performing the information source decoding process, there is an effect that the storage capacity can be reduced.

Embodiment 12 FIG. FIG. 14 shows Embodiment 12
FIG. 10 is a block diagram showing another aspect of the multimedia information processing system according to the first embodiment. 1, 2, 8, and 9 denote the same or corresponding parts, and a description thereof will not be repeated. FIG.
, 270 is a packet remultiplexing unit.

Next, the operation will be described with reference to the drawings. Transmission signals 14e and 14f input from two different transmission paths
Are input to different reception processing units 4e and 4f, respectively. In the reception processing units 4e and 4f, the demodulation units 250e and 250f respectively demodulate the digital signal 244 independent of the transmission path.
The format is inversely converted by 51e and 251f. Further, if there is an error in each data by the error correction units 252e and 252f, the error is corrected, the multiplexing stream 13a without error is decoded, and the reception processing unit 4e,
4f.

One of the output multiplexed streams 13a
Is decomposed into one fixed-length packet 242 by one packet separation unit 253a.

The other fixed-length packet 242 output from the other packet separating unit 253a is re-allocated to the one fixed-length packet together with auxiliary information such as an identifier by the packet re-multiplexing unit 270. It is generated as one multiplexed stream 13c and output to the transmission processing unit 3e.

In the transmission processing unit 3e, the packet remultiplexing unit 2
After the multiplexed stream 13c output by 70 is subjected to error correction processing by an error correction processing unit 235g and further converted by a transmission framing unit 236e into a format depending on the transmission path, the modulation unit 237e
Thus, the signal is modulated in a form suitable for the electric signal on the transmission line, and is output to the transmission line 3 as a new transmission signal 14g. With the above configuration, a packet sequence from a plurality of transmission paths is output to another transmission path as one new packet sequence.

When there is no transmission signal 14f input from the transmission path 2 or when the transmission capacity of the transmission signal 14g of the transmission path 3 output is smaller than the input, the packet remultiplexing unit 270 The element packets are selected so as to match the transmission capacity of the transmission path 3 and output to the transmission path 3 after speed matching.

As described above, a plurality of reception processing units 4e and 4f which receive a packet multiplexed signal from one or more transmission media and generate a multiplexed stream for each transmission media decoded.
A plurality of packet separation units 253a for separating the packet multiplexed stream into element packets for each transmission medium, a packet remultiplexing unit 270 for packet multiplexing the element packets into one multiplexed stream, and an output of the packet remultiplexing unit 270. And a transmission processing unit 3e for outputting a multiplexed stream to the transmission medium as a transmission signal in accordance with the characteristics of the transmission medium. It is possible to define the processing contents and further define the input / output data in each layer processing. Services such as mutual data exchange between services such as broadcasting, communication, computer / storage, etc. In terms of flexibility, the hardware configuration is simplified, additional functions can be added, and various applications can be developed. There is a result.

Embodiment 13 FIG. FIG. 15 shows a thirteenth embodiment.
1 is a block diagram illustrating a configuration of a transmission device in a multimedia information processing system according to the first embodiment. In FIG.
a is a video encoding unit that performs information source encoding on the video signal 101 to generate a video encoded bit sequence 111, and 9b is one or more audio signals 1 related to the video signal 101.
An audio encoding unit 9 that performs information source encoding to generate one or a plurality of audio encoded bit strings 112;
c is a data encoding unit that performs various processes on various data signals 103 related to the video signal 101 or the audio signal 102 to generate a data encoded bit string 113.
0a is an element packet generator, 1 is a video encoder 9a, an audio encoder 9b, a data encoder 9c, and an element packet generator 10a. To generate the respective encoded bit strings.

Reference numeral 97a denotes a media multiplexing unit for storing each coded bit string in fixed-length packets together with identification information for discriminating the type of signal and performing multiplexing in units of fixed-length packets. 98a denotes a multiplexed bit string. 151 and a predetermined number of fixed-length packets from these fixed-length packet sequences along with various data based on information 113b that is immediately required on the receiving side such as control information, instruction information, clock information, etc. Is a transmission processing unit that generates a transmission signal having a transmission frame depending on a transmission medium with respect to the frame sequence from the structure multiplexing unit 98a, according to the type and characteristics of the transmission path. , The scramble processing, the addition of an error correction code to the multiplexed bit sequence 152, and one or more multiplexed bit sequences 152. Performs channel multiplexing process to the audio data multiplexed bit sequence 153 associated with a plurality of other video and its configuration of the transmission frame, and generates a transmission signal 141 by performing a modulation process and the like.

Next, the operation will be described with reference to the drawings. The information source encoding unit 1 includes a video encoding unit 9a, an audio encoding unit 9b, a data encoding unit 9c, and an element packet generation unit 1.
0a, and performs redundant component reduction and packetization of various signals using various encoding methods. Video signal 1
01 and one or more audio signals 102 related to the video signal 101 are source-coded by a video encoding unit 9a and an audio encoding unit 9b, respectively, and a video encoded bit sequence 111 and one or more audio codes are encoded. The generated bit string 112 is generated. Various data signals 103 such as video and audio synchronization signals and control signals are subjected to information source coding and data structure conversion in the data coding unit 9c in the same manner as in the case of video and audio, and are subjected to data coding. 113 is generated.

In the element packet generator 10a, in the input video coded bit sequence 111, audio coded bit sequence 112, or data coded bit sequence 113, the receiving side such as control information, instruction information, clock information, etc. Bit string 113 of information other than necessary information
a, generating segments by dividing them according to a predetermined frame or a predetermined time, and adding auxiliary information for performing media identification, packet synchronization, reproduction synchronization, and the like to each of these segments to provide other systems. A component packet sequence 114 or 115 or 116 for each medium having a signal format compatible with the above is generated.

In the media multiplexing section 97a, the element packet sequence 11 for each medium generated by the information source coding processing section 1 is output.
4 or 115 or 116 is input to perform packet multiplexing to generate a multiplexed packet sequence 151. Note that the configuration and operation of the media multiplexing unit 97a in this embodiment are the same as those of the packet multiplexing unit 2a or the packet multiplexing unit 2b shown in FIG.

In the structure multiplexing section 98a, information 113b which is immediately required on the receiving side, such as control information, instruction information, clock information, etc., in the data coded bit string 113 not multiplexed by the media multiplexing section 97a. Is multiplexed with a multiplexed packet sequence 151 to generate a multiplexed bit sequence 152.

In the transmission processing unit 99a, a multiplexed bit string 152
, A scramble process, an error correction code, a channel multiplexing process between the multiplexed bit sequence 152 and one or more other multiplexed bit sequences 153, a transmission frame configuration, a modulation process, and the like, to perform a transmission signal 141. Generate

As described above, the transmitting apparatus in the multimedia information processing system performs information source coding on signals of different types, such as applications and media, to generate respective coded bit strings. And a media multiplexing / demultiplexing unit that stores each coded bit string together with identification information in a fixed-length packet and multiplexes the fixed-length packet unit to generate a fixed-length packet string; Multiplexing unit for storing a fixed-length packet together with various data in a frame of a predetermined size, and a transmission process for generating a transmission signal having a transmission frame depending on a transmission medium for a frame sequence from the structure multiplexing unit And multiplexing, since media multiplexing is performed in fixed-length packet units. Changes in individual media transmission rate to an effect that flexibly respond to the presence or absence of individual media may send a transmission signal by multiplexing.

Further, the structure multiplexing unit multiplexes signals, such as control information, instruction information, and clock information, which are required immediately by the receiving side, together with fixed-length packets as various data. The signal is not multiplexed in packet units, but is multiplexed with a fixed-length packet sequence, so that the receiver can easily obtain only the information that the receiving side needs immediately before separating the multiplexed packet sequence. And transmission and reproduction of a signal can be quickly performed.

Embodiment 14 FIG. FIG. 16 shows Embodiment 14
1 is a block diagram showing a receiving device in a multimedia information processing system according to the first embodiment. In FIG. 16, 99b is a reception processing unit, 98b is a structure separation unit, 97b is a media separation unit, 6 is a video decoding unit 14, an audio decoding unit 15b, a data decoding unit 15c, and an element packet decomposing unit 1.
0b.

Next, the operation will be described with reference to the drawings. The operation according to the fourteenth embodiment is the reverse of the operation of the transmitting device in the multimedia information processing system shown in FIG. The reception processing section 96 performs demodulation processing of the received transmission signal 141, synchronization establishment / reproduction of a transmission frame, channel separation, error detection / correction, descrambling processing, and the like, and performs a multiplexed bit string 153 for one or more different channels. Is reproduced.

The structure separating section 98b separates the structure of the multiplexed bit string 152 and immediately reproduces the multiplexed packet string 151 and the necessary information 113b such as control information, instruction information and clock information on the receiving side. Information 113b that is required immediately on the receiving side, such as control information, instruction information, and clock information, is immediately used via a data decoding unit 15c described later.

The media separation section 97b separates the multiplexed packet sequence 151 and reproduces the element packet sequence 114 or 115 or 116 for each medium. The configuration and operation of the media separation unit 97b in this embodiment are the same as those of the packet separation unit 5a or 5b shown in FIG.

The information source decoding unit 6 inputs the element packet sequence 114 or 115 or 116 for each medium to the element packet decomposing unit 10b, and converts each element packet using auxiliary information given to each element packet. The information is divided into auxiliary information and segments, and the segments are connected to form a video encoded bit sequence 111, an audio encoded bit sequence 112, or a data encoded bit sequence 113.
To play. These reproduced encoded bit strings are subjected to an information source decoding process or various inverse processes in a video decoding unit 14, an audio decoding unit 15b, or a data decoding unit 15c, to thereby produce a video signal 101, an audio signal 102, or various data signals 103. Is played.

As described above, the receiving apparatus in the multimedia information processing system stores a predetermined number of fixed-length packets together with various data in a frame of a predetermined size, and transmits a transmission frame sequence depending on the transmission medium. A reception processing unit 99b that receives the transmission signal and reproduces a multiplexed bit sequence, a structure separation unit 98b that reproduces a fixed-length packet sequence and various data from the multiplexed bit sequence, and extracts a fixed-length packet from the fixed-length packet sequence. A media separation unit 97b that reproduces an encoded bit sequence corresponding to identification information for discriminating the type of signal, and an information source decoding processing unit 6 that decodes the encoded bit sequence and reproduces signals of different types such as applications and media. Before demultiplexing the multiplexed packet sequence, a predetermined address in the structure multiplex frame is used. By accessing, only the separating real information required to the command and the like from the transmission device, so that it is quick response.

Further, the structure separating section 98b includes:
Various data signals, such as control information or instruction information or clock information, which are multiplexed immediately, are separated from fixed-length packets, so that various data required from a multiplexed bit string are immediately required. There is an effect that only the information to be reproduced can be reproduced.

Embodiment 15 FIG. FIG. 17 shows Embodiment 15
FIG. 10 is a configuration diagram showing another mode of the transmission device in the multimedia information processing system according to the first embodiment. In FIG. 17, 1
00 is an information source coding unit, 200 is a media multiplexing unit, 3
00 is a fixed-length packet generator, and 400 is a transmission path encoder.

Next, the operation will be described. As shown in FIG. 18, the information source coding unit 100 includes a video coding unit 61, an audio coding unit 62, and a data coding unit 63, and uses various information source coding methods. To reduce redundant components of various signals. Video signal 1
1a is source-coded by the video coding unit 61 to become a video coded bit stream 12a. The audio signal 11b is source-coded by the audio coding unit 62 to become an audio coded bit stream 12b. Various data signals 11c, such as video and audio synchronization signals and control signals, are subjected to data source encoding in the data encoding unit 63 in the same manner as in the case of video and audio, or data encoding is performed by changing the data structure. It becomes stream 12c.

In the media multiplexing section 200, each of the coded bit streams 12a, 12b and 12c generated by the information source coding section 100 is subjected to ISO / IEC 13813-1 (MPEG-2 Sy
multiplexed stream 13 called a transport stream (TS) or a program stream (PS).
Generate

The fixed-length packet generator 300 maps the multiplexed stream 13 to fixed-length packets. FIG. 19 shows the relationship between the case where a TS is used as the multiplexed stream 13 and an ATM cell is used as the fixed-length packet. Two TS packets (one TS packet is 188 bytes) are transferred to the ATM adaptation layer (AA).
L) Type 5 CPCS (Common Part Convergence Su)
blayer)-Stored in the payload of PDU (Protocol Data unit).

When the PS is mapped to the ATM cell, a packet (generally, a variable length packet) constituting the PS is stored such that the beginning of the packet coincides with the beginning of the AAL type 5 CPCS-PDU payload. The length of the packet constituting the PS is set to an integral multiple of the length of the CPCS-PDU payload, and the packet head is stored so as to match the head of the CPCS-PDU payload. A variable length packet may be packed in the CPCS-PDU payload.

The TS or PS may be stored in the AAL type 1 payload (47 bytes), and the method of storing the packet matches the head of the payload as in the case of storing the PS in the AAL5 payload. Packets may be stored in this way, or packets may be sequentially packed without being aware of the boundaries of the payload.

The transmission path coding section 400 has a general function as shown in FIG.
0, the scramble processing, the configuration of a transmission frame, the provision of an error correction code, the modulation processing, etc. are performed on the multiplexed bit stream 14a in accordance with the type and characteristics of the transmission path. The transmission signal 15 is generated. If the transmission path is an ATM network,
As exemplified in FIG. 21, the transmission path encoding unit 4 has an ATM physical layer processing function.

As described above, as a transmission device of a multimedia information processing system that distributes and records multimedia information, information source coding that takes in a plurality of media information and encodes the media information for each media unit. Unit 100, a media multiplexing unit 200 that performs packet multiplexing on a coded bit stream for each medium generated by the information source coding unit to generate a multiplexed stream, and a fixed length A fixed-length packet generator 300 for mapping on a packet, and transmission for generating a transmission signal by performing error correction code addition, transmission framing, and modulation on the fixed-length packet stream generated by the fixed-length packet generator. Channel encoding unit 400, so that the process from capture of element media to transmission Can be multiplexed efficiently by flexibly responding to changes in the transmission speed of individual media to be multiplexed, the presence or absence of individual media, etc. This has the effect of facilitating the mutual conversion of contents between contents and the transmission of contents over a plurality of transmission media.

The fixed-length packet generator 300
Maps the multiplexed stream to ATM cells, so if the transmission path is ATM, maps the multiplexed stream to fixed-length packets such as ATM cells and encodes the transmission path according to the characteristics of the transmission path. Can be transmitted.
Further, the transmission line encoding unit 400 determines that the transmitter is an ATM.
When connecting to a network, transmission processing is performed in the ATM physical layer, so that transmission path coding can be performed according to the characteristics of the ATM network.

Embodiment 16 FIG. FIG. 22 shows Embodiment 16
1 is a configuration diagram showing a receiving device of a multimedia information processing system according to the present invention. In FIG. 22, 500 is a transmission path decoding unit, 600 is a fixed length packet decomposing unit, 700 is a media separation unit, and 800 is an information source decoding unit.

Next, the operation will be described. In the transmission path decoding unit 500, as illustrated in FIG.
After the transmission signal 15 is received and demodulated, the fixed-length packet stream 14 is reproduced by performing synchronization establishment / reproduction of the transmission frame, error detection / correction processing, and the like. The transmission path is AT
In the case of the M network, as illustrated in FIG. 21, the transmission path decoding unit 5 has an ATM physical layer processing function.

The fixed-length packet decomposing section 600 extracts the payload of the fixed-length packet, and
Play 3 FIG. 19 shows T as a multiplexed stream 13.
9 is an example showing a relationship when S is an ATM cell as a fixed-length packet.

In the media separation section 700, ISO / IEC 1381
3-1 Multiplexed stream 1 according to (MPEG-2 Systems) standard
3 and the video encoded stream 12a, the audio encoded stream 12b, and the data encoded stream 1
Play 2c.

In the information source decoding section 800, as shown in FIG.
And the data encoding bit stream 12c are subjected to information source decoding or various inverse processing by a video decoding unit 64, an audio decoding unit 65, and a data decoding unit 66, respectively, to obtain a video signal 11a, an audio signal 11b, and various data signals 11c. To play.

As described above, as a receiving apparatus of a multimedia information processing system, a transmission apparatus for receiving a transmission signal from a transmitter, performing demodulation processing, transmission framing processing, and error correction processing to reproduce a fixed-length packet stream. Path decoding section 500 and fixed length packet decomposing section 600 for extracting a multiplexed stream from the fixed length packet stream.
And a media separation unit 700 for reproducing an encoded bit stream for each medium from the multiplexed stream, and an information source decoding unit 800 for decoding the encoded bit stream for each medium. Extract the multiplexed stream from the decoded fixed-length packet,
The multiplexed stream can be separated into coded streams of video, audio, various data, etc., and each coded stream can be source-decoded. Changes in the transmission speed of individual media to be multiplexed, presence or absence of individual media Multiplexing can be performed efficiently in accordance with the requirements, and mutual conversion of contents between different transmission media such as wired and wireless, and transmission of contents over a plurality of transmission media can be facilitated.

The fixed length packet decomposing unit 600
Extracts a multiplexed stream from an ATM cell stream, extracts a multiplexed stream from a decoded fixed-length packet, separates the multiplexed stream into coded streams of video, audio, various data, and the like. The source stream can be source decoded. Further, the transmission path decoding unit 800 determines that the receiver
When connecting to the M network, the receiving process is performed in the physical layer of the ATM, so that the receiving process can be performed according to the characteristics of the ATM network.

Embodiment 17 FIG. FIG. 24 shows Embodiment 17
1 is a configuration diagram of a multimedia information processing system according to the present invention. In FIG. 24, reference numeral 400 denotes a transmission path coding unit;
Denotes a transmission path decoding unit, and 900 converts the fixed-length packet stream from the transmission path decoding unit 500 as a common transmission signal between transmission paths having different characteristics irrespective of the transmission path, and transmits the same to a plurality of transmission path encoding units 400. This is a broadcast processing unit also serving as a transmission signal conversion processing unit.

FIG. 25 is a configuration diagram showing a network connection form of the multimedia information processing system according to the seventeenth embodiment. In FIG. 25, 101 is a transmitting station,
201 is a relay station, 280 is an ATM switch, and 301 and 302 are receivers.

Next, the operation will be described. In FIG.
An ATM network connects the transmitting station 101 and the relay station 201 and the relay stations are connected to each other. The relay station 201 and the receiver 301 are connected by a coaxial cable or the like, and a QAM-modulated signal is transmitted.

The operation when relay station 201 transmits a transmission signal received from transmitting station 101 to receiver 301 is shown in FIG.
This will be described with reference to FIG. In this embodiment, the fixed-length packet stream 14 is assumed to be an ATM cell stream. In this case, both the transmission path encoder 400 and the transmission path decoder 500 have an ATM physical layer processing function as shown in FIG. The transmission path decoding unit 500 receives the transmission signal 15 transmitted by the ATM from the transmission station 101 and reproduces the fixed-length packet stream 14. The reproduced fixed-length packet stream 14 is transmitted to the broadcast processing unit 9.
At 00, a fixed length packet stream for the delivery destination is copied and the address information of each delivery destination is written in the fixed length packet header, that is, in the ATM cell header based on the delivery destination address information 16. The transmission path encoding unit 400 performs transmission path encoding of the fixed-length packet stream 14 copied and generated for the delivery destination.

The operation when relay station 201 transmits a transmission signal received from transmitting station 101 to receiver 302 is shown in FIG.
This will be described with reference to FIG. In this embodiment, an ATM cell stream is assumed as the fixed-length packet stream 14. In this case, the transmission path encoding section 400 has a general function as shown in FIG. 20, and the transmission path decoding section 500 has an ATM physical layer processing function as shown in FIG. Also, the broadcast processing unit 900 can be omitted.
The transmission signal 15 transmitted by the ATM from the transmission station 101 is converted into the fixed-length packet stream 14 by the transmission line decoding unit 500, QAM-modulated by the transmission line encoding unit 400, and transmitted as the transmission signal 15.

As described above, a multimedia information processing system for delivering and recording multimedia information receives a transmission signal from a transmitter, performs demodulation processing, transmission framing processing, and error correction processing, and performs fixed-length processing. A transmission line decoding unit 500 for reproducing a packet stream and transmission signal conversion processing means for converting a fixed length packet stream from the transmission line decoding unit as a common transmission signal between transmission lines having different characteristics regardless of the transmission line. Broadcast processing unit 9 that also serves
00, and a transmission path encoding unit 400 that performs transmission processing, modulation framing processing, and error correction code processing on the converted fixed-length packet stream to generate a transmission signal. It is possible to efficiently multiplex by responding flexibly to changes in media transmission speed, the presence or absence of individual media, etc., and to mutually convert contents between different transmission media such as wired and wireless, and to transfer multiple transmission media. The transmission of the content that has exceeded is facilitated.

For example, if the transmission signal is QAM (Quadrature A)
mplitude modulation) or PSK (Phase Shift Keyin)
g) and the like, the general functions of the transmission path encoding unit and the transmission path decoding unit are as shown in FIG.
The basic functions of the transmission path encoding unit and the transmission path decoding unit in the case of the TM network are as shown in FIG. Therefore, Embodiment 17
As shown in FIG. 2, when the multimedia information processing system connected to the ATM network and the multimedia information processing system connected to the transmission line by QAM modulation exchange contents, the adapter is used as shown in FIGS. 21
It is sufficient to support the processing functions shown in (1), and a simpler adapter is required compared to the conventional one, so that the mutual conversion of contents between different transmission media and the transmission of contents over multiple transmission media can be performed easily and quickly. it can.

The transmission line decoding unit and the transmission line encoding unit perform the conversion process of the non-ATM transmission signal to the ATM transmission signal and the conversion process of the ATM transmission signal to the non-ATM transmission signal. Mutual conversion of content between transmission media and transmission of content over a plurality of transmission media can be performed easily and promptly. Further, the broadcast processing unit, together with the transmission signal conversion processing function,
Since the transmission signal is broadcast to a plurality of receivers by writing address information in the header of the fixed-length packet and designating the address of the receiver, the network may be connected to different transmission media. Even so, the mutual conversion of contents between different transmission media and the transmission of contents over a plurality of transmission media can be performed easily and promptly.

[0160]

As described above, according to the multimedia information processing system of the present invention, the source information encoding means encodes each piece of media information to generate an element packet to which auxiliary information is added, The multiplexing means performs speed matching and multiplexing of the element packets of each medium to generate a multiplexed stream, and the transmission processing means outputs the multiplexed stream as a transmission signal corresponding to a transmission medium and a storage medium. Since a series of processes from fetching media information to transmission processing is hierarchized, and the contents of processing and input / output data are regulated for each hierarchy, broadcasting,
Mutual data between services such as communications, computers and storage
In addition to the flexibility in terms of services such as data exchange, the hardware configuration is simplified, additional functions can be added, and various applications can be developed. .

The information source encoding processing means includes an element media capturing means, an information source encoding means, and an element packet generating means. Since element packets having a signal format having compatibility between them are generated, there is an effect that reproduction of each piece of media information becomes easy.

The packet multiplexing means includes a packet generating unit and a packet multiplexing means, and adds auxiliary information for performing media identification and packet reproduction synchronization, etc. corresponding to the media information, and also adds elementary packet information. Since the multiplexed stream is generated by performing speed matching and multiplexing, it is possible to cope with changes in the transmission speed of each media to be multiplexed and to easily separate the multiplexed stream into element packets. There is.

The packet multiplexing means generates a fixed-length packet by adding auxiliary information so that the receiving side can extract necessary data, and performs multiplexing while performing speed matching in units of the fixed-length packet. Since a fixed-length packet sequence is generated by performing the process, it is possible to cope with a change in the transmission speed of each medium to be multiplexed, and to easily separate the fixed-length packet sequence into element packets. .

The transmission processing means includes an error correction coding means, a transmission frame generation means, and a modulation processing means, and performs error correction according to a transmission storage medium such as broadcasting, communication, or digital storage medium. Since the transmission signal is output after performing the transmission framing process and the modulation process according to the transmission medium and the storage medium, the transmission signal according to the transmission medium and the storage medium can be output.

Further, the transmission processing means performs the TCP / UDP / XTP processing on the multiplexed stream and then performs the IP processing and sends the multiplexed stream to the Internet protocol transmission path. There is an effect that the transmitted signal can be transmitted.

Further, since software processing means having an application program is further provided and the operation of the information source coding process or the packet multiplexing process is changed in accordance with the application, the information source coding process or the packet multiplexing process is performed. It is possible to flexibly change the conversion process, and a wider service can be provided by the same system. That is,
The spatio-temporal resolution, encoding algorithm, bit rate, encoding quality, etc. of the video can be freely set by the processing application program according to the input element media material. There is an effect that the information encoding process can be performed. Further, there is an effect that the program contents transmitted by the packet multiplexing unit can be freely changed by the program scheduling application.

The element packet storing means for storing the element packets in units, the address managing means for storing the addresses of the element packets stored in the element packet storing means, and the element packets being stored in accordance with the instructions from the address managing means. An element packet transmitting means for outputting data from the storage means to the packet multiplexing means is further provided so that necessary data multiplexing and transmission processing can be performed when necessary, so that encoding processing must be performed in real time. Without,
There is no need to re-encode when sending repeatedly,
There is an effect that processing can be shortened and efficiency can be improved. Furthermore, since various media information is stored by reducing the amount of information by information source coding, it is possible to reduce the storage capacity. In addition, since each media information is stored individually for each medium, it can be used for multiplexing. This has the effect that the selection of media can be changed.

Also, a multiplexed stream storage means for storing the multiplexed stream, a multiplexed stream management means for storing the address of the multiplexed stream stored in the multiplexed stream storage means, and an instruction from the multiplexed stream management means. And a multiplexed stream sending means for outputting a multiplexed stream from the multiplexed stream storage means to the transmission processing means, so that necessary data transmission processing and the like can be performed when necessary. There is no need to perform encoding processing in time, and there is no need to perform encoding and multiplexing again at the time of repeated transmission, so that there is an effect that processing can be shortened and efficiency can be improved. Further, since various types of media information are stored after the amount of information is reduced by information source coding, there is an effect that the storage capacity can be reduced.

[0169] A multimedia information processing system according to another invention is a reception processing means for decoding a packet multiplex signal transmitted depending on a transmission medium and outputting a multiplex stream, and a multiplex stream. A packet separating means for separating element packets necessary for each media unit from each other, performing information source decoding of the separated element packets for each media unit, and synchronizing the element media based on the added auxiliary information. Information source decoding processing means for reproducing media information by means of a transmission method, so that a series of processing from reception to reproduction of a packet multiplexed signal transmitted depending on the transmission medium is hierarchized, and the processing content is defined for each layer. And input / output data can be regulated, making it possible to make services more flexible, such as mutual data exchange between services such as broadcasting, communication, and computer / storage. Both ha - Douea configuration is simplified, also enables additional such additional functions, there is an effect that it is possible to deploy a variety of applications.

The packet separating means separates each element packet from the multiplexed stream as a unit.
Since the information is output to the information source decoding processing means, there is an effect that media information can be output in element packet units corresponding to each medium.

Further, the packet separating means separates fixed-length packets from the multiplexed stream in units, reconstructs them into elementary packets, and outputs them to the information source decoding processing means, so that high-speed processing can be performed. effective.

The information source decoding processing means includes an element packet separating means, an information source decoding means, and a decoded data reproducing means, and converts the auxiliary information and the element media information encoded from the element packets. Since the separation is performed, and the encoded element media information is decoded and synchronized to reproduce the media information, it is possible to reproduce the media information according to each medium.

Further, the reception processing unit performs IP processing on data transmitted from the Internet protocol transmission path, and then performs TCP / UDP / XTP processing to receive a packet-multiplexed stream. There is an effect that reception processing suitable for the Internet protocol transmission path can be performed.

The reception processing means includes a demodulation processing means, a transmission frame reproducing means, and an error correction processing means, and performs demodulation, deframing, and error correction according to the characteristics of the transmission medium that transmitted the packet multiplexed signal. Since the multiplexed stream is reproduced by performing the correction decoding, there is an effect that the multiplexed stream can be reproduced by receiving the packet multiplexed signal from various transmission media and performing error correction decoding.

When an uncorrectable error occurs, the error correction processing means outputs an error occurrence signal indicating the presence of the error to the packet separation means together with the multiplexed stream to be output. Packet separation means
Since the packet separation is not performed when an error occurrence signal is input, there is an effect of preventing a decoding error or a reproduction error of a decoder, and also has an effect of decoding error and transmission error.
Can be separated, and the operation of the system can be easily managed.

When an uncorrectable error occurs, the error correction processing means outputs an error occurrence signal indicating the presence of the error to the information source decoding processing means together with the multiplexed stream to be output. Since the information source decoding processing means does not perform information source decoding when an error occurrence signal is input, it is possible to prevent decoding errors and reproduction errors of the decoder, and to separate decoding errors from transmission errors. And the operation of the system can be easily managed.

Further, software processing means having an application program is further provided, and the information source decoding process or the packet separation process is changed in accordance with the application. It can be made flexible and wider services can be provided by the same system. That is, program selection (navigator
Application) The application program allows the user to select a program suitable for the purpose, thereby improving convenience and operability. In addition, an instruction such as high-speed reproduction and selection of a decoding method can be made by the decoding application program, so that many functions can be realized.

The packet separating means includes a receiving element packet storing means, a receiving program managing means, and a receiving element packet reading means, and receives an element packet necessary for reproducing a program according to an instruction from the receiving program managing means. Since the data is output from the element packet storing means to the information source decoding processing means, necessary data packet separation and information source decoding processing can be performed when necessary, and the information source decoding processing is performed in real time. There is no necessity, and the receiver can repeatedly use the contents whenever he wants to see the contents, thereby improving the convenience. Furthermore, since each piece of media information is not accumulated after performing the information source decoding process, there is an effect that the storage capacity can be reduced.

A multimedia information processing system according to still another aspect of the present invention provides a multiplex stream for each transmission medium, which receives and decodes a packet multiplexed signal from one or more transmission media.
A plurality of reception processing means for generating a communication system, a plurality of packet separation means for separating a packet multiplexed stream into element packets for each transmission medium, a packet remultiplexing means for packet multiplexing the element packets into one multiplexed stream, Transmission processing means for converting the multiplexed stream output from the packet remultiplexing means in accordance with the characteristics of the transmission medium and outputting the converted signal to the transmission medium as a transmission signal; Can be hierarchized, processing contents for each layer can be defined, and input / output data in each layer processing can be defined. Mutual data between services such as broadcasting, communication, and computer / storage can be defined. -In addition to the flexibility in terms of services such as data exchange, the hardware configuration is simplified, and additional functions can be added.
There is an effect that various applications can be developed.

A multimedia information processing system according to still another aspect of the present invention comprises an information source encoding processing means for performing information source encoding on signals of different types such as applications and media to generate respective encoded bit strings, Media multiplexing means for storing each encoded bit string together with identification information in a fixed-length packet and performing multiplexing in fixed-length packet units to generate a fixed-length packet string; and a predetermined number of fixed lengths from the fixed-length packet string Structure multiplexing means for storing a packet together with various data in a frame of a predetermined size, and transmission processing means for generating a transmission signal having a transmission frame depending on a transmission medium with respect to a frame sequence from the structure multiplexing means. In addition, media multiplexing is performed in units of fixed-length packets. Change in transmission speed of and breakfasts, there is an effect that corresponds to the presence or absence of individual media may send a transmission signal by multiplexing.

Further, since the structure multiplexing means multiplexes signals, such as control information, instruction information, and clock information, which are required immediately by the receiving side as various data together with the fixed-length packet, the receiving side can immediately multiplex the signals. By not performing multiplexing on a per-packet basis and performing structure multiplexing with a fixed-length packet sequence, there is an effect that the transmission and reproduction of the signal can be speeded up.

A multimedia information processing system according to still another aspect of the present invention stores a fixed number of fixed-length packets together with various data in a frame of a predetermined size, and has a transmission frame sequence depending on a transmission medium. Reception processing means for receiving a signal and reproducing a multiplexed bit sequence, structure separating means for reproducing a fixed-length packet sequence and various data from the multiplexed bit sequence, and extracting a fixed-length packet from the fixed-length packet sequence to determine the type of the signal; A multiplexed bit string is provided, comprising: a media separating unit that reproduces an encoded bit string corresponding to the identification information to be determined; and an information source decoding processing unit that decodes the encoded bit string and reproduces signals of different types such as applications and media. Thus, there is an effect that necessary data can be immediately reproduced.

Further, the structure separation means separates various data signals such as control information, instruction information, clock information, etc., which are multiplexed in a structure, and a fixed length packet from the multiplexed bit string. There is an effect that only necessary information can be reproduced immediately with necessary data.

According to still another receiving apparatus of a multimedia information processing system, an information source encoding means for taking in a plurality of media information and encoding the media information for each media unit, Media multiplexing means for performing packet multiplexing on a coded bit stream for each medium generated by the above to generate a multiplexed stream, and fixed length packet generating means for mapping the multiplexed stream onto fixed length packets Transmission path encoding means for generating a transmission signal by performing error correction code addition, transmission framing processing, and modulation processing on the fixed-length packet stream generated by the fixed-length packet generation means. Layering a series of processes from the capture of data to the transmission process, and the individual media to be multiplexed It is possible to efficiently multiplex by responding flexibly to changes in transmission speed, the presence or absence of individual media, etc., and to convert contents between different transmission media such as wired and wireless, and to transcend multiple transmission media. This has the effect of facilitating content transmission.

The fixed-length packet generating means maps the multiplexed stream to ATM cells.
The data can be mapped to a fixed-length packet such as a TM cell, coded according to the characteristics of the transmission path, and transmitted.

Further, when the transmitter is connected to the ATM network, the transmission path encoding means performs transmission processing in the physical layer of the ATM. Therefore, the transmission path encoding means performs transmission path encoding according to the characteristics of the ATM network. it can.

According to still another receiving apparatus of a multimedia information processing system, transmission for receiving a transmission signal from a transmitter, performing demodulation processing, transmission framing processing, and error correction processing to reproduce a fixed-length packet stream. Path decoding means, fixed-length packet decomposing means for extracting a multiplexed stream from the fixed-length packet stream, media separating means for reproducing an encoded bit stream for each medium from the multiplexed stream, and an encoded bit stream for each medium And information source decoding means for decoding
Transmission path decoding of a transmission signal, extraction of a multiplexed stream from the decoded fixed-length packet, separation of the multiplexed stream into encoded streams of video, audio, various data, etc., and decoding of each encoded stream as an information source. It is possible to multiplex efficiently by flexibly responding to changes in the transmission speed of individual media to be multiplexed, the presence / absence of individual media, etc., and the mutual exchange of contents between different transmission media such as wired and wireless. Conversion and transmission of content across multiple transmission media are facilitated.

The fixed-length packet decomposing means
Since the multiplexed stream is extracted from the TM cell stream, the multiplexed stream is extracted from the decoded fixed-length packet, and the multiplexed stream is separated into encoded streams such as video, audio, and various data. Can be source-decoded.

The transmission path decoding means is such that the receiver
When connecting to the TM network, the receiving process is performed in the physical layer of the ATM, so that the receiving process can be performed according to the characteristics of the ATM network.

According to still another multimedia information processing system, transmission path decoding means for receiving a transmission signal from a transmitter, performing demodulation processing, transmission framing processing, and error correction processing to reproduce a fixed-length packet stream. Transmission signal conversion processing means for converting the fixed-length packet stream from the transmission path decoding means as a common transmission signal between transmission paths having different characteristics regardless of the transmission path; and On the other hand, transmission line coding means for generating a transmission signal by performing error correction code addition, transmission framing processing, and modulation processing is provided, so that the transmission speed of individual media to be multiplexed changes, the presence or absence of individual media, etc. It is possible to multiplex efficiently by flexibly coping with content, and to convert contents between different transmission media such as wired and wireless. Transmission of content over a plurality of transmission media becomes easy. For example, when the transmission signal is modulated by QAM or PSK, and the transmission path is an ATM network, a multimedia information processing system connected to the ATM network and a multimedia information processing system connected to the transmission path by QAM modulation are used. In the case of exchanging contents between different media, the adapter is simpler than before, so it is easy and easy to exchange contents between different transmission media and transmit content across multiple transmission media. It can be done promptly.

Further, the transmission path decoding means and the transmission path encoding means perform conversion processing of a non-ATM transmission signal to an ATM transmission signal and conversion processing of an ATM transmission signal to a non-ATM transmission signal. Mutual conversion of contents between transmission media and transmission of contents over a plurality of transmission media can be performed easily and promptly.

Further, since the transmission signal conversion processing means also serves as a broadcast processing means for broadcasting transmission signals to a plurality of receivers, the transmission signal conversion processing means can be transmitted to a plurality of receivers or repeaters together with the transmission signal conversion processing function. Transmission signals can be broadcast.

Further, the broadcast processing means writes address information in the header of the fixed-length packet and designates the address of the receiver. Therefore, when the networks are connected by different transmission media, The transmission signal can be broadcast to a plurality of receivers or repeaters even if there is, so that the mutual conversion of contents between different transmission media and the transmission of contents over multiple transmission media can be performed easily and promptly. it can.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a transmission device in a multimedia information processing system according to a first embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration example of a transmission device in a multimedia information processing system according to a second embodiment of the present invention.

FIG. 3 is an explanatory diagram of an element packet and a multiplexing stream according to a second embodiment of the present invention.

FIG. 4 is an explanatory diagram of an element packet and a multiplexing stream of another aspect according to the second embodiment of the present invention.

FIG. 5 is a block diagram showing a part of a configuration of a transmission device in a multimedia information processing system according to Embodiment 3 of the present invention.

FIG. 6 is a block diagram showing a part of a configuration of a transmission device in a multimedia information processing system according to a fourth embodiment of the present invention.

FIG. 7 is a block diagram showing a part of a configuration of a transmission device in a multimedia information processing system according to a fifth embodiment of the present invention.

FIG. 8 is a block diagram showing a configuration of a receiving device in a multimedia information processing system according to Embodiment 6 of the present invention.

FIG. 9 is a block diagram showing a configuration of a receiving device in a multimedia information processing system according to a seventh embodiment of the present invention.

FIG. 10 is a block diagram showing a part of a configuration of a receiving device in a multimedia information processing system according to an eighth embodiment of the present invention.

FIG. 11 is a block diagram showing a part of a configuration of a receiving device in a multimedia information processing system according to Embodiment 9 of the present invention.

FIG. 12 is a block diagram showing a part of a configuration of a receiving device in a multimedia information processing system according to a tenth embodiment of the present invention.

FIG. 13 is a block diagram showing a part of a configuration of a receiving device in a multimedia information processing system according to Embodiment 11 of the present invention.

FIG. 14 is a block diagram showing a configuration of a multimedia information processing system according to Embodiment 12 of the present invention.

FIG. 15 is a block diagram showing a configuration of a transmission device in a multimedia information processing system according to Embodiment 13 of the present invention.

FIG. 16 is a block diagram showing a configuration of a receiving device in a multimedia information processing system according to Embodiment 14 of the present invention.

FIG. 17 is a block diagram showing a configuration of a transmitting device in a multimedia information processing system according to Embodiment 15 of the present invention.

FIG. 18 is a diagram showing the configuration inside the information source coding unit 100 according to Embodiment 15 of the present invention.

FIG. 19 is an explanatory diagram showing the relationship between a multiplexed stream, fixed-length packets, and transmission frames according to Embodiment 15 of the present invention.

FIG. 20 is an explanatory diagram showing general functions of a transmission line encoding unit and a transmission line decoding unit in the multimedia information processing system according to the present invention.

FIG. 21 is an explanatory diagram showing basic functions of a transmission line encoding unit and a transmission line decoding unit when a transmission line is an ATM network in the multimedia information processing system according to the present invention.

FIG. 22 is a block diagram showing a configuration of a receiving device in a multimedia information processing system according to Embodiment 16 of the present invention.

FIG. 23 is a configuration diagram in an information source decoding unit 800 according to Embodiment 16 of the present invention.

FIG. 24 is a block diagram showing a configuration of a multimedia information processing system according to a seventeenth embodiment of the present invention.

FIG. 25 is a conceptual diagram showing a network connection form in a multimedia information processing system according to a seventeenth embodiment of the present invention.

FIG. 26 is a block diagram illustrating a configuration of a transmission device in a conventional multimedia information processing system.

FIG. 27 is a block diagram illustrating a configuration of a receiving device in a conventional multimedia information processing system.

FIG. 28 is an explanatory diagram of a configuration of a multiplexed frame in a conventional multimedia information processing system.

FIG. 29 is an explanatory diagram showing general functions of a transmission processing unit and a reception processing unit in a conventional multimedia information processing system.

FIG. 30 is an explanatory diagram illustrating a scrambling process and a descrambling process in a conventional multimedia information processing system.

FIG. 31 is a configuration diagram of an error correction frame when a Reed-Solomon code is used as an error correction code in a conventional multimedia information processing system.

FIG. 32 is an explanatory diagram illustrating the configuration of a channel multiplexing frame in a conventional multimedia information processing system.

FIG. 33 is an explanatory diagram illustrating a configuration of a transmission frame in a conventional multimedia information processing system.

FIG. 34 is an explanatory diagram showing basic functions of a transmission processing unit and a reception processing unit when a transmission path is an ATM network in a conventional multimedia information processing system.

[Explanation of symbols]

1,501 information source coding processing unit, 2,502 packet multiplexing unit, 3 transmission processing unit, 4 reception processing unit, 5 packet separation unit, 6 information source decoding processing unit, 9 coding unit,
10 element packet generator, 11 media information, 12
Element packet, 13 multiplexing stream, 14 transmission signal, 15 decoding unit, 61 video encoding unit, 62
Audio encoder, 63 data encoder, 64 video decoder, 65 audio decoder, 66 data decoder, 97a media multiplexer, 97b media separator, 98a structure multiplexer, 98b structure separator, 99a transmission processing Unit, 99b reception processing unit, 100 information source coding unit, 101 transmitting station, 200
Media multiplexing section, 201 relay station, 230 element media capture processing section, 233 packet generation section, 23
4 packet multiplexing section, 235 error correction coding processing section,
236 transmission framing processing section, 237 modulation section, 2
50 demodulation unit, 251 transmission deframing unit, 252
Error correction processing unit, 253, 432, 503 packet separation unit, 254 packet analysis unit, 255 decoded data display unit, 260, 261 auxiliary information, 270 packet remultiplexing unit, 280 ATM switch, 300 fixed length packet generation unit, 301, 302 receiving station, 400 transmission path coding section, 403,434 software processing section, 4
10 element packet storage unit, 411 address management unit,
412 element packet transmission unit, 413 multiplexed stream storage unit, 414 program management unit, 415 program transmission unit,
416 received element packet storage section, 417 received program management section, 418 received element packet reading section, 430
Error correction decoding section, 433, 504 information source decoding processing section,
500 transmission line decoding unit, 600 fixed length packet decomposition unit, 700 media separation unit, 800 information source decoding unit,
900 Broadcast processing unit.

────────────────────────────────────────────────── ─── Continued on the front page (72) Inventor Hideo Ohira 2-3-2 Marunouchi, Chiyoda-ku, Tokyo Inside Mitsubishi Electric Corporation (56) Reference European Patent Application Publication 691759 (EP, A2) News from NHK STRL No. 53 "Digital Video and Audio Coding Standards-Overview of the MPEG2 Standard-3. System" (1994-06-01) p. 12-20 News from NHK STRL No. 51 "Digital Video and Audio Coding Standards-Overview of MPEG2 Standards-1. Video" (1994-04-01) p. 13-17 News from NHK STRL No. 52 "Digital Video and Audio Coding Standards-Overview of the MPEG2 Standard-2. Audio" (1994-05-01) p. 11-15 1994 IEICE Spring Conference B-853, "A Study on Error Correction Method Considering Consistency between ATM Cells and MPEG-2 System Standard" (1994-3-10) The Institute of Electronics, Information and Communication Engineers, 1994 Spring Meeting B-786, "Error Control Method in ATM Network, FEC on AAL Type 5" (1994-3-10) Technical Report of the Institute of Television Engineers of Japan CE94-20 "Examination of application of MPEG-2 Systems to ISDB" (1994- 5-26) p. 7-12 IEICE Technical Report CS93-164, "MPEG-2 Video Coding and Application to ATM Networks" (1994-27), p. 91-102 Technical Report of the Institute of Television Engineers of Japan, ICS94-48, "International Standardization Trends in Multimedia Multiplexing" (1994-7-7), p. 37−42 (58) Fields surveyed (Int.Cl. ⁷ , DB name) H04L 12/56 H04L 7/08 H04L 7/13

Claims (4)

(57) [Claims] 1. An application or a media type.
Source coding is performed on different signals and each code is
Generate an encoded bit sequence, and
Is needed immediately on the receiving side for control information, instruction information, etc.
Compatible with other systems for encoded bit strings other than information
Element packet sequence for each media with signal format with reliability
Information source encoding processing means for generating the information, and the receiving side generated by the information source encoding processing means
Generated from coded bit strings other than information needed immediately
Determine the type of signal from the element packet sequence for each media
To be stored in a fixed-length packet along with identification information for
Performs multiplexing on a packet-by-packet basis to generate a fixed-length packet sequence
Media multiplexing means, and the fixed-length packet generated by the media multiplexing means.
The fixed number of fixed-length packets from the
Is immediately required on the receiving side generated by the
Frame with a predetermined size together with the
The structure multiplexing means to be stored in the system and the frame train from the structure multiplexing means.
Generates a transmission signal with a transmission frame that depends on the transmission medium
Multimedia information transmission with transmission processing means
system. 2. A method according to claim 1, wherein a predetermined number of fixed-length packets are transmitted to control information or a finger.
Information that is immediately needed on the receiving system side, such as
Stored in a frame of a predetermined size together with the encoded bit string
And the transmission frame sequence that depends on the transmission medium
And receive a transmission signal with
Receiving processing means, a fixed-length packet sequence from the multiplexed bit sequence,
Bit sequence of information needed immediately by the communication system
Structure separation means for separating and regenerating each
And the fixed separated and regenerated by the above structure separating means
Extract a fixed-length packet from the long packet sequence and
Reproduces the encoded bit string corresponding to the identification information to determine the distinction
Media separating means, and the main receiving system reproduced by the structure separating means.
The encoded bit string of information that is needed immediately on the stem side is restored.
And a fixed- length packet
Required immediately by the receiving system reproduced from the
Decoding the coded bit string other than the information
Information for playing different types of signals such as media and media
Multimedia decoding system comprising a source decoding processing means
Tem. 3. An information source code for multimedia information.
To generate the respective encoded bit strings.
In the coded bit string,
Coded bit strings other than information
Element packet for each media with interchangeable signal format
Generates a sequence and encodes bits other than the information needed immediately at the receiving side.
The elementary packet sequence for each media generated from the sequence is
Into fixed-length packets along with identification information to determine the type
Store and multiplex in fixed-length packet units to create fixed-length packets.
Generate a fixed number of fixed length packets from the fixed length packet sequence,
An encoded bit string of information immediately required on the receiving side and
Both of them must be stored in a frame of a predetermined size and transmitted.
Characteristic multimedia information transmission method. 4. A method according to claim 1, wherein a predetermined number of fixed-length packets
Along with the encoded bit string of information
It is stored in a frame of a fixed size and
Receiving a transmission signal having a body-dependent transmission frame sequence
To reproduce a multiplexed bit sequence, and from this multiplexed bit sequence,
Bit sequence of information that is needed immediately during communication processing
Was separated, regenerated respectively, fixed length path from the fixed-length packet sequence reproduced by the separation
Take out the packet and match the identification information to determine the type of signal.
A corresponding encoded bit string is reproduced, and immediately necessary for the above-mentioned separated and reproduced main reception processing.
Decode the encoded bit sequence of the necessary information and
At the time of the main reception process reproduced from the fixed-length packet sequence,
Decode coded bit strings other than the information needed immediately
To reproduce multimedia information .
Multimedia information receiving method.