JP2003047010A - Dynamic image data transmitting system and method there of - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow to select a transmitting mode correspondingly to the performance and the request of the reception terminal of a dynamic image data transmitting system when distributing a dynamic image data comprising a plurality of objects. SOLUTION: In the dynamic image data transmitting system and method for transmitting a dynamic image data comprising a plurality of objects, there are included a step of accumulating the plurality of objects (dynamic image data 1-4) for each object, a step of coding the respective accumulated objects every one of them to generate coded object data, a step of synthesizing the respective accumulated objects to generate a dynamic image data, a step of coding the synthesized dynamic image data to generate a coded dynamic image data, and a step for transmitting selectively the coded object data and the coded dynamic image data.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system and method for transmitting moving image data, and more particularly to a system and method for transmitting moving image data composed of a plurality of objects according to the performance and requirements of a receiving terminal.

[0002]

2. Description of the Related Art In recent years, next-generation data transmission systems for distributing moving image data have become popular. As the next-generation transmission method, for example, when a moving image scene is composed of a plurality of objects such as MPEG4, each object is encoded individually, and the moving image encoded data of each of these objects is transmitted and received. There is one that is composited and displayed on the terminal.

[0003]

However, there are cases where the encoded object cannot be decoded due to the performance of the receiving terminal or other reasons, and in this case, the moving image scene cannot be reproduced. The problem arises. In particular, during the transitional period when the next-generation moving image transmission system becomes widespread, since it is expected that old and new receiving terminals will be mixed, a terminal that can receive data transmitted by the new system, Some terminals cannot be created.

The present invention solves such a problem, and when distributing moving image data composed of a plurality of objects, a transmission method is selected according to the performance and requirements of the receiving terminal. It is an object of the present invention to provide a moving image data transmission system and method capable of performing the above.

[0005]

In order to solve the above problems, the present invention provides a moving image data transmission system and method for transmitting moving image data composed of a plurality of objects. Objects are accumulated for each object, each accumulated object is encoded to generate object encoded data, each accumulated object is combined to generate the moving image data, and the combined moving image data is generated. Are encoded to generate moving image encoded data, and the object encoded data and the moving image encoded data are transmitted.

According to the present invention, each object constituting the moving image data is accumulated, and these objects are
The data to be accumulated in the accumulating means for transmitting the data is generated by encoding each object to generate the object encoded data, or by encoding after combining to generate moving image encoded data. Since only the objects are decomposed from the image data, the amount of accumulated data can be reduced.

Another aspect of the present invention is a moving image data transmission system and method for transmitting moving image data composed of a plurality of objects, which stores object encoded data obtained by encoding a plurality of objects. , Decoding the accumulated object coded data, synthesizing the decoded objects to generate the moving image data,
The synthesized moving image data is encoded to generate moving image encoded data, and the object encoded data and the moving image encoded data are transmitted.

According to the present invention, each object constituting the moving image data is encoded and then accumulated, and these encoded objects are transmitted as they are, or they are decoded and then combined. To further encode this to generate and transmit moving image encoded data,
Since the data stored in the storage means is only the encoded object, the amount of data to be stored can be further reduced.

In the above invention, it is preferable that the object coded data and the moving image coded data are transmitted by being allocated to a plurality of logical channels, respectively, and the information regarding the allocation of these logical channels is sent to the receiving terminal.

In this case, the object coded data and the moving image coded data are collectively transmitted, and
Since the receiving side can select the data to be received based on the information about the allocation, the data according to the capability of the receiving terminal can be received.

Further, in the above invention, the information regarding the receiving format of the receiving terminal is acquired from the receiving terminal, and the object encoded data and the moving image encoded data are selectively selected based on the obtained information regarding the receiving format. In addition, it is preferable to send to the receiving terminal.

In this case, since information about the reception format can be acquired from the reception terminal in advance and the data format to be transmitted can be selected based on the information about the reception format, the format corresponding to the capability of the reception terminal can be selected. Data can be transmitted and reproduction on the receiving terminal side can be ensured.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [First Embodiment] (Overall Configuration of Moving Image Transmission System) An embodiment of a moving image transmission system of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a schematic configuration of a moving image transmission system according to this embodiment. As shown in FIG. 1, the moving image transmission system according to this embodiment includes a distribution server 5 that distributes moving images, and a receiving terminal 7 connected to the distribution server 5 via a transmission path 6. It The transmission line 6 in this embodiment is the Internet or an in-house LA.
It is a communication network capable of bidirectional communication such as N.

In this embodiment, the distribution server 5 is
This is a system for distributing moving image data composed of a plurality of objects, and has moving image encoding units 51 to 55, a moving image combining unit 56, a storage unit 57, a transmitting unit 58, and an image database 59. .

The image database 59 is an object storage means for storing moving image data 1 to 4 which are a plurality of objects for each object.

The moving image coding units 51 to 54 acquire the moving image data 1 to 4 stored in the image database 59,
It is an object encoding unit that encodes each moving image data to generate encoded object data.

More specifically, the moving picture coding section 51 is for coding the moving picture data 1, and in the present embodiment, MPEG-4 visual coding (ISO / ISO / ISO / ISO / ISO / coding suitable for coding on an object-by-object basis). IEC 14496-2) is used. In addition, the moving image coding units 52 to 54 MP the moving image data 2, the moving image data 3, and the moving image data 4, respectively.
EG-4 visual encoding. As the profile used in the MPEG-4 visual encoding performed by the moving image encoding units 51 to 54, a core profile that supports shape encoding is used. Moving image coding units 51 to 5
The moving image encoded data encoded in 4 is sent to the storage unit.

The moving image synthesizing unit 56 is used for the image database 5
The moving image data 1 to 4 stored in 9 are combined to generate moving image data. In the present embodiment, the moving image combining unit 56 is connected to the moving image encoding unit 55, and the combined moving image data is sent to the moving image encoding unit 55.

The moving picture coding section 55 is a moving picture coding means for coding the moving picture data combined by the moving picture combining section 56 to generate the moving picture coded data. In the present embodiment, the moving image coding unit 55 uses MPEG-4 visual coding. The moving picture coding unit 55 uses a simple profile that performs rectangular coding. The encoded moving image encoded data is sent to the storage unit 57.

The storage unit 57 includes moving picture diagram encoding units 51 to 54.
The moving image coded data for each object sent from the device and the moving image coded data of the composite moving image sent from the moving image coding unit 55 are stored. In particular, the storage unit 57 relating to the failure of the present embodiment selectively transfers the object coded data and the moving image coded data to the transmission path 6 based on the information about the reception format acquired by the reception format acquisition unit 58a described later. It plays the role of selecting means for sending.

The transmission unit 58 transmits the object coded data generated by the moving image coding units 51 to 54 and the moving image coded data generated by the moving image coding unit 55 to the receiving terminal 7 through the transmission line 6. It is a transmission means for transmitting. In addition, the transmission unit 58 in the present embodiment includes a reception format acquisition unit 58 a that acquires information regarding the reception format of the reception terminal 7 from the reception terminal 7.

That is, the transmission section 58 according to the present embodiment.
Receives from the receiving terminal 7 information on a reception format (a transmission request for requesting object encoded data or moving image encoded data) at the reception format acquisition unit 58a, sends the request to the storage unit 57, and sends it from the storage unit 57. The object encoded data or the moving image encoded data thus obtained is multiplexed to generate multiplexed data, and this multiplexed data is transmitted.

(Moving Image Transmission Method by Moving Image Transmission System) Next, the procedure of the moving image transmission method using the moving image transmission system having the above configuration will be described. First, moving image data transmitted in this embodiment will be described.

FIG. 2 or FIG. 3 is a diagram for explaining moving image data 1 to moving image data 4 used in this embodiment. FIG. 2 shows a display screen of a moving image Ma composed of a plurality of objects, and FIG. 3A shows a first screen which constitutes the moving image Ma.
Object F1 (female) of FIG. 3B is a moving image Ma.
The second object F2 (male) that makes up FIG.
(C) is a third object F3 forming the moving image Ma
(Vehicle) and FIG. 3D show the fourth object B (background) forming the moving image Ma. The moving image data 1 in FIG. 1 is the object F1, the moving image data 2 is the object F2, and the moving image data 3
Is an object F3, and the moving image data 4 is an object B.

Then, these moving image data (objects) 1 to 4 are transmitted by the following procedure. First, when a transmission request is received from the receiving terminal 7, the moving image data 1 which is an object stored in the image database 59.
~ 4 is read. This read moving image data 1
4 to 4 are input to the moving image coding units 51 to 54 for each object, and all the objects are collectively input to the moving image combining unit 56.

In each of the moving image coding units 51 to 54, each object is coded, object coded data is generated and sent to the storage unit 57. On the other hand, in the moving image synthesizing unit 56, the input objects are synthesized to generate one moving image data. That is, as shown in FIG. 4, the object B in FIG.
Object F1 and object F2 in FIG. 4 (c)
And the object F3 in FIG. 4 (d),
An object M, which is the combined moving image data shown in FIG. 4E, is generated and sent to the moving image encoding unit 55. The moving image coding unit 55 codes the sent moving image data M to generate moving image coded data, and sends this to the storage unit 57.

Then, the transmission unit 58 receives the information (transmission request) regarding the reception format from the reception terminal 7 in the reception format acquisition unit 58.
Then, the request is sent to the storage unit 57. In response to this transmission request, the storage unit 57 selects the object encoded data or the moving image encoded data and sends it to the transmission unit 58. The transmission unit 58 multiplexes the received data to generate multiplexed data, and transmits the multiplexed data to the receiving terminal 7 via the transmission line 6.

(Operation and Effect of Moving Image Data Transmission System and Method) According to the moving image data transmission system and method of this embodiment, the data stored in the image database 59 is decomposed from the moving image data. Since there are only objects, the amount of data to be stored can be reduced.

Further, in the present embodiment, the information regarding the reception format (request transmission) is acquired from the reception terminal 7 in advance, and the data format to be transmitted is selected based on this, so that the format corresponding to the capability of the reception terminal 7 is selected. Data can be transmitted, and the reproduction on the receiving terminal 7 side can be ensured.

(Modification) In the present embodiment, a case has been described as an example where the distribution server and the receiving terminal distribute the moving image data by bidirectional communication through a communication network such as the Internet, but the present invention is not limited to this. However, it can also be adopted when moving image data is distributed in a broadcast format via radio waves, for example.

That is, the transmission line 6 by the communication network in each of the above-described embodiments is a radio wave broadcast having a plurality of logical channels, and the object coded data and the moving picture code coded by the moving picture coding units 51 to 54. The moving image coded data synthesized and coded by the unit 55 is allocated to a plurality of logical channels and transmitted.

The logical channel may be a frequency division channel formed by dividing for each different frequency, a time division channel formed by dividing for each time, or a code division channel divided for each different code. It may be.

Then, the transmission unit 58 collectively sends the object coded data and the moving picture coded data through each logical channel, and also sends the information regarding the allocation of the logical channels through the main channel.

The receiving terminal 7 first obtains information on allocation through the main channel, selects a logical channel according to its own capability, and receives object encoded data or moving image encoded data. For example, when it has the ability to synthesize and reproduce the object coded data, it receives and reproduces the object coded data, and when it does not have the ability, it does not have the previously synthesized moving picture encoding. Receive and play data.

According to such a modified example, the object coded data and the moving image coded data are collectively transmitted through the broadcast wave, and the receiving terminal 7 side selects the data to be received based on the information regarding the allocation. Therefore, the moving image data can be transmitted according to the capability of the receiving terminal 7.

[Second Embodiment] Next, a moving image data transmission system according to a second embodiment of the present invention will be described. FIG. 5 is a block diagram showing the configuration of the moving image data transmission system according to the second embodiment.

The present embodiment is characterized in that the moving picture coded data 1 to 4 generated by coding four objects are transmitted as one moving picture coded data 5. Note that these moving image coded data 1 to 4 are MP
It is moving image coded data coded by the EG-4 visual (core profile) coding method.

As shown in the figure, in the moving image transmission system according to this embodiment, similarly to the above-described embodiment, the distribution server 5 that distributes moving images and the distribution server 5 via the transmission path 6 are used. And the receiving terminal 7 connected to each other. In the present embodiment, the distribution server 5 has storage units 81 to 81.
84, the moving image decoding units 91 to 94, and the moving image synthesizing unit 10.
0, a moving image coding unit 101, and an image database 59.

In the present embodiment, the image database 59 encodes each of the objects that make up the moving image data and stores them as object encoded data. The image database 59 includes storage units 81 to 8
4 are connected, and each object coded data read from the image database 59 is stored in the storage units 81 to 8
4 are stored respectively.

The storage units 81 to 84 are the image database 5
The moving picture coded data 1 to 4 read out from 9 are temporarily stored. The storage units 81 to 84 are connected to the moving image decoding units 91 to 94, and the storage units 81 to 8 are connected.
The encoded moving image data stored in 4 are input to the moving image decoding units 91 to 94, respectively.

The moving image decoding units 91-94 are stored in the storage units 81-81.
Each of the moving image coded data 1 to 4 input from 84 is decoded, and in this embodiment, MPEG-4 visual (core profile) coded data is decoded.

Specifically, when the moving image coded data 1 is decoded, the first object F1 shown in FIG. 3A is obtained.
(Female) is obtained, and when the moving image coded data 2 is decoded, the second object F3 (male) shown in FIG. 3B is obtained, and when the moving image coded data 3 is decoded, the second object F3 (male) is obtained. When the third object F3 (car) shown in c) is obtained and the moving image coded data 4 is decoded, FIG.
The fourth object B (background) indicated by is obtained.

In the present embodiment, the decoding process is completely performed to obtain the reproduced image and then the reproduced image is sent to the moving image synthesizing unit 100.
If the coefficients can be combined without decoding, the moving image decoding units 91 to 94 send the moving image encoded data 1 to 4 to the moving image combining unit 100 without completely converting them into reproduced images. You may

The moving image synthesizing unit 100 synthesizes the input image data into one image. In particular,
Object B of FIG. 4A, object F1 of FIG. 4B1, object F2 of FIG. 4C, and FIG.
The object F4 of (d) is combined to generate the object M which is the combined moving image data shown in FIG. 4 (e) and is sent to the moving image encoding unit 101.

The moving image coding unit 101 is a moving image synthesizing unit 10.
This is for encoding the composite moving image data generated by 0, and MPEG-4 visual encoding is used in this embodiment. In addition, in the present embodiment, the moving image encoding unit 1
01 uses a simple profile that performs rectangular coding. The moving image encoded data 5 encoded by the moving image encoding unit 101 is transmitted to the receiving terminal 7 through the transmission line 6.

According to this embodiment, the image database 5
In FIG. 9, since each object forming the moving image data is encoded and then stored, the data to be stored in the image database 59 is only the encoded and compressed object data. The amount of data can be further reduced.

[Third Embodiment] (Structure of Moving Image Data Transmission System) Next, a third embodiment of the present invention will be described. FIG. 6 is a block diagram illustrating a moving image data transmission system according to this embodiment. As shown in the figure, the moving image transmission system according to this embodiment is similar to the first and second embodiments described above.
Distribution server 5 that distributes moving images, and this distribution server 5
And a receiving terminal 7 connected to the receiving terminal 7 via a transmission line 6. In this embodiment, the distribution server 5 includes the storage unit 10.
3, a switch unit 104, a coding conversion unit 105, and a transmission unit 106.

The storage unit 103 stores the moving image coded data 1 to 4 generated by coding the objects forming the moving image data for each object. Specifically, the storage unit 103 stores moving image encoded data 1 to 4 encoded by the MPEG-4 visual (core profile) encoding method, and switches these moving image encoded data 1 to 4 Send to section 104.

The switch unit 104 transmits the moving image encoded data 1 to 4 to the transmission unit 106 or the encoding conversion unit 10 based on the information about the reception format acquired via the transmission unit 106.
5 is a selecting means for selectively sending the data. Specifically, in response to the transmission request acquired from the transmission unit 106, the switch 1
By switching between 04a to 104d, the storage unit 10
The route from No. 3 is selectively connected to the route directly connected to the transmission unit 106 or the route connected to the coding conversion unit 105.

The moving image coding unit 105 includes a switch unit 104.
After decoding each of the moving image data 1 to 4 sent from
This is combined into one image and the combined image is further encoded. Specifically, the object B of FIG.
The object F shown in FIG. 4B, the object F2 shown in FIG. 4C, and the object F3 shown in FIG. 4D are combined to generate an object M that is the combined moving image data shown in FIG. Then, the generated combined moving image data is subjected to MPEG-4 visual encoding to generate combined moving image encoded data. The moving image coded data synthesized and coded by the coding conversion unit 105 is sent to the transmission unit 106.

The transmission unit 106 acquires a transmission request (information about the reception format) from the receiving terminal 7, sends the request to the switch unit 104, and the switch unit 104 causes the moving image encoded data which is the object encoded data. 1 to 4 are directly acquired, or moving image coded data synthesized and coded by the coding conversion unit 105 is acquired, the acquired data is multiplexed to generate multiplexed data, and the multiplexed data is generated. The data is transmitted to the transmission line 6.

(Moving Image Data Transmission Method) A moving image data transmission method using the moving image data transmission system according to this embodiment having the above configuration is performed by the following procedure.

First, moving image encoded data 1 to 4 (object encoded data) obtained by encoding a plurality of objects are accumulated in the storage unit 103.

Then, the transmission section 106 acquires the request transmission from the receiving terminal 7 (information regarding the reception format of the receiving terminal 7) from the receiving terminal 7, and inputs the acquired request transmission to the switch section 104. The switch unit 104 switches the switches 104a to 104c in accordance with the input request transmission.

That is, when the receiving terminal 7 has the capability of decoding and synthesizing the object coded data, the moving image coded data 1 to 1 stored in the storage unit 103 are stored.
4 to the transmission unit 106 via the switch unit 104,
It is transmitted to the receiving terminal 7 in a state of being encoded for each object.

On the other hand, when the receiving terminal 7 does not have the ability to synthesize the object coded data, the storage unit 1
The moving image coded data 1 to 4 stored in 03 are sent to the coding conversion unit 105 via the switch unit 104, and the coding conversion unit 105 decodes each object coded data to obtain a decoded object. The moving image data is synthesized to generate moving image data, and the synthesized moving image data is encoded. The encoded moving image data is transmitted to the receiving terminal 7 via the transmitting unit 106.

(Operation / Effect of Moving Image Data Transmission System and Method) According to the present embodiment,
Since each object that constitutes the moving image data is encoded and then stored, the data to be stored in the storage unit 103 is only the encoded and compressed object data. It can be further reduced.

Further, in the present embodiment, the information about the reception format (request transmission) is acquired from the reception terminal 7 in advance, and the switch section 104 selects the data format to be transmitted based on this, so that the capability of the reception terminal 7 It is possible to transmit the data in the format according to the above, and to ensure the reproduction on the receiving terminal 7 side.

[0059]

As described above, according to the moving image data transmission system and method of the present invention, when delivering moving image data composed of a plurality of objects, the moving image data transmission system and method can meet the performance and requirements of the receiving terminal. , The transmission method can be selected.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of a moving image transmission system according to a first embodiment.

FIG. 2 is an explanatory diagram showing an example of moving image data transmitted in each embodiment.

FIG. 3 is an explanatory diagram showing an example in which moving image data transmitted in each embodiment is decomposed into objects.

FIG. 4 is an explanatory diagram showing an example of synthesizing object code data transmitted in each embodiment into one piece of moving image data.

FIG. 5 is a block diagram showing a schematic configuration of a moving image transmission system according to a second embodiment.

FIG. 6 is a block diagram showing a schematic configuration of a moving image transmission system according to a third embodiment.

[Explanation of symbols]

1 to 4 ... Moving image data, 5 ... Distribution server, 6 ... Transmission path,
7 ... Receiving terminals 51 to 55 ... Moving image coding unit, 56 ... Moving image synthesizing unit, 57
... storage unit, 58 ... transmission unit

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 5C059 KK37 MA00 MB11 MB21 PP04                       PP28 RA06 RA09 SS08 UA02                       UA05                 5C064 BB05 BC16 BC20 BD02 BD08

Claims (6)

[Claims] 1. A moving image data transmission system for generating and transmitting moving image data composed of a plurality of objects, wherein the object code encodes the plurality of objects for each object to generate object encoded data. Encoding means, combining the plurality of objects to generate the moving image data, encoding the combined moving image data to generate moving image encoded data, and storing the moving image encoded data; and the object code And a transmission means for transmitting the encoded image data and the encoded image data, the moving image data transmission system. 2. A moving image data transmission system for generating and transmitting moving image data composed of a plurality of objects, wherein encoded object storage for accumulating object encoded data obtained by encoding each of the plurality of objects. Means, decoding means for decoding each accumulated object coded data, and combining the decoded objects to generate the moving image data, and encoding the combined moving image data to generate the moving image coded data A moving picture data transmission system comprising: a moving picture coding means for generating the object and a transmitting means for transmitting the object coded data and the moving picture coded data. 3. The transmission means transmits data via a transmission path having a plurality of logical channels, and the object encoded data and the moving image encoded data are allocated to a plurality of logical channels and transmitted. And further comprising channel information transmitting means for transmitting information regarding the allocation of the logical channels.
Alternatively, the moving image data transmission system according to item 2. 4. The data is transmitted to a receiving terminal via a transmission line, and a reception format acquisition unit for acquiring information on a reception format of the reception terminal from the reception terminal, A selection means for selectively transmitting the object coded data and the moving picture coded data to the transmission means based on the information about the reception format acquired by the reception format acquisition means. Item 5. The moving image data transmission system according to items 1 to 3. 5. A moving image data transmission method for generating moving image data composed of a plurality of objects and transmitting the moving image data to a receiving terminal via a transmission path having a plurality of logical channels, wherein each of the plurality of objects is coded. Generating the encoded object coded data, decoding each of the object coded data, combining the decoded objects to generate the moving image data, and encoding the combined moving image data A step of generating moving image coded data, and a step of allocating the object coded data and the moving image coded data to a plurality of logical channels respectively for transmission, and sending information on allocation of the logical channels. A method for transmitting moving image data, comprising: 6. A moving image data transmission method for generating moving image data composed of a plurality of objects and transmitting the moving image data to a receiving terminal, wherein object encoded data is generated by encoding each of the plurality of objects. A step of decoding each of the object encoded data, combining the decoded objects to generate the moving image data, and encoding the combined moving image data to generate moving image encoded data. A step of acquiring information on a reception format of the reception terminal from the reception terminal, selectively selecting the object coded data and the moving picture coded data based on the acquired information on the reception format, And a step of sending to a receiving terminal.