JP2003037571A - Multimedia information transmitting device, multimedia information relay device, and multimedia information receiving device - Google Patents

Abstract

(57) [Summary] [Problem] To transmit supplementary information suitably for a change in user's preference and reception environment, and time shift reproduction. SOLUTION: An information separating means 102 is an information providing means 10.
1 and the main information A1 transmitted by the broadcast-type information transmitting means 104.
2 and supplementary information A13 transmitted by the IP-type transmitting unit 103
And separated into The broadcast-type information transmitting means 104 transmits the main information A
The IP packet transmitting means 103 receives the supplementary information A13, converts it into an IP packet, and makes the main information A as the supplementary information P11.
The transmission is performed in a different system from the transmission system 12. In the multimedia information receiving device 200, the information combining unit 203 combines the main information A12 received by the broadcast-type information receiving unit 201 and the supplementary information A13 received by the IP packet receiving unit 202, and indicates to the user.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia information transmitting apparatus for transmitting multimedia information such as video and audio, a multimedia information relay apparatus for relaying multimedia information, and a multimedia information for receiving multimedia information. With regard to a receiving device, in particular, a broadcast type multimedia information transmitting device represented by digital broadcasting,
In the case of transmitting / receiving multimedia information using a communication device of another system such as IP (Internet Protocol) connection other than that, multimedia for combining the transmitted / received information using both and presenting it to the user The present invention relates to an information transmitting device, a multimedia information relay device, and a multimedia information receiving device.

[0002]

2. Description of the Related Art A conventional method for synthesizing information received by digital broadcasting of multimedia information such as video and audio and information transmitted and received by a communication means different from the broadcast wave by the Internet and providing the user with the information. As a multimedia information receiving device, for example, Japanese Patent Laid-Open No. 11-8886.
There is a program-interlocked information processing device described in Japanese Patent No. In this program-linked information processing device, for the purpose of realizing a two-way advanced information service linked to a program, an internet connection using a telephone line or the like different from the broadcast receiving means used in digital broadcasting is used. Techniques for accessing a broadcasting center to apply for TV shopping and the like, and obtaining detailed program-related information related to a program, synthesizing it with a video / audio signal, and displaying the same have been disclosed.

[0003]

However, in the above-mentioned prior art, the multimedia information constituting a program and the program interlocking information are received by two systems of broadcasting and communication, and real-time processing is provided to the user. However, there is no mention of the technology that complements the multimedia information itself that composes the program, and user preferences, areas where the multimedia information reception environment is poor, and reception environments are not disclosed. In the case of dynamic deterioration, there is no disclosure about transmission of multimedia information in so-called time shift reproduction.

Therefore, the present invention provides a multimedia information transmitting apparatus, a multimedia information relaying apparatus, and a multimedia information suitable for user's preference, dynamic change of receiving environment of multimedia information, and further so-called time shift reproduction. An object is to provide a receiving device.

[0005]

In order to achieve the above object, in the invention according to claim 1, the broadcast type transmitting means for transmitting the main information of the multimedia information by broadcasting, and the complementary information of the multimedia information are provided. It is characterized by having another system transmitting means for transmitting in a system different from that for transmitting the main information.

Particularly, in the multimedia information transmitting apparatus according to the first aspect, further, there is provided a separating means for separating the multimedia information into main information and complementary information, and the broadcast type transmitting means is separated. While the main information is transmitted by broadcasting, the another system transmitting means transmits the separated complementary information by another system.

Further, in the multimedia information transmitting apparatus according to the present invention, the separating means uses the multimedia information of high priority among the multimedia information as main information and the multimedia information of low priority as complementary information. Separately, the broadcast type transmitting means transmits the high priority multimedia information as main information by broadcasting,
The separate system transmitting means may transmit the multimedia information having a low priority as complementary information in a separate system.

Further, in the multimedia information transmitting apparatus according to any one of claims 1 to 3, the multimedia information is MPEG2 video data, and the main information is I picture data constituting the MPEG2 video data. And P picture data, while the complementary information is B picture data forming the MPEG2 video data.

Further, in the multimedia information transmitting apparatus according to any one of claims 1 to 4, further, another system receiving means for receiving a resending request of the main information which is insufficient from the multimedia information receiving apparatus by another system. An extracting unit that extracts the main information requested to be retransmitted from the multimedia information to be transmitted by the broadcast-type transmitting unit, and the different-system transmitting unit uses the extracted main information as complementary information for the broadcast. It is characterized in that it is transmitted in a separate system to the multimedia information receiving device which has transmitted the retransmission request of the type information.

The multimedia information transmitting apparatus according to any one of claims 2 to 4, further comprising another system receiving means for receiving the reception status from the multimedia information receiving apparatus in another system, and the separating means. Separates the multimedia information into main information and complementary information based on the reception status, and the broadcast type transmission means transmits the main information separated based on the reception status by broadcasting, while transmitting the separate system. The means is characterized in that the complementary information separated based on the reception status is transmitted by another system.

Further, in the multimedia information transmitting apparatus according to any one of claims 1 to 6, a plurality of different system transmitting means are provided corresponding to the plurality of multimedia information receiving apparatuses, and the plurality of different system transmitting is provided. The means is characterized in that the complementary information is transmitted in a separate system for each corresponding multimedia information receiving device.

According to the invention described in claim 8,
A multimedia information relay device provided separately from the multimedia information transmitting device according to claim 7, wherein the content of the main information transmitted by the broadcast type information transmitting means of the multimedia information transmitting device is changed. It is characterized by doing.

According to the present invention, the broadcast type information receiving means for receiving the main information of the multimedia information transmitted by the broadcast from the broadcast type transmitting means of the multimedia information transmitting device in a separate system, and the multimedia information. Separate system receiving means for receiving complementary information of the multimedia information transmitted by the separate system transmitting means of the information transmitting apparatus by another system, and the received main information and the complementary information are combined and provided to the user. And an information synthesizing unit for performing the above.

Particularly, in the multimedia information receiving apparatus according to claim 9, a main information accumulating means for accumulating main information of the multimedia information transmitted and received by broadcasting from the broadcasting type transmitting means of the multimedia information transmitting apparatus. And combining means for combining the main information and the complementary information accumulated in the main information accumulating means to provide to the user.
It is characterized by

Further, in the multimedia information receiving apparatus according to claim 10, further, a judging means for judging lack of the main information based on the accumulation of the main information in the main information accumulating means, and a request for resending the lacking main information. Is transmitted to the multimedia information transmitting apparatus by another system, and the another system receiving means is a main unit that requests the resend request transmitted from the multimedia information transmitting apparatus in another system as complementary information. The information is received by another system, and the synthesizing means synthesizes the main information accumulated in the main information accumulating means and the main information for which a resend request is received as complementary information, and provides the synthesized information to the user. And

The multimedia information receiving apparatus according to any one of claims 9 to 11, further comprising:
Grasping means for grasping the reception status of the main information in the broadcast type information receiving means and the grasped reception status are transmitted to the multimedia information transmitting device by another system, and the main information of the multimedia information is based on the reception status. And another system transmitting means for instructing separation of complementary information.

Further, in the multimedia information providing apparatus according to any one of claims 9 to 12, the complementary information of the multimedia information transmitted and received by another system transmitting means of the multimedia information transmitting apparatus is accumulated. Comprising complementary information storage means, the information composition means, main information,
The supplementary information stored in the supplementary information storage means is combined and provided to the user.

[0018]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiment 1. FIG. 1 shows a configuration example of Embodiment 1 of a multimedia information transmitting apparatus and a multimedia information receiving apparatus to which the present invention is applied. In the figure, 100 is a multimedia information transmitting device, 101 is an information providing means, 102 is an information separating means,
103 is an IP (Internet Protocol) packet transmitting means as another system transmitting means, 104 is a broadcast type information transmitting means, 200 is a multimedia information receiving apparatus, 201
Is a broadcast type information receiving means, 202 is an IP packet receiving means, and 203 is an information synthesizing means.

Next, the operation will be described. Information separation means 102
The main information A12, which is received from the information providing means 101 such as a video encoder or a data storage medium, receives the multimedia information A11 such as video / audio constituting a program to be transmitted and is transmitted by the broadcast type information transmitting means 104, IP type transmission means 10 of another system such as an IP network
It is separated into the complementary information A13 transmitted in 3.

The broadcasting type information transmitting means 104 receives the main information A12 transmitted by broadcasting from the information separating means 102 and uses the broadcasting by radio waves or the like to send the main information to the broadcasting type information receiving means 201 of the multimedia information receiving apparatus 200. The information A12 is transmitted.

The IP packet transmitting means 103 converts the complementary information A13 received from the information separating means 102 into IP packets, and sends the IP packet receiving means 202 of the multimedia information receiving apparatus 200 to the IP packet receiving means 202 through the IP type network connection such as the Internet / Intranet. And transmits it as an IP packet P11.

In the multimedia information receiving apparatus 200,
The broadcast type information receiving means 201 is a broadcast type information transmitting means 104.
While receiving the main information A12 transmitted by the IP packet receiving means 202, the IP packet receiving means 202 receives the IP packet P11 of the complementary information A13 transmitted by the IP packet transmitting means 103. Then, the main information A12 and the complementary information A13 are output to the information synthesizing means 203, and the information synthesizing means 203 synthesizes the main information A12 and the complementary information A13, and the synthesized information is passed through a display (not shown) or the like. Present to the user.

Here, the main information A received by the broadcast type communication
When the information synthesizing unit 203 synthesizes 12 and the complementary information A13 received by the IP connection, it is necessary to perform the synthesizing at the same timing, and for this purpose, "information regarding synchronization" is required. come.

Therefore, in the multimedia information transmitting apparatus 100 of the first embodiment, when the information separating means 102 separates multimedia information, the broadcast type information transmitting means 1
Main information A12 to be sent to the server 04 and the IP packet transmission means 10
A synchronization signal related to data synchronization, for example, a time stamp related to the encoding time is added to each of the complementary information A13 to be transmitted to the third information transmission unit 3 to transmit the synchronization signal to the multimedia information receiving device 200. To do so.

Therefore, the multimedia information receiving device 2
At 00, by receiving those synchronization signals and recognizing the synchronization signals received by the information synthesizing means 203 and the like,
It is used to combine the main information A12 and the complementary information A13.

Next, an example of information regarding separation of multimedia information by the information separating means 102 according to the first embodiment and information regarding a synchronization signal added to the separated main information A12 and complementary information A13 will be shown.

FIG. 2 shows an example of frame transmission in MPEG-2 Video, for example, showing a case where I picture and P picture are transmitted by the broadcast type information transmitting means 104 and B picture is transmitted by the IP packet transmitting means 103. ing. In this case, I picture 1000 and B picture 10
01, B picture 1002, P picture 1003, B picture 1004, B picture 1005, B picture 10
Information providing means 1 assuming that encoding is performed in the order of 06, ...
01 to the information separating means 102.

(Contents of Embodiment 4) In this case, the information separating means 102 sends the above-mentioned MP from the information providing means 101.
When the EG-2Video is received, the I picture and the P picture have a high priority and are therefore separated as the main information A12 to the broadcast type information transmitting means 104, while the B picture has a lower priority than the I picture and the P picture, and thus IP. It is separated as complementary information A13 to the packet transmitting means 103.

As described above, by transmitting the high-priority main information A12 by the broadcast-type information transmitting means 104, it is possible to perform transmission while maintaining the immediacy of the high-priority main information A12. The priority here may be determined by the importance of the content of the information to be transmitted, and the strength of the immediacy of the information to be transmitted, that is, how much information is inevitably transmitted in real time. It may be determined by that.

At this time, the information separating means 102 is
Picture 1000, B picture 1001, B picture 1
002, P picture 1003, B picture 1004, B
For each of the picture 1005 and the B picture 1006,
As the synchronization signal, for example, time stamps 1100, 1101, 1102, 1103, 110 related to the encoding time are used.
4, 1105 and 1106 are added.

Then, the broadcast type information transmitting means 104 makes the I picture and the P picture in order of the I picture 1000, the P picture 1003, the P picture 1005, ... While transmitting, the IP packet transmitting means 103 causes the B picture 1001, the B picture 1002, and the B picture 100.
The B pictures are transmitted in the order of 4, B picture 1005, ....

Then, the multimedia information receiving apparatus 20
At 0, the broadcast type information receiving means 201 receives I pictures and P pictures, while the IP packet receiving means 202
Received the B picture and received the main information A, respectively.
12. The complementary information A13 is output to the information synthesizing means 202. When the information synthesizing means 202 receives the main information A12 consisting of I pictures and P pictures and the complementary information A13 consisting only of B pictures, the time stamp information relating to the encoding time given to each picture is referred to as a synchronization signal. By doing so, it is possible to recognize at what time each picture should be reproduced, and the picture is displayed on a display (not shown) or the like according to the time.

For example, it can be seen from the time stamp 1100 that, for example, the I picture 1000 received from the broadcast type information receiving means 201 was coded at time 0 milliseconds, and therefore the information synthesizing means 202 also displays at time 0 milliseconds. To do. Further, for example, the B picture 1001 received by the IP packet receiving unit 202 has the time stamp 11
From 01, it can be seen that the code was encoded at time 33 milliseconds, so the information synthesizing means 202 also displays at time 33 milliseconds, and the video is displayed at the time indicated by the time stamp of each picture. The synchronization of each picture is maintained.

Therefore, according to the first embodiment, while the main information A12 of the multimedia information A11 is transmitted to the multimedia information receiving apparatus 200 as broadcast type information,
Since the complementary information A13 of the multimedia information A11 is transmitted to the multimedia information receiving device 200 in another system of IP connection, the transmission band of the main information A12 can be suppressed and the complementary information A13 can be reliably transmitted. it can.

Particularly, in the first embodiment, MPEG-2 is used.
In the case of video frame transmission, the I-picture and P-picture are transmitted from the broadcast-type information transmitting means 104 as main information A12 having a high priority, while the B-picture is IP as a supplementary information A13 having a low priority in a separate IP connection system. Since the packet is transmitted from the packet transmitting means 103, the B picture is transmitted to the IP packet transmitting means 10 by another system of the IP connection of the complementary information A13 only to the user who desires high image quality, for example.
It is also possible to provide the image quality according to the user by transmitting the data from No. 3 and receiving by the multimedia information receiving apparatus 200 and combining with the I picture and P picture.

Also, in the description of the first embodiment, unlike the second embodiment to be described below, the multimedia information receiving apparatus 200 is a program of multimedia information after the multimedia information receiving apparatus 200 finishes broadcasting. Since the information synthesizing unit 203 synthesizes the main information A12 of the broadcast type information and the complementary information A13 of a system different from the main information A12 in real time, the information synthesizing unit 203 does not have a storage unit for viewing. In the information distribution where importance is attached to the information, for example, live broadcasting of multimedia information, information that cannot be transmitted / received through the broadcast type information transmitting / receiving means 104, 201 is transmitted in real time by the IP connection communication type transmitting / receiving means 103.292 of another system. It becomes possible to complement.

In the description of the first embodiment, as an example of multimedia information, MPEG-2 Video is used.
However, the present invention is not limited to this.
Such as EG4Video and MOTION JPEG,
Of course, other multimedia information may be used. Further, the I picture and P picture having a high priority are separated as the main information A12, and the B picture having a lower priority is separated as the complementary information A13. However, the present invention is not limited to this, and only the I picture is the main information. The information A12 is used, and the P picture and B picture are used as the complementary information A13, or the I picture is the most important so that the complementary information A13 must be delivered to the receiving side through the IP connection.
Of course, the P picture and the B picture may be used as the main information A12. Further, for example, in the case where data in one picture can be separated into basic information for ensuring a minimum image quality and extension information for producing a higher quality image, the former is the main information A12. Of course, the latter may be used as the complementary information A13.

Embodiment 2. FIG. 3 is a diagram showing a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 200 according to Embodiment 2 of the present invention. In the figure, 100 is a multimedia information transmitting device, 101 is an information providing means, 102 is an information separating means, 103 is an IP packet transmitting means, 104 is a broadcast type information transmitting means, 105 is an IP packet receiving means, and 106 is retransmitted credit data. Extraction means, 200 is a multimedia information receiving device, 201 is a broadcast type information receiving means, 202 is an IP packet receiving means, 2
Reference numeral 03 is an information synthesizing means, 204 is a broadcast type information storage means, 2
Reference numeral 05 is an IP packet transmitting means.

That is, the multimedia information transmitting apparatus 100 according to the second embodiment is different from the multimedia information transmitting apparatus 100 according to the first embodiment shown in FIG. 1 in that an IP packet receiving means 105 and a retransmission credit data extracting means are further added. 106
On the other hand, the multimedia information receiving apparatus 200 according to the second embodiment is different from the multimedia information receiving apparatus 200 according to the first embodiment shown in FIG. 1 in that a broadcast type information accumulating means 204 and an IP packet transmitting means are added. 205 is added.

Next, the operation will be described. The second embodiment
The explanation will focus on the unique operation. In the case of the second embodiment,
In the multimedia information receiving apparatus 200, the main information A12 of the broadcast type information received by the broadcast type information receiving means 201 is temporarily stored in the broadcast type information storing means 204. In the case of the second embodiment, the multimedia information transmitting apparatus 10
In the information separating means 102 of 0, the multimedia information A11 from the information providing means 101 is not separated into the main information A12 and the complementary information A13, and all the multimedia information A11 is directly used as the main information A12. The output may be omitted, or the main information A12 and the complementary information A13 may be separated as in the first embodiment.

The information synthesizing means 2 of the second embodiment
03 also functions as a judgment means for judging a shortage of the main information A12, checks the main information A12 stored in the broadcast-type information storage means 204, and provides the user with high-quality information by, for example, rain attenuation. Main information A12 to provide
If it is determined that the shortage occurs, the main information 21 for the shortage is specified, and a retransmission request A16 for requesting the main information 21 for the shortage is output to the IP packet transmitting means 205. Then, the IP packet transmission means 205
The retransmission request A16 is converted into an IP packet and transmitted to the IP packet receiving means 105 of the multimedia information transmitting apparatus 200 in the form of an IP packet P12.

In the multimedia information transmitting apparatus 100,
The IP packet receiving means 105 receives the IP packet P12 and sends the main information A to the retransmission credit data extracting means 106.
Twelve shortfall retransmission requests A16 are passed. Upon receiving the retransmission request A16 received from the IP packet receiving unit 105, the retransmission data extraction unit 106 receives the retransmission request A1.
Based on 6, the main information A14 of the retransmission credit is extracted from the media information providing means 101 in order to supplement the shortage, and is passed to the IP packet transmitting means 103.

Then, the IP packet transmitting means 103 converts the insufficient main information A14 into IP packets,
It is transmitted as an IP packet P11 to the IP packet receiving means 202 of the multimedia information receiving apparatus 200.

On the other hand, the multimedia information receiving apparatus 200
In the IP packet receiving means 202, the IP packet P11 of the insufficient main information A14 transmitted by the IP packet transmitting means 103 of the multimedia information transmitting apparatus 100 is received, and the insufficient main information A14 is sent to the information synthesizing means 203. hand over. Here, this data A14 is the main information A1 for the shortage.
The data sent in response to the transmission of the resend request A16 for requesting 2, that is, the shortage main information A12 not stored in the broadcast type information storage means 204, the information synthesis means 203 uses the data. The shortage main information A12, which is A14, and the main information A12 accumulated in the broadcast-type information accumulating unit 204 are combined and displayed on a display (not shown) or the like to present to the user.

Therefore, according to the second embodiment, the main information A, which is broadcast type information, is caused by the deterioration of the receiving environment such as rainfall.
If only low quality information can be received at the time of 12 and the main information is insufficient, an IP requesting instruction for the insufficient main information is issued.
It transmits to the multimedia information transmitting apparatus 100 through the IP packet transmitting / receiving means 205, 105 by connection,
I by IP connection with the main information of the shortage as the supplementary information 14.
Since the P-packet transmitting / receiving means 103 and 202 are used for receiving and synthesizing at the time of storage / reproduction, even if only low-quality information can be received at the time of receiving broadcast type information, high-quality information is provided to the user at the time of storage / reproduction. It is possible to

Embodiment 3. Next, a third embodiment will be described. The third embodiment has the same configuration as the multimedia information transmitting apparatus 100 and the multimedia information receiving apparatus 200 of the second embodiment shown in FIG.
Since a new function for "time shift reproduction" is added to the multimedia information receiving apparatus 200 of the second embodiment, the description of the configuration will be omitted and the configuration of the second embodiment shown in FIG. 3 will be omitted. The operation unique to the third embodiment will be described with reference to FIG.

Next, the operation will be described. FIG. 4 shows the conventional "time shift reproduction". The "time shift reproduction" is a function of watching a program from the beginning of the program while recording, and when the user starts watching the program at time T1 (time between the program start time S1 and the program end time E1). Then, while the broadcasted contents are accumulated in the hard disk or the like, the user can see the accumulated contents while being accumulated. Therefore, in order to watch the program from the beginning, it is necessary to accumulate the programs in advance from the program start time S1 as shown in FIG.

However, for example, as shown in FIG. 5, when the accumulation of the program is started from the time T1 and the program from the program start time S1 to the time T1 is not accumulated, the time shift reproduction is performed. Even if there is, the user cannot watch the program from the program start time S1 to the viewing start time T1, and as a result, the user can watch only from the middle of the program.

Therefore, in the multimedia information receiving apparatus 200 according to the third embodiment, the information synthesizing means 203 and the like serve as a judging means for judging the lack of the main information when receiving the instruction to start the time shift reproduction of a certain program from the user. It functions to judge whether or not the program is stored in the broadcast type information storage means 204 from the beginning. If the program is not stored from the start of the program, the broadcast type information among the programs is stored. Broadcast portions not stored in the storage means 204 are I
The command A16 for transmitting the P packet is output to the IP packet transmitting means 205, and the IP packet transmitting means 205 transmits the command A16 in the form of the IP packet PP12 to the multimedia information transmitting apparatus 100 by IP connection.

Then, the multimedia information transmitting apparatus 10
0, as shown in FIG. 3, the IP packet receiving means 10
5 receives the command, and resending credit data extraction means 10
6 is a program which the user intends to perform time shift reproduction from the information providing means 101 based on the instruction A16. The broadcast type information storage means 20 of the multimedia information receiving apparatus 200
4, the multimedia information of the programs that have been broadcast from the program start time S1 to the viewing start time T1 that has not been stored in FIG. 4 is extracted and output to the IP packet transmission means 103. The IP packet transmitting means 103 converts the multimedia information of the extracted and unstored programs broadcast from the program start time S1 to the viewing start time T1 into IP packets as complementary information A14, and I
Multimedia information receiving device 2 in the form of P packet P11
To 00.

As a result, in the multimedia information receiving apparatus 200, as shown in FIG. 6, the program broadcast from the program start time S1 to the viewing start time T1 is transmitted through the IP packet transmitting / receiving means 103 and 202 by IP connection to the IP packet P11. The complementary information A14 in the form of is downloaded by the IP packet receiving means 202 and the content from the viewing start time T1 to the program end time E1 is held by the information synthesizing means 203, or the broadcast type information is transmitted via the information synthesizing means 203. The user can see all the contents from the start to the end of the program by sending it to the storage means 204 for storage and reproduction.

Therefore, according to the third embodiment, when the received program is time-shifted and reproduced, even if the program is not accumulated from the start of the program, the IP connection is used to store the unaccumulated portion. By having the program transmitted as the complementary information A14, the time shift reproduction can be performed from the beginning of the program.

As a result, for example, on the side of the broadcasting station having the multimedia information transmitting apparatus 100, it is possible to obtain a profit by making a business model by charging only for the downloaded portion by the IP connection.

[0054] Embodiment 4 of the form 4. then implementation of the embodiment will be described.

FIG. 7 shows a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 2 according to the fourth embodiment.
It is a figure which shows 00. The fourth embodiment is characterized in that the multimedia information receiving apparatus 200 has a reception status grasping means 204 for grasping the reception status of broadcast type information. Since the other configurations are the same as those of the first and second embodiments shown in FIGS. 1 and 3, the same reference numerals are given and the description thereof will be omitted.

Next, the operation will be described. The fourth embodiment
The explanation will focus on the unique operation. First, in the multimedia information receiving apparatus 200, the reception status grasping unit 204 receives the main information A12 received by the broadcast type information receiving unit 201.
Is checked to determine whether or not the main information A12 is correctly received. The main information A12 is the main information A12 transmitted from the broadcast type information transmitting means 104 of the multimedia information transmitting apparatus 100, which is received by the broadcast type information receiving means 201. In the information separating means 102 of the multimedia information transmitting apparatus 100 of No. 4, the multimedia information A11 from the information providing means 101 is not separated into the main information A12 and the complementary information A13, and all the multimedia information A11 is kept as it is.
It may be 12 or may be separated into the main information A12 and the complementary information A13 as in the above embodiment.

When it is determined that the main information A12 is not correctly received, the reception status grasping means 204 sends the information A17 regarding the reception status to the IP packet transmitting means 205, and the IP packet transmitting means 205 related to the reception status. The information A17 is converted into an IP packet, and the multimedia information transmitting apparatus 1 is transmitted through the IP packet transmitting means 205
00 in the form of an IP packet P12.

Then, the multimedia information transmitting apparatus 10
In the IP packet receiving unit 105 of 0, the IP packet P12 of the received information A17 regarding the reception status is transmitted to the information A1 regarding the reception status of the multimedia information receiving apparatus 200.
7 and sends it to the information separating means 102. Information separation means 1
In 02, the main information A12 and the main information A12 for transmitting the multimedia information provided from the information providing means 101 by broadcasting based on the information A17 regarding the reception status.
Complementary information A1 transmitted by IP connection in a system different from 12
Separate into 3.

For example, when video transmission / reception in MPEG-2 System is performed via the broadcast type information transmission / reception means 104, 201, the transmission side transmits main information A12 of multimedia information including I picture, P picture, and B picture. Although it is transmitted from the broadcast type information transmitting / receiving means 104, I-pictures,
In a case where only the P picture is received and the B picture is not received, the multimedia information transmitting apparatus 100 on the transmitting side is informed of the receiving state and the image quality is improved. The B picture is transmitted as the complementary information A13 via the IP via the IP transmitting / receiving means 103 and 202.

As a result, on the multimedia information receiving device 200 side, even if the receiving side does not receive the B picture of the main information A12 due to the influence of rain attenuation or the like, the B picture is the complementary information. IP as A13
Since the image is transmitted via the IP via the transmitting / receiving means 103 and 202, it is possible to improve the image quality of the image by receiving this and synthesizing it by the information synthesizing means 203.

Therefore, according to the fourth embodiment, the reception status grasping means 20 is provided on the multimedia information receiving apparatus 200 side.
4, the current reception status on the receiving device side is grasped, and the reception status is transmitted to the multimedia information transmitting device 100 side through an IP connection of a system different from the main information A12, A12. On the information transmitting device 100 side, main information A12, A1 is set in accordance with the current reception status on the multimedia information receiving device 200 side.
The main information A12 transmitted from the broadcast-type information transmitting means 104 can be supplemented by controlling the transmission of the supplementary information A13 by an IP connection of a system different from that of 2.

Unlike the multimedia information receiving apparatus 200 shown in FIG. 3, the multimedia information receiving apparatus 200 according to the fourth embodiment does not include the broadcast type information accumulating means 204. Type information storage means 204
Of course, it may be provided.

Further, regardless of the deterioration of the receiving environment such as rainfall, the user of the multimedia information receiving apparatus 200 is not satisfied with only receiving the main information A12 of the broadcast type information, and the supplementary information A13 of higher quality or the like is not received. Even when the transmission request instruction is transmitted to the multimedia information transmitting apparatus 100 through the IP connection and the complementary information A13 is received through the IP connection, the user is provided with high quality information by synthesizing at the time of storing and reproducing. Is possible. In this case, the reception status grasping means 204 on the multimedia information receiving apparatus 200 side is unnecessary, and the IP packet transmitting means 103 on the multimedia information transmitting apparatus 100 side is
Normally, the complementary information A13 is sent to the multimedia information receiving device 2
00 packet, the IP packet receiving means 105 sends the complementary information A13 from the multimedia information receiving apparatus 200.
When the IP packet receiving unit 105 receives the transmission request instruction A17 of the IP packet P12, the IP packet receiving unit 105
To the complementary information A13, the complementary information A13 is separated by sending a transmission request instruction A17 of the complementary information A13.
The P packet transmitting means 103 may transmit the complementary information A13 to the multimedia information receiving apparatus 200 in the form of the IP packet P11.

Embodiment 5. Next, a fifth embodiment will be described.

FIG. 8 shows a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 2 according to the fifth embodiment.
It is a figure which shows 00. In the figure, reference numeral 206 denotes an IP transmission information storage means as a complementary information storage means. Other configurations are the same as those of the first embodiment shown in FIG.
That is, the fifth embodiment is different from the first embodiment in that
The multimedia information receiving device 200 has a complementary information storage means 206 for storing the complementary information A13 received by the IP connection via the IP packet receiving means 202, and in the information synthesizing means 203, the real time information received by the broadcast type information receiving means 201. It is characterized in that the main information A12 of the broadcast and the complementary information A13 read from the complementary information storage means 206 in advance are combined to present the combined information to the user.

Next, the operation will be described. The fifth embodiment
The explanation will focus on the unique operation. For example, in the multimedia information transmitting apparatus 100, the broadcast type information transmitting means 104
When it becomes necessary to transmit multimedia information having a larger capacity than the band allocated for the broadcast type information transmission of the above, the multimedia information transmitting apparatus 1 according to the fifth embodiment
In 00, the information separating means 1 is provided before the large volume information is broadcast.
02 separates the multimedia information A11 that exceeds the band allocated for broadcasting type information transmission, and supplements the multimedia information A11 that exceeds the band with complementary information A13.
As the main information A1 in advance in the form of an IP packet P11 through the IP packet transmitting means 103 by IP connection.
It transmits by IP connection of the system different from 2.

In the multimedia information receiving apparatus 200,
The IP packet P11 of the complementary information A13 is received through a system different from the main information A12 via the IP packet receiving unit 202 by IP connection, and the received complementary information A13 is stored in the complementary information storage unit 206.

When the user or the like gives an instruction to start broadcasting, the information synthesizing means 203 is transmitted without exceeding the band allocated for broadcasting type information transmission, and the main information received by the broadcasting type information receiving means 201. A12 and the complementary information A13 stored in the complementary information storage means 206, which is the multimedia information exceeding the band allocated for broadcasting type information transmission, are combined and displayed on a display (not shown) or the like. Then, the combined information is presented to the user.

Therefore, according to the fifth embodiment, the multimedia information receiving apparatus 200 side is provided with the complementary information storage means 206 for storing the complementary information received via the IP packet receiving means 202 by the IP connection. When it becomes necessary to transmit multimedia information having a larger capacity than the bandwidth allocated for the broadcast type information transmission by the information transmitting means 104, the multimedia information for the bandwidth exceeding the bandwidth is IP-connected. Packet transmission means 1
It is possible to transmit all the multimedia information to the multimedia information receiving device 200 side by transmitting the complementary information via 03 as a separate system.

Further, irrespective of the band allocated for broadcasting type information transmission by the broadcasting type information transmitting means 104,
For example, in a news program, only the video and audio of an announcer, which requires real-timeness, are transmitted as the main information A12 of broadcast-type information, while the real-timeness is not so required for video information of a background portion such as a studio set. That is, since it is expected that it will not change so much over time, transmission / reception may be performed in advance as the complementary information A13 using the IP connection. In this way, for information that is not required to have a high real-time property, it is broadcast by separating it from the multimedia information as complementary information A13 and transmitting it through a system different from the main information A12 through the IP packet transmitting means 103 by IP connection. All the multimedia information can be transmitted to the multimedia information receiving apparatus 200 side while suppressing the broadcast type information transmission band by the type information transmitting unit 104 to the extent that real-time property is required. In particular, the complementary information A13 that does not require real-time property is I
By sending using the P connection, it is possible to send a small amount or a large amount according to a user's instruction.

When the complementary information A13 is stored, not only the IP packet transmitting / receiving means 103 and 202 but also the CD-RO is used as a communication type means of another system other than the broadcast type.
A distribution means using a recording medium such as an M / DVD is also conceivable.

Sixth Embodiment Next, a sixth embodiment will be described.

FIG. 9 shows a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 2 according to the sixth embodiment.
It is a figure which shows 00,300. In the sixth embodiment,
A plurality of multimedia information transmitting devices 100 (in FIG. 9,
For convenience of explanation, the number is set to two, but it is of course possible to use more than two. )
Of the multimedia information receiving devices 200 and 300, respectively, having IP packet transmitting means 103 and 106, and the plurality of IP packet transmitting means 103 and 106 corresponding to the multimedia information receiving devices 200 and 30 respectively.
0, supplementary information A13, A through IP connection individually
It is characterized in that 15 pieces of information are transmitted.

Next, the operation will be described. The sixth embodiment
The explanation will focus on the unique operation. In the multimedia information transmitting means 100 of the sixth embodiment, the information separating means 10
The main information A12 common to the multimedia information receiving devices 200 and 300 to be transmitted by broadcasting is separated from the multimedia information provided from the information providing means 101 by the broadcasting-type information transmitting means 104 so as to be transmitted by broadcasting. Output.

On the other hand, the information separating means 102, based on the multimedia information A11 provided by the information providing means 101, complement information A13, A15 unique to each multimedia information receiving apparatus 200, 300 for each multimedia information receiving apparatus 200, 300. Each of the multimedia information receiving devices 200 and 3 in a separate system from the main information A12.
IP packet transmission means 103, 1
It outputs to 06.

Here, the multimedia information receiving apparatus 20
As the complementary information A13 and A15 specific to 0,300, for example, for an area where data is difficult to reach due to the broadcast wave by the broadcast-type information transmitting means 104, IP by IP connection is used.
Through the packet transmitting means 103 and 106, the main information A12 not received by the broadcast type information is complemented, and the multimedia information receiving apparatus 200 of the user who has a reception contract,
IP packet transmitting means 10 by IP connection only to 300
It is conceivable to provide complementary information A13 and A15 in order to display a high quality image through 3,106.

Further, with respect to the main information A12 of the video including violence and sexual depiction, to the multimedia information receiving apparatus 200, 300 which has a contract to prevent such depiction from being shown. Is complementary information A13, A15, which is information necessary for performing processing such as mosaic processing.
It can also be used for applications such as providing as. On the contrary, the information which has already been subjected to the mosaic processing is provided as the main information A12, and the information necessary for removing the mosaic is provided by the complementary information A13 and A15 for each of the multimedia information receiving devices 200 and 300. But of course it is good.

Therefore, according to the sixth embodiment, on the multimedia information transmitting apparatus 100 side, the IP packet transmitting means 103 and 106 corresponding to the respective multimedia information receiving apparatuses 200 and 300 are provided and the corresponding multimedia information is transmitted. I by IP connection for each of the receiving devices 200, 300
Complementary information A through the P packet transmitting means 103 and 106
Since the A.13 and A15 are transmitted separately from the main information A12, the multimedia information receiving devices 200 and 30 are transmitted.
Complementary information A13, A15 transmitted by IP connection every 0
You can change the content of.

In the first to sixth embodiments, the IP communication is used as another system transmitting means for transmitting the complementary information A13 of the multimedia information in a system different from the broadcast communication means 104 for transmitting the main information A12. However, the present invention is not limited to this, and it is sufficient if the complementary information of the multimedia information can be transmitted in a system different from that of the broadcast communication means 104. Of course, communication other than the packet transmission means, such as data communication using a dedicated line, may be used.

Seventh Embodiment Next, a seventh embodiment will be described. FIG. 10 shows a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 200 according to the seventh embodiment.
300 and multimedia information relay device 400, 50
It is a figure which shows 0. In the seventh embodiment, a plurality of multimedia information transmitting apparatuses 100 (two in FIG. 10 are shown for convenience of explanation, but more than this is of course possible) corresponding to multimedia information receiving apparatuses 200 and 300 ( In FIG. 10, the number is set to two for convenience of explanation, but it is also possible to use more than two.)
It is characterized by relaying 0,500 and individually transmitting main information by broadcasting. In the figure, 40
1, 501 are broadcast type information transmitting means, 402, 502 are information synthesizing means, and 403, 503 are information providing means.

Next, the operation will be described. The seventh embodiment
The explanation will focus on the unique operation. In the multimedia information transmitting apparatus 100 according to the seventh embodiment, the information separating means 10
2 is the multimedia information A11 provided from the information providing means 101 to the multimedia information receiving device 200, 3
The main information A12 and A18 to be transmitted by broadcasting are separated for each 00, and multimedia information relay device 400,
It is output to the information synthesizing means 402 and 502 of 500. The main information A12 and the main information A18 may be the same information or different information.

On the other hand, the multimedia information relay device 40
In 0 and 500, information combining means 402 and 502, respectively.
In the main information A12, A18 and the information providing means 40
The information A42 and A52 from the information A3 and 503 are combined, and the main information A4 is added to the respective broadcast type information transmitting means 401 and 501.
1, output as A51. Broadcast type information transmitting means 40
Reference numerals 1, 501 respectively receive main information A41, A51 transmitted by broadcasting from the information synthesizing means 402, 502, and use broadcasting by radio waves or the like to broadcast-type information receiving means 201, 30 of the multimedia information receiving apparatus 200, 300, respectively.
The main information A41 and A51 are transmitted to 1.

Here, for example, it is assumed that the multimedia information transmitting apparatus 100 is a terrestrial key station, the multimedia information relay apparatuses 400 and 500 are terrestrial local stations, and the multimedia information transmitting apparatus 10 that is a key station.
The supplementary information A13 transmitted by the IP packet transmitting means 103 of 0 is the information common throughout the nation, and is the main information transmitted by broadcasting from the broadcast type information transmitting means 401, 501 via the multimedia information relay devices 400, 500 which are local stations. A1
2, A18 is information unique to the region or information necessary for transmitting the information as main information, for example, information regarding synchronization.

Then, in the multimedia information relay means 400, 500 which are local stations, the main information A12, A1
8, the main information A42 and A52 unique to the region are further added from the information providing means 403 and 503 to the information combining means 402 and 5, respectively.
02, and the information synthesizing means 402 and 502 synthesize the information to obtain the final main information A41 and A51.
It is output to the broadcast type information transmitting means 401, 501.

Here, as the main information A12 and A18 provided from the multimedia information transmitting apparatus 100, which is a key station, for example, image information of a background portion such as a set of a studio is transmitted as information nationwide in news programs. Then, the multimedia information relay means 40 which is a local station
Area-specific main information A42, A5 provided at 0,500
The second method is to use an announcer of a local station or to send video and audio of scenery of each region. In this way, the multimedia information relay means 4 which is a local station
Main information A42 and A52 unique to 00 and 500 respectively
By newly providing, the main information A12, A18 provided from the multimedia information transmitting apparatus 100 is left as it is, and the content of the information transmitted from the broadcast information transmitting means 401, 501 as the main information A41, A51 is maintained. It can be changed for each of the multimedia information relay devices 400 and 500.

Then, the multimedia information receiving apparatus 20
At 0, the main information A12 is transmitted via the broadcast type information receiving means 201.
While receiving the main information 41 including the main information A42,
The complementary information A13 is received via the IP packet receiving unit 202, the main information 41 and the complementary information A13 are combined by the information combining unit 203, and the combined information is presented to the user. On the other hand, in the multimedia information receiving device 300,
The main information 51 including the main information A18 and the main information A52 is received via the broadcast type information receiving means 301, and the complementary information A13 is received via the IP packet receiving means 202,
The information combining means 30 combines the main information 51 and the complementary information A13.
The combined information is presented in 3 and presented to the user.

Therefore, according to the seventh embodiment, the multimedia information transmitting apparatus 100 and the broadcast type information transmitting means 40.
Since the multimedia information relay apparatuses 400 and 500 for individually adding the main information are provided between the multimedia information transmitting apparatus 100 and the multimedia information transmitting apparatuses 100 and 501, respectively, the multimedia information is different from the main information A12 and A18 provided from the multimedia information transmitting apparatus 100. It is possible to add individual main information to each of the relay devices 400 and 500.

In the seventh embodiment, the information providing devices 403 and 503 are not necessarily required in the multimedia information relay devices 400 and 500, and the main information A12 and A18 sent from the key station are directly used as they are. You may broadcast as information A41 and A51.

In the seventh embodiment, the information providing means 403, 503 and the information synthesizing means 402, 502 are provided in the multimedia information relay devices 400, 500, but the present invention is not limited to this. However, any means may be provided in the multimedia information relay devices 400 and 500 as long as the main information transmitted from the broadcast-type information transmission means 401 and 501 can be changed. It is also possible to provide a means for deleting, or a means for deleting in addition to these means.

Further, also in the seventh embodiment, as shown in FIG.
6, the information separating means 102 separates the complementary information 103, 106 for each of the multimedia information receiving devices 200, 300, and the IP packet transmitting means 10
3, 106, complementary information 103, 10 to the corresponding multimedia information receiving devices 200, 300, respectively.
6 may be transmitted.

[0091]

As described above, according to the present invention,
While the main information of the multimedia information is transmitted by broadcasting, the complementary information of the multimedia information is transmitted separately from the main information according to the user's request and the reception environment. In addition to being suppressed, the supplementary information can be surely transmitted. As a result, it becomes possible to send and receive the complementary information according to the preference of the user and the change of the receiving environment.

Also, by transmitting / receiving main information of multimedia information which is insufficient on the receiving side as complementary information, transmission / reception can be suitably performed for time shift reproduction.

[Brief description of drawings]

FIG. 1 is a first embodiment of a multimedia information transmitting apparatus and a multimedia information receiving apparatus to which the present invention is applied.
The figure which shows the structural example.

FIG. 2 is a diagram showing an example of frame transmission in MPEG-2 Video, for example. Therefore, according to the first embodiment,

FIG. 3 is a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 20 according to the second embodiment of the present invention.
The figure which shows 0.

FIG. 4 is a diagram showing a conventional “time shift reproduction”.

FIG. 5 is a diagram showing a defect in a conventional “time shift reproduction”.

FIG. 6 is a diagram showing “time shift reproduction” according to the third embodiment.

FIG. 7 is a diagram showing a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 200 according to the fourth embodiment.

FIG. 8 is a diagram showing a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 200 according to a fifth embodiment.

FIG. 9 is a diagram showing a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 200 according to the sixth embodiment.

FIG. 10 is a diagram showing a multimedia information transmitting apparatus 100 and a multimedia information receiving apparatus 200 according to the sixth embodiment.

[Explanation of symbols]

100 multimedia information transmitting device, 101 information providing means, 102 information separating means, 103 IP packet transmitting means (separate system transmitting means), 104 broadcast type information transmitting means (broadcast type transmitting means), 200 multimedia information receiving device, 201 Broadcast type information receiving means, 202 IP
Packet receiving means (different system receiving means) 203 Information combining means (judging means) 204 Reception status grasping means.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 7/081 H04N 7/08 Z 7/173 620 7/137 Z 7/32 F term (reference) 5C059 MA00 PP05 PP06 PP07 RA08 RB02 RC04 RE16 RF23 SS01 SS08 5C063 AA01 AB03 AB07 AC01 AC10 BA08 CA23 CA36 DA01 DA07 DA13 DB09 5C064 BA01 BB05 BC10 BC18 BC25 BD02 BD05 BD08 BD09 BD14 5K028 AA01 BB04 CC05 EE03 EE07 KK32 MM32

Claims (13)

[Claims] 1. A broadcasting type transmission means for transmitting main information of multimedia information by broadcasting, and another system transmission means for transmitting complementary information of the multimedia information in a system different from that of the transmission of the main information. A multimedia information transmission device characterized by the above. 2. The system further comprises a separating means for separating the multimedia information into main information and complementary information, wherein the broadcast type transmitting means transmits the separated main information by broadcasting while the separate system. The multimedia information transmitting apparatus according to claim 1, wherein the transmitting means transmits the separated complementary information by another system. 3. The separating means separates the multimedia information having a high priority among the multimedia information as main information and the multimedia information having a low priority as complementary information, and the broadcasting type transmitting means separates the priority information. 3. The multimedia information according to claim 2, wherein the multimedia information having a high priority is transmitted by broadcasting as the main information, while the different system transmitting means transmits the multimedia information having a low priority as the complementary information by another system. Transmitter. 4. The multimedia information is MPEG2 video data, the main information is I picture data and P picture data forming the MPEG2 video data, and the complementary information is forming the MPEG2 video data. 4. The multimedia information transmitting apparatus according to claim 1, wherein the multimedia information transmitting apparatus is B picture data. 5. Further, another system receiving means for receiving a retransmission request of the main information which is insufficient from the multimedia information receiving device by another system, and a multimedia which should be transmitted by the broadcasting type transmitting means to the main information for which the retransmission request is made. Extracting means for extracting from media information, the separate system transmitting means is separate system to the multimedia information receiving device that has transmitted the retransmission request of the broadcast type information with the extracted main information as complementary information. It transmits, The multimedia information transmission apparatus in any one of the Claims 1-4 characterized by the above-mentioned. 6. The system further comprises another system receiving means for receiving the receiving status from the multimedia information receiving apparatus in another system, wherein the separating means separates the multimedia information into main information and complementary information based on the receiving status. Separation, the broadcast type transmission means transmits the main information separated based on the reception status by broadcasting, while the separate system transmission means transmits the complementary information separated based on the reception status in another system, The multimedia information transmitting apparatus according to any one of claims 2 to 4, wherein 7. A plurality of different system transmitting means are provided corresponding to a plurality of multimedia information receiving devices, and the plurality of different system transmitting means transmit complementary information in different systems for each corresponding multimedia information receiving device. The multimedia information transmitting apparatus according to any one of claims 1 to 6, characterized in that. 8. A multimedia information relay device provided separately from the multimedia information transmitting device according to claim 1, wherein the broadcast-type information transmitting means of the multimedia information transmitting device is provided. A multimedia information relay device characterized by changing the content of main information to be transmitted. 9. A broadcast type information receiving means for receiving main information of multimedia information transmitted by broadcasting from a broadcast type transmitting means of the multimedia information transmitting apparatus by another system, and another system transmitting means of the multimedia information transmitting apparatus. A separate system receiving means for receiving the complementary information of the multimedia information transmitted by another system in a separate system, and an information combining means for combining the received main information and the received complementary information and providing them to the user. A multimedia information receiving device characterized by the above. 10. The main information storage means for storing main information of multimedia information transmitted and received by broadcasting from the broadcast type transmission means of the multimedia information transmission device, wherein the combining means is the main information storage means. 10. The multimedia information receiving apparatus according to claim 9, wherein the main information and the complementary information accumulated in are combined and provided to the user. 11. A determination means for determining a shortage of the main information based on the accumulation of the main information in the main information accumulation means, and a retransmission request for the lacking main information are transmitted to the multimedia information transmitting apparatus by another system. The separate system receiving means, the separate system receiving means receives, in a separate system, the main information for which the retransmission request has been transmitted in a separate system as complementary information from the multimedia information transmitting device, and the combining means 11. The multimedia information reception according to claim 10, wherein the main information stored in the main information storage means and the main information for which a resend request is received as complementary information are combined and provided to the user. apparatus. 12. The grasping means for grasping the reception status of the main information in the broadcast type information receiving means and the grasped reception status are transmitted to the multimedia information transmitting device by another system, and based on this reception status. 12. The multimedia information receiving apparatus according to any one of claims 9 to 11, further comprising: another system transmitting unit that instructs separation of main information and complementary information of the multimedia information. 13. Complementary information accumulating means for accumulating complementary information of the multimedia information transmitted and received by the separate system transmitting means of the multimedia information transmitting apparatus, wherein the information synthesizing means comprises main information and the complementary information. The multimedia information receiving apparatus according to any one of claims 8 to 11, wherein the multimedia information receiving apparatus combines the complementary information accumulated in the information accumulating means and provides the synthesized information to the user.