JP2004328204A - Video signal processor - Google Patents

Abstract

A video signal transmission processing device and a video signal reception processing device capable of simultaneously viewing all or most regions of a panoramic video and reducing the cost of a receiving device are provided.
A video signal photographed by a plurality of photographing means is synthesized into one panoramic image by a video synthesizing means. The panoramic video signal is compression-encoded by the encoding unit 16 so that it can be transmitted in a band corresponding to one channel, and is transmitted after the multiplexing unit 17 multiplexes the additional information. The receiving device decodes the received signal as a one-channel video signal and displays it.
[Selection diagram] Fig. 1

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a video signal transmitting device for transmitting a television broadcast and a video signal processing device applicable to a video signal receiving device for receiving a television broadcast, and more particularly to a television signal including a panoramic video signal. The present invention relates to a video signal transmission processing device and a video signal reception processing device.
[0002]
[Prior art]
With the progress of digital technology in recent years, the television broadcasting system is also shifting from the conventional analog system (NTSC / PAL / SECAM) to a digital system. For example, terrestrial digital broadcasting has already started in the United States and Europe, and BS digital broadcasting has started in Japan since December 2000. In Japan, terrestrial digital broadcasting is scheduled to start in 2003.
[0003]
In the digital broadcasting, since a broadcast band is used effectively, it is possible to increase the number of channels. One of the applications using this multi-channel is multi-angle broadcasting. This has already been realized in some pay broadcasts in the UK and elsewhere. In multi-angle broadcasting, videos shot from different angles by a plurality of cameras are broadcast as broadcasts on a plurality of channels. Viewers can freely switch channels to view videos at various angles.
[0004]
On the other hand, as another application using multiple channels, panoramic broadcasting has also been proposed. In panoramic broadcasting, a plurality of adjacent continuous angles are connected to each other to form a panoramic image instead of a plurality of discrete angles. The viewer can select and view a desired angle.
[0005]
For example, in Patent Document 1, a plurality of cameras are used to divide and shoot an omnidirectional image, a plurality of video and audio information are multiplexed and transmitted together with additional information, and a plurality of A transmitting device and a receiving device that output only a video signal selected by a viewer among video signals to a television monitor are disclosed. Further, in Patent Document 2, a plurality of demultiplexed video signals are arranged in a memory and stored as a panoramic video, and the plurality of video signals are subjected to a joint process so that a viewer can view the video at an angle over two videos. There is disclosed a broadcasting method and a receiving device that can be selectively viewed even if there is any.
[0006]
[Patent Document 1]
JP-A-9-51513
[Patent Document 2]
JP-A-11-261883
[0007]
[Problems to be solved by the invention]
However, in the above-described panoramic broadcast transmitting apparatus and receiving apparatus, since only a limited part of a wide-angle panoramic video can be viewed simultaneously, the features of the panoramic broadcast cannot be fully utilized. Furthermore, since the receiving device requires a plurality of decoding means, there is a problem that the receiving device becomes expensive.
[0008]
SUMMARY OF THE INVENTION The present invention has been made in view of the above points, and is capable of simultaneously viewing all or most areas of a panoramic video and reducing the cost of the receiving apparatus. It is an object to provide a device and a video signal reception processing device.
[0009]
[Means for Solving the Problems]
In order to achieve the above object, a video signal processing apparatus according to the present invention comprises: an encoding unit for compressing and encoding a panoramic video signal obtained by combining a plurality of video signals; and a panorama compressed and encoded by the encoding unit. Multiplexing means for multiplexing the video signal with panoramic information indicating that the video signal is a panoramic video, wherein the encoding means compresses and encodes at least two of the video signals at different compression rates. It is characterized by the following.
[0010]
Also, the video signal processing device of the present invention is a panoramic video signal in which a plurality of video signals are combined and at least two of the video signals are compression-coded at different compression rates, and indicates that the panoramic video signal is a panoramic video A video signal processing device that receives and processes the multiplexed information signal, wherein the separating unit separates the panoramic information and the encoded panoramic video signal from the received information signal; Decoding means for decoding the encoded panoramic video signal corresponding to the compression ratio for each of the video signals, and display means for displaying the panoramic video signal decoded by the decoding means It is characterized.
[0011]
In these video signal processing apparatuses, it is better that the video signal corresponding to the center of the video is compression-coded at a lower compression ratio than the plurality of video signals corresponding to both ends of the video.
[0012]
Further, the video signal processing device of the present invention includes: an encoding unit that compresses and encodes a panoramic video signal obtained by combining a plurality of video signals; and a panoramic video signal that is compression-encoded by the encoding unit. Multiplexing means for multiplexing panorama information indicating that the panorama video is a panorama video, wherein the panorama video signal is reduced at a predetermined reduction ratio by thinning out at least two video signals in a horizontal direction respectively. It is characterized by having means.
[0013]
Further, the video signal processing device of the present invention is characterized in that a panoramic video signal synthesized so as to include a plurality of video signals which are each thinned out in the horizontal direction and reduced at a predetermined reduction rate, and that it is a panoramic video. A panorama information, and a video signal processing device that receives and processes the multiplexed information signal, and a separation unit that separates the panorama information and the encoded panorama video signal from the received information signal, Decoding means for decoding the encoded panoramic video signal, and display means for enlarging and displaying the panoramic video signal decoded by the decoding means in accordance with the reduction ratio. Features.
[0014]
BEST MODE FOR CARRYING OUT THE INVENTION
Preferred embodiments of the present invention will be illustratively described in detail below with reference to the drawings.
[0015]
(1st Embodiment)
In the first embodiment of the present invention, on the transmitting side, video signals captured by a plurality of capturing means are combined into one panoramic video, compressed and transmitted, and then decoded and displayed as one video signal on the receiving side. Configuration.
[0016]
Now, this embodiment will be described in detail with reference to the drawings.
[0017]
FIG. 1 is a block diagram illustrating a schematic configuration of a video signal transmission processing device (hereinafter, referred to as a “panorama broadcast transmission device”) according to a first embodiment of the present invention.
[0018]
The panoramic broadcast transmitting apparatus includes a plurality of photographing units 11, 12, and 13, a video synthesizing unit 14, an additional information generating unit 15, an encoding unit 16, a multiplexing unit 17, a transmitting unit 18, and a transmitting antenna unit 19. Is done.
[0019]
<Shooting means>
The photographing units 11 to 13 are photographing cameras for photographing program contents for panoramic broadcasting. For example, as shown in FIG. 2, by arranging the photographing means 11 to 13 adjacently on the same circumference, a wide-angle panoramic broadcast video is photographed.
[0020]
The photographing means 11 to 13 may be a photographing camera for HD broadcasting or a photographing camera for SD broadcasting. Further, the number of photographing means may be appropriately increased or decreased depending on how many angles are transmitted in a band for one channel, as described later. Furthermore, as shown in FIG. 2, it is desirable that the images shot by the respective shooting means slightly overlap each other at the ends.
[0021]
<Video synthesis means>
The image synthesizing unit 14 is a unit for synthesizing the images captured by the image capturing units 11 to 13 as one panoramic image. For example, assuming that the images photographed by the photographing means 11, 12, and 13 are images A, B, and C shown in FIG.
[0022]
The image synthesizing unit 14 performs a joint process between images at the time of image synthesis. For example, by performing a correlation between two images to be connected, a process of positioning an overlapping portion is performed. Further, a process of making the joint inconspicuous is performed by applying a low-pass filter or a median filter to the pixel of the joint. Note that the seam processing may use another method.
[0023]
The video signal synthesized by the video synthesis means 14 is output to the encoding means 16. That is, in the present embodiment, the photographing units 11 to 13 and the video synthesizing unit 14 correspond to an input unit that inputs a panoramic video signal obtained by synthesizing a plurality of video signals.
[0024]
<Encoding unit>
The encoding means 16 is means for compression-encoding the panoramic video signal obtained from the video synthesizing means 14. Here, MPEG (Moving Picture Experts Group) -2 is adopted as a compression encoding method.
[0025]
Normally, SD (standard definition) is coded to a bit rate of about 4 to 6 Mbps, and HD (high definition) is coded to a bit rate of about 18 to 24 Mbps. One slot allocates 1.08 Mbps transmission capacity). However, since a panoramic video signal is composed of a plurality of angled videos, when encoded at a normal bit rate, a plurality of channels are required for transmission.
[0026]
Therefore, in the present embodiment, as shown in FIG. 4A, the panoramic video signal is compression-coded at a bit rate of SD broadcast quality. Then, by using the band for HD broadcasting, it becomes possible to transmit a panoramic video signal including a video signal for a plurality of angles (for example, 3 to 5 angles) in a band for one channel.
[0027]
At this time, the panoramic video signal may be further divided into a plurality of regions, and each region may be compression-coded at a different bit rate. More specifically, as shown in FIGS. 4B to 4D, the panoramic video signal is divided in the horizontal direction, and compression encoding may be performed at a higher bit rate in the center area and at a lower bit rate in both end areas. . As a result, it is possible to achieve high-quality image quality in the central part where the viewer (viewer) pays the most attention, while compressing the panoramic video to such an extent that the panoramic video can be transmitted in the band of one channel.
[0028]
It should be noted that the area to be divided to make the bit rate different and the area of each angle photographed by each of the photographing means 11 to 13 do not necessarily have to match. It is sufficient that the entire panoramic video signal is compression-encoded so as to be within the band of one channel, and the number of divisions, the manner of division, and the respective bit rates can be appropriately set.
[0029]
For example, in FIG. 4B, the image is divided into five regions, and compression encoding is performed from the left region to 4 Mbps, 5 Mbps, 6 Mbps, 5 Mbps, and 4 Mbps, respectively. Further, in FIG. 4D, the data is divided into three regions, and compression coding is performed from the left region to 5 Mbps, 10 Mbps, and 5 Mbps, respectively.
[0030]
Instead of using the band for HD broadcasting, compression encoding may be performed so as to be able to transmit in the band for one channel for SD broadcasting by further reducing the bit rate. For example, in FIG. 4C, compression coding is performed from the left area to 1.5 Mbps, 3 Mbps, and 1.5 Mbps, respectively, using six slots for SD broadcasting. Also in this case, by increasing the bit rate of the central area, the image quality equivalent to SD broadcast is maintained in the central area.
[0031]
<Additional information generation means>
The additional information generation unit 15 outputs to the multiplexing unit 17 a packet stream (TS) (Transport Stream) packet of PSI (Program Specific Information) and SI (Service Information) described below.
[0032]
PSI / SI corresponds to program arrangement information, and various tables shown in FIG. 5 are defined. PSI / SI is described in detail in Chapter 5 of the ARIB (radio industry) STD-B10 second part.
[0033]
A PSI / SI signal is transmitted by being arranged in a payload in a TS packet in a signal configuration called a section. The PAT (Program Association Table) specifies a PID (Packet ID) of a TS packet that transmits a PMT (Program Map Table) related to the program arrangement, and the PMT transmits a TS packet that transmits each encoded signal constituting a broadcast program. Is specified.
[0034]
The NIT (Network Information Table) provides information on a network including a plurality of TSs and indicates the specifications of various services and transmission paths performed in the entire network. FIG. 6 shows the data structure of NIT.
[0035]
The NIT section shown in FIG. 6 has two descriptors. The underlined descriptor is a service list descriptor, and provides a list of services by service identification and service type.
[0036]
FIG. 7 shows a service list descriptor structure. The service ID in FIG. 7 uniquely identifies the information service in the TS. This service ID is equal to the broadcast program number identification (Program_number) in the corresponding PMT. The service type indicates the service type (digital TV service, data service, etc.) shown in FIG.
[0037]
In the present embodiment, information that a specific channel or program is a panoramic broadcast (hereinafter, referred to as “panoramic information”) is included in the PSI / SI. For example, a new service type (for example, “Panorama Broadcasting Service ”).
[0038]
Of course, this panoramic information may be included in other parts of the PSI / SI as long as there is a correspondence between the transmitting device and the receiving device. For example, it may be included in the program description portion of the rectangular event descriptor of the EIT (Event Information Table), or may be another portion. Further, the panorama information may include information indicating a compression ratio corresponding to each synthesized video signal.
[0039]
<Multiplexing means, transmitting means>
The multiplexing unit 17 multiplexes the additional information (PSI / SI) generated by the additional information generating unit 15 on the panoramic video signal (video signal and audio signal) encoded by the encoding unit 16. After adding a code for error correction, the signal is modulated and amplified by a modulator (not shown) into a system suitable for the transmission path, and transmitted by the transmitter 18 via the transmission antenna 19. .
[0040]
Next, the receiving device will be described with reference to FIG.
[0041]
FIG. 9 is a block diagram illustrating a schematic configuration of a video signal reception processing device (hereinafter, referred to as a “panorama broadcast reception device”) according to the present embodiment.
[0042]
The panoramic broadcast receiving apparatus includes a receiving antenna unit 21, a tuner unit 22, a signal separating unit 23, a decoding unit 24, a display unit 25, an external input unit 26, and a control unit 27.
[0043]
<Receive antenna means, tuner means>
The receiving antenna means 21 and the tuner means 22 function as receiving means for receiving a television broadcast (information signal) transmitted from the panoramic broadcast transmitting device. The tuner unit 22 obtains information (frequency, TS_ID) of the channel to be received from the control unit 27, switches the frequency based on the information, demodulates a desired TS, and performs error correction.
[0044]
<Signal separation means>
The signal separating unit 23 performs demultiplexing (separation) of multiplexed signals such as video, audio, and PSI / SI. The video signal is output to the decoding means 24. On the other hand, various PSI sections specified by the PID shown in FIG. 5 are filtered here, and information necessary for forming an EPG (electronic program guide) and panorama information are obtained. These pieces of information are output to the control unit 27.
[0045]
<Decoding means>
The decoding means 24 performs processing opposite to the compression coding processing performed by the coding means 16 of the panoramic broadcast transmitting apparatus, that is, decoding of MPEG-2 such as variable length decoding, inverse quantization, inverse DCT, and motion compensation. By performing the processing, the encoded panoramic video signal is decoded. It is preferable that the corresponding video signal is decoded at an expansion rate corresponding to the compression rate based on panorama information including information indicating the compression rate of each synthesized video signal.
[0046]
<Control means>
The control means 27 performs control such as switching of a channel or a program and switching between a video signal and an EPG screen, based on a selection request input from an external input means 26 such as a remote controller operated by a viewer.
[0047]
When a channel or program selection request is received from the viewer, the control means 27 sends information (channel frequency, TS_ID, video PID, video PID) necessary for receiving the channel to the tuner means 22. send. Then, switching is performed so that the video signal output from the decoding unit 24 is output to the display unit 25. Here, a channel number and information necessary for receiving the channel may be tabulated, and the channel switching may be speeded up by skipping the above PAT and PMT.
[0048]
On the other hand, when an EPG display request is received, the control unit 27 generates an EPG screen based on the PSI / SI information obtained from the signal separation unit 23, and displays the EPG screen instead of the video signal on the display unit 25. Output.
[0049]
When generating the EPG screen, it is determined whether each channel or program is a panoramic broadcast or a normal broadcast by referring to the panoramic information included in the additional information. In the present embodiment, as described above, since the panorama information is reflected in the service type in the NIT service list descriptor in the PSI information or in the program description portion of the rectangular event descriptor in the EIT, The means 27 makes a judgment by checking these information.
[0050]
Next, the control means 27 generates an EPG screen so that the viewer can distinguish between a panoramic broadcast and a normal broadcast on the EPG screen. FIG. 10 shows an example of such an EPG screen.
[0051]
In the example of FIG. 10A, channels 100 and 101 are normal broadcasts, and channel 102 is a panoramic broadcast. It is assumed that all programs on channel 102 are broadcast as panoramic broadcast programs. In this case, identification information of normal broadcast or panoramic broadcast may be added for each channel. For example, by displaying a mark “*” in the channel display column of the panoramic broadcast, it is possible to inform the viewer that the 102 channel is a panoramic broadcast.
[0052]
In the example of FIG. 10B, a panoramic broadcast program and a normal program are mixed in one channel. In this case, identification information may be added for each program. For example, by displaying a mark “*” in the program name display column of “F1 Grand Prix Round 5” which is a panoramic broadcast program, it is possible to notify that the program is a panoramic broadcast.
[0053]
As the identification information, any information may be used as long as the viewer can identify whether the broadcast is a normal broadcast or a panoramic broadcast. In addition to the mark, for example, a dedicated icon image may be displayed, display attributes such as color, size, and typeface may be changed, or a sound may be emitted when a channel or program is selected. .
[0054]
According to the configuration of the present embodiment described above, the transmitting side compresses and encodes the panoramic video signal at a compression rate sufficient to simultaneously display the panoramic video signal on a common display screen. Then, since the receiving side can receive the panoramic video signal as one channel or one program, the receiving side can receive the panoramic broadcast by the same processing as ordinary broadcast, decode the panoramic broadcast, and simultaneously display the same on a common display screen.
[0055]
Therefore, it is possible to simultaneously watch all areas of the wide-angle panoramic video. Also, there is no need to provide a special device for panoramic broadcasting such as a plurality of decoding means on the receiving side, and the cost of the receiving device can be reduced.
[0056]
Furthermore, since the panorama information is multiplexed with the panorama video signal, the receiving side can determine whether each channel or each program is a normal broadcast or a panoramic broadcast. Moreover, the EPG screen is configured based on the result of the determination, and the viewer is notified of the normal broadcast or the panoramic broadcast, so that the operability can be improved.
[0057]
(Second embodiment)
First, an outline of a process according to the second embodiment of the present invention will be described with reference to FIG.
[0058]
In the present embodiment, on the transmitting side, video signals (see FIG. 11A) photographed by a plurality of (n) photographing units are respectively reduced to 1 / n (see FIG. 11B). 11), is combined with one panoramic video (see FIG. 11 (c)), compressed and transmitted, and decoded on the receiving side as one video signal, which is then enlarged and displayed n times (FIG. 11 (c)). d) configuration).
[0059]
Now, this embodiment will be described in detail with reference to the drawings.
[0060]
FIG. 12 is a block diagram illustrating a schematic configuration of a panoramic broadcast transmitting apparatus according to the second embodiment of the present invention.
[0061]
The panoramic broadcast transmitting apparatus includes a plurality of photographing units 11, 12, 13, a plurality of video processing units 34, 35, 36 connected to each photographing unit, a video synthesizing unit 37, an additional information generating unit 15, an encoding unit 16, It comprises multiplexing means 17, transmitting means 18, and transmitting antenna means 19. Among them, the components other than the video processing means 34 to 36 and the video synthesizing means 37 are the same as those of the first embodiment, and the description is omitted.
[0062]
<Video processing means>
The video processing units 34 to 36 reduce the video signals photographed by the photographing units 11 to 13 to 1 / n and output to the video synthesizing unit 37. As the reduction process, for example, the number of pixels may be reduced by using a simple thinning process, or an interpolation pixel is formed by a coordinate conversion process such as Bi-Linear or Bi-Cubic, and a part of the original pixels is thinned. The number of pixels may be reduced. The direction in which pixels are reduced and reduced may be, for example, the horizontal direction or the vertical direction as shown in FIG. 11B, or may be reduced in both the horizontal and vertical directions. Should be reduced to 1 / n.
[0063]
<Video synthesis means>
The video synthesizing unit 37 is a unit that synthesizes the video reduced by the video processing units 34 to 36 as one panoramic video. For example, assuming that the video reduced by the video processing means 34, 35, and 36 is the video in FIG. 11B, they are arranged in the horizontal direction and combined as shown in FIG. . The joint processing at this time may be the same as that in the first embodiment.
[0064]
The video signal synthesized by the video synthesizing unit 37 is output to the encoding unit 16. That is, in the present embodiment, the image capturing means 11 to 13, the video processing means 34 to 36, and the video synthesizing means 37 input a panoramic video signal obtained by synthesizing a plurality of thinned video signals. It corresponds to a means.
[0065]
Thereafter, in the same manner as in the first embodiment, the compression encoding process by the encoding unit 16, the multiplexing process of the additional information by the multiplexing unit 17, and the transmission process by the transmission unit 18 and the transmission antenna unit 19 are executed.
[0066]
Next, a panoramic broadcast receiving apparatus according to the present embodiment will be described.
[0067]
FIG. 13 is a block diagram illustrating a schematic configuration of the panoramic broadcast receiving device.
[0068]
The panoramic broadcast receiving apparatus includes a receiving antenna unit 21, a tuner unit 22, a signal separating unit 23, a decoding unit 24, a video processing unit 45, a display unit 25, an external input unit 26, and a control unit 27. Among them, the components other than the video processing means 45 are the same as those of the first embodiment, and therefore the description is omitted.
[0069]
<Video processing means>
The video processing means 45 enlarges the panoramic video signal, which is decoded by the decoding means 44 and reduced to 1 / n as shown in FIG. I do. As the enlargement process, for example, a process of simply outputting the same data n times (nearest neighbor interpolation method) may be used, or an interpolation process such as Bi-Linear or Bi-Cubic may be used. The direction of enlargement corresponds to the direction of reduction in the video processing means 34 to 36 in the transmission device. Since the number of pixels of the photographing unit and the number of pixels of the display device do not always match, the enlargement ratio does not necessarily need to be the reciprocal of the reduction ratio.
[0070]
As described above, in the present embodiment, the image size is reduced (compressed) on the transmission side, and the image size is expanded (expanded) on the reception side, so that the panorama video signal can be transmitted and received in the band for one channel. ing. Therefore, according to the configuration of the present embodiment, the same operation and effect as those of the first embodiment can be obtained. Furthermore, when the reduction ratio of each video signal before synthesis is made different for each corresponding region, that is, when the reduction ratio of the video on both sides is 1 / a and the reduction ratio of the central video is 1 / b, It is also preferable that 1 / a <1 / b. It is also preferable to include information indicating the compression rate of each synthesized video signal in the panorama information, and decode and expand the panorama video signal based on the information.
[0071]
(Third embodiment)
In the first and second embodiments, images captured by a plurality of imaging units are combined in advance into a single panoramic image, and then the subsequent processing is performed. However, in the third embodiment, a plurality of The images photographed by the photographing means are individually processed and output side by side at the time of the final display.
[0072]
Now, this embodiment will be described in detail with reference to the drawings.
[0073]
FIG. 14 is a block diagram illustrating a schematic configuration of a panoramic broadcast transmitting apparatus according to the third embodiment of the present invention.
[0074]
The panoramic broadcast transmitting apparatus includes a plurality of photographing units 11, 12, and 13, a plurality of encoding units 55, 56, and 57 connected to each photographing unit, an additional information generating unit 15, a multiplexing unit 58, a transmitting unit 18, and a transmitting unit. It has an antenna means 19. Among them, the components other than the encoding units 55 to 57 and the multiplexing unit 58 are the same as those of the first embodiment, and thus the description is omitted.
[0075]
<Encoding unit>
The encoding means 55 to 57 are means for compression-encoding the video signal (original video signal) of each angle obtained from the photographing means 11. Here, MPEG-2 is adopted as a compression encoding method, and encoding is performed at a bit rate of about 4 to 6 Mbps for SD (standard definition) and about 18 to 24 Mbps for HD (high definition). Also, the point that the bit rate is selected so that transmission can be performed in a band of one channel as a whole when the video signal of each angle constituting the panoramic video signal is compression-coded is the same as in the first embodiment. It is. At this time, weighting is performed for each video signal. For example, the compression rate is lower (the bit rate is higher) for the video signal at the center, and the compression rate is higher (the bit rate is lower) for the video signal at the end. May be.
[0076]
Here, a configuration of an MPEG bit stream according to the present embodiment and an example of adding information such as a shooting angle of a panoramic broadcast will be described with reference to FIGS. 15 and 16.
[0077]
As shown in FIG. 15, the MPEG bit stream has a sequence layer including a sequence header 101, a sequence extension 102, an extension and user data (0) 103, a GOP (Group of Picture) header 104, an extension and user data (1). GOP layer 105, picture header 106, picture coding extension 107, extension and user data (2) 108, picture layer composed of picture data 109, although not shown, a slice layer and a macro block layer.
[0078]
The sequence layer starts with a sequence header 101 and classifies the MPEG-1 and MPEG-2 bit streams according to the presence or absence of the "extension start code" of the sequence extension 102. In general, a sequence represents an entire video program and ends with a “sequence end code”. The sequence layer is basically composed of one or more GOPs. The sequence header 101 includes information set for each sequence, such as an encoded image size, an aspect ratio, a frame rate, a bit rate, a VBV buffer size, and a quantization matrix. In the sequence extension 102, a profile, a level, a color difference format, and a progressive sequence are designated. Further, as shown in FIG. 16, in the extension and user data (0), user data can be freely set at a sequence level in addition to the extension data and scalability information.
[0079]
In the present embodiment, information (panorama composition information) indicating at which angle (or which photographing means) the sequence has been photographed is added in units of one video program. For example, the information is added to the user data of the extension and user data (0) 103. For example, information of "right" for an image captured by the image capturing means 11, "center" for an image captured by the image capturing means 12, and "left" for an image captured by the image capturing means 13 are added to the user data. Of course, such panorama synthesis information may be described in other header information.
[0080]
The description of the GOP layer, picture layer, slice layer, and macroblock layer is omitted.
[0081]
<Multiplexing means>
The multiplexing unit 58 multiplexes the additional information (PSI / SI) generated by the additional information generating unit 15 with the video signals (video signal and audio signal) of each angle encoded by the encoding units 55 to 57. I do. After adding a code for error correction, the signal is modulated and amplified by a modulating means into a system suitable for a transmission path, and transmitted by a transmitting means 18 via a transmitting antenna means 19.
[0082]
Subsequently, the receiving device according to the present embodiment will be described.
[0083]
The schematic configuration of the panoramic broadcast receiving apparatus of the present embodiment is the same as that of the first embodiment shown in FIG. However, the processing performed by the signal separating means 23 and the decoding means 24 is different from that of the first embodiment. Hereinafter, this point will be described.
[0084]
<Signal separation means>
The signal separating unit 23 demultiplexes a multiplexed TS such as a video signal and PSI / SI. The video signal is output to the decoding means 24. On the other hand, various PSI sections specified by the PID are filtered here, and information necessary for forming an EPG (electronic program guide) and panorama information are obtained. These pieces of information are output to the control unit 27. The above processing is the same as that in the first embodiment.
[0085]
However, in the present embodiment, since the signals photographed at a plurality of angles (or photographing means) are individually compression-encoded and transmitted, the signal separating means 23 is added for each individual sequence described above. The video signal of each angle (or each photographing means) is sequentially output to the decoding means 24 based on the panorama synthesis information.
[0086]
<Decoding means>
The decoding means 24 performs processing opposite to the compression coding processing performed by the coding means 55 to 57 of the panoramic broadcast transmitting apparatus, that is, decoding of MPEG-2 such as variable length decoding, inverse quantization, inverse DCT, and motion compensation. By performing the encoding process, each of the plurality of encoded video signals is decoded.
[0087]
At this time, the video signal of each angle (or each photographing means) input from the signal separating means 23 is sequentially decoded in parallel (simultaneously) or in time series. Then, based on the panorama synthesis information, it is determined at which angle (or photographing means) each video signal has been captured, that is, how to arrange a plurality of video signals, and each decoded video signal is determined. Output to an appropriate position on the display means 25. As a result, the video captured by the capturing unit 11 is displayed on the “right” of the display unit 25, the video captured by the capturing unit 12 is displayed on the “center”, and the video captured by the capturing unit 13 is displayed on the “left”. , A panoramic video is formed on the screen.
[0088]
With the configuration described above, it is also possible to achieve the same functions and effects as the above embodiments.
[0089]
As described above, the preferred embodiments of the present invention have been illustratively described, but the present invention is not limited to these, and includes the following embodiments.
[0090]
(Embodiment 1)
In the present invention, it is preferable that the encoding unit compression-encodes the panoramic video signal so that the panoramic image signal can be transmitted in a band of one channel.
[0091]
(Embodiment 2)
In the present invention, the transmitting means may transmit the multiplexed signal in a band corresponding to one channel.
[0092]
(Embodiment 3)
In the present invention, the plurality of video signals may be reduced so that the size of the video signal before the reduction process is equal to the size of the panoramic video signal.
[0093]
(Embodiment 4)
In the present invention, when the number of the photographing units is n, the video processing unit may reduce the video signal to 1 / n.
[0094]
(Embodiment 5)
In the present invention, it is preferable that panoramic synthesis information indicating an arrangement of the video in a panoramic video is added to the compression-coded video signal.
[0095]
(Embodiment 6)
In the present invention, the apparatus further includes control means for switching display between the video signal and the EPG screen,
The control means,
The EPG screen may be generated in such a manner that panoramic broadcast or normal broadcast can be distinguished on the EPG screen.
[0096]
(Embodiment 7)
The video signal reception processing device according to the sixth embodiment,
The control means,
It is preferable to add identification information to a panoramic broadcast channel or a panoramic broadcast program on the EPG screen.
[0097]
(Embodiment 8)
The video signal reception processing device according to the seventh embodiment,
The identification information may be a mark, an icon image, a display attribute, or a sound.
[0098]
【The invention's effect】
Advantageous Effects of Invention According to the present invention, by appropriately setting the compression ratio of a video, transmission can be facilitated, all or most areas of a panoramic video can be viewed at the same time, and cost reduction on the receiving device side can be achieved. It is possible to provide a video signal transmission processing device and a video signal reception processing device that can perform the processing.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a schematic configuration of a panoramic broadcast transmitting apparatus according to a first embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of installation of photographing means.
FIG. 3 is a conceptual diagram for describing synthesis of video signals.
FIG. 4 is a diagram for describing a compression encoding method according to the first and third embodiments of the present invention.
FIG. 5 is a diagram for describing PSI / SI.
FIG. 6 is a diagram for explaining a data structure of NIT.
FIG. 7 is a diagram for describing a service list descriptor of NIT.
FIG. 8 is a diagram illustrating a service type of NIT.
FIG. 9 is a block diagram illustrating a schematic configuration of a panoramic broadcast receiving apparatus according to the first embodiment of the present invention.
FIG. 10 is a diagram showing a display example of an EPG screen.
FIG. 11 is a conceptual diagram for describing video processing and video synthesis processing according to the second embodiment of the present invention.
FIG. 12 is a block diagram illustrating a schematic configuration of a panoramic broadcast transmitting apparatus according to a second embodiment of the present invention.
FIG. 13 is a block diagram illustrating a schematic configuration of a panoramic broadcast receiving apparatus according to a second embodiment of the present invention.
FIG. 14 is a block diagram illustrating a schematic configuration of a panoramic broadcast transmitting apparatus according to a third embodiment of the present invention.
FIG. 15 is a diagram for describing an MPEG data structure.
FIG. 16 is a diagram for describing extension of an MPEG sequence layer and user data (0).
[Explanation of symbols]
11, 12, 13 photographing means
14 Image synthesis means
15 Additional information generation means
16 Encoding means
17 Multiplexing means
18 Transmission means
19 transmitting antenna means
21 receiving antenna means
22 Tuner means
23 Signal separation means
24 Decoding means
25 Display means
26 External input means
27 control means
34, 35, 36 Image processing means
37 Image synthesis means
44 Decoding means
45 Video processing means
55,56,57 encoding means
58 Multiplexing means

Claims (5)

Encoding means for compression-encoding a panoramic video signal obtained by synthesizing a plurality of video signals;
Multiplexing means for multiplexing panoramic information indicating that it is a panoramic video, to the panoramic video signal compressed and encoded by the encoding means,
Has,
The video signal processing apparatus according to claim 1, wherein said encoding means compresses and encodes at least two video signals at different compression rates. An information signal in which a plurality of video signals are synthesized, and a panoramic video signal in which at least two of the video signals are compression-encoded at different compression rates from each other and panorama information indicating that the video signal is a panoramic video are multiplexed A video signal processing device for receiving processing of
Separating means for separating the panoramic information and the encoded panoramic video signal from the received information signal,
Decoding means for decoding the encoded panoramic video signal corresponding to the compression rate for each video signal,
Display means for displaying a panoramic video signal decoded by the decoding means,
A video signal processing device comprising: The video signal processing device according to claim 1, wherein the video signal corresponding to the center of the video is compression-coded at a lower compression ratio than a plurality of video signals corresponding to both ends of the video. Encoding means for compression-encoding a panoramic video signal obtained by synthesizing a plurality of video signals;
Multiplexing means for multiplexing panoramic information indicating that it is a panoramic video, to the panoramic video signal compressed and encoded by the encoding means,
Has,
A video signal processing device, comprising: a reduction unit configured to reduce the panoramic video signal at a predetermined reduction rate by thinning out at least two of the video signals in a horizontal direction. Information obtained by multiplexing a panoramic video signal synthesized so as to include a plurality of video signals which are each thinned out in the horizontal direction and reduced at a predetermined reduction rate, and panoramic information indicating that the panoramic video signal is a panoramic video A video signal processing device that receives and processes a signal,
Separating means for separating the panoramic information and the encoded panoramic video signal from the received information signal,
Decoding means for decoding the encoded panoramic video signal,
Display means for enlarging and displaying a panoramic video signal decoded by the decoding means in accordance with the reduction ratio;
A video signal processing device comprising:

Images