JP2012004660A - Moving picture encoding method, moving picture decoding method, moving picture encoding apparatus and moving picture decoding apparatus - Google Patents

Abstract

An object of the present invention is to reduce the influence of disturbance of a moving image when an error is mixed in the moving image data.
A moving picture coding method includes steps of separation, moving picture coding, multiplexing, and output. In the separation step, the original moving image frame 100 having a predetermined resolution is separated into a low-resolution first moving image frame 100A and a second moving image frame 100B. In the moving image encoding step, the first and second moving image frames are encoded into the first and second moving image encoding information 103A and 103B by the first and second moving image encoding processes 102A and 102B. . In the multiplexing step, a multiplexed stream 105 including first packet data 105_0 and 2 including first moving image encoded information and second packet data 105_1 and 3 including second moving image encoded information is formed. In the output step, 105 is output as a moving image encoding output signal.
[Selection] Figure 3

Description

  The present invention relates to a moving image encoding method, a moving image decoding method, a moving image encoding device, and a moving image decoding device, and particularly reduces the influence of disturbance of moving images when an error is mixed in moving image data. It relates to effective technology.

  A general moving image compression method called MPEG-2 is a standard standardized by ISO / IEC 13818-2, and is described, for example, in Non-Patent Document 1 below. MPEG-2 is based on the principle of reducing video storage capacity and required bandwidth by removing redundant information from the video stream. MPEG is an abbreviation for Moving Picture Experts Group.

  The MPEG-2 standard only defines the syntax of the bit stream by the encoding process (the rules of the compression encoded data string or the method of configuring the bit stream of the encoded data), so satellite broadcasting / service, cable television, It is flexible enough to be used in various situations such as interactive television and the Internet.

  On the other hand, in Patent Document 1 below, the selection of whether to execute an error concealment process for repairing an error mixed in encoded moving image data adopting the moving image compression standard or to stop the repair is performed. A moving picture decoding apparatus that selects based on a time interval from a frame to the next incoming I frame is described.

  According to this video decoding device, error concealment processing is executed when the above-mentioned time interval is larger than a predetermined threshold, and when the above-mentioned time interval is smaller than the predetermined threshold, The error concealment process is disabled, and the skip process is performed until the next I frame.

JP 2008-42769 A

INTERNATIONAL STANDARD 13818-2, RECOMMENDATION ITU-T 262, "INFORMATION TECHNOLOGY-GENERIC CODING OF MOVING PICTURES AND ASSOCIATED AUDIO INFORMATION: VIDEO" http: // neuron2. net / library / mpeg2 / iso13818-2. pdf [Search October 05, 2009]

  On April 1, 2006, a one-segment partial reception service “One Seg” for digital terrestrial television broadcasting, which mainly targets mobile terminals in Japan, was started. In 1Seg, the amount of information is minimized by broadcasting using one segment obtained by dividing the frequency band of 6 MHz of physical channels from 13 channels to 62 channels of digital terrestrial television broadcasting into 13 segments. Restricted. Therefore, even a terminal having a relatively small information processing capability such as a mobile terminal can be appropriately received. As a feature, data broadcasting can be received simultaneously in addition to video and audio.

  Next-generation one-segment broadcasting called ISDB-Tmm aims to realize new services such as video content download and services, as well as high-quality and high-quality stream broadcasting, compared to one-segment broadcasting. ISDB-Tmm is an abbreviation for Integrated Service Digital Broadcasting-Terrestrial for mobile multimedia.

  Prior to the present invention, the present inventors engaged in the development of a semiconductor integrated circuit called an application processor mounted on a mobile phone terminal capable of receiving the next-generation one-segment broadcasting called ISDB-Tmm described above.

  This next-generation one-seg broadcasting called ISDB-Tmm is required to support high-quality / high-quality stream broadcasting and video content download services. Compared to standard one-seg broadcasting, next-generation one-seg broadcasting The bit rate of MPEG2-TS was expected to be very high.

  However, in next-generation one-seg broadcasting, it was also expected that the disturbance of the moving image would occur due to an error mixed in the encoded moving image data adopting the moving image compression standard due to radio interference in a large city area.

  Against this background, the present inventors have examined a moving image encoding method and a moving image decoding method compliant with the MPEG-2 standard prior to the present invention.

  FIG. 1 shows MPEG video encoding for generating a bit stream of encoded data to be decoded by a moving picture decoding processing device compliant with the MPEG-2 standard studied by the present inventors prior to the present invention. It is a figure explaining the hierarchical structure in a system.

  As shown in FIG. 1, the MPEG moving image encoding method is a block (Block) 15, 16, 17 of a processing unit from DCT (Discrete Cosine Transform) to a sequence (Sequence) 10 corresponding to the entire moving image. It has a 6-layer structure. That is, the first layer is a sequence 10, the second layer is a group of pictures (GOP) 11, the third layer is a picture 12, the fourth layer is a slice 13, and the fifth layer is a macroblock. (Macro-block) 14, the sixth layer is blocks (Blocks) 15, 16, and 17. This hierarchical structure is based on the moving picture structure, but the number of pictures 12 included in a group of pictures (GOP) 11 or a macro-block 14 included in a slice 13. The number of is relatively flexible.

  FIG. 2 is a diagram showing a typical video stream encoded by the MPEG-2 moving picture encoding method having the hierarchical structure shown in FIG.

  The video stream shown in FIG. 2 has a hierarchy in which different levels of sequence level 211, group of picture (GOP) level 221, picture level 231, slice level 241, and macroblock (MB) level 251 are overlapped. Thus, each next level is part of each previous level. The sequence level 211 is a sequence sequence, and each sequence includes a plurality of group of pictures (GOP) groups. A group of group of pictures (GOP) level 221 is a series of groups of pictures, each GOP containing one or multiple pictures. The picture level 231 is a sequence of pictures (including I frames, P frames, and B frames), and each picture 230 includes one or many slices 240. Slice level 242 is a series of slices 240, and each slice 240 includes one or many macroblocks 250. The macroblock (MB) level 251 is a series of macroblocks.

  In order to decode the video stream shown in FIG. 2, certain information about the video stream is required, and this information is often included in a header included in the video stream. Thus, each block of data at each level of the video stream generally has a header that includes relevant information related to the encoding and decoding of the video stream. For example, at sequence level 211, sequence 210 has sequence header 212, GOP level 221, GOP 220 has GOP header 222, picture level 231, picture 230 has picture header 232, slice level 241 and slice 240 has In the MB level 251, the macroblock (MB) 250 has a macroblock (MB) header 252.

  On the other hand, in the next-generation one-segment broadcasting, when an error is mixed in moving image data due to radio wave interference and a moving image is disturbed, as described in Patent Document 1, an error concealment for error correction is performed. Processing is executed. By this error concealment process, a technique is adopted in which pixel data of a decoded image before the error is copied to a portion where an error has occurred in the image. However, since the error concealment process is not a complete error correction technique, some distortion occurs in the image after the error is repaired by the error concealment process.

  Furthermore, as is well known, MPEG-2 moving picture coding scheme pictures include I frames (intra coded frames), P frames (unidirectional predictive encoded frames), and B frames (bidirectional predictive codes). There are three types of frames. An I frame is a frame that is encoded without using predictions from other frames, a P frame is a frame that is encoded using predictions from past I frames or past P frames, and B frames A frame is a frame that has been encoded using predictions from past and future I or P frames. On the other hand, a group of pictures (GOP) included in a sequence is a group of consecutive pictures in an encoded video stream, and specifies the order of I frames, P frames, and B frames.

  This group of picture (GOP) always starts with an I frame, and includes a P frame and a B frame encoded with reference to the I frame. However, since the code transmission order is reversed between the B frame and the I frame, the actual start frame of the group of pictures (GOP) is often a B frame instead of an I frame. The structure of a group of picture (GOP) can be described by two parameters N and M. The first parameter N is the total number of pictures included in one group of picture (GOP), and is included in the I frame and the next group of picture (GOP) included in one group of picture (GOP). The number of pictures between I frames, that is, the GOP length. The next parameter M is a distance between two adjacent P frames included in one group of pictures (GOP). Accordingly, one group of picture (GOP) includes one I frame which is a reference for encoding a plurality of P frames and B frames included in the group of picture (GOP). The two parameters N and M can be set freely, and various GOPs exist. In the most general GOP, N = 15 and M = 3 are set.

  On the other hand, when an error is mixed in the moving image data due to the radio wave interference and the moving image is disturbed as described above, the moving image is not disturbed even if the error concealment process is executed. The inside is continued. That is, the disturbance of the moving image is continued until the next GOP is normally received without causing an error in the moving image data without causing radio wave interference when the next GOP is received. . The reason for this is as follows.

  That is, when a disturbance occurs in one I frame included in one group of pictures (GOP) due to radio wave interference, a P frame and a B frame encoded based on the I frame This is because of the disturbance of the image. Therefore, the disturbance of the moving image is continued until one I frame included in the next group of picture (GOP) is normally received.

  The present invention has been made as a result of the examination by the present inventors prior to the present invention as described above.

  Accordingly, an object of the present invention is to reduce the influence of the disturbance of the moving image when an error is mixed in the moving image data.

  The above and other objects and novel features of the present invention will be apparent from the description of this specification and the accompanying drawings.

  A typical one of the inventions disclosed in the present application will be briefly described as follows.

  That is, a typical embodiment of the present invention is a moving picture coding method including a separation step, a moving picture coding step, a multiplexing step, and an output step.

  The separation step separates the original moving image frame (100) having a predetermined resolution into a first moving image frame (100A) and a second moving image frame (100B) having a lower resolution smaller than the predetermined resolution.

  In the moving image encoding step, the first moving image frame and the second moving image frame are subjected to a first moving image encoding process (102A) and a second moving image encoding process (102B). The encoded information (103A) and the second moving image encoded information (103B) are encoded.

  The multiplexing step includes multiplexing including first packet data (105_0, 105_2) including the first video encoding information and second packet data (105_1, 105_3) including the second video encoding information. A stream (105) is formed.

  In the output step, the multiplexed stream formed in the multiplexing step is output as a moving image encoded output signal (see FIGS. 3 and 5).

  The effects obtained by the representative ones of the inventions disclosed in the present application will be briefly described as follows.

  That is, according to the present invention, it is possible to reduce the influence of the disturbance of the moving image when an error is mixed in the moving image data.

FIG. 1 shows MPEG video encoding for generating a bit stream of encoded data to be decoded by a moving picture decoding processing device compliant with the MPEG-2 standard studied by the present inventors prior to the present invention. It is a figure explaining the hierarchical structure in a system. FIG. 2 is a diagram showing a typical video stream encoded by the MPEG-2 moving picture encoding method having the hierarchical structure shown in FIG. FIG. 3 is a diagram showing a configuration of a moving picture coding method and a moving picture coding apparatus according to Embodiment 1 of the present invention. FIG. 4 is a diagram showing a configuration of a moving picture decoding method and a moving picture decoding apparatus according to Embodiment 1 of the present invention. FIG. 5 is a diagram showing a configuration of a moving picture coding method and a moving picture coding apparatus according to Embodiment 2 of the present invention. FIG. 6 is a diagram showing a configuration of a moving picture decoding method and a moving picture decoding apparatus according to Embodiment 2 of the present invention. FIG. 7 is a diagram showing a configuration of a moving image encoding device and a moving image decoding device according to Embodiment 3 of the present invention.

1. First, an outline of a typical embodiment of the invention disclosed in the present application will be described. Reference numerals in the drawings referred to with parentheses in the outline description of the representative embodiments merely exemplify what are included in the concept of the components to which the reference numerals are attached.

  [1] An embodiment according to the first aspect of the present invention is a moving picture coding method including a separation step, a moving picture coding step, a multiplexing step, and an output step.

  The separating step separates the original moving image frame (100) having a predetermined resolution into a first moving image frame (100A) and a second moving image frame (100B) having a lower resolution than the predetermined resolution. It is.

  In the moving image encoding step, the first moving image frame and the second moving image frame separated by the separating step are subjected to a first moving image encoding process (102A) and a second moving image encoding process (102B). ) To the first moving image encoded information (103A) and the second moving image encoded information (103B).

  The multiplexing step includes multiplexing including first packet data (105_0, 105_2) including the first video encoding information and second packet data (105_1, 105_3) including the second video encoding information. A stream (105) is formed.

  In the output step, the multiplexed stream formed in the multiplexing step is output as a moving image encoded output signal (see FIGS. 3 and 5).

  According to the embodiment, it is possible to reduce the influence of the disturbance of the moving image when an error is mixed in the moving image data.

  In a preferred embodiment, the original moving image frame (100) having the predetermined resolution includes a predetermined number of horizontal scanning lines, and the first moving image frame (100A) and the second moving image frame (100A) having the low resolution. The moving image frame (100B) includes a first horizontal scanning line and a second horizontal scanning line, each having a smaller number than the predetermined number of horizontal scanning lines (see FIG. 3).

  In another preferred embodiment, the moving image frame having the predetermined resolution includes a plurality of moving image frames (Frame_0, 1, 2, 3) having a predetermined number of frame rates, and has the low resolution. The first moving image frame (100A) and the second moving image frame (100B) are a first plurality of moving image frames (Frame_0, 2) having a lower frame rate than the predetermined number of the frame rates. 2 moving image frames (Frame_1, 3), respectively (see FIG. 5).

  In a more preferred embodiment, the first moving image encoding information (103A) includes moving image information of the first moving image frame (100A), and a moving image of the second moving image frame (100B). Image information is not included, and the second moving image encoding information (103B) does not include moving image information of the first moving image frame (100A), and moving image information of the second moving image frame (100B). Is included (see FIGS. 3 and 5).

  In a specific embodiment, the first moving image encoding information (103A) includes a first frame including an I frame, a P frame, and a B frame as the moving image information of the first moving image frame (100A). Group of pictures (11A), and the second moving image coding information (103B) includes an I frame, a P frame, and a B frame as the moving image information of the second moving image frame (100B). The second group of picture (11B) is included.

  [2] A typical embodiment of the second aspect of the present invention is a video decoding method including an input step, a separation step, a video decoding step, a synthesis step, and an output step.

  In the input step, the multiplexed stream (105) defined in the embodiment according to the first aspect of the present invention is input.

  By the separation step, the first moving image coding information (TS_A) defined in the embodiment according to the first aspect of the present invention is separated by separating the multiplexed stream (105) input by the input step. ) And the second moving image coding information (TS_B) are separated.

  The first moving image decoding information (202A) and the second moving image decoding processing are performed on the first moving image encoded information and the second moving image encoded information separated by the separating step by the moving image decoding step. (202B) respectively decodes the first moving image frame (100A) and the second moving image frame (100B) defined in the embodiment according to the first aspect of the present invention.

  Implementation according to the first aspect of the present invention by synthesizing the first moving image frame (100A) and the second moving image frame (100B) decoded by the moving image decoding step by the combining step. The original moving image frame (100) having the predetermined resolution defined in the form is reproduced.

  The output step outputs the moving image frame reproduced in the synthesizing step as a moving image decoded output signal (see FIGS. 4 and 6).

  According to the embodiment, it is possible to reduce the influence of the disturbance of the moving image when an error is mixed in the moving image data.

  In a preferred embodiment, when an error occurs in the first video decoding process (202A) of the video decoding step, a first video decoding error signal (Error A) is generated and the moving image is decoded. When an error occurs in the second moving image decoding process (202B) of the image decoding step, a second moving image decoding error signal (Error B) is generated.

  In the synthesizing step, the first video frame (100A) decoded by the video decoding step in response to the first video decoding error signal is not used, and the second video decoding error signal is added to the second video decoding error signal. In response, the second video frame (100B) decoded by the video decoding step is not used (see FIG. 4).

  The moving picture decoding method according to another preferred embodiment further includes an interpolation step.

  In the interpolation step, an interpolation frame is generated by interpolation processing of the frame used in the synthesis step as a substitute for the frame that is not used in the synthesis step.

  In the synthesis step, the frame to be used and the interpolation frame are synthesized (see FIG. 4).

  In a more preferred embodiment, the original moving image frame (100) having the predetermined resolution reproduced in the combining step includes a predetermined number of horizontal scanning lines, and is decoded by the moving image decoding step. The first moving image frame (100A) and the second moving image frame (100B) each include a first horizontal scanning line and a second horizontal scanning line that are smaller in number than the predetermined number of horizontal scanning lines. (See FIG. 3).

  In a specific embodiment, the original moving image frame having the predetermined resolution reproduced in the combining step includes a plurality of moving image frames (Frame_0... 3) having a predetermined number of frame rates, and the moving image decoding is performed. The first moving image frame (100A) and the second moving image frame (100B) decoded in the step are a plurality of first moving image frames (a plurality of low frame rates that are smaller than the predetermined number of the frame rates). Frame_0, 2) and a second plurality of moving image frames (Frame_1, 3), respectively (see FIG. 5).

  [3] An embodiment according to the third aspect of the present invention has a function as a separator, a function as a moving picture encoder, a function as a multiplexer, and a function as an output unit. It is a moving image encoding device.

  The function as the separator is to convert an original moving image frame (100) having a predetermined resolution into a first moving image frame (100A) and a second moving image frame (100B) having a lower resolution smaller than the predetermined resolution. To separate.

  The function as the moving image encoder includes a first moving image encoding process (102A) and a second moving image obtained by separating the first moving image frame and the second moving image frame separated by the function as the separator. The first moving image encoded information (103A) and the second moving image encoded information (103B) are respectively encoded by the image encoding process (102B).

  The function as the multiplexer includes first packet data (105_0, 105_2) including the first moving image encoding information and second packet data (105_1, 105_3) including the second moving image encoding information. A multiplexed stream (105) is formed.

  The function as the output unit is characterized in that the multiplexed stream formed by the function as the multiplexer is output as a moving image encoded output signal (see FIGS. 3 and 5).

  According to the embodiment, it is possible to reduce the influence of the disturbance of the moving image when an error is mixed in the moving image data.

  In a preferred embodiment, the original moving image frame (100) having the predetermined resolution includes a predetermined number of horizontal scanning lines, and the first moving image frame (100A) and the second moving image frame (100A) having the low resolution. The moving image frame (100B) includes a first horizontal scanning line and a second horizontal scanning line, each having a smaller number than the predetermined number of horizontal scanning lines (see FIG. 3).

  In another preferred embodiment, the moving image frame having the predetermined resolution includes a plurality of moving image frames (Frame_0, 1, 2, 3) having a predetermined number of frame rates, and has the low resolution. The first moving image frame (100A) and the second moving image frame (100B) are a first plurality of moving image frames (Frame_0, 2) having a lower frame rate than the predetermined number of the frame rates. 2 moving image frames (Frame_1, 3), respectively (see FIG. 5).

  In a more preferred embodiment, the first moving image encoding information (103A) includes moving image information of the first moving image frame (100A), and a moving image of the second moving image frame (100B). Image information is not included, and the second moving image encoding information (103B) does not include moving image information of the first moving image frame (100A), and moving image information of the second moving image frame (100B). Is included (see FIGS. 3 and 5).

  In a specific embodiment, the first moving image encoding information (103A) includes a first frame including an I frame, a P frame, and a B frame as the moving image information of the first moving image frame (100A). Group of pictures (11A), and the second moving image coding information (103B) includes an I frame, a P frame, and a B frame as the moving image information of the second moving image frame (100B). The second group of picture (11B) is included.

  [4] A representative embodiment of the fourth aspect of the present invention includes a function as an input unit, a function as a separator, a function as a moving picture decoder, a function as a combiner, and an output. And a video decoding device including a function as a device.

  The multiplexed stream (105) defined in the embodiment according to the third aspect of the present invention is input by the function as the input device.

  The first moving image defined in the embodiment according to the third aspect of the present invention by separating the multiplexed stream (105) inputted by the function as the input device by the function as the separator. Image coding information (TS_A) and the second moving image coding information (TS_B) are separated.

  The first moving image encoded information and the second moving image encoded information separated by the function as the moving image decoder by the function as the moving image decoder, the first moving image decoding process (202A), By the second moving image decoding process (202B), the first moving image frame (100A) and the second moving image frame (100B) defined in the embodiment according to the third aspect of the present invention are respectively applied. Decrypt.

  By combining the first moving image frame (100A) and the second moving image frame (100B) decoded by the function as the moving image decoder by the function as the combining device, The original moving image frame (100) having the predetermined resolution defined in the embodiment according to the third aspect is reproduced.

  The function as the output unit is characterized in that the moving image frame reproduced by the function as the synthesizer is output as a moving image decoded output signal (see FIGS. 4 and 6).

  According to the embodiment, it is possible to reduce the influence of the disturbance of the moving image when an error is mixed in the moving image data.

  In a preferred embodiment, when an error occurs in the first video decoding process (202A) of the function as the video decoder, a first video decoding error signal (Error A) is generated. When an error occurs in the second video decoding process (202B) of the function as the video decoder, a second video decoding error signal (Error B) is generated.

  In the function as the synthesizer, the first moving image frame (100A) decoded by the function as the moving image decoder in response to the first moving image decoding error signal is not used, and the second moving image frame is not used. The second moving image frame (100B) decoded by the function as the moving image decoder in response to a moving image decoding error signal is not used (see FIG. 4).

  The moving picture decoding apparatus according to another preferred embodiment further includes a function as an interpolator.

  In the function as the interpolator, an interpolation frame is generated by interpolation processing of the frame used in the function as the synthesizer, instead of the frame that is not used in the function as the synthesizer.

  The function as the synthesizer synthesizes the used frame and the interpolated frame (see FIG. 4).

  In a more preferred embodiment, the original moving image frame (100) having the predetermined resolution reproduced by the function as the combiner includes a predetermined number of horizontal scanning lines, and serves as the moving image decoder. The first moving image frame (100A) and the second moving image frame (100B) decoded by the function are smaller in number than the predetermined number of horizontal scanning lines, the first horizontal scanning line and the second horizontal scanning line. Each of which includes a scanning line (see FIG. 3).

  In a specific embodiment, the original moving image frame having the predetermined resolution reproduced by the function as the combiner includes a plurality of moving image frames (Frame_0 ... 3) having a predetermined number of frame rates, The first moving image frame (100A) and the second moving image frame (100B) decoded by the function as the moving image decoder have a low frame rate that is smaller than the predetermined number of the frame rates. A plurality of moving image frames (Frame_0, 2) and a second plurality of moving image frames (Frame_1, 3) are respectively included (see FIG. 5).

2. Details of Embodiment Next, the embodiment will be described in more detail. In all the drawings for explaining the best mode for carrying out the invention, components having the same functions as those in the above-mentioned drawings are denoted by the same reference numerals, and repeated description thereof is omitted.

[Embodiment 1]
<< Configuration of Moving Picture Encoding Method and Moving Picture Encoding Apparatus According to Embodiment 1 >>
FIG. 3 is a diagram showing a configuration of a moving picture coding method and a moving picture coding apparatus according to Embodiment 1 of the present invention.

  As shown in FIG. 3, for example, one image frame shot by a next-generation one-segment broadcasting television camera of ISDB-Tmm is stored in a frame memory 100 configured by a synchronous DRAM or the like. Therefore, one image frame stored in the frame memory 100 includes the image data of the odd-numbered scan lines of the horizontal direction scan lines 0, line 2, line 4, line 6... And the even-numbered scan lines of lines 1 and 3. , Line 5, line 7... Actually, a moving image shot by a television camera is composed of a plurality of moving image frames that are temporally continuous, and the plurality of continuous moving image frames are sequentially stored in the frame memory 100.

  One image data including image data of line 0, line 2, line 4, line 6... Of odd-numbered scanning lines of horizontal scanning lines and image data of line 1, line 3, line 5, line 7. In one example, the image frame is a top field including image data of lines 0, 2, 4, 4, 6... Of odd-numbered scanning lines and lines 1, 3, 3, 5, and lines of even-numbered scanning lines by interlace scanning. 7 is a bottom field including image data. In another example, this one image frame includes the image data of the odd-numbered scanning lines of line 0, line 2, line 4, line 6..., And the even-numbered scanning lines of line 1, line 3,. The image data of line 5, line 7... Is included. As described above, in the first embodiment of the present invention shown in FIG. 3, one image frame stored in the frame memory 100 may be either the interlace scanning method or the progressive scanning method. Image data of a plurality of consecutive lines 0, 1, 2, 2, 3, 4, 5, 6, 7, etc. of one image frame stored in the frame memory 100 are sequentially read out. Thus, the plurality of read image data are supplied to the moving image encoding device 150. Actually, regarding each moving image frame of a plurality of moving image frames constituting the moving image, a plurality of continuous lines 0, 1, 2, 2, 3, 4, 5, 6, 7,... The image data is sequentially read, and the plurality of read image data is supplied to the moving image encoding device 150.

  3 includes an image data separator 101, a first buffer memory 100A, a second buffer memory 100B, a first video encoder 102A, and a second video encoder. 102B and transport stream multiplexer 104. The first buffer memory 100 </ b> A and the second buffer memory 100 </ b> B can be configured by a synchronous DRAM or the like, similar to the frame memory 100.

  Image data of a plurality of continuous lines 0, line 1, line 2, line 3, line 4, line 5, line 6, line 7... Sequentially read from one image frame stored in the frame memory 100. Are sequentially supplied to the input terminals of the image data separator 101, so that the odd-numbered scan lines of line 0, line 2, line 4, line 6 from the first output terminal and the second output terminal of the image data separator 101 are supplied. .. And image data of even-numbered scanning lines 1, 3, 5, 7,... Are sequentially generated. Actually, a plurality of moving image frames constituting a moving image are sequentially supplied to the input terminal of the image data separator 101, so that a moving image is transmitted from the first output terminal and the second output terminal of the image data separator 101. Image data of a plurality of lines of odd-numbered scan lines and image data of a plurality of lines of even-numbered scan lines of each of the plurality of moving image frames constituting the image are sequentially generated.

  Image data of line 0, line 2, line 4, line 6... Of odd scanning lines of a plurality of moving image frames constituting a moving image sequentially generated from the first output terminal of the image data separator 101 is a first buffer. Lines 1, 3, 5, 5 of even-numbered scan lines of a plurality of moving image frames that are sequentially stored in the memory 100 </ b> A and are generated sequentially from the second output terminal of the image data separator 101. The image data of lines 7 is sequentially stored in the second buffer memory 100B.

  The first moving image encoder 102A receives from the first buffer memory 100A the image data of line 0, line 2, line 4, line 6 ... of the odd scanning lines of each moving image frame constituting the moving image from the first buffer memory 100A. Are sequentially read, and the first moving image encoding process 103A is executed, while the second moving image encoder 102B scans the moving image frames of the plurality of moving image frames constituting the moving image from the second buffer memory 100B. The image data of line 1, line 3, line 5, line 7,... Is read out sequentially, and the second moving image encoding process 103B is executed.

  The first moving image encoding process 103A executed by the first moving image encoder 102A is a line of odd scan lines of each moving image frame of a plurality of moving image frames constituting the moving image stored in the frame memory 100. Only from the image data of 0, line 2, line 4, line 6..., The first sequence 10A, the first group of pictures 11A, the first picture 12A, the first slice 13A, the first macroblock 14A, the first block 15A, A first system of moving picture coding hierarchical structure composed of 16A and 17A is formed. Actually, the moving picture coding hierarchical structure of the first system is expressed by the first transport stream TS_A generated from the output terminal of the first moving picture coder 102A. In addition, the second moving image encoding process 103B executed by the second moving image encoder 102B performs the processing of even-numbered scanning lines of each moving image frame of a plurality of moving image frames constituting the moving image stored in the frame memory 100. From only the image data of line 1, line 3, line 5, line 7,..., The second sequence 10B, the second group of pictures 11B, the second picture 12B, the second slice 13B, the second macroblock 14B, the second block 15B. , 16B, and 17B, a second system moving image coding hierarchical structure is formed. Actually, the moving picture coding hierarchical structure of the second system is expressed by the second transport stream TS_B generated from the output terminal of the second moving picture encoder 102B.

  The motion vector detection in units of macroblocks executed by the first moving image encoder 102A is also performed on the odd scan lines of the moving image frames of the plurality of moving image frames constituting the moving image stored in the frame memory 100. Only the image data of line 0, line 2, line 4, line 6... Is executed. Similarly, the motion vector detection in units of macroblocks executed by the second moving image encoder 102B is also performed by even-number scanning of each moving image frame of a plurality of moving image frames constituting the moving image stored in the frame memory 100. Only the image data of the line 1, the line 3, the line 5, the line 7.

  The transport stream multiplexer 104 generates a first transport stream TS_A generated from the output terminal of the first moving picture encoder 102A and a second transport stream generated from the output terminal of the second moving picture encoder 102B. By multiplexing TS_B, a multiplexed transport stream (TS_Multi) 105 is generated from the output terminal. Multiplexed transport stream (TS_Multi) 105 includes a plurality of transport stream packets having a length of 188 bytes. This transport stream packet includes a 4-byte transport stream header and moving image payload data of a maximum of 184 bytes.

  Therefore, the plurality of temporally continuous transport stream packets included in the multiplexed transport stream 105 include the first moving image coding information of the first stream moving image coding hierarchical structure and the second stream moving image coding. The second moving image encoded information having a hierarchical structure is included sequentially and alternately in a time division manner. As the multiplexing method of the first and second moving image encoded information, any method such as time division multiplexing or packet multiplexing can be adopted. That is, the first transport stream packet 105_0, the third transport stream packet 105_2, which is an odd number of the multiplexed transport stream 105 generated from the output terminal of the transport stream multiplexer 104, is included in the first. The second transport stream that is the even-numbered multiplexed transport stream 105 that is generated from the output terminal of the transport stream multiplexer 104 and includes the first moving picture coding information of the system moving picture coding hierarchical structure The packet 105_1, the fourth transport stream packet 105_3,... Include the second moving image coding information of the second moving image coding hierarchical structure.

  As shown in FIG. 3, assuming that the error 106 due to radio interference occurs at the timing of FIG. 3, the error 106 due to radio interference is the transport stream that is generated second from the output terminal of the transport stream multiplexer 104. Only the packet 105_1 is adversely affected. Therefore, the error 106 due to radio interference shown in FIG. 3 adversely affects only the second moving image coding information of the second system moving image coding hierarchical structure, but the error of the first system moving image coding hierarchical structure is the first. The moving image encoded information of 1 is not adversely affected.

<< Configuration of moving picture decoding method and moving picture decoding apparatus according to Embodiment 1 of the present invention >>
FIG. 4 is a diagram showing a configuration of a moving picture decoding method and a moving picture decoding apparatus according to Embodiment 1 of the present invention.

  As shown in FIG. 4, the multiplexed transport stream 105 generated from the output terminal of the multiplexed transport stream 105 of the moving picture encoding apparatus 150 shown in FIG. 3 is supplied to the input terminal of the moving picture decoding apparatus 250. Is done. The multiplexed transport stream 105 includes an odd first transport stream packet 105_0, a third transport stream packet 105_2, and an even second transport stream packet 105_1, a fourth transport stream. Port stream packets 105_3... Are sequentially and alternately included in a time division manner. It should be noted that any method such as time division multiplexing or packet multiplexing can be employed for multiplexing the odd-numbered and even-numbered transport stream packets.

  Actually, the multiplexed transport stream 105 generated from the output terminal of the moving image encoding device 150 shown in FIG. 3 of the next-generation one-segment broadcasting station of ISDB-Tmm is included in the RF transmission signal, and broadcast. An RF transmission signal is transmitted from the station. The RF transmission signal is received by a one-seg broadcast reception tuner mounted on the mobile phone terminal, and a multiplexed transport stream 105 is generated from the output terminal of the one-seg broadcast reception tuner, and is built in an application processor mounted on the mobile phone terminal. This is supplied to the input terminal of the video decoding device 250 shown in FIG.

  The moving picture decoding apparatus 250 shown in FIG. 4 includes a transport stream separator 201, a first moving picture decoder 202A, a second moving picture decoder 202B, a first buffer memory 203A, and a second buffer memory 203B. And a moving image synthesizer 205 and a moving image interpolator 206. The first buffer memory 203A and the second buffer memory 203B can be configured by a synchronous DRAM or the like.

  First moving image coding information of the first moving image coding hierarchical structure and second moving image coding hierarchical structure included in a plurality of temporally continuous transport stream packets of the multiplexed transport stream 105 The second moving image encoded information is supplied to the input terminal of the transport stream separator 201 in order and alternately, whereby the first transformer and the second output terminal of the transport stream separator 201 A port stream TS_A and a second transport stream TS_B are generated. Accordingly, the first transport stream TS_A and the second transport stream TS_B respectively generated from the first output terminal and the second output terminal of the transport stream separator 201 are the input terminal of the first moving picture decoder 202A and the second transport stream TS_B. The video stored in the frame memory 100 from the output terminal of the first video decoder 202A and the output terminal of the second video decoder 202B is supplied to the input terminal of the two video decoder 202B. The decoded image data of the odd-numbered scanning lines and the decoded image data of the even-numbered scanning lines of each of the moving image frames constituting the plurality of moving image frames are generated. The transport stream separator 201 separates the first transport stream TS_A and the second transport stream TS_B from the multiplexed transport stream 105 into the 4-byte transport stream header of the multiplexed transport stream 105. This is possible by using the included 13-bit bucket identifier (PID).

  In the video decoding device 250 shown in FIG. 4, the first video decoding process 204A executed by the first video decoder 202A includes the first sequence 10A and the first group included in the first transport stream TS_A. The moving picture stored in the frame memory 100 from the moving picture coding hierarchical structure of the first system including the of picture 11A, the first picture 12A, the first slice 13A, the first macroblock 14A, and the first blocks 15A, 16A, and 17A. Only the moving image decoded data of the odd-numbered scanning lines of line 0, line 2, line 4, line 6... Still further, the second video decoding process 204B executed by the second video decoder 202B includes a second sequence 10B, a second group of pictures 11B, a second picture 12B, a second picture included in the second transport stream TS_B. A plurality of moving picture decoded frames constituting a moving picture stored in the frame memory 100 from the moving picture coding hierarchical structure of the second system composed of the two slices 13B, the second macro block 14B, and the second blocks 15B, 16B, and 17B. Only the moving image decoded data of line 1, line 3, line 5, line 7,... Of even-numbered scanning lines of each moving image decoded frame is formed.

  Also, motion compensation in units of macroblocks executed by the first moving picture decoder 202A is performed in the first sequence 10A, the first group of pictures 11A, the first picture 12A, and the first slice included in the first transport stream TS_A. 13A, the first macroblock 14A, and the first block 15A, 16A, and 17A are executed only for the first-system moving picture coding hierarchical structure. Similarly, motion compensation in units of macroblocks executed by the second video decoder 202B is also performed in the second sequence 10B, the second group of pictures 11B, the second pictures 12B, included in the second transport stream TS_B. Only the moving picture coding hierarchical structure of the second system composed of the second slice 13B, the second macroblock 14B, and the second blocks 15B, 16B, and 17B is executed.

  Also, in the moving picture decoding apparatus 250 shown in FIG. 4, the moving picture decoded data on the odd-numbered scanning lines of the moving picture decoded frames of the plurality of moving picture decoded frames generated from the output terminal of the first moving picture decoder 202A is a moving picture. Each moving image of the plurality of moving image decoded frames generated from the first input terminal of the image synthesizer 205 and the first input terminal of the moving image interpolator 206 and generated from the output terminal of the second moving image decoder 202B. The decoded video data of even-numbered scan lines of the decoded frame is supplied to the second input terminal of the video synthesizer 205 and the second input terminal of the video interpolator 206.

  On the other hand, when a decoding error occurs in the first moving image decoding process 204A executed by the first moving image decoder 202A due to error mixing in moving image data due to radio interference, etc., the first moving image decoding error signal Error A is generated from the first moving image decoder 202A and supplied to the first control input terminal of the moving image synthesizer 205 and the first control input terminal of the moving image interpolator 206. When a decoding error occurs in the second moving picture decoding process 204B executed by the second moving picture decoder 202B due to the above error mixing or the like, the second moving picture decoding error signal Error B is changed to the second moving picture decoding. And is supplied to the second control input terminal of the moving image synthesizer 205 and the second control input terminal of the moving image interpolator 206.

  First, when no error is mixed into moving image data due to radio interference, the first moving image decoding error signal Error A and the second moving image are transmitted from the first moving image decoder 202A and the second moving image decoder 202B. The decoding error signal Error B is not generated. In this case, the moving image decoding data of the odd-numbered scanning lines of each moving image decoding frame of the plurality of moving image decoding frames generated from the output terminal of the first moving image decoder 202A and the output of the second moving image decoder 202B. The moving image synthesizer 205 reproduces the moving image stored in the frame memory 100 using the moving image decoded data of the even moving scanning lines of the moving image decoded frames of the plurality of moving image decoded frames generated from the terminal. A plurality of moving image decoding frames for generating the image are generated.

  Next, when a slight error is mixed in the moving image data due to radio wave interference, for example, the first moving image decoder 202 does not generate the first moving image decoding error signal Error A, but the second moving image decoding Assume that the second video decoding error signal Error B is generated from the device 202B. In this case, the moving image synthesizer 205 uses the moving image decoded data of the odd scanning lines of each moving image decoded frame of the plurality of moving image decoded frames generated from the output terminal of the first moving image decoder 202A. The moving image decoding data stored in the frame memory 100 is not used as the moving image decoding data of even-numbered scanning lines of the moving image decoding frames of the plurality of moving image decoding frames generated from the output terminal of the second moving image decoder 202B. A plurality of moving image decoding frames for reproducing an image are generated.

  In the preferred embodiment, in this case, the video decoding of the even-numbered scan line of each video decoding frame of the plurality of video decoding frames generated from the output terminal of the second video decoder 202B which is not used. As a substitute for data, the output signal of the moving image interpolator 206 is supplied to the moving image synthesizer 205. That is, in this case, the moving image interpolator 206 interpolates moving image decoded data of odd-numbered scan lines of each moving image decoded frame of the plurality of moving image decoded frames generated from the output terminal of the first moving image decoder 202A. By processing, substitute moving image decoding data of even-numbered scan lines of each moving image decoding frame of a plurality of moving image decoding frames is generated and supplied to the moving image synthesizer 205.

  Finally, when serious error mixing occurs in the moving image data due to radio wave interference, the first moving image decoding error signal Error A and the second moving image data are output from the first moving image decoder 202A and the second moving image decoder 202B. A moving image decoding error signal Error B is generated, and the moving image decoding device 250 shown in FIG. 4 executes an error concealment process.

  The first moving image decoder 202A and the second moving image decoder 202B are configured to generate a first moving image decoding error signal based on a syntax error generated in the decoded bitstream when an error is mixed in moving image data due to radio interference. It is possible to generate Error A and second video decoding error signal Error B.

<< Effects of Video Encoding Method and Video Decoding Method According to Embodiment 1 of the Present Invention >>
As described above, according to the moving picture coding method and the moving picture decoding method according to Embodiment 1 of the present invention described with reference to FIGS. 3 and 4, the effects described below can be obtained.

  (1). According to the moving picture coding method and the moving picture coding apparatus of Embodiment 1 of the present invention shown in FIG. 3, the original moving picture frame is generated by the image data separator 101 from one original moving picture frame stored in the frame memory 100. A moving image frame of odd-numbered scanning lines and a moving image frame of even-numbered scanning lines that are half of the horizontal scanning lines are generated.

  The odd-numbered scan line moving image frame and the even-numbered scan line moving image frame whose resolution is halved compared to the original moving image frame are independent of each other by the first moving image encoder 102A and the second moving image encoder 102B. The first moving image encoded information and the second moving image encoded information are encoded.

  The transport stream multiplexer 104 of the moving image encoding apparatus 150 performs a time division method on the transport stream packets 105_0 and 105_2 of the first moving image encoded information and the transport stream packets 105_1 and 105_3 of the second moving image encoded information. A multiplexed transport stream 105 that is sequentially and alternately included is generated and supplied to the input terminal of the video decoding device 250. As a result, the transport of the first moving image encoded information sequentially and alternately transferred from the output terminal of the transport stream multiplexer 104 of the video encoding device 150 to the input terminal of the video decoding device 250 in a time division manner. There is a low possibility that adverse effects of errors due to radio wave interference appear in parallel with stream packets and transport stream packets of the second moving image encoded information.

  (2). According to the moving picture decoding method and the moving picture decoding apparatus of Embodiment 1 of the present invention shown in FIG. 4, an adverse effect of errors due to radio wave interference appears on the output of the second moving picture decoder 202B, while the first moving picture When the adverse effect of the error due to the radio wave interference does not appear in the output of the image decoder 202A, the output of the second video decoder 202B is not used, while the output of the first video decoder 202A is used. Decode frames of a plurality of moving images for image reproduction are generated.

  As a result, even if the resolution is halved, the moving image can be reproduced. In particular, in the group of picture (GOP), it is possible to reproduce an I frame that affects a significant disturbance of a moving image even if the resolution is reduced by half. Therefore, it is possible to reduce the spread of image disturbance to the P frame and the B frame included in the group of pictures (GOP).

  (3). According to the moving picture decoding method and moving picture decoding apparatus of Embodiment 1 of the present invention shown in FIG. 4, the output of the first moving picture decoder 202A and the output of the second moving picture decoder 202B are caused by radio interference. If no adverse effect of the error appears, the moving image synthesizer 205 uses the output of the first moving image decoder 202A and the output of the second moving image decoder 202B to obtain the same high resolution as the original moving image frame. The video decoding frame is generated.

[Embodiment 2]
<< Configuration of Moving Image Encoding Method and Moving Image Encoding Device According to Embodiment 2 >>
FIG. 5 is a diagram showing a configuration of a moving picture coding method and a moving picture coding apparatus according to Embodiment 2 of the present invention.

  The moving picture coding method and moving picture coding apparatus according to Embodiment 2 of the present invention shown in FIG. 5 are different from the moving picture coding method and moving picture coding apparatus according to Embodiment 1 of the present invention shown in FIG. It is the following point.

  That is, in the second embodiment of the present invention shown in FIG. 5, a plurality of continuous moving image frames Frame_0, 1, 2, and 3 photographed by the ISDB-Tmm next-generation one-segment broadcasting television camera are sequentially stored in the frame memory 100. Stored in

  A plurality of continuous moving image frames Frame_0, 1, 2, and 3 read from the frame memory 100 are sequentially supplied to the input terminal of the image data separator 101 of the moving image encoding device 150 shown in FIG. The odd-numbered moving image frames Frame_0 and Frame_2 and the even-numbered moving image frames Frame_1 and Frame_3 are sequentially generated from the first output terminal and the second output terminal of the image data separator 101, respectively. Image data of odd-numbered moving image frames Frame_0 and Frame_2 that are sequentially generated from the first output terminal of the image data separator 101 are sequentially stored in the first buffer memory 100A, and the second output of the image data separator 101 is output. The image data of even-numbered moving image frames Frame_1 and Frame_3 generated sequentially from the terminals are sequentially stored in the second buffer memory 100B.

  The first moving image encoder 102A sequentially reads out image data of odd-numbered moving image frames Frame_0, Frame_2,... Constituting the moving image from the first buffer memory 100A, and executes the first moving image encoding process 103A. The second moving image encoder 102B sequentially reads the image data of the even-numbered moving image frames Frame_1, Frame_3,... Constituting the moving image from the second buffer memory 100B, and executes the second moving image encoding process 103B.

  The first moving image encoding process 103A executed by the first moving image encoder 102A is only image data of a plurality of odd-numbered moving image frames Frame_0, Frame_2, etc. constituting the moving image stored in the frame memory 100. From the first sequence 10A, the first group of pictures 11A, the first picture 12A, the first slice 13A, the first macroblock 14A, the first blocks 15A, 16A, and 17A, the first system of moving picture coding hierarchical structure. Form. Actually, the moving picture coding hierarchical structure of the first system is expressed by the first transport stream TS_A generated from the output terminal of the first moving picture coder 102A. The second moving image encoding process 103B executed by the second moving image encoder 102B performs image data of a plurality of even-numbered moving image frames Frame_1, Frame_3,... Constituting the moving image stored in the frame memory 100. Only, the second sequence 10B, the second group of pictures 11B, the second picture 12B, the second slice 13B, the second macroblock 14B, and the second block 15B, 16B, 17B of the second system moving picture coding hierarchical structure Is formed. Actually, the moving picture coding hierarchical structure of the second system is expressed by the second transport stream TS_B generated from the output terminal of the second moving picture encoder 102B.

  Also, motion vector detection in units of macroblocks executed by the first moving image encoder 102A is also performed on the image data of a plurality of odd-numbered moving image frames Frame_0, Frame_2, etc. constituting the moving image stored in the frame memory 100. Only executed with respect to. Similarly, the motion vector detection in units of macroblocks executed by the second moving image encoder 102B is performed for a plurality of even-numbered moving image frames Frame_1, Frame_3,... Constituting the moving image stored in the frame memory 100. It is executed only for image data.

  The transport stream multiplexer 104 generates a first transport stream TS_A generated from the output terminal of the first moving picture encoder 102A and a second transport stream generated from the output terminal of the second moving picture encoder 102B. By multiplexing TS_B, a multiplexed transport stream 105 is generated from the output terminal. The multiplexed transport stream 105 includes a plurality of transport stream packets having a length of 188 bytes. This transport stream packet includes a 4-byte transport stream header and moving image payload data of a maximum of 184 bytes.

  Therefore, the plurality of temporally continuous transport stream packets included in the multiplexed transport stream 105 include the first moving image coding information of the first stream moving image coding hierarchical structure and the second stream moving image coding. The second moving image encoded information having a hierarchical structure is included sequentially and alternately in a time division manner. As the multiplexing method of the first and second moving image encoded information, any method such as time division multiplexing or packet multiplexing can be adopted. That is, the first transport stream packet 105_0, the third transport stream packet 105_2, which is an odd number of the multiplexed transport stream 105 generated from the output terminal of the transport stream multiplexer 104, is included in the first. The second transport stream that is the even-numbered multiplexed transport stream 105 that is generated from the output terminal of the transport stream multiplexer 104 and includes the first moving picture coding information of the system moving picture coding hierarchical structure The packet 105_1, the fourth transport stream packet 105_3,... Include the second moving image coding information of the second moving image coding hierarchical structure.

  As shown in FIG. 5, assuming that the error 106 due to radio interference occurs at the timing of FIG. 5, the error 106 due to radio interference is the transport stream generated second from the output terminal of the transport stream multiplexer 104. Only the packet 105_1 is adversely affected. Accordingly, the error 106 due to radio interference shown in FIG. 5 adversely affects only the second moving image coding information of the second system moving image coding hierarchical structure, but the error of the first system moving image coding hierarchical structure is the first. The moving image encoded information of 1 is not adversely affected.

<< Configuration of moving picture decoding method and moving picture decoding apparatus according to Embodiment 2 of the present invention >>
FIG. 6 is a diagram showing a configuration of a moving picture decoding method and a moving picture decoding apparatus according to Embodiment 2 of the present invention.

  As shown in FIG. 6, the multiplexed transport stream 105 generated from the output terminal of the multiplexed transport stream 105 of the moving picture encoding apparatus 150 shown in FIG. 5 is supplied to the input terminal of the moving picture decoding apparatus 250. Is done. The multiplexed transport stream 105 includes an odd first transport stream packet 105_0, a third transport stream packet 105_2, and an even second transport stream packet 105_1, a fourth transport stream. Port stream packets 105_3... Are sequentially and alternately included in a time division manner.

  Actually, the multiplexed transport stream 105 generated from the output terminal of the moving picture encoding device 150 shown in FIG. 5 of the broadcasting station for next-generation one-segment broadcasting of ISDB-Tmm is included in the RF transmission signal. An RF transmission signal is transmitted from the station. The RF transmission signal is received by a one-seg broadcast reception tuner mounted on the mobile phone terminal, and a multiplexed transport stream 105 is generated from the output terminal of the one-seg broadcast reception tuner, and is built in an application processor mounted on the mobile phone terminal. This is supplied to the input terminal of the video decoding device 250 shown in FIG.

  The moving picture decoding apparatus 250 shown in FIG. 6 includes a transport stream separator 201, a first moving picture decoder 202A, a second moving picture decoder 202B, a first buffer memory 203A, and a second buffer memory 203B. And a moving image synthesizer 205 and a moving image interpolator 206.

  First moving image coding information of the first moving image coding hierarchical structure and second moving image coding hierarchical structure included in a plurality of temporally continuous transport stream packets of the multiplexed transport stream 105 The second moving image encoded information is supplied to the input terminal of the transport stream separator 201 in order and alternately, whereby the first transformer and the second output terminal of the transport stream separator 201 A port stream TS_A and a second transport stream TS_B are generated. Accordingly, the first transport stream TS_A and the second transport stream TS_B respectively generated from the first output terminal and the second output terminal of the transport stream separator 201 are the input terminal of the first moving picture decoder 202A and the second transport stream TS_B. The video stored in the frame memory 100 from the output terminal of the first video decoder 202A and the output terminal of the second video decoder 202B is supplied to the input terminal of the two video decoder 202B. Decoded image data of a plurality of odd-numbered moving image frames Frame_0, Frame_2,... And decoded image data of a plurality of even-numbered moving image frames Frame_1, Frame_3,. The transport stream separator 201 separates the first transport stream TS_A and the second transport stream TS_B from the multiplexed transport stream 105 into the 4-byte transport stream header of the multiplexed transport stream 105. This is possible by using the included 13-bit bucket identifier (PID).

  In the video decoding device 250 shown in FIG. 6, the first video decoding process 204A executed by the first video decoder 202A includes the first sequence 10A and the first group included in the first transport stream TS_A. The moving picture stored in the frame memory 100 from the moving picture coding hierarchical structure of the first system including the of picture 11A, the first picture 12A, the first slice 13A, the first macroblock 14A, and the first blocks 15A, 16A, and 17A. Only the moving image decoded data of a plurality of odd-numbered moving image frames Frame_0, Frame_2,. Further, the second video decoding process 204B executed by the second video decoder 202B includes a second sequence 10B, a second group of pictures 11B, a second picture 12B, a second picture included in the second transport stream TS_B. A plurality of even-numbered moving image frames constituting the moving image stored in the frame memory 100 from the moving image coding hierarchical structure of the second system composed of the slice 13B, the second macro block 14B, and the second blocks 15B, 16B, and 17B. Only the decoded video data of Frame_1, Frame_3,... Is formed.

  Also, motion compensation in units of macroblocks executed by the first moving picture decoder 202A is performed in the first sequence 10A, the first group of pictures 11A, the first picture 12A, and the first slice included in the first transport stream TS_A. 13A, the first macroblock 14A, and the first block 15A, 16A, and 17A are executed only for the first-system moving picture coding hierarchical structure. Similarly, motion compensation in units of macroblocks executed by the second video decoder 202B is also performed in the second sequence 10B, the second group of pictures 11B, the second pictures 12B, included in the second transport stream TS_B. Only the moving picture coding hierarchical structure of the second system composed of the second slice 13B, the second macroblock 14B, and the second blocks 15B, 16B, and 17B is executed.

  In the moving picture decoding apparatus 250 shown in FIG. 6, moving picture decoded data of a plurality of odd-numbered moving picture frames Frame_0, Frame_2,... Generated from the output terminal of the first moving picture decoder 202A are stored in the moving picture synthesizer 205. A plurality of even-numbered video frames Frame_1, Frame_3,..., Which are supplied from the first input terminal and the first input terminal of the video interpolator 206, and generated from the output terminal of the second video decoder 202B. The decoded data is supplied to the second input terminal of the moving image synthesizer 205 and the second input terminal of the moving image interpolator 206.

  On the other hand, when a decoding error occurs in the first moving image decoding process 204A executed by the first moving image decoder 202A due to error mixing in moving image data due to radio interference, etc., the first moving image decoding error signal Error A is generated from the first moving image decoder 202A and supplied to the first control input terminal of the moving image synthesizer 205 and the first control input terminal of the moving image interpolator 206. When a decoding error occurs in the second moving picture decoding process 204B executed by the second moving picture decoder 202B due to the above error mixing or the like, the second moving picture decoding error signal Error B is changed to the second moving picture decoding. And is supplied to the second control input terminal of the moving image synthesizer 205 and the second control input terminal of the moving image interpolator 206.

  First, when no error is mixed into moving image data due to radio interference, the first moving image decoding error signal Error A and the second moving image are transmitted from the first moving image decoder 202A and the second moving image decoder 202B. The decoding error signal Error B is not generated. In this case, it is generated from the decoded video data of a plurality of odd-numbered video frames Frame_0, Frame_2,... Generated from the output terminal of the first video decoder 202A and the output terminal of the second video decoder 202B. The moving image synthesizer 205 uses the moving image decoding data of the plurality of even-numbered moving image frames Frame_1, Frame_3... To reproduce the moving images stored in the frame memory 100. Generate a frame.

  Next, when a slight error is mixed in the moving image data due to radio wave interference, for example, the first moving image decoder 202 does not generate the first moving image decoding error signal Error A, but the second moving image decoding Assume that the second video decoding error signal Error B is generated from the device 202B. In this case, the moving image synthesizer 205 uses the moving image decoded data of the plurality of odd-numbered moving image frames Frame_0, Frame_2,... Generated from the output terminal of the first moving image decoder 202A, but the second moving image. The plurality of even-numbered moving image frames Frame_1, Frame_3,... Generated from the output terminal of the image decoder 202B are not used, and a plurality of moving images stored in the frame memory 100 are reproduced. A moving image decoding frame is generated.

  In a preferred embodiment, in this case, as a substitute for moving image decoded data of a plurality of even-numbered moving image frames Frame_1, Frame_3,... Generated from the output terminal of the second moving image decoder 202B which is not used. The output signal of the moving image interpolator 206 is supplied to the moving image synthesizer 205. That is, in this case, the moving image interpolator 206 performs a plurality of operations by interpolating moving image decoded data of a plurality of odd-numbered moving image frames Frame_0, Frame_2,... Generated from the output terminal of the first moving image decoder 202A. .. Are generated and supplied to the moving image synthesizer 205. The moving image decoded data of the moving image decoded data of the even-numbered moving image frames Frame_1, Frame_3.

  Finally, when serious error mixing occurs in the moving image data due to radio wave interference, the first moving image decoding error signal Error A and the second moving image data are output from the first moving image decoder 202A and the second moving image decoder 202B. A moving picture decoding error signal Error B is generated, and the moving picture decoding apparatus 250 shown in FIG. 6 executes an error concealment process.

  The first moving image decoder 202A and the second moving image decoder 202B are configured to generate a first moving image decoding error signal based on a syntax error generated in the decoded bitstream when an error is mixed in moving image data due to radio interference. It is possible to generate Error A and second video decoding error signal Error B.

<< Effects of Video Encoding Method and Video Decoding Method According to Embodiment 2 of the Present Invention >>
As described above, according to the moving picture coding method and the moving picture decoding method according to the second embodiment of the present invention described with reference to FIGS. 5 and 6, the effects described below can be obtained.

  (1). According to the moving picture coding method and the moving picture coding apparatus of Embodiment 2 of the present invention shown in FIG. 5, the original moving picture is obtained from the 2X original moving picture frames stored in the frame memory 100 by the image data separator 101. A plurality of odd-numbered moving image frames Frame_0, Frame_2,... And a plurality of even-numbered moving image frames Frame_1, Frame_3,.

  The plurality of odd-numbered moving image frames Frame_0, Frame_2,... And the plurality of even-numbered moving image frames Frame_1, Frame_3,... Encoding is performed by the encoder 102A and the second moving image encoder 102B into first moving image encoded information and second moving image encoded information, respectively.

  The transport stream multiplexer 104 of the moving image encoding apparatus 150 performs a time division method on the transport stream packets 105_0 and 105_2 of the first moving image encoded information and the transport stream packets 105_1 and 105_3 of the second moving image encoded information. A multiplexed transport stream 105 that is sequentially and alternately included is generated and supplied to the input terminal of the video decoding device 250. As a result, the transport of the first moving image encoded information sequentially and alternately transferred from the output terminal of the transport stream multiplexer 104 of the video encoding device 150 to the input terminal of the video decoding device 250 in a time division manner. There is a low possibility that adverse effects of errors due to radio wave interference appear in parallel with stream packets and transport stream packets of the second moving image encoded information.

  (2). According to the moving picture decoding method and the moving picture decoding apparatus of Embodiment 2 of the present invention shown in FIG. 6, the adverse effect of errors due to radio wave interference appears on the output of the second moving picture decoder 202B, while the first moving image When the adverse effect of the error due to the radio wave interference does not appear in the output of the image decoder 202A, the output of the second video decoder 202B is not used, while the output of the first video decoder 202A is used. Decode frames of a plurality of moving images for image reproduction are generated.

  As a result, even if the resolution is halved, the moving image can be reproduced. In particular, in the group of picture (GOP), it is possible to reproduce an I frame that affects a significant disturbance of a moving image even if the resolution is reduced by half. Therefore, it is possible to reduce the spread of image disturbance to the P frame and the B frame included in the group of pictures (GOP).

  (3). According to the moving picture decoding method and moving picture decoding apparatus of Embodiment 2 of the present invention shown in FIG. 6, the output of the first moving picture decoder 202A and the output of the second moving picture decoder 202B are caused by radio wave interference. If no adverse effect of the error appears, the moving image synthesizer 205 uses the output of the first moving image decoder 202A and the output of the second moving image decoder 202B, and has the same high frame rate as the original moving image frame. A video decoding frame having a resolution of 1 is generated.

[Embodiment 3]
<< Configuration of Video Coding Method and Video Coding Apparatus According to Embodiment 3 >>
FIG. 7 is a diagram showing a configuration of a moving image encoding device and a moving image decoding device according to Embodiment 3 of the present invention.

  Each of the moving picture coding apparatuses 150 of the first embodiment of the present invention shown in FIG. 3 and the moving picture coding apparatus 150 of the second embodiment of the present invention shown in FIG. Common video encoding of the image data separator 101, the first buffer memory 100A, the second buffer memory 100B, the first video encoder 102A, the second video encoder 102B, and the transport stream multiplexer 104 Includes hardware resources.

  Each of the moving picture decoding devices of the moving picture decoding apparatus 250 according to the first embodiment of the present invention shown in FIG. 4 and the moving picture decoding apparatus 250 according to the second embodiment of the present invention shown in FIG. Common video of the port stream separator 201, the first video decoder 202A, the second video decoder 202B, the first buffer memory 203A, the second buffer memory 203B, the video synthesizer 205, and the video interpolator 206 Includes decryption hardware resources.

  Therefore, the moving picture encoding apparatus 150 according to the third embodiment of the present invention shown in FIG. 7 includes an image data separator 101, a first buffer memory 100A, a second buffer memory 100B, a first moving picture encoder 102A, The video encoding hardware resources common to the second video encoder 102B and the transport stream multiplexer 104 are included. However, the video encoding device 150 including the common video encoding hardware resource is arbitrarily set to any one of the first operation mode and the second operation mode by an operation instruction signal supplied from the outside. It is possible to be done. That is, the moving picture coding apparatus 150 according to the third embodiment of the present invention shown in FIG. 7 set in the first operation mode operates in exactly the same manner as the moving picture coding apparatus 150 according to the first embodiment of the present invention shown in FIG. On the other hand, the moving picture coding apparatus 150 according to the third embodiment of the present invention shown in FIG. 7 set in the second operation mode is exactly the same as the moving picture coding apparatus 150 according to the second embodiment of the present invention shown in FIG. Operate.

  Also, the moving picture decoding apparatus 250 according to Embodiment 3 of the present invention shown in FIG. 7 includes a transport stream separator 201, a first moving picture decoder 202A, a second moving picture decoder 202B, and a first buffer memory 203A. The video buffer hardware resources common to the second buffer memory 203B, the video synthesizer 205, and the video interpolator 206 are included. However, the video decoding device 250 including the common video decoding hardware resource is arbitrarily set to any one of the first operation mode and the second operation mode by an operation instruction signal supplied from the outside. It is possible. That is, the moving picture decoding apparatus 250 according to the third embodiment of the present invention shown in FIG. 7 set in the first operation mode operates in exactly the same manner as the moving picture decoding apparatus 250 according to the first embodiment of the present invention shown in FIG. The moving picture decoding apparatus 250 according to the third embodiment of the present invention shown in FIG. 7 set in the second operation mode operates in exactly the same manner as the moving picture decoding apparatus 250 according to the second embodiment of the present invention shown in FIG.

  The ISDB-Tmm broadcast station for next-generation one-segment broadcasting uses a format of the multiplexed transport stream 105 generated from the moving picture encoding device 150 of the broadcast station according to the unique policy of each broadcast station and the radio wave environment of each broadcast station. Can be arbitrarily set to one of the first operation mode and the second operation mode. That is, the broadcast station supplies an operation instruction signal including information on the determined operation mode to the moving image encoding apparatus 150 according to Embodiment 3 of the present invention shown in FIG. .

  The RF transmission signal transmitted from the broadcasting station is received by a one-segment broadcast receiving tuner mounted on the mobile phone terminal, and the broadcast program information including the operation instruction signal from the output terminal of the one-segment broadcasting receiving tuner is shown in FIG. To the moving picture decoding apparatus 250 according to the third embodiment. Therefore, the moving picture decoding apparatus 250 according to the third embodiment of the present invention shown in FIG. 7 can be arbitrarily set to any one of the first operation mode and the second operation mode in accordance with the operation instruction signal included in the broadcast program information. Is set to At this time, since the motion instruction signal is common between the moving picture coding apparatus 150 and the moving picture decoding apparatus 250 according to Embodiment 3 of the present invention shown in FIG. 7, the moving picture coding apparatus 150 and the moving picture decoding apparatus are the same. 250 is set to a common operation mode.

  As mentioned above, the invention made by the present inventor has been specifically described based on various embodiments. However, the present invention is not limited thereto, and various modifications can be made without departing from the scope of the invention. Needless to say.

  For example, in the moving picture coding apparatus 150 according to Embodiment 1 of the present invention shown in FIG. 3, the first moving picture encoder 102A and the second moving picture encoder 102B are respectively provided by separate hardware resources. In addition to being configured, it can be configured with a single hardware resource. That is, the function of the first video encoder 102A and the function of the second video encoder 102B can be realized by switching the functions of a single hardware resource in a time division manner.

  Furthermore, in the moving picture decoding apparatus 250 according to Embodiment 1 of the present invention shown in FIG. 4, the first moving picture decoder 202A and the second moving picture decoder 202B are configured by separate hardware resources. In addition to this, it can be configured by a single hardware resource. That is, the function of the first video decoder 202A and the function of the second video decoder 202B can be realized by switching the functions of a single hardware resource in a time division manner.

  Furthermore, in the moving picture coding apparatus 150 according to Embodiment 1 of the present invention shown in FIG. 3, the first moving picture encoder 102A and the second moving picture encoder 102B are configured by hardware resources. In addition, it can be realized by software processing executed by hardware such as a central processing unit (CPU).

  Furthermore, in the moving picture decoding apparatus 250 according to Embodiment 1 of the present invention shown in FIG. 4, the first moving picture decoder 202A and the second moving picture decoder 202B are configured by hardware resources. It can also be realized by software processing executed by hardware such as a central processing unit (CPU).

DESCRIPTION OF SYMBOLS 100 ... Frame memory 150 ... Moving image encoder 101 ... Image data separator 100A ... First buffer memory 100B ... Second buffer memory 102A ... First moving image encoder 102B ... Second moving image encoder 104 ... Transformer Port stream multiplexer TS_A ... first transport stream TS_B ... second transport stream 105 ... multiplexed transport stream 105_0, 105_2 ... odd transport stream bucket 105_1, 105_3 ... even transport stream bucket 106 ... Error due to radio wave interference 103A: first moving image encoding process 103B: second moving image encoding process 10A, 10B: first and second one sequences 11A, 11B: first and second group of pictures 12A, 12 ... 1st and 2nd picture 13A, 13B ... 1st and 2nd slice 14A, 14B ... 1st and 2nd macroblock 15A, 16A, 17A ... 1st block 15B, 16B, 17B ... 2nd block 250 ... moving picture decoder 201 ... transport stream separator 202A ... first moving picture decoder 202B ... second moving picture decoder 203A ... first buffer memory 203B ... second buffer memory 205 ... moving picture synthesizer 206 ... moving picture Interpolator 204A ... first moving picture decoding process 204B ... second moving picture decoding process Error A ... first moving picture decoding error signal Error B ... second moving picture decoding error signal Frame_0, 1, 2, 3 ... a plurality of moving pictures flame

Claims (20)

A video encoding method including a separation step, a video encoding step, a multiplexing step, and an output step,
The separation step is to separate an original moving image frame having a predetermined resolution into a first moving image frame and a second moving image frame having a lower resolution than the predetermined resolution;
In the moving image encoding step, the first moving image frame and the second moving image frame separated in the separation step are subjected to a first moving image encoding process and a second moving image encoding process. The image encoding information and the second moving image encoding information are encoded respectively.
The multiplexing step forms a multiplexed stream including first packet data including the first moving image encoding information and second packet data including the second moving image encoding information,
In the moving image coding method, the output step outputs the multiplexed stream formed in the multiplexing step as a moving image coded output signal. In claim 1,
The original moving image frame having the predetermined resolution includes a predetermined number of horizontal scanning lines, and the first moving image frame and the second moving image frame having the low resolution are the predetermined number of horizontal scanning lines. A moving picture coding method comprising a first horizontal scanning line and a second horizontal scanning line, each having a smaller number than the first horizontal scanning line. In claim 1,
The original moving image frame having the predetermined resolution includes a plurality of original moving image frames having a predetermined number of frame rates, and the first moving image frame and the second moving image frame having the low resolution are the predetermined number of the frames. A moving picture coding method comprising: a plurality of first moving picture frames and a second plurality of moving picture frames each having a low frame rate that is smaller than the frame rate. In claim 1,
The first moving image encoding information includes moving image information of the first moving image frame, does not include moving image information of the second moving image frame, and the second moving image encoding information includes A moving picture encoding method, wherein moving picture information of the first moving picture frame is not included, and moving picture information of the second moving picture frame is included. In claim 4,
The first moving image coding information includes a first group of pictures having an I frame, a P frame, and a B frame as the moving image information of the first moving image frame, and the second moving image code The moving picture encoding method according to claim 1, wherein the conversion information includes a second group of pictures having an I frame, a P frame, and a B frame as the moving picture information of the second moving picture frame. A video decoding method including an input step, a separation step, a video decoding step, a synthesis step, and an output step,
In the input step, the multiplexed stream defined in claim 1 is input,
The first moving image encoded information and the second moving image encoded information defined in claim 1 are separated by separating the multiplexed stream input by the input step by the separating step. Is,
The first moving image encoded information and the second moving image encoded information separated by the moving image decoding step by the separating step are converted into a first moving image decoding process and a second moving image decoding process, respectively. Decoding the first moving image frame and the second moving image frame defined in claim 1 respectively;
The original moving image having the predetermined resolution defined in claim 1 by combining the first moving image frame and the second moving image frame decoded by the moving image decoding step by the combining step. To play frames,
In the moving image decoding method, the output step outputs the moving image frame reproduced in the combining step as a moving image decoding output signal. In claim 6,
If an error occurs in the first video decoding process of the video decoding step, a first video decoding error signal is generated, and an error occurs in the second video decoding process of the video decoding step. Is generated, a second video decoding error signal is generated.
In the synthesizing step, the first video frame decoded by the video decoding step in response to the first video decoding error signal is not used, and in response to the second video decoding error signal. The moving image decoding method, wherein the second moving image frame decoded in the moving image decoding step is not used. In claim 7,
Further comprising an interpolation step,
In the interpolation step, an interpolation frame is generated by interpolation processing of the frame used in the synthesis step as a substitute for the frame that is not used in the synthesis step.
In the synthesizing step, the frame to be used and the interpolated frame are synthesized with each other. In claim 8,
The original moving image frame having the predetermined resolution reproduced in the combining step includes a predetermined number of horizontal scanning lines, and the first moving image frame and the second moving image decoded by the moving image decoding step. 2. A moving picture decoding method according to claim 1, wherein the frame includes a first horizontal scanning line and a second horizontal scanning line that are smaller in number than the predetermined number of horizontal scanning lines. In claim 8,
The original moving image frame having the predetermined resolution reproduced in the synthesizing step includes a plurality of moving image frames having a predetermined number of frame rates, and the first moving image frame decoded by the moving image decoding step and the The second moving image frame includes a first plurality of moving image frames and a plurality of second moving image frames each having a low frame rate that is smaller than the predetermined number of the frame rates. Decryption method. A video encoding device having a function as a separator, a function as a video encoder, a function as a multiplexer, and a function as an output device,
The function as the separator is to separate an original moving image frame having a predetermined resolution into a first moving image frame and a second moving image frame having a lower resolution than the predetermined resolution,
The function as the moving image encoder includes a first moving image encoding process and a second moving image encoding of the first moving image frame and the second moving image frame separated by the function as the separator. The first moving image encoded information and the second moving image encoded information are respectively encoded by processing,
The function as the multiplexer is to form a multiplexed stream including first packet data including the first moving image encoding information and second packet data including the second moving image encoding information. ,
The function as the output unit outputs the multiplexed stream formed by the function as the multiplexer as a video encoded output signal. In claim 11,
The original moving image frame having the predetermined resolution includes a predetermined number of horizontal scanning lines, and the first moving image frame and the second moving image frame having the low resolution are the predetermined number of horizontal scanning lines. A moving picture coding apparatus comprising a first horizontal scanning line and a second horizontal scanning line, each having a smaller number than the first horizontal scanning line. In claim 11,
The original moving image frame having the predetermined resolution includes a plurality of original moving image frames having a predetermined number of frame rates, and the first moving image frame and the second moving image frame having the low resolution are the predetermined number of the frames. A moving picture encoding apparatus comprising: a plurality of first moving picture frames and a second plurality of moving picture frames each having a low frame rate that is smaller than the frame rate. In claim 11,
The first moving image encoding information includes moving image information of the first moving image frame, does not include moving image information of the second moving image frame, and the second moving image encoding information includes A moving picture encoding apparatus characterized in that moving picture information of the first moving picture frame is not included, and moving picture information of the second moving picture frame is included. In claim 14,
The first moving image coding information includes a first group of pictures having an I frame, a P frame, and a B frame as the moving image information of the first moving image frame, and the second moving image code An image encoding apparatus comprising: a second group of pictures having an I frame, a P frame, and a B frame as the moving image information of the second moving image frame). A video decoding device including a function as an input device, a function as a separator, a function as a video decoder, a function as a synthesizer, and a function as an output device,
The multiplexed stream defined in claim 11 is input by the function as the input device,
The first moving image coding information and the second moving image coding defined in claim 11 by separating the multiplexed stream input by the function as the input device by the function as the separator. Information is separated,
By the function as the moving picture decoder, the first moving picture encoded information and the second moving picture encoded information separated by the function as the separator are converted into a first moving picture decoding process and a second moving picture. An image decoding process for decoding the first moving image frame and the second moving image frame defined in claim 11, respectively,
The predetermined function defined in claim 11 by combining the first moving image frame and the second moving image frame decoded by the function as the moving image decoder by the function as the combining device. Replaying the source image frame having a resolution;
The function as the output device outputs the moving image frame reproduced by the function as the combiner as a moving image decoding output signal. In claim 16,
When an error occurs in the first video decoding process of the function as the video decoder, a first video decoding error signal is generated, and the second moving image of the function as the video decoder is generated. When an error occurs in the image decoding process, a second moving image decoding error signal is generated,
In the function as the synthesizer, the first moving image frame decoded by the function as the moving image decoder in response to the first moving image decoding error signal is not used, and the second moving image decoding The moving picture decoding apparatus, wherein the second moving picture frame decoded by the function as the moving picture decoder in response to an error signal is not used. In claim 17,
It further has a function as an interpolator,
In the function as the interpolator, as a substitute for the frame that is not used in the function as the synthesizer, an interpolation frame is generated by the interpolation process of the frame used in the function as the synthesizer,
In the function as the synthesizer, the moving picture decoding apparatus synthesizes the used frame and the interpolated frame. In claim 18,
The original moving image frame having the predetermined resolution reproduced by the function as the synthesizer includes a predetermined number of horizontal scanning lines, and is decoded by the function as the moving image decoder. And the second moving image frame includes a first horizontal scanning line and a second horizontal scanning line each having a smaller number than the predetermined number of horizontal scanning lines. In claim 18,
The original moving image frame having the predetermined resolution reproduced by the function as the combiner includes a plurality of moving image frames having a predetermined number of frame rates, and is decoded by the function as the moving image decoder. Each of the one moving image frame and the second moving image frame includes a plurality of first moving image frames and a plurality of second moving image frames having a low frame rate that is smaller than the predetermined number of the frame rates. A video decoding apparatus characterized by the above.

Images