JP4672561B2 - Image processing apparatus, receiving apparatus, broadcast system, image processing method, image processing program, and recording medium - Google Patents

Description

  The present invention relates to an image processing apparatus, a receiving apparatus, a broadcast system, an image processing method, an image processing program, and a recording medium that process and output an image of digital content data.

  Conventionally, in digital broadcasting, a method in which video data is compressed by MPEG-2 (Motion Picture Experts Group-2), packetized, and transmitted is widely used. In MPEG-2, image data is subjected to DCT (Discrete Cosine Transform) conversion, thereby converting the data into the frequency domain and compression encoding. Furthermore, the data is compression encoded by encoding the difference from the motion compensated adjacent frame or field.

  Each picture used in MPEG-2 will be described with reference to FIG. FIG. 11 is a schematic diagram showing the state of each image data when digital content is encoded and decoded. In MPEG-2, there are three types of pictures: I picture, P picture, and B picture. An I picture is a picture encoded in the same frame or field.

  A P picture is a picture obtained by performing forward prediction from the same frame or field and encoding a difference. The B picture is a picture obtained by performing bi-directional prediction from two past and future frames and encoding a difference. The B picture not only uses the past I picture or P picture as a reference screen for prediction, but also uses the future I picture or P picture as a reference screen for prediction. Therefore, the I picture and the P picture are processed first, and the B picture between the I picture and the P picture is processed later.

  In the following, referring to FIG. 11, an encoding process for encoding an input video sequence that has been input is performed, and a process for obtaining a playback video sequence by performing decoding again to decode the encoded data is performed. explain.

  The B picture before the I picture needs to wait for the buffer until the I picture is encoded. In FIG. 11, the B pictures of B0 and B1 need to be temporarily stored in a buffer and wait for output until the I picture of I2 is encoded. Similarly, the B picture of B3 and B4 needs to be temporarily stored in the buffer and output until the P picture of P5 is encoded.

  Similarly, encoding is performed in the order of I2, B0, B1, P5, B3, B4. That is, the encoder side skips the B picture and processes the next I picture or P picture first, and then processes the B picture in between.

  On the other hand, when decoding the encoded data, as shown in FIG. 11, when the encoded data is received in the order of I2, B0, B1, P5, B3, B4..., The decoding processing is performed in that order. However, since the screen presentation is kept waiting until the first image B0 can be reproduced in the original input image order, a delay of one frame occurs here. That is, on the decoder side, the B picture is decoded and displayed immediately, but even if the I picture and P picture are decoded, the next several B pictures are processed and displayed until the process is completed. Therefore, a delay occurs until the screen is presented.

  For this reason, when the user switches the channel while watching the digital broadcast, the video after the channel switching is not immediately displayed, and it takes a long time until the video after the switching is displayed on the display device. Necessary. The above time gives the user a psychological burden of waiting until an image is displayed, and is not suitable for so-called zapping viewing, in which content is viewed while switching channels one after another.

  Therefore, Patent Document 1 discloses a digital broadcast television receiver that outputs a still image that connects a channel before switching and a channel after switching to an output waiting time due to channel switching.

  In the above digital broadcasting television receiver, the still image before switching the channel gradually decreases on the screen until the switched image is displayed when the channel is switched. A state of gradually increasing is displayed. By filling the time required for channel switching with the series of output processes described above, the user's psychological burden due to the length of the channel switching time is reduced.

Further, the digital broadcast television receiver of Patent Document 1 creates a plurality of images using a plurality of image data before channel switching stored in a memory, and displays the moving image at the time of channel switching. Thereby, the user's psychological burden due to the length of the channel switching time is reduced by filling the time required for the channel switching.
Japanese Patent Laid-Open No. 9-135394 (published on May 20, 1997)

  However, the digital broadcast television receiver disclosed in Patent Document 1 processes the images before channel switching stored in the memory, creates a plurality of images that are gradually reduced, and outputs them to the screen. Therefore, there arises a problem that the user must continue to view the image based on the image before the channel switching or the moving image for a while after the channel switching. For this reason, the user performs an operation of switching channels, but feels uncomfortable with seeing the image before switching, and feels a psychological burden.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to output an image with less sense of incongruity between the time the digital content data is output and the time the image is actually output. An image processing apparatus, a receiving apparatus, a broadcasting system, an image processing method, an image processing program, and a recording medium.

  In order to solve the above problems, the processing device of the present invention includes an input unit for inputting digital content data composed of a plurality of image data, which is created by encoding a video composed of a plurality of images. An image processing apparatus comprising: a playback unit that decodes the digital content data received from the input unit into a playback image; and an output unit that rearranges the plurality of decoded playback images and outputs the video as a video. Extracting means for extracting a reproduced image not output as a preceding image, adding means for adding an effect to the preceding image to generate an additional image, and when the digital content data is input, the preceding image is decoded. A period from when the plurality of reproduced images decoded from the above are rearranged and output as video. Output control means for controlling the output means so as to output an image, and when the digital content data input to the input means is changed, the first decoded playback image is extracted as the preceding image It is characterized by doing.

  According to the above configuration, the digital content that is input as a result of performing the decoding process on the digital content in the time required for the processing that is performed when the digital content data is decoded, the reproduced images are rearranged, and the video is output. When the data is changed, an additional image obtained by adding an effect to the reproduced image obtained first is generated, and is output at a waiting time until the decoding of the reproduced image to be output first is completed.

  Thus, control is performed so that the additional image from the adding means is output before the reproduced image is output. Here, the adding means applies to the preceding image extracted by the extracting means, i.e., the preceding image that is a reproduced image that has not been decoded yet and is output in a delayed manner. Video effects.

  Therefore, the adding means, if it is later than the time point when the preceding image is decoded, is the time when the decoding of the reproduced image to be output first should be completed, and the time point when the preceding image is set after that. It is possible to apply a video effect to the preceding image at an earlier time. Therefore, when the preceding image is arranged at the beginning of the digital content data that is instructed to be output, the video playback device is earlier than the time when the playback means decodes and outputs the first output image as video. Thus, it is possible to output a signal indicating an image obtained by adding a video effect to the preceding image obtained by decoding the image data in the digital content data instructed to be output.

  The preceding image output by the adding means is a reproduced image to be output after the time when the reproduced images decoded by the reproducing means are rearranged and the video is output. This is an image obtained by adding a video effect to an image generated by decoding the image data in the inside. Therefore, compared with an image that has been instructed to be output before the output of the digital content data is instructed, in many cases, it is more similar to the image that is output first as a video image. Can be reduced.

  Further, since the preceding image to which the adding means adds an effect has a video effect, even if it is slightly different from the reproduced image to be output first as a video, the user hardly notices the difference. As a result, it is possible to realize an image reproducing apparatus capable of outputting an image with less sense of incongruity between the time when the output of digital content data is instructed and the time when the image is actually output.

  In the image processing apparatus of the present invention, it is preferable that the preceding image is intra-encoded image data in which all pixels in the screen are intra-encoded.

  According to the above configuration, decoding is performed at the waiting time until the decoding of the reproduced image, which is the first image to be output, is performed using the preceding image that is first decoded but has time to output. An image can be generated. As a specific example, the intra-coded image data may be an I picture in MPEG2, for example. In the case of an I picture, the image data of the frame decoded at the beginning of each GOP is satisfied, so that the above condition can be satisfied.

  In the image processing apparatus of the present invention, when the digital content data input to the input unit is changed, the output control unit uses the preceding image as a playback image to be output first as a video, and uses the playback image. The output means may be controlled to output the additional image during a period until output.

  According to the above configuration, conventionally, an image that is output before a period in which no image is output, or a period in which an image using a past image is output and data of an image that is first decoded is output. In this period, the additional image that is scheduled to be output and created based on the preceding image can be output until the reproduction image to be output first as a video is ready to be output. As a result, an image with less sense of incongruity is output during a period in which no image is output or an image using a past image is output, and the past image in time series is ahead of the future image. Therefore, the user's psychological burden can be further reduced.

  Compared with the above-described example, the reproduced image output by the adding unit does not output the reproduced image to be output later than the time when the reproducing unit decodes and outputs the second decoded data. Furthermore, the uncomfortable feeling given to the user can be reduced.

  In order to solve the above problems, the processing device of the present invention includes an input unit for inputting digital content data composed of a plurality of image data, which is created by encoding a video composed of a plurality of images. An image processing apparatus comprising: a playback unit that decodes the digital content data received from the input unit into a playback image; and an output unit that rearranges the plurality of decoded playback images and outputs the video as a video. Extracting means for extracting an incomplete reproduced image as a preceding image from image data in which complete video cannot be decoded but part of the complete video can be decoded when the digital content data is changed Adding means for adding an effect to the preceding image to generate an additional image; and the digital content An output for controlling the output means to output the additional image during a period from when the preceding image is decoded to when the plurality of decoded reproduced images are rearranged and output as video. And a control means.

  According to the above configuration, when the digital content data to be input is changed as a result of performing the decoding process on the digital content in the time required for the processing to be performed when decoding the digital content data and outputting the video, Reproduced image that cannot be decoded completely, but generates an additional image with an effect added to the incomplete replayed image from image data that can decode a part of the complete video. Is output during the waiting time until the decoding of is completed. In this way, control is performed so that the additional image from the adding means is output before the reproduced image subjected to the rearrangement from the reproducing means is output.

  In addition, since the video effect is added to the preceding image to which the adding means adds the effect, even if the video is incomplete, the user can hardly notice the difference. As a result, it is possible to realize an image reproducing apparatus capable of outputting an incomplete but little uncomfortable image from when the output of the digital content data is instructed until the image is actually output.

  To give a specific example, it is generated by decoding from data that can be decoded only part of an image, which is input from the middle of a group of video that is a unit of digital content data due to changes in the input digital content data. A video effect is added to the preceding image that is the reproduced image.

  In the image processing device according to the aspect of the invention, it is preferable that the preceding image is inter-frame forward prediction image data including data intra-coded in pixels in the screen.

  According to the above configuration, although decoding cannot be performed completely, a video that has been subjected to incomplete decoding from image data that can be partially decoded is used as a preceding image, and a complete reproduced image is decoded. An image to be output during the waiting time until completion can be generated. As a specific example, image data including the intra-encoded data may use a P picture in MPEG2, for example.

  In the image processing apparatus according to the aspect of the invention, it is preferable that the preceding image is bi-directional predictive encoded image data including data that is intra-encoded into pixels in the screen.

  According to the above configuration, the decoding cannot be performed completely, but the incomplete video decoded from the image data that can be partially decoded is used as the preceding image until the decoding of the complete reproduced image is completed. An image to be output during the waiting time can be generated. As a specific example, the picture data including the intra-coded data may use a B picture in MPEG2, for example.

  In the image processing apparatus according to the aspect of the invention, the adding unit generates one or more additional images by adding an effect of changing a parameter of the preceding image, and the output control unit approximates the preceding image. It is preferable to perform control so that the additional images are output in the order of increasing degrees.

  According to the above configuration, the adding means creates a plurality of images having step-by-step effects using the first decoded image and gradually approaches the original reproduced image. Can be generated. Thus, since the screen can be made to continue smoothly using successive images that gradually approach the original reproduced image, it is possible to further reduce the sense of discomfort given to the user.

  Note that the degree of approximation described above is based on the comparison between the preceding image before the effect is added and the additional image after the effect is added from the viewpoint of the parameters indicating the characteristics of the predetermined image. The degree of approximation is higher as the parameters indicating the characteristics of both images are closer to each other.

  As a specific example, when the parameter indicating the characteristics of the image is resolution, the closer the resolution is, the lower the degree of approximation is. When the resolution is the same, the degree of approximation is maximum. If the parameter indicating the characteristics of the image is lightness, the degree of approximation decreases with the addition of an effect that changes the lightness in a larger amount. If the lightness is the same, the degree of approximation becomes maximum. And

  In the image processing apparatus of the present invention, the effect may be an effect that changes at least one parameter among resolution, brightness, saturation, and blur.

  The effect is not limited to the above example. Any effect may be used as long as it can form a plurality of images that gradually approach the original image.

  A receiving apparatus according to the present invention includes the above-described image processing apparatus and receiving means for receiving digital content data based on a user instruction and inputting the received digital content data to the input means.

  Furthermore, a broadcasting system can be configured by including the above-described receiving device and a transmitting device that transmits digital content data to the receiving device.

  If the above configuration is used, it is possible to realize a receiving apparatus and a broadcasting system that have substantially the same effects as described above.

  An image processing method according to the present invention includes a step of inputting digital content data composed of a plurality of image data created by encoding a video composed of a plurality of images, and reproducing the inputted digital content data In an image processing method comprising a step of decoding into an image and a step of rearranging the plurality of decoded reproduced images and outputting as a video, a step of extracting a reproduced image that is not output immediately when decoded as a preceding image; A step of generating an additional image by adding an effect to the preceding image; and when the digital content data is input, the decoded images are rearranged after the preceding image is decoded and output as a video. Controlling to output the additional image during a period until Further comprising the input to the step of the input if the digital content data has been changed, it is characterized by extracting the first decoded reproduction image as the preceding image.

  According to the above configuration, the first reproduction image obtained as a result of decoding the digital content during the time required for decoding the digital content data, rearranging the reproduction images, and outputting the video. An additional image to which an effect is added is generated, and is output in a waiting time until the decoding of the reproduced image to be output first as a video is completed.

  Thus, the additional image is controlled to be output before the reproduced image is output. Here, the preceding image extracted and temporarily stored in the extracting step, that is, the reproduced image to be output first as the previous image in the order in the above video has not been decoded yet and is output with delay. A video effect is added to the preceding image that is the reproduced image to be reproduced.

  Therefore, in the step of generating the additional image, if it is after the time point when the preceding image is decoded, the time point when the reproduction image to be output first as a video is decoded, and the time point when the preceding image is set thereafter It is possible to apply a video effect to the preceding image at an earlier time. Therefore, when the preceding image is arranged at the beginning of the digital content data instructed to be output, at a time earlier than the time when the reproduced image to be output first as a video is decoded and output in the decoding step, A signal indicating an image obtained by adding a video effect to a preceding image obtained by decoding the image data in the digital content data instructed to be output can be output.

  Further, the preceding image output in the step of generating the additional image is a reproduced image to be output after the time when the reproducing means decodes and outputs the first reproduced image to be output as the video. Is an image obtained by adding a video effect to an image generated by decoding image data in the digital content data instructed. Therefore, compared with an image that has been instructed to be output before the output of the digital content data is instructed, in many cases it is more similar to a reproduced image that should be output first as a video. The feeling of incongruity given can be reduced.

  Further, since the preceding image to which the effect is added in the step of generating the additional image has a video effect, even if it is slightly different from the reproduced image to be output first as a video, the user notices the difference. hard. As a result, it is possible to realize an image processing method capable of outputting an image with less sense of incongruity between the time when the output of digital content data is instructed and the time when the image is actually output.

  The image processing method of the present invention includes a step for inputting digital content data composed of a plurality of image data, which is created by encoding a video composed of a plurality of images, and the input digital content data An image processing method comprising: a step of decoding a reproduced image; and a step of rearranging the plurality of decoded reproduced images and outputting the image as a video, wherein when the input digital content data is changed, Extracting an incomplete reproduced image as a preceding image from image data that cannot be decoded but can decode a part of a complete image, and adding an effect to the preceding image to generate an additional image And when the digital content data is input, the preceding image is decoded. It is characterized period until the output rearranges a plurality of the reproduced image obtained by decoding the video, further comprising the step of controlling to output the additional image from.

  According to the above configuration, when the digital content data to be input is changed as a result of performing the decoding process on the digital content in the time required for the processing to be performed when decoding the digital content data and outputting the video, Incomplete playback image is extracted as a preceding image from image data that cannot decode a complete video but can decode a part of a complete video, and an additional image with an effect added to the previous image is generated. Then, it is output during the period until the playback images are rearranged and output as video.

  Accordingly, the additional image is controlled to be output before the rearranged video is output. Here, the video effect is added to the preceding image to be extracted, that is, the incomplete reproduced image decoded from the image data which cannot decode the complete video but can decode a part of the complete video. is doing.

  Therefore, the video effect is applied to the preceding image obtained by decoding the image data in the digital content data instructed to be output at a time earlier than the time when the image output as the video is decoded and rearranged and output in the step of reproducing. A signal indicating the added image can be output.

  Furthermore, in the step of adding an effect, since the video effect is added to the preceding image, even if the preceding image is incomplete as a video, the user can hardly notice the difference. As a result, it is possible to realize an image reproduction method capable of outputting an incomplete but less uncomfortable image from the time when the output of digital content data is instructed until the image is actually output.

  Each unit in the image processing apparatus can be executed on a computer by a program. Furthermore, by storing the image processing program in a computer-readable recording medium, the program can be executed on any computer.

  The processing apparatus according to the present invention provides an effect of outputting image data with respect to image data obtained first as a result of performing decoding processing on digital content during the time required for processing performed when outputting digital content data. Is generated, and the image data to which the effect is added is output in a waiting time until the decoding of the image data along the time series is completed.

  As a result, an image with a little sense of incongruity that is smoothly connected to the image to be output after the decoding is completed is generated and output. A processing apparatus that can reduce the burden can be realized.

  That is, since the user can view the image data with the effect added until the user views the video after the channel switching, the user's psychological burden caused by the length of the channel switching time can be reduced. A processing device can be realized.

Embodiment 1
One embodiment of the present invention is described below with reference to FIGS. Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the drawings used for the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a schematic diagram showing a main configuration of a broadcasting system 1 according to the present embodiment. FIG. 2 is a block diagram illustrating a main configuration of the image processing device 20 provided in the receiving device 10 of the broadcasting system 1. FIG. 3 is a block diagram showing the main configuration of an effect addition processing unit (addition means) 30 provided in the image processing apparatus 20, and the effect addition processing unit 30 applies an effect ( Effects) can be added. Details of each functional block will be described below.

  As shown in FIG. 1, the broadcasting system 1 according to the present embodiment provides a user with digital content according to the operation of the user 48, and includes a receiving device 10, a digital content providing server (transmitting device) 42, An external device 44 and a display device 46 are provided.

  The receiving device 10 receives the digital content 50 from the digital content providing server 42 in accordance with an operation instruction from the user 48, and outputs the image processed image to the external device 44 and the display device 46. The apparatus 10 includes a content receiving unit (receiving unit) 12, a channel switching unit 14, a content display processing unit (output unit) 16, and an image processing device 20.

  The content receiving unit 12 can receive the digital content 50 in accordance with an instruction from the channel switching unit 14 and transmit it to the image processing apparatus 20. On the other hand, the channel switching unit 14 includes an interface for inputting an operation from the user, can receive a channel switching instruction from the user 48, and can specify the digital content 50 to be received to the content receiving unit 12. Examples of the interface include a circuit that receives a signal from a remote controller (hereinafter referred to as a remote controller). In this case, when the user 48 operates the remote controller to switch the channel of the content currently being viewed, a signal indicating a channel switching instruction performed by the user 48 is input to the channel switching unit 14 from the remote controller, and the channel switching instruction is received. It is sent to the content receiver 12.

  The image processing apparatus 20 decodes the digital content 50 received by the content receiving unit 12 based on an instruction from the channel switching unit 14, and outputs the image data obtained by the decoding to the external device 44, or a content display Or output to the display device 46 via the processing unit 16. Further, the image processing apparatus 20 not only outputs image data obtained by decoding, but also outputs image data obtained by adding a video effect to the image data obtained by decoding to the external device 44 or content display processing. Or output to the display device 46 via the unit 16. The content display processing unit 16 performs processing for converting the image data output from the image processing device 20 to the display device 46 (such as conversion to a signal suitable for the display device 46).

  The external device 44 is, for example, a recording device such as a hard disk recorder or a video recording device, and may include a display device (not shown). On the other hand, the display device 46 is, for example, a display device. The external device 44 and the display device 46 may be included in the receiving device 10 or may be provided separately. Further, only one of the two may be included in the receiving device 10. Although FIG. 1 illustrates a case where the broadcast system 1 includes both the external device 44 and the display device 46, only one of them may be included.

  The digital content 50 refers to moving image data such as MPEG2 distributed by digital broadcasting, for example. The digital content 50 may be distributed by streaming through a network, or may be distributed from each broadcasting station and received by channel switching. Hereinafter, a case where the digital content 50 is distributed from the digital content providing server 42 will be described as an example.

  The broadcasting system 1 is not limited to the form distributed from the external digital content providing server 42, but the digital content 50 stored in a recording device such as a home server is displayed in each room, a playback device, a PC, It may be distributed to a mobile phone or the like. The digital content providing server 42 may read digital content from a recording device inside the playback device or a recording medium inserted from the outside. The digital content 50 input to the image processing apparatus 20 may be digital content data including image data in which the order in which the image data is decoded and the image is output differs from the order in which the encoded image data is input. .

  Next, each processing unit of the image processing apparatus 20 will be described with reference to FIG. As shown in FIG. 2, the image processing apparatus 20 includes an input unit (input unit) 22, a content storage unit 24, a decode processing unit (reproduction unit) 26, an image data storage unit 28, and an effect addition processing unit (addition unit) 30. , And an image data output processing unit (output control means) 40. In FIG. 2, for convenience of explanation, only the signal path from the image data output processing unit 40 to the external device 44 is illustrated, but the output signal of the image data output processing unit 40 is transmitted via the content display processing unit 16. 1 is also output to the display device 46 shown in FIG.

  The input unit 22 is an interface for inputting information. The input unit 22 outputs the digital content 50 input from the outside to the content storage unit 24. The content storage unit 24 stores the digital content 50 input via the input unit 22. The content storage unit 24 may be a recording medium such as a hard disk or a semiconductor memory such as a flash ROM. The content storage unit 24 may be any recording medium as long as the digital content 50 can be recorded and stored.

  The decode processing unit 26 decodes the digital content input through the input unit 22 and stored in the content storage unit 24 into image data. The decode processing unit 26 outputs the decoded image data to the image data storage unit 28. The image data storage unit 28 stores the image data obtained by the decoding process in the decoding processing unit 26. The image data stored in the decoding processing unit 26 is referred to by the effect addition processing unit 30 and the image data output processing unit 40 at an arbitrary timing.

  The effect addition processing unit 30 performs processing for adding an effect when the image data stored in the image data storage unit 28 is output to the external device 44. Details of the processing performed by the effect addition processing unit 30 will be described later. The image data output processing unit 40 outputs the image data stored in the image data storage unit 28 to the external device 44. Further, the image data output processing unit 40 can output the image data to which the effect is added by the effect addition processing unit 30 to the external device 44 and the display device 46. Therefore, when the image data output processing unit 40 outputs the image data to which the effect is added by the effect addition processing unit 30, the user 48 is provided with a display device provided in the display device 46 and the external device 44. Can view the image data to which the effect is added on the display device.

  Next, the functional configuration of the effect addition processing unit 30 will be described with reference to FIG. As shown in FIG. 3, the effect addition processing unit 30 includes a resolution adjustment processing unit 31, a brightness adjustment processing unit 33, a saturation adjustment processing unit 35, a blur adjustment processing unit 37, and image data processing units 32, 34, 36, and so on. 38, and an image data combination processing unit 39. Note that the effect addition processing unit 30 is not necessarily provided with all of these, and may have functions other than those described here. The effect addition processing unit 30 may have any function as long as it has a function capable of adding an output effect to the input image data 60.

  The resolution adjustment processing unit 31 performs processing for adjusting the resolution of the input image data 60, and the image data processing unit 32 creates image data with the resolution adjusted. Here, as a method of adjusting the resolution, for example, there is a method of reducing the resolution by thinning out the input image data, but it is not necessarily limited thereto.

  The resolution adjustment processing unit 31 and the image data processing unit 32 can create one or a plurality of image data having different resolutions. Further, the resolution adjustment processing unit 31 and the image data processing unit 32 can create image data having a resolution lower than that of the input image data 60.

  The brightness adjustment processing unit 33 performs a process of adjusting the brightness on the input image data 60, and the image data processing unit 34 creates image data with adjusted brightness. Here, examples of the method for adjusting the brightness include a method for adjusting the brightness by adjusting RGB gradations, and a method for adjusting the brightness by applying gamma correction, but are not necessarily limited thereto.

  The brightness adjustment processing unit 33 and the image data processing unit 34 can create one or a plurality of image data having different brightnesses. Further, the lightness adjustment processing unit 33 and the image data processing unit 34 may create image data having a lightness lower than the lightness of the input image data 60, and may be based on the lightness of the input image data 60. Alternatively, image data with high brightness may be created.

  The saturation adjustment processing unit 35 performs processing for adjusting the saturation of the input image data 60, and the image data processing unit 36 creates image data with adjusted saturation. Here, as a method of adjusting the saturation, a method of adjusting the saturation by adjusting the gradation of RGB may be mentioned, but the method is not necessarily limited thereto.

  Note that the saturation adjustment processing unit 35 and the image data processing unit 36 can create one or a plurality of image data having different saturations. Further, the saturation adjustment processing unit 35 and the image data processing unit 36 may create image data whose saturation is lower than the saturation of the input image data 60, or the input image data 60 Image data with higher saturation than that of the above may be created.

  The blur adjustment processing unit 37 performs a process of adjusting the blur on the input image data 60, and the image data processing unit 38 creates image data with the blur adjusted. Here, as a method of adjusting the blurring degree, there is a method of performing filter processing, but it is not necessarily limited thereto.

  Note that the blur adjustment processing unit 37 and the image data processing unit 38 can create one or a plurality of image data having different blur conditions.

  When a plurality of pieces of image data are created in the image data processing units 32, 34, 36 and 38, the image data combination processing unit 39 can create one moving image data by combining the images of the plurality of pieces of data.

  For example, when the resolution adjustment processing unit 31 and the image data processing unit 32 create a plurality of pieces of image data having different resolutions, the image data combination processing unit 39 performs an order from image data having a low resolution to image data having a high resolution. In addition, a plurality of pieces of the image data are combined to create one moving image data. As a result, when the user 48 views one piece of moving image data created by the image data combination processing unit 39 on the display device 46, for example, it seems that an image with a gradually higher resolution is output from an image with a lower resolution. . That is, the user 48 feels that the resolution of the image gradually approaches the resolution of the input image data from a low resolution.

  Similarly, when the brightness adjustment processing unit 33 and the image data processing unit 34 create a plurality of pieces of image data whose brightness is lower than the brightness of the input image data 60, the image data combination processing unit 39 displays the image data with a low brightness. A plurality of pieces of the image data are combined so as to create one moving image data so that the image data is ordered in descending order of brightness. As a result, when the user 48 views one piece of moving image data created by the image data combination processing unit 39 on the display device 46, for example, it seems that an image with gradually increasing brightness is output from an image with lower brightness. . That is, the user 48 feels that the brightness of the image gradually approaches the brightness of the image data input from a low brightness.

  Conversely, when the brightness adjustment processing unit 33 and the image data processing unit 34 create a plurality of pieces of image data having a higher brightness than that of the input image data 60, the image data combination processing unit 39 uses the image data having a higher brightness. A plurality of pieces of the image data are combined so as to create one moving image data in order of image data having a low brightness. As a result, when the user 48 views one piece of moving image data created by the image data combination processing unit 39 on the display device 46, for example, it seems that an image having a gradually lower brightness is output from an image having a higher brightness. . That is, the user 48 feels that the brightness of the image gradually approaches the brightness of the image data input from the high brightness.

  In addition, when the saturation adjustment processing unit 35 and the image data processing unit 36 create a plurality of pieces of image data whose saturation is lower than the saturation of the input image data 60, the image data combination processing unit 39 displays the saturation data. A plurality of pieces of image data are combined to create one moving image data so that the order is from low image data to high saturation image data. As a result, when the user 48 views one piece of moving image data created by the image data combination processing unit 39 on the display device 46, for example, an image with gradually increasing saturation is output from an image with lower saturation. Looks like. That is, the user 48 feels that the saturation of the image gradually approaches the saturation of the image data input from the low saturation.

  Conversely, when the saturation adjustment processing unit 35 and the image data processing unit 36 create a plurality of pieces of image data with higher saturation than the saturation of the input image data 60, the image data combination processing unit 39 A plurality of pieces of image data are combined so as to create one moving image data so that the image data is ordered from high image data to low image data. As a result, when the user 48 views one piece of moving image data created by the image data combination processing unit 39 on the display device 46, for example, an image with a gradually lower saturation is output from a higher saturation image. Looks like. That is, the user 48 feels that the saturation of the image gradually approaches the saturation of the image data input from the high saturation.

  Further, when the blur adjustment processing unit 37 and the image data processing unit 38 create a plurality of image data having different blur levels, the image data combination processing unit 39 changes from image data having a high blur level to image data having a low blur level. A plurality of pieces of the image data are combined so as to create one moving image data so as to be in this order. As a result, when the user 48 views one piece of moving image data created by the image data combination processing unit 39 on the display device 46, for example, image data with a gradually reduced blur is output from image data with a higher blur. Looks like you are. That is, the user 48 feels as if the image data gradually inputted from the image data having a large blurring degree is approached.

  Next, the timing for outputting an image with an added video effect will be described with reference to FIG. FIG. 4 is a schematic diagram showing the state of each image data when encoding and decoding the digital content 50 in each embodiment. In FIG. 4, the time, the received image, the decoded image, and the screen output of the first embodiment are shown from left to right along the time series in order from the top. The time indicates each time from time T1 to time T26 in order from left to right. In FIG. 4, the screen output of the second embodiment is also shown. This will be described in the second embodiment.

  As described above, the digital content 50 according to the present embodiment is composed of image data obtained by encoding each image constituting a video. Each image data is either an I picture, a P picture, or a B picture. When the image data is an I picture, the decoding processing unit 26 can generate data obtained by decoding the image data from only the image data. On the other hand, when the image data is a P or B picture, the decoding processing unit 26 decodes the image data with reference to other image data referred to when the image data is encoded.

  Here, if each image data in the digital content 50 is arranged in time series in the video of the corresponding image, and the digital content 50 including each image data is transmitted, P or When the image data of the B picture is received, other image data necessary for decoding the image data may not be received. In this case, since the decode processing unit 26 cannot decode the received image data, there is a possibility that a period during which the decode processing unit 26 cannot process any image data may occur.

  On the other hand, in the digital content 50 according to the present embodiment, the image data of the P or B picture is arranged so as to be behind the other image data necessary for decoding the image data. The apparatus 10 decodes each image data included in the received digital content, rearranges the order of the decoded image data, and outputs each image data in the time-series order in the video of the corresponding image. is doing. Thereby, the decoding processing unit 26 is operated efficiently.

  As an example, in the example of FIG. 4, in the digital content 50, each image data is arranged in the order of I2, B0, B1, P5, B3. Note that each image data is provided with a reference code obtained by concatenating an English character (I, P, or B) indicating whether it is an I picture, a P picture, or a B picture with a numerical value indicating a time-series order in the video. ing. In the following, for convenience of explanation, an image corresponding to image data is also referred to with the same reference numeral as that of the image data. The digital content 50 according to the present embodiment is composed of a plurality of GOPs (Group of Pictures), but FIG. 4 illustrates only one GOP. In the example of FIG. 4, the GOP is composed of 12 frames B0 to P11.

  Before describing the output timing of an image with a video effect, the output timing of an image without a video effect and the processing of image data indicating the image will be described.

  At times T1 to T2, the receiving device 10 receives and decodes the image data I2. The image data I2 is image data that has been intra-coded, and can be decoded using only the image data I2. However, the output timing of the screen I2 is after the output of the screens B0 and B1. Therefore, the receiving device 10 (more specifically, the decoding processing unit 26 of the receiving device 10) stores the decoded image data I2 in the image data storage unit 28 as a temporary storage memory.

  Further, at time T3 to T4, the receiving device 10 receives the image data B0, and the decoding processing unit 26 decodes the image data B0 based on the decoding result of the image data I2 and the image data B0. Furthermore, the receiving device 10 outputs the decoded image data B0 to a display device such as the display device 46 (hereinafter simply referred to as a display device), and the display device outputs an image B0 indicated by the image data B0. .

  Here, the image B0 is the first image of the digital content 50. For example, when receiving an output instruction of the digital content 50 such as channel switching, it is desired to output the image B0 immediately. However, as described above, the image data B0 is data decoded based on the decoding result of the image data I2 and the image data B0, and is arranged next to the image data I2 in the digital content 50. Therefore, when receiving an instruction to output the digital content 50, the receiving device 10 cannot output the image B0 immediately, and outputs it to the display device after a delay of at least one frame at times T1 to T2.

  Similarly, at time T5 to T6, the receiving device 10 receives the image data B1, and the decoding processing unit 26 decodes the screen data B1 based on the image data I2 and the image data B1. Thereby, the screen B1 indicated by the screen data B1 is output from the display device.

  On the other hand, at the output timing of the screen data I2 stored in the image data storage unit 28, that is, from time T7 to T8, the decode processing unit 26 stores the screen data I2 stored in the image data storage unit 28. And output to the display device. Further, at times T7 to T8, the receiving apparatus 10 receives and decodes the image data P5. However, since the output timing of the screen P5 is after the screens B3 and B4, the decode processing unit 26 decodes the image data P5 and stores it in the image data storage unit 28.

  At times T9 to T10, the receiving device 10 receives the image data B3, and the decoding processing unit 26 decodes the image data B3 based on the decoding result of the image data P5 and the image data B3. Thereafter, the screen B3 indicated by the image data B3 is output to the display device. At times T11 to T12, the receiving device 10 receives the image data B4, and the decoding processing unit 26 decodes the screen data B4 based on the decoding result of the image data P5 and the image data B4. Thereafter, a screen B4 indicated by the image data B4 is output to the display device.

  At the output timing of the screen data P5, that is, times T13 to T14, the decode processing unit 26 outputs the screen data P5 stored in the image data storage unit 28 to the display device. At times T13 to T14, the receiving device 10 receives and decodes the image data P8. However, since the output timing of the screen P8 is after the screens B6 and B7, the decode processing unit 26 decodes the image data P8 and stores it in the image data storage unit 28.

  Similarly, at time T15 to T16, the image data B6 is received by the receiving device 10, and the decoding processing unit 26 decodes the screen B6 based on the data of the image data P8 and the image data B6. Thereafter, the screen B6 is output to the display device. At times T17 to T18, the image data B7 is received by the receiving device 10, and the decode processing unit 26 decodes the screen B7 based on the data of the image data P8 and the image data B6. Thereafter, the screen B7 is output to the display device.

  From time T19 to T20, the screen P8 is output to the display device. Then, the image data P11 is received by the receiving device 10. Since the output timing of the screen P11 is after the screens B9 and B10, the image data P11 is decoded and stored in the image data storage unit 28.

  At times T21 to T22, the image data B9 is received by the receiving device 10, and the decode processing unit 26 decodes the screen B9 based on the data of the image data P11 and the image data B9. Thereafter, the screen B9 is output to the display device. At times T23 to T24, the image data B10 is received by the receiving device 10, and the decoding processing unit 26 decodes the screen B9 based on the data of the image data P11 and the image data B9. Thereafter, the screen B9 is output to the display device.

  At times T25 to T26, the screen P11 temporarily stored in the image data storage unit 28 is output to the display device. Thereafter, the same GOP is repeated for the next GOP.

  By the way, when the receiving device 10 receives I2 and the decode processing unit 26 decodes the image data I2, the image data B0 has not been decoded even though the decoding of the image data I2 has been completed. The image data I2 is stored in the image data storage unit 28. The image I2 indicated by the image data I2 is output after the first image B0 and the next image B1 in the video indicated by the digital content 50 are output.

  Conventionally, a blank image, a blank black screen, a past screen, or the like is output to the display device at times T1 to T2 before the image B0 is output.

  On the other hand, the receiving apparatus 10 according to the present embodiment displays a video on the image data I2 of the screen I2 to be output in the period (time T1 to T2) from when the image data I2 is decoded until the image B0 is output. Output with effect.

  Specifically, the effect addition processing unit 30 generates, based on the image data I2, a screen I2a having a low degree of approximation and a screen I2b having a higher degree of approximation than the screen I2a and a lower degree of approximation than the screen I2. The screen I2a is output at time T1, and the screen I2b is output at time T2. As a result, the image is output so that the screen I2a → screen I2b → screen B0 gradually approaches the same image as the screen I2.

  Here, the screen I2a and the screen I2b are future images than the screen B0, but the screen B0 is an image decoded based on the image data I2, and the screen B0 and the screen I2 may be similar images. Therefore, the user feels uncomfortable. Therefore, at time T1 to T2 when a delay of one frame is conventionally generated, an image that is naturally connected to the screen B0 output at time T3 can be output, so that the psychological burden on the user can be reduced.

  Further, the screen I2a... Inserted before the screen B0 is a screen generated by adding a video effect to the screen I2, and has a lower degree of approximation than the original digital content 50 including the screen I2. . Therefore, even if the screen I2 is slightly different from the screen B0, the user hardly notices the difference. As a result, the uncomfortable feeling given to the user can be suppressed, and the psychological burden given to the user can be reduced.

[Embodiment 2]
Next, another screen output method according to the second embodiment will be described. The receiving device 10 according to the second embodiment is different from the receiving device 10 according to the first embodiment in the operation timing and the effect adding method of the effect addition processing unit 30 and the image data output processing unit. Except for the operation timing and the method of adding effects, both receiving apparatuses 10 have the same structure. Therefore, in the second embodiment, the receiving apparatus and each member constituting the receiving apparatus are referred to with the same reference numerals as those in the first embodiment.

  In the second embodiment, the receiving device 10 receives I2, the decoding processing unit 26 decodes I2, and the time T1 to T2 when nothing is output to the external device 44 and the time T3 when the screens B0 and B1 are output conventionally. In ~ T6, an image with an effect is created and output using the image of the screen I2 to be output from now on. That is, the screen with the effect is output from time T7 to time T8 when the screen I2 is output.

  Specifically, the effect addition processing unit 30 generates the screens I2a, I2b, I2c, I2d, I2e, and I2f based on the image data I2 so that the degree of approximation increases in order, and the times T1 and T2 At T3, T4, T5, and T6, screens I2a, I2b, I2c, I2d, I2e, and I2f are output, respectively. As a result, the screen gradually approximates as screen I2a → screen I2b → screen I2c → screen I2d → screen I2e → screen I2f → screen I2, and the image is output so as to approach the same screen as screen I2.

  Compared with the screen output method of the first embodiment, images that do not follow the time series are not output, and thus images that are more naturally connected can be output in order, thereby further reducing the psychological burden on the user. can do.

  Next, image processing actually performed by the image processing apparatus 20 will be described with reference to FIGS. FIG. 5 is a flowchart showing an outline of the main operations S101 to S107 of the image processing apparatus 20. FIG. 6 is a flowchart showing the resolution adjustment process executed in S103 shown in FIG. FIG. 7 is a flowchart showing the brightness adjustment process executed in S104 shown in FIG. FIG. 8 is a flowchart showing the saturation adjustment process executed in S105 shown in FIG. FIG. 9 is a flowchart showing the blurring degree adjustment process executed in S106 shown in FIG.

  With reference to FIG. 5, the flow of the main operation process will be described. When the image processing apparatus 20 is turned on, image processing is started, and the process proceeds to S101.

  In step S <b> 101, the image processing apparatus 20 determines whether there is an instruction to add an effect to the input digital content 50. If there is an instruction to add an effect (YES in S101), the process proceeds to S102, and if there is no instruction to add an effect (NO in S101), the process ends. It should be noted that the information as to whether or not the effect is to be added may be stored in advance in the image processing apparatus 20, and the user 48 instructs or sets the image processing apparatus 20 as appropriate. It doesn't matter.

  In S <b> 102, the effect addition processing unit 30 determines an effect to be added to the image data 60. If an effect is added to the image data 60 by adjusting the resolution (resolution adjustment in S102), the process proceeds to S103. When an effect is added to the image data 60 by adjusting the lightness (lightness adjustment in S102), the process proceeds to S104. When an effect is added by adjusting the saturation of the image data 60 (saturation adjustment in S102), the process proceeds to S105. When an effect is added to the image data 60 by adjusting the blur level (blur level adjustment in S102), the process proceeds to S106.

  The information about which effect is added to the image data 60 may be stored in advance by the effect addition processing unit 30, and the user 48 may instruct the image processing apparatus 20 as appropriate or It may be set.

  In S103, the resolution adjustment processing unit 31 and the image data processing unit 32 create one or more image data with different resolutions by adjusting the resolution of the image data 60, and the process proceeds to S107. Details of the resolution adjustment processing will be described later. In S104, the brightness adjustment processing unit 33 and the image data processing unit 34 adjust the brightness of the image data 60 to create one or more image data having different brightnesses, and the process proceeds to S107. Details of the brightness adjustment processing will be described later.

  In S105, the saturation adjustment processing unit 35 and the image data processing unit 36 create one or more image data having different saturations by adjusting the saturation of the image data 60, and the process proceeds to S107. Details of the saturation adjustment process will be described later. In S106, the blurring degree adjustment processing unit 37 and the image data processing unit 38 adjust the blurring degree with respect to the image data 60 to create one or a plurality of image data having different blurring degrees, and the process proceeds to S107. The details of the blur adjustment process will be described later.

  In S107, the image data output processing unit 40 outputs the image data to which the effect is added in S103, S104, S105, and S106, and ends the process.

  Next, the resolution adjustment process will be described with reference to FIG. When the resolution adjustment processing is started, in S201, the resolution adjustment processing unit 31 creates image data with a resolution lower than that of the image data 60 for the image data 60 obtained by the decoding processing in the decoding processing unit 26. It is determined whether or not to do so. If image data with a reduced resolution is to be created, the process proceeds to S202. If image data with a reduced resolution is not to be created, the process proceeds to S203. Note that the reference for determining whether or not the resolution adjustment processing unit 31 creates image data with a reduced resolution may be held in advance by the image processing apparatus 20.

  Specifically, the number of image data to be created may be determined in advance, and in S205, a plurality of created image data are combined to create one moving image data. The number of image data to be created may be determined according to the time of moving image data to be created. The image data may be created if the number is within the number, and the image data may not be created when the number is reached.

  In S <b> 202, the image data processing unit 32 creates image data in which the resolution is lower than the resolution of the image data 60 obtained by the decoding processing in the decoding processing unit 26. However, when the repetitive processing is performed in S201 and S202 and the processing in S202 is performed a plurality of times, the resolution of the image data created by the image data processing unit 32 in S202 is controlled to be all different. .

  Specifically, the resolution adjustment processing unit 31 manages all the resolutions of the image data created in S202, so that every time the image data creation process is performed by the image data processing unit 32 in S202, the resolution The adjustment processing unit 31 may determine the resolution of the image data. The method for determining the resolution by the resolution adjustment processing unit 31 is not limited. For example, the resolution is determined by subtracting a predetermined amount or a predetermined ratio from the resolution of the image data created immediately before. It doesn't matter.

  Note that the method of reducing the resolution performed by the image data processing unit 32 can be realized, for example, by thinning out the input image data 60, but is not necessarily limited thereto. Anything can be used as long as the resolution can be lower than that of the input image data 60.

  In S203, the image data combination processing unit 39 determines whether there are a plurality of pieces of image data with a reduced resolution created in S202. When there are a plurality of image data, the process proceeds to S204, and when there are no plurality of image data, the process ends.

  In step S204, the image data combination processing unit 39 sorts the plurality of pieces of image data created in step S202 in the order of image data having a low resolution to image data having a high resolution, and the process proceeds to S205.

  In S205, the image data combination processing unit 39 combines the image data in the order sorted in S204, creates one moving image data, and ends the process. The moving image data is created so that the image data gradually becomes higher in resolution from the image data whose resolution is lower. That is, the moving image data is created so as to gradually approach the image data obtained by the decoding process from the image data having a resolution much lower than that of the image data obtained by the decoding process.

  Next, the brightness adjustment process will be described with reference to FIG. When the brightness adjustment processing is started, in S301, the brightness adjustment processing unit 33 creates image data having a higher brightness than the image data 60 for the image data 60 obtained by the decoding processing in the decoding processing unit 26. Or whether to create image data having a lightness lower than that of the image data 60 is determined. When creating image data with increased brightness, the process proceeds to S302, and when creating image data with decreased brightness, the process proceeds to S307.

  Note that the criterion for determining whether the brightness adjustment processing unit 33 creates image data with increased brightness or creates image data with reduced brightness is the one that the image processing apparatus 20 holds in advance. It doesn't matter.

  In S <b> 302, the brightness adjustment processing unit 33 determines whether or not to create image data having a higher brightness than the brightness of the image data 60 obtained by the decoding process in the decoding processing unit 26. If image data with increased brightness is to be created, the process proceeds to S303. If image data with increased brightness is not to be created, the process proceeds to S304.

  Note that the criterion for determining whether or not the brightness adjustment processing unit 33 creates image data may be one that the image processing apparatus 20 holds in advance. Specifically, the number of image data to be created may be determined in advance. In S306, a plurality of created image data are combined to create one moving image data. The number of image data to be created may be determined according to the time of moving image data to be created. The image data may be created if the number is within the number, and the image data may not be created when the number is reached.

  In step S <b> 303, the image data processing unit 34 creates image data having a lightness higher than that of the image data 60 obtained by the decoding processing in the decoding processing unit 26. However, when the repeated processing is performed in S302 and S303 and the processing in S303 is performed a plurality of times, the brightness of the image data created by the image data processing unit 34 is controlled to be different in S303. .

  Specifically, the lightness adjustment processing unit 33 manages all the lightnesses of the image data created in S303, so that every time image data creation processing is performed by the image data processing unit 34 in S303, the lightness is processed. The adjustment processing unit 33 may determine the brightness of the image data. The method for determining the brightness by the brightness adjustment processing unit 33 is not limited. For example, the brightness is determined by increasing the brightness of the previously created image data by a certain amount or a certain percentage. It doesn't matter.

  As a method of increasing the brightness performed by the image data processing unit 34, for example, the brightness can be increased by gradually increasing the gradation of RGB. For example, if only red (R value) is gradually increased without reducing green (G value) and blue (B value) from cyan (R = 0, G = 255, B = 255), The amount increases and finally white (R = 255, G = 255, B = 255). In this way, the brightness can be adjusted by adjusting the gradation of RGB. Note that the method of adjusting the brightness is not necessarily limited to this. For example, brightness can be increased by applying gamma correction.

  In S304, the image data combination processing unit 39 determines whether or not there are a plurality of pieces of image data with high brightness created in S303. If there are a plurality of image data, the process proceeds to S305, and if there is no plurality of image data, the process ends. In step S305, the image data combination processing unit 39 sorts the plurality of pieces of image data created in step S303 in the order of image data having a high lightness to image data having a low lightness, and the process proceeds to S306.

  In S306, the image data combination processing unit 39 combines the image data in the order sorted in S305, creates one moving image data, and ends the process. This is created so that the moving image data gradually changes from image data with high brightness to image data with low brightness. That is, the moving image data is created so as to gradually approach the image data obtained by the decoding process from the image data having a much higher brightness than the image data obtained by the decoding process.

  In step S <b> 307, the brightness adjustment processing unit 33 determines whether to create image data whose brightness is lower than the brightness of the image data 60 obtained by the decoding processing in the decoding processing unit 26. When creating image data with low brightness, the process proceeds to S308, and when not creating image data with low brightness, the process proceeds to S309. Note that the criterion for determining whether or not the brightness adjustment processing unit 33 creates image data may be one that the image processing apparatus 20 holds in advance.

  Specifically, the number of image data to be created may be determined in advance, and in S311, a plurality of created image data are combined to create one moving image data. The number of image data to be created may be determined according to the time of moving image data to be created. The image data may be created if the number is within the number, and the image data may not be created when the number is reached.

  In S <b> 308, the image data processing unit 34 creates image data having a lightness lower than the lightness of the image data 60 obtained by the decoding processing in the decoding processing unit 26. However, when the repeated processing is performed in S307 and S308 and the processing in S308 is performed a plurality of times, the brightness of the image data created by the image data processing unit 34 in S308 is controlled to be different from each other. .

  Specifically, the lightness adjustment processing unit 33 manages all the lightnesses of the image data created in S308, so that every time image data creation processing is performed by the image data processing unit 34 in S308, the lightness is processed. The adjustment processing unit 33 may determine the brightness of the image data. The method for determining the lightness by the lightness adjustment processing unit 33 is not limited. For example, the lightness is determined by decreasing the lightness of the previously created image data by a certain amount or a certain ratio. It doesn't matter.

  As a method for reducing the brightness performed by the image data processing unit 34, the reverse of the above-described methods for increasing the brightness may be performed. That is, the brightness can be lowered by gradually lowering the gradation of RGB.

  In step S309, the image data combination processing unit 39 determines whether there are a plurality of pieces of image data with low brightness created in step S308. If there are a plurality of image data, the process proceeds to S310, and if a plurality of image data does not exist, the process ends.

  In step S310, the image data combination processing unit 39 sorts the plurality of pieces of image data created in step S308 in order of image data having low brightness to image data having high brightness, and the process advances to step S311.

  In S311, the image data combination processing unit 39 combines the image data in the order sorted in S310, creates one moving image data, and ends the process. This is created so that the moving image data gradually changes from image data with low brightness to image data with high brightness. That is, the moving image data is created so as to gradually approach the image data obtained by the decoding process from the image data having a lightness much lower than that of the image data obtained by the decoding process.

  Next, the saturation adjustment process will be described with reference to FIG. When the saturation adjustment processing is started, in S401, the saturation adjustment processing unit 35 sets an image with higher saturation than the image data 60 with respect to the image data 60 obtained by the decoding processing in the decoding processing unit 26. It is determined whether to create data, or to create image data with a lower saturation than the image data 60. When creating image data with high saturation, the process proceeds to S402, and when creating image data with low saturation, the process proceeds to S407.

  Note that the image processing apparatus 20 holds in advance a criterion for determining whether the saturation adjustment processing unit 35 creates image data with high saturation or whether to create image data with low saturation. It doesn't matter.

  In step S <b> 402, the saturation adjustment processing unit 35 determines whether or not to create image data with a saturation higher than the saturation of the image data 60 obtained by the decoding processing in the decoding processing unit 26. When creating image data with high saturation, the process proceeds to S403. When image data with high saturation is not created, the process proceeds to S404. Note that the criterion for determining whether or not the saturation adjustment processing unit 35 creates image data may be one that the image processing apparatus 20 holds in advance.

  Specifically, the number of image data to be created may be determined in advance, and in S406, a plurality of created image data is combined to create one moving image data. The number of image data to be created may be determined according to the time of moving image data to be created. The image data may be created if the number is within the number, and the image data may not be created when the number is reached.

  In step S <b> 403, the image data processing unit 36 creates image data whose saturation is higher than the saturation of the image data 60 obtained by the decoding processing in the decoding processing unit 26. However, when the repeated processing is performed in S402 and S403 and the processing in S403 is performed a plurality of times, the saturation of the image data created by the image data processing unit 36 in S403 is controlled to be different. The

  Specifically, the saturation adjustment processing unit 35 manages all the saturations of the image data created in S403, so that every time image data creation processing is performed by the image data processing unit 36 in S403. The saturation adjustment processing unit 35 may determine the saturation of the image data. The method for determining the saturation by the saturation adjustment processing unit 35 is not limited. For example, the saturation is determined by increasing the saturation of the previously created image data by a certain amount or a certain ratio. It doesn't matter if you do it.

  As a method of increasing the saturation performed by the image data processing unit 36, for example, the saturation can be increased by adjusting the gradation of RGB. For example, gradually increase blue (B value) from gray (R = 39, G = 39, B = 39) and decrease red (R value) and green (G value) by the increased amount. As it goes on, the color becomes more vivid and approaches cyan (R = 0, G = 255, B = 255). As a result, the saturation can be increased.

  In step S404, the image data combination processing unit 39 determines whether there are a plurality of pieces of image data with high saturation created in step S403. If there is a plurality of image data, the process proceeds to S405, and if there is no plurality of image data, the process ends.

  In step S405, the image data combination processing unit 39 sorts the plurality of pieces of image data created in step S403 in order of image data with high saturation to image data with low saturation, and the process proceeds to step S406.

  In S406, the image data combination processing unit 39 combines the image data in the order sorted in S405, creates one moving image data, and ends the process. The moving image data is created so that the image data gradually becomes lower from the image data having higher saturation. That is, the moving image data is created so as to gradually approach the image data obtained by the decoding process from the image data having a much higher saturation than the image data obtained by the decoding process.

  In step S <b> 407, the saturation adjustment processing unit 35 determines whether or not to create image data whose saturation is lower than the saturation of the image data 60 obtained by the decoding processing in the decoding processing unit 26. When creating image data with low saturation, the process proceeds to S408, and when not creating image data with low saturation, the process proceeds to S409.

  Note that the criterion for determining whether or not the saturation adjustment processing unit 35 creates image data may be one that the image processing apparatus 20 holds in advance. For example, the number of image data to be created may be determined in advance. In S411, a plurality of created image data are combined to create one moving image data. The number of image data to be created may be determined according to the time of the image data. The image data may be created if the number is within the number, and the image data may not be created when the number is reached.

  In step S <b> 408, the image data processing unit 36 creates image data having a saturation lower than that of the image data 60 obtained by the decoding processing in the decoding processing unit 26. However, when iterative processing is performed in S407 and S408 and the processing in S408 is performed a plurality of times, the saturation of the image data created by the image data processing unit 36 in S408 is controlled to be different. The

  Specifically, the saturation adjustment processing unit 35 manages all the saturations of the image data created in S408, so that every time image data creation processing is performed by the image data processing unit 36 in S408. The saturation adjustment processing unit 35 may determine the saturation of the image data. The method for determining the saturation by the saturation adjustment processing unit 35 is not limited. For example, the saturation can be reduced by decreasing the saturation of the image data created previously by a certain amount or a certain ratio. It may be determined.

  As a method for reducing the saturation performed by the image data processing unit 36, for example, the saturation can be reduced by adjusting the gradation of RGB. For example, red (R value) is gradually increased from cyan (R = 0, G = 255, B = 255), and green (G value) and blue (B value) are decreased by the increased amount. As it goes on, the color loses its vividness and approaches gray (R = 39, G = 39, B = 39). As a result, the saturation can be lowered.

  In step S409, the image data combination processing unit 39 determines whether there are a plurality of pieces of image data with low saturation created in step S408. If there is a plurality of image data, the process proceeds to S410, and if a plurality of image data does not exist, the process ends.

  In step S410, the image data combination processing unit 39 sorts the plurality of pieces of image data created in step S408 in the order of image data having low saturation to image data having high saturation, and the process advances to step S411.

  In S411, the image data combination processing unit 39 combines the image data in the order sorted in S410, creates one moving image data, and ends the process. This moving image data is created so that the image data gradually becomes higher in saturation from the image data having lower saturation. In other words, the moving image data is created so as to gradually approach the image data obtained by the decoding process from the image data whose saturation is much lower than that of the image data obtained by the decoding process.

  Next, the blurring degree adjustment process will be described with reference to FIG. In step S <b> 501, the blurring degree adjustment processing unit 37 determines whether to create blurred image data for the image data 60 obtained by the decoding processing in the decoding processing unit 26. If the blurred image data is to be created, the process proceeds to step S502. If the blurred image data is not to be created, the process proceeds to step S503.

  Note that the criterion for determining whether or not to create the blurred image data by the blurring degree adjustment processing unit 37 may be one held in advance by the image processing device 20. For example, the number of image data to be created may be determined in advance. In step S505, a plurality of created image data are combined to create one moving image data. The number of image data to be created may be determined according to the time of the image data. The image data may be created if the number is within the number, and the image data may not be created when the number is reached.

  In step S502, the image data processing unit 38 creates blurred image data with respect to the image data 60 obtained by the decoding processing in the decoding processing unit 26. However, when iterative processing is performed in steps S501 and S502 and the processing in step S502 is performed a plurality of times, the degree of blurring of the image data created by the image data processing unit 38 in step S502 is all different. To be controlled.

  For example, the blur adjustment processing unit 37 manages all the blurs of the image data created in step S502, so that every time the image data creation process is performed by the image data processing unit 38 in step S502, The blur adjustment processing unit 37 may determine the blur of the image data.

  The method of determining the blur level by the blur level adjustment processing unit 37 is not limited. For example, the blur level is determined by increasing the blur level of the previously created image data by a certain amount or a certain ratio. It doesn't matter if you do it. Further, as a method of creating blurred image data performed by the image data processing unit 38, for example, there is a method of performing filter processing. For example, the image data can be blurred by applying a filter that sets the target pixel density value after filtering to the average value of adjacent pixels.

  In step S503, the image data combination processing unit 39 determines whether there are a plurality of blurred image data created in step S502. If a plurality of image data exists, the process proceeds to step S504, and if a plurality of image data does not exist, the process ends.

  In step S504, the image data combination processing unit 39 sorts the plurality of image data created in step S502 in the order of image data with a high degree of blurring to image data with a low degree of blurring, and the process proceeds to step S505.

  In step S505, the image data combination processing unit 39 combines the image data in the order sorted in step S504, creates one moving image data, and ends the process. This moving image data is created so that the image data having a gradually increased blur is gradually changed from the image data having the increased blur. That is, the moving image data is created so that the image data obtained by the decoding process gradually approaches the image data obtained by the decoding process from the image data obtained by blurring the image data obtained by the decoding process.

  Next, as a specific operation of the image processing apparatus 20, Example 1 to Example 4 will be exemplified.

  In the first embodiment shown below, a plurality of pieces of image data with adjusted resolution are created for the image data obtained by the decoding process, and one piece of moving image data is created by combining the plurality of pieces of created image data. The operation of the image processing apparatus 20 at the time of output is exemplified.

  For example, a case where image data A0 having an a × b resolution is input will be described with reference to the flowchart shown in FIG. In S201 and S202, the resolution adjustment processing unit 31 creates image data having a resolution lower than the a × b resolution for the input image data A0. Here, as a method of creating image data with a reduced resolution, the resolution adjustment processing unit 31 may create image data with a reduced resolution by thinning out the input image data A0, for example. When the horizontal and vertical resolutions are halved, image data with a / 2 × b / 2 resolution is created by thinning even lines in the horizontal component and thinning even lines in the vertical component. Can do.

  Here, in S201 and S202, five pieces of image data having a resolution lower than that of the image data A0 are created. In this case, image data is created in which the horizontal and vertical resolutions are 5/6, 4/6, 3/6, 2/6, and 1/6, respectively. The reason why the resolution is as described above is to prevent the user 48 from feeling uncomfortable when the image data is created by combining the five pieces of image data and the user 48 views it. . That is, by regularly changing the resolution, the user 48 who has viewed the moving image data created from the resolution is prevented from feeling uncomfortable.

  In S202, the image data processing unit 32 starts from the image data A1 having a resolution of 5a / 6 × 5b / 6, the image data A2 having a resolution of 4a / 6 × 4b / 6, and the resolution of 3a / 6 × 3b / 6. Five pieces of image data A3, image data A4 having a resolution of 2a / 6 × 2b / 6, and image data A5 having a resolution of 1a / 6 × 1b / 6 are created.

  In S203, S204, and S205, since there are five pieces of image data, the five pieces of image data are combined to create one moving image data. Here, the image data combination processing unit 39 sorts the five pieces of image data A1 to A5 in order from the image data having the low resolution to the image data having the high resolution, so that A5-A4-A3-A2-A1. Sort in the order of.

  In S205, the image data combination processing unit 39 combines the five pieces of image data in the sorted order to create one moving image data A10.

  5, the image data output processing unit 40 outputs the moving image data A10 to the external device 44. In the case where the external device 44 has a display device, the moving image data A10 is output, and the user 48 can view the moving image data A10. Since the moving image data A10 is configured so that the image data gradually becomes higher from the image data with lower resolution, the user 48 starts from image data with lower resolution and gradually approaches the original image data A0. I can feel it.

  Next, the operation of the receiving apparatus 10 including the image processing apparatus 20 that can generate image data in which the resolution is adjusted with respect to the input image data as described above will be exemplified. For example, a case will be described in which the user 48 is watching the digital content A200 by switching the channel while watching the digital content A100 of the digital broadcast.

  The channel switching unit 14 receives a channel switching instruction from the user 48, and the content receiving unit 12 receives the digital content A 200 that is the content after the channel switching instructed by the user 48. It is assumed that the digital content A200 is encoded and decoded in the form shown in FIG. That is, digital content A200 encoded in the order of I2, B0, B1, P5, B3, B4... Is input via the content receiving unit 12, and the decoding processing unit 26 receives I2, B0, B1, P5, B3, Decode processing is performed in the order of B4.

  Therefore, the resolution adjustment processing unit 31 and the image data processing unit 32 constituting the effect addition processing unit 30 create image data with the resolution adjusted for the first decoded I2, and the image data with low resolution Are combined in the order of high resolution image data to create one moving image data A201. The series of processing is as described above.

  Then, the content display processing unit 16 outputs the moving image data A201 until the video after the channel switching by the user 48 is displayed. That is, as shown in FIG. 11, moving image data A201 is output until B0 next to I2 is decoded and reproduced.

  Alternatively, the moving image data A201 may be output until I2 used when creating the moving image data A201 is reproduced. In this case, B0 and B1 are not output. Thus, the user 48 does not have to wait until the video after the channel switching is output, and can view the moving image data A201 until the video after the channel switching is output. It is possible to reduce the psychological burden of the user 48 who is waiting until

  Furthermore, since the moving image data A201 is created so as to gradually approach the original image data from the low-resolution image data, the moving image data A201 can be smoothly switched to the video after channel switching, The user 48 does not feel uncomfortable.

  Note that it is not always necessary to create a plurality of image data with a reduced resolution, and one image data may be used. In this case, since the moving image data is not created, the image data is displayed until the video after the channel switching is output.

  As described above, in the configuration of the first embodiment, image data having a resolution lower than that of the original image data is created for the image data obtained by the decoding process, and the created image data is combined. Create two video data. Then, by outputting the created moving image data until the video after the channel switching by the user 48 is displayed, the user 48 can appreciate the moving image data. Thereby, it is possible to reduce the psychological burden of the user 48 that is waiting until the video after the channel switching is displayed.

  In Example 2 shown below, a plurality of pieces of image data with adjusted brightness are created for the image data obtained by the decoding process, and one piece of moving image data is created by combining the plurality of pieces of created image data. The operation of the image processing apparatus 20 at the time of output is exemplified.

  For example, a case where image data C0 is input will be described. In S301, the brightness adjustment processing unit 33 determines whether to create image data with higher brightness or image data with lower brightness for the image data obtained by the decoding process. Here, it is assumed that image data with high brightness is created.

  At this time, in S302 and S303, the brightness adjustment processing unit 33 creates image data having a higher brightness than the image data C0 for the input image data C0. Here, as a method of creating image data with increased brightness, the brightness adjustment processing unit 33 may create image data with high brightness by gradually increasing RGB gradations, for example. . Further, image data with high brightness may be created by applying gamma correction. Note that when creating a plurality of pieces of image data with high brightness, the image data is created so that the change in brightness gradually.

  In step S305, the image data combination processing unit 39 sorts the created image data in order of image data having high brightness to image data having low brightness, and combines the image data in the sorted order in step S306. , One moving image data C10 is created.

  5, the image data output processing unit 40 outputs the moving image data C10 to the external device 44. When the external device 44 is equipped with a display device, the moving image data C10 is output, and the user 48 can view the moving image data C10. Since the moving image data C10 is configured so that the image data is gradually changed from image data with high brightness to image data with low brightness, the user 48 starts from image data with high brightness and gradually approaches the original image data C0. I can feel it.

  Next, the operation of the receiving apparatus 10 including the image processing apparatus 20 capable of creating image data in which the brightness is adjusted with respect to the image data input as described above will be exemplified. For example, a case where the user 48 is watching the digital content C100 by switching the channel while watching the digital content C100 of the digital broadcast will be described.

  The channel switching unit 14 receives a channel switching instruction from the user 48, and the content receiving unit 12 receives the digital content C 200 that is the content after the channel switching instructed by the user 48. The digital content C200 is encoded and decoded in the form shown in FIG. That is, digital content C200 encoded in the order of I2, B0, B1, P5, B3, B4... Is input via the content receiving unit 12, and the decoding processing unit 26 receives I2, B0, B1, P5, B3, Decode processing is performed in the order of B4.

  Therefore, the lightness adjustment processing unit 33 and the image data processing unit 34 constituting the effect addition processing unit 30 create image data in which the lightness is adjusted for the first decoded I2, and the image data having high lightness. The moving image data C201 is created by combining the image data with the lowest brightness. The series of processing is as described above.

  Then, the content display processing unit 16 outputs the moving image data C201 until the video after the channel switching by the user 48 is displayed. That is, as shown in FIG. 11, moving image data C201 is output until B0 next to I2 is decoded and reproduced. Alternatively, the moving image data C201 may be output until I2 used when creating the moving image data C201 is reproduced. In this case, B0 and B1 are not output. As a result, the user 48 does not need to wait until the video after the channel switching is output, and can view the moving image data C201 until the video after the channel switching is output, so that the video is output. It is possible to reduce the psychological burden of the user 48 who is waiting until Furthermore, since the moving image data C201 is created so as to gradually approach the original image data from the image data with high brightness, the moving image data C201 can be smoothly switched to the video after channel switching. The user 48 does not feel uncomfortable.

  Note that it is not always necessary to create a plurality of image data with high brightness, and one image data may be used. In this case, since the moving image data is not created, the image data is output until the video after the channel switching is output.

  In the above description, the case where image data having a higher brightness than input image data has been described. However, image data having a brightness lower than that of input image data may be generated. . In this case, in S310, the image data combination processing unit 39 sorts the created image data so that the image data having the low brightness is ordered in the order of the image data having the high brightness, and in S311, the image data is sorted in the sorted order. Combined to create one moving image data.

  Then, by outputting this moving image data between the time when the user 48 issues a channel switching instruction and the video after switching is displayed, the user 48 can view it and wait until the video is output. Therefore, the psychological burden on the user 48 can be reduced. Furthermore, since the moving image data is created so as to gradually approach the original image data from the image data with low brightness, the moving image data can be smoothly switched to the video after channel switching. Does not give a sense of incongruity.

  As described above, in the configuration of the second embodiment, image data with adjusted brightness is created for the image data obtained by the decoding process, and one moving image data is created by combining the created image data. To do. Then, by outputting the created moving image data until the video after the channel switching by the user 48 is displayed, the user 48 can appreciate the moving image data. Thereby, it is possible to reduce the psychological burden of the user 48 that is waiting until the video after the channel switching is displayed.

  In Example 3 shown below, a plurality of pieces of image data with adjusted saturation are created for the image data obtained by the decoding process, and one piece of moving image data is combined by combining the plurality of pieces of created image data. The operation of the image processing apparatus 20 when creating and outputting is illustrated.

  For example, a case where image data D0 is input will be described. In step S <b> 401, the saturation adjustment processing unit 35 determines whether to create image data with high saturation or image data with low saturation for the image data obtained by the decoding process. Here, it is assumed that image data with high saturation is created.

  At this time, in S402 and S403, the saturation adjustment processing unit 35 creates image data with higher saturation than the image data D0 for the input image data D0. Here, as a method of creating image data with high saturation, the saturation adjustment processing unit 35 adjusts the gradation of RGB, for example, and increases the amount of light entering the image data, so that image data with high saturation is obtained. You may create. Note that when creating a plurality of high-saturation image data, the image data is created so that the change in the saturation gradually.

  In step S405, the image data combination processing unit 39 sorts the created image data in order of image data with high saturation to image data with low saturation, and combines the image data in the sorted order in step S406. Thus, one moving image data D10 is created.

  In step S <b> 107 illustrated in FIG. 5, the image data output processing unit 40 outputs the moving image data D <b> 10 to the external device 44. If the external device 44 is equipped with a display device, moving image data D10 is output, and the user 48 can view the moving image data D10. Since the moving image data D10 is configured so that image data with high saturation gradually changes to image data with low saturation, the user 48 starts from image data with high saturation and gradually approaches the original image data D0. You can feel like going.

  Next, the operation of the receiving device 10 including the image processing device 20 capable of creating image data in which the saturation is adjusted with respect to the image data input as described above will be exemplified. For example, a case will be described in which the user 48 is watching the digital content D200 by switching the channel while watching the digital content D100 of the digital broadcast.

  The channel switching unit 14 receives a channel switching instruction from the user 48, and the content receiving unit 12 receives the digital content D200 that is the content after the channel switching instructed by the user 48. It is assumed that the digital content D200 is encoded and decoded in the form shown in FIG. That is, digital content D200 encoded in the order of I2, B0, B1, P5, B3, B4... Is input via the content receiving unit 12, and the decoding processing unit 26 receives I2, B0, B1, P5, B3, Decode processing is performed in the order of B4.

  Therefore, the saturation adjustment processing unit 35 and the image data processing unit 36 constituting the effect addition processing unit 30 create image data in which the saturation is adjusted for the first decoded I2, and the saturation adjustment One moving image data D201 is created by combining high image data and low saturation image data in this order. The series of processing is as described above.

  Then, the content display processing unit 16 outputs the moving image data D201 until the video after the channel switching by the user 48 is displayed. That is, as shown in FIG. 11, moving image data D201 is output until B0 next to I2 is decoded and reproduced. Alternatively, the moving image data D201 may be output until I2 used for creating the moving image data D201 is reproduced. In this case, B0 and B1 are not output.

  Thus, the user 48 does not need to wait until the video after the channel switching is output, and can view the moving image data D201 until the video after the channel switching is output. It is possible to reduce the psychological burden of the user 48 who is waiting until Furthermore, since the moving image data D201 is created so as to gradually approach the original image data from the image data with high saturation, the moving image data D201 can be smoothly switched to the video after channel switching. , The user 48 does not feel uncomfortable.

  Note that it is not always necessary to create a plurality of image data with high saturation, and one image data may be used. In this case, since the moving image data is not created, the image data is output until the video after the channel switching is output.

  In the above description, the case where the image data with higher saturation than the input image data is created has been described. However, the image data with lower saturation than the input image data may be created. I do not care.

  In this case, in S410, the image data combination processing unit 39 sorts the created image data in the order of image data with low saturation to image data with high saturation, and in S411, the images are sorted in the sorted order. Combine the data to create one moving image data. Then, by outputting this moving image data between the time when the user 48 issues a channel switching instruction and the video after switching is displayed, the user 48 can view it and wait until the video is output. Therefore, the psychological burden on the user 48 can be reduced.

  Furthermore, since the moving image data is created so as to gradually approach the original image data from the low-saturation image data, it is possible to smoothly switch from the moving image data to the video after the channel switching. 48 does not give a sense of incongruity.

  As described above, in the configuration of the third embodiment, image data with adjusted saturation is created for the image data obtained by the decoding process, and one moving image data is combined by combining the created image data. create. Then, by outputting the created moving image data until the video after the channel switching by the user 48 is displayed, the user 48 can appreciate the moving image data. Thereby, it is possible to reduce the psychological burden of the user 48 that is waiting until the video after the channel switching is displayed.

  In Example 4 shown below, a plurality of blurred image data is created for the image data obtained by the decoding process, and one moving image data is created by combining the created plurality of image data. The operation of the image processing apparatus 20 when outputting will be exemplified.

  For example, a case where image data E0 is input will be described. In step S501 and step S502, the blurring degree adjustment processing unit 37 creates image data obtained by blurring the image data E0 with respect to the input image data E0. Here, as a method of creating the blurred image data by the blurring degree adjustment processing unit 37, for example, a filtering process may be performed.

  The filter used in this case may be such that the density value of the target pixel after the filter processing is set to the average value of the surrounding pixels of the target pixel. For example, if the “vertical × horizontal” of the filter is 3 × 3 pixels, the numerical values of all nine filters may be 1/9. However, the filter is not necessarily limited to this. A larger filter may be used. Note that the larger the filter is used, the more the image data with a higher degree of blur can be created.

  Further, mosaic processing may be used as a method of creating blurred image data. As a method of performing the mosaic processing, for example, by setting the density value of one pixel in a certain rectangular range to the density value of the entire rectangle, it is possible to create mosaic-processed image data. Note that when creating a plurality of pieces of blurred image data, the image data is created so that the change in the blurring degree is gradually increased.

  In step S504, the image data combination processing unit 39 sorts the generated image data so that the image data having the highest blur level is arranged in the order of the image data having the lower blur level, and in step S505, the image data is sorted in the sorted order. Are combined to create one moving image data E10.

  In step S <b> 107 illustrated in FIG. 5, the image data output processing unit 40 outputs the moving image data E <b> 10 to the external device 44. In the case where the external device 44 has a display device, the moving image data E10 is output, and the user 48 can view the moving image data E10. Since the moving image data E10 is configured so that image data with a high degree of blur gradually changes to image data with a low degree of blur, the user 48 starts with image data with a high degree of blur and gradually approaches the original image data E0. You can feel like going.

  Next, the operation of the receiving apparatus 10 including the image processing apparatus 20 capable of creating image data in which the blur level is adjusted with respect to the image data input as described above will be exemplified. For example, a case where the user 48 is watching the digital content E100 by switching the channel while watching the digital content E100 of the digital broadcast will be described.

  The channel switching unit 14 receives a channel switching instruction from the user 48, and the content receiving unit 12 receives the digital content E200 that is the content after the channel switching instructed by the user 48.

  The digital content E200 is encoded and decoded in the form shown in FIG. That is, digital content E200 encoded in the order of I2, B0, B1, P5, B3, B4... Is input via the content receiving unit 12, and the decoding processing unit 26 receives I2, B0, B1, P5, B3, Decode processing is performed in the order of B4.

  Therefore, the blurring degree adjustment processing unit 37 and the image data processing unit 38 constituting the effect addition processing unit 30 create image data in which the blurring degree is adjusted for the first decoded I2, and the blurring degree is adjusted. One moving image data E201 is created by combining large image data and image data with a small blurring degree. The series of processing is as described above.

  Then, the content display processing unit 16 outputs the moving image data E201 until the video after the channel switching by the user 48 is displayed. That is, as shown in FIG. 11, moving image data E201 is output until B0 next to I2 is decoded and reproduced. Alternatively, the moving image data E201 may be output until I2 used for creating the moving image data E201 is reproduced. In this case, B0 and B1 are not output.

  As a result, the user 48 does not need to wait until the video after the channel switching is output, and can view the moving image data E201 until the video after the channel switching is output. It is possible to reduce the psychological burden of the user 48 who is waiting until Furthermore, since the moving image data E201 is created so as to gradually approach the original image data from image data with a high degree of blurring, the moving image data E201 can be smoothly switched to the video after channel switching. , The user 48 does not feel uncomfortable.

  Note that it is not always necessary to create a plurality of blurred image data, and a single image may be used. In this case, since the moving image data is not created, the image data is output until the video after the channel switching is output.

  As described above, in the configuration of the fourth embodiment, image data obtained by adjusting the blurring degree is created for the image data obtained by the decoding process, and the created image data is combined to generate one moving image data. create. Then, by outputting the created moving image data until the video after the channel switching by the user 48 is displayed, the user 48 can appreciate the moving image data. Thereby, it is possible to reduce the psychological burden of the user 48 that is waiting until the video after the channel switching is displayed.

  As described above, the image processing apparatus according to the present embodiment includes a reproducing unit that decodes digital content data indicating a video composed of a plurality of images, and the digital content data has an order different from the order of the images in the video. The image data obtained by encoding each image is arranged, and the reproduction means decodes the image data included in the digital content data to generate a reproduction image, and then generates an image corresponding to the reproduction image to be processed. If the playback image corresponding to the previous image in the video is not yet decoded, the playback image to be processed is temporarily stored, and the playback image that has not been decoded is decoded. In an image playback device to be output later, an image for adding a video effect to the temporarily stored playback image And adding means for outputting subjected to a treatment, when the output of the digital content data is instructed, and an output control means for outputting an output from said reproducing means after adding the output from said adding means.

  According to the above configuration, the output from the adding unit is output before the output from the reproducing unit is output. Here, the adding means does not yet decode the preceding image that is temporarily recorded, that is, the reproduction image that should be output first as the image of the previous image in the above order, and is output with a delay. A video effect is added to the playback image. Therefore, if the adding means is later than the time point when the preceding image is decoded, the time point when the reproduced image to be output first as a video is decoded, and the time point earlier than the output time point of the preceding image set thereafter Thus, a process for adding a video effect to the preceding image can be performed.

  Therefore, when the preceding image is arranged at the beginning of the digital content data that is instructed to be output, the video playback device is more than the time when the playback means decodes and outputs the playback image to be output first as video. At an early point, a signal indicating a reproduced image obtained by adding a video effect to an image generated by decoding image data in the digital content data instructed to be output can be output.

  Further, the image output by the adding means is a reproduced image that should be output later than the time point when the reproducing means decodes and outputs the first reproduced image to be output as a video. This is an image obtained by adding a video effect to a reproduced image generated by decoding image data in content data. Therefore, in many cases, it is more similar to a reproduced image to be output first as a video, compared to an image instructed to be output before the output of the digital content data is instructed. The user feels uncomfortable.

  Furthermore, since the image output by the adding means has a video effect, even if it is slightly different from the reproduced image to be output first as a video, the user hardly notices the difference. As a result, it is possible to realize an image reproducing apparatus capable of outputting an image with less sense of incongruity between the time when the digital content data is output and the time when the image is actually displayed.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  In the above-described embodiment, intra-encoded image data to be intra-encoded, that is, an I picture is used, and image data in which an effect is added to the I picture is created. However, the present invention is not limited to this. For example, a P picture and a B picture may be used. P picture and B picture cannot be completely decoded by themselves, but by using P picture and B picture, it is possible to obtain image data that gradually approximates a complete picture to be output first. By outputting these images during the channel switching time, it is possible to achieve the same effects as described above.

  Further, in the case of using a P picture or a B picture, if the digital content data input to the input means is changed, an incomplete reproduced image is extracted from the P picture or B picture decoded first, It may be output as a preceding image. Although it is impossible to decode a complete picture from a single P picture or B picture, it is possible to decode a part of a complete picture. By extracting such an incomplete reproduced image and adding an effect, it can be used as the preceding image.

  Specifically, in the decoding processing unit 26, a reproduced image that is incompletely decoded from the input data is output to the image data storage unit 28 and stored. The image data stored in the decode processing unit 26 is referred to at an arbitrary timing by the effect addition processing unit 30 and the image data output processing unit 40 as in the above-described embodiment. The effect addition processing unit 30 performs processing for adding an effect when the image data stored in the image data storage unit 28 is output to the external device 44.

  According to the above configuration, image processing that can output a preceding image earlier than the above-described embodiment, and that outputs a video with reduced discomfort by adding an effect to an incomplete reproduced image The device 20 and the receiving device 10 can be realized.

  More specifically, an input unit 22 for inputting digital content 50 composed of a plurality of image data created by encoding a video composed of a plurality of images, and the digital content received from the input unit 22 In an image processing apparatus 20 including a decoding processing unit 26 that decodes 50 into a reproduction image, and an image data output processing unit 40 that rearranges a plurality of decoded reproduction images and outputs them as video, digital input to the input unit 22 An image data storage unit 28 for extracting an incomplete reproduced image as a preceding image from image data in which complete video cannot be decoded but part of the complete video can be decoded when the content 50 is changed; An effect addition processing unit 30 that adds an effect to the preceding image to generate an additional image, and digital content 50 A content display processing unit 16 for controlling the output means so as to output an additional image during a period from when the preceding image is decoded until a plurality of decoded reproduced images are rearranged and output as video. It has more.

  According to the above configuration, when the input digital content 50 is changed as a result of performing the decoding process on the digital content 50 during the time required for the processing performed when the digital content 50 is decoded and the video is output. , Playback that has been rearranged by generating an additional image with effects added to the incomplete playback image from image data that cannot be decoded completely, but can decode a part of the complete video Output during waiting time until image decoding is complete. Accordingly, the additional image from the effect addition processing unit 30 is controlled to be output before the reconstructed reproduced image is output from the image data output processing unit 40.

  Finally, each block of the receiving device 10, in particular, the decoding processing unit 26, the image data storage unit 28, the effect addition processing unit 30, and the image data output processing unit 40 included in the image processing device 20 are configured by hardware logic. Alternatively, it may be realized by software using a CPU as follows.

  That is, the image processing apparatus 20 according to the present embodiment is substantially realized by computer hardware, a program executed by the computer hardware, and data stored in the computer hardware. FIG. 10 is a block diagram showing the internal configuration of the computer system 200.

  Referring to FIG. 10, a computer system 200 includes a computer 220 having an optical disk drive 201 and a magnetic disk drive 202, a monitor 203, and a remote controller (hereinafter referred to as “remote controller”) 204.

  In addition to the optical disk drive 201 and the magnetic disk drive 202, the computer 220 includes a remote control interface (I / F) 205 that receives a signal from the remote control 204, a CPU (central processing unit) 206, a remote control interface 205, a CPU 206, and an optical disk. A bus 207 connected to the drive 201 and the magnetic disk drive 202, a read-only memory (ROM) 208 connected to the bus 207 and storing a boot-up program and the like, and also connected to the bus 207, program instructions, system programs, And a random access memory (RAM) 209 for storing work data and the like.

  Although not shown here, the computer 220 may further include a network adapter board that provides a connection to a local area network (LAN).

  A program for causing the computer system 200 to realize the functions of the image processing apparatus 20, the digital content 50, and the image data 60 are all stored in the optical disk 210 or the magnetic disk 211 inserted into the optical disk drive 201 or the magnetic disk drive 202. And further transferred to the hard disk 212. Alternatively, the program, the digital content 50, and the image data 60 may be transmitted to the computer 220 through a network (not shown) and stored in the hard disk 212. The program is loaded into the RAM 209 when executed. The program may be loaded directly into the RAM 209 from the optical disk 210, from the magnetic disk 211, or via a network.

  This program includes a plurality of instructions for causing the computer 220 to realize the functions of the image processing apparatus 20 according to the present embodiment. Some of the basic functions necessary to realize these functions are provided by an operating system (OS) or a third-party program running on the computer 220 or various toolkit modules installed on the computer 220. Therefore, this program does not necessarily include all functions necessary to realize the functions of the image processing apparatus 20 according to this embodiment. This program may include only instructions for executing the control of the image processing apparatus 20 described above by calling an appropriate function or “tool” in a controlled manner so as to obtain a desired result. That's fine. The operation of computer system 200 is well known and will not be repeated here.

  A recording medium on which the program for realizing the functions of the image processing apparatus 20, the digital content 50, and the image data 60 are recorded is a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical Disk), an MD. It is not limited to the optical disk 210 such as (Mini Disc) and DVD (Digital Versatile Disk), and the magnetic disk 211 such as FD (Floppy (registered trademark) Disk) and hard disk.

  Alternatively, tapes such as magnetic tapes and cassette tapes, card-type recording media such as IC cards and optical cards, mask ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash ROM, etc. Any of these semiconductor memories may be used. However, the computer system 200 requires a reading device for reading from these recording media.

  The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  Note that the video data output to the external device and the display device may be different.

  Since the present invention generates and outputs an image that is smoothly connected to an image to be output after the completion of decoding and has a less uncomfortable feeling, the user can reduce the time required for processing such as decoding of digital content data that occurs at the time of channel switching or the like. Since the psychological burden to be felt can be reduced, the present invention can be applied to uses such as a decoding device for decoding digital contents and a digital broadcast receiving terminal device for watching digital broadcasting.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram illustrating a configuration of a main part of a broadcasting system that provides an embodiment of the present invention and provides digital content by user operation. It is a block diagram which shows the principal part structure of the image processing apparatus in the receiver in said broadcast system. It is a block diagram which shows the principal part structure of the effect addition process part in said image processing apparatus. It is the schematic which shows the mode of each image data at the time of encoding and decoding the digital content in said image processing apparatus. It is a flowchart which shows the flow of each process S101-S107 in said image processing apparatus. It is a flowchart which shows the resolution adjustment process performed by S103 in FIG. It is a flowchart which shows the brightness adjustment process performed by S104 in FIG. It is a flowchart which shows the saturation adjustment process performed by S105 in FIG. It is a flowchart which shows the blurring degree adjustment process performed by S106 in FIG. It is a block diagram which shows an internal structure in the case of implement | achieving said receiving apparatus and broadcast system with a computer system. It is the schematic which shows a mode at the time of encoding digital content and decoding the encoded digital content.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Broadcasting system 10 Receiving device 12 Content receiving part (receiving means)
14 Channel switching unit 16 Content display processing unit (output means)
20 Image processing device 22 Input unit (input means)
24 content storage unit 26 decoding processing unit (reproducing means)
28 Image data storage (extraction means)
30 Effect addition processing part (addition means)
31 Resolution adjustment processing unit 32 Image data processing unit 33 Brightness adjustment processing unit 34 Image data processing unit 35 Saturation adjustment processing unit 36 Image data processing unit 37 Blurness adjustment processing unit 38 Image data processing unit 39 Image data combination processing unit 40 Image Data output processor (output control means)
42 Digital content providing server (transmitting device)
44 External device 46 Display device 48 User 50 Digital content 60 Image data 200 Computer system 201 Optical disk drive 202 Magnetic disk drive 203 Monitor 204 Remote controller 204 Remote controller 205 Remote control interface 206 CPU
207 Bus 208 Read only memory 209 RAM
209 Random access memory 210 Optical disk 211 Magnetic disk 212 Hard disk 220 Computer

Claims (14)

An input means for inputting digital content data composed of a plurality of image data created by encoding a video composed of a plurality of images, and the digital content data received from the input means are decoded into reproduced images. In an image processing apparatus comprising: a reproducing unit that outputs; and an output unit that rearranges the plurality of decoded reproduced images and outputs the rearranged images.
Extraction means for extracting a reproduced image that is not output immediately upon decoding as a preceding image;
An adding means for generating an additional image by adding an effect to the preceding image;
When the digital content data is input, the output means is controlled to output the additional image during a period from when the preceding image is decoded to when the decoded plurality of reproduced images are rearranged and output as video. And an output control means for
An image processing apparatus, wherein when the digital content data input to the input means is changed, a reproduced image that is decoded first is extracted as the preceding image.   The image processing apparatus according to claim 1, wherein the preceding image is intra-encoded image data that intra-encodes all pixels in the screen.   When the digital content data input to the input unit is changed, the output control unit uses the preceding image as a first reproduced image to be output and rearranges the period until the reproduced image is output, The image processing apparatus according to claim 1, wherein the output unit is controlled to output the additional image. An input means for inputting digital content data composed of a plurality of image data created by encoding a video composed of a plurality of images, and the digital content data received from the input means are decoded into reproduced images. In an image processing apparatus comprising: a reproducing unit that outputs; and an output unit that rearranges the plurality of decoded reproduced images and outputs the rearranged images.
When the digital content data input to the input means is changed, an incomplete reproduced image is converted from an image data that cannot be completely decoded but can be partially decoded. Extraction means for extracting as:
An adding means for generating an additional image by adding an effect to the preceding image;
When the digital content data is input, the output means is controlled to output the additional image during a period from when the preceding image is decoded to when the decoded plurality of reproduced images are rearranged and output as video. And an output control means.   5. The image processing apparatus according to claim 1, wherein the preceding image is inter-frame forward prediction image data including intra-coded data in pixels in a screen.   5. The image processing apparatus according to claim 1, wherein the preceding image is bi-directional predictive encoded image data including intra-encoded data in pixels in a screen. The adding means generates one or more additional images by adding an effect of changing a parameter of the preceding image,
The image processing apparatus according to claim 1, wherein the output control unit performs control so that the additional image is output in an order in which the degree of approximation with the preceding image increases.   The image processing apparatus according to claim 7, wherein the effect is an effect of changing at least one parameter among resolution, brightness, saturation, and blur.   9. The image processing apparatus according to claim 1, further comprising: a receiving unit that receives digital content data based on a user instruction and inputs the received digital content data to the input unit. A receiving device.   A broadcasting system comprising: the receiving device according to claim 9; and a transmitting device that transmits digital content data to the receiving device. A step of inputting digital content data composed of a plurality of image data created by encoding a video composed of a plurality of images; a step of decoding the input digital content data into a reproduced image; and a decoding An image processing method comprising: rearranging a plurality of the reproduced images and outputting as a video image,
Extracting a reproduced image that is not output immediately upon decoding as a preceding image;
Adding an effect to the preceding image to generate an additional image;
When the digital content data is input, controlling to output the additional image during a period from when the preceding image is decoded until a plurality of decoded playback images are rearranged and output as video. In addition,
An image processing method, wherein when the digital content data input in the input step is changed, a reproduced image that is decoded first is extracted as the preceding image. A step for inputting digital content data composed of a plurality of image data created by encoding a video composed of a plurality of images, and a step of decoding the input digital content data into a reproduced image; An image processing method comprising a step of rearranging a plurality of decoded reproduced images and outputting as a video,
A step of extracting an incomplete reproduced image as a preceding image from image data in which complete video cannot be decoded but part of the complete video can be decoded when the input digital content data is changed When,
Adding an effect to the preceding image to generate an additional image;
When the digital content data is input, controlling to output the additional image during a period from when the preceding image is decoded until a plurality of decoded playback images are rearranged and output as video. An image processing method further comprising:   An image processing program for causing a computer to function as each unit of the image processing apparatus according to claim 1.   A computer-readable recording medium on which the image processing program according to claim 13 is recorded.

Images