JP2012019386A - Reproduction device, reproduction method, and program - Google Patents

Abstract

A user can recognize a 3D image without an uncomfortable feeling during a jump operation during playback of 3D content.
A playback device plays back 3D content recorded on an optical disc. When a jump operation is performed on the 3D image of the 3D content being played, the playback device 1 displays the 2D image of the 3D content on the main screen having a predetermined size in the display screen, and displays the 3D image of the 3D content. It is displayed on a sub-screen having a size smaller than a predetermined size in the display screen. The present invention can be applied to a playback device that plays back 3D content recorded on an optical disc such as a BD-ROM.
[Selection] Figure 1

Description

  The present invention relates to a playback device, a playback method, and a program, and in particular, a playback device, a playback method, and a method that allow a user to recognize a 3D image without discomfort during a jump operation during playback of 3D content. Regarding the program.

  In recent years, 3D movies that can perceive video in three dimensions have become a hot topic. In addition, sales of television receivers capable of viewing in 3D have begun, and viewing in 3D has begun to become full-scale.

  When the playback device plays back 3D content, during fast forward or fast return, only one of the left eye image or the right eye image is displayed and displayed as a 2D image.

  On the other hand, in the conventional switching from the 2D display to the 3D display, there is one in which the parallax amount is gradually increased so that the switching to the 3D display can be performed without a sense of incongruity (for example, see Patent Document 1).

Japanese Patent Laid-Open No. 2004-328566

  As described above, only the 2D image is displayed during fast forward and fast return. Therefore, the 3D image cannot be recognized. Therefore, for example, by searching for a position where the user can fully enjoy the 3D image while fast-forwarding and fast-returning and switching to normal playback, the user cannot view the 3D image from that position.

  On the other hand, when only a 3D image is displayed during fast-forwarding or fast-returning, it is difficult for the user to cope with the change in the amount of parallax, and it is uncomfortable.

  The present invention has been made in view of such a situation, and enables a user to recognize a 3D image without an uncomfortable feeling during a jump operation during playback of 3D content.

  A playback apparatus according to an aspect of the present invention includes a playback unit that plays back 3D content recorded on a content recording medium, and a jump operation performed on the 3D image of the 3D content being played back by the playback unit. Display control means for displaying a 2D image of the 3D content on a main screen of a predetermined size in a display screen and displaying a 3D image of the 3D content on a sub-screen of a size smaller than the predetermined size in the display screen With.

  In the playback method according to one aspect of the present invention, when a playback device that plays back 3D content recorded on a content recording medium performs a jump operation on a 3D image of the 3D content being played back, the 3D content The 2D image is displayed on a main screen having a predetermined size in the display screen, and the 3D image of the 3D content is displayed on the sub-screen having a size smaller than the predetermined size in the display screen.

  According to the program of one aspect of the present invention, a computer performs a jump operation on a playback unit that plays back 3D content recorded on a content recording medium, and a 3D image of the 3D content being played back by the playback unit. In such a case, the 2D image of the 3D content is displayed on the main screen having a predetermined size in the display screen, and the 3D image of the 3D content is displayed on the child screen having a size smaller than the predetermined size in the display screen. It is for functioning as a control means.

  In one aspect of the present invention, when a jump operation is performed on a 3D image of the 3D content being played back, the 2D image of the 3D content is displayed on a master screen of a predetermined size in a display screen, A 3D image of the 3D content is displayed on a small screen having a size smaller than the predetermined size in the display screen.

  The playback device may be an independent device, or may be an internal block constituting one device.

  According to one aspect of the present invention, a user can recognize a 3D image without discomfort during a jump operation during playback of 3D content.

It is a block diagram which shows the structural example of one Embodiment of the reproducing | regenerating apparatus to which this invention is applied. 3 is a flowchart for explaining a reproduction process by the reproduction apparatus of FIG. 1. It is a figure which shows the content of the data recorded as an index file. It is a figure which shows the example of the image displayed. It is a block diagram which shows the structural example of one Embodiment of the computer to which this invention is applied.

[Configuration example of a playback apparatus to which the present invention is applied]
FIG. 1 shows a configuration example of an embodiment of a playback apparatus to which the present invention is applied.

  The playback device 1 is a device that plays back 3D content recorded on an optical disc 2 as a content recording medium and displays a 3D image of the 3D content on an external display 3. Here, to reproduce the content recorded on the optical disc 2 is to reproduce the data of the content (content data), but in this specification, it is expressed to reproduce the content as appropriate. Of course, the playback device 1 can also play back 2D content when 2D content is recorded on the optical disc 2. The 2D content (the 2D image thereof) is a conventional image, and the images corresponding to the right eye and the left eye are the same, and the 3D content (the 3D image thereof) has different images corresponding to the right eye and the left eye. Thus, the image is perceived in three dimensions by the parallax provided between the right-eye image and the left-eye image. In FIG. 1, the solid line indicates the flow of content data, and the dotted line indicates the flow of control signals.

  In the present embodiment, it is assumed that the optical disc 2 played back by the playback device 1 is, for example, a BD-ROM. The optical disc 2 may be a DVD (Digital Versatile Disc) or Blu-ray (registered trademark) Disc other than the BD-ROM. Further, the playback device 1 may play back 3D content recorded on a semiconductor memory such as a flash memory other than the optical disk 2, a hard disk, or the like. That is, the type of content recording medium is not particularly limited.

  The optical disc drive 11 drives the optical disc 2 under the control of the controller 27. The stream supply unit 12 reads an AV stream of 3D content as a recording signal recorded on the optical disc 2 driven by the optical disc drive 11 and supplies the AV stream to the buffer memory 14.

  The tuner 13 receives a broadcast wave signal in a frequency band of a predetermined channel determined by the control of the controller 27 via an antenna (not shown), and supplies an AV stream of 3D content obtained as a result to the buffer memory 14. . The buffer memory 14 holds the AV stream of the 3D content for a predetermined time and supplies it to the Demux processing unit 15.

  The Demux processing unit 15 extracts packets such as video data, audio data, and caption data based on the PID (packet ID) of the AV stream supplied from the buffer memory 14. The PID is a unique ID for each type of data constituting the packet, and is added to the packet.

  Then, the Demux processing unit 15 supplies the extracted video data (video ES) to the video ES buffer 16 and supplies the extracted audio data (audio ES) to the audio ES buffer 19. ES represents an elementary stream.

  The video ES buffer 16 holds the video data supplied from the Demux processing unit 15 for a predetermined time and supplies it to the video decoding unit 17. The video decoding unit 17 decodes video data encoded by a predetermined encoding method such as MPEG2 (Moving Picture Experts Group phase 2), MPEG4, AVC (Advanced Video Coding), etc. Hereinafter, image data of an L image) and an image for the right eye (hereinafter referred to as an R image) are generated. The video buffer 18 holds the image data of the L image and the R image obtained by decoding for a predetermined time and supplies them to the image processing unit 24.

  In order to be able to save the image data of 3D content with a reduced data capacity, for example, encoding by H.264 AVC (Advanced Video Coding) / MVC (Multi-view Video coding) is performed, Compressed and recorded.

  In H.264 AVC / MVC, a video stream called Base view video and a video stream called Dependent view video are defined. Hereinafter, H.264 AVC / MVC is simply referred to as MVC as appropriate.

  MVC performs encoding using not only prediction between images in the time direction but also prediction between streams (views).

  In other words, in MVC, Base view video is not allowed to use predictive coding with another stream as a reference video, but Dependent view video is allowed to use predictive coding with Base view video as a reference video. ing. Therefore, as the image data of the 3D content, for example, encoding is performed in which the L image is Base view video and the R image is Dependent view video. In this case, since predictive encoding is performed on the R image based on the L image, the data amount of the Dependent view video stream can be reduced compared to the data amount of the Base view video stream.

  In addition, since it is the encoding by H.264 / AVC, the prediction of the time direction is performed about Base view video. Also, with regard to the Dependent view video, prediction in the time direction is performed together with prediction between views. In order to decode the Dependent view video, it is necessary that decoding of the corresponding Base view video, which is a reference destination at the time of encoding, has been finished first.

  The image data of the 3D content may be recorded on the optical disc 2 as MPEG-TS in which L image data and R image data are different from each other, or may be recorded as one MPEG-TS.

  The audio ES buffer 19 holds the audio data supplied from the Demux processing unit 15 for a predetermined time and supplies it to the audio decoding unit 20. The audio decoding unit 20 generates audio data by decoding audio data encoded by a predetermined encoding method such as MPEG. The audio buffer 21 holds the audio data obtained by decoding for a predetermined time and supplies it to the AV synchronization unit 25.

  The OSD drawing unit 22 generates an OSD (On Screen Display) screen to be displayed by being superimposed on the 3D image of the 3D content under the control of the controller 27 and supplies the generated OSD (On Screen Display) screen to the OSD buffer 23. For example, the OSD drawing unit 22 generates an OSD screen that displays a channel number and a volume, an OSD screen that displays a playback time, a current playback position in the entire 3D content, and the like. The OSD buffer 23 holds the OSD screen (image data) generated by the OSD drawing unit 22 for a predetermined time and supplies it to the image processing unit 24.

  The image processing unit 24 acquires image data held in the video buffer 18 and the OSD buffer 23 under the control of the controller 27, executes predetermined processing as necessary, and supplies the image data to the AV synchronization unit 25. . The processing executed by the image processing unit 24 includes, for example, 3D image 3D content and OSD screen composition processing, 2D image or 3D image size conversion processing, and the like.

  The AV synchronization unit 25 synchronizes the image data supplied from the image processing unit 24 and the audio data supplied from the audio buffer 21 in accordance with PTS, and supplies them to the output unit 26. PTS (Presentation Time Stamp) is time information for reproduction.

  The output unit 26 includes a D / A converter, and outputs the image data and audio data supplied from the AV synchronization unit 25 to the display 3 as analog or digital AV signals. The output unit 26 has, for example, an HDMI output terminal that outputs an AV signal as an HDMI (High-Definition Multimedia Interface) signal, an output terminal that outputs an AV signal as a component signal, and the like as output terminals.

  The display 3 connected to the output unit 26 is, for example, a television receiver configured with a PDP (Plasma Display Panel) display or a liquid crystal display. In the reproduction of 3D content, the L image and the R image are alternately displayed on the display 3. A viewer (user) wears stereoscopic glasses and views a 3D image of 3D content. The stereoscopic glasses have, for example, a shutter function that opens and closes alternately left and right, and the left and right eye shutters alternately open and close in synchronization with the L image and the R image displayed on the display 3. . The L image and the R image are provided with parallax, and the viewer can view the image displayed on the display 3 in three dimensions by viewing the corresponding L image and R image independently for each of the right eye and the left eye. Can be perceived.

  The controller 27 controls the reproduction image to be displayed on the display 3 by controlling the reproduction operation of the reproduction apparatus 1 in accordance with an operation command from the operation unit 28 or the light receiving unit 29 according to a control program recorded in a memory (not shown). To do.

  The operation unit 28 includes, for example, a reproduction button for executing reproduction, a stop button for stopping reproduction, and the like. The operation unit 28 accepts a user operation and supplies an operation signal corresponding to the accepted operation to the controller 27. The light receiving unit 29 receives an operation signal supplied from the remote controller 30 attached to the reproducing apparatus 1 by an infrared signal or the like, and supplies the operation signal to the controller 27.

  The remote controller 30 transmits an operation signal corresponding to the operation button operated by the user to the light receiving unit 29 of the reproduction apparatus 1 main body by wireless communication such as an infrared signal.

  The remote controller 30 includes, for example, a play button, a stop button, an FF (fast forward) button, an FR (fast reverse) button, a next button, a prev button, and a flash + button as operation buttons related to 3D content playback. , Flash-buttons, etc.

  The FF (fast forward) button, FR (fast reverse) button, Next (next) button, Prev button, Flash + button, and Flash- button all jump to a predetermined number of images ahead or behind from the current point. This is a button for performing a jump operation to be displayed.

  The Next button is a button for moving the playback position to the start position of the chapter next to the chapter currently being played back. The Prev button is a button for moving the playback position to the start position of the chapter currently being played or the start position of the previous chapter. The Flash + button is a button for moving the playback position to a position ahead of a preset number of seconds (for example, 15 seconds) from the current playback position. The Flash-button is a button for moving the playback position to a position that is a predetermined number of seconds (for example, 10 seconds) before the current playback position. The FF (fast forward) button and the FR (fast reverse) button are buttons for changing the playback position (playback image) while being operated (pressed). On the other hand, the Next button, the Prev button, the Flash + button, and the Flash- button are buttons for designating a predetermined playback position (time) of the playback content and moving it to that time. Hereinafter, the Next button, the Prev button, the Flash + button, and the Flash- button are collectively referred to as a Jump key.

  The playback device 1 is configured as described above.

[Reproduction process of reproduction apparatus 1]
In the playback device 1 of FIG. 1, when an image (scene) changes greatly by operating (pressing) the FF button, FR button, or Jump key during playback of 3D content, the 3D content is displayed as a 2D image on the parent screen. It can be displayed and displayed on a small screen as a 3D image. Note that the parent screen is a screen having a predetermined size in the display screen, and the child screen is a screen having a size smaller than the parent screen in the display screen.

  As described above, in the playback device 1, when the FF button, the FR button, and the Jump key are operated during playback of 3D content, the 3D image is displayed together with the 2D image of the 3D content, so that the user recognizes the 3D image. can do. Further, in the playback device 1, since the 3D image of the 3D content is displayed on a small child screen compared to the parent screen, the amount of parallax of the 3D image is smaller than when the 3D image is displayed on the parent screen. , User discomfort is reduced.

  Therefore, referring to the flowchart of FIG. 2, a playback device including processing when an image (scene) changes greatly by operating (pressing) the FF button, FR button, and Jump key during playback of 3D content. 1 will be described. This reproduction process is started, for example, when a BD-ROM as the optical disk 2 is loaded in the optical disk drive 11 or when a reproduction button is operated.

  First, in step S1, the controller 27 of the playback device 1 reads an index file recorded on the BD-ROM. In step S2, the playback apparatus 1 determines whether the content recorded on the optical disc 2 is 3D content by acquiring information described at a predetermined position in the index file.

  FIG. 3 shows the contents of data recorded as an index file.

  In the BD-ROM, a BDMV directory exists under a root directory, and an index file (index.bdmv file) is placed therein.

  FIG. 3A shows the data structure of the index file.

  In the index file, AppinfoBDMV () in which information about content is recorded is arranged. The data structure of AppinfoBDMV () is shown in FIG. 3B.

  AppinfoBDMV () describes a flag of an item SS_content_exist_flag. When this flag is “1”, it indicates that the content recorded on the BD-ROM is 3D content. The controller 27 checks the SS_content_exist_flag flag to determine whether the content recorded on the optical disc 2 is 3D content. In addition, AppinfoBDMV () records information about the video format (video_format), information about the frame rate (frame_rate), and the like.

  Returning to FIG. 2, when it is determined in step S2 that the content recorded on the optical disc 2 is not 3D content, the process proceeds to step S3, and the playback device 1 plays back 2D content (2D playback). . The process ends when all the recorded 2D content playback ends or when the stop button is operated.

  On the other hand, if it is determined in step S2 that the content recorded on the optical disc 2 is 3D content, the process proceeds to step S4, and the playback device 1 plays back 3D content (3D playback).

  Here, the flow of content data in normal 3D playback will be briefly described.

  The AV stream read from the optical disc 2 is supplied to the Demux processing unit 15 via the buffer memory 14. The AV stream is separated into a video ES and an audio ES by the Demux processing unit 15, and the video ES is supplied to the video decoding unit 17 via the video ES buffer 16. The audio ES is supplied to the audio decoding unit 20 via the audio ES buffer 19. In the video decoding unit 17, the video ES is decoded, and image data of L image and R image is generated. The image data of the L image and the R image is temporarily stored in the video buffer 18. The image processing unit 24 generates L image data and R image data of the size of the parent screen from the L image and R image image data held in the video buffer 18. Also, the audio decoding unit 20 decodes the audio ES and generates audio data. The image data and audio data of the main screen size L image and R image are output at a predetermined timing according to the PTS by the AV synchronization unit 25, and the display 3 displays the L image and the R image and outputs the sound. Is done.

  After the 3D content playback is started, in step S5, the controller 27 determines whether the FF button, the FR button, or the Jump key is operated (pressed). If it is determined in step S5 that none of the FF button, FR button, and Jump key has been operated, the process returns to step S4. That is, when none of the FF button, FR button, and Jump key is operated, normal 3D playback is continuously executed.

  On the other hand, if it is determined in step S5 that the FF button, FR button, or Jump key has been operated, in step S6, the playback device 1 performs 2D3D playback from the current playback position of the 3D content.

  Here, the flow of content data in 2D3D playback will be briefly described.

  When the FF button, FR button, or Jump key is operated during playback of 3D content, the AV stream is intermittently read from the optical disc 2 under the control of the controller 27. The read AV stream is supplied to the Demux processing unit 15 via the buffer memory 14. The AV stream is separated into a video ES and an audio ES by the Demux processing unit 15, and the video ES is supplied to the video decoding unit 17 via the video ES buffer 16. The audio ES is supplied to the audio decoding unit 20 via the audio ES buffer 19. In the video decoding unit 17, the video ES is decoded, and image data of L image and R image is generated. The image data of the L image and the R image is temporarily stored in the video buffer 18. In the image processing unit 24, from the image data of the L image and the R image held in the video buffer 18, the image data of the small screen size L image and the R image (hereinafter referred to as the small screen data) and the size of the parent screen are displayed. One of the image data of the L image and the R image (hereinafter referred to as parent screen data) is generated. Also, the audio decoding unit 20 decodes the audio ES and generates audio data. The main screen data, the sub screen data, and the audio data are output at a predetermined timing in accordance with the PTS by the AV synchronization unit 25, and on the display 3, a 2D image is displayed on the main screen and a 3D image is displayed on the sub screen. The At the same time, sound is output.

  Then, the process proceeds to step S7, and it is determined by the controller 27 whether or not the playback button has been operated. If it is determined in step S7 that the playback button has been operated, the process returns to step S4, and 3D playback is resumed from the current playback position.

  On the other hand, if it is determined in step S7 that the playback button has not been operated, in step S8, the controller 27 determines whether or not to end playback. For example, the controller 27 determines that the reproduction is to be terminated when all the 3D content recorded on the optical disc 2 has been reproduced, or when the stop button is operated, and otherwise the reproduction is not terminated. Is determined. If it is determined in step S8 that the reproduction is to be terminated, the process is terminated.

  On the other hand, if it is determined in step S8 that the reproduction is not terminated, the process returns to step S6, and the processes in steps S6 to S8 are repeated until the reproduction button is operated or until it is determined that the reproduction is terminated. . That is, fast-forward or fast-rewind by 2D3D playback is continued until the playback button is operated or until it is determined that the playback is to end.

[Example of display image]
FIG. 4 is a diagram illustrating an example of an image displayed when the playback button is operated and an image displayed when the FF button, FR button, or Jump key is operated.

  As shown in FIG. 4A, when the playback button is operated, 3D playback is performed, and a 3D image 51A having the size of the parent screen 51 is displayed on the parent screen 51 in the display screen of the display 3.

  When the FF button, FR button, or Jump key is operated during 3D playback, 2D3D playback is performed from the playback position at that time as shown in FIG. A 2D image 52A having the size of the sub-screen 52 is displayed on the sub-screen 52. Since the size of the 3D image 52B is smaller than that of the 3D image 51A, the amount of parallax of the 3D image 52B is smaller than that of the 3D image 51A. Therefore, the user's discomfort due to fast-forwarding or fast-rewinding of the 3D image is reduced.

  When the playback button is operated again after the operation of the FF button, the FR button, or the Jump key, 3D playback is performed again from the playback position at that time, and as shown in FIG. 4A, the 3D image 51A is displayed on the main screen 51. Is displayed.

  As described above, in the playback apparatus 1, when the FF button, FR button, or Jump key is operated, the 3D image 52B is displayed on the sub-screen 52, so that the user can select the FF button, FR button, or Jump. A 3D image can be recognized even when a key is operated. In addition, the user can perform 3D playback from the playback position by operating the playback button again after operating the FF button, FR button, or Jump key.

  As a result, for example, while the user operates the FF button, the FR button, or the Jump key, the user searches for a position where the 3D image can be sufficiently enjoyed on the sub-screen 52, and operates the playback button to start the main screen 51 from that position. Can see 3D images.

[Computer configuration example]
The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software is installed in the computer. Here, the computer includes, for example, a general-purpose personal computer capable of executing various functions by installing various programs by installing a computer incorporated in dedicated hardware.

  FIG. 5 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processing by a program.

  In a computer, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103 are connected to each other via a bus 104.

  An input / output interface 105 is further connected to the bus 104. An input unit 106, an output unit 107, a storage unit 108, a communication unit 109, and a drive 110 are connected to the input / output interface 105.

  The input unit 106 includes a keyboard, a mouse, a microphone, and the like. The output unit 107 includes a display, a speaker, and the like. The storage unit 108 includes a hard disk, a nonvolatile memory, and the like. The communication unit 109 includes a network interface or the like. The drive 110 drives a removable recording medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

  The tuner 112 receives a broadcast wave signal in a predetermined frequency band corresponding to a predetermined broadcast station, and supplies the signal to the CPU 101 or the like via the input / output interface 105.

  In the computer configured as described above, the CPU 101 loads, for example, the program stored in the storage unit 108 to the RAM 103 via the input / output interface 105 and the bus 104 and executes the program. Is performed.

  The program executed by the computer (CPU 101) can be provided by being recorded on a removable recording medium 111 as a package medium, for example. The program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

  In the computer, the program can be installed in the storage unit 108 via the input / output interface 105 by attaching the removable recording medium 111 to the drive 110. Further, the program can be received by the communication unit 109 via a wired or wireless transmission medium and installed in the storage unit 108. In addition, the program can be installed in the ROM 102 or the storage unit 108 in advance.

  The program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.

  The embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

  1 playback device, 2 optical disc, 11 optical disc drive, 12 stream supply unit, 27 controller

Claims (5)

Playback means for playing back 3D content recorded on a content recording medium;
When a jump operation is performed on the 3D image of the 3D content being played back by the playback means, the 2D image of the 3D content is displayed on a main screen of a predetermined size in the display screen, and the 3D of the 3D content is displayed. A display device comprising: display control means for displaying an image on a child screen having a size smaller than the predetermined size in the display screen. The playback apparatus according to claim 1, wherein the display control unit displays a 3D image of the 3D content on the parent screen when a playback operation is performed after the interlace operation. The playback apparatus according to claim 1, wherein the interlace operation includes at least one of an operation of an FF button, an FR button, a Next button, a Prev button, a Flash + button, and a Flash- button. A playback device that plays back 3D content recorded on a content recording medium,
When a jump operation is performed on the 3D image of the 3D content being played back, the 2D image of the 3D content is displayed on a main screen of a predetermined size in a display screen, and the 3D image of the 3D content is displayed. A playback method including a step of displaying on a sub-screen having a size smaller than the predetermined size in the screen. Computer
Playback means for playing back 3D content recorded on a content recording medium;
When a jump operation is performed on the 3D image of the 3D content being played back by the playback means, the 2D image of the 3D content is displayed on a main screen of a predetermined size in the display screen, and the 3D of the 3D content is displayed. A program for causing an image to function as display control means for displaying an image on a sub-screen having a size smaller than the predetermined size in the display screen.

Images