CN102027749B

CN102027749B - Reproduction device, integrated circuit, reproduction method considering special reproduction

Info

Publication number: CN102027749B
Application number: CN200980117335.9A
Authority: CN
Inventors: 大久保雅文; 杰尔马诺·莱希森林
Original assignee: Matsushita Electric Industrial Co Ltd
Current assignee: Panasonic Holdings Corp
Priority date: 2008-11-18
Filing date: 2009-11-16
Publication date: 2014-02-19
Anticipated expiration: 2029-11-16
Also published as: KR20110095128A; WO2010058547A1; EP2348747A4; US8548308B2; US20100150523A1; JPWO2010058547A1; JP5632291B2; CN102027749A; EP2348747A1

Abstract

The present invention provides a playback device, an integrated circuit, and a playback method in consideration of special playback. A reading unit (201) reads a digital stream including a left-eye video stream and a right-eye video stream from a recording medium. A mode storage unit (203) stores, as a playback mode of the device, one of a 3D mode for enabling a user to see video frames stereoscopically, and a 2D mode for enabling the user to see two-dimensionally of video frames. The dimensionality judging unit (202) judges whether the digital stream read from the recording medium supports the 3D mode; the splitter (204) converts the digital stream from the The digital stream is separated into a right-eye video stream and a left-eye video stream, and when the above condition is not satisfied, either the right-eye video stream or the left-eye video stream is separated from the digital stream.

Description

The transcriber of considering specialized reproduction, integrated circuit, reproducting method

Technical field

The present invention relates to the technical field of the superimposing technique of stereoscopic vision video and captions and figure.

Background technology

Above-mentioned superimposing technique is that to instigate transcriber be video flowing, captions, figure and have respectively different display planes, overlapping text and figure in each frame of video of the video flowing of high picture element, and output to the technology of the equipment such as display unit that are connected, just extensively universal as the technology that realizes high telepresenc.

In the display device as connecting object, can not only appreciate flat image and also can appreciate protrude like the stereoscopic vision display unit of image estimate can popularize in the near future.In stereoscopic vision display unit, there are various modes, basic principle is to make left eye and right eye watch the mechanism of different pictures by importing, utilizes the parallax between these two, comes artificially generated terrain to become stereopsis.

For example, one of usual way is the mode of utilizing shutter glasses.In which, by the visual field of coming with glasses alternately to cover spectators' left eye and right eye at a high speed, synchronize with the work of these glasses, the demonstration image of display unit is also used for upgrading at a high speed with/right eye by left eye, result is to realize following mechanism: the image that the left eye that shutter glasses makes to show in display unit is used can only be seen by left eye, and the image that right eye is used can only be seen by right eye.

If want to make spectators to watch so that by the image of three-dimensional, display apparatus side needs 2 times to common response performance with the equal frame per second of common plane image, for example, in order to show the video of one second 60 frame, minimumly must carry out the switching of 1 second 120 frame.Therefore, the video flowing of demonstration must be encoded with the state of 1 second 120 frame, in order to obtain stereoeffect with improving frame per second method in addition, also has the method for encoding by (side-by-side) mode arranged side by side as non-patent literature 1.

In addition, also there is the mode of using checkerboard pattern (checkered pattern) as patent documentation 2.

Moreover, in the situation that to being undertaken by the image of three-dimensional in the Display Technique of special reproduction, have as patent documentation 3 in the situation that suspended while reproducing by the image of three-dimensional and also can continue to appreciate the technology of stereopsis.

In the technology showing at overlapping a plurality of layers, have as patent documentation 4 in the situation that many picture displies have surpassed under the state of frame numbers of regulation and carry out GFX drafting, control, make the technology of carrying out frame-skipping to being judged as more than at least 1 input image of the input image that priority is low during GFX draws.

Prior art document

Patent documentation

Patent documentation 1: No. 2005/119675 brochure of International Publication

Patent documentation 2: No. 2008/0036854 specification of U.S. Patent Application Publication

Patent documentation 3: TOHKEMY 2002-95017

Patent documentation 4: TOHKEMY 2003-298938

Non-patent literature

Non-patent literature 1:FOUNDATIONS OF THE STEREOSCOPIC CINEMA A STUDY IN DEPTH (by LENNY LIPTON)

Yet at present the three-dimensional mode of appreciating digital stream is mainly used in arenas etc., as described in above-mentioned patent documentation, the transcriber that use is set by family reproduces the type of service that stereoscopic vision digital stream appreciates to be estimated also can popularize from now on.

And in order to form the stereopsis of 3D, certainly need to make digital stream support 3D.

Yet, even if digital stream is supported 3D, the in the situation that digital stream not being supported 3D in transcriber, can not form the stereopsis of 3D.In addition,, even if digital stream is supported 3D, user also wants to reproduce digital stream with 2D sometimes.

That is, if only support that with digital stream 2D still supports 3D, decide transcriber with 3D, reproduce or reproduce digital stream with 2D, imappropriate sometimes.

Summary of the invention

The object of the present invention is to provide a kind of transcriber, the in the situation that of supporting that whether in 3D this point, digital stream is different with transcriber, also can realize suitable stream and reproduce.

The transcriber that can solve above-mentioned problem can be switched to display mode the 3D pattern of the stereoscopic vision that makes user realize frame of video and make user realize any in the 2D pattern of plane visual of frame of video, it is characterized in that, comprising:

Read-out element, reads and comprises left eye video flowing and the right eye digital stream of video flowing from recording medium;

Pattern storage portion, is storing current display mode;

Dimension judging part, whether the digital stream that judgement is read from recording medium supports 3D pattern;

Separator, in the situation that above-mentioned digital stream supports that 3D pattern and current display mode are this condition establishment of 3D pattern, from above-mentioned digital stream, isolate video flowing and left eye video flowing for right eye, and in the invalid situation of above-mentioned condition, from above-mentioned digital stream, isolate video flowing and the left eye one party video flowing for right eye;

Video Decoder, by above-mentioned isolated video flowing is decoded, obtains the frame of video for stereoscopic vision or plane visual;

Video plane, writes the frame of video being obtained by above-mentioned Video Decoder; And

Reproduction control portion, while having asked special reproduction in the situation that current reproduction mode is 3D pattern, carry out following processing, this processing will repeat output by frame of video from above-mentioned video plane with frame of video and left eye as right eye by the frame of video that the video flowing of the side video flowing obtains with video flowing and left eye from above-mentioned right eye.

Invention effect is as follows:

Transcriber carries out two judgements as constructed as above: judgement digital stream supports that 2D still supports 3D, judgement transcriber is set to reproduce or be set to 2D reproduce with 3D, finally by determining that reproducing digital stream with 2D still reproduces digital stream with 3D, can suitably form stereopsis.

In the situation that want to reproduce stereoscopic vision video flowing with the transcriber of family expenses, the special reproduction such as certainly likely carry out F.F., retreat.But, for artificially generated terrain becomes stereopsis, need to decode respectively to the video flowing of left eye and right eye, alternately switch and export them, to compare with the plane treatment of carrying out the processing of flatness, treating capacity increases.Therefore, in the situation that carry out special reproduction with the transcriber that reproduces stereoscopic vision video flowing, the three-dimensional reproduction speed of processing in the situation that does not likely catch up with special reproduction.

In order to solve this problem, preferably form as follows above-mentioned transcriber.

That is, best above-mentioned transcriber comprises: reproduction control portion, while having asked special reproduction in the situation that current display mode is 3D pattern, display mode is maintained to 3D pattern, and make Video Decoder carry out the processing of 2 same frame of video of above output of repetition;

As the frame of video that repeats object output, be the frame of video obtaining decoding by the one party video flowing with video flowing and left eye from the isolated right eye of digital stream, the frame of video that repeats output is written to respectively to video plane for right eye, left eye with on video plane.Even if this transcriber in the situation that carry out special reproduction with the transcriber that reproduces stereoscopic vision video flowing, also can prevent the three-dimensional reproduction speed of processing in the situation that does not catch up with special reproduction.

The in the situation that of 3D display of video streams, be shown to nearside or be shown to these two kinds of patterns of distally.In the situation that video flowing is presented at nearside by 3D, if the graphical stream of synthetic 2D, graphical stream can be can't see, and is a problem.

Therefore,, by graphical stream also can be shown with 3D, can eliminate the problems referred to above.

In addition, if graphical stream also can show by 3D also have user can appreciate this effect of various stereopsis.

In the situation that display mode by from 3D is altered to 2D in the situation that or display mode from 3D, be altered to 2D, transcriber notice display unit has been switched display mode.Notified display unit is actual have been completed after the preparation that can show with the pattern after switching, and notice transcriber has completed the preparation that can show with the pattern after switching.Having switched display mode from notice display unit, to display unit notice transcriber, completed the preparation that can show with the pattern switching during, become can be written in plane, but the state not being shown in display unit (disappears, blackout).Therefore, during this period, the content being written in plane can not be shown in display unit.

On the other hand, application program is such as can be by providing the game etc. of the image of the positive that has utilized film to make the program of consumer entertainment.Game etc. in, also have the situation of for example reproducing animation according to the image of positive, sound.That is, draw forming the application program of the graph image of animation need to be with the image of positive--video flowing be synchronizeed graph image is plotted in interactive graphics plane.

As known from the above, having switched display mode from application notification display unit, to display unit notice transcriber, completed the preparation that can show with the pattern switching during, sometimes also can process to writing the drafting that graph image carries out graph image in interactive graphics plane.

In this case, application program can not make graphical stream and video flowing synchronous.

When solving this problem, preferably form as follows above-mentioned transcriber.That is, above-mentioned transcriber comprises:

Platform part, carries out bytecode application; With

Transmission part, by the display unit transmission of video frame to being connected with transcriber, and makes display unit carry out the output of frame of video;

In the situation that the display mode of storing in above-mentioned pattern storage portion is switched to 3D pattern from 2D pattern, or is switched to the situation of 2D pattern from 3D pattern, transmission part carries out the authentication again of display unit;

After above-mentioned authentication again, receive can carry out with switch after the situation of notice of the meaning of the corresponding output of pattern under, the bytecode applicative notifications that should carry out above-mentioned platform part can carry out with above-mentioned switching after the meaning of the corresponding output of pattern.

In order to make having switched display mode from notice display unit, to display unit notice transcriber, completed the preparation that can show with the pattern switching during, application program is not processed to writing graph image in interactive graphics plane, can set up the mechanism that display unit notification application has completed the preparation that can show with the pattern after switching.Thus, can make the application program can be with video flowing synchronously to graphing image in interactive graphics plane.

Accompanying drawing explanation

Fig. 1 is the cut-away view that possesses the application's problem solution transcribers parts, the most basic.

Fig. 2 is the flow chart that possesses the application's problem solution reproducting methods parts, the most basic.

Fig. 3 is the use aspect graph when transcriber that possesses the application's problem solution parts is used as to concrete electric equipment products.

Fig. 4 is the cut-away view of BD-ROM100.

Fig. 5 is the detail drawing of the internal structure of " reproduction attribute information " in the internal structure of play list file, " rendering data information ".

Fig. 6 illustrates the specific descriptions of the play list file of regulation 2D playlist.

Fig. 7 illustrates an example of the play list file of regulation 3D playlist.

Fig. 8 is the structure chart of the internal structure of the problem that the possesses the application transcriber that solves parts.

Fig. 9 is the schematic diagram of example of the content of register group 12.

Figure 10 is the figure that has synthesized the frame of video of the plane of delineation that carried out planar movement.

Figure 11 illustrates by watch the plane of delineation after planar movement left and the plane of delineation after planar movement occurs stereo-picture to the right with liquid crystal glasses 500.

Figure 12 is that transcriber 200 reads in above-mentioned image data--the flow chart of playlist the processing procedure while showing three-dimensional captions/solid figure overlapping on stereopsis.

Figure 13 is the flow chart of the processing procedure of the frame of video processing under 3D pattern.

Figure 14 is the flow chart of the processing procedure of the playlist reproduction under 2D pattern.

Figure 15 is the flow chart of the processing procedure processed of the frame of video of 2D under 2D pattern stream.

Figure 16 is the flow chart of the processing procedure processed of the frame of video of 3D under 2D pattern stream.

Figure 17 is the flow chart of processing procedure that can support the playlist reproduction processes of many planes of delineation.

Figure 18 has added the flow chart that output display pattern has been switched the processing procedure that frame of video process, under 3D pattern of notification event processes.

Figure 19 has added the flow chart that output display pattern has been switched the processing procedure that frame of video process, under 2D pattern of notification event processes.

Figure 20 is the flow chart of the processing procedure processed of the frame of video outside common reproduction, under the 3D pattern of considering specialized reproduction.

Figure 21 shows and forbids according to user operation, from the indication of BD-J application program, movie objects, carries out an example of the flow chart in the situation of special reproduction.

Figure 22 is the block diagram of internal structure that has been suitable for the transcriber of Depth (degree of depth) compute mode.

Figure 23 is the flow chart of the processing procedure processed of the frame of video under the 3D pattern having adopted in the situation of Depth compute mode.

Figure 24 illustrates the communication sequence of transcriber 200 and display unit 400.

The flow chart of the processing procedure that Figure 25 is in HDMI interface, pattern is switched.

Figure 26 be in the situation that display mode manifests (presentation) pattern, B-B appearance mode, B-D appearance mode and shifts like that by B-D, the picture of output and the figure how display frequency, HDMI change.

Figure 27 illustrates owing to being switched to F.F. from common reproduction, being switched to common reproduction from F.F., and how the displaying contents of the decode content in transcriber and display unit 400 changes.

Which in I picture by selecting to exist in GOP, B picture, P picture Figure 28 illustrate and reproduce, select to form a plurality of Closed-GOP (closing GOP) of video flowing, which in Open-GOP (opening GOP) to reproduce, realize the realization that speed that speed adjusts reproduces routine.

Figure 29 illustrates the internal structure of separator and Video Decoder.

Figure 30 is the flow chart of the processing procedure of the special reproduction of considering that speed is reproduced.

Figure 31 is the flow chart of the processing procedure of the frame of video processing under 3D pattern.

Figure 32 is, the flow chart of the corresponding plane of delineation processing procedure of the request of movie objects with user's operation, the request of BD-J application program.

Figure 33 is the flow chart of the processing procedure of recording method.

Figure 34 is the cut-away view of the hardware of transcriber.

Figure 35 is in the symbol of the planar offset situation that is just (graph image that left eye is used is offset to the right, and the graph image that right eye is used is offset left), as the key diagram that seems the principle nearer than display frame.

Figure 36 is in the symbol of the planar offset situation for negative (graph image that left eye is used is offset left, and the graph image that right eye is used is offset to the right), as the key diagram of the principle that seems more farther than display frame.

Figure 37 is the figure how the protrusion degree of captions changes according to the size of planar offset.

Figure 38 illustrates the internal structure of the plane of delineation 8.

After Figure 39 illustrates and moves right, is moved to the left, the pixel data of foreground area and the pixel data of background area.

Figure 40 is the figure of the processing procedure of the planar movement on the plane of delineation 8.

Figure 41 is the figure of pixel data in store on graphics plane.

Figure 42 illustrates the preservation content of the graphics plane after moving.

Label declaration

100BD-ROM; 200 transcribers

300 remote controls; 400 TVs

500 liquid crystal glasses; 1a BD driver

The 1b network equipment; 1c local storage

2a, 2b read buffer; 3 Virtual File Systems

4 separators; 5 Video Decoders

6 video planes; 7a, b image decoder

7c, d video memory; 8 planes of delineation

9 audio decoders; 10 interactive graphics planes

11 background planes; 12 register groups

13 static scenario memories; 14 reproducing control engines

15 zooming engines; 16 synthetic portions

17HDMI transmission and reception unit; 18 Presentation Function sign maintaining parts

Storage part is processed in 19 left and right; 20 planar movement engines

21 offset information memories; 22BD-J platform

Embodiment

Below, with reference to accompanying drawing explanation, possesses the execution mode that above-mentioned problem solves the transcriber of parts.

Fig. 1 is the cut-away view that possesses the application's problem solution transcribers parts, the most basic.Transcriber shown in this figure, except above-mentioned problem solves parts, has been got rid of useless member as far as possible, read-out element 201, dimension judging part 202, pattern storage portion 203, separator (demultiplexer) 204, Video Decoder 205, consists of.

Fig. 2 is the flow chart that possesses the application's problem solution reproducting methods parts, the most basic.Reproducting method shown in this figure is by solving with above-mentioned problem the sequential key element that parts are corresponding--and reading step S101, mode store step in use S102, separating step S103, decoding and frame output step S104 form.

Fig. 3 is the use aspect graph when transcriber that possesses above-mentioned problem solution parts is used as to concrete electric equipment products.As shown in this figure, an example of recording medium--BD-ROM100, transcriber 200 form household audio and video system together with remote control 300, display unit 400, liquid crystal glasses 500, for user.

BD-ROM100 provides for example cinematographic work to above-mentioned household audio and video system.

Transcriber 200 is connected with display unit 400, reproduces BD-ROM100.In the reproduction image reproducing like this, there is 2D image, 3D image.2D image refers to the image that the display frame of display unit is regarded as to X-Y plane, showed by the pixel on this X-Y plane, also referred to as plane picture.

On the other hand, 3D image refers to the image that the pixel on the X-Y plane on the picture of display unit has been added to the depth gained of Z-direction.3D image reproduces image and the right eye image that will watch with right eye for the left eye that will watch with left eye together, with these for left eye image, right eye with image, bring into play stereoeffect, for user, watch.Pixel in the pixel in 3D image, that there is positive Z axis coordinate, it is nearer than the picture of display unit that user feels; And there is the pixel of negative Z axis coordinate, feel that conversation structure is farther.

Remote control 300 is to accept the various operations relevant with reproducing control there and the machine of the operation of accepting the GUI of classification to carry out from user there from user, in order to accept this operation, remote control 100 comprise call popup menu Menu key, the arrow key of the focus of the mobile GUI parts that form popup menu, to forming the GUI parts of popup menu, determine definite key of operating, for making the popup menu of classification turn back to return key, the numerical key of upper level.

Display unit 400 passes through to show the reproduction image of cinematographic work, or display menu etc., and provide interactively operating environment to user.

Liquid crystal glasses 500 consists of liquid crystal shutter and control part, with user's the parallax of two, realizes stereoscopic vision.The liquid crystal shutter of liquid crystal glasses 500 is to have adopted to have by change to apply the shutter of liquid crystal lens that voltage changes the character of optical transmission rate.The synchronizing signal of the output switching of the image that the image that the right eye that the control part of liquid crystal glasses 500 accepts to send from transcriber is used and left eye are used, according to this synchronizing signal, switches the 1st state, the 2nd state.

The 1st state refers to that adjusting applies voltage, makes the liquid crystal lens corresponding with right eye not see through light, regulates and apply voltage, makes the liquid crystal lens corresponding with left eye to see through the state of light, and under this state, the image that left eye is used is for watching.

The 2nd state refers to that adjusting applies voltage, makes the liquid crystal lens corresponding with right eye see through light, regulates and apply voltage, makes the liquid crystal lens corresponding with left eye not see through the state of light, and in the case, liquid crystal glasses can make the image that right eye is used supply to watch.

Generally, due to the position difference of right eye and left eye, the picture that the picture that right eye is seen and left eye are seen visually has some difference.Utilize this difference, the picture that people can see eyes is identified as solid.Therefore,, if liquid crystal glasses 500 is synchronizeed the switching timing of the output of the image that image that the switching of above the 1st such state, the 2nd state uses with right eye and left eye use, user can produce and regard plane demonstration as three-dimensional illusion.Then, be described the time interval while showing image for right eye, left eye with image.

Specifically, in the image showing in plane, the image that the image that right eye is used and left eye are used has the vision difference suitable with people's parallax, by switching with the very short time interval, shows these images, seems that just looking like is to carry out stereo display.

The time interval that this is very short is so long as show that by above-mentioned switching to be enough to that people is produced and to regard as the time of three-dimensional illusion just much of that.

It is more than the explanation to household audio and video system.

Object--the recording medium that transcriber 200 reproduces is then described.That transcriber 200 reproduces is BD-ROM100.Fig. 4 is the cut-away view of BD-ROM100.

The 4th row of this figure illustrates BD-ROM, and the 3rd row illustrates the session on BD-ROM.The session that the session of this figure forms the interior thoughtful periphery helical form from BD-ROM is drawn along cross directional stretch.This session is comprised of ,Juan district, Lead-In Area and leading-out zone.In addition, in the inner side of Lead-In Area, there is the special area that can only be read by driver that is called BCA (Burst Cutting Area).This region can not be read from application program, so usually for such as copyright protection technology etc.

Ben Tujuan district has file system layer, the such hierarchical model of application layer, in file system layer, with filesystem information, takes the lead, and is recording the application datas such as image data.File system refers to UDF or ISO9660 etc., can by catalogue, file structure, read the logical data recording equally with common PC, can read filename, the directory name of 255 characters.With bibliographic structure, show the application layer form of BD-ROM, as shown in the row of the 1st in figure.In the 1st row, on BD-ROM, under Root catalogue, there are CERTIFICATE catalogue and BDMV catalogue.

Under CERTIFICATE catalogue, the file (app.discroot.cert) of the root certificate of existence dish.App.discroot.cert is while carrying out Java (registered trade mark) application program of carrying out dynamic script control with Java (registered trade mark) virtual machine, for confirming whether application program is tampered and the digital certificate of the process of the identity of application program (hereinafter referred to as signature verification).

BDMV catalogue is to record the catalogue of the data such as AV content that BD-ROM processes and management information, under BDMV catalogue, existence is called 6 subdirectories of PLAYLIST catalogue, CLIPINF catalogue, STREAM catalogue, BDJO catalogue, JAR catalogue, META catalogue, is arranging these 2 kinds of files of INDEX.BDMV and MovieObject.bdmv.

STREAM catalogue be in store be the catalogue of the file of transport stream main body, there is the file (00001.m2ts) be endowed extension name " m2ts ".

In PLAYLIST catalogue, there is the file (00001.mpls) that has been endowed extension name " mpls ".

In CLIPINF catalogue, there is the file (00001.clpi) that has been endowed extension name " clpi ".

In BDJO catalogue, there is the file (XXXXX.bdjo) that has been endowed extension name " bdjo ".

In JAR catalogue, there is the file (YYYYY.jar) that has been endowed extension name " jar ".

In META catalogue, there is XML file (ZZZZZ.xml).

Below, these files are described.

＜Index.bdmv＞

Index.bdmv (concordance list) is the management information relevant with whole BD-ROM, after CD is inserted in transcriber, by first reading index.bdmv, in transcriber, can identify uniquely CD.Index.bdmv regulation forms each program of program structure of CD and the corresponding relation between the mode of operation object of regulation mode of operation.Program structure refers to when packing CD into, start to reproduce the program (broadcast program for the first time) with the logo demonstration to spectators' warning or content supplier etc., reproduce for the first time after broadcast program, reproduce the general program (the general program identifying with " 1 ", " 2 ", " 3 " such sequence number) of the positive that forms cinematographic work, if the reproduction of positive program finishes, reproduce and accept the program (menu programs) of program selection and wait for that user selects general program.

The program of CD, by the mode of operation object to broadcast program for the first time as described above, general program, menu programs difference distribution provisions mode of operation, comes each program of specified in more detail which kind of mode of operation to carry out work with.

＜MovieObject.bdmv＞

The in store movie objects of MovieObject.bdmv.Movie objects is one of mode of operation object, is in the mode of operation (being called HDMV pattern) based on order, offers transcriber using a plurality of navigation command as batch job, makes transcriber according to these navigation command, carry out the batch job program of work.Specifically, movie objects comprises 1 above order and is defined in user GUI has been carried out whether shielding the Shield Flag that these call in situation that menu call, program call.Navigation command refers to the control command of describing by so-called interpreted languages, and a plurality of navigation command are explained by interpreter (job control program) as batch job, made the operation of CPU carry out desired.Navigation command is comprised of command code and operand, can enough command codes come order transcriber to carry out the operations such as program branch or reproduction, computing.Operand is number or the program number of playlist, can specify object to be operated.

< m2ts file >

The file that has been endowed extension name " m2ts " is the digital AV stream of MPEG-TS (TransportStream) form, by multiplexing video flowing, 1 above audio stream, caption data, obtains.Video flowing represents the animation part of film, and audio stream represents the sound part of film.The transport stream that only comprises the stream that 2D uses is called to " 2D stream ", the transport stream that comprises the stream that 3D uses is called to " 3D stream ".

In the situation that 3D flows, can to put in m2ts left eye with and the two data for right eye, also can for left eye with right eye with preparing respectively m2ts.In order to reduce stream capacity used, preferably use left eye with video flowing and right eye with the codec of the mutual reference of video flowing (for example, MPEG-4AVCMVC).The video flowing of having encoded by this compressed with codecs is called to MVC video flowing.

< playlist information >

The file that has been endowed extension name " mpls " is the file of in store playlist (PL) information.Playlist information is the information of playlist that defines with reference to AV segment.

On BD-ROM, existing identification stream to be reproduced is that 2D uses or the dimension distinguishing mark that 3D uses, and in the present embodiment, in playlist (PL) information, has embedded dimension distinguishing mark.

In the present embodiment, can determine the stream that whether exists 3D to use in stream to be reproduced according to the formation form of the playlist on BD-ROM (PL).Java (TM) application program for reproducing control can generate the JMF player example that reproduces this playlist information by order Java (TM) virtual machine, starts AV and reproduces.JMF (Java Media Frame work, Java media framework) player example refers to the actual data that generate in the heap memory of virtual machine according to JMF player class.

Moreover as term definition, 2D playlist only comprises 2D used stream again, and 3D playlist is except comprising 2D stream, also comprises the stream that 3D stereoscopic vision is used.

The file that has been endowed extension name " clpi " is to distinguish Clip (segment) information one to one with AV segment.Owing to being management information, so Clip information has the information such as the coding form, frame per second, bit rate, resolution of the stream in AV segment and represents the EP_map of the original position of GOP.Above Clip information and playlist information are classified as " static scenario ".

<BD-J object >

BD-J to as if make transcriber with the mode of operation (being called BD-J pattern) based on bytecode application, carry out the mode of operation object of work.Bytecode application refers to the application program with the such compiling type language of object oriented language, for example Java (TM) language generation.BD-J to as if with " compiling type language " such as Java (TM) language, carry out the work of regulation transcriber, so have with by interpreted languages--order the meaning that the movie objects described is contrary.BD-J object comprises following " application program management table ".

(application program management table)

Application program management table comprises a plurality of projects.These projects be included in program be automatically start application program (AutoStart), still should wait for from other application programs, call to start " control code " of the method that (Present) this expression starts, 5 bit value that are used as the filename of jar file represent " the application program ID " and " application program details " as the application program of object.

Whether " priority " in the situation that " application program details " are loaded into for the in store application program of each application program, expression application program are whether program is not bound, is " the logo location symbol " at " binding information " of CD binding, the character string of the title that represents application program, " language code " of the linguistic property that represents application program and the indication icon place corresponding with application program.Application program management table, by program was managed as life cycle, can be take this reproduction unit of program as separating to manage the consumption of each application program to storage resources etc.Thus, even if the utilization of a plurality of applications compete resources and be absorbed in deadlock state in the reproduction of certain program if user selects other program, also can make these application programs all finish, so deadlock state compulsory commutation.In addition,, even application program out of control has been occupied memory in the reproduction of certain program, if user selects other program, also can make this application program force to finish, so the pressure compulsory commutation of memory capacity.By doing like this, can realize the management that does not consume meaningless storage resources, stable storage resources.Owing to can realizing the management of stable storage resources, so in the realization of the limited home appliance of the capacity of storage resources, will further bring into play its real value.Come the bytecode application of regulation work to be called " BD-J application program " in the application program management table with in BD-J object.

Suitable with the entity of this Java (registered trade mark) application program is Java (registered trade mark) history file (YYYYY.jar) in store in the JAR catalogue under the BDMV catalogue in Fig. 2.

Application program is Java (registered trade mark) application program for example, 1 the above xlet program being loaded in virtual machine Dui district (also referred to as working storage), consists of.

In META catalogue in store meta file (ZZZZZ.xml), the relevant various information of the in store image works with putting into CD.As information in store in meta file, there are the CD name of CD and image, CD by the information of whose making, the program names relevant with each program etc.It is more than the explanation to BD-ROM100.Meta file is file not necessarily, also has the BD-ROM that does not preserve this document.

It is more than the reproduction object to transcriber--the explanation of BD-ROM.The details of playlist information then, is described.

The playlist information that realizes stereoscopic vision and plane visual forms as follows.Generally " playlist " refers to by regulation reproduction section on the time shaft of AV stream and the reproduction paths of logically specifying the reproduction order between this reproduction section to stipulate, have in regulation reproduction of AV stream which which part and which kind of sequentially launches the effect of scene with.In MPLS file, in store playlist information defines this playlist " type ".By the reproduction paths of playlist information definition, be so-called " multipath ".Multipath refers to the reproduction paths (main path) of main AV stream definition and the binding to the reproduction paths (branch path) of secondary flow definition.On the recovery time of this multipath axle, defined chapter position.By making transcriber with reference to this chapter position, and make transcriber realize the random access to the random time point on the time shaft of multipath.In order to define this multipath, playlist information comprises attribute information, MainPath information, Subpath information, the PlayListMark information reproduced.

1) MainPath information be by define main depending in the recovery time axle of video flowing, 1 above, as the time point of In_Time with as the combination of the time point of Out_Time, define the information of logic reproduction section, comprise STN_table.This MainPath information is equivalent to rendering data information.

2) playlist Mark packets of information containing in a part for the video flowing of the combination appointment by In_Time information and Out_Time information, as the appointment of the time point of chapter.

3) Subpath information is by 1 above SubPlayItem information structure, and SubPlayItem packets of information is containing the In_Time information on the auxiliary appointment depending on stream that will synchronize to reproduce depending on video flowing with above-mentioned master and this auxiliary recovery time axle of looking stream and the combination of Out_Time information.

Use above data structure, can define left eye is bundled to the multipath of gained with the reproduction section on video flowing and right eye by the reproduction section on video flowing, by the definition of this multipath, can be with the form of the data structure compatibility with existing BD-ROM, define can stereoscopic rendering reproduction section.

Fig. 5 is the detail drawing of internal structure in the internal structure of play list file, " reproduction attribute information ", " rendering data information ".

" reproduction attribute information " comprise play list file based on standard " version ", specify this play list file be during film, magic lantern are play any, be sequential reproduction or reproduce " the reproduction type " of each PlayItem that forms play list file and represent that play list file is 2D playlist or this difference of 3D playlist " dimension distinguishing mark " at random.

" rendering data information " consists of N+1 PlayItem information (the PlayItem#0 information～PlayItem#N information in figure).Each PlayItem packets of information containing represent the transport stream that this PlayItem is corresponding " stream file information ", represent this stream file recovery time length " recovery time information " and be illustrated in " the stream log-on message " that allows which kind of Packet Elementary Stream of reproduction in this playitem information for each Packet Elementary Stream.

" dimension distinguishing mark " represents is 3D playlist, and this is to be the situation of supporting the digital stream of 3D with digital stream in the transfer stream file of play list file reference; " dimension distinguishing mark " represents is 2D playlist, and this is to be the situation of only supporting the digital stream of 2D with digital stream in the transfer stream file of play list file reference.

The specific descriptions example of play list file is described below.Fig. 6 illustrates the specific descriptions of the play list file of regulation 2D playlist.

In an example of Fig. 6, " version information " is 2.00; The reproduction type of play list file is set to following content: the PlayItem information of rendering data information is " film ", represents from section start sequential reproduction " sequentially " with the stream file of PlayItem information appointment.

In addition, to illustrate be the example of the flow structure that can 2D shows to dimension distinguishing mark.

In rendering data information, the information relevant with image/sound/caption data has been described.

In the example of Fig. 6, the stream file that PlayItem#0 use is shown is the 00001.m2ts under above-mentioned STREAM catalogue, and the recovery time of PlayItem#0 is 0x002932E0.3 stream log-on messages of PlayItem#0 illustrate the details by 3 Packet Elementary Stream of image #1, these 3 logic stream number signs of sound #1, captions #1.

Specifically, illustrating by the Packet Elementary Stream of this logic stream number identification of image #1 is the video flowing consisting of the TS bag with Packet Identifier 0x02.

Illustrating by the Packet Elementary Stream of this logic stream number identification of sound #1 is by the sound stream that TS bag forms, language is Japanese with Packet Identifier 0x80.

Packet Elementary Stream with the identification of this logic stream number of captions #1 be shown be by the TS bag with Packet Identifier 0x92 form, language is Japanese, be of a size of the caption data of common size.

Fig. 7 illustrates an example of the play list file of regulation 3D playlist.

The version of the reproduction attribute information in this figure is " 2.00 ", and the reproduction type of play list file is " film ", represent that " sequentially " of the broadcasting item comprise from section start sequential reproduction rendering data information is set to reproduce type.Dimension distinguishing mark illustrate be can stereo representation 3D playlist.

In rendering data information, illustrate and have 1 PlayItem, the stream file that PlayItem#0 is used is the 00001.m2ts under above-mentioned STREAM catalogue.The recovery time of PlayItem#0 is 0x002932E0, in PlayItem#0, has 4 stream log-on messages that represent the details of Packet Elementary Stream.

Known following true by these stream log-on messages.

That is, known: the TS bag that the Packet Elementary Stream that has been assigned with this logic stream number of image #1 is 0x02 by Packet Identifier forms, and has this perceptual property of left eye.

The TS bag that the Packet Elementary Stream that has been assigned with this logic stream number of image #2 is 0x02 by Packet Identifier forms, and has this perceptual property of right eye.

The TS bag that the Packet Elementary Stream that has been assigned with this logic stream number of sound #1 is is 0x80 by Packet Identifier forms, has the sound stream of this linguistic property of Japanese.

Known: TS that the Packet Elementary Stream that has been assigned with this logic stream number of captions #1 is is 0x92 by Packet Identifier bag forms, has the caption data that this linguistic property of Japanese, character size are common size.

It is more than the explanation to playlist information.The details of transcriber then, is described.

Describe the member of transcriber below in detail.Fig. 8 is the structure chart of the internal structure of transcriber.As shown in this figure, transcriber is by BD driver 1a, network equipment 1b, local storage 1c, read

buffer

2a, 2b, Virtual File System 3, separator 4, Video Decoder 5a, b, video plane 6, image decoder 7a, b, video memory 7c, d, the plane of delineation 8, audio decoder 9, interactive graphics plane 10, background plane 11, register group 12, static scenario memory 13, reproducing control engine 14, zooming engine 15, synthetic portion 16, HDMI transmission and reception unit 17, Presentation Function sign maintaining part 18, storage part 19 is processed in left and right, planar movement engine 20, offset information memory 21, BD-J platform 22, dynamic script memory 23, schema management module 24, HDMV module 25, UO detection module 26, drawing engine 27a, draw memory 27b, display mode arranges initial demonstration setting unit 28, dimension pattern storage portion 29 forms.

In video flowing in being input to the transcriber 200 of the 1st execution mode, what have respectively that left eye uses uses with right eye, but captions/GUI stream input left eye with and right eye with sharing.In the present embodiment, take and in a stream file, embedded in advance right eye and be described as prerequisite with stream and left eye stream.This is for example, in order to suppress the poor required operand of machine (CE machine) of machine resources of memory and figure aspect as far as possible.

(BD driver 1a)

BD driver 1a comprise there is semiconductor laser, the optical head of collimating lens, beam splitter, object lens, collector lens, photodetector.From the light beam of semiconductor laser outgoing, by collimating lens, beam splitter, object lens, converge in the information faces of CD.Light beam reflection/diffraction on CD of assembling, by object lens, beam splitter, collector lens, converges on photodetector.Photodetector, according to the light quantity of the light of assembling, generates reproducing signal.By this reproducing signal is carried out to demodulation, can demodulate the various data that recording on BD.

(network interface 1b)

Network interface 1b, for communicating with the outside of transcriber, can access the server of available access to the Internet, or the server of local network connection for access.For example, can be used in and download disclosed BD-ROM on internet and append content, or by the server on internet with content appointment, carry out data communication and reproduce the content of utilizing network function.BD-ROM appends content and refers to the content not having on original BD-ROM, such as the second audio frequency appending, captions, give image, application program etc.Can control network interface 1b from BD-J platform, the disclosed content of appending on internet can be downloaded in local storage 1c.

(local storage 1c)

Local storage 1c comprises built-in media and mobile media, for preserving in appending of downloading data used of application program perhaps etc.Preservation is appended the region of content and is given each BD-ROM, and application program can be used for keeping the region of data to be given each application program.In addition, recording by download append content how with BD-ROM on the merging management information of the merging rule that merges of data be also stored in these built-in media, mobile media.

Built-in media refer to the recording medium that such as hard disk drive built-in in transcriber, memory etc. can be write.

Mobile media refers to for example have portable recording medium, and preferably SD card etc. has portable semiconductor memory card.

Take mobile media during as semiconductor memory card as example describes, transcriber comprises slot (not shown) for mobile media is installed and for example, for reading the interface (memory card interface) of the mobile media of installing on slot, in slot, installed after semiconductor memory, mobile media and transcriber are electrically connected to, and can to utilize interface (for example memory card interface) be the signal of telecommunication by the data transformation recording in semiconductor memory and read.

(read buffer 2a)

Read buffer 2a be for temporary transient preserve the formation of reading from BD driver 1a form left eye with the source in the panel of stream wrap, after having adjusted transfer rate, be sent to the buffer of separator 4.

(read buffer 2b)

Read buffer 2b be for temporary transient preserve the formation of reading from BD driver 1a form right eye with the source in the panel of stream wrap, after having adjusted transfer rate, be sent to the buffer of separator 4.

(Virtual File System 3)

Virtual File System 3 is according to download to the merging management information in local storage 1c together with appending content, merge the content on the BD-ROM that appends content and insertion in store in local storage, to construct virtual BD-ROM (virtual software bag).In order to construct virtual software bag, Virtual File System 3 has for generating and upgrading application data be associated " the application data associated modules 3a " of information.The application data information of being associated refers to according to the another name visit information of the filesystem information on BD-ROM CD and application program setting, information that the Information and application program of local storage is associated.

The operative body of HDMV pattern--operative body of HDMV module or BD-J pattern--BD-J platform can indistinction ground with reference to virtual software bag and original BD-ROM.In the process of reproducing virtual software kit, by the data on BD-ROM and the data on local storage, the two carries out reproducing control to transcriber.

(separator 4)

Separator 4 consists of source bag bale breaker, PID filter, accept with the stream that will reproduce (stream be comprised in insertion BD-ROM and with local storage corresponding to the BD-ROM of insertion in) indication of corresponding Packet Identifier, according to this Packet Identifier, carry out packet filtering, the TS bag that its result is obtained outputs to decoder.When packet filtering, separator 4 can be divided the frame of video that left eye is used video flowing with frame of video and the right eye of video flowing according to the header information of stream.This transcriber alternately carries out processing the output of the image that image that left eye uses and right eye use when to display unit output data.

The in the situation that of need to exporting both when some output form simultaneously, separator alternately process left eye with the frame of video of video flowing and right eye the frame of video with video flowing, at left eye, with frame of video and right eye, with the time point that the two decoding of frame of video completes, export both.Moreover, the in the situation that of having 2 output on hardware configuration, export respectively the image that left eye is used and right eye is used.

(Video Decoder 5)

5 pairs of formation left eyes from separator 4 outputs of Video Decoder are decoded and the frame of video of non-compressed format are written on left eye video plane 6 (symbol (L) those shown the video plane 6 of Fig. 8) with the TS bag of video flowing.On the other hand, the formation right eye from separator 4 outputs is decoded and the frame of video of non-compressed format is written on right eye video plane 6 (symbol (R) those shown the video plane 6 of Fig. 8) with the TS bag of video flowing.

(video plane 6)

Video plane 6 is for example to preserve the flat memory that forms the image data of frame of video with the such resolution in 1920 * 2160 (1280 * 1440), has the plane for left eye (symbol (L) those shown on the video plane 6 of Fig. 8) of the resolution of 1920 * 1080 (1280 * 720), the plane for right eye (symbol (R) those shown on the video plane 6 of Fig. 8) of the resolution of 1920 * 1080 (1280 * 720).

(image decoder 7a, b)

Image decoder 7a, b decodes and the graphic subtitle of non-compressed format is written in the plane of delineation 8 export, be written to the TS bag of the formation caption

data video memory

7c, 7d from separator 4.Image decoder 7a, " caption data " of b decoding is the data that represent captions of having compressed by run length coding, RLC, with representing that Y value, Cr value, Cb value, the pixel code of α value and the run length of this pixel code define.

(plane of delineation 8)

The plane of delineation 8 is for example can preserve with the such resolution in 1920 * 1080 (1280 * 720) caption data to be decoded and the graphics plane of the graph data (for example caption data) that obtains, for example have the resolution that can preserve 1920 * 1080 (1280 * 720) data storage area plane for left eye (symbol (L) those shown on the plane of delineation 8 shown in Fig. 8), there is the plane for right eye (symbol (R) those shown on the plane of delineation 8 shown in Fig. 8) of storage area of the data of the resolution that can preserve 1920 * 1080 (1280 * 720).

(audio decoder 9)

9 pairs of audio frames of exporting from separator 4 of audio decoder are decoded, and export the voice data of non-compressed format.

(interactive graphics plane 10)

Interactive graphics plane 10 is for example to have to preserve the graphics plane that BD-J application program is utilized the storage area of the graph data that drawing engine 27a draws with 1920 * 1080 (1280 * 720) such resolution, the plane for left eye (in the interactive graphics plane 10 of Fig. 8 with symbol (L) person) of storage area for example with the data of the resolution that can preserve 1920 * 1080 (1280 * 720), the plane for right eye (in the interactive graphics plane 10 of Fig. 8 with symbol (R) person) of storage area with the data of the resolution that can preserve 1920 * 1080 (1280 * 720).

" graph data " in interactive graphics plane 10, preserved is the figure that each pixel is defined by R value, G value, B value, α value.Be written to image or gadget that figure in interactive graphics plane 10 is mainly used for forming GUI.Although represent that the data of pixel have difference, view data and graph data are summed up with this performance of graph data.The application for graphics plane have the plane of delineation 8, interactive graphics plane 10 these 2 kinds, in the situation that being called for short " graphics plane ", indicating image plane 8, interactive graphics plane 10 the two or wherein a certain.

(background plane 11)

Background plane 11 is for example can preserve the flat memory of the Still image data that will become background image with 1920 * 1080 (1280 * 720) such resolution, specifically, there is the plane for left eye (on the background plane 11 shown in Fig. 8 with symbol (L) person) of the resolution of 1920 * 1080 (1280 * 720), plane right eye for of the resolution of 1920 * 1080 (1280 * 720) (having symbol (R) person) on the background plane 11 shown in Fig. 8.

(register group 12)

Register group 12 is that the playback mode register, the preservation that comprise the playback mode of preserving playlist represent the register set that the reproduction of the configuration information of the configuration in transcriber arranges register, can preserve the general register of content any information used.The playback mode of playlist represents to utilize which the AV data in the various AV data messages of recording in playlist, the states such as which position (constantly) of reproduction playlist.

When the playback mode of playlist changes, reproducing control engine 14 is preserved its content in register group 12.In addition, can be according to the operative body from HDMV pattern the indication of the application program carried out of--operative body of HDMV module or BD-J pattern--Java platform, preserve the value of application program appointment, or give application program by store value.

(static scenario memory 13)

Static scenario memory 13 is for preserving the memory of current playlist information and present pieces information.Current playlist information refer to can be from a plurality of playlist information of BD-ROM or built-in media drive, the access of mobile media driver when pre-treatment object.Present pieces information refer to can be from a plurality of clip information of BD-ROM or built-in media drive, the access of mobile media driver when pre-treatment object.

(reproducing control engine 14)

Reproducing control engine 14 is carried out the representational role of AV representational role, playlist.AV representational role refers to the functional group following from DVD player, CD Player, be the releasing that reproduce to start, reproduce the releasing that stops, suspending, suspends, freeze image function, with immediate specified reproduction speed F.F., by immediate, specified the retreating of reproduction speed, sound switching, subpictures switching, angle to switch these processing.The BD-J application program that the movie objects that HDMV module is carried out or BD-J platform are carried out is by processing request to reproducing control engine 14, can make reproducing control engine not only reproduce beginning, reproduce and to stop the reproducing control of these common reproductions, and the releasing of the releasing that suspends, suspends, freeze image function, with immediate specified reproduction speed F.F., by immediate, specified the retreating of reproduction speed, sound switching, subpictures to switch these special reproduction.Playlist representational role refers to that the reproduction of carrying out in this AV representational role according to the current playlist information, the present pieces information that form current playlist starts or reproduce to stop.The AV stream more existing user's of take operation (for example reproducing button) is the situation that triggering starts, and also has certain event of take in terminal as triggering situation about automatically starting.

The middleware of transcriber will offer BD-J application program for carrying out the API of the various functions of reproducing control engine.The storehouse that is used for making reproducing control engine carry out the API of each representational role is " AV reproduces storehouse 14a ".Each API in " AV reproduces storehouse 14a " comprises various member functions, by specifying argument to call the member function (method) that AV reproduces storehouse, and makes reproducing control engine carry out the function of these member functions.On the other hand, movie objects is passed through the issue navigation command suitable with this member function, and makes reproducing control engine carry out the processing suitable with these API.

Attempt an example, " selectPlayList " is BD-J application program for ordering the API that switches playlist, for calling the argument of this API, is BD-J finger URL.BD-J finger URL is that energy enough title_id, playlist_id, PlayItem_id specify finger URL playlist, BD-J application-specific that will select.By using the file body of the play list file in BDMV/PLAYLIST catalogue, specifying, to become the playlist that reproduces object.

The result that the function of reproducing control engine is carried out with event notice to BD-J application program.Thus, when utilizing AV to reproduce storehouse, BD-J application program needs log-in events monitor in advance, to can receive the event that represents execution result.

(zooming engine 15)

Zooming engine 15 can carry out dwindling, amplifying of image on the plane of delineation 8 or video plane 5 and etc. control doubly.If in time point value of being provided with in planar movement engine 20 of carrying out the decoding of view data, frame of video, zooming engine 15 is thought convergent-divergent has been occurred, and the graphics saving decoding was being carried out to convergent-divergent by zooming engine 15 before on video plane.

(synthetic portion 16)

Synthetic portion 16 carries out the laminated one-tenth of interactive graphics plane 10, the plane of delineation 8, video plane 6, background plane 11.Interactive graphics plane 10, the plane of delineation 8, video plane 6, background plane 11 these flat memories form layer models, and the laminated one-tenth that synthetic portion 16 carries out is that this processing of pixel value by all combinations between the stratum in layer model being carried out to pixel data in store in the flat memory between overlapping stratum in the layer model of flat memory is carried out.

Overlapping between stratum is following processing: the pixel value of behavior unit of usining that is positioned at flat memory in certain stratum is multiplied by transmissivity α as weighting, and the pixel value with behavior unit that is positioned at the flat memory in its next stratum is multiplied by (1-transmissivity α) this weighting, the pixel value of these weightings is added to the pixel value of the pixel with behavior unit using addition result in this stratum.By repeating overlapping between this stratum between the pixel with behavior unit in 2 stratum at layer model, realize above-mentioned laminated one-tenth.

In the situation that content is assumed to be captions or popup menu the data of the plane of delineation, one fixes on superimposed image plane on video plane.That is,, even if video plane is three-dimensional content, in the situation that do not have the captions of depth or popup menu to overlap on stereoscopic vision video, also must preferentially show image.This be because, do not do like this, the part of figure will become the appearance being absorbed in video, nature seems.

(HDMI transmission and reception unit 17)

HDMI transmission and reception unit 17 comprises and for example meets HDMI standard (HDMI:High Definition Multimedia Interface, HDMI (High Definition Multimedia Interface)) interface, by HDMI standard, send reception with the device being connected with transcriber HDMI (in this example for display unit 400), the incompressible voice data that image data in store on video plane and audio decoder 9 are decoded is transferred to display unit 400 through HDMI transmission and reception unit 17.Display unit 400 for example keeping with whether support the relevant information of stereo display, the information relevant with the resolution can plane showing, the relevant information with resolution that can stereo representation, from transcriber after HDMI transmission and reception unit 17 request of having sent, display unit 400 for example, sends back to transcriber by the information needed of request (with whether support the relevant information of stereo display, the information relevant with the resolution can plane showing, the relevant information with resolution that can stereo representation).Like this, by through HDMI transmission and reception unit 17, can obtain the information whether display unit 400 supports stereo display from display unit 400.

(Presentation Function sign maintaining part 18)

Can the in store expression transcriber of Presentation Function sign maintaining part 18 carry out the 3D Presentation Function sign that 3D shows this difference.

(storage part 19 is processed in left and right)

Left and right is processed the current output of storage part 19 storage and is treated to the output that output that left eye uses or right eye are used.The sign that storage part 19 is processed in left and right represents that to the output of the indication equipment being connected with the transcriber shown in Fig. 1 (being TV in the example of Fig. 1) be left eye output or right eye output.Carrying out between left eye period of output, the sign that storage part 19 is processed in left and right is set to the sign that represents that left eye is exported.And carry out right eye output during, the sign that storage part 19 is processed in left and right is set to represent the sign of right eye output.

(planar movement engine 20)

Planar movement engine 20 has both the region of preserving plane of delineation offset information, in judging left and right processing storage part 19, after pre-treatment object is left-eye images or right-eye image, by the planar offset shown in store plane of delineation offset information, come the amount of movement of the transverse axis of computed image plane also to move.By changing the offset amplitude of the transverse axis of captions/GUI, change depth.For example, can obtain following visual effect: more make left eye with captions and right eye with captions in a certain direction away from, show nearer; Leave more in opposite direction, seem far away.

(offset information memory 21)

Temporary transient module of preserving its value while upgrading plane of delineation offset information that offset information memory 21 has been user or application requests.Plane of delineation offset information be for example with-255～255 integers that show depth (the 255th, recently, the-255th, farthest), be transformed to the pixel coordinate that represents final mobile range.

(BD-J platform 22)

BD-J platform 22 is operative bodies of BD-J pattern--Java platform, Java2Micro_Edition (J2ME) Personal Basis Profile (PBP1.0) and Globally Executable MHP specification (GEM1.0.2) for package media targets have been realized completely, by sense byte code in the class file existing from JAR history file, be saved in heap memory, start BD-J application program.Then, the bytecode of formation BD-J application program, the bytecode of construction system application program are transformed to the machine code, and MPU is carried out.

(dynamic script memory 23)

Dynamic script memory 23 is in store current dynamic script, operative body--operative body of HDMV module, the BD-J pattern--memory of Java platform processes that supplies HDMV pattern.Current dynamic script refers to the current execution object in the Index.bdmv that recording on BD-ROM or built-in media, mobile media, BD-J object, movie objects.

(schema management module 24)

Schema management module 24 keeps the Index.bdmv reading from BD-ROM or built-in media drive, mobile media driver, carries out schema management and branch and controls.The schema management that schema management module 24 is carried out is to instigate which the execution dynamic script in BD-J platform 22, HDMV module 25, the distribution of this module.

(HDMV module 25)

HDMV module 25 is operative bodies of HDMV pattern--the virtual player of DVD is the executive agent of HDMV pattern.This module possesses command interpreter, by explaining and carry out the control that the navigation command that forms movie objects is carried out HDMV pattern.Navigation command is to use the grammer similar to DVD-Video to describe, so by carrying out this navigation command, can realize the reproducing control that is similar to DVD-Video.

(UO detection module 26)

UO detection module 26 is accepted the operation of user to GUI.In this user's operation of accepting with GUI, there are which this program selection, captions selection, sound in the program of selecting recording on BD-ROM to select.Particularly, as the distinctive user's operation of stereoscopic rendering, sometimes accept the rank of the depth feelings of stereopsis.For example, sometimes accepting depth feelings and be 3 far away, common, near etc. ranks, is also the rank that several cm, the such numerical value input of a few mm are accepted depth feelings by depth feelings sometimes.

In addition, UO detection module 26 is in the situation that receive the instruction of the convergent-divergent of the change plane of delineation by the operation of remote control or the subsidiary button of machine etc., and the module in issue machine is by the instruction of its direct convergent-divergent.

(drawing engine 27a)

Drawing engine 27a comprises these platforms of Java2D, OPEN-GL (Ji Disk) software, according to carrying out the decoding of jpeg data/PNG data from the request of BD-J application program, obtain image or gadget, be written in interactive graphics plane and background graphics plane.The view data obtaining by jpeg data is decoded becomes the wallpaper of GUI, is written in background graphics plane.By the pixel data that PNG decoding data is obtained, be written in interactive graphics plane, can realize the button indication with animation.By image that these jpeg data/PNG decoding datas are obtained or gadget, in BD-J application program, show when accepting the popup menu that program is selected or captions are selected, sound is selected or making stream reproduce the game work of linkage type, be used to form GUI parts.In addition,, when BD-J application program accessing WWW website, be used to form the browser menu of this WWW website.

(drawing memory 27b)

Draw memory 27b and read in the PNG data that will decode with drawing engine, the memory of jpeg data.At this, draw in memory 27b, when BD-J application program is carried out live display mode, retain cache area.Live display mode refers to that the browser menu of WWW website and the stream of BD-ROM that on combinational network, exist reproduce.Cache area is current browser menu during for the live display mode of high-speed cache and the cache memory of last browser menu, and the incompressible PNG data or the incompressible jpeg data that form above-mentioned browser menu are stored in here.

(display mode arranges initial demonstration setting unit 28)

Display mode arranges initial demonstration setting unit 28 according to the BD-J object offering in the current program of BD-J platform part, and reproduction mode, resolution are set.

(dimension pattern storage portion 29)

Dimension pattern storage portion 29 storing reproduction patterns, three-dimensional pattern.In the situation that transcriber being provided with can 3D shows as 3D Presentation Function sign, in store terminal setting in dimension pattern storage portion 29--reproduction mode can be switched to some in 2D, 3D.Below, reproduction mode is represented to the state of " 3D " is called " 3D pattern ", reproduction mode is represented to the state of " 2D " is called " 2D reproduction mode ".It is more than the explanation to the member of transcriber.Then, illustrate for realizing the details of stereoscopic rendering.

(forming the required thing of stereopsis)

In order to form 3D image, transcriber and display unit self all needs there is this ability, by prompting in content, whether have this ability, or setting wants to allow content self carry out work or carry out work with 3D with 2D in transcriber, making content increases with the convenience of realizing transcriber.Reason is because content and transcriber can prevent the factitious overlapping of image and figure.An example as keeping the ability of transcriber and the configuration information of content, has register group 12.

Fig. 9 is the schematic diagram of example of the content of register group 12.Register group 12 consists of " playback mode register (0)～(127) " and " general register (0)～(4096) ".In playback mode register for preserving certain value, the set of the preservation address of having numbered.For example, in the preservation address of certain number, put into the identifier of the playlist of current reproduction, or in the preservation address of certain number in addition, put into the identifier of the audio frequency utilizing.What put into each value is reproducing control engine 18, HDMV module 25 or BD-J platform 22.The content enough HDMV modules 25 of energy or BD-J platform 22 are obtained the value corresponding with the number of appointment from playback mode register or general register, or the preservation value corresponding with the number of appointment.

In the 14th (playback mode register (14)) in playback mode register, its high the 3rd is assigned to and wants to carry out work or carry out this setting of work with 3D with 2D.

In the 29th (playback mode register (29)) in playback mode register, its low the 3rd is assigned to transcriber and whether is useful on this setting of ability that forms 3D image.

(with single graphics plane, realizing stereoscopic vision)

Before explanation 3D image output is processed, first have a talk about the data of the captions/GUI that realizes stereoscopic vision., there are the data of captions/GUI in the data of processing as the transcriber 200 of present embodiment.In order to reduce the fatigue strength of eyes, need to the data of captions/GUI be shown closelyer than video flowing.

As captions/GUI stream is presented to method nearby, when forming left eye and right-eye image, synthetic result the output that captions/GUI stream has been moved along transverse axis.By changing the offset amplitude of the transverse axis of captions/GUI, change depth.For example, can obtain following visual effect: more make left eye with captions and right eye with captions in a certain direction away from, show nearer; Leave more in opposite direction, seem far away.

To on 1 graphics plane, according to planar offset, carry out planar movement, to realize the reproduction mode of stereoscopic vision, be called " 1plane+Offset pattern " (1 plane+side-play amount pattern) as mentioned above.Planar movement engine 20 is for realizing this 1plane+Offset pattern.

Difference between the coordinate of original pixel data and the coordinate of each pixel data to the right or in situation about being moved to the left is called to " amount of movement ".This amount of movement, in stereoscopic vision, can calculate by this depth value of depth that makes the plane of delineation 8 or interactive graphics plane 10 have which kind of degree.In addition, in stereoscopic rendering, can be derived by some parameter of the parallax as two.

In addition, the parameter for making pixel data in graphics plane move left and right amount of movement as described above is called to " planar offset ".Amount of movement is scalar, and planar offset is the vector with positive and negative value, and indication is from current state along making the coordinate of pixel data move how many to the right and to which left direction.

In the present embodiment, which kind of depth will be contents producer will show that this information of captions/GUI is embedded in playlist information with in advance, thus transcriber 200 during reproducing the stream be associated with playlist information according to this information by captions/GUI three-dimensionally continue to be presented at video flowing before.Be not limited to playlist information, can be used as the amount of movement of pixel of planar offset and the moving direction of pixel also from recording medium or user operate etc., the outside of transcriber provides.Using as planar offset based on the combination of information, the amount of movement of pixel providing from transcriber outside and the moving direction of pixel be called " plane of delineation offset information ".

Amount of movement can directly utilize the value of recording in plane of delineation offset information, also can utilize other operation results, for example, the value setting in advance in plane of delineation offset information and terminal multiplied each other or combine the value of gained.

While in addition, appearing at sometimes the resolution of some display unit and size, the amount of movement of the plane of delineation is excessive, eyes do not catch up with, image looks like 2 heavy phenomenons.In this case, by obtaining amount of movement according to the information of the resolution of the value of recording in plane of delineation offset information, combined display equipment and size, and adjust, make captions/figure not show excessively closely.

Below, illustrate with 1plane+Offset mode reappearing to go out which kind of presentation content.

9L, 9R illustrate the example that decoder is saved in the frame of video on video plane.From women's the direction of face and the difference of position, the stream that the stream that known left eye is used and right eye are used is from different angle shots.

9S is the figure of content that does not carry out the graphics plane of planar movement, and 9LS is the snapshot of the plane of delineation of " I love you " these captions while being moved to the left.9RS is the snapshot of the plane of delineation of " I love you " these captions while having been moved right.

9LL is the resultant image of the frame of video of synthetic left eye and the image gained that has been moved to the left, and 9RR is the resultant image of the frame of video of synthetic right eye and the image gained that moved right.

Left eye at 9LL is used in image, and the captions of known " I love you " are offset and are synthesized left.And use in image at the right eye of 9RR, the captions of " I love you " are offset and are synthesized to the right.If do not wear liquid crystal glasses TV, the image of this 9LL, 9RR seems to be superimposed.This as shown in Figure 3.

The image that right eye is used and left eye is used filters by example liquid crystal glasses 500 as shown in Figure 1, mirrors different images in each.Here it should be noted, the image of not only video flowing image is superimposed left and right and by three-dimensional, and also the captions of " I love you " are also and then along lateral shift, added between depth and (be presented at nearby the in the situation that of present embodiment).Like this, can reproduce stereopsis and the captions that reduce spectators' eye fatigue degree.

Fig. 9, Figure 10 use with the captions of video flowing interlock to illustrate, but the figures such as button also can use the same method, process and make it have depth.

Figure 12 is that the transcriber 200 of this 1st execution mode reads in above-mentioned image data--playlist the flow chart while showing three-dimensional captions/solid figure overlapping on stereopsis.

Playlist reproduces request for example, becomes triggering with the indication from content or user's operation (reproducing button).Be not limited to this, while inserting CD or during choice menus etc., program handover request also becomes triggering sometimes.

Static scenario memory 11, by starting to reproduce playlist and transport stream in a plurality of playlists on the timing extraction BD-ROM CD of playlist, a plurality of stream, that become current reproduction processes object, is set to (S1) in current playlist information.

Thereafter, determining step through step S2, step S3, if the judged result in these determining steps is sure, reproduction mode is switched to 3D pattern in step S4, the value (hereinafter referred to as plane of delineation offset information) that extract to represent shows the depth of captions/GUI from the current playlist information of static scenario memory 11, is saved in the storage area of planar movement engine internal (S5).

Step S2 judges whether the dimension distinguishing mark in current playlist information represents to allow the reproduction of 3D pattern, and step S3 judges whether the reproduction mode in transcriber is 3D pattern.This judgement is carried out by reference to sign (2Dor3D) in store in dimension mode record portion 29.In imagination dimension mode record portion, in store value has been switched in advance according to for example user's operation or from the indication of application program.

If some in these steps negate, reproduction mode is switched to 2D reproduction mode in step S12, under 2D pattern, reproduce and play (a step S13).

After having carried out step S4, step S5, transfer to the circulation of step S6～step S13.

The circulation of step S6～step S13 is that after current broadcasting item No. being initialized as to 1 in step S6, the processing of repeating step S7～step S13, until step S12 is judged as "Yes" ("Yes").Here, the termination condition of circulation is to play item to become the last-number in playlist, as long as do not meet this condition, just increases progressively current broadcasting item No. (step S13).

With the processing that repeats of circulation, be that AV stream by the stream file information appointment by current playitem information is set to current stream (step S7), the left eye of current playitem information is set in separator by the Packet Identifier of video flowing with the Packet Identifier of video flowing and right eye and makes it isolate video flowing and video flowing (step S8) for right eye for left eye, the reproduction type that judges current playitem information is film, or magic lantern is play (step S9), if magic lantern is play, by the frame of video under 3D pattern, process to carry out magic lantern play reproduction (step S10), and if film, by the frame of video under 3D pattern, process to carry out film and reproduce (step S11).

Figure 13 is the flow chart that the frame of video under 3D pattern is processed.

First, separator 4 carries out the multichannel separation of the transport stream on CD, graphical stream is saved in to video memory 7c, in d (S802).Then, 8 couples of video memory 7c of image decoder, in d, in store graphical stream etc. is decoded and is written to (S803) on the plane of delineation 8.Then, separator 4 carries out the multichannel separation of the transport stream on CD, processes the sign of storage part 19 according to left and right, extracts the video flowing corresponding with it, and the video decoding by Video Decoder 5 is saved in to (S804) on video plane.Suppose in the 1st execution mode, the sign that storage part is processed in left and right is the processing that left eye is used by default setting.The order of S802～S804 is an example, and their order can be carried out with any order.

After the preservation being through with on the plane of delineation, planar movement engine is according to the plane of delineation offset information of preserving in step S5, with reference to left and right, process the sign of storage part 19, the plane of delineation is moved to the image (S805) of synthetic portion 16 synthetic graphics plane 9 having moved on video plane 5 along certain direction.

S805 midplane moves direction that engine moves because making the plane of delineation be shown to nearby, still be shown to different at a distance, and in the 1st execution mode, as left eye image, take that to be offset, to be shown to be prerequisite to the right nearby.

Synthetic portion 16 synthetic final images in S805 are outputed to display unit 400 (S806) as left-eye images.Complete simultaneously with this output, the sign of storage part 19 is processed in this transcriber conversion left and right.That is, be set to the in the situation that left eye being processed to be switched to right processing, and in the situation that being set to right eye processing, be switched to left processing.

Then, separator 4 carries out the multichannel separation of the transport stream on CD, processes the sign of storage part 19 according to left and right, extracts the video flowing corresponding with it, and the video decoding by Video Decoder 5 is saved in to (S807) on video plane.In this example, in this step for right eye is processed, so extract right eye video flowing.

8 couples of video memory 7c of image decoder, in d, in store graphical stream etc. is decoded and is written to (S808) on the plane of delineation 8.The sign of processing storage part 19 with reference to left and right, moves the plane of delineation along certain direction, the image (S809) of the synthetic portion 16 synthetic graphics plane 9 having moved on video plane 5.In S805, carried out the processing that left eye is used, thus moved right, but carry out specifically the processing that right eye is used, so round about, be moved to the left.Synthetic portion 16 synthetic final images in S809 are outputed to display unit 400 (S810) as eye image.

Complete simultaneously with this output, the sign of storage part 19 is processed in this transcriber conversion left and right.That is, be set to the in the situation that left eye being processed to be switched to right processing, and in the situation that being set to right eye processing, be switched to left processing.

Transcriber 200, as long as the time point completing at S810 exists next frame, just repeats the processing of S802～S810.

(2D reproduction mode)

2D reproduction mode is to take the pattern that the high picture element of 2D while reproducing be prerequisite, thus reproduction mode in the situation that stream to be reproduced is 2D uses and be necessarily switched to 2D, this can provide the highest picture element all the time to client.In the situation that reproduce the stream of object, be the three-dimensional use of 3D, maintain current reproduction mode.After reproduction mode is switched, to occurring that picture needs the time, so by reduce like this switching of reproduction mode as far as possible, can cripetura start the time that AV reproduces.

Figure 14 illustrates the processing procedure that the playlist under 2D pattern reproduces.

Current broadcasting item No. is set to 1 (step S21), with the AV stream of the stream file information appointment of current playitem information, be set to current stream (step S22), thereafter, according to the result of the determining step of step S23, optionally perform step the processing of S24～step S25, step S26～step S27.Step S23 judges whether current stream comprises video flowing for left eye, right eye video flowing, in the situation that comprising, by left eye is set in separator and makes it isolate video flowing (step S24) depending on the Packet Identifier of video flowing with master in video flowing, that can reproduce separately with video flowing and right eye, carry out the main frame of looking video flowing and process (step S25) thereafter.

In the situation that not comprising, by the Packet Identifier of video flowing is set in separator, and make it isolate video flowing (step S26), carry out the frame of video flowing and process (step S27).

Separator 4 carries out the multichannel separation of the transport stream on CD, graphical stream is saved in to video memory 7c, in d (S1103).

Then, 8 couples of video memory 7c of image decoder, in d, in store graphical stream etc. is decoded and is written to (S1104) on the plane of delineation 8.

Then, separator 4 carries out the multichannel separation of the transport stream on CD, extracts video flowing, and the video decoding by Video Decoder 5 is saved in to (S1105) on video plane.

Then, the image (S1106) of synthetic portion 16 synthesising pattern plane 9 on video plane 5.The synthetic final image output of synthetic portion 16 in S1106 is arrived to display unit 400 (S1107).In S1107, after display unit 400 has been exported final image, judge whether it is that frame for the first time after the switching of reproduction mode occurs is processed (S1108).In S1108, to display unit 400, export final image.

Figure 16 is the flow chart of the processing procedure processed of the frame of video of 2D under 2D pattern stream.Below, with the flow chart of Figure 16, the processing of 2D image output is described.

First, then, separator 4 carries out the multichannel separation of the transport stream on CD, graphical stream is saved in to video memory 7c, in d (S1201).

Then, 8 couples of video memory 7c of image decoder, in d, in store graphical stream etc. is decoded and is written to (S1202) on the plane of delineation 8.

Then, separator 4 carries out the multichannel separation of the transport stream on CD, extracts left eye video flowing, and the video decoding by Video Decoder 5 is saved in to (S1203) on video plane.

Then, the image (S1204) of synthetic portion 16 synthesising pattern plane 9 on video plane 5.The synthetic final image output of synthetic portion 16 in S1204 is arrived to display unit 400 (S1205).Wherein, in S1203, extract left eye video flowing, but also can extract right eye video flowing, synthetic in S1204.Like this, transcriber 200, in the situation that transport stream to be reproduced is 3D (S2:3D), if terminal setting is set to 2D pattern (S3:2D), also can be exported the image that 2D uses.

As mentioned above, according to present embodiment, carry out two judgements: judgement digital stream supports that 2D still supports 3D, judgement transcriber is set to reproduce or be set to 2D reproduce with 3D, finally by determining that reproducing digital stream with 2D still reproduces digital stream with 3D, can suitably form stereopsis.

(the 2nd execution mode)

Above execution mode consists of the plane of delineation and these two planes of video plane, and in the situation that video plane and more than 2 graphics planes, according to the number of plane, increase the number of video memory and the plane of delineation, according to the plane of delineation offset information of each plane of delineation be offset, overlay plane.

Figure 17 is the flow chart of processing procedure that can support the playlist reproduction processes of many planes of delineation.Transcriber 200 extracts the same number of plane of delineation offset information with the plane of delineation from the current playlist information of static scenario memory 11, by array, is saved in (S1301) on planar movement engine 28.Then, separator 4 carries out the multichannel separation of the transport stream on CD, extracts left eye video flowing, and the video decoding by Video Decoder 5 is saved in to (S1302) on video plane.Then, separator 4 carries out the multichannel separation of the transport stream on CD, graphical stream is saved in to video memory 7c, in d (S1303).Then, 8 couples of video memory 7c of image decoder, in d, in store graphical stream etc. is decoded and is written to (S1304) on the plane of delineation 8.

Then, planar movement engine moves the plane of delineation according to the value of the upper of the array of the plane of delineation offset information of preserving in S1301 along certain direction, the image (S1305) of synthetic portion 16 synthetic graphics plane 9 having moved on video plane 5.Wherein, S1305 is not the image of the synthetic graphics plane 9 having moved on video plane later in the situation that at the 2nd time, but in the S1305 of last time overlapping new images plane on synthetic image.In addition, S1305 the 2nd time later in the situation that with the image shift information of the array reference of image shift information also utilize in the lump the 2nd time later.

Then, whether all transcriber 200 judges the plane of delineation synthetic complete (S1306) according to the processing of two of whether having carried out with the array as much of plane of delineation offset information.At the plane of delineation whole synthetic (S1306: "No" (No)), in order to process the next plane of delineation, and carry out the processing of repetition S1303～S1305 with next plane of delineation offset information complete in the situation that.And in the situation that the plane of delineation is all synthetic complete (S1306: "Yes"), synthetic portion 16 synthetic final images in S1305 are outputed to display unit 400 (S1307) as left-eye image.After having exported left-eye images in S1307, then with right eye, with image, carry out and the equal processing of image (S1302～S1307) for left eye.Only at right eye, use in processing, in S1305, be offset the plane of delineation to the right and be all offset left.In addition, in S1307, as left eye, with image output, arrive display unit, and use the synthetic image of processing to be output with image as right eye by right eye.The time point completing with image with image and right eye at left eye carries out the processing of next frame.

(the 3rd execution mode)

The BD-J application program of present embodiment imagination is Java (TM) Xlet controlling by the application manager in Xlet interface, use platform.Xlet interface has " loaded " (packing into), " paused " (time-out), " active " (activity), these 4 states of " destroyed " (dismounting), be event driven, that is, according to event, carry out state transitions and carry out and control.In xlet, logined in advance the critical event as the triggering of the work of application program.Like this, as the login of critical event of the triggering of work, by EventListner, undertaken.

BD-J application program is event driven, so compare with movie objects, the work of BD-J application program has following difference.The executive agent of the order under HDMV pattern--command interpreter, when for example being reproduced the digital stream of 10 minutes length by order, was not returned to any replying at 10 minutes in during this, and 10 minutes this time is through just returning and reply later.But BD-J application program is event driven, so Java Virtual Machine returns and replys to BD-J application program immediately after explaining reproduction order and sending indication to lower layer.Like this, the action of executive agent because of mode of operation different, so during the work of the BD-J application program under BD-J pattern, need to be in the predetermined event that will notify of the key position of controlling, by sign in in advance the Xlet interface of class file for receiving the event sniffer of this critical event, impel virtual machine suitably to work.For example, in the situation that the reproduction mode of transcriber is switched to 3D, is switched to 2D from 3D from 2D, if output represents the event of this switching, and the event sniffer that this is received signs in to the Xlet interface of BD-J application program in advance, just can switch according to the variation of above-mentioned reproduction mode the processing of BD-J application program.

In the present embodiment, in the situation that reproduction mode has been switched, the fact that the pattern of above-mentioned transcriber has been switched is notified to display unit, in the situation that from above-mentioned display unit receive can carry out with switch the notice of the meaning of the corresponding output of pattern, to the output of above-mentioned application program represent to carry out with above-mentioned switching after the event of the corresponding output of pattern, impel BD-J application program to carry out work correspondingly.

Figure 18 has added the flow chart that output display pattern has been switched the processing procedure that frame of video process, under 3D pattern of notification event processes.This figure be take Figure 13 as basis mapping, compares as basic Figure 13 with this, and difference is, between step S810 and step S811, has added step S1108, step S1109 in this figure.

Judge whether it is that reproduction mode is switched first frame (S1108) after occurring.In the situation that being first frame, to application program, send the reproduction mode finishing switching notice (S1109) of terminal.Like this, transcriber 200, in the situation that the transport stream of reproduction object is that 2D and terminal setting are 2D patterns, can carry out the processing of 2D image output, so can switch 2D/3D pattern.

Figure 19 has added the flow chart of processing procedure that output reproduction mode has been switched frame of video processing process, under 2D pattern of notification event.This figure be take Figure 15 as basis mapping, compares as basic Figure 15 with this, and difference is, between step S1107 and step S1110, has added step S1108, step S1109.Judge whether it is that reproduction mode is switched first frame (S1108) after occurring.In the situation that being first frame, to application program, send the reproduction mode finishing switching notice (S1109) of terminal.Like this, transcriber 200, in the situation that transport stream to be reproduced is 2D and terminal setting is 2D pattern, can carry out the processing of 2D image output, so can switch 2D/3D pattern.

As mentioned above, according to present embodiment, output impels the BD-J application program that possesses event driven xlet to carry out the event for the suitable drafting of 3D pattern, so presentation content from 2D be switched to 3D, be switched to 2D from 3D in the situation that, the graphic plotting that BD-J application program is carried out also can be switched to 3D, from 3D, be switched to 2D from 2D.

(the 4th execution mode)

Above execution mode has illustrated when common reproduction how to realize stereoscopic rendering, and in the present embodiment, illustrates when user has asked special reproduction, how to carry out stereoscopic rendering.

Figure 20 is the flow chart of the processing procedure processed of the frame of video outside common reproduction, under the 3D pattern of considering specialized reproduction.This figure be take Figure 13 as basis mapping, compares as basic Figure 13 with this, and difference is, has added step S1401～step S1404.

Step S1401 judges that the image in current reproduction is special reproduction or common reproduction.Show if common reproduction, image, captions all carry out an example of the situation of 3D demonstration.

The in the situation that of being special reproduction in S1401, separator 4 carries out the multichannel separation of the transport stream on CD, the sign of processing storage part 19 according to left and right, extracts the video flowing corresponding with it, and the video decoding by Video Decoder 5 is saved in to (S1402) on video plane.In the 1st execution mode, the sign that storage part is processed in left and right is the processing that left eye is used by default setting.Synthetic portion 16 synthetic final images are outputed to display unit 400 (S1403) as left-eye images.Complete simultaneously with this output, the sign of storage part 19 is processed in this transcriber conversion left and right.That is, be set to the in the situation that left eye being processed to be switched to right processing, and in the situation that being set to right eye processing, be switched to left processing.

Then, synthetic portion 16 synthetic final images are outputed to display unit 400 (S1404) as eye image.Complete simultaneously with this output, the sign of storage part 19 is processed in this transcriber conversion left and right.That is, be set to the in the situation that left eye being processed to be switched to right processing, and in the situation that being set to right eye processing, be switched to left processing.Transcriber 200, as long as the time point completing at S1404 exists next frame, just repeats the processing of S1401～S1404.

The in the situation that of being common reproduction in S1401, the 3D that continues captions/GUI, image shows, as the handling process of Fig. 8, implements aforesaid S802～S810.

Here, in the situation that being difficult to also continue 3D demonstration in the situation that suspending, can be same with the situation of special reproduction, repeat to export 1 frame of video.

If special reproduction is switched to image 2D and shows, hide (ミュート) captions.The special reproduction such as carry out F.F. at video, retreat, can only be in the some situations of decoding in the video that right eye is used or left eye is used, also can export two with video, so not only can prevent the flicker of image, and can prevent owing to showing that obstinately captions make image and captions not mate so factitious reproduction.

(continuing the method for 3D)

As continue the processing that 3D shows in the situation that stopping, suspending or magic lantern reproduces, there are " by repeating to show, continuing 3D ", " next frame is set ", " capability-based exception ".

1. by repeating to show, continue 3D

For example, at image, with 3D, show to reproduce, the operation of carrying out with remote control 300 due to user or content (Java (registered trade mark) application program, MovieObject) and stop midway, suspend or situation that magic lantern reproduces under, by continuing to repeat the left eye of the position that show image stops, with frame of video and right eye, with frame of video and caption data, continue 3D and show.

That is, by, continuing 3D and show on left eye that the next frame of next frame while processing be arranged on the position that image stops all the time position by the frame of video of video flowing carrying out in Figure 14.In addition, can only continue 3D display video, and closed caption.Equally, can not continue 3D demonstration due to resource restrictions such as memories in the situation that, also can hide video and captions.

Like this, by continuing as much as possible 3D, show, can suppress as much as possible the generation of the difference of factitious third dimension, can alleviate the unplessantness displeasure to spectators.

2. next frame is set

By, continuing 3D and show on left eye that the next frame of next frame while processing be arranged on the position that image stops all the time position by the frame of video of video flowing carrying out.

In addition,, can not continue 3D demonstration due to resource restrictions such as memories in the situation that, can hide video and captions.Like this, by continuing as much as possible 3D, show, can suppress as much as possible the generation of the difference of factitious third dimension, can alleviate the unplessantness displeasure to spectators.

3. capability-based exception

Certainly, at transcriber 200, be in high performance situation, the in the situation that of the special reproduction such as carry out F.F. at video, retreat, also can continue 3D and show by implementing the processing of S802～S810.

(the 5th execution mode)

Movement when more than having described due to user's operation or having implemented special reproduction from the indication of BD-J application program, movie objects.But, say, image is chaotic, image and captions can not mate to result from and carry out by force special reproduction.Therefore, below, illustrate and in order to continue the 3D of captions/GUI, image to reproduce, forbid the improvement of special reproduction.

Suppose at transcriber 200 just under the state of reproducing caption/GUI, image, by user use operation that remote control 300 carries out, from the indication of BD-J application program, movie objects, and asked F.F., retreated etc., reproduction speed is the special reproduction (S1501) beyond 1 speed.In current playlist (PL) information of reproducing control engine 18 from static scenario memory 11, obtain dimension distinguishing mark 40111, judgement image is 2D or 3D (S1502).The in the situation that of judging image be 3D in S1502, reject the special reproduction request in S1501, continue the common reproduction (S1503) of image.And judge image be 2D in S1502 in the situation that, accept the special reproduction request in S1501, image reproduction is changed to special reproduction (S1504).

Like this, by prevention, be difficult to the special reproduction that 3D shows, can carry out 3D demonstration.

(the 6th execution mode)

In the present embodiment, the improvement that has been suitable for Depth compute mode is described.

Figure 22 is the block diagram of internal structure that has been suitable for the transcriber of Depth compute mode.As shown in figure 16, known in the internal structure shown in execution mode 1, added Depth computation engine 34.

Depth computation engine 34 has the function that the captions/GUI that can use according to left eye and frame of video are calculated depth.As the computational methods of depth, the depth of each picture pixel of every frame of input 2D video flowing and this 2D video flowing, reproduces machine and generates accordingly 3D video flowing and right eye 3D AV stream for left eye.Which is shown in No. 5929859 specification of United States Patent (USP).In the situation that mode--the Depth compute mode of describing in No. 5929859 specification of United States Patent (USP), also can be by changing a little the method shown in Figure 15, and on 3D video flowing overlapping three-dimensional captions/figure.

Figure 23 is the flow chart of the processing procedure processed of the frame of video under the 3D pattern having adopted in the situation of Depth compute mode.This figure be take Figure 20 as basis mapping, compares as basic Figure 20 with this, and difference is, between step S1401 and step S802, has added step S1701～step S1703.

In the series of steps of this interpolation, Depth computation engine 34 extracts the whole depth information (S1701) of picture of the depth information of each pixel that represents picture.Then,, in the whole depth information of picture that Depth computation engine 34 extracts from S1701, extract the depth information (S1702) corresponding with being judged as nearest pixel.Depth computation engine 34 is saved in the value extracting in S1702 in the storage area of planar movement engine 28 (S1703).

In step S1703, for captions/figure is presented at than the closest approach of video slightly nearby, the value extracting in S1703, preferably also will slightly near value be saved in the storage area of planar movement engine 28.

Then, transcriber 200 carries out the processing of S802～S810, S1401～S1404.For the explanation of the detailed processing of S802～S810, S1401～S1404 at Fig. 8 of execution mode 1, crossed in the explanation of Figure 14, so just do not carried out here.After the processing of step S810, S1404 finishes, as next frame, process, repeat the later processing of S1701.

In the case of this example, S804 in Figure 13 and the video of S807 be not that separator 4 carries out the multichannel of the transport stream on CD separated and video flowing and the right eye video flowing for left eye obtained, but implemented the left eye that machining obtains for the 2D video flowing of input is shown as to 3D, with frame of video and right eye, by frame of video, becomes the step S804 of Figure 13, the object of step S807.

As mentioned above, according to present embodiment, in the Depth compute mode of input, also video is carried out F.F., the special reproduction such as retreats take the depth information of each pixel of 2D video flowing and picture, in the situation that the decoding of the video that can not use from left eye generates frame of video for right eye, also can export two with video, so not only can prevent the flicker of image, and can prevent owing to showing that obstinately captions make image and captions not mate so factitious reproduction.

Moreover, also can combine the 1st execution mode, the 6th execution mode reproduces.That is, if in the method for using embodiment 2, the in the situation that of also can continuing 3D output when special reproduction, also can in special reproduction, be switched to the method for embodiment 2, in common reproduction, by the method for embodiment 1, carry out reproducing content.

(the 7th execution mode)

Above execution mode does not touch the transmission between display unit 400 and transcriber especially, and in the present embodiment, this transmission is discussed.

Below, illustrate that the data between transcriber and display unit transmit through HDMI.

HDMI transmission and reception unit 17 is sent to display unit according to the horizontal synchronizing cycle in display unit with high transfer rate by the pixel data that has carried out the non-compression of a line/flat civilian form in the image data of laminated one-tenth.On the other hand, in horizontal flyback period and vertical flyback period in display unit, to other devices (be not only display unit, also comprise amplifier, loud speaker) that are connected with transcriber, transmit the voice data of non-compression/flat civilian form.By doing like this, the display unit being connected by HDMI, amplifier, these machines of loud speaker can be accepted the voice data of the non-compression/image data of flat civilian form, non-compression/flat civilian form, can realize and reproduce output.HDMI transmits image data, the voice data of non-compression/flat civilian form, so when HDMI connects machine, being severe in judgment, it connects whether the other side is proper machine.Therefore,, when the connection of HDMI, between the transcriber being connected and display unit, mutually authenticate.This mutually authenticates substantially and also carries out when having changed frequency, so when above-mentioned mode altering, carry out the mutual authentication between transcriber-display unit.

Below, how explanation mutually authenticates between transcriber 200 and display unit 400.

Figure 24 illustrates the communication sequence of transcriber 200 and display unit 400.Time shaft in this figure is the longitudinal axis, in HDMI, has transmit stage, mutual authentication phase, these 3 stages of transmit stage.

Switching from transmit stage to mutual authentication phase be take 2D → 3D handover request (or 3D → 2D handover request) as triggering, and the switching from mutual authentication phase to transmit stage ends up being triggering with authentication.That is, the decoding of L image by transcriber end carry out, the expression output of L image is when undertaken by display unit 400, if sent handover request, begin mutual authentication.During this period, the state of display unit 400 for disappearing.In authentication ending phase, event is output to BD-J application program.Then, the decoding of L image, R image is undertaken by transcriber end, and the expression output of L image, R image is undertaken by display unit 400.

Authentication is carried out when HDMI interface wants implementation pattern to switch mutually above.Below, the pattern switching that HDMI interface carries out is described.

By HDMI, new pattern is outputed to display unit 400 (step S31), carry out with display unit 400 that re-synchronizations are processed and authentication processing (step S32) again.Then, wait to be certified completing (step S33), if authenticated, event is outputed to BD-J application program (step S34).

Owing to there is authentication mutually, the displaying contents of display unit 400 is disappeared, so need to manage to make the pattern switching in display unit 400 not occur.

This pattern is switched and is resulted from frequency change, so in the present embodiment, and 2 patterns that the frequency that importing does not cause in display unit 400 is switched.

Video flowing, the right eye for left eye that illustrated are above looked to video flowing with the master that is called in video flowing, that can reproduce separately.On the other hand, by according to and form this master depending on the correlation between each frame of video of video flowing and compressed encoding the video flowing of frame of video composition be called the auxiliary stream of looking.

In addition, by the main frame of video depending on video flowing and the auxiliary frame of video depending on stream with the indication cycle of 1/48 second by " B "-" D "-" B "-" D " like that alternately the pattern of output be called " B-D appearance mode ".

By the main frame of video depending on video flowing and the auxiliary frame of video depending on stream, not alternately output, but reproduction mode is maintained to 3D pattern, same frame of video (is for example repeated to 2 times above, video planes of outputing to left and right, on the video plane 6 shown in Fig. 8, Figure 22, the regional with symbol (L), (R)) on, by being written to frame of video on video plane for reproducing, the reproduction type of carrying out above-mentioned processing is called to B-B appearance mode.Under B-B appearance mode, only have the master that can reproduce separately by " B "-" B "-" B "-" B ", to be repeated like that output depending on the frame of video of video flowing.

In the situation that the reproduction mode that is illustrated in Figure 26 shifts like that by B-D appearance mode, B-B appearance mode, B-D appearance mode, output picture and display frequency, HDMI how to change.The 1st row illustrates the picture that outputs to display unit 400, and the 2nd row illustrates display frequency.This frequency be the frequency with film source material show left eye with, right eye by frame of video, be 48 these values of z frame/second (2 * 24 frame/second).The 3rd row illustrates the state of HDMI.

Transfer from B-D appearance mode to B-B appearance mode is carried out at the time point of having indicated special reproduction to start, and the transfer from B-B appearance mode to B-D appearance mode is carried out when special reproduction finishes.Like this, even the transfer between B-B appearance mode, B-D appearance mode has occurred known, as shown in the 2nd row, display frequency also keeps 48Hz, as shown in the 3rd row, the authentication again in HDMI does not occur.

Figure 27 illustrates owing to being switched to F.F. from common reproduction, being switched to common reproduction from F.F., and how the displaying contents of the decode content in transcriber and display unit 400 changes.Time shaft in this figure is longitudinally, consists of common present stage again, special reproduction stage, common present stage again in these 3 stages.

In common present stage again, transcriber is B-D appearance mode, carries out decoding and the output of L image, R image.Display unit 400 is carried out the alternately output of L image, R image.

In the special reproduction stage, transcriber is B-B appearance mode.Here, if left eye video flowing is master, look video flowing, carry out decoding and the output of L image, L image.Display unit 400 is carried out the alternately output of L image, L image.

Even if there is the switching of these 3 reproduction mode, on HDMI, do not occur again to authenticate yet.

(the 8th execution mode)

The special reproduction illustrating in above execution mode is not dwindled the scope of concrete contents processing and is illustrated, and in the present embodiment, the realization that focus is narrowed down to speed reproduction describes.

First, the video flowing as the basic MPEG4-AVC form of MVC video flowing is described.The video flowing of MPEG4-AVC form consists of I picture, B picture, P picture.This is identical with the video flowing of MPEG2 form.

In I picture, there is IDR picture and Non (non-)-these 2 kinds, IDR I picture.Non-IDR I picture, P picture, B picture are basis codings compressed with the frame correlation of other pictures.B picture refers to the picture that (B) sheet of form (スライス) data form by Bidirectionally predictive (bi-directional predicted), and P picture refers to the picture that (P) the sheet data of form form by Predictive (prediction).In B picture, there is refrence (reference) B picture and nonrefrence (non-reference) B picture.IDR picture and follow B picture after this IDR picture, P picture to form 1 Closed-GOP.On the other hand, Non-IDR I picture and follow B picture after Non-IDR I picture, P picture to form 1 Open-GOP.

In coded sequence, Closed-GOP is arranged in section start by IDR picture.In DISPLAY ORDER, IDR picture is not initial, other pictures (B picture, P picture) beyond IDR picture can not with Closed-GOP before GOP in the picture that exists there is dependence.Like this, Closed-GOP has the effect that the dependence of making finishes.

The difference of coded sequence and DISPLAY ORDER is that the order of IDR picture, Non-IDR I picture, P picture has exchanged.In DISPLAY ORDER, before Non-IDR I picture, there is B picture.B picture before Non-IDRI picture has dependence with GOP above.On the other hand, the later picture of Non-IDR I picture can not have dependence with GOP above.Like this, Open-GOP can have dependence with picture above.

The relation of these I pictures, P picture, B picture and addressed location is 1 addressed location=1 picture.Audio stream also consists of a plurality of audio frames, and the relation of these audio frames and addressed location is also 1 audio frame=1 addressed location.In addition, in BD-ROM, restriction 1PES bag=1 frame.That is, if animation is frame structure, 1PES wraps=1 picture, and the in the situation that of field structure, 1PES wraps=2 pictures.According to these facts, PES wraps the in store picture of ratio or the audio frame with 1 to 1.

It is more than the gop structure in MPEG4-AVC.In this gop structure, which in a plurality of Closed-GOP, the Open-GOP of video flowing which in I picture by selecting to exist in GOP, B picture, P picture reproduce, select to form and reproduce so intermittent reproduction, the reproduction speed in the time of can adjusting speed reproduction.In addition, under 3D pattern, when carrying out speed and reproduce, by only from BD-ROM read main depending on video flowing and auxiliary depending in stream, form the main image data of looking video flowing, under B-B appearance mode, reproduce, alleviate access burden.

Which in a plurality of Closed-GOP, the Open-GOP which in I picture by selecting to exist in GOP, B picture, P picture reproduce, select to form video flowing Figure 28 illustrate, and to reproduce, realize the realization that speed that speed adjusts reproduces routine.

Figure 28 (a) is the figure that reproduces successively this common reproduction of image data comprising in main a plurality of GOP depending on video flowing and auxiliary a plurality of GOP depending on stream.Figure 28 (b) be skip main depending on the B picture that exists in the GOP existing in video flowing, only read successively the figure that I picture, this IP of P picture are read.In this figure (b), although known, be 3D pattern, to auxiliary, depending on stream, do not conduct interviews.

Figure 28 (c) skips the B picture that exists in GOP, P picture, only reads successively the figure that this I of I picture reads.In this figure (c), although also known, be 3D pattern, to auxiliary, depending on stream, do not conduct interviews.

Figure 28 (d) skips this figure skipping of a plurality of GOP.In this figure, reproduce I picture in the I picture comprising in a plurality of GOP, GOP, thereafter, skip the read-out position shown in arrow, reproduce the I picture of the GOP after several.In this figure (d), although known, be 3D pattern, to auxiliary, depending on stream, do not conduct interviews.

If carry out the such IP of Figure 28 (b), read, transcriber carries out the reproduction of 2 speeds substantially; If carry out the such I of Figure 28 (c), reproduce, transcriber carries out the reproduction of 10 speeds.Moreover, if carry out the such reproduction of Figure 28 (d), carry out reproductions more than 30 speeds.In order to alleviate the access burden under 3D pattern, in this figure (b)～(d), only having the main video flowing of looking--left eye for access, only has this left eye reproduced under B-B appearance mode with the I picture in video flowing with the GOP of video flowing.

As mentioned above, the number of the image data that should skip by the speed adjustment according to receiving from remote control, increases and decreases the reproduction speed on animation interval.It is more than the explanation that speed is reproduced.The details of Video Decoder then, is described.

Figure 29 illustrates the internal structure of separator and Video Decoder.As shown in this figure, separator 4 consists of ATC counter 41, source bale breaker 42, PID filter 43, stc counter 44, ATC counter 45, source bale breaker 46, PID filter 47.

ATC counter 41 generates Arrival Time Clock (ATC, the time of advent clock), adjusts the work timing in transcriber.

The in the situation that source bale breaker 42 being stored source bag in read buffer 2a, the moment that the ATS value of the value of the ATC generating at ATC counter and source bag becomes identical, according to the recording rate of AV segment, only this TS bag is sent to PID filter.When this transmits, according to the ATS of each source bag, adjust the moment being input in decoder.

PID filter 43, by PID the TS bag from former bale breaker 22 outputs, TS bag the PID consistent person required with reproduction, according to PID, is sent to each decoder.

Stc counter 44 generates System Time Clock (STC, system clock), adjusts the work timing of each decoder.

ATC counter 45 generates Arrival Time Clock (ATC), adjusts the work timing in transcriber.

The in the situation that source bale breaker 46 being stored source bag in read buffer 2ab, the moment that the ATS value of wrapping in value and the source of ATC counter generation ATC becomes identical, according to the system speed of AV segment, only this TS bag is sent to PID filter.When this transmits, according to the ATS of each source bag, adjust the moment being input in decoder.

The consistent person of PID who records in the stream option table of PID PID filter 47 wraps the TS from former bale breaker 26 outputs, that TS wraps and current broadcasting item, according to PID, is sent to main Video Decoder.

Video Decoder 5 consists of TB51, MB52, EB53, TB54, MB55, EB56, decoder core 57, buffer switch 58, DPB59, picture switch 60.

Transport Buffer (TB, transmission buffer) the 51st, is comprising the buffer that left eye is coated during from 43 output of PID filter with the TS of video flowing, intactly temporarily store TS bag.

Multiplexed Buffer (MB, multiplexing buffer) the 52nd, for when from TB to EB outputting video streams, temporarily store the buffer of PES bag.When transmitting data from TB to MB, remove the TS head of TS bag.

Elementary Buffer (EB, basic buffer) the 53rd, the buffer of the video access unit of preservation in encoding state.When transmitting data from MB to EB, remove PES head.

Transport Buffer (TB) the 54th, comprises right eye and is coated with the TS of video flowing the buffer of while exporting from PID filter, intactly temporarily storing TS bag.

Multiplexed Buffer (MB) the 55th, for when from TB to EB outputting video streams, temporarily store the buffer of PES bag.When transmitting data from TB to MB, remove the TS head of TS bag.

Elementaly Buffer (EB) the 56th, the buffer of the video access unit of preservation in encoding state.When transmitting data from MB to EB, remove PES head.

Decoder core 57 decodes to create frame/field picture by the decoding moment (DTS) in accordance with regulations to each video access unit of video-frequency basic flow.In AV segment, in the compressed encoding form of multiplexing video flowing, there are MPEG2, MPEG4AVC, VC1 etc., so according to the attribute of stream, carry out the coding/decoding method of switching encoding/decoding device core 57.Main while decoding depending on the image data of video flowing to forming, decoder core 57 as reference picture, is carried out motion compensation by future directions or the image data that exists in direction in the past.And when forming auxiliary each image data depending on video flowing and decode, decoder core 57 will form the main image data of looking video flowing as reference picture, carries out motion compensation.If like this image data is decoded, decoder core 57 is sent to DPB59 by the frame/field picture decoding, by showing that the timing of (PTS) is sent to picture switch by corresponding frame/field picture constantly.

The switch decoder information obtaining when buffer switch 58 is used 57 pairs of video access unit of decoder core to decode, decide in which from EB53, EB56 and select next addressed location, the picture of storing in EB53 and EB56 is sent to decoder core 57 by the decoding timing of (DTS) constantly of distributing to video access unit.Left eye is set to and on time shaft, take picture and alternately occur as unit with the DTS of video flowing with video flowing and right eye, so the in the situation that of decoding in advance for example ignoring DTS, the picture of preferably take is sent to decoder core 57 by video access unit as unit.

Decoded Picture Buffer (DPB, decoded picture buffering device) the 59th, the buffer of frame/field picture that temporary transient maintenance decodes.When decode in the video access unit such as the P picture that prediction has been encoded between 57 pairs of pictures of decoder core or B picture, for the picture with reference to having decoded.

Picture switch 60 is in the situation that by being written to video plane from the complete frame/field picture of decoding of decoder core 57 transmission, write destination and be switched to left eye video plane, right eye video plane.In the situation that the stream of left eye, be written out on left eye video plane incompressible image data is instantaneous; And in the situation that the stream of right eye, be written out on right eye video plane incompressible image data is instantaneous.

It is more than the explanation to Video Decoder.Then, the details of how to carry out speed reproduction is described.

When reproducing animation interval, while there is the Video Decoder of internal structure as described above, by skipping image data, read, realize speed and reproduce.

In the present embodiment, according to reproduction speed, implement hiding, 2D, the 3D demonstration judgement processing of captions/GUI, image.For example, for example, in the situation that the reproduction of image, sound, captions is (to reproduce the reproduction speed carry out on an equal basis with 1 speed, while requiring the putting soon, advance frame by frame, retreat frame by frame of reproduction speed of 1.3 times), show with the 3D that continues equally captions/GUI, image for the situation of common reproduction in S1401.

In the situation that only need stop the 3D image that the decoding of captions just can continue image, only image is proceeded to 3D and show.In the situation that if 2D can resultant image and the reproduction speed of captions, by making image, only left eye is used or right eye decoding data, captions are decoded, without planar movement engine 28, just move and synthesize and export with the image that left eye is used, right eye is used, and carry out show image/captions with Java pattern D.Moreover the in the situation that of can not showing with 2D in high-speed retrieval, image, captions are all hidden.

Reproduction processes during this special reproduction can realize with the flow chart of Figure 30.

Figure 30 is the flow chart of the processing procedure of the special reproduction of considering that speed is reproduced.This flow chart, according to the judged result of step S51, step S52, optionally performs step S53, step S54, step S55.Whether the special reproduction of step S51 judgement request comprises and reproduction speed controls of decoding accordingly, and step S52 judges whether it is can be with the speed of B-D appearance mode reproduction.

If speed, below 1.3 times, is transferred to step S53, be switched to B-D appearance mode, by B-D appearance mode, carry out decoding and control.If more than 2.0 times,, in step S54, be switched to B-B appearance mode, by B-B appearance mode, carry out the decoding of IP reproduction, I reproduction etc. and control.Decode accordingly control in the situation that not comprising with speed, carry out the special reproduction (step S55) of request.

In step S52, if if disclose reproduction speed 1.3 times with next execution step S53 reproduction speed 2 times above; perform step the structure of S54, do not consider that reproduction speed is than 1.3 times of large, 2 times of little scopes of ratio, and this does not have and carries out this prerequisite of function that reproduction speed speeds larger than 1.3 times, than 2 times little are reproduced based on transcriber.Yet, if transcriber possesses, in special reproduction, also can carry out reproduction speed in more than 2 times special reproduction and can carry out reproduction speed than 1.3 times of large, to compare the special reproduction of 2 times of little scopes functions, for example changing to and in step S52, in the situation that reproduction speed is larger than 1.3 times, perform step S54.

(the 9th execution mode)

In above execution mode, when request special reproduction, so that 2D reproduction mode turns back to 3D pattern, this is treated to principle and carries out, and in the present embodiment, has proposed to shield with the broadcasting item in playlist the request of the special reproduction that user sends by operating and remote controlling 300.

The UO shielding table of playing in item consists of following sign.

Chapter_serch_mask sign

Chapter_serch_mask sign is to be defined in user to have asked chapter to search in the situation of this reproducing control, whether shielded the sign of this request.Here, chapter search refers to from user and accepts number input there, from the chapter of this number appointment, starts to reproduce this reproducing control.

Time_search_mask sign

Time_search_mask is the sign that is defined in the situation that user asked this reproducing control of time search, whether shields this request.Here, time search refer to from user accept again there now input operation, from reproducing the time point of appointment constantly, start to reproduce this reproducing control.

Skip_next_mask sign, skip_back_mask sign

Skip_next_mask sign, skip_back_mask indicate the sign that means in the situation that, user same with the 1st execution mode have asked to skip the next one, rebound, whether shields this request.

Play_mask sign

Play_mask indicates the sign that means in the situation that user has asked to reproduce this reproducing control of beginning, whether shields this request.

Stop_mask sign

Stop_mask indicates the sign that means in the situation that user has asked reproduction to stop this reproducing control, whether shields this request.

Pause_on_mask sign

Pause_on_mask indicates the sign that means in the situation that user has asked this reproducing control of pause on (time-out), whether shields this request.

Pause_off_mask sign

Pause_off_mask indicates the sign that means in the situation that user has asked this reproducing control of pause off (remove and suspend), whether shields this request.

Still_off_mask sign

Still_off_mask indicates the sign that means in the situation that user has asked to close this reproducing control of rest image pattern, whether shields this request.

Forward_play_mask sign, backward_play_mask sign

Forward_play_mask sign, backward_play_mask sign are to be defined in, user same with the 1st execution mode to have asked F.F., fall in the situation of these reproducing control soon, whether shielded the sign of this request.

Resume_mask sign

Resume_mask indicates the sign that means in the situation that user has asked to restart to reproduce this reproducing control, whether shields this request.

Audio_change_mask sign

Audio_change_mask indicates the sign that means in the situation that user has asked sound to switch this reproducing control, whether shields this request.

PG_textST_change_mask sign

PG_textST_change_mask sign means in the situation that user has asked to switch captions and the captions of drawing with text of drawing with figure (Presenttation Graphics), the sign that whether shields this request.

Angle_change_mask sign

Angle_change_mask indicates the sign that means in the situation that, user same with the 1st execution mode have asked angle to switch this reproducing control, whether shields this request.

Popup_on_mask sign

Popup_on_mask indicates the sign that means in the situation that user has asked to call this reproducing control of popup menu, whether shields this request.

Popup_off_mask sign

Popup_off_mask sign mean in the situation that user asked to close popup menu this reproducing control of demonstration, whether shield the sign of this request.

Select_menu_language_mask sign

Select_menu_language_mask sign mean in the situation that user asked choice menus this reproducing control of descriptive language, whether shield the sign of this request.

Wherein, the just user operation with the shielding of UO shielding table, does not shield the indication from the special reproduction of BD-J application program or movie objects.

It is more than UO shielding table.Use the frame of video of this UO shielding table to process as shown in figure 31.

Figure 31 is the flow chart of the processing procedure of the frame of video processing under 3D pattern.It is the circulation of the processing of repeating step S41～step S43, step S802～step S810, step S811.The termination condition of this circulation is in step S811, to judge not have next frame of video.

Step S41 judges whether user has the request of special reproduction, and step S42 has judged whether to stop request, and step S43 has judged whether to suspend request.

Whether step S44 judgement has shielded special reproduction request in the UO shielding table of current broadcasting item, if shielding is carried out special reproduction in step S45.

Step S42 judges whether to have sent and stops request, if sent, stops asking, and, in step S47, maintains B-D appearance mode, and alternately frame of video and the right eye frame of video of video flowing of video flowing for the left eye of stop position reproduced in output, and returns.

Step S43 judges whether to have asked time-out, if asked,, in step S46, whether judgement has shielded special reproduction request in the UO shielding table of current broadcasting item.If do not shielded,, in step S47, do not maintain B-D appearance mode, alternately frame of video and the right eye frame of video of video flowing of video flowing for the left eye of stop position reproduced in output, and returns.

(the 10th execution mode)

In above execution mode, formation and the reproducting method of the required content of 3D display graphics, captions, image described.Below, the content reproducing method in the situation that the playback mode of describing image has changed.As the playback mode of image, take carried out F.F., retreat, skip etc., situation and the image of the special reproduction of reproduction speed beyond a speed is reproduced are suspended, magic lantern reproduces, situation about stopping is example.

Problem in reproduction processes while being below special reproduction is mentioned.In the situation that carried out the special reproduction of image, in the reproducting method of the 3D content illustrating with figure, the decoding of frame of video does not catch up with, and not only image is chaotic, and the decoding of the caption data coordinating with frame of video does not catch up with yet, and to spectators, provides offending content.

Be below suspend, magic lantern reproduces, the problem in the reproduction processes while stopping is mentioned.

In addition, at image, be suspended, magic lantern reproduces, stopped in the situation that, in the situation that the last frame in the place that show image stops, if show that from 3D being switched to 2D shows, due to and captions/GUI between factitious third dimension poor, eyes do not catch up with, and have damaged original due visual impression, result is that sensation reduces when participating in the cintest, so can bring unplessantness displeasure to spectators.

This flow chart is the circulation of repeating step S61～step S63, judges whether user has sent the indication of special reproduction in step S61, in step S62, judge whether to have sent to stop request, time-out request, and whether be the terminal of video.Step S63 judges whether it is magic lantern play reproduction.

As mentioned above, whether the reproduction type of the PlayItem in play list file represents magic lantern play reproduction stream file, so be switched to while representing to realize the PlayItem of magic lantern play reproduction at current PlayItem, step S63 is judged as "Yes" (Yes).

If asked special reproduction, in step S67, can judgement synthetic with the plane of delineation, if can synthesize possibility, at left eye, with frame of video and the right eye of video flowing, use on the side in the frame of video of video flowing, the figure that synthetic pixel coordinate has changed by planar movement, turns back to circulation.

If can not synthesize, the figure on the synthetic plane of delineation in step S69, uses the side in the frame of video of video flowing and export left eye with frame of video and the right eye of video flowing.

If sent, stop request, time-out request, or the terminal of video, in step S70, judging whether can planar movement and synthetic, if can, the figure (step S71) that is reproducing left eye on stop position and changed by planar movement with the coordinate that synthesizes respectively pixel in the frame of video of video flowing with the frame of video of video flowing and right eye.

If can not planar movement and synthetic, the figure on the synthetic plane of delineation in step S72, and alternately export left eye with the frame of video of video flowing and right eye the frame of video with video flowing.

(the 11st execution mode)

Present embodiment is to offering the improvement of the function of BD-J application program.

In order not make BD-J application requests special reproduction, add and make BD-J application program from playlist information, obtain the function of dimension distinguishing mark.

Below, how describe BD-J application program obtains show state and obtains register settings.To BD-J application program, provide following function: at captions/GUI that 3D is being shown, image, be transformed to 2D or when hiding, to context notification show state, or make it obtain current show state.Now, current show state can be documented in register group 12.By doing like this, can control to such an extent that make content self can not seem unnatural, can alleviate the unplessantness displeasure to spectators.

Then, illustrate reproducing control engine offers BD-J application program by which kind of function.It is that the request of sending according to BD-J application program is carried out that transcriber 200 generates to the processing of the data of display unit 400 outputs, is to realize by the instruction from BD-J platform 22 to reproducing control engine.The details of the instruction from BD-J module 22 to reproducing control engine 14 in reproducing the processing starting is described here.

Specifically, reproducing control engine offers BD-J application program by following 3 instructions.

1. reproduce preparation instruction

Reproducing preparation instruction is for reminding the instruction of preparation.Reproduce preparation instruction and just remind and prepare, whether according to reproducing, preparation instruction is actual is prepared reproducing control engine, can by the attribute on BD-J platform 22, " reproduce and prepare " and obtain.In the situation that " reproduce and prepare " is " carrying out ", according to reproducing preparation instruction, reproduce preparation, obtain current playlist, request reproduction of AV flows, and judges the reproduction mode of current playlist, judgement reproduction mode.In the situation that playlist is 2D, judgement reproduction mode, switches reproduction mode.According to synchronous sign on, ask reproduction of AV stream.

In the situation that " reproduce and prepare " is " not carrying out ", according to reproducing preparation instruction, do not reproduce preparation.By carrying out actual preparation according to reproducing preparation instruction, there is the degree of freedom from BD-J module to increase, can carry out these advantages of careful control, but in the realization of some player, sometimes can not prepare to reproduce preparation instruction, so be provided with this attribute.

2. synchronous sign on

Synchronous sign on is the instruction for reproduction mode is synchronizeed with the pattern attribute of AV stream." reproduce prepare ", be " carrying out ", AV stream be 3D for 2D and reproduction mode in the situation that, according to reproduction preparation instruction, reproduction mode is switched to 2D." reproduce prepare ", be that " not carrying out ", AV stream are 2D and reproduction mode be 3D in the situation that, according to synchronous sign on, reproduction mode be switched to 2D.

3. reproduce sign on

Reproducing sign on is comprehensive above-mentioned two instructions, the instruction for reproducing preparation and synchronously starting.No matter the value of " reproducing and preparing " is how, all obtain current playlist, request reproduction of AV flows, and judges the reproduction mode of current playlist, the reproduction mode in judgement transcriber.In the situation that playlist is 2D, judgement reproduction mode, switches reproduction mode.Thereafter, request reproduction of AV stream.

(the 11st execution mode)

In the present embodiment, illustrate how by the reproduction object of transcriber--BD-ROM is recorded to the execution mode of this recording method in recording medium.

The recording method of present embodiment not only comprises real-time establishment file as described above, directly write to this real time record in the file system area of recording medium, and comprise integral mirror picture that prior establishment will be recorded to the bit stream in file system area, according to this bit stream make stamper, compacting by this stamper carrys out this preformat record of volume production CD.The recording method of present embodiment is also determined by the recording method based on real time record and the recording method based on preformat record.

Figure 33 is the flow chart of the processing procedure of recording method.Step S201 imports animation, sound, captions, these data materials of menu; In step S202, by data material being carried out to digitlization and carrying out compressed encoding, according to mpeg standard, encode, obtain Packet Elementary Stream.In step S203, multiplexing Packet Elementary Stream becomes corresponding clip information next life; In step S204, AV segment and clip information are saved in respectively in different files.

In step S205, create the reproduction paths of regulation AV segment playlist, with playlist, come the program of regulation control procedure, management information to them; In step S206, AV segment, clip information, playlist, program, other management information are written in recording medium.

(the 12nd execution mode)

In the present embodiment, illustrate with which kind of hardware and form the transcriber of describing in above execution mode.

Figure 34 is the cut-away view of the hardware of transcriber.In this figure, the critical piece that forms transcriber is leading section 101, system LSI 102, memory device 103, rearward end 104, nonvolatile memory 105, host microcomputer 106, network interface 107.

Leading section 101 is input data sources.Leading section 101 comprises example BD driver 1a, local storage 1c as shown in Figure 4.

System LSI 102 consists of logic element, becomes transcriber core.At least separator 4, Video Decoder 5a, b, image decoder 7a, b, audio decoder 9, register group 12, reproducing control engine 14, synthetic portion 16, planar movement engine 20 these members are comprised in the inside of this system LSI.

Memory device 103 consists of the array of the memory component of SDRAM etc.Memory device 107 comprises for example read

buffer

2a, 2b, dynamic script memory 23, static scenario memory 13, video plane 6, the plane of delineation 8, interactive graphics plane 10, background plane 11.

Rearward end 104 is connecting interfaces of transcriber inside and other devices, comprises HDMI transmission and reception unit 17.

Nonvolatile memory 105 is read-write recording medium, even if be, does not provide power supply, also can the hold the record media of content, the backup of the reproduction mode of storing for aftermentioned dimension pattern storage portion 29.This nonvolatile memory 105 is such as using flash memory, FeRAM etc.

The microsystem that host microcomputer 106 is comprised of ROM, RAM, CPU, in ROM, recording the program of controlling transcriber, program in ROM is read in CPU, by the cooperation of program and hardware resource, realize the function of Virtual File System 3, HDMV module 24, BD-J platform 22, schema management module 24, UO detection module 26.

Below, illustrative system LSI.System LSI refers to installs bare chip, the integrated circuit that forms of encapsulation on high-density base board.By a plurality of bare chips being installed on high-density base board and encapsulation, make a plurality of bare chips there is contour structures as 1 LSI, be also comprised in that in system LSI, (this system LSI is called as multi-chip module.)。

Here, if be conceived to the kind of encapsulation,, in system LSI, there are QFP (four line flat packaging), these kinds of PGA (pin net array).QFP has installed the system LSI of pin on four sides of encapsulation.PGA has installed the system LSI of a lot of pins on whole bottom surface.

These pins are being born the effect with the interface of other circuit.In pin in system LSI, there is the effect of this interface, so by connect other circuit on these pins of system LSI, and make system LSI play the core of transcriber 200.

This system LSI can cover in transcriber 200 certainly, can also cover TV or game, personal computer, 1seg (ワ Application セグ) mobile phone etc., carry out in the various machines of image reproduction, can greatly expand purposes of the present invention.

The framework of system LSI preferably meets Uniphier framework.

The system LSI that meets Uniphier framework consists of following circuit block.

Parallel data processing device DPP

It is the SIMD type processor that a plurality of processor units (key element プロセッサ) carry out same work, by arithmetic unit built-in in each processor unit is worked with 1 instruction simultaneously, realize the parallelization of processing forming the decoding of a plurality of pixels of picture.

Parallel instructions processor IPP

It by " local storage controller (the Local Memory Controller) " that formed by instruction RAM, instruction cache, data RAM, data cache, " Processing Unit (processing unit) portion " that formed by instruction fetch portion, decoder, performance element, register file, " Virtual Multi Processor Unit (dummy multiprocessor unit) portion " of a plurality of application programs of Processing Unit portion's executed in parallel formed.

MPU piece

It consists of peripheral interfaces such as ARM core, external bus interface (Bus Control Unit:BCU), dma controller, timer, these peripheral circuits of vectored interrupt controller, UART, GPIO (General Purpose Input Output, universal input output), synchronous serial interfaces.

Stream I/O piece

It carries out data input and output through USB interface or ATA Packet (bag) interface with the drive assembly being connected on external bus, hard disk drive device, SD Storage Card Drivers apparatus.

AVI/O piece

It consists of audio frequency input and output, video input output, osd controller, carries out data input and output with TV, AV amplifier.

Memory control block

It is the piece of realizing the read-write of the SD-RAM connecting through external bus, the internal bus connecting portion being connected by the inside of controlling each interblock, carry out the access control portion of data transmission with the SD-RAM that is connected to system LSI outside, the access scheduling portion adjusting from the request of the access SD-RAM of each piece forms.

The details of concrete production process is as described below.First according to the structure chart shown in each execution mode, make the circuit diagram of the part that will make system LSI, with circuit element or IC, LSI, carry out the member in specific implementation structure chart.

If like this specific implementation each member, stipulate bus between connecting circuit element or IC, LSI or its peripheral circuit, with outside interface etc.And then, also stipulate connecting line, power line, ground wire, clock cable etc.When this is stipulated, consider that the specification of LSI is adjusted the work timing of each member, or apply the adjustment that guarantees bandwidth that each member is required etc., carry out completing circuit figure.

If circuit diagram completes, realize design.Realize design and refer to the operation of making substrate layout: determine where the parts on the circuit diagram of making by circuit design (circuit element or IC, LSI) are arranged into go substrate, or how the connecting line on circuit diagram is arranged on substrate.

If carried out like this realizing design, determined the layout on substrate, by realizing design result, be transformed to CAM data, output to the equipment of NC lathe etc.NC lathe, according to these CAM data, carries out SoC realization or SiP and realizes.It is the technology of a plurality of circuit of scribing on 1 chip that SoC (System on chip, System on Chip/SoC) realizes.It is the technology of 1 encapsulation that a plurality of chips are made with resin etc. that SiP (System in Package, system in package) realizes.Through above process, system LSI of the present invention can be made according to the cut-away view of the transcriber 200 shown in each execution mode.

Wherein, the integrated circuit generating is as mentioned above because of the difference of integrated level, sometimes also referred to as IC, LSI, super LSI, special LSI.

In the situation that realizing system LSI with FPGA, latticed by many logical blocks are arranged to, according to the combination of the input and output of recording in LUT (Look Up Table, look-up table), connect vertical/horizontal distribution, can realize the hardware configuration shown in each execution mode.LUT is stored in SRAM, and the content of this SRAM is eliminated when dump, so when utilizing this FPGA, need to, according to the definition of configuration information, the LUT that realizes the hardware configuration shown in each execution mode be written in SRAM.

Hardware for present embodiment beyond middleware and the hardware corresponding with system LSI, system LSI, with the part of the interface of part, middleware and the system LSI of the interface of middleware, with middleware and system LSI beyond required hardware the part of interface, the part of user interface realize, when comprising them and form transcriber, by mutual collaborative work, provide distinctive function.

By the interface of suitable definition and middleware and the interface of middleware and system LSI, can distinguish user interface part, middleware part, the system LSI part of concurrent development transcriber independently, can develop more efficiently.Wherein, in the dividing method of each interface, there are various dividing methods.

(the 12nd execution mode)

The principle of the stereoscopic vision based on planar movement is described in the present embodiment.

In this figure, shown in circle is the picture showing in display frame.

First, in the situation that there is no planar offset, the picture that the picture that right eye is seen, left eye are seen is all same position, thus with two soon this as time focal position be positioned at (Figure 35 (a)) in display frame.

On the other hand, in the situation that the three-dimensional pattern of 3D pattern closes, the picture that left eye is seen seems in the situation position more on the right side that is 0 than planar offset.Now with liquid crystal shutter glasses, right eye be cannot see whatever.On the other hand, the picture that right eye is seen seems in more the keep left position of side of the situation that is 0 than planar offset.Now with liquid crystal shutter glasses, make left eye cannot see whatever (Figure 35 (b)).

People identifies on this focal position and has picture with two focusing.Therefore, if alternately switch left eye with the very short time interval with liquid crystal shutter glasses, see the state of picture and the state that right eye is seen picture, want focal position to gather the position nearer than display frame for people's two, result is to cause an illusion, as there is picture (Figure 35 (c)) on the focal position nearer than display frame.

In Figure 36, shown in circle is the picture showing in display frame.First, in the situation that there is no planar offset, the picture that the picture that right eye is seen, left eye are seen is all same position, thus with two soon this as time focal position be positioned at (Figure 36 (a)) in display frame.

On the other hand, in the situation that the three-dimensional pattern of 3D pattern closes, the picture that left eye is seen seems in more the keep left position of side of the situation that is 0 than planar offset.Now with liquid crystal shutter glasses, right eye be cannot see whatever.On the other hand, the situation that it is 0 that the picture that right eye is seen seems in ratio deviation amount position more on the right side.Now with liquid crystal shutter glasses, make left eye cannot see whatever (Figure 36 (b)).

If alternately switch left eye with the very short time interval with liquid crystal shutter glasses, see the state of picture and the state that right eye is seen picture, want focal position to gather the position more farther than display frame for people's two, result is to cause an illusion, as there is picture (Figure 36 (c)) on the position more farther than display frame.

More than illustrating it is that the graph image being written on graphics plane is described, if certainly interactive graphics plane, video plane, background plane are suitable for the concept of above-mentioned side-play amount, is also same.

(implementation method of protrusion degree/depth)

This figure (a) (b) in, a near side illustrates the graph image that right eye when output use with the right eye that the graphics plane after mobile is exported.The graph image of using with the left eye of the graphics plane output after mobile when a side far away illustrates left eye output.

The symbol that this figure (a) illustrates planar offset is the situation of (graph image that left eye is used is offset to the right, and the graph image that right eye is used is offset left) just.If planar offset is positive value, as shown in figure 35, captions during left eye output seem the righter position of captions when exporting than right eye.That is, convergent point (focal position) is nearer than screen, so that captions also seem is near.

The symbol that this figure (b) illustrates planar offset is negative situation.If negative value, as shown in figure 36, captions during left eye output seem the more left position of captions when exporting than right eye.That is, convergent point (focal position) is more farther than screen, so that captions also seem is far away.

It is more than the explanation to the principle of stereoscopic vision.Then, illustrate under 1plane+Offset pattern, how to carry out the movement of image coordinate as described above.

First, the internal structure that the plane of delineation 8 is described moves the arrangement of the pixel data of front and back with it.

Figure 38 illustrates the internal structure of the plane of delineation 8.In the situation that resolution is set to 1920 * 1080, as shown in this figure (a), the plane of delineation 8 is comprised of horizontal 1920 *

vertical memory elements

1080,8 bit long.This means can be with 1920 * 1080 resolution every 1 pixel memory of preserving the pixel code of 8 bits distribute.The pixel code of 8 bits of storing in memory element, by using the color transformation of color look-up table, is transformed to Y value, Cr value, Cb value.The corresponding relation of the pixel code in this color look-up table and Y value, Cr value, Cb value is stipulated by the palette definition phase in caption data.

This figure (b) illustrates pixel data in store on the plane of delineation 8.As shown in this figure, on the plane of delineation 8 in store graph data by with the suitable pixel data of prospect part (forming the parts of captions " I love "), the pixel data suitable with background parts formation.Here, in the memory element suitable with background parts, the pixel code of in store expression Transparent color, in this part, when synthetic with video plane, the moving image on video plane looks like transparent.On the other hand, dividing in suitable memory element with foreground portion, the pixel code beyond in store expression Transparent color, describes captions by Y, Cr, Cb, α value beyond this Transparent color.In synthetic portion 15, carry out plane when synthetic, in the part suitable with transparent pixels, the content of background graphics plane, video plane looks like transparent, owing to there being this transparent part, so it is synthetic to carry out plane.

After Figure 39 illustrates and moves right, is moved to the left, the pixel data of foreground area and the pixel data of background area.(a) be the pixel data before moving, (b) be the pixel data after moving right.Here, suppose that amount of movement is 15 pixels, " y " of known captions character " I love you " is so mobile that from picture, to have cannot see.(c) be the pixel data after being moved to the left.Here, suppose that amount of movement is 15 pixels, knownly follow " o " this character in captions character " I love " captions character " you " below to occur.

It is more than the explanation of the internal structure of the plane of delineation 8 and the arrangement of its pixel data that moves front and back.

(a) graphics plane that generate from the plane of delineation 8, being moved to the left is shown and move right after graphics plane.

(b) illustrate and move right.As shown in this figure, the method that horizontal direction moves right (1-2) is carried out (1-3) as (1-1) below.(1-1). cut the right-hand member region of the plane of delineation 8.(1-2). by the position of the pixel data existing on the plane of delineation 8 amount of movement shown in along continuous straight runs offset planes side-play amount to the right as mentioned above.(1-3). the high order end at the plane of delineation 8 adds transparent region.

(c) illustrate and be moved to the left.As shown in this figure, the method that horizontal direction is moved to the left (2-2) is carried out (2-3) as (2-1) below.(2-1). cut the left end region of the plane of delineation 8.(2-2). by the position of each pixel data on the plane of delineation 8 amount of movement shown in along continuous straight runs offset planes side-play amount left.(1-3). the right-hand member at the plane of delineation 8 adds transparent region.

(movement of the pixel data in the memory element of graphics plane)

The following describes by movement as described above, how the pixel data in the memory element of graphics plane moves.Graph data consists of the pixel data of 1920 * 1080,1280 * 720 such resolution.

Figure 41 is the figure of pixel data in store on graphics plane.In this figure, square frame is that word length is the memory element of 32 bits or 8 bits, 0001,0002,0003,0004, the numerical value of 07A5,07A6,07A7,07A8,07A9,07AA, these 16 system numbers of 07AB be in the storage space of MPU continuous dispensing to the address of these memory elements.In addition the pixel data of these numeric representations of (0,0) (1,0) (2,0) (3,0) (1916,0) (1917,0) (1918,0) (1919,0) in store which coordinate in memory element in memory element.

Here, coordinate (0,0) the upper pixel data existing is stored in the memory element of address 0001, coordinate (1,0) the upper pixel data existing is stored in the memory element of address 0002, and the upper pixel data existing of coordinate (1918,0) is stored in the memory element of address 07A7, the upper pixel data existing of coordinate (0,1) is stored in the memory element of address 07A9.That is, known graph data is saved to such an extent that make to form a plurality of behavior continuation addresses of figure.By doing like this, by the memory element with continuation address carries out DMA transmission successively to these, can read in groups these pixel datas.

This figure (a) illustrates the graphics plane that planar offset is set to " 3 ", has moved right.Because planar offset is " 3 ", thus known in the memory element of address 0004, the pixel data of the coordinate (0,0) in store graphics plane coordinate system; In the memory element of address 0005, the pixel data of the coordinate (1,0) in store graphics plane coordinate system; In the memory element of address 0006, the pixel data of the coordinate (2,0) in store graphics plane coordinate system.

In addition, known in the memory element of address 07AC, the pixel data of the coordinate (0,1) in store graphics plane coordinate system; In the memory element of address 07AD, the pixel data of the coordinate (1,1) in store graphics plane coordinate system; In the memory element of address 07AE, the pixel data of the coordinate (2,1) in store graphics plane coordinate system.

This figure (b) illustrates the graphics plane that planar offset is set to " 3 ", has been moved to the left.Because planar offset is " 3 ", thus known in the memory element of address 0001, the pixel data of the coordinate (3,0) in store graphics plane coordinate system; In the memory element of address 0002, the pixel data of the coordinate (4,0) in store graphics plane coordinate system; In the memory element of address 0003, the pixel data of the coordinate (5,0) in store graphics plane coordinate system.

In addition, known in the memory element of address 07A9, the pixel data of the coordinate (3,1) in store graphics plane coordinate system; In the memory element of address 07AA, the pixel data of the coordinate (4,1) in store graphics plane coordinate system; In the memory element of address 07AB, the pixel data of the coordinate (5,1) in store graphics plane coordinate system.

As mentioned above, the known graphics plane having moved is the coordinate of each pixel data on graphics plane has been offset to the pixel count shown in planar offset to the right, left from original coordinate.

By making to arrange the address of address change regulation of memory element of each pixel data of pie graph graphic data, can realize the movement of graphics plane.Certainly processing of equal value with it, even unactual, makes to arrange the address change of the memory element of pixel data, if also can realize the movement of graphics plane.

(appendix)

Above, the best execution mode that illustrated when application, applicant can know, but for technology topic shown below, can further be improved or be changed enforcement.As shown in each execution mode, implementing, still implement these to improve/change, is all arbitrarily, by implementer's subjectivity, is decided, and this point please be careful.

(Video Decoder realize number)

In Fig. 8, Figure 22, disclose the realization example that Video Decoder 5 only has 1, and this is because in the situation that reproducing stereopsis with MVC video flowing, can public conduct with reference to the image data of image.

But in reality, preferably realize the Video Decoder of respectively left eye being decoded with video flowing and the Video Decoder that right eye is decoded with video flowing, what make Video Decoder realizes number for " 2 ".

(utilization of automatic reproduction playlist)

The in the situation that of there is " addressable playlist information " in BD-J object, also can, by the timing of having selected the program corresponding with this BD-J object, carry out switching, the switching from 3D pattern to 2D reproduction mode from 2D reproduction mode to 3D pattern.In the case, in the time of will inserting CD or during choice menus etc., program handover request is as triggering, carries out the processing procedure of the flow chart of Figure 12.

When " addressable playlist information " comprises the program corresponding with BD-J object and becomes current program, want the appointment of the playlist of automatic reproduction.When in addition, addressable playlist information comprises the program corresponding with BD-J object and becomes current program, can select to make the appointment of playlist of the application program of its work.

When having selected certain program, reproducing control engine in transcriber does not wait for that the reproduction indication from application program just starts to reproduce the playlist of the addressable playlist information appointment of using the program corresponding with the current program of selecting, in the situation that the end FEFO that the execution of BD-J application program is reproduced than playlist continues to reproduce playlist.

By this, reproduce in advance, in the situation that the class of application program packs spended time into, so the drafting dialogue picture that can not carry out figure always can not be exported, the reproduction image reproducing based on playlist is intactly exported, even if so in the significant situation of start delay in application program, also can first make user watch the reproduction image of playlist.During the start delay of application program, can be in showing the state of whatsit, so can give user with the sense of feeling at ease.

In addition, owing to finishing when different, so even application program because of the exhaustion abnormal ending of resource, the GUI of application program is by cancellation automatically, if intactly continue to display the play, picture is reproduced in list, means that the reproduction image of playlist is continued to output to display unit.By this continuation, export, even the abnormal ending of Java (TM) LISP program LISP, display unit is also being shown the state of whatsit in for the time being, can prevent that abnormal ending due to application program from making picture this state of affairs that disappears.

(applicable object that pattern is switched)

In each execution mode, reproduction mode is altered to 2D from 3D, but also can obtain same effect in the situation that reproduction mode is altered to 3D from 2D.

The side-play amount of 2 times (reuse and)

In step S808 in Figure 13, to video memory 7c, graphical stream in store in d is decoded, and outputs on the plane of delineation 8; But also can be by not carrying out this step, and reuse the plane of delineation utilizing in the step S805 of Figure 13, the plane of delineation is offset in opposite direction to the original amount of 2 times in the S809 of Figure 13, and make need not the 2nd time image encode.

(2 decoders, 2 adders)

In the structure chart of Fig. 7, Video Decoder, video plane, plane of delineation adder respectively have one, but also can be for example for the object of high speed, make each several part respectively have 2, the image that comes image that parallel processing left eye uses and right eye to use.

(dimension knowledge method for distinguishing)

On BD-ROM, having identification stream to be reproduced is that 2D uses or the dimension distinguishing mark that 3D uses, in the present embodiment, in playlist (PL) information, embedded dimension distinguishing mark, but so long as can determine stream main body and this stream be 2D with or the information used of 3D and the information that records also can be recorded on BD-ROM with other forms.

(also using of convergent-divergent)

When the S809 of Figure 13 moving images plane, S805 best and Figure 13 zooms in or out by convergent-divergent equally.

(the default appointment of processing)

The processing of step S801～S810 shown in Figure 13 is the left and right processing used of left eye of having processed storage part 19 default settings, thus first carry out the synthetic and output of left eye, but the processing of right eye is first carried out in the processing of also can default setting right eye using.

(object of change)

More than recorded in the step S805 of Figure 13 the plane of delineation has been offset to certain amplitude in a certain direction, in step S809, be offset in opposite direction same amplitude, but also can change the amplitude of migrated image plane.In addition, also can not two and all be offset, but be offset a certain eyes, and make it have stereoeffect.

(object that depth arranges)

In the situation that only want on the video flowing that 2D uses to make captions/graph data there is depth, carry out the processing of step S802～S809 of Figure 13.Just the processing of S804 and S807 is not to use frame of video and the right eye frame of video of video flowing for left eye, and can be by two of 2D are carried out with the frame on stream for each.

(the preservation address of plane of delineation offset information)

In the 1st execution mode, the plane of delineation offset information of take is present in current playlist information as prerequisite is described, but for exquisiteness realize and the synchronizeing of MVC video flowing, be preferably in MVC video flowing and be provided with offset-lists, preserve plane of delineation offset information here.Thus, can take synchronous fine and smooth as unit realizes of picture.In addition,, the in the situation that of having embedded plane of delineation offset information replace current playlist information in current flow management information, the processing of the step S5 of Figure 12 also can obtain from current flow management information.

(CD ground switches depth one by one)

In the present embodiment, planar movement engine calculates lateral shift value according to the plane of delineation offset information of current playlist information.That is, in the situation that while generating a series of processing of output of left-eye images and right-eye image, there is the switching of playlist, need the processing that again obtains plane of delineation offset information of the step S5 of Figure 12.But, also imagined the situation of not thinking to change one by one the depth of the plane of delineation playlist.For example, be to want to take that CD is as unit or the situation of program unique depth as unit decides of take.

In order to take the CD depth unique as unit decides, imagination content with take the information that CD is unit and be associated.For example, can consider the in store meta file (ZZZZZ.xml) of META catalogue of the various information that " Index.bdmv " that exist under the BDMV catalogue shown in Fig. 2 or in store image works with putting in CD are relevant.

(program ground switches depth one by one)

In order to take the program depth unique as unit decides, imagination content with take the information that program is unit and be associated.The meta file (ZZZZZ.xml) that the META catalogue of the various information that " XXXXX.bdjo " for example, existing under " MovieObject.bdmv " that, can consider to exist under the BDMV catalogue shown in Fig. 2, BDJO catalogue or in store image works with putting in CD are relevant is preserved.

(flicker prevents plan)

When connecting the display unit of the transcriber of BD-ROM etc. and TV etc., sometimes use HDMI, and by showing that from 3D being switched to 2D shows, can prevent the flicker by the image that authentication causes again of HDMI.

(being suitable for of convergent-divergent)

In real world, object nearby seeing greatly, and the object showing at a distance seems little.But only use above-mentioned planar movement, the size of object no change is just displayed on nearby or distant place.In this case, can bring unplessantness displeasure to spectators.In order to eliminate this unplessantness displeasure, and the plane of delineation is moved and carries out convergent-divergent simultaneously along certain direction, it is seemed greatly, or seem little.

For example, the in the situation that of making it be presented at nearby at eccentric panel, by convergent-divergent, increase captions/figure.

(the stream log-on message in rendering data information)

Stream log-on message in rendering data information preferably forms with STN_table.STN_table be to a plurality of stream kinds be defined in one by one form playlist a plurality of in playing, when comprising this STN_table person and becoming current play, allow to reproduce which the table in Basic Flow multiplexing in Basic Flow multiplexing in the AV segment with the main path reference of multipath and the AV segment with the branch path reference of multipath.The stream kind here refers to main video flowing, the second video flowing in picture-in-picture, the main audio stream in audio mixing, the second audio stream in audio mixing in picture-in-picture, manifests graph text caption data, these kinds of interactive graphic stream, and STN_table can should allow the stream reproducing for each these stream kinds login.Specifically, STN_table consists of the array that flows log-on message.Here, stream login refers to when the broadcasting item in STN_table ownership is become to current broadcasting item, will allow the Basic Flow reproducing is for which kind of stream, represents accordingly with this stream number; Stream log-on message adopts the combination of stream project and stream attribute this data structure corresponding with logic stream number.

Stream number in stream login shows by 1,2,3 such integer values, and the maximum number of stream number is the stream number of corresponding stream kind.

Stream attribute comprises the information that represents the language code of stream and the coded system of stream.The stream project corresponding with the stream of main path end comprises Packet Identifier, and the project corresponding with the stream of branch path end comprises sub identifier and the Packet Identifier of playing item of identifier, sign that identifies transfer stream file.

In this stream project, the Packet Identifier of the Basic Flow that description will be reproduced.Due in stream project, the Packet Identifier of the Basic Flow that will reproduce can be described, so the stream number in stream log-on message is saved in the stream number register of transcriber, makes the PID filter of transcriber carry out packet filtering according to the Packet Identifier in the stream project in stream log-on message.By doing like this, in STN_table, allow the coated decoder that outputs to of TS of the Basic Flow of reproduction, reproduce Basic Flow.

These stream log-on messages in stream number table are arranged according to the order of stream number, the order of the stream log-on message of the order based on stream number in the situation that meet the stream of " transcriber can reproduce " this condition and exist a plurality ofly, becomes which the benchmark of preferential selection in them.

By doing like this, creation (オーサリ Application グ) person can convey to transcriber by following policy: in the situation that there is the irreproducible stream of transcriber in the stream log-on message in STN_table, this stream is rejected to outside reproduction; And in the situation that meet the stream of " transcriber can reproduce " this condition and exist a plurality ofly, should preferentially select which in them.

Judge whether exist to meet the stream of " transcriber can reproduce " this condition, select to meet which in the stream of " can reproduce " this condition, when current broadcastings is switched to new broadcasting item and execution when user has asked stream to switch.

Current play item be switched to new broadcasting item etc., while there is the state variation of transcriber, carry out judgement as described above and selection, one of register in transcriber in register group--in stream number register, stream number is set, above-mentioned a series of processes are called to " process that should carry out during state variation ".

In the situation that stream handover request is sent by user, carry out judgement as described above and selection, in the stream number register of transcriber, stream number is set, above-mentioned a series of processes are called to " process while having asked rheology ".

When having inserted BD-ROM, stream number register is set to flow the initial value in log-on message string, said process is called " initialization ".

Stream log-on message string in stream number table has been given priority without exception to the stream with sub-playitem information appointment with the stream of playitem information appointment, even so not multiplexing with video flowing stream, if specified by sub-playitem information, also become the object that selection is selected will be with the stream of video flowing reproduced in synchronization time.

In the situation that transcriber can reproduce with the stream of sub-playitem information appointment and also with the priority of the stream of sub-playitem information appointment than with video flowing multiplexing the priority of graphical stream high, can, by the stream with sub-playitem information appointment for reproducing, replace the stream multiplexing with video flowing.

Like this, provide a kind of approach by stream with sub-playitem information appointment for reproducing, replace with video flowing multiplexing stream, this is only the essence of STN_table.

As the improvement of the STN_table for stereoscopic rendering, the expansion of the distinctive STN_table of 3D pattern (being called STN_table_SS (StereoScopic)) is present in playlist information.This STN_table_SS consists of with the stream log-on message string of interactive graphic stream with stream log-on message string, the right eye of interactive graphic stream with the stream log-on message string, the left eye that manifest graphical stream with the stream log-on message string, the right eye that manifest graphical stream with stream log-on message string, the left eye of video flowing with stream log-on message string, the right eye of video flowing left eye.

When 3D pattern, the stream log-on message string of the stream kind by the stream log-on message string of each the stream kind in STN_table_SS in STN_table is combined.

This combination is carried out as follows: the stream log-on message tandem arrangement of the main video flowing in STN_tabl is changed to the stream log-on message string that the left eye in STN_table_SS is used video flowing with stream log-on message string and the right eye of video flowing; By the stream log-on message tandem arrangement of the second video flowing in STN_table be changed to left eye in STN_table_SS with the stream log-on message string of the second video flowing and right eye the stream log-on message string with the second video flowing; The stream log-on message tandem arrangement that manifests graphical stream in STN_table is changed to the stream log-on message string and the right eye stream log-on message string that manifests graphical stream that manifest graphical stream for left eye in STN_table_SS; The stream log-on message tandem arrangement of the interactive graphic stream in STN_table is changed to the stream log-on message string that the left eye in STN_table_SS is used interactive graphic stream with stream log-on message string and the right eye of interactive graphic stream.

If carry out the combination of STN_table, by the STN_table to after combination, carry out said process, and in stream log-on message string in STN_table from combination, select the stream log-on message of the Basic Flow that will select under 3D pattern, the stream number in this stream log-on message is set in the stream number register of transcriber.And, from this stream log-on message, take out Packet Identifier, make the PID filter of transcriber carry out packet filtering according to this Packet Identifier.By doing like this, can be by forming stream for left eye, right eye is put in decoder with the TS bag of stream, and its reproduction is exported.By doing like this, stream, right eye for left eye can be supplied to reproduce with stream, so if reproduce output combination with these, can carry out stereoscopic rendering.

(distortion of recording medium)

Recording medium in each execution mode comprises whole box-packed media such as CD, semiconductor memory card.The recording medium of present embodiment is for example, with the CD of pre-recorded required data (BD-ROM, the existing readable CD such as DVD-ROM) for example describes, but without being defined in this, for example, the terminal installation 3D content utilization via implementing data required for the present invention comprising of broadcast or net distribution to CD write-in functions (for example can be cited sb. for meritorious service a left side can be included in transcriber, also can be the device beyond transcriber) be recorded to the CD that can write (BD-RE for example, the existing CD of writing such as DVD-RAM) on, the CD that this has been recorded is applicable to transcriber of the present invention, also can implement the present invention.

In addition,, even if recording medium is the semiconductor memory cards such as SD storage card beyond CD, also can implement the present invention.

(reproduction of semiconductor memory card)

In addition, illustrative examples is as the reproduction process when the recording medium by semiconductor memory card.CD for example carrys out sense data through CD drive, and in the situation that using semiconductor memory card, through carrying out sense data for reading the interface of the data in semiconductor memory card.

In more detail, after semiconductor memory card being inserted in the slot (not shown) of transcriber, transcriber and semiconductor memory card are electrically connected to via semiconductor storage card interface.Through semiconductor storage card interface, read the data that recording on semiconductor memory card.

(execution mode of program)

Also can carry out creation procedure according to the processing procedure shown in the flow chart of each execution mode, implement to have recorded the computer-readable recording medium of this program.

First, software developer describes the source program of realizing each flow chart or functional component with programming language.When this is described, software developer is according to the grammer of programming language, with calling of class formation body and variable, aray variable, external function, describes the source program of each flow chart of specific implementation and functional component.

The source program of describing is provided for compiler as file.Compiler compiles these source programs and generates target program.

The compiling that compiler carries out is generated these processes and is formed by syntactic analysis, optimization, resource distribution, code.In syntactic analysis, carry out morphological analysis, syntactic analysis and the semantic analysis of source program, by source transformation, be interlude.In optimization, interlude is carried out to basic blocking, control flow analysis, these operations of data-flow analysis.In resource is distributed, in order to adapt to the instruction set of target processor, the variable in interlude is distributed to register or the memory that the processor of target processor has.In code generates, each intermediate command in interlude is transformed to program code, obtain target program.

Here the target program generating consists of 1 the above program code that makes computer carry out each step of the flow chart shown in each execution mode and each process of functional component.Here, program code has the various like this kinds of the machine code, JAVA bytecode of processor.Program code has various forms to the realization of each step.In the situation that can utilizing external function to realize each step, the call statement of calling this external function becomes program code.In addition the program code of, realizing 1 step also belongs to different target programs sometimes.In the limited risc processor of instruction type, also can, by combination arithmetic operation instruction and logic instruction, branch instruction etc., carry out each step of realization flow figure.

Generate after target program, programmer starts connector to them.Connector is assigned to these target programs in storage space with associated library, and they are connected to 1, generates load module.The load module generating is like this read as prerequisite with computer, for making computer carry out the processing procedure of the processing procedure shown in each flow chart and functional component.Then, program is recorded in computer-readable recording medium and offers user.

Industrial applicability

The present invention relates to the technology that overlapping text and figure show in the reproduction machine that reproduces stereoscopic vision video flowing, on stereoscopic vision video flowing, be specially adapted to not only export stereoscopic vision video flowing but also the stereoscopic vision video reproducing apparatus of three-dimensional output, overlapping text and figure in the lump.

Claims

1. A reproduction device capable of switching the reproduction mode to any one of the 3D mode enabling the user to realize the stereoscopic vision of the video frame and the 2D mode enabling the user to realize the plane vision of the video frame, characterized in that it comprises:

A reading unit for reading a digital stream including a video stream for the left eye and a video stream for the right eye from the recording medium;

The mode storage unit stores the current reproduction mode;

The dimension judgment unit judges whether the digital stream read from the recording medium supports 3D mode;

A splitter that separates a video stream for the right eye and a video stream for the left eye from the digital stream when the condition that the above-mentioned digital stream supports 3D mode and the current playback mode is 3D mode is satisfied, and when the above-mentioned condition is not satisfied In this case, one of the video stream for the right eye and the video stream for the left eye is separated from the above digital stream;

A video decoder is used to obtain video frames for stereoscopic vision or planar vision by decoding the above-mentioned separated video streams;

a video plane for writing the video frames obtained by the above-mentioned video decoder; and

When the playback control unit requests special playback when the current playback mode is the 3D mode, the playback control unit performs the following processing: the video stream obtained from one of the video stream for the right eye and the video stream for the left eye Frames are repeatedly output from the video plane as right-eye video frames and left-eye video frames.

2. The playback device according to claim 1, wherein:

The above reproduction means are:

When special playback is requested while the current playback mode is 3D mode, the playback control section maintains the playback mode in 3D mode, controls the video decoder to write the same video frame output from the video decoder into the On the right-eye video plane and the left-eye video plane included in the video plane;

The video frame to be repeatedly output is a video frame obtained by decoding either one of the video stream for the right eye and the video stream for the left eye separated from the digital stream, and the playback control unit is configured to be able to decode the video frame from the video stream. The same video frame output by the device is repeatedly written on the video plane for the right eye and the video plane for the left eye, respectively.

3. The playback device according to claim 2, wherein:

The instruction for the above-mentioned special playback is either fast forward or rewind.

4. The playback device according to claim 2, wherein:

The aforementioned special reproductions are accompanied by changes in the speed of reproduction;

When special playback accompanied by a change in playback speed is requested, the playback control unit determines whether alternate output of video frames of the video stream for the left eye and video frames of the video stream for the right eye can be performed at the changed playback speed;

The playback control unit repeatedly writes the same video frame output from the video decoder to the right-view video plane and the left-view video plane, when the playback control unit judges that the video frame cannot be reproduced at the changed playback speed. Performed in case of alternate output of video frames.

5. The playback device according to claim 4, wherein:

The playback speed at which video frames of the above-mentioned left-view video stream and video frames of the right-view video stream can be alternately output refers to the playback speed when the special playback is fast forward, and the playback speed when the special playback is frame-by-frame forward. One of the playback speed and the playback speed when the special playback is frame-by-frame rewind.

6. The playback device according to claim 1, characterized in that it comprises:

the Platform Division, which executes bytecode applications; and

The transmission part is configured to cause the display device to perform output of the video frame by transmitting the video frame to the display device connected to the reproduction device;

When the reproduction mode stored in the above-mentioned mode storage unit is switched from 2D mode to 3D mode, or when switched from 3D mode to 2D mode, the transmission means re-authenticates the display device;

After the above-mentioned re-authentication, when a notification is received that the output corresponding to the switched mode can be performed, the bytecode application executed by the above-mentioned platform unit is notified that the output corresponding to the switched mode can be performed. mean.

7. The playback device according to claim 1, wherein:

When playback of the video stream in 3D mode is stopped or paused, the mode storage unit maintains the setting that the playback mode is 3D mode;

The video decoder described above alternately outputs video frames obtained by decoding the video stream for the left eye at the playback stop position and video frames obtained by decoding the video stream for the right eye at the playback stop position.

8. The playback device according to claim 7, wherein:

The reproduction device above includes: a platform unit, executing bytecode applications; a command interpreter, interpreting and executing programs described by commands;

The stop or pause of the above-mentioned video reproduction is one of the following cases:

When the user has operated by remote control;

Instructions issued by the bytecode application executed by the platform department;

A case where an instruction is issued by an object program executed by a command interpreter;

When the video stream for the left eye or the right eye is reproduced to the end point.

9. The playback device according to claim 1, wherein:

When the playback control in the playback device is changed from normal playback to slide show playback,

A video frame obtained by decoding the video stream for the left eye and a video frame obtained by decoding the video stream for the right eye are alternately output.

10. The playback device according to claim 9, wherein:

The above playback control means executes control to cause the video decoder to decode the video stream in the digital stream based on the playback interval information recorded on the recording medium;

The playback interval information includes attribute information indicating whether the above-mentioned digital stream has a slide show attribute or a movie attribute;

The above-mentioned slideshow playback is executed when the current playback section information is switched from playback section information with movie attributes to playback section information with slide show attributes.

11. The playback device according to claim 1, wherein:

Blocking information is recorded in the recording medium to set whether to block an instruction of special playback from the user or an instruction of special playback from the content;

The reproduction control means described above is constituted by:

When a special playback is requested in the 3D mode, it is determined whether the mask information indicates an instruction to block the special playback from the user,

In the case where the mask information indicates masking, special reproduction is not performed, but the video decoder is caused to alternately output video frames,

On the other hand, when the masking information indicates no masking, the playback mode in the mode storage unit can be maintained in the 3D mode, and the same video frame output from the video decoder can be repeatedly written to the right eye of the video plane. On the video plane, on the video plane for the left eye.

12. The playback device according to claim 1, wherein:

The aforementioned digital streams include graphics streams;

The playback device includes an image decoder, an image plane, a plane movement engine, and a synthesis unit;

The reading means further reads offset position information for moving the image plane from the recording medium;

The above splitter also splits out the graphics stream;

The above-mentioned image decoder decodes the above-mentioned separated graphics stream, and writes the graphics obtained through decoding into the above-mentioned image plane;

The above-mentioned plane moving engine moves the coordinates of the pixels constituting the graphics written on the above-mentioned image plane according to the offset position information;

The synthesizing unit synthesizes right-eye and left-eye video frames obtained by decoding the separated right-eye video stream and left-eye video stream, and the moved graphics on the image plane to obtain a 3D video frame. The output video frame in the mode.

13. The reproducing apparatus according to claim 2 or 12, wherein:

In a case where special reproduction is instructed in 3D mode, one of the following is performed:

1) Outputting either a video frame obtained by decoding the video stream for the left eye or a video frame obtained by decoding the video stream for the right eye without synthesizing with graphics;

2) Either one of the video frame obtained by decoding the video stream for the left eye and the video frame obtained by decoding the video stream for the right eye is synthesized with a graphic in which the coordinates of the pixels do not change due to plane movement, and output .

14. The playback device according to claim 11, wherein:

When reproduction of the above video decoder is stopped or paused, one of the following is performed:

1) A video frame obtained by decoding the video stream for the left eye and a video frame obtained by decoding the video stream for the right eye existing at the playback stop position are synthesized, and the coordinates of the pixels changed by planar movement After graphics, output alternately;

2) Only the video frame obtained by decoding the video stream for the left eye and the video frame obtained by decoding the video stream for the right eye existing at the playback stop position are alternately output, and graphics are not composited on the video frame.

15. The playback device according to claim 13, wherein:

The above-mentioned video reproduction stops or pauses when:

1) When the user operates with the remote control;

2) When the bytecode application executed by the platform department issues an instruction;

3) When the target program executed by the command interpreter issues an instruction;

4) When the video stream for the left eye or the right eye is reproduced to the end point.

16. The reproduction apparatus according to claim 11, wherein:

When the playback of the above-mentioned video decoder is changed from normal playback to slide show playback, the display mode is maintained in 3D mode, and one of the following processes is performed:

1) After synthesizing the video frame obtained by decoding the video stream for the left eye and the video frame obtained by decoding the video stream for the right eye, respectively, with a graphic in which the coordinates of the pixels change through plane movement, they are alternately output;

2) Only video frames obtained by decoding the video stream for the left eye and video frames obtained by decoding the video stream for the right eye are alternately output, and graphics on the image plane are not output.

17. An integrated circuit that can be incorporated into a playback device capable of switching the display mode to either a 3D mode that enables a user to realize a stereoscopic vision of a video frame, or a 2D mode that enables a user to realize a two-dimensional vision of a video frame, wherein Features include:

The dimensionality judging unit judges whether the digital stream read from the recording medium supports the 3D mode if the digital stream including the video stream for the left eye and the video stream for the right eye is read from the recording medium;

When the playback control unit requests special playback when the current playback mode is the 3D mode, the playback control unit performs the following processing: the video stream obtained from one of the video stream for the right eye and the video stream for the left eye Frames are repeatedly output from the above-mentioned video plane as video frames for the right eye and video frames for the left eye.

18. A reproduction method for a computer capable of switching the display mode to any one of a 3D mode enabling a user to realize a stereoscopic vision of a video frame and a 2D mode enabling a user to realize a two-dimensional vision of a video frame, wherein: have:

A read step of reading a digital stream including a video stream for the left eye and a video stream for the right eye from the recording medium;

Dimension judgment step, judging whether the digital stream read from the recording medium supports 3D mode;

The separation step is to separate the right-eye video stream and the left-eye video stream from the above-mentioned digital stream when the condition that the above-mentioned digital stream supports 3D mode and the current display mode is 3D mode is established, and if the above-mentioned condition is not established In this case, one of the video stream for the right eye and the video stream for the left eye is separated from the above digital stream;

The decoding step is to obtain video frames for stereoscopic vision or planar vision by decoding the above-mentioned separated video streams;

A video plane writing step, writing the video frame obtained by the above decoding step to the video plane; and

In the playback control step, when special playback is requested when the current playback mode is 3D mode, the following processing is performed. The video stream obtained from one of the above-mentioned right-eye video stream and left-eye video stream Frames are repeatedly output from the above-mentioned video plane as video frames for the right eye and video frames for the left eye.