WO2013031307A1

WO2013031307A1 - Recording device, method and medium, and playback device and method

Info

Publication number: WO2013031307A1
Application number: PCT/JP2012/063034
Authority: WO
Inventors: 昭信渡邊; 星沢　拓; 裕永井; 正幸平林
Original assignee: 日立コンシューマエレクトロニクス株式会社
Priority date: 2011-08-26
Filing date: 2012-05-22
Publication date: 2013-03-07
Also published as: JP2013046323A

Abstract

The present invention provides: playlists in which information that enables 3D content that has been edited in 2D to be displayed correctly, even in 3D, is recorded; and a recording and playback device, method and medium, and a playback device and method therefor. For example, a recording and playback device, method and medium, and a playback device and method, whereby a state regarding whether or not editing in 2D has been reflected in 3D is recorded and replayed for the playlists, are provided. The recording method, whereby information is recorded on the recording medium, is characterized by comprising a step for recording audio/video streams, and a step for recording playlists that stipulate the order in which the audio/video streams are to be replayed. The recording method is further characterized in that: the playlists include user interface application information; the user interface application information includes a 3D synchronization flag representing the synchronization status of information for managing 2D compatible parts of 3D content and information for managing 3D parts; and the 3D synchronization flag is set to asynchronous status when the information for managing the 2D compatible parts is to be updated, and is set to synchronous status when the information for managing the 3D parts is to be updated.

Description

Recording apparatus / method / medium, reproducing apparatus / method

Import by reference

This application claims the priority of Japanese Patent Application No. 2011-184272 filed on August 26, 2011, and is incorporated herein by reference.

The present invention relates to a recording apparatus / method / medium and a reproducing apparatus / method.

As a background art of the present invention, there is JP-A-2007-280496 (Patent Document 1). In this publication, as a problem, “a virtual play list that refers to the same clip becomes reproducible even though a flag indicating whether or not reproducibility is prohibited in the real play list”.
As a solution,
“All playlist information management means for managing information of all playlists (both real and virtual) in the folder, playlist attribute changing means for changing the attributes of the designated playlist, and the playlist Change the attributes of the target clip attribute that changes the attributes of all the clips that are included, the all clip information management means that manages the information of all the clips in the folder, and the attributes of the playlist that references the changed clips A playlist attribute change determining unit that determines whether or not to perform, and a disk writing unit that writes to the information disc of the updated playlist. "
It is described.

JP 2007-280496 A

Patent Document 1 describes a playlist structure of AV data, a clip structure, and an AV data editing apparatus and method. However, the playlist and the clip of Patent Document 1 do not consider the problem that the result of editing in the 2D editing environment cannot be reflected in 3D when the content is 3D.

Such a playlist structure may not be displayed correctly according to the content edited in 2D during 3D playback, for example.

Therefore, the present invention provides a playlist in which information that enables 3D content edited in 2D to be correctly displayed in 3D, its recording / playback apparatus / method / medium, and playback apparatus / method. For example, a recording / reproducing apparatus / method / medium and a reproducing apparatus / method for recording / reproducing a state as to whether or not editing in 2D is reflected in 3D in a playlist are provided.

In order to solve the above problems, for example, the configuration described in the claims is adopted.

The present application includes a plurality of means for solving the above-described problems. To give an example, a recording method for recording information on a recording medium,
Recording an AV stream;
Recording a playlist defining the playback order of the AV stream,
The playlist includes user interface application information, and the user interface application information includes a 3D synchronization flag indicating a synchronization state between management information of the 2D compatible part of 3D content and management information of the 3D part. ,
The 3D synchronization flag is set to an asynchronous state when the management information of the 2D compatible part is updated, and is set to a synchronous state when the management information of the 3D part is updated.

According to the present invention, it is possible to provide a recording / reproducing apparatus / method / medium and a reproducing apparatus / method capable of correctly displaying 3D content edited in 2D even in 3D.

Issues, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

Example of schematic diagram of directory structure and file structure. The example of the schematic diagram which showed the structure of the playlist file. The example of the schematic diagram which showed the structure of user interface application information. The example of the schematic diagram which showed the structure of the time zone. The example of the schematic diagram which showed the structure of playlist information. The example of the schematic diagram which showed the structure of play item. The example of the schematic diagram which showed the structure of bridge sequence information. The example of the schematic diagram which showed the structure of the sub play item. An example of a schematic diagram showing the structure of an MPEG-2 transport stream. The example of the schematic diagram of the recording device which showed the implementation system. The example of the schematic diagram of the reproducing | regenerating apparatus which showed the implementation system. The example of the schematic diagram of a real play list. The example of the schematic diagram which showed an example of the production | generation of a real play list. The example of the schematic diagram which showed an example of the division | segmentation of a real play list. The example of the schematic diagram which showed an example of the division | segmentation of a real play list. The example of the schematic diagram which showed an example of the connection of a real play list. The example of the schematic diagram which showed an example of the connection of a real play list. The example of the schematic diagram which showed an example of the deletion of a real play list. The example of the schematic diagram which showed an example of the partial deletion of the head part of a real play list. The example of the schematic diagram which showed an example of the partial deletion of the head part of a real play list. The example of the schematic diagram which showed an example of the partial deletion of the intermediate part of a real play list. The example of the schematic diagram which showed an example of the partial deletion of the intermediate part of a real play list. The example of the schematic diagram which showed an example (non-seamless connection of two play items) of an assembly edit. The example of the schematic diagram which showed an example (non-seamless connection of two play items) of an assembly edit. The example of the schematic diagram which showed an example (seamless connection of two play items) of an assembly edit. The example of the schematic diagram which showed an example (seamless connection of two play items) of an assembly edit. The example of the schematic diagram of the recording device which showed the implementation system. The example of the schematic diagram of the recording / reproducing part of the recording device which showed the implementation system. The example of the schematic diagram of the video decoding conversion part of the recording device which showed the implementation system. The example of the process of the recording / reproducing apparatus and display apparatus which showed the implementation system. The example of the process of the recording / reproducing apparatus and display apparatus which showed the implementation system. The example of the schematic diagram which displayed the content list on the display apparatus. The example of the process of the recording / reproducing apparatus and display apparatus which showed the implementation system. Example of schematic diagram of directory structure and file structure. The example of the schematic diagram which showed the structure of stream number information. The example of the schematic diagram which showed the structure of 3D stream number information. The flowchart which showed the recording method of the management information when recording 3D content. The flowchart which showed the update method of the management information when editing 3D content in 2D editing environment. The flowchart which showed the update method of the management information when the 3D content edited in 2D editing environment is loaded by 3D reproducing | regenerating apparatus or 3D editing environment. The flowchart which showed the management method when editing 3D content in 3D editing environment.

Hereinafter, an embodiment in which the present invention is applied to a recording apparatus / method / medium and a reproducing apparatus / method will be described.

(recoding media)
FIG. 1 is an example of a schematic diagram of a directory structure and a file structure showing an implementation method of the present invention.

101 is a root directory and includes at least the BDAV directory 102.

102 is a BDAV directory, which includes a PLAYLIST directory 121, a CLIPINF directory 122, a STREAM directory 123, and a BACKUP directory 131.

The root directory 101 includes external BDAV directories such as a BDAV1 directory 103, a BDAV2 directory 104, and a BDAVn directory 105. Here, n in the BDAVn directory 105 is a natural number continuous from 1 corresponding to the number of external BDAV directories. For example, when four external BDAV directories exist under the root directory 101, n is 4, and the directory names are BDAV1, BDAV2, BDAV3, and BDAV4, respectively.

The PLAYLIST directory 121 includes management files such as real playlist files 141 and 142 and a virtual playlist 143.

The CLIPINF directory 122 includes management files such as clip information files 144 and 145.

The STREAM directory 123 includes stream files such as stream files 146 and 147.

Info. The bdav file 111 is a file that stores general information, and is stored in the BDAV directory.

Menu. The tidx file 112 stores menu thumbnail header information.

Menu. The tdt1 file 113 stores menu thumbnail picture data. menu. The tdt2 file 114 is a similar file.

Mark. The tidx file 115 stores mark thumbnail header information.

Mark. The tdt1 file 116 stores mark thumbnail picture data. mark. The tdt2 file 117 is a similar file.

01001. The rpls file 141 includes information regarding the real play list. One rpls file is generated for one real play list. 02002. The rpls file 141 is a similar file.

99999. The vpls file 143 includes information regarding the virtual playlist. One vpls file is generated for one virtual playlist.

01000. The clpi file 144 is a clip information file and includes clip information related to an AV stream file (clip AV stream file, bridge clip AV stream file). 02000. The clpi file 145 is a similar file.

01000. The m2ts file 146 is an AV stream file and includes an MPEG-2 transport stream. 02000. The m2ts file 147 is a similar file.

Clip information file zzzzz. clpi and the AV stream file zzzzz. The file name “zzzzz” of m2ts is a 5-digit integer, and the same 5-digit integer is assigned to the associated clip information file and AV stream file.

Note that the clip information file zzzzz. clpi and the AV stream file zzzzz. A set of m2ts is called a clip.

Thus, a playlist is a file stored in the PLAYLIST directory.

Hereinafter, the real playlist file and the virtual playlist file will be described in detail.

Both real playlists and virtual playlists are composed of the following data.

FIG. 2 is an example of a diagram showing the structure of a playlist file.

201 is a type identifier that stores information indicating a playlist file. For example, it is possible to identify a playlist file by setting a value of “PLAYLIST” in ASCII code.

202 is a version number, which is a number indicating the version of the playlist file.

203 is the playlist information start address, and a value indicating the relative start position of the playlist information in the playlist file in bytes is set. The head starts from 0.

204 is a playlist mark information start address, and a value indicating the relative start position of the playlist mark information in the playlist file in bytes is set. The head starts from 0.

205 is a manufacturer-specific data start address, and a value indicating the relative start position of the manufacturer-specific data information in the playlist file in bytes is set. The head starts from 0. If this value is set to 0, there is no manufacturer-specific data information.

206 is user interface application information having a data structure as shown in FIG.

207 is play list information, which has a data structure as shown in FIG.

208 is playlist mark information.

209 is manufacturer-specific data.

210 is 3D stream number information and has a data structure as shown in FIG.

FIG. 3 is an example of a diagram showing the structure of user interface application information. Stores parameters for the playlist user interface app.

301 is a length indicating the length from immediately after this field to the end of the user interface application information.

321 is a 3D flag, and if 1 is set, it indicates that the content included in the playlist includes 3D (stereoscopic) content. If 0 is set, it indicates that 3D content is not included.

322 is a 3D type, and in combination with the 3D flag 321 indicates a 3D system of content included in the playlist. First, a case where 1 is set in the 3D flag 321 will be described. At this time, if 00 is set in the 3D type 322, it indicates that the content included in the playlist is a side-by-side format. If 01 is set in the 3D type 322, it indicates that the content included in the playlist is the top-and-bottom method. If 10 is set in the 3D type 322, it indicates that the content included in the playlist is the frame packing method. If 11 is set in the 3D type 322, it indicates that the content included in the playlist is another 3D system. Next, a case where 0 is set in the 3D flag 321 will be described. In this case, regardless of the value set in the 3D type 322, it indicates that 3D content is not included.

302 is a character code that defines the character code used in the channel name 314, playlist name 316, and playlist details 318. This also applies to the character code of the mark name in the playlist mark information. For example, 1 is set to Japanese, 16 is set to ASCII code, and 32 is set to Unicode.

303 is a reproduction protection flag. If 1 is set, playlist information such as a playlist name and thumbnail and a playlist are not reproduced and displayed to the user. If authentication by entering the PIN is successful, it will be played. If 0 is set, playback is possible even if the password is not entered.

304 is a recording protection flag. If 1 is set, playlist information other than the recording protection flag must not be changed and deleted. If 0 is set, the user can freely change or delete. If 1 is set, the recording device should reconfirm with the user before the user deletes, edits or overwrites the playlist information. There are cases where a real playlist in which the recording protection flag is set to 0 and a virtual playlist in which the recording protection flag is set to 1 share the same part of the clip. In this case, if the user intends to delete the real playlist, the recording apparatus should reconfirm the user before deleting the real playlist.

305 is a played flag, and if 1 is set, it indicates that this playlist has been played at least once. If 0 is set, it indicates that it has never been played.

Reference numeral 306 denotes an edited flag. If 0 is set, the original data at the time of recording is stored without being changed. If 1 is set, a change has been added. It shows that.

307 is a time zone and has a data structure as shown in FIG.

308 is a recording date and time, which includes date and time information when the playlist is recorded. Shown in local time. The year, month, day, hour, minute, and second are represented by a 4-bit single-digit BCD (Binary Coded Decimal). The first four digits are the four digits of the year.

309 is a playlist length, which indicates the length of the playlist in time units. This is calculated | required by the sum total of the reproduction time of the play item contained in a play list. The play item playback time is the time from IN time to OUT time. Units are rounded up to the second. Hour, minute, and second are represented by 4 bits and 1 digit BCD.

310 is a manufacturer ID, which indicates the manufacturer of the recording device that last updated the playlist.

311 is a manufacturer model code, which indicates the model number of the recording device that last updated the playlist.

Reference numeral 312 denotes a channel number, which is a broadcast channel number or service number selected by the user when the playlist is recorded. In the case of a playlist in which two or more playlists are combined, this value is representative. Indicates the value of. The value is 999 or less. It is invalid when 0xFFFF is set.

313 is the channel name length and indicates the byte length of the channel name. The value is 20 or less.

314 is a channel name, which indicates the broadcast channel name or service name that was selected when the user recorded the playlist. The length from the left end of this field to the byte length indicated by the channel name length 313 is valid.

315 is the playlist name length, which indicates the byte length of the playlist name. The value is 255 or less.

316 is a playlist name including the playlist name. The length from the left end of this field to the byte length indicated by the playlist name length 315 is valid.

317 is the detailed length of the playlist, and indicates the byte length of the playlist details. It becomes a value of 1200 or less.

318 is the playlist details and includes detailed text information of the playlist. From the left end of this field to the byte length indicated by the play list detailed length 317 is effective.

323 is a 3D synchronization flag, which indicates that when the 3D content is edited by an editing machine capable of editing in 2D, the edited content needs to be reflected in the 3D content management information.

For example, if the 3D content is a stream encoded with MPEG4-MVC (Multi View Coding) and consists of Base View and Dependent View, the Base View is compatible with the MPEG4-AVC stream, which is a 2D stream. is there. Therefore, in an environment where MPEG4-AVC can be edited, an MPEG4-MVC Base View stream can be edited.

Furthermore, the management information of the stream is managed separately into a 2D compatible part and a 3D specific part. In an editing environment that supports only 2D, only the 2D compatible part can be edited. In an editing environment that also supports 3D, 2D compatible parts and 3D specific parts can be edited.

FIG. 4 is an example of a schematic diagram showing the structure of the time zone.

401 is padding for alignment.

402 is a daylight saving time flag. If it is set to 0, it indicates standard time, and if it is set to 1, it indicates summer time.

403 is a time zone code, which indicates a positive number if 0 is set, and a negative number if 1 is set.

404 is a time zone value and indicates the absolute value of the time difference from UTC (coordinated universal time). The unit is time (= 60 minutes). If 15 is set, the time zone value is invalid, and the daylight saving time flag, time zone code, and 30 minute flag are invalid.

405 is a 30 minute flag, and if 1 is set, the time zone value indicates that it has an additional difference time of 30 minutes as an absolute value. If 0 is set, the time zone value indicates that there is no additional time.

FIG. 5 is an example of a diagram showing the structure of playlist information.

501 is the length, indicating the length from immediately after this field to the end of the playlist information.

502 is a playlist CPI type, an access point type that is referred to from an IN time or an OUT time in a play item, and an access point type of a mark time stamp in a playlist mark. If 1 is set, it indicates that each access point in the playlist information indicates the display time in the AV stream file, which is called EP_map type playlist information. If 2 is set, it represents the arrival time and is called TU_map type playlist information.

503 is the number of play items, indicating the number of play items in the play list. The play item ID is an integer starting from 0. Entries of play items in the playlist are sorted in the display order.

504 is the number of sub play items and indicates the number of sub play items in the play list.

505 is a play item having a data structure as shown in FIG.

506 is a sub play item and has a data structure as shown in FIG.

FIG. 6 is an example of a diagram showing the structure of a play item.

601 is a length indicating the length from immediately after this field to the end of the play item information.

602 is a clip information file name indicating the name of the clip information file of the clip used in the play item information. This field is zzzzzz. A 5-digit number zzzzz of the file name clpi is shown. Expressed as a character string of ACSII code. The clip stream type field in the clip information file indicates a clip AV stream file (MPEG-2 transport stream).

603 is clip CODEC information, and this field has a value indicating “M2TS” of the ASCII code. All play items in the playlist information have the same value of the clip CODEC information “MTS”. If the playlist CPI type in the playlist information is set to 1 and the clip CODEC information is set to “M2TS”, each clip used in the playlist file has EP_map in the CPI information. . If the playlist CPI type in the playlist information is set to 2 and the clip CODEC information is set to “M2TS”, each clip used in the playlist file has TU_map in the CPI information. .

604 is a connection condition, which indicates a connection condition between the IN time of the current play item and the OUT time of the immediately preceding play item. Any value from 1 to 6 is indicated. If the play item is the first play item in the playlist, the connection condition field is invalid and 1 is set.

605 is STC information. If the CPI type in the CPI information of the clip information file is EP_map, it indicates the STC_ID of the STC sequence including the presentation unit of the current play item. The clip referred to by the clip information file name of the current play item has the STC sequence. The value of STC_ID is defined in the clip sequence information.

606 is the IN time, indicating the IN time of the current play item, that is, the display start time of the current play item. The meaning of the IN time differs depending on the CPI type in the CPI of the clip information file referred to by the clip information file name.

607 is the OUT time, indicating the OUT time of the current play item, that is, the display end time of the current play item. The meaning of the OUT time differs depending on the CPI type in the CPI of the clip information file referred to by the clip information file name.

In the case of EP_map, the IN time and the OUT time indicate display times based on the STC time of the clip used for the play item. It is measured in units of 45 kHz clock. For example, the presentation unit is represented by the upper 32 bits of a 33-bit PTS with 90 kHz accuracy. Further, the system time discontinuity is not included between the IN time and the OUT time. Further, the OUT time indicates a time earlier than the IN time. However, when wrapping around, the IN time is greater than the OUT time.

In the case of TU_map, it indicates the same TU_time_base time as the ATC sequence of the clip referenced by the clip information file name of the play item. Furthermore, IN time and OUT time are measured with a 45 kHz clock. Furthermore, the OUT time is greater than the IN time.

608 is bridge sequence information, which will be described in detail with reference to FIG.

FIG. 7 is an example of a diagram showing the structure of the bridge sequence information.

701 is the bridge sequence information file name, which indicates the name of the clip information file of the bridge clip used in the bridge sequence information. This field includes a 5-digit numerical value (corresponding to the file name zzzzz) described in ASCII code. The clip stream type in the clip information of the clip information file is a bridge clip AV stream (MPEG-2 transport stream).

702 is clip CODEC information, which has a value of “M2TS” in the ASCII code, and indicates that the playlist file uses the MPEG-2 transport stream. The bridge clip used in the bridge sequence information has EP_map in CPI.

621 is multi-angle information indicating that multi-angle entry information is included. The multi-angle entry information includes the number of angles, the clip file name of each angle, clip CODEC information, and STC information.

622 is user operation suppression information, and has information indicating restrictions on user operations during reproduction of the play item. User operations include chapter search, time search, fast forward, rewind, stop, pause, pause release, cursor movement, menu display, button selection, voice selection, angle selection, subtitle display, and the like.

623 is a random access flag, which indicates that playback from the middle of this play item is prohibited during special playback.

624 is still image information, and indicates that the last video is held in a state where the still image is displayed when play item reproduction ends.

625 is stream number information, which will be described in detail with reference to FIG.

FIG. 35 is an example of a diagram showing the structure of stream number information.

The stream number information is information indicating the stream number of the elementary stream included in the play item. The elementary stream includes a main video stream, a main audio stream, a subtitle stream, a menu stream, a sub video stream, and a sub audio stream.

3501 is the length and indicates the length of the stream number information.

3502 is the number of main image information, and indicates the number of main image information included in the stream number information.

3503 is the number of main audio information and indicates the number of main audio information included in the stream number information.

3504 is the number of text subtitle information, which indicates the number of text subtitle information included in the stream number information.

3505 is the number of menu graphic information, which indicates the number of menu graphic information included in the stream number information.

3506 is the number of sub-image information and indicates the number of sub-image information included in the stream number information.

3507 is the number of sub audio information and indicates the number of sub audio information included in the stream number information.

3508 is the number of two-screen information, and indicates the number of two-screen information included in the stream number information.

3509 is main image information, and has as many main image stream entries and attributes as the number of main image information 3502.

3510 is main audio information, and has as many main audio stream entries and attributes as the number of main audio information 3503.

3511 is text subtitle information, which has as many text subtitle stream entries and attributes as indicated by the number of text subtitle information 3504.

3512 is menu graphic information, and has the number of menu graphic stream entries and attributes as indicated by the number of menu graphic information 3505.

3513 is sub-image information, and has as many sub-image stream entries and attributes as the number of sub-image information 3506.

3514 is sub audio information, and has sub audio stream entries and attributes as many as the number of sub audio information 3507.

3515 is two-screen information, and has the same number of two-screen stream entries and attributes as indicated by the number of two-screen information 3508.

Entry includes information such as PID. The attribute includes information such as a video format, an audio format, a frame rate, a sampling rate, and a language.

FIG. 36 is an example of a diagram illustrating the structure of 3D stream number information.

3601 is the length and indicates the length of the 3D stream number information.

3602 is a 3D time stamp and indicates the latest time when the 3D stream number information was updated.

3603 is 2D stream number information, which is stream number information having the structure shown in FIG. When first recorded, a copy of the stream number information 625 is recorded.

Reference numeral 3604 denotes main image 3D information, which is information related to the main image 3D stream that becomes a 3D stream in combination with the main image stream indicated by the main image information 3509. Have the number shown in.

3605 is text subtitle 3D information, which is information regarding the text subtitle 3D stream that becomes a 3D stream in combination with the text subtitle stream indicated by the text subtitle information 3511. The text subtitle 3D stream entry and attribute are set to the number 3504 of text subtitle information. Have the number shown in.

Reference numeral 3606 denotes menu graphic 3D information, which is information related to the menu graphic 3D stream that becomes a 3D stream in combination with the menu graphic stream indicated by the menu graphic information 3512. Have the number shown in.

Reference numeral 3607 denotes sub-image 3D information, which is information related to the sub-image 3D stream that becomes a 3D stream in combination with the sub-image stream indicated by the sub-image information 3513. Have the number shown in.

Reference numeral 3608 denotes two-screen 3D information, which is information regarding a two-screen 3D stream that becomes a 3D stream in combination with the two-screen stream indicated by the two-screen information 3515. Have the number shown in.

FIG. 8 shows an example of the structure of the sub play item.

801 is the length, which is the byte length from immediately after this field to the end of the sub play item.

802 is a clip information file name, which indicates the name of the clip information file of the clip used in the sub play item. This field has a 5-digit number corresponding to zzzzz of the clip name as an ASCII code. The clip stream type in the clip information of the clip information file indicates “clip AV stream (MPEG-2 transport stream)”.

803 is clip CODEC information, which has a value of “M2TS” in the ASCII code and indicates that the MPEG-2 transport stream is used in the playlist file. The clip used in the sub play item has EP_map in the CPI.

804 is a sub play item type, which indicates the type of sub path used in the sub play item, but only a value of 1 is set. A clip AV stream of an after-recording audio stream is used.

805 is STC_ID, which indicates the STC_ID corresponding to the STC sequence of the clip indicated by the clip information file name referred to by the sub play item. Both the sub play item IN time and the sub play item OUT time of the sub play item indicate a presentation unit in the same STC sequence referenced by the STC_ID.

806 is a sub play item IN time, and has a display start time of the sub play item. The sub play item IN time is a display time measured with 45 kHz accuracy from the STC of the clip used in the sub play item.

807 is a sub play item OUT time, a sub play item OUT time, and has a display end time of the sub play item. The sub play item OUT time is a display time measured with an accuracy of 45 kHz from the STC of the clip used in the sub play item. The sub play item OUT time indicates a time earlier than the sub play item IN time, and when the STC wraps around between the sub play item IN time and the sub play item OUT time, the sub play item IN time is the sub play item IN time. It becomes larger than OUT time. Both the sub play item IN time and the sub play item OUT time indicate the display time of the section between the display start time and the display end time corresponding to the STC sequence referenced by the STC_ID of the sub play item.

808 is a synchronous play item ID, which indicates the play item ID of the play item in the playlist. This play item includes a sub play item, and the sub play item is one whose reproduction starts within the reproduction time of the play item. The play item ID is determined by a play list in the play list.

809 is a synchronous play item start PTS, which indicates the display time in the play item pointed to by the synchronous play item ID. The sub play item starts its own display when the display time of the play item reaches the synchronous play item start PTS. The synchronized play item start PTS is a display time measured with a 45 kHz clock of the play item pointed to by the synchronized play item ID.

FIG. 34 is an example of a schematic diagram of a directory structure and a file structure showing another implementation method of the present invention.

3401 is a root directory and includes a BDMV directory 3402. Reference numeral 3402 denotes a BDMV directory, which includes a PLAYLIST directory 3421, a CLIPINF directory 3422, a STREAM directory 3423, and an AUXDATA 3431.

The PLAYLIST directory 3421 includes

playlists

3441, 3442, 3443.
The CLIPINF directory 3422 includes clip information files 3444 and 3445.

The STREAM directory 3423 includes

stream files

3444 and 3445.
AUXDATA 3431 is a directory for storing font files and the like.

Index. The bdmv file 3411 is a file storing overall information. The MovieObject file 3412 is a file that stores title objects.

00001. The mpls file 3441 includes information on a playlist. 00002. mpls files 3442, 00003. The mpls file 3443 is a similar file.

01000. The clpi file 3444 is a clip information file and includes clip information related to the AV stream file. 02000. The clpi file 3445 is a similar file.

01000. The m2ts file 3446 is an AV stream file and includes an MPEG-2 transport stream. 02000. The m2ts file 3447 is a similar file.

With the above configuration, in the first embodiment of the present invention,
An AV stream and a playlist that defines the playback order of the AV stream;
In the user interface application information of the playlist,
It has a 3D synchronization flag indicating the synchronization status of the management information of the 2D compatible part of the 3D content and the management information of the 3D part,
The 3D synchronization flag is set to the asynchronous state when the management information of the 2D compatible part is updated, and is set to the synchronous state when the management information of the 3D part is updated, so that the 3D content edited in 2D is converted to 3D. But it can be displayed correctly.

(Recording device)
First, the recording apparatus will be described with reference to FIGS. 9 and 10.

FIG. 9 is an example of a diagram showing the structure of an MPEG-2 transport stream.

AV stream file has the structure of MPEG-2 transport stream. The MPEG-2 transport stream includes a natural number of aligned units 901. The aligned unit 901 has a size of 6144 bytes (= 2048 × 3 bytes). The aligned unit 901 starts from the first byte of the source packet 902. The length of the source packet 902 is 192 bytes. One source packet includes a TP extra header 903 and a transport packet 904. The length of the TP extra header 903 is four times, and the length of the transport packet 904 is 188 bytes. One aligned unit 901 is composed of 32 source packets 902. The last aligned unit 901 in the MPEG-2 transport stream is composed of 32 source packets 902. Therefore, the MPEG-2 transport stream is terminated at the end of the aligned unit 901. If the last aligned unit 901 is not filled with the input transport stream, the remaining bytes are filled with a transport packet with PID = 0x1FFF, that is, a source packet of a null packet.

The transport packet 904 is defined by ISO / IEC 13818-1.

The TP extra header 903 includes copy permission information 905 and arrival time stamp 906. The copy permission information 905 includes content protection information of the related transport packet 904. The arrival time stamp 906 is set with an arrival time stamp value to be described later.

FIG. 10 is an example of a schematic diagram of a recording apparatus showing an embodiment of the present invention.

1001 is an antenna for inputting a digital broadcast wave.

Reference numeral 1002 denotes a tuner that receives a digital broadcast wave input from the antenna 1001.

Reference numeral 1003 denotes a DEMUX, which separates digital broadcast waves (full TS (Transport Stream)) received by the tuner 1002 into elementary streams as necessary.

1004 is a data selector, and selects a necessary stream from the elementary streams separated by the DEMUX 1003 as necessary.

Reference numeral 1005 denotes a REMUX, which multiplexes the stream sent from the data selector with the MPEG-2 transport stream again as necessary to make a partial TS (Transport Stream).

1006 is a transcoder, which converts the format of the TS audio stream and video stream input from the REMUX 1005 as necessary.

1011 is a video input for inputting an analog video signal.

Reference numeral 1012 denotes A / D conversion, which converts analog data input from the video input 1011 into digital data.

1021 is an audio input for inputting an analog audio signal.

1022 is A / D conversion, which converts analog data input from the audio input 1021 into digital data.

1013 is an encoder that encodes the video data and audio data digitized by the A /

D conversions

1012 and 1022 into an MPEG-2 transport stream.

1014 is a selector, which switches and inputs a stream sent from the transcoder 1006 or the encoder 1013.

1031 is T_STD, which is a transport system target to which an MPEG-2 transport stream at time i is input and is a coder.

1032 is a PLL, which has a frequency of 27 MHz, and is synchronized with the PCR (Program Clock Reference) of the input MPEG-2 transport stream.

1033 is a counter, which is a binary counter that counts pulse signals with a frequency of 27 MHz. The count value i at time i is passed to the packetizer 1034 as arrival time clock (i).

1034 is a packetizer, which adds a TP extra header to all transport packets and generates a source packet stream and an aligned unit. The generated source packet stream is transferred to the write buffer 1035 at the maximum transfer rate RMAX. The packetizer 1034 has a small buffer inside and averages the bit rate of the stream. Although the peak rate of digital broadcasting may exceed RMAX, the transfer rate to the write buffer 1035 is guaranteed to be RMAX or less by an internal buffer.

The arrival time stamp is the time when the first byte of the source packet arrives at the T_STD 1031 and the packetizer 1034. The arrival time stamp (k) is a sample value of the arrival time clock (k). (See the formula below)
Arrival time stamp (k) = Arrival time clock (k)% (2 to the 30th power)
Here, “%” indicates a remainder when divided by (2 to the 30th power).
The maximum difference between the arrival time stamps of two consecutive packets is (2 ³⁰ −1) / 27000000 seconds (= approximately 40 seconds).

If the difference exceeds this value, change the arrival time stamp so that it becomes this maximum value. The recording apparatus needs to assume such a case. When an MPEG-2 transport stream player, which will be described later, outputs a transport stream in accordance with arrival time stamps, the PCR accuracy of the output transport stream is defined by ISO / IEC13818-9.

1035 is a buffer, which is a write buffer for writing the source packet transferred from the packetizer 1034 to the drive 1036. The TS recording rate defined in the clip information of the AV stream file determines the value of RMAX. This RMAX is calculated as follows.

RMAX = TS recording rate x 192/188
The unit of TS recording rate is byte / second.

When the buffer 1035 is not empty, the recording rate to the drive 1036 is RUD, and when the buffer 1035 is a shell, the recording rate to the drive 1036 is 0. Buffer 1035 does not overflow.

Reference numeral 1036 denotes a drive which writes a stream input from the write buffer 1035 to a recording medium such as an optical disk at the maximum recording rate RUD.

1041 is a CPU that controls recording of the entire recording apparatus. Each block in the recording apparatus is connected to the CPU bus indicated by a broken line, and exchanges and controls data.

Reference numeral 1042 denotes a memory, which is used as a work memory of the CPU 1041 or an encoder buffer.

With the above configuration, in the second embodiment of the present invention,
An AV stream, and a recording unit that records a playlist defining the playback order of the AV stream on a recording medium;
A control unit for controlling the recording unit;
In the user interface application information of the playlist,
It has a 3D synchronization flag indicating the synchronization status of the management information of the 2D compatible part of the 3D content and the management information of the 3D part,
The 3D synchronization flag is set to an asynchronous state when the management information of the 2D compatible part is updated,
By setting the synchronization state when the management information of the 3D part is updated,
3D content edited in 2D can be displayed correctly in 3D.

(Playback device)
Next, the playback apparatus will be described with reference to FIG.

FIG. 11 is an example of a schematic diagram of a playback apparatus showing an embodiment of the present invention.

1101 is a drive that reads an MPEG-2 transport stream from a recording medium such as an optical disk and transfers it to the buffer 1102.

1102 is a buffer which buffers the MPEG-2 transport stream read from the drive 1101.

Reference numeral 1103 denotes a depacketizer, which separates the MPEG-2 transport stream input from the buffer 1102 into a TP extra header and a transport packet, and synchronizes the arrival time stamp with the arrival time clock input from the counter 1104. The transport packet is output. First, the initial value of the arrival time clock is passed to the counter 1104.

1104 is a counter, which starts from the initial value received from the depacketizer 1103, counts the 27 MHz pulse signal from the X-tal 1105, and passes the arrival time clock to the depacketizer 1103.

1105 is X-tal, which generates a 27 MHz pulse signal.

Reference numeral 1111 denotes a selector which switches the transport packet input from the depacketizer 1103 for each type and passes it to the corresponding decoder.

1121 is an audio decoder, which decodes the audio packet input from the selector 1111 and passes it to the mixer 1122.

1122 is a mixer, and performs mixing such as volume setting of multi-channel audio at a specified rate as necessary.

1131 is a video decoder, which decodes the video packet input from the selector 1111 and passes it to the video plane 1132.

1132 is a video plane, which is a plane buffer for expanding and displaying the picture data decoded by the video decoder 1131.

1141 is a graphic decoder which decodes the graphic packet input from the selector 1111 and passes it to the graphic plane 1142.

1142 is a graphic plane, which is a plane buffer for developing graphic data input from the graphic decoder 1141.

1143 is a CLUT (Color Look Up Table), which is a table that references RGB data and alpha blend data corresponding to each pixel of the graphic plane 1142.

1151 is an output unit that multiplexes input audio / video / graphics data and outputs the multiplexed audio / video / graphic data from the playback apparatus to the outside in an analog format such as YCbCr or a digital format such as HDMI.

1161 is a CPU, which controls playback control of the entire playback device. Each block in the recording apparatus is connected to the CPU bus indicated by a broken line, and exchanges and controls data.

1162 is a memory, which is used as a work memory of the CPU 1161 or a buffer of a decoder.

FIG. 12 is an example of a schematic diagram of a real playlist and a virtual playlist showing one implementation method of the present invention.

1201 is the first real play list, which refers to the play item 1211.

1202 is the second real play list, which refers to the play item 1212 and the play item 1213.

1211 is the first play item and refers to the clip 1203.

1212 is the second play item and refers to the clip 1204.

1213 is the third play item and refers to the clip 1205.

1203 is the first clip.

1204 is the second clip.

1205 is the third clip.

1231 is the fourth play item and refers to a part of the clip 1203.

1232 is the fifth play item, which refers to a part of the clip 1204.

1233 is the sixth play item, which refers to a part of the clip 1204 and a part of the bridge clip 1208.

1234 is the seventh play item, which refers to a part of the bridge clip 1208 and a part of the clip 1205.

1206 is the first virtual play list, which refers to the play item 1231 and the play item 1232.

1207 is the second virtual play list, which refers to the play item 1233 and the play item 1234.

1208 is the first bridge clip, which is re-encoded from the data at the end of the clip 1204 and the data at the top of the clip 1205.

Explain about playlists.

The playlist is for enabling the user to easily edit the playback time of the clip that the user wants to play. For example, cut and paste editing can be performed without moving, copying, or deleting a clip file entity (including partial movement, partial copying, and partial deletion). A playlist is a collection of continuous playback sections in a clip called play items, and a play item is represented by a set of in points and out points. The IN point and OUT point are time information indicating the position of the clip on the time axis. Therefore, it can be said that the playlist is a collection of play items. The In point means the playback start position of the playback section, and the Out point means the playback end position of the playback section. There are two types of playlists, a real playlist and a virtual playlist.

Explain the real playlist.

Real playlist is used for clip AV stream files, not for bridge clip AV stream files. The real playlist refers to a certain part of the clip.

By referring to the real play list, the data space on the disc is consumed by the size of the reference destination clip (a part thereof), and when the real play list is deleted, the reference destination clip (a part thereof) is deleted. .

Explanation of virtual playlist.

Real playlist is used for both clip AV stream files and bridge clip AV stream files. The virtual playlist has no data entity when used for a clip AV stream file, but has a data entity when used for a bridge clip AV stream file. When a virtual playlist that does not use the bridge clip AV stream file is deleted, the clip does not change.

On the other hand, when the virtual playlist using the bridge clip AV stream file is deleted, the clip AV stream file and the related clip information file do not change, but the bridge clip AV stream file and the related clip information file are not changed. Is deleted.

Clip is a management unit for internal control of the playback device or recording device, and is not displayed on the user interface. Only the playlist is shown to the user.

The following playlist operations are available.

The following are examples of operations related to the real playlist.
(1) Generation of Real Playlist The real playlist generated when the first broadcasted program is recorded is a real playlist that refers to the entire recorded clip.

FIG. 13 is an example of a diagram illustrating an example of generating a real play list.

1301 is a real play list and refers to the play item 1311. At the time of new recording, it is generated as one playlist file.

1311 is a play item and refers to the clip 1303.

Reference numeral 1303 denotes a clip, which is generated as one clip information file and one AV stream file at the time of new recording.
(2) Splitting a real playlist When a single real playlist is split into two real playlists, the clips themselves do not change.

FIG. 14 and FIG. 15 are examples of diagrams showing an example of real play list division.

1401 is a real play list, and refers to the clip 1403 via a play item (not shown).

1403 is a clip.

1421 is a division point and shows an example of dividing the vicinity of the center of the real play list 1401.

1511 is a real play list, which refers to a part of the clip 1503 (a part corresponding to the left of the dividing point 1521) via a play item (not shown).

1503 is a clip, which is the same as the clip 1403.

A real play list 1512 refers to a part of the clip 1503 (a part corresponding to the right side of the dividing point 1521) via a play item (not shown).
(3) Linking real playlists When two real playlists are linked into a new real playlist, the clip itself does not change.

FIG. 16 and FIG. 17 are examples of diagrams showing an example of concatenation of real play lists.

1611 is a real play list, and refers to the clip 1601 via a play item (not shown).

1601 is a clip.

1612 is a real play list, and refers to the clip 1602 via a play item (not shown).

1602 is a clip.

1701 is a clip, which is the same as the clip 1601.

1702 is a clip, which is the same as the clip 1602.

Reference numeral 1721 denotes a real play list, which refers to a clip 1701 and a clip 1702 via play items (not shown).
(4) Deleting the entire real playlist When deleting an entire real playlist, the referenced range of the reference destination clip is deleted.

FIG. 18 is an example of a diagram showing an example of deleting a real play list.

1801 is a real play list, and refers to a clip 1803 via a play item (not shown).

Reference numeral 1803 denotes a clip.
(5) Deleting a part of a real playlist When deleting a part of a clip referenced by a real playlist, change the play item to leave the necessary part, but the part that is no longer referenced in the clip Deleted.

19 and 20 are examples of diagrams showing an example of partial deletion of the top part of the real play list.

1901 is a real play list, which refers to the play item 1911.

1911 is a play item and refers to the clip 1903.

1903 is a clip.

2021 is a real play list and refers to the play item 2031.

2041 is a deletion range, and shows an example in which a part corresponding to the left side of the real play list 1901 is partially deleted.

2031 is a play item and refers to the clip 2023.

2023 is a clip.

When editing and deleting the middle part of a clip AV stream, the remaining part is linked to one clip file.

21 and 22 are examples of diagrams showing an example of partial deletion of the middle part of the real play list.

2101 is a real play list, and refers to the clip 2121 via a play item (not shown).

2121 is a clip.

2141 is a deletion range, and shows an example in which a part corresponding to the intermediate area of the real play list 2101 is partially deleted (= deletion by deletion).

2211 is a real play list, and refers to the clip 2231 via a play item (not shown).

2231 is a clip.

The followings are related to the operation of the virtual playlist.
(1) Assemble Edit As shown in FIGS. 23 to 26, a play item that the user wants to reproduce can be generated and linked to another play item using a virtual play list.

ブリッジ By creating a bridge clip file, it is possible to realize smooth connection playback at the connection point. In order to seamlessly connect and play back an MPEG video stream, it is a common practice to re-encode a very small number of pictures near the connection point into bridge clips.

This process eliminates the need to change the original clip AV stream file and its clip information file.

FIG. 23 and FIG. 24 are examples of diagrams showing an example of assemble editing (non-seamless connection of two play items).

2301 is a real play list, and refers to the clip 2303 via a play item (not shown).

2303 is a clip.

2302 is a real play list, and refers to the clip 2304 via a play item (not shown).

2304 is a clip.

2341 is an IN point, which is the IN time of the play item 2431 registered in the virtual play list.

2342 is an OUT point, which is the OUT time of the play item 2431 registered in the virtual play list.

2343 is an IN point, which is the IN time of the play item 2432 to be registered in the virtual playlist.

2344 is an OUT point, which is the OUT time of the play item 2432 to be registered in the virtual play list.

2406 is a virtual play list, which refers to the play item 2431 and the play item 2432.

2431 is a play item and refers to a part of the real play list 2401.

2432 is a play item and refers to a part of the real play list 2402.

2403 is a clip, which is the same as the clip 2303.

2404 is a clip, which is the same as the clip 2304.

25 and 26 are examples of diagrams showing an example of assembly editing (seamless connection of two play items).

2501 is a real play list, and refers to a clip 2503 via a play item (not shown).

2503 is a clip.

2502 is a real play list, and refers to the clip 2504 via a play item (not shown).

2504 is a clip.

2541 is an IN point, which is the IN time of the play item 2631 to be registered in the virtual play list.

2542 is an OUT point, which is the OUT time of the play item 2631 to be registered in the virtual play list.

2543 is an IN point, which is the IN time of the play item 2632 to be registered in the virtual play list.

2544 is an OUT point, which is the OUT time of the play item 2632 to be registered in the virtual play list.

2606 is a virtual play list, which refers to the play item 2631 and the play item 2632.

2631 is a play item, and a part of the real play list 2601 is referred to.

2632 is a play item and refers to a part of the real play list 2602.

2603 is a clip, which is the same as the clip 2503.

2604 is a clip, which is the same as the clip 2504.

Reference numeral 2605 denotes a bridge clip. By generating the bridge clip, it is possible to realize smooth connection reproduction at the connection point.
(2) Re-editing the virtual playlist By adding or inserting a play item to the virtual playlist, or deleting a play item in the virtual playlist, the IN point of the play item in the virtual playlist, or An editing method of changing the OUT point can be considered.

When the IN point and OUT point referring to the bridge clip are changed by the user operation, the recording device warns the user that the existing bridge clip is deleted and a new bridge clip needs to be generated. A process of executing such a process after confirmation of the user is conceivable.
(3) Delete virtual playlist Delete entire virtual playlist (4) Post-record editing with virtual playlist It is possible to record additional audio (= post-recording) to the virtual playlist. The added audio can be added as a sub path.

The following operations are common to the virtual playlist and the real playlist.
(1) Changing the playlist playback order This is realized by changing the playlist table that defines the playlist playback order. This operation does not change the clip itself.

With the above configuration, in the third embodiment of the present invention,
A reproduction unit that reproduces information from the recording medium, and a control unit that controls the reproduction unit;
On the recording medium, an AV stream and a playlist that defines the playback order of the AV stream are recorded,
In the user interface application information of the playlist,
It has a 3D synchronization flag indicating the synchronization status of the management information of the 2D compatible part of the 3D content and the management information of the 3D part,
When the 3D synchronization flag is set to the asynchronous state, the management information of the 2D compatible part and the management information of the 3D part are synchronized to reproduce the 3D content,
3D content edited in 2D can be displayed correctly in 3D.

(Recording and playback device)
Next, an embodiment of the recording / reproducing apparatus will be described.

FIG. 27 is an example of a hardware configuration diagram illustrating a configuration example of the recording / reproducing apparatus.
2704 is a recording / reproducing apparatus, 2703 is an antenna that receives a broadcast signal transmitted from a transmitting apparatus via a broadcast transmission network such as radio (satellite, terrestrial), and a cable. Unit), 2722 is a general-purpose bus for transmitting control and information between the CPU 2721 and each part in the recording / reproducing apparatus, and 2723 is a broadcast transmitted from the transmission apparatus via a broadcast transmission network such as radio (satellite, ground), cable, etc. A tuner that receives a signal, selects a specific frequency, performs demodulation, error correction processing, and the like, and outputs a multiplexed packet such as MPEG2-Transport Stream (hereinafter also referred to as “TS”), 2724 is a tuner 2723 Descrambler that decodes the scramble of the broadcast signal input from, 2725 is the network terminal 2 56 is a network I / F (Interface) for transmitting / receiving information to / from a network 2755 outside the apparatus, and transmitting / receiving various information and MPEG2-TS between the Internet and the recording / reproducing apparatus, 2726 is, for example, a removable HDD, disk type recording Main recording medium such as medium, flash memory, etc., 2750 is a sub recording medium such as HDD (Hard Disk Drive) or flash memory built in the recording / reproducing apparatus, or removable HDD, disk type recording medium, flash memory, etc. , 2727 controls the main recording medium 2726 and the sub recording medium 2750, and controls the recording of data on the main recording medium 2726 and the sub recording medium 2750 and the reproduction of data from the main recording medium 2726 and the sub recording medium 2750. Part 2729 is MPEG2-TS etc. The data multiplexed in a formula is separated into data such as video ES (Elementary Stream), audio ES, program information, subtitle information, graphic data, or data such as video ES and audio ES is converted into MPEG2-TS, etc. This is a demultiplexing unit that multiplexes them into the format. An ES is each of compressed and encoded image / sound data.

A video decoding conversion unit 2730 decodes the video ES into video data or converts the video ES into a video ES of another format. 2731 decodes the audio ES into audio data and outputs it from the audio output 2742, or the audio ES. The audio decoding conversion unit 2732 converts the video data decoded by the video decoding unit 2730 into 2D according to the instruction of the CPU. Conversion processing for converting 2D video data to 3D, processing for superimposing a display such as 2D or 3D OSD (On Screen Display) created by the CPU 2721 on the video data, or predetermined processing such as HDMI The video data after processing is output to the video signal output unit 2741 and the video data after processing is processed. The video conversion processing unit 2733 outputs a synchronization signal or control signal (used for device control) corresponding to the format from the video signal output unit 2741 and the control

signal output unit

2743, and 2733 is an operation input (for example, IR ( Infrared (Radiation) key code from a remote controller that transmits a signal), and transmits a device control signal (for example, IR) generated by the CPU 2721 or the video conversion processing unit 2732 to the external device from the device control signal transmission unit 2744. A control signal transmission / reception unit, 2734 has a counter inside, a timer for holding the current time, 2746 is a digital input / output terminal that performs necessary processing such as encryption on the TS reconfigured by the demultiplexing unit Output TS from 2757 to the outside, or receive from outside via digital input / output terminal 2757 The high-speed digital I / F such as a serial interface or an IP interface that decodes the TS and inputs the TS to the demultiplexing unit 2729 is represented.

FIG. 28 is an example of a hardware configuration diagram illustrating a detailed configuration example of the recording / reproducing unit 2727 in FIG. 27 in the recording / reproducing apparatus.
Reference numeral 2827 denotes the recording / reproducing unit 2727 in FIG.
Reference numeral 2821 denotes the CPU 2721 in FIG.
Reference numeral 2811 denotes the demultiplexing unit 2711 in FIG.
Reference numeral 2825 denotes a network I / F 2725 in FIG.
Reference numeral 2826 denotes the main recording medium 2726 in FIG.
Reference numeral 2850 denotes the secondary recording medium 2750 in FIG.
Reference numeral 2860 denotes a PLL having a frequency of 27 MHz, which is synchronized with MPEG-2TS PCR (Program Clock Reference) input from the demultiplexing unit 2829.
An encryption unit 2861 performs encryption such as Advanced Encryption System (AES) on the MPEG-2TS input from the demultiplexing unit 2829.
Reference numeral 2862 denotes a counter that counts a 27 MHz pulse signal input from the PLL.
2863 divides the MPEG2-TS input from the encryption unit 2861 into fixed-length data, adds a header including an arrival time stamp generated based on the count value input from the counter 2862, and adds a fixed-length It is a packetizer that outputs as a packet.
Reference numeral 2864 denotes a write buffer that temporarily stores packets input from the packetizer 2863. Further, it is a write buffer that temporarily stores data downloaded from the network via the network I / F 2825. Furthermore, it is also a read buffer that temporarily stores reproduction data input from the storage I / F 2865.
Reference numeral 2865 denotes a storage I / F, which transfers data to the main recording medium 2826 and the sub recording medium 2850 via the buffer 2865. A data bus such as a SATA (Serial ATA) bus is connected to the main recording medium 2826 and the sub recording medium 2850, and data is transferred using the SATA protocol or the like.

Reference numerals

2866 and 2868 denote depacketizers that separate the MPEG-2 transport stream input from the buffer 2864 into a TP extra header and a transport packet, and synchronize the arrival time stamp with the arrival time clock input from the counter 2872. And output a transport packet.

Reference numerals

2867 and 2869 denote decryption units which decrypt the encrypted transport packet.
Reference numeral 2870 denotes X-tal, which generates a 27 MHz pulse signal.

Reference numerals

2871 and 2872 denote counters which start from the initial values received from the

depacketizers

2866 and 2868, count the 27 MHz pulse signal from the X-tal 2870, and pass the arrival time clock to the

depacketizers

2866 and 2868.

Although not shown in FIG. 28, data input / output to / from the high-speed digital I / F 2746 in FIG. 27 is similar to the network I / F 2825, and digital data input from the high-speed digital I / F 2746 is buffered 2864. The digital data recorded on the main recording medium 2826 and the sub-recording medium 2850 and reproduced from the main recording medium 2826 and the sub-recording medium 2850 are temporarily stored in the buffer 2864, and the high-speed digital I Output from / F2746.
FIG. 29 is an example of a hardware configuration diagram illustrating a detailed configuration example of the video decoding conversion unit 2730 in FIG. 27 in the recording / reproducing apparatus.
Reference numeral 2921 denotes the CPU unit 2721 in FIG.
Reference numeral 2949 denotes the memory 2749 in FIG.
Reference numeral 2929 denotes the demultiplexing unit 2729 in FIG.
Reference numeral 2932 denotes the video conversion processing unit 2732 in FIG.
Reference numeral 2930 denotes the video decoding conversion unit 2730 in FIG.
Reference numeral 2980 denotes a switching unit, which has a function of a PID filter that distributes and transfers a transport packet input from the demultiplexing unit 2929 to a set block according to the PID.

Reference numerals

2981, 2984, 2987, 2991, and 2995 are buffers, and temporarily buffer transport packets input / output to / from the switching unit 2980.
Reference numeral 2982 denotes a main decoder which decodes transport packets of a code-compressed video stream input via the buffer 2981.
Reference numeral 2983 denotes a video plane, which is a display plane buffer for expanding the video data decoded by the main decoder 2982.
Reference numeral 2985 denotes a sub-decoder for decoding transport packets of a code-compressed video stream input via the buffer 2984.
Reference numeral 2986 denotes a video plane, which is a display plane buffer for expanding the video data decoded by the sub-decoder 2985.
Reference numeral 2988 denotes a graphic decoder which decodes a transport packet of graphic data input via the buffer 2987.
Reference numeral 2989 denotes a graphic plane which is a plane buffer for developing graphic data decoded and drawn by the graphic decoder 2988.
Reference numeral 2990 denotes a CLUT, which performs conversion processing for replacing graphic data expanded on the graphic plane 2989 with display data.
Reference numeral 2992 denotes a caption decoder, which decodes a transport packet of caption data input via the buffer 2991.
Reference numeral 2993 denotes a subtitle plane, which is a plane buffer for developing graphic data decoded and drawn by the subtitle decoder 2992.
Reference numeral 2994 denotes a CLUT, which performs conversion processing to replace the caption data expanded on the caption plane 2993 with display data.
2996 is a transcoder, which transcodes the transport packet of the code-compressed video stream input via the buffer 2995 into a video stream of another format or other bit rate, and outputs it again to the buffer 2995 To do.
Data output from the

video planes

2983 and 2986 and CLUTs 2990 and 2994 are transferred to the video conversion processing unit 2932.

The recording operation of this embodiment will be described.

The state where the channel to be recorded has already been selected before recording is considered as the initial state. In this state, the digital broadcast wave received by the tuner 2723 via the antenna 2703 is descrambled by the descrambler 2724 and separated into a video stream, audio stream, other graphic stream, subtitle stream, etc. To the decoder.

The video decoding unit 2730 decompresses the video stream, the video conversion processing unit 2732 converts the video data as necessary, and outputs control signals and video outputs from the

output terminals

2732 and 2741.

As described above, the output video output is displayed on the monitor display connected to the recording / reproducing apparatus and can be viewed by the user.

Next, details of the process of starting the recording operation when the recording button is pressed by the user or when the recording apparatus starts recording at the scheduled recording start time will be described.

When the user presses the recording button, a control signal indicating the start of recording is input from the user operation input unit 2745 and received by the control signal transmission / reception unit 2733. The received control signal is temporarily stored in the buffer 2749, interpreted by the CPU 2721, and controlled to start the recording operation.

At the same time, the CPU 2721 notifies the user that the input from the user is normally received and the recording starts using the OSD (On Screen Display) or the like.

The CPU 2721 controls the demultiplexing unit 2729 and transfers the stream of the program instructed by the user to select and record to the recording / reproducing unit 2727.

As shown in FIG. 28, the recording / playback unit 2827 performs encryption processing such as AES (Advanced Encryption System) on the stream data input from the demultiplexing unit 2829, and the packetizer 2863 Packetization processing is performed and temporarily stored in the buffer 2864. In addition, the pulse signal synchronized with the PLL 2860 is counted by the counter 2862 to the PCR of the stream input from the demultiplexing unit 2829, transferred to the packetizer 2863, and added to the transport packet as the arrival time clock of the TP extra header. .

Packets stored in the buffer 2864 are recorded on a main recording medium 2826 such as a DVD or Blu-ray Disc (TM) by the storage I / F 2865. At this time, the video stream and the audio stream are recorded as an m2ts file with a file structure as shown in FIG. For example, the stream file name is “01000.m2ts”.

Furthermore, when recording is completed, a clip information file, a real playlist file, info. A bdav file or the like is recorded on the main recording medium 2826. For example, the clip information file is “01000.clpi”, and the real playlist file is “01001.rpls”.

The recording start time and recording end time of the stream file 146 are recorded in the IN time 606 and the OUT time 607 of the clip information file “01000.clpi”, respectively. “01000” is recorded in the clip information file 602 of the real play list file “01001.rpls”.

When recording only one clip, “1” is recorded in the number of play items 503.

In the mode in which the video stream and audio stream included in the broadcast wave are recorded as they are, the stream is transferred as it is from the demultiplexing unit 2729 of FIG. In the case of recording in a format such as H.264 or Dolby Digital (TM), it is transferred from the demultiplexing unit 2729 to the video decoding conversion unit 2730, and the switching unit 2980 in the video decoding conversion unit 2730 shown in FIG. The data is stored in the buffer 2995, converted in format by the transcoder 2996, and returned to the demultiplexing unit 2729 in FIG. 27 via the buffer 2995 and the switching unit 2980. The returned stream data is transferred to the recording / reproducing unit 2727 and recorded on the main recording medium 2726 as described above.

In addition to recording broadcast waves, content downloaded from the network may be recorded on the main recording medium 2726 and sub-recording medium 2750.

When the recording / playback apparatus is connected to a network 2755 outside the apparatus via a network terminal 2756, a program (eg, JAVA (TM) program) included in the main recording medium 2726 is loaded, and the CPU 2721 executes the program. If the program is described to perform network access, it is possible to connect to a website specified in the program and download new content.

The downloaded content is transferred to the recording / reproducing unit 2727 via the network I / F 2725 and recorded on the sub-recording medium 2750.

Also, digital data may be input via the digital input / output 2757 by the digital I / F 2746 and recorded on the main recording medium 2726 or the sub recording medium 2750.

If the digital input / output 2757 of the recording / reproducing device is USB (Universal Serial Bus) or IEEE 1394, a storage device having the same digital I / F, for example, a digital video camera, a digital still camera, an external HDD, or a USB flash memory And can input digital data.

Alternatively, if the digital input / output 2757 is an SD card (TM) slot, digital data can be directly input from the SD card by inserting the SD card on which the content is recorded into this slot.

For example, in the case of a video camera or a digital camera compatible with AVCHD (TM), connect to the USB, and from the built-in HDD, flash memory, or optical disk to the recording / reproducing apparatus. The compressed digital data recorded in the H.264 format can be input and recorded in the main recording medium 2726 and the sub recording medium 2750.

Whether the recorded content is 3D from the SI information included in the broadcast wave, the program information on the Internet, or the content information input by the user using a remote controller, etc., and whether the 3D format of the recorded content is the side-by-side format A top-and-bottom method, a frame packing method, or another method can be determined.

· Record whether 3D or 3D method is in the real playlist file generated when recording the content. At this time, the 3D flag 321 and the 3D type 322 are recorded.

The processing flow for recording the 3D type 322 will be described with reference to FIG.

When the recording / reproducing apparatus receives the broadcast, information indicating 3D or 2D is acquired from the program information included in the received broadcast data (step 3301). If it is 2D (step 3302), 000 is recorded as a value to be set for the 3D type 322 (step 3303).

Thereafter, the AV stream is recorded (step 3304), and the play list is recorded (step 3312). If it is 3D instead of 2D (step 3302), it is determined whether it is a 1080p24Hz frame pack (step 3305). If it is a 1080p24 Hz frame pack (step 3305), 100 is recorded as a value to be set in the 3D type 322 (step 3306). If it is not a 1080p24Hz frame pack (step 3305), it is determined whether it is 720p60Hz top and bottom (step 3307). If it is 720p60 Hz top and bottom (step 3307), 010 is recorded as a value to be set in the 3D type 322 (step 3308). Thereafter, an AV stream is recorded (step 3304), and a play list is recorded (step 3312). If it is not 720p60Hz top and bottom (step 3307), it is determined whether it is 1080i60Hz side by side (step 3309). If it is 1080i60 Hz side-by-side (step 3309), 110 is recorded as a value to be set in the 3D type 322 (step 3310).

Thereafter, the AV stream is recorded (step 3304), and the play list is recorded (step 3312). If it is not 1080i60 Hz side-by-side (step 3309), a message that recording is impossible is displayed to the user (step 3311).

As described above, the 3D type of the content can be recorded correctly, and if the recording is impossible, the user can be notified that the recording is impossible.

The playback operation of this embodiment will be described.

When the optical disk as the main recording medium 2726 in FIG. 27 is loaded into the recording / reproducing unit 2727, the recording / reproducing unit 2727 notifies the insertion of the disk, and the CPU 2721 instructs the recording / reproducing unit 2727 to access the disk. Execute confirmation of NO. Thereafter, a list of contents recorded on the disc is read, and the contents list is displayed on a display connected to the recording / reproducing apparatus.

FIG. 32 shows an example of a content list recorded by the user.

FIG. 32 is an example of a schematic diagram of a screen displaying a list of programs recorded by the user on the disc.

3201 is a title display part of this screen. The screen shows a list of recorded programs.

3202 is a page number display section. The recorded program list has one page in total, and the first page is displayed.

3203 is a display section for the total number of contents and the total content recording time. In this case, 10 programs are recorded in total, and the total time is 4 hours and 15 minutes.

3204 is a scroll up button. By performing an operation of pressing this button using a cursor or the like by a user operation such as a remote control, the recorded programs displayed in a list are scrolled up.

3205 is a scroll down button. Performs the reverse operation of the scroll up button.

3211 is an information display section of the recorded program 1. In this example, the recording date and time is from 12:00 to 13:00 on September 30, the broadcast channel is BS11 channel, the program name is “golf lesson”, the program is 3D content, The fact that the recording mode is the TS mode is displayed. Reference numeral 3212 denotes an information display section of the recorded program 2. Reference numeral 3213 denotes an information display section of the recorded program 3. Reference numeral 3214 denotes an information display section of the recorded program 4. Reference numeral 3215 denotes an information display section of the recorded program 5. Reference numeral 3216 denotes an information display section of the recorded program 6.

3221 is a menu list of playback functions. By selecting this menu list, it is possible to continuously play back recorded programs.

3231 is a selection frame for indicating an item selected when the user selects an item from items displayed on the screen using a user interface such as a remote controller. In this case, the “reproduction function” is selected.

3222 is a menu list of the deletion function. By selecting this menu list, the recorded program can be deleted.

3223 is a menu list of the dubbing function. By selecting this menu list, a recorded program can be dubbed.

3224 is a conversion function menu list. By selecting this menu list, the recorded program can be converted.

3225 is a menu list of editing functions. By selecting this menu list, the recorded program can be locked for deletion.

3227 is a menu list of display functions. By selecting this menu list, a list of recorded programs can be displayed.

32. In FIG. 32, the target program is selected from the displayed recorded programs 3211 to 3216 with the remote controller or the like, and the “playback function” is selected to start playback.

Or, when the disc is inserted into the recording / reproducing apparatus, it is possible to perform automatic reproduction such as executing the first play or resuming the reproduction from the position where the previous reproduction was completed.

In resume play, resume point list information in which the disc ID and final playback position are paired is stored in the nonvolatile memory in the device when the disc is ejected, and the disc of the inserted disc is inserted when the disc is inserted. When the ID is recognized, the resume point list is referred to, and if there is a matching disc ID, the corresponding final playback position is determined as the playback restart position, jumping to that position and starting playback. It is feasible.

Or info. By registering the file name of the playlist to be resumed in the resume playlist file name of the bdav file 111, the info. This can be realized by reading the bdav file 111 and reproducing the playlist file recorded in the resume playlist file name.

In addition to first play and resume play, the recorded program list display function of the recording / playback apparatus can be used to select a scene or content that the user wants to play from a thumbnail list displayed there. .

For example, when the playlist file 141 (01001.rpls) of FIG. 1 is reproduced, first, the playlist information start address 203 is read out from the playlist file structure of FIG. 2, and the playlist information is stored. Get the offset on the file. Next, when the playlist information is read from the position where the offset is seeked from the top of the playlist file, the playlist information shown in FIG. 5 is obtained. Among these structures, the play item 505 has the structure shown in FIG. 6, and the clip information file name to be reproduced can be known by referring to the clip information file 602. For example, if “01000” is recorded in the clip information file 602, it can be understood that the clip information file 144 (01000.rpls) and the stream file (01000.rpls) may be read. Further, referring to the IN time 606 and the OUT time 607, the reproduction start position and the reproduction end position of the clip to be reproduced can be known. By repeating this as many times as recorded in the number of play items 503, it is possible to acquire which part of which clip should be reproduced in order.

Also, information such as the

3D flag

321 and 3D type 322, recording date and time 308, channel number 312 and playlist name 316 recorded in the playlist file, bit rate, image resolution, and CODEC recorded in the clip information file are recorded. By reading various information such as information, it is possible to acquire not only the video / audio data itself but also various attribute information. The acquired attribute information is subjected to graphic processing by the video conversion processing unit 2732 according to an instruction from the CPU 2721, converted into image data, superimposed on the main image output from the video decoding conversion unit 2730, and video output 2741. Can be transmitted to the display or notified to the user.

Alternatively, information such as the 3D flag 321 and the 3D type 322 is encoded into a control signal by the video conversion processing unit 2732 and output from the control signal 2743 in accordance with an instruction from the CPU 2721.

The control signal output from the control signal 2743 and the video signal output from the video output 2741 are connected to the outside of the recording / playback apparatus as signals compliant with a digital video transmission standard (for example, HDMI standard or DisplayPort standard). Is output to the display.

The display can correctly display the video signal output from the video output 2741 by receiving the control signal output from the control signal 2743 and setting the display mode according to the control signal.

An example of processing of the recording / reproducing apparatus and the display in this embodiment will be described.

The recording / reproducing apparatus can recognize display specifications and performance by acquiring display information from an externally connected display via a control signal 2743 and interpreting the information according to an instruction from the CPU 2721. For example, whether the display is compatible with 3D display, which of the 3D systems is compatible with the display, and the like.

The recording / reproducing apparatus can determine whether or not 3D content can be correctly displayed by comparing the display information acquired and interpreted as described above with information such as the 3D flag 321 and the 3D type 322. If the 3D display cannot be performed correctly, the user can be informed accordingly.

For example, if the 3D flag 321 recorded in the playlist file of the content to be played is 1 and the 3D type 322 is 10, and the connected display is a display that supports only side-by-side stereoscopic display, The content that is being attempted is 3D content recorded by the frame packing method, and the display to be displayed is incompatible with the display of the frame packing method. Therefore, a message such as “This display cannot be stereoscopically displayed on this display” can be displayed on the display to notify the user.

FIG. 30 is an example of a timing chart showing processing of the recording / reproducing apparatus and the display.

When a disc to be played back is inserted into the recording / playback apparatus (step 3001), information about the content is read from the disc (step 3002). Information related to content includes information related to 3D such as the 3D flag 321 and the 3D type 322. The acquired 3D information 3004 is transmitted to the display device via the digital I / F connected to the display device (display) (step 3003).

The display device receives the 3D information sent from the recording / reproducing device and analyzes the content (step 3005). The display device collates the analyzed result with the 3D method supported by the display device, determines whether the display can be performed without conversion or whether conversion is necessary, and sets an optimal display mode (step 3006). After the setting is completed, normal completion information 3008 is returned to the recording / reproducing apparatus (step 3007). If it is determined in step 3006 that the content cannot be displayed, step 3007 returns error information indicating that display is impossible.

When the recording / playback apparatus receives the normal completion information 3008, the recording / playback apparatus starts transmitting the 3D content 3009. If error information is received, 3D content is not transmitted, and the user is notified that display is not possible. At this time, the notification may be displayed on the display device by OSD.

An example of another recording / playback apparatus and display process in the present embodiment will be described.

When a disc to be played back is inserted into the recording / playback apparatus (step 3001), information about the content is read from the disc (step 3002). Information related to content includes information related to 3D such as the 3D flag 321 and the 3D type 322. On the other hand, the display device (display) transmits 3D information 3004 supported by the display device to the recording / playback device via the digital I / F connected to the display device (display) (step 3003). ).

The recording / reproducing apparatus collates the 3D system information 3004 sent from the display device with the 3D information of the content acquired in step 3002, and determines whether it can be displayed without conversion or whether conversion is necessary (step 3005). If conversion is necessary, it is determined whether the recording / playback apparatus can perform conversion (step 3006). If conversion is possible, the 2D / 3D system information 3008 of the content to be transmitted is notified to the display device (step 3007), and the display device receives the 2D / 3D system information 3008 sent from the recording / playback device, A display mode is set (step 3009). If conversion is impossible, the recording / reproducing apparatus notifies the user that display is impossible. At this time, the notification may be displayed on the display device by OSD. In this case, the 3D content is not transmitted to the display device.

After setting the display mode (step 3009), the display device returns normal completion information 3011 to the recording / playback device (step 3010), and the recording / playback device converts the 3D content and displays the converted content 3013. Transmit to the device (step 3012).

The processing flow of 3D type 322 playback will be described with reference to FIG.

When playing back the content recorded by the recording / playback apparatus, the play list is played back (step 3101). Information indicating the 3D method is acquired from the 3D type information 322 included in the playlist (step 3102). If it is 000 (step 3103), it is determined that the content is 2D content, and the AV stream is reproduced (step 3104).

If it is not 000 (step 3103), it is determined whether it is 100 (step 3105). If 100 (step 3105), it is determined that the frame pack is a 1080p24Hz frame pack, and it is confirmed whether the 1080p24Hz frame pack is included in the 3D format supported by the display device (step 3106). If it is included, it is determined that display is possible (step 3106), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If it is not included, it is determined that display is impossible (step 3106), and it is confirmed whether the recording / playback apparatus supports the conversion function of 1080p24Hz frame pack content (step 3110). If it is compatible (step 3110), the AV stream is converted (step 3111), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If not supported (step 3110), a message indicating that reproduction is impossible is displayed to the user (step 3112).

If not 100 (step 3105), it is determined whether it is 010 (step 3108). If it is 010 (step 3108), it is determined that the top and bottom is 720p60Hz, and it is confirmed whether or not the 720p60Hz top and bottom is included in the 3D system supported by the display device (step 3106). If it is included, it is determined that display is possible (step 3106), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If it is not included, it is determined that display is impossible (step 3106), and it is confirmed whether or not the recording / playback apparatus supports the function of converting 720p60Hz top and bottom content (step 3110). If it is compatible (step 3110), the AV stream is converted (step 3111), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If not supported (step 3110), a message indicating that reproduction is impossible is displayed to the user (step 3112).

If it is not 010 (step 3108), it is determined whether it is 110 (step 3109). If it is 110 (step 3109), it is determined that it is 1080i60Hz side-by-side, and it is confirmed whether 1080i60Hz side-by-side is included in the 3D system supported by the display device (step 3106). If it is included, it is determined that display is possible (step 3106), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If it is not included, it is determined that display is impossible (step 3106), and it is confirmed whether the recording / playback apparatus supports the conversion function of 1080i60Hz side-by-side content (step 3110). If it is compatible (step 3110), the AV stream is converted (step 3111), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If not supported (step 3110), a message indicating that reproduction is impossible is displayed to the user (step 3112).

As described above, the 3D type of content can be correctly played back, and if playback is impossible, the user can be notified that playback is not possible.

FIG. 27 is used to explain the details of the process of reading desired data from the AV stream file and displaying it on the display.

The AV stream file read from the main recording medium 2726 is separated into elementary streams by the demultiplexing unit 2729 via the recording / reproducing unit 2727, the video stream to the video decoding conversion unit 2730, and the audio stream to audio decoding. The data is transferred to the conversion unit 2731.

The video stream is decoded by the video decoding conversion unit 2730 and output from the video output 2741 via the video conversion processing unit 2732.

The audio stream is decoded by the audio decoding conversion unit 2731 and output from the audio output 2742.

Details of the recording / reproducing unit 2727 will be described with reference to FIG.

The audio / video stream data of the AV stream file recorded on the main recording medium 2826 is read by the designated length from the designated sector in response to the read request command from the storage I / F 2865 and exceeds a certain amount in the buffer 2864. Accumulated.

The stream data stored in the buffer 2864 is read in units of TS packets in response to a request from the depacketizer 2866, and the packet is resolved by the depacketizer 2866 and the arrival time stamp in the header is analyzed. Then, the arrival time stamp and the clock information supplied from the counter 2872 are compared, and the packet is transferred to the decoding unit 2867 at a correct interval. The decryption unit 2867 decrypts the packet encryption and sends it to the demultiplexing unit 2829.

On the other hand, the same processing is performed for the path from the buffer 2864 to the packetizer 2868 and the decoding unit 2869. As a result, it becomes possible to perform two streams of processing at the same time, and a function for superimposing a sub image on a main image, for example, a PictureInPicture function, a PopUpMenu function, and the like can be realized.

It is also possible to simultaneously process the AV stream file read from the main recording medium 2826 and the AV stream file read from the sub recording medium 2850 at the same time.

37 to 40, an example of a management method that can correctly reflect the editing result even in 3D when 3D content is edited in the 2D editing environment will be described.

FIG. 37 is a flowchart showing a method for recording management information when recording 3D content.

When 3D content is recorded (step 3701),

stream number information

625 and 3D stream number information 210 of the recorded 3D content are recorded in the playlist (step 3702, step 3703). Further, the edited flag 306 is set to 0 (step 3704), and the 3D synchronization flag 323 is set to 1 (step 3705). Finally, the 3D time stamp 3602 is updated (step 3706), and the time stamp of the playlist file is updated (step 3707).

This will make the 3D timestamp 3602 and the playlist file timestamp the same value. A 3D synchronization flag 323 indicates a 2D / 3D synchronization state. Furthermore, the 2D stream number information 3603 of the stream number information 625 and the 3D stream number information 210 has the same contents.

FIG. 38 is a flowchart showing a method for updating management information when editing 3D content in a 2D editing environment.

When an editing operation for changing the stream number information is performed on the recorded 3D content in the 2D editing environment (step 3801), the stream number information 625 is updated (step 3802), and the edited flag 306 is set. 1 is set (step 3803), and the 3D synchronization flag is set to 0 (step 3804). Further, the time stamp of the file is updated (step 3805).

This makes the 3D timestamp 3602 and the playlist file timestamp different values. A 3D synchronization flag 323 indicates a 2D / 3D asynchronous state. Furthermore, the 2D stream number information 3603 of the stream number information 625 and the 3D stream number information 210 has different contents.

Editing that changes the stream number information includes 3D / 2D conversion of the main image stream, 3D / 2D conversion of the text subtitle stream, and the like.

FIG. 39 is a flowchart showing a method for updating management information when 3D content edited in the 2D editing environment is loaded in the 3D playback device or the 3D editing environment.

When the 3D content edited in the 2D editing environment is loaded in the 3D editing environment, the edited flag of the playlist file is checked to determine whether editing has been performed (step 3901). If it has been edited, it is confirmed whether or not the 3D stream number information of the playlist file exists, and it is determined whether or not it is 3D content (step 3902). If it is 3D content, the 3D synchronization flag of the playlist file is confirmed, and it is determined whether or not the management information of the 2D compatible part and the 3D specific part is synchronized (step 3903). If not synchronized, the 3D time stamp 3602 is compared with the time stamp of the playlist file to determine whether they are the same, and it is determined whether the content edited in the 2D editing environment needs to be reflected in the 3D specific part. (Step 3904).

Alternatively, the 2D stream number information 3603 of the stream number information 625 and the 3D stream number information 210 may be compared, and if they are different, it may be determined that the content edited in the 2D editing environment needs to be reflected in the 3D specific part. Is possible.

If it is determined that reflection is necessary (step 3904), the 3D stream information 210 is updated (step 3905). Then, the 3D synchronization flag is set to 1 (step 3905), the 3D time stamp is updated (step 3907), and the time stamp of the playlist file is updated (step 3908).

This makes it possible to reproduce the 3D content in a state in which the edited content executed in the 2D editing environment is correctly reflected.

In the case of a 3D playback device, instead of updating the file from step 3905 to step 3908, the management information is updated on the memory in the playback device, and this is used during playback to rewrite the file on the recording medium. Even if it is not possible, it can be reproduced in 3D correctly according to the editing contents of 2D.

FIG. 40 is a flowchart showing a management method when editing 3D content in the 3D editing environment.

When an editing operation for changing the stream number information is performed on the recorded 3D content in the 3D editing environment (step 4001), the stream number information 625 is updated (step 4002), and the 3D stream number information 210 is updated. (Step 4003), the 3D time stamp 3602 is updated (step 4004), the edited flag 306 is set to 1 (step 4005), and the 3D synchronization flag 323 is set to 1 (step 4006). Further, the time stamp of the file is updated (step 4007).

With the above configuration, in the fourth embodiment of the present invention,
An AV stream, and a recording unit that records a playlist defining the playback order of the AV stream on a recording medium;
A reproduction unit that reproduces information from the recording medium, and a control unit that controls the recording unit and the reproduction unit,
In the user interface application information of the playlist,
It has a 3D synchronization flag indicating the synchronization status of the management information of the 2D compatible part of the 3D content and the management information of the 3D part,
The 3D synchronization flag is set to an asynchronous state when the management information of the 2D compatible part is updated,
When the management information of the 3D part is updated,
When the 3D synchronization flag is set to the asynchronous state, the management information of the 2D compatible part and the management information of the 3D part are synchronized to reproduce the 3D content,
3D content edited in 2D can be displayed correctly in 3D.

In addition, this invention is not limited to the above-mentioned Example, Various modifications are included. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

In addition, each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor. Information such as programs, tables, and files for realizing each function should be stored in a memory, a hard disk, a recording device such as SSD (Solid State Drive), or a recording medium such as an IC card, SD card (TM), or DVD. Can do.

Also, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

In addition, although the configuration in which the determination by the 3D synchronization flag, the determination by the time stamp comparison, and the determination by the stream number information comparison are performed continuously is shown, it can be realized by a configuration in which only one or two of them are combined And has the same effect.

301 Length 302 Character code 303 Playback protection flag 304 Recording protection flag 305 Playback completed flag 306 Edited flag 307 Time zone 308 Recording date and time 309 Playlist length 310 Manufacturer ID
311 Model code 312 Channel number 313 Channel name length 314 Channel name 315 Playlist name length 316 Playlist name 317 Playlist detail length 318 Playlist details 321 3D flag 322 3D type 323 3D synchronization flag

Claims

A recording method for recording information on a recording medium,
Recording an AV stream;
Recording a playlist defining the playback order of the AV stream,
The playlist includes user interface application information, and the user interface application information includes a 3D synchronization flag indicating a synchronization state between management information of the 2D compatible part of 3D content and management information of the 3D part. ,
The recording method, wherein the 3D synchronization flag is set in an asynchronous state when the management information of the 2D compatible part is updated, and is set in a synchronous state when the management information of the 3D part is updated.
A recording device for recording information on a recording medium,
An AV stream, and a recording unit for recording a playlist defining the playback order of the AV stream on the recording medium;
A control unit for controlling the recording unit;
The playlist includes user interface application information, and the user interface application information includes a 3D synchronization flag indicating a synchronization state between the management information of the 2D compatible part of the 3D content and the management information of the 3D part,
The control unit sets the 3D synchronization flag in an asynchronous state when the management information of the 2D compatible part is updated, and sets the synchronous state when the management information of the 3D part is updated. Recording device.
A reproduction method for reproducing information recorded on a recording medium,
On the recording medium, an AV stream and a playlist that defines the playback order of the AV stream are recorded,
The playlist includes user interface application information, and the user interface application information includes a 3D synchronization flag indicating a synchronization state between the management information of the 2D compatible part of the 3D content and the management information of the 3D part. And
When the 3D synchronization flag is set in an asynchronous state, the 3D content is played by synchronizing the management information of the 2D compatible part and the management information of the 3D part.
A playback device for playing back information recorded on a recording medium,
A reproducing unit for reproducing information from the recording medium;
A control unit for controlling the reproduction unit,
On the recording medium, an AV stream and a playlist that defines the playback order of the AV stream are recorded,
The playlist includes user interface application information, and the user interface application information includes a 3D synchronization flag indicating a synchronization state between the management information of the 2D compatible part of the 3D content and the management information of the 3D part. And
When the 3D synchronization flag is set in an asynchronous state, the playback apparatus plays back the 3D content by synchronizing the management information of the 2D compatible part and the management information of the 3D part.
A recording medium on which information is recorded,
AV stream,
A playlist that defines the playback order of the AV stream,
The playlist includes user interface application information,
The user interface application information includes a 3D synchronization flag indicating a synchronization state between the management information of the 2D compatible part of the 3D content and the management information of the 3D part,
The 3D synchronization flag is information that is set in an asynchronous state when the management information of the 2D compatible part is updated, and is set in a synchronous state when the management information of the 3D part is updated. recoding media.