TW200935873A - Playback and overlay of 3D graphics onto 3D video - Google Patents
Playback and overlay of 3D graphics onto 3D video Download PDFInfo
- Publication number
- TW200935873A TW200935873A TW097149429A TW97149429A TW200935873A TW 200935873 A TW200935873 A TW 200935873A TW 097149429 A TW097149429 A TW 097149429A TW 97149429 A TW97149429 A TW 97149429A TW 200935873 A TW200935873 A TW 200935873A
- Authority
- TW
- Taiwan
- Prior art keywords
- stream
- information
- graphics
- depth
- video
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
Description
200935873 九、發明說明: 【發明所屬之技術領域】 本發明係關於一種播放適於在三維(3D)顯示器上播放之 資訊流的方法,該資訊流包括一主視訊流及輔助視訊資 訊’其包括用於實現主視訊流之三維(3D)顯示的視訊深度 • 資訊;至少一圖形流及與其相關聯之至少一輔助圖形資 • 訊,該至少一輔助圖形資訊包括至少一圖形深度資訊,其 係用於實現該至少一圖形流之三維(3D)顯示。本發明亦關 φ 於一種用於如以上描述之資訊流的播放之裝置,及關於一 種包括如以上描述之資訊流的信號。 【先前技術】 藉由導入新三維顯示器係有使三維視訊打入廣大消費者 市場之機會。此類三維顯示器能處置三維顯示及二維顯示 兩者。現今存在用於三維視訊的各種格式且大多數係基於 單一觀點立體,藉以使用者可從一單一觀點看見立體中之 一場景。然而,導入三維視訊不僅關於導入能三維顯示的 ® 新顯示器,且其亦具有在整個内容產生及輸送鏈條方面之 影響。首先,三維視訊内容之產生係在初期技術階段,且 . 已提出欲使用之各種格式,其各具有其自己的優點及缺 點。相對於内容分佈,新編碼方法被導入用於編碼三維内 容且已提出新格式以包括mpeg流中之三維視訊流。 一已知事實係新格式之導入通常係缓慢且一當導入新格 式時之所需特徵係與經安裝播放器基礎的反向播放相容 性。一遺失區域係在如數位視訊廣播(DVB)或DVD之内容 136730.doc 200935873 分佈或出版格式及如藍光光碟(BD)或HD-DVD的高晝質格 式中之三維視訊内容的托架。 一重要特徵高畫質出版格式係内容提供者提供如子母畫 面及圖形及互動式流之多個視訊流的能力。例如,在 BD、DVD及HD-DVD之情況下,已知此等系統允許同時播 放視訊及圖形(如字幕、導航按鈕)。通常如字幕之圖形流 應始終出現在主要視訊之前,且因此以後增加至欲顯示的 最後影像。200935873 IX. INSTRUCTIONS: TECHNICAL FIELD The present invention relates to a method for playing a stream of information suitable for playing on a three-dimensional (3D) display, the information stream comprising a main video stream and auxiliary video information 'including Video depth/information for realizing three-dimensional (3D) display of the main video stream; at least one graphics stream and at least one auxiliary graphics resource associated therewith, the at least one auxiliary graphics information including at least one graphics depth information, A three-dimensional (3D) display for implementing the at least one graphics stream. The invention is also directed to a device for playing a stream of information as described above, and to a signal comprising a stream of information as described above. [Prior Art] By introducing a new three-dimensional display, there is an opportunity to bring 3D video into the consumer market. Such three-dimensional displays can handle both three-dimensional displays and two-dimensional displays. There are various formats for 3D video today and most are based on a single perspective stereo, whereby a user can see one of the stereos from a single point of view. However, the introduction of 3D video is not only about the introduction of new displays that can be displayed in 3D, but also has an impact on the entire content generation and delivery chain. First of all, the generation of 3D video content is in the initial stage of technology, and various formats have been proposed, each of which has its own advantages and disadvantages. Relative to the content distribution, a new encoding method is imported for encoding the three-dimensional content and a new format has been proposed to include the three-dimensional video stream in the mpeg stream. A known fact is that the introduction of a new format is generally slow and the required features of the new format are compatible with the reverse playback of the installed player base. A lost area is a rack of 3D video content in a distributed or published format such as Digital Video Broadcasting (DVB) or DVD 136730.doc 200935873 and a high-quality format such as Blu-ray Disc (BD) or HD-DVD. An important feature of high-quality publishing formats is the ability of content providers to provide multiple video streams such as picture and graphics and interactive streaming. For example, in the case of BD, DVD, and HD-DVD, such systems are known to allow simultaneous playback of video and graphics (e.g., subtitles, navigation buttons). Usually a stream of graphics such as subtitles should always appear before the main video, and therefore later added to the last image to be displayed.
然而,當使用三維顯示器時,應保持相同組合次序及重 疊限制,但此可能不發生。在三維顯示器中,每一像素 (屬於視訊或圖形流)具有一與顯示相關的深度。若使用三 維流之二維+深度編碼,則此深度或係直接與其相關聯, 或深度資訊可從其他編碼系統直接推論,例如二維+視差 資訊。無法防止主視訊之像素以具有—比屬於如字幕或互 動式按鈕之圖形物件的一些像素更低的深度(即,欲顯示 更接近檢視者),其造成圖形物件之部分藉由背景視訊的 部分堵塞’而作者之意圖係所有圖形出現在視訊背景前。 圖1 a說明在B D系統之扭.it t» λ, ,ι.- 疋特疋障況中的視訊及圖形流之已 知重疊。在此等系統中作左* '、存在一主電影平面、一包括靜態 圖像物件之表達平面及—包括 一 匕枯互動式物件之互動式平面。 二個平面係彼此重疊:主電 电京y十面在背景中,表達平面在 主電影平面之頂部上且互動& 勒武干面最向前。圖la中之右影 ㈣曰示具有重疊的三個平面之㈣影像。 圖lb係一在各流的三雜基5 — ^ —維顯不之情況下此等平面如何可能 136730.doc 200935873 纏結之二維表達。由於深度,主電影平面之一些部分可具 有比圖形項目更接近檢視者的深度。在此等部分中,前景 圖形物件被貫穿且文字變得難以讀取,而顯示影像之一般 態樣係破裂及令人不悦。在圖形流之情況下,此係特別有 問題,因為圖形可能在視訊中之任何位置處出現且係取決 於來自使用者的輸入。 【發明内容】 本發明之目的在於克服顯示三維視訊流及三維圖形流兩 者於頂部上之以上所述問題而無堵塞問題。本發明之一目 的係藉由一種根據請求項之方法達到,其係用於播放一適 於在三維(3D)顯示器上播放之資訊流的方法,該資訊流包 括一主視訊流及輔助視訊資訊,該辅助視訊資訊包括用於 實現主視訊流之三維(3D)顯示的視訊深度資訊;至少一圖 形流及與其相關聯之至少一輔助圖形資訊,該至少一辅助 圖形資訊包括至少一圖形深度資訊,其係用於實現至少一 圖形流之三維(3D)顯示。 根據本發明,該方法包括讀取或接收該資訊流;決定三 維顯示之可用深度範圍,歸屬對應非重疊深度範圍至該主 視訊流及該至少一圖形流之各者,按比例調整該視訊深度 資訊及該至少一圖形深度資訊之各者至該對應深度範圍, 且使用該按比例調整視訊深度資訊及該至少一圖形深度資 訊用於該資訊流的三維(3D)顯示。此係基於不同平面間之 堵塞問題係藉由將可藉由一顯示器顯示之可能深度值的間 隔分割成為非重疊範圍,且將其指派至現存表達平面(如 136730.doc -9- 200935873 視訊及圓形平面),之播 再按比例調整各流之深度至 派範圍來解決的深入了 解。因此,根據本發明,一平面之 一像素的最高深度係小於 J於下一平面(在增加深度之方向中)However, when using a 3D display, the same combination order and overlap limit should be maintained, but this may not happen. In a three-dimensional display, each pixel (belonging to a video or graphics stream) has a depth associated with the display. If two-dimensional + depth coding of three-dimensional streams is used, this depth is directly related to it, or depth information can be directly inferred from other coding systems, such as two-dimensional + disparity information. It is not possible to prevent the pixels of the main video from having a lower depth than some pixels belonging to a graphical object such as a subtitle or an interactive button (ie, to be displayed closer to the viewer), which results in a portion of the graphical object being dominated by the background video Blocking' and the author's intention is that all graphics appear in front of the video background. Figure 1a illustrates the known overlap of video and graphics streams in the twisted.it t» λ, , ι.- 疋 special conditions of the B D system. In these systems, left*', there is a main movie plane, an expression plane including static image objects, and an interactive plane including a dry interactive object. The two planes overlap each other: the main electric power is in the background, the expression plane is on the top of the main movie plane and the interactive & Lewu dry noodles are the most forward. The right image in Figure la (4) shows the (four) image with three planes that overlap. Figure lb is a two-dimensional representation of the tangles in the case where the tri-hybrids of each stream are not visible. 136730.doc 200935873 Due to the depth, portions of the main movie plane may have a depth closer to the viewer than the graphical item. In these sections, the foreground graphic object is penetrated and the text becomes difficult to read, and the general aspect of the displayed image is broken and unpleasant. This is particularly problematic in the case of graphics streams, as graphics may appear anywhere in the video and depend on input from the user. SUMMARY OF THE INVENTION It is an object of the present invention to overcome the above-described problems of displaying a three-dimensional video stream and a three-dimensional graphics stream on the top without clogging problems. One object of the present invention is achieved by a method according to the claim for playing a stream of information suitable for playing on a three-dimensional (3D) display, the information stream comprising a main video stream and auxiliary video information The auxiliary video information includes video depth information for realizing three-dimensional (3D) display of the main video stream; at least one graphics stream and at least one auxiliary graphics information associated therewith, the at least one auxiliary graphics information including at least one graphics depth information It is used to implement a three-dimensional (3D) display of at least one graphics stream. According to the present invention, the method includes reading or receiving the information stream; determining a usable depth range of the three-dimensional display, and assigning the non-overlapping depth range to each of the main video stream and the at least one graphics stream, and adjusting the video depth proportionally The information and each of the at least one graphical depth information are to the corresponding depth range, and the scaled video depth information and the at least one graphics depth information are used for three-dimensional (3D) display of the information stream. This is based on the problem of occlusion between different planes by dividing the interval of possible depth values that can be displayed by a display into non-overlapping ranges and assigning them to existing expression planes (eg 136730.doc -9- 200935873 video and The circular plane), the broadcast then scales the depth of each stream to the range to solve the in-depth understanding. Therefore, according to the present invention, the highest depth of a pixel of a plane is smaller than J in the next plane (in the direction of increasing depth)
之像素的最低深度。應注意到此概念係可應用於任何 播放系統其顯不圖像之至少兩個重疊三維圖形流或非 動流(例如投影片顯示),W個重#視訊流。因此本發明 亦可應用至在—維視訊之頂部上顯示三維次要視訊或 維圖形旁景之頂部上顯示經轉譯的三維圖形物件。 在本發月之有利具體實施例中,該資訊流進一步包括 重疊資訊纟❹於重疊該至少—圖形流至該主視訊流 上,該重叠資訊包括該非重叠深度範圍,其中該非重疊深 度範圍較佳係4義為該可用深度範圍的深度百分比。當表 達為冰度百刀比時,可在編寫内容時定義範圍限制,因此 提供作者將更大範圍指派予—平面(如互動式圖形)及—更 小1已圍予另一者(如字幕)的自由及控制。此外,一非絕對 範圍指示(如相對於目標螢幕之最大深度值的百分比)具有 與任何三維顯示之相容性的優點。 在-較佳具體實施例中,該資訊流係BD相容且其包括 -視訊流、-圖形流及一互動式圖形流,該互動式圖形流 係顯示在該圖形流之前,其係顯示在該主視訊流之前。在 此等情況下,一用於深度範圍之最佳值對應至深度範圍對 於主電影流、圖形流及互動式圖形流係依5 : 3 : 2之比。 本發明亦關於一種如請求項7定義用於播放一適於在三 維(3D)顯示器上播放之資訊流的裝置,及一種如請求項" 136730.doc 200935873 中定義的信號。 本發明之此等及其他態樣可從參考下文描述之具體實施 例的闡示中瞭解。 【實施方式】 圖2概要地說明一其中實現本發明之播放器件。應注意 * 到此描述一對應至來自光碟之播放的特定具體實施例,但 • 資訊流之來源係無關,其可在如光學媒體、硬碟或固態記 憶體之記錄媒體上本機地提供,或其可用經由有線或無線 ❹ 傳輸系統(包括網際網路)之廣播接收。本發明可在用於播 放視訊資訊之任何器件中實施,包括硬碟記錄器、視訊轉 換器(STB)及數位(衛星/陸地/纜線)接收器。 光碟具有一磁軌,該磁軌係代表資訊之預記錄標記的系 列之位置,且根據在一資訊層上構成實質上平行磁軌之一 單一螺旋圖案配置。光碟可包括一可記錄類型的一或多個 資訊層。預記錄光碟之已知範例係CD-ROM或DVD-ROM 或如HD DVD-ROM或BD-ROM之高密度光碟。例如,關於 ❿ CD-ROM及DVD-ROM光碟之實體結構及定址資訊的進一 步細節可分別於參考文件ECMA-130及ECMA-267(ISO IEC - 16449)中發現。在BD系統之情況下,進一步細節可在公開 . 可用技術白皮書「藍光光碟格式通則,2004年8月(Blu-rayThe lowest depth of the pixel. It should be noted that this concept is applicable to at least two overlapping three-dimensional graphics streams or non-moving streams (e.g., transmissive sheet displays) of any of the playback systems of the playback system, and W. Thus, the present invention can also be applied to displaying a translated three-dimensional graphic object on top of a three-dimensional secondary video or dimensional side view on top of a video. In an advantageous embodiment of the present month, the information stream further includes overlapping information to overlap the at least one graphics stream to the main video stream, the overlapping information including the non-overlapping depth range, wherein the non-overlapping depth range is better Line 4 is the percentage of depth of the available depth range. When expressed as a hundred degrees of ice, you can define a range limit when writing content, so the author is provided to assign a larger range to - plane (such as interactive graphics) and - smaller 1 has been surrounded by another (such as subtitles) ) freedom and control. In addition, a non-absolute range indication (such as a percentage of the maximum depth value relative to the target screen) has the advantage of compatibility with any three-dimensional display. In a preferred embodiment, the information flow system BD is compatible and includes a video stream, a graphics stream, and an interactive graphics stream. The interactive graphics stream is displayed before the graphics stream. Before the main video stream. In such cases, an optimum value for the depth range corresponds to a depth range of 5:3:2 for the main movie stream, the graphics stream, and the interactive graphics stream. The invention also relates to a device as defined in claim 7 for playing a stream of information suitable for playing on a three dimensional (3D) display, and a signal as defined in the claim "136730.doc 200935873. These and other aspects of the invention are apparent from the description of the specific embodiments described hereinafter. [Embodiment] FIG. 2 schematically illustrates a playback device in which the present invention is implemented. It should be noted that the description here corresponds to a specific embodiment from the playback of the optical disc, but the source of the information stream is irrelevant and can be provided locally on a recording medium such as an optical medium, a hard disk or a solid state memory. Or it can be received via a broadcast over a wired or wireless transmission system, including the Internet. The present invention can be implemented in any device for playing video information, including hard disk recorders, video converters (STBs), and digital (satellite/terrestrial/cable) receivers. The optical disc has a track that represents the position of the series of pre-recorded marks of information and is configured in a single spiral pattern that forms one of the substantially parallel tracks on an information layer. The optical disc may include one or more information layers of a recordable type. A known example of a pre-recorded optical disc is a CD-ROM or a DVD-ROM or a high-density optical disc such as an HD DVD-ROM or a BD-ROM. For example, further details regarding the physical structure and addressing information of CD-ROMs and DVD-ROM discs can be found in reference documents ECMA-130 and ECMA-267 (ISO IEC - 16449), respectively. In the case of the BD system, further details can be made public. Available Technical White Paper "Blu-ray Disc Format General, August 2004 (Blu-ray
Disc Format General August 2004)」及「BD-ROM之藍光 光碟l.C實體格式規格,2005年11月(Blu-ray Disc l.C Physical Format Specifications for BD-ROM November, 2005)」中發現,其係由 Blu-Ray Disc association(http : 136730.doc 200935873 //WWW.bluraydisc.com)出版。資訊係藉由沿磁軌之光學可 發現標記號在資訊層上表達。光碟上之磁軌丨2係藉由在空 白光碟製造期間提供的一預浮雕磁軌結構指示。磁執結構 係例如藉由一預溝槽構成,其致使一讀/寫頭在掃描期間 跟隨該磁軌。 光碟係意欲根據標準化格式承載使用者資訊,以在標準 化播放器件上播放。記錄格式包括記錄、編碼及邏輯上映 射至藉由該磁軌提供之記錄空間的資訊之方法。可記錄空 間通常係細分成一引入區域(LI)31,一用於記錄資訊之資 料區(DZ)及一引出區域(L〇)。引入區域(LI)通常包括基本 光碟管理資訊及如何實體上存取資料區(DZ)之資訊。例 如,該基本光碟管理資訊對應至CD系統中之内容表或 DVD系統中的格式化光碟控制塊(FDCB)。 記錄在資料區(DZ)中之使用者資訊係進一步根據應用格 式配置,例如包括檔案及目錄之一預定義結構。 此外在邏輯位準,資料區中的使用者資訊係根據一包 括檔案管理資訊之檔案系統配置,如用於CD系統之is〇 9660,其可用為ECMA_U9 ;或用於dvd系統之,其 可用為ECMA-167。 記錄器件具有用於掃描光碟的磁執之掃描構件,掃描構 件包括:一驅動單元16,其係用於旋轉光碟ιι; 一磁頭 18 ’ 一定位單元21,#係用於在該磁軌上之徑向中粗略地 疋位磁頭18;及一控制單元17。磁頭18包括一已知類型的 光學系統用於產生透過聚焦___射束2Q至光碟η之磁轨 136730.doc •12· 200935873 12上的-輻射點19之光學元件所導引之該輻射㈣。韓射 束2〇係藉由輕射源(如雷射二極體)產生。該磁頭進一步包 括(未顯示广-聚焦致動器,其係用於沿該輻射束之光學 轴移動輻射束2G的焦點;及—循軌致動器,其係用於在該 磁軌的中心之徑向中精細地定位輻射點循軌致動器可 包括線圈’用於徑向地移動_光學元件或可另配置用於改 變一反射元件的角度。Disc Format General August 2004) and "Blu-ray Disc lC Physical Format Specifications for BD-ROM November (2005)" were found in Blu-ray Disc lC Physical Format Specifications for BD-ROM November (2005). Published by Ray Disc association (http: 136730.doc 200935873 //WWW.bluraydisc.com). Information is expressed on the information layer by optically discoverable marker numbers along the track. The track 丨 2 on the disc is indicated by a pre-embossed track structure provided during the manufacture of the blank disc. The magnetic structure is constructed, for example, by a pre-groove that causes a read/write head to follow the track during scanning. The disc is intended to carry user information in a standardized format for playback on standard playback devices. The recording format includes a method of recording, encoding, and logically mapping information to a recording space provided by the track. The recordable space is usually subdivided into a lead-in area (LI) 31, a data area (DZ) for recording information, and a lead-out area (L〇). The lead-in area (LI) usually includes basic disc management information and information on how to physically access the data area (DZ). For example, the basic disc management information corresponds to a content disc table in the CD system or a formatted disc control block (FDCB) in the DVD system. The user information recorded in the data area (DZ) is further configured according to the application format, for example, including a predefined structure of files and directories. In addition, in the logic level, the user information in the data area is configured according to a file system including file management information, such as is〇9660 for CD system, which can be used as ECMA_U9; or for dvd system, which can be used as ECMA-167. The recording device has a magnetic member for scanning a magnetic disk, and the scanning member includes: a driving unit 16 for rotating the optical disk; a magnetic head 18' a positioning unit 21, # is used for the magnetic track The magnetic head 18 is roughly clamped in the radial direction; and a control unit 17. The magnetic head 18 includes a known type of optical system for generating the radiation guided by the optical elements of the radiant point 19 on the track 136730.doc • 12· 200935873 12 of the focus ___beam 2Q to the optical disc η. (4). The Han beam 2 is produced by a light source such as a laser diode. The magnetic head further includes (not showing a wide-focus actuator for moving the focus of the radiation beam 2G along the optical axis of the radiation beam; and - a tracking actuator for use in the center of the magnetic track Finely locating the radiant point tracking actuator in the radial direction may include a coil 'for radial movement _ optical element or may be otherwise configured to change the angle of a reflective element.
為讀取資訊’由資訊層反射之輻射係藉由在磁頭18中的 -種通常類型(例如四象限二極體)之偵測器予則貞測,用 於產生-讀取信號及另—㈣器信號,如—循軌誤差信號 及聚焦誤差信號,用於控制循軌致動器及聚焦致動器。 控制單το 17控制自光碟⑽取資訊’且可配置用於從使用 者或自主機電腦接收命令。就此目的而言,控制單元17可 包括控制電路’例如-微處理器、—程式記憶體及控制 閘用於執行以下描述之程序。控制單元j 7亦可實施為邏 輯電路中之一狀態機。 為了讀取,讀取信號藉由一讀取處理單元予以處理,讀 取處理單it包括—解調變器26、__解格式化器27及輸出單 二28’肖於處理資訊及輸出該資訊至適合構件,例如顯示 器、揚聲器。解調變器26、解格式化器27及輸出單元28之 力能係藉由控制器i 7予以控制。因此用於讀取資訊之操 取構件包括雜動單元16、磁頭18、定位單元21及讀取處理 單元解調變器26係藉由使用適合通道解碼器負責解調變 來自通道信號之資料信號’如美國專利US 5,920,272或 136730.doc -13- 200935873 US 5,477222中所揭示。解格式化器27係負責使用錯誤校 正碼及/或解交錯用於從資料信號擷取資訊信號。輸出單 几28在控制單元17的控制下負責依邏輯位準處理資訊信 號。此外’應注意到資訊信號可根據播放格式配置,其可 規疋管理資5fl係與音訊-視訊資訊相關聯。因此該輸出單 元係負責將來自音訊_視訊資訊之管理資訊分開,及用於 解多工/或解碼音訊及/或視訊資訊。適合之壓縮/解壓縮構 件係在WO 98/16014-Α1(ΡΗΝ 16452)中描述用於音訊,且 ® 在MPEG2標準(iSO_IEC 13818)中用於視訊。其中此使用者 資訊欲記錄之記錄格式規定用於管理記錄使用者資訊的管 理資訊係亦記錄在光碟上。 藉由輸出單元28產生之視訊及音訊資訊被傳送至適合構 件’此一適合顯示用於視訊資訊。一些三維顯示器係已 知’其一係在美國專利US 6,069,650中描述。顯示器件包 括一 LCD顯示器,其包括主動可切換液晶雙凸透鏡狀透 鏡。取決於該影像内容’一在顯示器處的經定義組位置可 ❹ 對於二維或三維模式切換。對於意欲使用此等顯示系統之 内容提供者(例如電影製片廠)而言,其需要能以一係與舊 • 有播放器可相容地播放之格式在相同記錄媒體上分佈二維 . 及三維内容兩者,不能顯示三維流之該播放器應能處理該 記錄媒體。 相對於一本發明係可應用之可能視訊應用格式,一亦稱 為BD視訊應用格式之格式係在以下白皮書中描述(其係藉 由引用包括於本文中),該白皮書可在www.bluraydisc.com 136730.doc 14 200935873 處下載: -技術白皮書:「80-11£之藍光光碟格式2.八邏輯及音 訊視覺應用-格式規格,2004年8月(Blu-ray Disc Format 2. A Logical and Audio Visual Application -Format Specifications for BD-RE August 2004)」;In order to read the information 'radiation reflected by the information layer is detected by a detector of the usual type (for example, a four-quadrant diode) in the magnetic head 18, for generating a read signal and another (4) The signals, such as the tracking error signal and the focus error signal, are used to control the tracking actuator and the focus actuator. The control unit το 17 controls the information from the disc (10) and can be configured to receive commands from the user or from the host computer. For this purpose, control unit 17 may include control circuitry 'e.g., a microprocessor, a program memory, and a control gate for performing the procedures described below. Control unit j 7 can also be implemented as one of the state machines in the logic circuit. For reading, the read signal is processed by a read processing unit, and the read processing unit includes a demodulator 26, a __deformatter 27, and an output single 28'. Information to suitable components such as monitors, speakers. The force of the demodulator 26, the deformatter 27 and the output unit 28 is controlled by the controller i 7. Therefore, the operation means for reading information, including the dynamism unit 16, the magnetic head 18, the locating unit 21, and the read processing unit demodulator 26 are responsible for demodulating the data signal from the channel signal by using a suitable channel decoder. 'as disclosed in U.S. Patent No. 5,920,272, or 136,730, doc. The deformatter 27 is responsible for using the error correction code and/or deinterleaving for extracting information signals from the data signals. The output unit 28 is responsible for processing the information signal according to the logic level under the control of the control unit 17. In addition, it should be noted that the information signal can be configured according to the playback format, which can be associated with the management information 5fl and the audio-visual information. Therefore, the output unit is responsible for separating the management information from the audio_video information and for multiplexing/decoding audio and/or video information. Suitable compression/decompression components are described in WO 98/16014-Α1 (ΡΗΝ 16452) for audio, and ® is used for video in the MPEG2 standard (iSO_IEC 13818). The record format specified by the user information record is used to manage the recorded user information and is also recorded on the disc. The video and audio information generated by the output unit 28 is transmitted to the appropriate component' which is suitable for display for video information. Some three-dimensional displays are known in the art as described in U.S. Patent No. 6,069,650. The display device includes an LCD display including an actively switchable liquid crystal lenticular lens. Depending on the image content, a defined set of locations at the display can be switched for two or three dimensional mode. For content providers (such as movie studios) who wish to use such display systems, they need to be able to distribute two dimensions on the same recording medium in a format that is compatible with the old player. For both of the three-dimensional content, the player that cannot display the three-dimensional stream should be able to process the recording medium. The format of a possible video application format that is applicable to a invention, also known as the BD video application format, is described in the following white paper (which is incorporated herein by reference) which is available at www.bluraydisc. Com 136730.doc 14 200935873 Download: - Technical White Paper: "80-11 Blu-ray Disc Format 2. Eight Logic and Audio Vision Applications - Format Specification, August 2004 (Blu-ray Disc Format 2. A Logical and Audio Visual Application -Format Specifications for BD-RE August 2004)";
-技術白皮書:「BD-RE之藍光光碟格式2.B邏輯及音 " 訊視覺應用格式規格,2005年3月(Blu-ray Disc Format 2.B- Technical White Paper: "BD-RE Blu-ray Disc Format 2.B Logic & Sound " Vision Visual Application Format Specification, March 2005 (Blu-ray Disc Format 2.B
Logical and Audio Visual Application Format Specifications ❹ for BD-ROM March 2005)」; -技術白皮書:「BD-ROM之應用定義藍光光碟格式 BD-J基線應用及邏輯模型定義,2005年3月(Application Definition Blu-ray Disc Format BD-J Baseline Application and Logical Model Definition for BD-ROM March 2005)」。 在BD系統中,對於表達四個平面係定義如下:自背面 起係主視訊平面、次要視訊平面、表達圖形平面(PG平面) ® 及互動式圖形平面(IG平面),且各平面係連結至專用解碼 器之一輸出。在主視訊平面上,係表達來自主視訊解碼器 之移動或靜止圖像資料。在次要視訊平面上,係表達來自 次要視訊解碼器之移動圖像資料。在表達圖形平面上,係 表達來自表達圖形解碼器或文字字幕解碼器的圖形資料^ 並且在兩個平面上之此等資料係首先重疊以製造中間視訊 資料。兩個平面間之透明比係定義為在表達圖形平面的 CLUT中之阿爾法值。在互動式圖形平面上,來自互動式 136730.doc 200935873 圖形解碼器的圖形資料係表達及重疊在以上中間視訊資料 上以造成最後視訊輸出。兩個資料間之透明比係定義為在 互動式圖形平面的CLUT中之阿爾法值。應注意到圖1說明 此等平面中之三,為明顯未顯示次要視訊平面。 相對於用於三維播放之視訊資訊的編碼(其係未藉由已 知BD系統定址),需用於三維顯示之多個視野的計算可基 ' 於一個二維圖像及一額外圖像,一所謂深度圖,如描述於Logical and Audio Visual Application Format Specifications ❹ for BD-ROM March 2005)" - Technical White Paper: "BD-ROM Application Definition Blu-ray Disc Format BD-J Baseline Application and Logic Model Definition, March 2005 (Application Definition Blu- Ray Disc Format BD-J Baseline Application and Logical Model Definition for BD-ROM March 2005)". In the BD system, the definition of four plane systems is defined as follows: from the back side, the main video plane, the secondary video plane, the expression graphics plane (PG plane) ® and the interactive graphics plane (IG plane), and the planes are connected. To one of the dedicated decoder outputs. On the primary video plane, the mobile or still image data from the primary video decoder is represented. On the secondary video plane, the moving image data from the secondary video decoder is expressed. On the expression graphics plane, the graphics data from the presentation graphics decoder or the text subtitle decoder is expressed and the data on the two planes are first overlapped to produce intermediate video material. The transparency ratio between the two planes is defined as the alpha value in the CLUT that represents the graphics plane. On the interactive graphics plane, the graphics data from the interactive 136730.doc 200935873 graphics decoder is expressed and overlaid on the above intermediate video data to cause the final video output. The transparency ratio between the two data is defined as the alpha value in the CLUT of the interactive graphics plane. It should be noted that Figure 1 illustrates three of these planes, with the secondary video plane not being apparent. The calculation of multiple fields of view for three-dimensional display can be based on a two-dimensional image and an additional image, relative to the encoding of the video information for three-dimensional playback (which is not addressed by known BD systems). a so-called depth map, as described in
Oliver Sheer之「三維視訊通信(3D Video Communication)」 O (Wiley ’ 20〇5年,第29至34頁)。深度圖傳送關於二維影像 中之物件深度的資訊。深度圖中之灰階值指示二維影像中 相關像素的深度。一立體顯示可藉由使用來自深度圖之深 度值及藉由計算所需要像素轉換來計算需用於立體之額外 視野。相對於一用於壓縮及傳輸三維視訊資訊之格式,一 解決方案係使用MPEG流,其中一 MPEG三維視訊流將包 括一個二維視訊流(作為或一程式_或一基本視訊傳送流), 及用二維視訊流進行多工,一輔助流包括額外資訊以實現 三維顯示(例如一深度圖流)。 應注意雖然以上二維視訊+深度圖被描述為用於實施本 發明之較佳格式,但其並非可支援的唯一格式。例如二維 視訊+深度圖可藉由增加背景解堵塞資訊及透明性資訊而 L伸或立體+/木度可用作輸入格式。或者,可將多個視 野用作輸入信號及直接映射至顯示(子)像素上。 在本發明之一具體實施例中,為了針對BD平面之各者 實施三維顯示,對於各平面係可如先前描述使用格式二維 136730.doc •16· 200935873 +深度,即將全解析度影像分成四個象限且將其—用於二 維内容,巾另一者承載深度資訊。此係各平面在其被組合 -起成為在螢幕上顯示之最後影像前具有的格式。Oliver Sheer's "3D Video Communication" O (Wiley ' 20 5 years, pp. 29-34). The depth map conveys information about the depth of the object in the 2D image. The grayscale value in the depth map indicates the depth of the associated pixel in the 2D image. A stereoscopic display can be used to calculate the additional field of view required for stereoscopic use by using the depth values from the depth map and by calculating the required pixel conversions. In contrast to a format for compressing and transmitting 3D video information, a solution uses an MPEG stream, wherein an MPEG 3D video stream will include a 2D video stream (either as a program or a basic video transport stream), and Multiplexing with a two-dimensional video stream, an auxiliary stream including additional information for three-dimensional display (eg, a depth map stream). It should be noted that while the above two-dimensional video + depth map is described as a preferred format for implementing the present invention, it is not a unique format that can be supported. For example, 2D video + depth map can be used as an input format by adding background relief information and transparency information. Alternatively, multiple fields of view can be used as input signals and mapped directly onto display (sub)pixels. In a specific embodiment of the present invention, in order to implement three-dimensional display for each of the BD planes, for each plane system, the format two-dimensional 136730.doc •16·200935873+depth can be used as previously described, that is, the full-resolution image is divided into four. One quadrant and use it for two-dimensional content, the other carries depth information. The planes of this system are in a format that they are combined to be the last image displayed on the screen.
本發明者深人理解不同平面間之堵塞問題係藉由分割可 能深度值的間隔解決,其可藉由—顯示器顯示進人至非重 疊範圍及將其指派予現存表達平面,例如視訊及圖形平 面。因此,根據本發明,一平面之一像素的最高深度係小 於在下平面(在增加深度之方向中前進)中之一像素的最 低深度。應注意到此概念係可應用於顯示圖像之至少兩個 重叠三維(靜止)流的任何播放系統,例如投影片顯示,或 兩個重疊視訊流。因此本發明係亦可應用至在三維視訊之 頂π上顯示二維次要視訊,或在三維背景之頂部上顯示經 轉譯的三維物件。 範圍限制可在編寫内容時定義,以提供作者將更大範圍 才曰派予一平面(如互動式圖形)及一更小範圍予另一者(如字 幕)的自由及控制。一非絕對範圍指示(如一相對於目標螢 幕之最大深度值的百分比)將會係最佳選擇。 一種在本發明之基本具體實施例(其中三維物件係重疊 在一維視訊流上)中的播放方法,其包括以下步驟: -讀取及處理該兩流,包括適當之處理,如解多工; -決定一可用深度範圍用於三維顯示; -將對應非重疊深度範圍歸屬至主視訊流及圖形流之各 者; -按比例調整視訊深度資訊及圖形深度資訊至該對應深度 136730.doc 17 200935873 範圍; ❹ -使用該按比例調整視訊深度資訊及至少一圖形深度資訊 用於呈現級中之資訊流的三維(3D)顯示。 在本發明之第二具體實施例(在圖3中所說明)中此係 延伸至三個平面 個圖形平面。35 ,如用於BD系統中之一 、3 6及3 7指示主電影平面 個視訊平面及兩 、表達平面及互 動式平面中之各者的相對深度,3中,深度係說明成 為在對於檢視者之相反方向中增加。尤其係’在本發明的 改進方面,範圍限制可在編寫内容時定義,以提供作者將 更大範圍指派予一平面(如互動式圖形)及一更小範圍予另 一者(如字幕)的自由及控制。一非絕對範圍指示(如一相對 於目標螢幕之最大深度值的百分比)將會是最佳選擇。範 圍之一較桂選擇係對於主電影平面的5〇%,對於表達平面 之30°/。及對於互動式平面之2〇0/〇。 由本發明者應付的另一問題係如何採用一維持與已知系 統之反向相容性的此一方式提供需用以避免堵塞問題之深 度範圍選擇。 在BD系統内,已知存在三類型的圖形片段: _物件定義片段,其儲存某一圖形物件之位元映像值: -調色定義片段,其提供在該等值及真實色彩間之映射; -表達及互動式複合片段(c〇mp〇siti〇n Segment),其依其 中目前圖形元件應增加至圖形平面的方式提供資訊。 當實施三維物件時,係期望使用兩額外類型之片段即 深度圖物件定義片段及深度圖調色片段連同先前者存在。 136730.doc -18- 200935873 根據本發明的_具體實施例,— 之新資料靡_加至複m⑼4 pth—p咖entage 姓 “至m又結構。因為複合片段亦保 持-對於深度圖調色片段之參考以配合某一圖形物件使 用,此允許根據表達百分比按比例調整深度圖。因此,此 實現聯結深度之不同部分至不同圖形平面,例如2㈣至字 幕及整個深度的3〇%至互動式選單。 根據本發明之一替代具體實施例,若depth_percentageThe inventors have well understood that the problem of occlusion between different planes is solved by dividing the interval of possible depth values, which can be displayed by the display to the non-overlapping range and assigned to existing expression planes, such as video and graphics planes. . Therefore, according to the present invention, the highest depth of one pixel of a plane is smaller than the lowest depth of one pixel in the lower plane (advancing in the direction of increasing depth). It should be noted that this concept is applicable to any playback system that displays at least two overlapping three-dimensional (still) streams of an image, such as a slide display, or two overlapping video streams. Thus, the present invention can also be applied to display two-dimensional secondary video on top π of a three-dimensional video or to display a translated three-dimensional object on top of a three-dimensional background. Scope restrictions can be defined at the time the content is written to provide the author with the freedom and control to assign a larger scope to a plane (such as interactive graphics) and a smaller scope to another (such as a subtitle). A non-absolute range indication (such as a percentage of the maximum depth value relative to the target screen) will be the best choice. A playback method in a basic embodiment of the present invention (wherein a three-dimensional object is superimposed on a one-dimensional video stream), comprising the steps of: - reading and processing the two streams, including appropriate processing, such as demultiplexing - Determine a usable depth range for 3D display; - Assign the corresponding non-overlapping depth range to each of the main video stream and graphics stream; - Scale the video depth information and graphics depth information to the corresponding depth 136730.doc 17 200935873 Range; ❹ - Use the scaled video depth information and at least one graphics depth information for the three-dimensional (3D) display of the information stream in the presentation stage. In a second embodiment of the invention (illustrated in Figure 3) this system extends to three planar graphics planes. 35, as used in one of the BD systems, 3 6 and 3 7 indicating the relative depth of each of the main movie plane video planes and the two, the expression plane and the interactive plane, 3, the depth system description becomes The opposite direction increases. In particular, in the improved aspect of the invention, the scope limitation can be defined at the time of writing the content to provide the author to assign a larger range to a plane (such as an interactive graphic) and a smaller range to another (such as a subtitle). Freedom and control. A non-absolute range indication (such as a percentage of the maximum depth value relative to the target screen) would be the best choice. One of the ranges is 〇% for the main movie plane and 30° for the expression plane. And for the interactive plane 2〇0/〇. Another problem dealt with by the inventors is how to provide a depth range selection that is needed to avoid clogging problems in a manner that maintains backward compatibility with known systems. Within the BD system, there are known three types of graphics segments: _object definition segments that store the bit map values of a graphical object: - a tonal definition segment that provides a mapping between the equivalent and the true color; - Expression and interactive composite segments (c〇mp〇siti〇n Segment), which provide information in a manner in which the current graphical elements should be added to the graphics plane. When implementing a three-dimensional object, it is desirable to use two additional types of segments, a depth map object definition segment and a depth map toning segment, along with the predecessor. 136730.doc -18- 200935873 According to a specific embodiment of the present invention, - the new data 靡 _ is added to the complex m (9) 4 pth - p entage surname "to m and structure. Because the composite segment is also maintained - for the depth map toning the fragment The reference is used in conjunction with a graphic object, which allows the depth map to be scaled according to the percentage of expression. Therefore, this implementation connects different parts of the depth to different graphics planes, such as 2 (four) to subtitles and 3% of the entire depth to the interactive menu. According to an alternative embodiment of the present invention, if depth_percentage
爛位係直接地包括進入深度圖調色片段定義則可達到相同 效應。 才目對於一播放器件中之太I日月&香 β4不I明的實施,以下各項應加以 注意: 藉由輸出單元28處理之資訊流係提供至一視訊處理單元 31,其負責實施播放模型之已知功能,例如緩衝、解多 處理各基本流、執行接收到命令。視訊處理單元31通 常係實施為軟體及硬體的結合❶經處理視訊資訊流係提供 給一呈現單元,其負責將視訊資訊處理成為一適用於三維 顯示之信號。應注意到呈現單元亦可在三維顯示本身中實 施。此外,已知視訊處理單元31及呈現級32的控制單元17 之功能可藉由相同硬體及/或軟體塊在一器件中實施。 依據本發明,控制單位丨7經調適以決定一用於三維顯示 之可用深度範圍’且用於歸屬對應非重疊深度範圍至主視 訊流及至少一圖形流之各者,且用於按比例調整視訊深度 資訊及至少一圖形深度資訊之各者至該對應深度範圍,而 該呈現單元經調適以使用經按比例調整之視訊深度資訊及 136730.doc -19- 200935873 至少一圖形深度資訊用於資訊流的三維(3D)呈現。在—特 定具體實施例中,深度決定構件29係在控制單元中提供, 較佳係實施為韌體或為嵌入式軟體。 根據本發明’需要在包括視訊處理單元31及呈現級32的 功能組塊内執行兩個額外功能’其一特定具體實施例係在 圖4中更詳細說明。接收到之流係在單元4丨中予以解多工 、 及緩衝,圖形流傳送至流圖形處理器42。為了產生顯示用 於右視圖及左視圖之各者的圖形影像,提供在圖形控制器 ® 控制下的兩個緩衝器43及44。兩個緩衝器43及44供應兩個 圖形平面處理器45及46。 根據本發明’兩個圖形解碼器(分別係43、45及44、46) 係調適以考慮在複合片段中存在之depth_percentage的值。 深度囷調色板必須經調適至depth—percentage值,即在調色 板中含有之最深度小及最大深度必須在整個可能深度值的 該百分比内》 參 此保證表達平面及互動式平面將具有一根據對應 depth_percentage值之深度。當將所有平面重疊一起時該 裝置確保視訊平面的深度不超過其百分比(即總可能深度 . 跨度減去兩個圖形平面之百分比的總和)。 .此外,應注意到BD及HD-DVD亦支援一用於pip之次要 視訊平面。對於PIP,PIP中之視訊可與主視訊一起或在螢 幕之四分之一内出現。無法按比例調整主視訊,所以次要 視訊始終覆蓋主視訊的部分。另一已知限制係該次要視訊 係完全透明或完全不透明。所以有利的係,當次要視訊完 136730.doc •20- 200935873 全不透明時,依一具有該等圖形時可能發生的類似方法, 視訊在顯71T器中呈現二維+深度資訊期間不穿透其他視 訊。 根據本發明,—種替代解決方案係在重4兩個視訊流之 f況下可行。根據本發明’在播放器中,針對二維且針對 深度資訊兩者而結合主視訊及次要視訊。來自次要視訊平 面的資料僅僅覆寫相同表達平面上之主視訊的像素,此解 決方案可能鑑於沒有半透明性且沒有強烈需要藉由次要視 ❹ 《藏之主視訊的堵塞資訊的事實。此與重疊一圖形流相 反,因為圖形流可為半透明及可依任何形狀及位置重疊視 訊流。 最後應注意到以上本發明之範例性具體實施例係參考用 於播放來自-光碟的資訊之播放器件。應注意到資訊的來 源係無關,其可在如光學媒體、硬碟或固態記憶體之記錄 媒體上本機地提供,或其可用經由有線或無線傳輸系統 (包括網際網路)之廣播接收。本發明可在任何器件中實施 用於播放視訊資訊,尤其包括硬碟記錄器、視訊轉換器 (STB)及數位(衛星/陸地/纜線)接枚器。 此發明可概述如下:本發明係關於一資訊流之三維(3〇) 顯示,該資訊流包括一主視訊流及輔助視訊資訊,該輔助 視訊資訊包括用於實現主視訊流之三維(3D)顯示的視訊深 度資訊’至少一圖形流及與其相關聯之至少一輔助圖形資 訊’該至少一輔助圖形資訊包括至少一圖形深度資訊以用 於實現至少一圖形流之三維(3D)顯示。一種根據本發明之 136730.doc •21 - 200935873 方法包括:讀取或接收資訊流;決定一用於三維顯示之可 用深度範圍;歸屬對應非重疊深度範圍至主視訊流及至少 —圖形流之各者;按比例調整視訊深度資訊及至少一圖形 深度資訊之各者至該對應深度範圍;及使用該按比例調整 視訊深度資訊及至少一圖形深度資訊用於資訊流的三維 OD)顯示。本發明實現重疊三維圖形至三維上而無不希望 之堵塞問題。 應注意的係如上所述具體實施例係意於思說明而非限制 本發明。並且熟習此項技術人士將能設計許多替代具體實 施例而不脫離隨附申請專利範圍之範疇。在申請專利範圍 中’任何置於括弧間的參考符號不應視為限制申請專利範 圍。動詞「包括」及「包括」和其結合的使用並不排除存 在除了 一請求項中陳述的元件或步驟以外之元件或步驟。 一兀件前之冠詞「一」或「一個」不排除存在複數個此類 兀件。本發明可藉由包括數個不同元件的硬體來實施,且 亦可藉由適當程式化電腦來實施。一電腦程式可在一適當 媒體上儲存/分佈,如光學儲存器或與硬體部分一起供 應,但亦可依其他形式分佈,如經由網際網路或有線或無 線通信分佈。在列舉數個構件的系統/器件/裝置請求項 中,可藉由硬體或軟體之一及相同項來體現該等構件之數 個構件。在互不相同的獨立項中引用某些方法之僅有事 實’並不指示不能有利地使用此等方法之組合。 【圖式簡單說明】 本發明之特徵及優點將在參考以下圖式進一步解釋時, 136730.doc -22· 200935873 其中: 圖1 a說明在BD系統之特定情況中的視訊及圖形流之已 知重疊’而圖lb係一當兩流皆在二維中顯示時圖形流藉由 視訊流堵塞之二維表達。 圖2概要地說明一其中實現本發明之播放器件; * 圖3概要地說明根據本發明之一具體實施例的各種表 ' 平面及相關聯深度範圍, 建 圖4概要地說明真實處理單元及呈現級的根據本發 〇 一具體實施例。 之 【主要元件符號說明】 11 光碟 12 磁軌 16 驅動單元 17 控制單元 18 磁頭 19 輻射點 胃 20 輻射束 21 定位單元 • 26 解調變器 27 28 解格式化器 輪出單元 29 31 32 深度決定構件 硯訊處理單元/弓丨入區域 至現級 136730.doc -23-The rotten position directly includes the definition of the depth map tones to achieve the same effect. The following items should be noted for the implementation of the sun, the moon, the scent, and the scent: The information flow processed by the output unit 28 is provided to a video processing unit 31, which is responsible for implementation. Known functions of the playback model, such as buffering, de-processing multiple elementary streams, and executing received commands. The video processing unit 31 is typically implemented as a combination of software and hardware. The processed video stream is provided to a rendering unit that is responsible for processing the video information into a signal suitable for three-dimensional display. It should be noted that the presentation unit can also be implemented in the three-dimensional display itself. Furthermore, it is known that the functions of the video processing unit 31 and the control unit 17 of the presentation stage 32 can be implemented in a device by the same hardware and/or software blocks. In accordance with the present invention, the control unit 丨7 is adapted to determine a usable depth range for three-dimensional display and is used to assign a corresponding non-overlapping depth range to each of the primary video stream and the at least one graphics stream, and for scaling Each of the video depth information and the at least one graphics depth information is to the corresponding depth range, and the presentation unit is adapted to use the scaled video depth information and 136730.doc -19- 200935873 at least one graphic depth information for information Three-dimensional (3D) rendering of the stream. In a particular embodiment, the depth determining member 29 is provided in the control unit, preferably as a firmware or as an embedded software. In accordance with the present invention, it is desirable to perform two additional functions within a functional block comprising video processing unit 31 and presentation stage 32. A particular embodiment is illustrated in more detail in FIG. The received stream is demultiplexed and buffered in unit 4, and the graphics stream is passed to stream graphics processor 42. In order to produce a graphic image showing each of the right and left views, two buffers 43 and 44 under the control of the graphics controller ® are provided. Two buffers 43 and 44 supply two graphics plane processors 45 and 46. In accordance with the present invention, the two graphics decoders (43, 45 and 44, 46, respectively) are adapted to take into account the value of depth_percentage present in the composite segment. The depth 囷 palette must be adapted to the depth-percentage value, ie the minimum depth and maximum depth contained in the palette must be within this percentage of the full possible depth value. This ensures that the expression plane and the interactive plane will have A depth based on the corresponding depth_percentage value. The device ensures that the depth of the video plane does not exceed its percentage (i.e., the total possible depth. The span minus the sum of the percentages of the two graphics planes) when all the planes are overlapped together. In addition, it should be noted that BD and HD-DVD also support a secondary video plane for pip. For PIP, the video in the PIP can appear with the primary video or within a quarter of the screen. The primary video cannot be adjusted proportionally, so the secondary video always covers the portion of the primary video. Another known limitation is that the secondary video system is completely transparent or completely opaque. Therefore, when the secondary video is 136730.doc •20-200935873 is completely opaque, according to a similar method that may occur when the graphics are present, the video does not penetrate during the 2D+depth information in the 71T device. Other video. According to the present invention, an alternative solution is feasible in the case of two video streams. According to the present invention, in the player, the primary video and the secondary video are combined for both two-dimensional and for depth information. The information from the secondary video plane simply overwrites the pixels of the primary video on the same presentation plane. This solution may be based on the fact that there is no translucency and there is no strong need to rely on the secondary blocking of the information of the main video. This is in contrast to overlapping a graphics stream because the graphics stream can be translucent and can overlap the video stream in any shape and location. Finally, it should be noted that the above exemplary embodiments of the present invention are directed to a playback device for playing back information from a disc. It should be noted that the source of the information is irrelevant, it may be provided natively on a recording medium such as an optical medium, a hard disk or a solid state memory, or it may be received via a broadcast via a wired or wireless transmission system (including the Internet). The present invention can be implemented in any device for playing video information, including, in particular, a hard disk recorder, a video converter (STB), and a digital (satellite/terrestrial/cable) connector. The invention can be summarized as follows: The present invention relates to a three-dimensional (3〇) display of a news stream, the information stream including a main video stream and auxiliary video information, the auxiliary video information including three-dimensional (3D) for realizing the main video stream. The displayed video depth information 'at least one graphics stream and at least one auxiliary graphics information associated therewith'. The at least one auxiliary graphics information includes at least one graphics depth information for implementing a three-dimensional (3D) display of the at least one graphics stream. A method according to the present invention 136730.doc • 21 - 200935873 includes: reading or receiving a flow of information; determining a usable depth range for three-dimensional display; assigning a non-overlapping depth range to a primary video stream and at least a graphics stream Adjusting the video depth information and each of the at least one graphics depth information to the corresponding depth range; and using the proportional video depth information and the at least one graphics depth information for the three-dimensional OD) display of the information stream. The present invention achieves the problem of overlapping three-dimensional graphics onto three dimensions without unwanted jamming. It is to be noted that the specific embodiments described above are intended to be illustrative and not limiting. Those skilled in the art will be able to devise many alternative embodiments without departing from the scope of the appended claims. In the scope of the patent application, any reference symbol placed between brackets shall not be construed as limiting the scope of the patent application. Use of the verbs "comprise" and "comprising" and "comprising" or "the" The article "a" or "an" preceding a clause does not exclude the existence of the plural. The invention can be implemented by a hardware comprising several different components, and can also be implemented by a suitably programmed computer. A computer program can be stored/distributed on a suitable medium, such as an optical storage or with a hardware portion, but can be distributed in other forms, such as via an internet or wired or wireless communication. In the system/device/device request item enumerating several components, several components of the components may be embodied by one or the same of hardware or software. The mere fact that certain methods are recited in separate items that are different from each other does not indicate that a combination of such methods cannot be used. BRIEF DESCRIPTION OF THE DRAWINGS Features and advantages of the present invention will be further explained with reference to the following drawings, 136730.doc -22 200935873 where: Figure 1 a illustrates the known video and graphics streams in a particular case of a BD system The overlap </ br> is a two-dimensional representation of the graphics stream blocked by the video stream when both streams are displayed in two dimensions. 2 schematically illustrates a playback device in which the present invention is implemented; FIG. 3 schematically illustrates various table 'planes and associated depth ranges in accordance with an embodiment of the present invention. FIG. 4 schematically illustrates a real processing unit and presentation. The level of a specific embodiment according to the present invention. [Main component symbol description] 11 Disc 12 Track 16 Drive unit 17 Control unit 18 Head 19 Radiation point Stomach 20 Radiation beam 21 Positioning unit • 26 Demodulation converter 27 28 Deformatter wheel-out unit 29 31 32 Depth decision Component processing unit / bow intrusion area to the current level 136730.doc -23-
200935873 41 42 43 44 45 46 DZ LI 參 LO α〇 —» 早/0 流圖形處理器 緩衝器/圖形解碼器 緩衝器/圖形解碼器 圖形平面處理器/圖形解碼器 圖形平面處理器/圖形解碼器 資料區 引入區域 引出區域200935873 41 42 43 44 45 46 DZ LI LOLO α〇—» Early/0 stream graphics processor buffer/graphic decoder buffer/graphic decoder graphics plane processor/graphic decoder graphics plane processor/graphic decoder Data area introduction area lead-out area
136730.doc 24·136730.doc 24·
Claims (1)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP07123796 | 2007-12-20 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| TW200935873A true TW200935873A (en) | 2009-08-16 |
Family
ID=40394513
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW097149429A TW200935873A (en) | 2007-12-20 | 2008-12-18 | Playback and overlay of 3D graphics onto 3D video |
Country Status (2)
| Country | Link |
|---|---|
| TW (1) | TW200935873A (en) |
| WO (1) | WO2009083863A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014056150A1 (en) * | 2012-10-09 | 2014-04-17 | Nokia Corporation | Method and apparatus for video coding |
| TWI462567B (en) * | 2010-06-18 | 2014-11-21 | Realtek Semiconductor Corp | Three dimensional processing circuit and processing method |
| TWI510071B (en) * | 2013-09-18 | 2015-11-21 | Vivotek Inc | Pre-processing method for video data playback and playback interface apparatus |
| US9549163B2 (en) | 2010-07-28 | 2017-01-17 | S.I.Sv.El Societa' Italiana Per Lo Sviluppo Dell'elettronica S.P.A. | Method for combining images relating to a three-dimensional content |
| US9571811B2 (en) | 2010-07-28 | 2017-02-14 | S.I.Sv.El. Societa' Italiana Per Lo Sviluppo Dell'elettronica S.P.A. | Method and device for multiplexing and demultiplexing composite images relating to a three-dimensional content |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5616352B2 (en) * | 2008-11-24 | 2014-10-29 | コーニンクレッカ フィリップス エヌ ヴェ | Extension of 2D graphics in 3D GUI |
| US20110234754A1 (en) * | 2008-11-24 | 2011-09-29 | Koninklijke Philips Electronics N.V. | Combining 3d video and auxiliary data |
| EP2320667A1 (en) * | 2009-10-20 | 2011-05-11 | Koninklijke Philips Electronics N.V. | Combining 3D video auxiliary data |
| CN102138335B (en) * | 2009-07-10 | 2013-02-06 | 松下电器产业株式会社 | Recording method, reproducing device, and recording medium reproduction system |
| KR20110018261A (en) * | 2009-08-17 | 2011-02-23 | 삼성전자주식회사 | Text subtitle data processing method and playback device |
| JP4957831B2 (en) * | 2009-08-18 | 2012-06-20 | ソニー株式会社 | REPRODUCTION DEVICE AND REPRODUCTION METHOD, RECORDING DEVICE AND RECORDING METHOD |
| US8614737B2 (en) * | 2009-09-11 | 2013-12-24 | Disney Enterprises, Inc. | System and method for three-dimensional video capture workflow for dynamic rendering |
| EP2309463A3 (en) | 2009-10-07 | 2011-07-27 | Thomson Licensing | Method of displaying a 3D video with insertion of a graphic item and terminal for implementing the method |
| US20110085023A1 (en) * | 2009-10-13 | 2011-04-14 | Samir Hulyalkar | Method And System For Communicating 3D Video Via A Wireless Communication Link |
| KR101631451B1 (en) * | 2009-11-16 | 2016-06-20 | 엘지전자 주식회사 | Image Display Device and Operating Method for the Same |
| KR101737832B1 (en) * | 2010-02-05 | 2017-05-29 | 엘지전자 주식회사 | A method for providing an user interface and a digital broadcast receiver |
| EP2553933B1 (en) | 2010-03-31 | 2018-10-24 | Thomson Licensing | 3d disparity maps |
| US9699438B2 (en) | 2010-07-02 | 2017-07-04 | Disney Enterprises, Inc. | 3D graphic insertion for live action stereoscopic video |
| JP2013546220A (en) * | 2010-10-01 | 2013-12-26 | サムスン エレクトロニクス カンパニー リミテッド | Display device, signal processing device and method thereof |
| US8537201B2 (en) * | 2010-10-18 | 2013-09-17 | Silicon Image, Inc. | Combining video data streams of differing dimensionality for concurrent display |
| US8786673B2 (en) | 2011-01-07 | 2014-07-22 | Cyberlink Corp. | Systems and methods for performing video conversion based on non-linear stretch information |
| EP2495979A1 (en) | 2011-03-01 | 2012-09-05 | Thomson Licensing | Method, reproduction apparatus and system for display of stereoscopic 3D video information |
| US8923686B2 (en) | 2011-05-20 | 2014-12-30 | Echostar Technologies L.L.C. | Dynamically configurable 3D display |
| US9600923B2 (en) | 2011-05-26 | 2017-03-21 | Thomson Licensing | Scale-independent maps |
| EP2627093A3 (en) * | 2012-02-13 | 2013-10-02 | Thomson Licensing | Method and device for inserting a 3D graphics animation in a 3D stereo content |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH11113028A (en) * | 1997-09-30 | 1999-04-23 | Toshiba Corp | 3D video display |
| JP2004274125A (en) * | 2003-03-05 | 2004-09-30 | Sony Corp | Image processing apparatus and method |
| EP2074832A2 (en) * | 2006-09-28 | 2009-07-01 | Koninklijke Philips Electronics N.V. | 3 menu display |
| CN101653011A (en) * | 2007-03-16 | 2010-02-17 | 汤姆森许可贸易公司 | System and method for combining text with three-dimensional content |
-
2008
- 2008-12-16 WO PCT/IB2008/055338 patent/WO2009083863A1/en not_active Ceased
- 2008-12-18 TW TW097149429A patent/TW200935873A/en unknown
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI462567B (en) * | 2010-06-18 | 2014-11-21 | Realtek Semiconductor Corp | Three dimensional processing circuit and processing method |
| US9123177B2 (en) | 2010-06-18 | 2015-09-01 | Realtek Semiconductor Corp. | Three dimensional processing circuit and processing method |
| US9549163B2 (en) | 2010-07-28 | 2017-01-17 | S.I.Sv.El Societa' Italiana Per Lo Sviluppo Dell'elettronica S.P.A. | Method for combining images relating to a three-dimensional content |
| US9571811B2 (en) | 2010-07-28 | 2017-02-14 | S.I.Sv.El. Societa' Italiana Per Lo Sviluppo Dell'elettronica S.P.A. | Method and device for multiplexing and demultiplexing composite images relating to a three-dimensional content |
| WO2014056150A1 (en) * | 2012-10-09 | 2014-04-17 | Nokia Corporation | Method and apparatus for video coding |
| TWI510071B (en) * | 2013-09-18 | 2015-11-21 | Vivotek Inc | Pre-processing method for video data playback and playback interface apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2009083863A1 (en) | 2009-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TW200935873A (en) | Playback and overlay of 3D graphics onto 3D video | |
| TWI528825B (en) | 3d mode selection mechanism for video playback | |
| US11277600B2 (en) | Switching between 3D video and 2D video | |
| JP5859309B2 (en) | Combination of 3D video and auxiliary data | |
| CN102257825B (en) | For the method and apparatus covering 3D figure on 3D video | |
| EP2320667A1 (en) | Combining 3D video auxiliary data | |
| JP2012243330A (en) | Disk playback device | |
| KR101537615B1 (en) | Recording medium, data recording/reproducing method, and data recording/reproducing apparatus | |
| KR101596832B1 (en) | / / recording medium data recording/reproducing method and data recording/reproducing apparatus | |
| HK1164001B (en) | Information processing device, information processing method | |
| HK1164001A1 (en) | Information processing device, information processing method |