1261192 五、發明說明（1)1261192 V. Description of invention (1)
【發明所屬之技術領域】 本發明是關於一種影片瀏覽系統及 於一種多層次影片瀏覽系統及其方法。、法 【先前技術】 特別是關 隨 可以更 通，但 使用者 檔案的 的數位 數位影 間順序看完， 覽數位 能僅能 著數位 有效率 是也造 對影像 儲存空 影片資 片資料播放， 才知道 影片資 就數位 時代的 、更加 成大量 及音效 間需求 料中， 有興趣 使得使 是否有 料的功 影片資 來臨， 方便的 的影音 的品質 亦隨之 也許使 ，但是 用者需 感興趣 能，大 料作一 牢首、 數位化 資訊累 要求越 增力口。 用者僅 現有之 袍長時 的内容 部分的 些簡單 影像等 形式儲 積氾濫 來越南 然而在 對其中 系統需 間將整 ，缺少 糸統提 的操作 各式各 存、散 的問題 樣的資訊 佈和流 。再加上 ，因此單一影音 一整段預先錄製 之一小段或數段 將整段内容按時 段數位影片資料 供使用者快速瀏 供給使用者的功 時門m一些糸統將數位影片資料按照時間分為固定 守間長度的資訊片段進行處理或保存，同時將其切分社果 :不為割覽畫面以提供使用纟整體性㈣覽輿“立影片；料 的=^。由於根據時間所呈現的切分結果，每一段資訊並 不一疋包含一段完整情節，如以較大的時間間隔作切分， ^所切分之晝面未必具有代表性，且使用者亦無從得知其 忍，趣的内容係位於哪一段資訊。如以較小的時間間隔作 切分，則同一段内容可能被切分數個段落。而如果為了方 便使用者，於視訊系統中的每一段資訊作出内容註解，完BACKGROUND OF THE INVENTION 1. Field of the Invention This invention relates to a movie browsing system and a multi-level movie browsing system and method therefor. , [previous technology] In particular, it can be more connected, but the number of digits of the user file is read in order, and the digital position can only be digitally efficient. I know that the film resources are in the digital age, and there are a lot of demand for the sound and the sound. I am interested in making the material of the film available. The quality of the convenient audio and video may also be used, but the user needs to be interested. The bulk of the material is a dagger, and the digital information is getting more and more demanding. The user only accumulates in the form of simple images such as the long-term contents of the existing robes, but in the case of the system, there is a lack of information on the system, and the lack of information on the operation and the scattered information. flow. In addition, a single video or a whole segment of a pre-recorded one or a few segments of the entire content of the time-based digital video data for the user to quickly browse the user's work hours, some of the system will divide the digital video data according to time Processing or saving a piece of information for a fixed length of the squad, and cutting it out at the same time: not to cut the picture to provide use 纟 holistic (four) view 立 "立影; material = ^. Because of the cut according to time According to the results, each piece of information does not contain a complete plot. If the score is divided at a larger time interval, the face of the segmentation may not be representative, and the user may not know the content of the end. Which piece of information is located. If the segmentation is performed at a small time interval, the same piece of content may be segmented into paragraphs. If the content is annotated for each piece of information in the video system for the convenience of the user,
1261192 五、發明說明（2) 全以人工方式對 於母一段資訊並 片中每個段落定 數位資料之索引 定時間的切分書 次的影片資料索 上的需求。 因此’使系 鬆獲取所需的資 供的資訊，可以 【發明内容】 為改善習知 瀏覽系統及其方 片資料能夠自動 次瀏覽晝面令使 資料快速瀏覽， 者需求和瀏覽視 為達上述目 及其方法，係利 數位影片資料， 層次的索引；同 表示這段情節或 位影片資料可以 以供使用者依照 大量影片内容作註解仰 不一定包含一段完整情 下客觀而詳盡的文字描 顯示和瀏覽的方式，往 面’固定時間間隔難以 卜主 引’鐵法一一滿足各 種 統能夠提供有效的索引 訊，以及快速瀏覽整段 使數位影片資料更加有 技術的缺 法，主要 根據内容 用者可以 以解決過 訊費時過 的，本發 用對相鄰 並且可以 時輸出切 場景的内 按其切分 不同需求 點’本 目的在 進行多 根據不 去基於 長的缺 明的影 影像圖 設定不 分處的 容。根 、结果顯 進行快 發明提 於使影 層次切 同的需 時間進 點。 片之多 片内容 同程度 影像圖 據多層 示不同 速瀏覽 賴極大人力。又由 節，故難以針對影 述，特別是傳統上 往是單純的顯示固 有效的提供具有層 數位影片資料搜尋 ’讓使用者可以輕 數位影片資料所提 效的被利用。 出一種多層次影片 片所包含的數位影 分，同時提供多層 求，進行數位影片 行切分不符合使用 層次影片瀏覽系統 變化的偵測來切分 的内容變化來作多 片做為索引圖片以 次的切分結果，數 層次的瀏覽畫面， η1261192 V. INSTRUCTIONS (2) Indexing the information of the parent section and the digitized data of each paragraph in the film by hand. The demand for the video data of the book is divided. Therefore, the information that enables the company to obtain the required resources can be [invented]. In order to improve the knowledge of the browsing system and its squares, the information can be browsed automatically and the data can be browsed quickly. The purpose and method, the digital video data, the hierarchical index; the same representation of this episode or video material can be used for users to comment on a large number of video content does not necessarily contain a complete and objective and detailed text description And the way of browsing, the past 'fixed time interval is difficult to lead the main lead' iron method one by one to meet the various systems can provide effective indexing, and quickly browse the entire paragraph to make digital video material more technical, lack of law, mainly based on content It can be used to solve the problem of the time of the communication. The present is used to cut the different scenes according to the distance between the adjacent and the output cut scenes. No matter what you are. The root, the result is fast, and the invention is proposed to make the time of the shadow level the same. The content of the film The content of the film The same level Image image The data shows the different speeds. It is also difficult to address the film, especially the traditionally effective display of the layered video data search, which allows the user to use the light digital data. A multi-level film contains a digital image, and provides multiple layers of information. The digital film segmentation does not conform to the change of the content of the hierarchical video browsing system to make multiple slices as index images. Sub-segmentation results, number of levels of browsing, η
第6頁 1261192 五、發明說明（3) 為了針制* / 先對數位影片多2影片資料查詢出特定影片段落，我們需 發明所提供之夕^ _人的切分，並且進行進一步的比對。本 影片資料根攄^層次影片瀏覽方法，將儲存於電腦之數位 用複數組索引圖^内容差異產生複數組索引圖片，進而利 步驟：首先，:片組成多層次索引圖片集。其包含有下列 引圖片，每一細：數位影片資料進行切分以取出複數組索 分；輸出每組帝⑴引圖片係基於不同程度的内容變化作切 集，進而組成夕、^片及其對應片段位置至一索引圖片 包含之每組索人之索引圖片冑；將每層索引圖片集所 形成多層次的福:片順序排列組合輸出為一·覽晝面，以 尽人的设數個瀏覽晝面。 d组以：：，”皆經過切分完成後，所有輸 弓1圖片集都表示影像資料的—段ΐ 集，母一層索 口在電腦之數位。;=二= 處理模組、影像切分模組、;^隹^像解碼模組、預 組。影像解瑪模組係用以對於數和劉覽介面模 值；預處理模組則用來對J y的原始像素 心像圖片進行預處理以 第7頁 五、發明說明（4) 去除雜訊等不必要的影響，並將該影像圖片的原始 轉為灰階像素值；影像切分模組係藉由比較相鄰^ $僮 片的灰階像素值，以檢測出複數組索引圖片；索引=二 ΐϊ面”複數組索引圖片儲存為複數層索引圖片i :; 見；丨面杈.、且，係用以將每一層索引圖片集所包 引圖片組合輸出為一湖覽書面真來W夕 、、、且索 j 到見旦面再形成多層次瀏覽晝面。 错由上述之方法可以把數位影片資料根據1 :成具有完整的情節或場景的很多片段組合:、：‘即 内容，噗㈣：: 來表不這段情節或場景的 ：使用者可以輕易找到所需的影像 ：：？ 層乂之索引圖片集，可供使用者而猎由夕 資料的主要内容，再針對自己有廬趣=-個數位影片 細部的内容，利用多声次舍弓丨蚩、I的片奴一一檢視較為 快速而有效的比對。θ ’、 |面4覽數位影片資料可做 為使對本發明的目的、構造 了解，茲配合圖示詳細說明如：、"，、功能有進一步的 【貫施方式】 含有：：：第1圖，其為本發明實施例之方、 有下列步驟：首先，對數位影方法机程圖。包 個影像圖片，並得到影像圖 進厅解碼以形成複 (:v再對影像圖片進行預處理消：：像素值(步驟 作"驟120);將複數個影像圖片的*減汛和不必要的影響 像素值（步驟130);設定遞減游f始像素值轉換為灰階 4 0);累計相鄰影像圖片之 丈個臨界閥值（步驟 位置的灰階像素差異 1261192 五、發明說明（5) 之累積值（步驟150);擷取累積值大於第—個臨界閥值之 影像圖片以組成一組索引圖片（步驟i 6 〇 )，每一索引圖片Page 6 1261192 V. Description of invention (3) In order to make a */first search for a specific film passage for a digital video and more than 2 video materials, we need to invent the division of the provided _ ^ _ person and make further comparisons . This video data is based on the ^ level video browsing method, which will be stored in the computer's digits. The complex array index image is generated by the complex array index image and the content difference. Steps: First, the slices form a multi-level index image set. It includes the following pictures, each detail: the digital video data is divided to extract the complex array; the output of each group of the emperor (1) is based on different levels of content changes for the cut set, and then form the eve, ^ and its Corresponding segment position to index image of each group of people included in an index picture; forming a multi-level blessing of each layer of index picture sets: the order of the pieces is output as one view, and the number of people is set Browse the page. After the grouping of d::,", after all the cuts are completed, all the images of the bow 1 represent the image data, and the maternal layer is in the digit of the computer.; = 2 = processing module, image segmentation The module, the ^^^ image decoding module, the pre-group. The image decoding module is used for the logarithm and the Liujian interface modulus; the pre-processing module is used to preprocess the original pixel image of the Jy 7 pages 5, invention description (4) remove unnecessary effects such as noise, and convert the original image image into grayscale pixel values; image segmentation module is to compare the grayscale of adjacent children's films Pixel value to detect complex array index picture; index=two-sided" complex array index picture is stored as complex layer index picture i :; see; 丨 杈 、., and is used to pack each layer of index picture set The combination of the picture and the output of the picture is written in a lake, and the picture is really written to the W-, and, and the j-to-face to form a multi-level browsing. By the above method, the digital video material can be combined according to 1: into a complete plot or scene with many segments: ,: 'that is, content, 噗 (four):: to show the episode or scene: the user can easily find Required image::? The layered index picture set, for users to hunt for the main content of the eve data, and then for their own interest =- a number of video details of the content, the use of multiple times bow, I's a slave View the quicker and more effective comparisons. θ ', | face 4 view digital video material can be used to make the purpose and structure of the present invention, as explained in the figure, such as:, ", function has a further [through the way] contains::: 1st The figure is the embodiment of the embodiment of the present invention and has the following steps: First, a logarithmic bitmap method. Pack an image picture, and get the image image into the hall to decode to form a complex (: v and then pre-process the image picture:: pixel value (step for " step 120); reduce the number of image images by * Necessary influence pixel value (step 130); setting the decreasing pixel value to the gray level 4 0); accumulating the threshold value of the adjacent image picture (the gray level pixel difference of the step position 1261192) 5) the cumulative value (step 150); extracting the image picture whose accumulated value is greater than the first critical threshold to form a set of index pictures (step i 6 〇), each index picture
係對應一影像片段位置；依序擷取每一臨界閥值所對D 每組索引圖片（步驟17〇);輸出每組索引圖片以形成複數 層索引圖片集（步驟18〇);將每層索引圖片集所包含之 組索引圖片排列組合輸出為一瀏覽晝面，以形成多犀 瀏覽晝面（步驟190)。其中，複數個臨界閱 曰' 一方式遞減。 】值係以一为之 此外，本發明更包含一相應產生每一 料的步驟，索引資料可包含編號、起始：㈡： ^束晝面位置、時間長度、代表晝面位置及註解文字等 月S考第2圖，其為本發明實施例之多層次影片瀏臨 糸統示意圖，係於數位影片資料2〇〇選出複以 亚輸出成複數層索引圖片集，每一索引 ’、\片 V傻其系統包含*:影像解碼模組210、預：理;像 旦本發明之方法時’數位影片資料2 0 0係輪入於 2?⑽、隹二旲組2 1 〇，影像解碼模組2 1 〇則對於數位影片資料 Π :值；複數個影像圖片再由預處理模組： Κ = 除雜訊等不必要的影，，並將複數個景象 圖片的原始像素值轉為灰階像素*Corresponding to an image segment position; sequentially extracting each set of index pictures for each threshold threshold (step 17〇); outputting each set of index pictures to form a plurality of layer index picture sets (step 18〇); The group index picture arrangement combination included in the index picture set is output as a browsing face to form a multi-rhythm browsing face (step 190). Among them, a plurality of critical readings are decremented. In addition, the present invention further includes a step of generating each material correspondingly, and the index data may include a number, a start: (2): a position of the beam, a length of time, a position of the face, and an annotation text. Figure 2 is a second schematic diagram of a multi-level video browsing system according to an embodiment of the present invention. The digital video data is selected and output into a complex layer index picture set, each index ', \ piece V silly system includes *: image decoding module 210, pre-processing; as in the method of the present invention, 'digital video data 2000 rounds in 2? (10), 隹 two groups 2 1 〇, image decoding mode Group 2 1 〇 for digital video data Π: value; multiple image images and then pre-processing module: Κ = unnecessary shadows such as noise, and the original pixel values of multiple scene images are converted to grayscale Pixel*
1261192 五、發明說明（6) 模組2 3 0比輕、i日細 值，以檢測出每《且之^象圖圖片片及的/階像素值差異之累積 ”位置輪出至索“且=成”每組索引圖片 木，並可對每—層隹:、、、成夕層次索引圖片 層索引圖片集所木目應產生索弓I資料，；每— 組合輸出為—。：：母：索引圖片再經由㈣介面模组 數位影片資料成多層次劉覽晝面。其t、， 此外，本發明更'包人士”或是網路傳輸。 法，請參考第3圖，其為3 即^之影片多層次濁覽方 利用儲存於電腦數位/〜用例之方法流程圖。係 所組成的多層次索貝料所切分之複數組索引圖片 個臨界閥值來切分，臨界二佶索引圖片係根據遞減之複數 階像素差異之累 i : {係用以和相鄰影像圖片的灰 片係對應一影像片% ^ ^取出索引圖片，每一索引圖 驟包含有··㈣啟2進行即時多層次瀏覽，其步 化程度最大之索 守^見旦面（步驟3 1 〇 )，係由内容變 索引圖片集係根:集所包含的索引圖片所組成，即其 息（步驟32 0 )，以、^的^界閱值作切分；接收一選擇訊 段；開啟一進階、^臨♦特定之索引圖片以及其對應影片片 較小之索引圖片:見里面（步驟3 3 0 )，係由内容變化程度 組成，即其索引:取出對應影片片段所包含的索引圖片所 由於本發明：二：：根據其次的臨界閥值作切分。 形成多層次瀏覽書、衫像育料中所擷取之複數組索引圖片 是欲建構影像I =可方便使用者進行快速瀏覽。特別 象貝抖庫的使用者能以更快的速度，對重要的1261192 V. Description of the invention (6) Module 2 3 0 is lighter and i-day fine value, to detect the position of each [and the image of the image and the difference of the pixel value difference] = into "each group of index pictures wood, and for each layer -:,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, The index picture is then multi-leveled through the (four) interface module digital video material. In addition, the invention is more 'packaged person' or network transmission. For the method, please refer to Figure 3, which is a multi-level turbidity of the film of 3, which is a flowchart of the method stored in the computer digits/~ use case. The multi-level Sobeite material consisting of multiple levels of Sobey material is divided into multiple critical index indexes to cut the critical threshold. The critical two-index image is based on the decreasing complex-order pixel difference. i: {System and adjacent image The gray image of the picture corresponds to a video slice % ^ ^ to take out the index picture, and each index picture contains ··(4) start 2 for instant multi-level browsing, and the most step-by-step is to meet the surface (step 3 1) 〇), is the content index index image set is the root: the index image contained in the set, that is, its interest (step 32 0), with the ^ boundary value of the ^ for the segmentation; receive a selection segment; An advanced index, a specific index picture, and a smaller index picture of its corresponding movie: see inside (step 3 3 0), which consists of the degree of content change, that is, its index: extract the index contained in the corresponding movie fragment. The picture is due to the invention: two:: according to the second critical threshold for the division. Forming a multi-level browsing book, the image of the complex array index captured in the image is to construct the image I = convenient for the user to quickly browse. Especially users like the Bay Library can be important at a faster rate.
1261192 五、發明說明（7) 切分段落作人工註解等處理。影像資料中每個切分段落的 索引資料（包含編號、起始晝面位置、結束晝面位置、時 間長度、代表晝面位置及註解文字等等），亦可以透過資 料庫檔案的形式產生，並輸出至索引圖片集，其中僅有註 解文字需要經過人工方式加入，其他的都可以透過程式自 動產生。藉由多層次瀏覽晝面，使用者不僅可在影像資料 中簡單而有效的比對搜尋出所需的片段，同時可以進一步 得到許多切分段落資訊，使影像資料能更方便有效的被更 多人使用。 雖然本發明之較佳實施例揭露如上所述，然其並非用 以限定本發明，任何熟習相關技藝者，在不脫離本發明之 精神和範圍内，當可作些許之更動與潤飾，因此本發明之 專利保護範圍須視本說明書所附之申請專利範圍所界定者 為準。1261192 V. Description of invention (7) Segmentation of paragraphs for manual annotation and other processing. The index data of each segmented paragraph in the image data (including the number, starting position, ending position, length of time, representing the position of the face and annotation text, etc.) can also be generated by means of a database file. And output to the index picture set, only the annotation text needs to be manually added, and other items can be automatically generated by the program. By multi-level browsing, users can not only find the required segments in a simple and effective comparison in the image data, but also get a lot of segmentation information, so that the image data can be more convenient and effective. People use. While the preferred embodiment of the invention has been described above, it is not intended to limit the invention, and it is obvious to those skilled in the art that the invention may be modified and modified without departing from the spirit and scope of the invention. The patent protection scope of the invention is subject to the definition of the scope of the patent application attached to the specification.
第11頁 1261192 圖式簡單說明 第1圖為本發明實施例之方、土 1 ^ ^ 0 — 又万去流程圖； 弟2圖為本發明實施例之牿 <荷欲影像資料 圖；及 掏取系統示意 第3圖為本發明應用例之方法流程圖。 【圖式符號說明】 步驟11 0 對數位影片資料淮并紐雄^ / 像圖片，並得到影像圖片的原=丁素解值碼以形成複數個影 對影像圖片進行預處理消除雜訊和不必要 步驟1 3 0 將複數個影像圖片的原始像素 階像素值 步驟1 4 0 設定遞減之複數個臨界閥值 累計相鄰影像圖片之所有對應位置的灰階 轉換為灰 步驟1 5 0 像素差異之累積值 步驟1 6 0 擷取累積值大於第一個臨界閥值之影像圖 片以組成一組索引圖片 步驟1 7 0 依序擷取每一臨界閥值所對應之每組索引 圖片 ^ 步驟180 輸出每組索引圖片以形成複數層索引圖片 集 步~1 9 0 將每層索引圖片集所包含之每組索引圖片 排列組合輸出為—瀏覽晝面，以形成多層次的瀏覽晝面 200 210 數位影片資料 影像解碼模組Page 11 1261192 Brief Description of the Drawings FIG. 1 is a flowchart of the embodiment of the present invention, a soil 1 ^ ^ 0 - 10,000; and a second diagram of the image of the image of the image of the present invention; FIG. 3 is a flow chart of a method for applying an example of the present invention. [Illustration of schema symbols] Step 11 0 The digital video data Huaihe New Zealand ^ / Like the picture, and get the original image of the image image = Dingsu solution to form a plurality of shadows to preprocess the image to eliminate noise and no The necessary steps 1 3 0 convert the original pixel-order pixel values of the plurality of image images. Step 1 4 0 Decrease the plurality of threshold thresholds and accumulate the gray scales of all corresponding positions of the adjacent image images into gray steps 1 5 0 pixel difference Cumulative value Step 1 6 0 Capture image images with accumulated values greater than the first critical threshold to form a set of index pictures. Step 1 7 0 Capture each set of index pictures corresponding to each critical threshold. Step 180 Output Each set of index pictures to form a complex layer index picture set step ~ 1 9 0 Each group of index picture sets included in each set of index picture arrangement is output as - browse the face to form a multi-level browsing page 200 210 digital video Data decoding module
第12頁 1261192Page 12 1261192
第13頁 圖式簡單說明 220 預處理模組 230 影像切分模組 240 索引圖片集模組 250 瀏覽介面模組 步驟3 1 0 開啟一即時瀏覽晝面 步驟3 2 0 接收一選擇訊息 步驟3 3 0 開啟一進階瀏覽晝面Page 13 Simple Description 220 Pre-Processing Module 230 Image Segmentation Module 240 Index Picture Set Module 250 Browse Interface Module Step 3 1 0 Open an Instant View Step 3 2 0 Receive a Select Message Step 3 3 0 Open an advanced browsing page