TWI554094B - Multi - view audio - visual intelligent switching system and method - Google Patents
Multi - view audio - visual intelligent switching system and method Download PDFInfo
- Publication number
- TWI554094B TWI554094B TW104119917A TW104119917A TWI554094B TW I554094 B TWI554094 B TW I554094B TW 104119917 A TW104119917 A TW 104119917A TW 104119917 A TW104119917 A TW 104119917A TW I554094 B TWI554094 B TW I554094B
- Authority
- TW
- Taiwan
- Prior art keywords
- view
- information
- video
- viewing
- audio
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 27
- 230000000007 visual effect Effects 0.000 title 1
- 238000004458 analytical method Methods 0.000 claims description 25
- 230000007246 mechanism Effects 0.000 claims description 12
- 238000011156 evaluation Methods 0.000 claims description 11
- 238000005457 optimization Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 description 7
- 238000007726 management method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000007619 statistical method Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Description
本發明係關於一種應用於多視角影音智慧切換系統及方法，特別係指在具備多視角的影音內容中，透過一可自動判斷何種視角最具觀看價值的判斷機制，為用戶選擇最佳視角的影音來觀看，以減少使用者在眾多多視角影音內容中，不知該選哪台做為收視影音內容中並錯過了最精華視角鏡頭的問題，並增加用戶的最佳收視體驗。 The invention relates to a multi-view audio-visual intelligent switching system and method, in particular to selecting a best viewing angle for a user through a judging mechanism that can automatically determine which viewing angle has the most viewing value in a multi-view audiovisual content. The audio and video to watch, in order to reduce the user in a large number of multi-view video content, I do not know which one to choose as the viewing of audio and video content and missed the most essential perspective lens, and increase the user's best viewing experience.
過往有關針對多視角的切換，仍著墨在多視角預覽技術以及各多視角使用統計之相關應用為主(例如：提供即時多視角影像預覽、多視角圖片預覽、降低預覽資訊的資料傳輸量以及在哪個視角安插廣告)，並在相關的收視端提供一多路多視角頻道，以及各多視角頻道的即時圖片預覽，讓用戶依圖像選擇多視角，及利用頭端所收集到的資訊，決定在那個多視角安插特定影片資訊。 In the past, regarding the switching of multiple viewing angles, it is still in the multi-view preview technology and related applications of various multi-view usage statistics (for example, providing instant multi-view image preview, multi-view image preview, reducing the amount of preview information, and Which perspective is used to insert the advertisement), and provide a multi-channel multi-view channel on the relevant viewing end, and an instant image preview of each multi-view channel, allowing the user to select multiple viewing angles according to the image, and using the information collected at the head end to decide Insert specific video information at that multi-view.
本案發明人鑑於上述習用方式所衍生的各項缺點，乃亟思加以改良創新，並經多年苦心孤詣潛心研究後，終於成功研發完成本多視角影音智慧切換系統及方法。 In view of the shortcomings derived from the above-mentioned conventional methods, the inventor of the present invention has improved and innovated, and after years of painstaking research, he finally succeeded in researching and developing the multi-view audio-visual intelligent switching system and method.
本發明的目的即在於提供多視角影音智慧化的切換影音內容的系統及方法，其中多視角智慧切換系統，包含：一多視角觀看行為紀錄分析蒐集伺服器；一社群行為資訊資料庫；一用戶社群行為資訊；一用戶多視角觀看行為資訊；一選台權重資訊；一選台權重資訊資料庫；一多視角觀看行為紀錄資訊伺服器；一視角最佳化資訊；一最佳化視角錄製儲存伺服器。 The object of the present invention is to provide a system and method for switching audio and video content with multi-view audio and video, wherein the multi-view intelligent switching system includes: a multi-view viewing behavior record analysis and collecting server; a community behavior information database; User community behavior information; one user multi-view viewing behavior information; one selection platform weight information; one selection platform weight information database; one multi-view viewing behavior record information server; one perspective optimization information; one optimization perspective Record the storage server.
其中，一多視角觀看行為紀錄分析蒐集伺服器，係提供使用者在觀賞多視角影音時，用戶多視角觀看行為紀錄模組會自動記錄該使用者的觀看行為，並將該觀看行為之資訊傳回至該多視角觀看行為紀錄分析蒐集伺服器；一社群行為資訊資料庫，係具有影音討論次數、正面評價、負面評價之資訊，並由該多視角觀看行為紀錄分析蒐集伺服器連線取用；一用戶社群行為資訊，係包含用戶之社群行為資訊；一用戶多視角觀看行為資訊，係提供該多視角觀看行為紀錄分析蒐集伺服器之觀看行為影音資訊；一選台權重資訊，係包含複數種評分項目，並計算權重之資訊；一選台權重資料庫，係包含多視角影音，經由計算後之權重分數資訊，由多視角觀看行為紀錄資訊伺服器連線取用；該多視角觀看行為紀錄資訊伺服器，係當用戶選擇自動切換時，用戶多視角自動切換功能模組會透過該多視角觀看行為紀錄資訊伺服器，取得儲存在儲存裝置之權重資料，決定各視角影音的排序後， 由最高排序開始選擇；一視角最佳化資訊，係包含多視角影音內容，在平台端所分析統計所產生該多視角影音內容之權重分數最高的各片段資訊，由此資訊即可組合出該影音內容視角最佳化的離線影片；一最佳化視角錄製儲存伺服器，係由該平台端所蒐集到的該視角最佳化資訊以及多視角影音內容權重分數最高的各片段資訊。 Wherein, the multi-view viewing behavior record analysis collecting server provides the user to automatically record the viewing behavior of the user when viewing the multi-view video and audio, and transmit the information of the viewing behavior. Returning to the multi-view viewing behavior record analysis and collecting server; a community behavior information database, having the information of video discussion frequency, positive evaluation, negative evaluation, and viewing the server connection by the multi-view viewing behavior record analysis a user community behavior information, including the user's community behavior information; a user's multi-view viewing behavior information, providing the multi-view viewing behavior record analysis to collect the server's viewing behavior video information; a selection of weight information, The system includes a plurality of scoring items and calculates weight information; a selection weight database includes multi-view audio and video, and the multi-view viewing behavior information server is accessed through the calculated weight score information; Viewing the behavior record information server, when the user chooses to automatically switch, the user has multiple views from After switching module will watch the behavior of log information server via the multi-angle, the right to obtain heavy data stored in the storage device, the decision to sort each view audio and video, The selection is started by the highest ranking; the one-view optimization information includes the multi-view audio-visual content, and the analysis of the statistics generated by the platform side generates the segment information with the highest weight score of the multi-view audio and video content, and the information can be combined. An offline video optimized for audio and video content perspective; an optimized view recording storage server is the view optimization information collected by the platform end and the segment information with the highest weight score of the multi-view video content.
本發明的另一目的即在於提供多視角影音智慧化的切換影音內容的系統及方法，其中多視角智慧切換方法，包括：從頭端取得多視角節目影音串流列表，使用者在觀賞多視角影音時，記錄使用者的觀看行為；從頭端取得多視角切換之資訊，取得使用者的觀看行為以及社群行為資訊；從裝置端取得多視角切換之系統狀態參考資訊，對使用者的觀看行為以及社群行為資訊，進行統計與分析，針對各視角影音產生不同的權重；從裝置端取得多視角切換之用戶設定資訊，當觀看多視角影音時，用戶可選擇視角切換模式，並依據所選擇之模式，進行相應之處理；進行多視角自動切換決策，取得裝置的狀態與效能；當評估裝置的效能及狀態，符合條件者，則執行多視角切換相關機制，切換到該視角之影音播放，反之，若不符合選擇視角之影音，則留在原視角，播放預設視角之影音；完成多視角切換相關機制。 Another object of the present invention is to provide a system and method for switching audio and video content with multi-view audio and video, wherein the multi-view smart switching method includes: obtaining a multi-view program video stream list from the head end, and the user viewing the multi-view video and audio. Recording the user's viewing behavior; obtaining multi-view switching information from the head end, obtaining the user's viewing behavior and community behavior information; obtaining the system state reference information of the multi-view switching from the device side, and viewing the user's viewing behavior and Community behavior information, statistics and analysis, different weights for each view video and audio; from the device side to obtain multi-view user setting information, when viewing multi-view video, the user can select the view switching mode, and according to the selected The mode is processed accordingly; the multi-view automatic switching decision is made to obtain the state and performance of the device; when the performance and state of the device are evaluated, if the condition is met, the multi-view switching related mechanism is executed, and the video and audio playback of the view is switched, and vice versa. If it does not meet the video of the selected viewing angle, leave it in the original perspective. Put the default perspective of the video; the completion of multi-angle switching mechanism.
本發明所提供一種多視角影音智慧切換系統及方法，與其他習用技術相互比較時，更具備下列優點： The invention provides a multi-view audio-visual intelligent switching system and method, which has the following advantages when compared with other conventional technologies:
1.用戶多視角觀看行為紀錄模組：用來紀錄用戶觀看多視角的觀看行為及使用狀態，本模組每隔一段時間記錄用戶目前所觀看的視角影音資訊、社交聊天資訊，並將紀錄下來的資訊送回頭端進行分析統計使用。 1. User multi-view viewing behavior record module: used to record the viewing behavior and usage status of users viewing multiple viewing angles. This module records the viewing angle video information and social chat information that the user is currently viewing at regular intervals, and will record it. The information is sent back to the head for analysis and statistics.
2.用戶多視角自動切換功能模組：由頭端取得提供多視角切換之準則以及裝置端目前的效能以及狀態，根據切換之準則以及裝置的效能與狀態，選擇最適合之視角的影音來播放，並自動切換到該視角的影音播放。 2. User multi-view automatic switching function module: The head end obtains the criterion of providing multi-view switching and the current performance and state of the device end. According to the switching criterion and the performance and state of the device, the most suitable viewing angle is selected to play. And automatically switch to the video playback of the view.
3.用戶多視角觀看行為紀錄分析模組：接收用戶多視角觀看行為紀錄模組傳來的資訊並統計所有用戶裝置熱門的多視角影音，如最多人收看、最久停留時間、最多人討論等統計資訊，經由分析後轉換成權重資訊供終端裝置讀取，並輸入到用戶多視角自動切換功能模組來選擇最適當的視角之影音來播放。 3. User multi-view viewing behavior record analysis module: Receive users' multi-view viewing behavior record module information and count all user devices' popular multi-view video and audio, such as most people watching, longest stay time, most people discussion, etc. The statistical information is converted into weight information for analysis by the terminal device, and input to the user multi-view automatic switching function module to select the most appropriate viewing angle of the video to play.
101‧‧‧多視角觀看行為紀錄分析蒐集伺服器 101‧‧‧Multi-view viewing behavior record analysis collection server
102‧‧‧社群行為資訊資料庫 102‧‧‧Community Behavior Information Library
103‧‧‧用戶社群行為資訊 103‧‧‧User community behavior information
104‧‧‧用戶多視角觀看行為資訊 104‧‧‧Users viewing behavior information from multiple perspectives
105‧‧‧選台權重資訊 105‧‧‧Selection weight information
106‧‧‧選台權重資料庫+ 106‧‧‧Selection weight database +
107‧‧‧多視角觀看行為記錄資訊伺服器 107‧‧‧Multi-view viewing behavior record information server
108‧‧‧視角最佳化資訊 108‧‧‧Viewpoint Optimization Information
109‧‧‧最佳化視角錄製儲存伺服器 109‧‧‧Optimized perspective recording storage server
110‧‧‧平台端 110‧‧‧ platform side
201‧‧‧觀看行為記錄單元 201‧‧‧View Behavior Recording Unit
202‧‧‧觀看行為記錄分析單元 202‧‧‧View Behavior Record Analysis Unit
203‧‧‧自動切換功能單元 203‧‧‧Automatic switching function unit
301‧‧‧用戶裝置端 301‧‧‧User device side
302‧‧‧記錄用戶多視角觀看行為 302‧‧‧ Record user multi-view viewing behavior
303‧‧‧回報頭端多視角觀看行為 303‧‧‧Returning multi-view viewing behavior at the head end
S401~S408‧‧‧設備管理之處理流程 S401~S408‧‧‧Process management process
S501~S505‧‧‧告警事件管理之處理流程 S501~S505‧‧‧Processing process of alarm event management
601‧‧‧觀看行為紀錄分析蒐集伺服器 601‧‧‧View behavior record analysis collection server
602‧‧‧用戶多視角觀看行為紀錄分析模組 602‧‧‧User multi-view viewing behavior analysis module
603‧‧‧儲存裝置 603‧‧‧Storage device
604‧‧‧多視角觀看行為記錄資訊伺服器 604‧‧‧Multi-view viewing behavior record information server
605‧‧‧觀看行為記錄單元 605‧‧‧View Behavior Recording Unit
606‧‧‧用戶多視角自動切換功能模組 606‧‧‧User multi-view automatic switching function module
607‧‧‧社群行為資訊 607‧‧‧Community Behavior Information
請參閱有關本發明之詳細說明及其附圖，將可進一步瞭解本發明之技術內容及其目的功效；有關附圖為：圖1為本發明多視角影音智慧切換系統及方法之系統架構示意圖；圖2為本發明多視角影音智慧切換系統及方法之設備管理規則之整合方法示意圖；圖3為本發明多視角影音智慧切換系統及方法之告警事件管理規則之整合方法示意圖；圖4為本發明多視角影音智慧切換系統及方法之子系統 異常監測方法於設備管理之處理流程圖；圖5為本發明多視角影音智慧切換系統及方法之子系統異常監測方法於告警事件管理之處理流程圖；圖6為本發明多視角影音智慧切換系統及方法之多視角影音時之流程架構圖。 The detailed description of the present invention and the accompanying drawings will be further understood, and the technical contents of the present invention and the functions thereof are as follows. FIG. 1 is a schematic diagram of a system architecture of a multi-view audio-visual intelligent switching system and method according to the present invention; 2 is a schematic diagram of a method for integrating device management rules of a multi-view audio-visual switching system and method according to the present invention; FIG. 3 is a schematic diagram of an integrated method for alarm event management rules of a multi-view audio-visual intelligent switching system and method according to the present invention; Subsystem of multi-view audio and video intelligent switching system and method FIG. 5 is a flowchart of processing an alarm abnormality management method for a multi-view audio-visual intelligent switching system and method according to the present invention; FIG. 6 is a multi-view audio-visual intelligent switching system according to the present invention; The process architecture diagram of the multi-view video and audio method of the method.
為了使本發明的目的、技術方案及優點更加清楚明白，下面結合附圖及實施例，對本發明進行進一步詳細說明。應當理解，此處所描述的具體實施例僅用以解釋本發明，但並不用於限定本發明。 The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
以下，結合附圖對本發明進一步說明：請參閱圖1所示，係為一平台端110包含選台權重資訊105，其包含各種影響因子，例如同時間觀看人數、同一時段觀看成長人數、觀看時間長短，加上社群行為資訊資料庫102所收集資訊如用戶社群行為資訊103及用戶多視角觀看行為資訊104及討論次數、正面評價、負面評價…等因素於多視角觀看行為紀錄分析蒐集伺服器101進行計算，其中計算方式可依各種項目的重要性而改變其重要係數，重要係數值在此定義為F，F介於(0~1)之間，例如同時間觀看人數可設定為F 1 值為0.5，觀看時間長短可設為值F 2 為0.3…等。各種項目排名分數因多視角影音排名而異，各種項目排名分數定義為S，S介於(0~1)之間，如該影音同時間觀看人數排名分數為S 1 ，同一時段觀看成長人數排名分數為S 2 …等，即可得到該多視角影音在各種項目與其它多視角影音的排名成績。再考量到該項目的重要係數F，則選台權重資訊可定義為FS=F 1 S 1 +F 2 S 2 +F 3 S 3 +…+F n S n ，選台權重資訊可被儲存至選 台權重資料庫106提供裝置端存取，若選台權重資訊若尚無足夠資訊產生權重，將給予預設權重。 Hereinafter, the present invention is further described with reference to the accompanying drawings. Referring to FIG. 1 , a platform end 110 includes channel selection weight information 105, which includes various influence factors, such as the number of people watching at the same time, the number of people watching and watching at the same time, and the viewing time. The length and length, together with the information collected by the community behavior information database 102, such as the user community behavior information 103 and the user's multi-view viewing behavior information 104 and the number of discussions, positive evaluation, negative evaluation, etc. The calculation unit 101 performs calculations in which the important coefficients are changed according to the importance of various items. The important coefficient values are defined here as F and F is between (0 and 1). For example, the number of simultaneous views can be set to F. The value of 1 is 0.5, and the length of the viewing time can be set to a value F 2 of 0.3 or the like. The ranking scores of various items vary according to the multi-view video and audio rankings. The ranking scores of various items are defined as S and S are between (0~1). If the number of viewers in the video is at the same time, the ranking score is S 1 . The score is S 2 ..., etc., and the ranking results of the multi-view video and audio in various items and other multi-view audio and video are obtained. After considering the important coefficient F of the project, the channel weight information can be defined as FS = F 1 S 1 + F 2 S 2 + F 3 S 3 +... + F n S n , and the channel weight information can be stored to The channel selection weight database 106 provides device-side access. If the channel selection weight information does not have enough information to generate weights, a preset weight will be given.
其上述所提及之影音，包含即時的多視角頻道或是非即時的影音資訊如多視角的影片…等各種影音內容，只要符合可提供多視角的內容皆可做為本案所揭露之內容進行自動切換。另外當多視角觀看行為紀錄伺服器107可自動紀錄下平台端110內所蒐集到多視角影音內容權重分數最高的各片段資訊，並紀錄為視角最佳化資訊108，多視角觀看行為紀錄資訊伺服器107，係當用戶選擇自動切換時，用戶多視角自動切換功能模組會透過該多視角觀看行為紀錄資訊伺服器，取得儲存在儲存裝置之權重資料，決定各視角影音的排序後，由最高排序開始選擇，藉由此資訊即可利用一最佳化視角錄製儲存伺服器109進行自動化的依據視角最佳化的資訊，將各最佳化片段所組成的最佳化視角的影片錄製下來做成離線影音內容並供後續應用。 The audio and video mentioned above includes instant multi-view channels or non-instant video information such as multi-view videos... and other audio and video content, as long as it meets the content that can provide multiple views, it can be automatically made for the content disclosed in this case. Switch. In addition, when the multi-view viewing behavior record server 107 can automatically record the clip information of the multi-view video content weight score collected in the platform end 110, and record it as the view optimization information 108, the multi-view viewing behavior record information servo When the user selects automatic switching, the user multi-view automatic switching function module can view the behavior record information server through the multi-view view, obtain the weight data stored in the storage device, and determine the order of the audio and video of each view. Sorting starts selection, and by using this information, the optimized viewing angle storage server 109 can be used to automatically optimize the viewing angle-optimized information, and the optimized viewing angle composed of the optimized segments is recorded. Offline audio and video content for subsequent applications.
請參閱圖2所示，係為多視角自動切換功能模組，包含：觀看行為紀錄單元201，係位於用戶端的裝置上，以紀錄用戶觀看多視角的觀看行為及使用狀態；自動切換功能單元202，係亦位於用戶端的裝置上，並執行多視角自動切換機制；以及觀看行為紀錄分析單元203，係位於起始端，並即時接收該裝置傳來的資訊，並統計所有該用戶裝置熱門的多視角影音。 Referring to FIG. 2 , the multi-view automatic switching function module includes: a viewing behavior recording unit 201 , which is located on the device of the user end to record the viewing behavior and usage state of the user viewing multiple viewing angles; the automatic switching function unit 202 The system is also located on the device of the user end, and performs a multi-view automatic switching mechanism; and the viewing behavior record analyzing unit 203 is located at the starting end, and immediately receives the information transmitted by the device, and counts all the multi-views of the user device. Audio and video.
其根據系統上從各裝置所蒐集的資訊及裝置端用戶所設定的主觀條件搭配上環境條件，如CPU、網路等狀態 的客觀條件，並即時蒐集並計算各種條件並評分各多視角影音，以達到智慧化切換多視角影音的效果。 It is based on the information collected from each device on the system and the subjective conditions set by the device user, such as CPU, network, etc. The objective conditions, and immediately collect and calculate various conditions and score each multi-view video to achieve the effect of intelligent switching multi-view video.
請同時參閱圖2及圖3，其中，觀看行為紀錄單元201，該單元運行於用戶端的裝置上，用來紀錄用戶觀看多視角的觀看行為及使用狀態，每隔一段時間，用戶端裝置301記錄用戶目前觀看多視角影音資訊、社交聊天等資訊，並記錄用戶多視角觀看行為302，將紀錄下來的資訊送回頭端進行分析統計使用，用戶端程式可自動統計關於哪一個視角影音最常被用戶觀看，或是最常被用戶拿來討論，再回報頭端多視角觀看行為303，收集統計資訊利用網路回傳回到頭端儲存並進行後續的統計分析使用。 Please refer to FIG. 2 and FIG. 3 simultaneously, wherein the viewing behavior recording unit 201 is operated on the device of the user end to record the viewing behavior and the usage state of the user viewing the multi-view, and the client device 301 records every other period of time. The user currently views multi-view video information, social chat and other information, and records the user's multi-view viewing behavior 302, and sends the recorded information back to the head end for analysis and statistics. The user program can automatically count which view angle audio and video is most frequently used by the user. Watch, or most often used by users to discuss, and then return the multi-view viewing behavior 303 at the head end, collect statistical information using the network back to back to the headend storage and use for subsequent statistical analysis.
請同時參閱圖2及圖4，其自動切換功能單元202，其單元於用戶端的裝置上，用來執行多視角自動切換之方法，其流程如下：S401從頭端取得提供多視角節目影音串流列表，得知可支援的多視角的播放串流；S402再從頭端取得多視角切換之參考資訊，即可取得多視角權重的參考資訊；S403再從裝置端取得多視角切換之系統狀態參考資訊，如系統狀態如CPU繁忙程度及各多視角串流之網路連線狀態；S404再從裝置端取得多視角切換之用戶設定資訊，讀取用戶於裝置端程式上所設定的多視角切換的喜好設定；S405進行多視角自動切換決策，再於裝置端程式上透過各多視角的評分判斷機制來決定切換到哪個多視角影音進行播放； S406若現行播放的多視角影音分數較高，則機制將會留在原視角影音繼續播放；S407若因有重大比賽花絮鏡頭出現受到用戶觀看及社群討論，則分數將會衝高，而在多視角自動切換決策時將會自動或是詢問用戶是否切換過去評分較高的多視角影音，如果用戶願意切換則執行切換多視角影音機制；S408完成多視角切換相關機制後，系統將重新此流程並在一定時間內收集統計資訊後重新執行此流程並完成自動切換多視角影音的機制。 Referring to FIG. 2 and FIG. 4, the automatic switching function unit 202 is configured on the device of the user end to perform a multi-view automatic switching method. The flow is as follows: S401 obtains a multi-view program video stream list from the head end. The S406 can learn the multi-view playback stream that can be supported; the S402 can obtain the multi-view weight reference information from the head end to obtain the multi-view weight reference information; and the S403 obtains the multi-view switch system state reference information from the device side. For example, the system status such as the CPU busy level and the network connection status of each multi-view stream; S404 then obtains the user setting information of the multi-view switching from the device side, and reads the user's preference for multi-view switching set on the device side program. Setting; S405 performs multi-view automatic switching decision, and then determines which multi-view video and audio to switch to play through the multi-view score judgment mechanism on the device-side program; S406 If the current multi-view video and audio scores are higher, the mechanism will remain in the original view and the video will continue to play; if the S407 has been watched by the user and the community discussion due to the major game footage, the score will be higher, and more When the angle of view automatically switches the decision, it will automatically or ask the user whether to switch the multi-view video with higher score in the past. If the user is willing to switch, the multi-view video and audio mechanism will be switched. After the S408 completes the multi-view switching related mechanism, the system will restart the process. After collecting statistical information for a certain period of time, re-execute this process and complete the mechanism of automatically switching multi-view video and audio.
請參閱圖2、圖5，其中觀看行為紀錄分析單元203，是為運行於S501頭端伺服器，用來即時接收裝置端傳來的資訊並統計所有用戶裝置熱門的多視角影音如最多人收看、最久停留時間、最多人討論等統計資訊並儲存起來供裝置端來讀取，S502接收各裝置端各用戶多視角觀看行為，收集用戶在各時段觀看某一多視角影音，對該多視角影音進行社交按讚或討論等動作等資訊，S503再統計分析用戶多視角觀看行為，針對用戶的觀看資訊進行統計分析，計算出哪個多視角影音最多人觀看或是最多聊天、按讚等社群動作，S504並取得其它自定資訊，取得各多視角的重要性(如廠商是否安插廣告、影音精采度、政策需要等事宜)，並S505產生即時多視角切換參考資訊並進行儲存，以供裝置端來進行存取。 Please refer to FIG. 2 and FIG. 5 , wherein the viewing behavior record analyzing unit 203 is configured to run on the S501 head end server to receive the information transmitted from the device end and count the popular multi-view video and audio of all user devices. The longest stay time, the most people discuss and other statistical information and stored for the device to read, S502 receives the multi-view viewing behavior of each user at each device end, collects the user to watch a certain multi-view video at each time interval, the multi-view Video and audio to social praise or discussion and other information, S503 statistical analysis of user multi-view viewing behavior, statistical analysis of user viewing information, calculate which multi-view video most people watch or most chat, press like, etc. Action, S504 and obtain other customized information, to obtain the importance of each multi-view (such as whether the manufacturer inserts advertisements, audio and video fineness, policy needs, etc.), and S505 generates instant multi-view switching reference information and stores it for the device. The end is to access.
請參閱圖6所示，在觀賞多視角影音時之流程為：當使用者在觀賞多視角影音時，觀看行為紀錄單元605會自動記錄使用者的觀看行為，如觀看哪個視角，觀看時間長度等並將這些資訊傳回觀看行為紀錄分析蒐集伺服器601。觀看行為紀錄分析蒐集伺服器601將所蒐集到的資訊傳送到用戶 多視角觀看行為紀錄分析模組602。社群行為資訊607則是儲存各個視角的影音在社群中的資訊，如討論次數，正面評價，負面評價等資訊。用戶多視角觀看行為紀錄分析模組602取得使用者的觀看行為以及社群行為資訊607後，例如當使用者選擇手動切換視角時，使用者花了70%時間觀賞第一視角之影音，20%時間觀賞第二視角之影音，10%時間觀賞第三視角，此資訊的權重設定為0.5。在社群網站中，有60%推薦第一視角之影音，10%推薦第二視角之影音，30%推薦第三視角之影音，此資訊的權重設定為0.3。將這些資訊輸入到產生各個視角影音的選台權重資訊。可以得到第一視角影音的權重為0.7*0.5+0.6*0.3=0.53，第二視角影音的權重為0.2*0.5+0.6*0.3=0.28，第三視角影音的權重為0.1*0.5+0.3*0.3=0.14，並將這些權重儲存到儲存裝置603。若某個視角之影音尚無足夠的資訊可以產生權重，則給予預設的權重。如下表1所示。 Referring to FIG. 6 , the process of viewing the multi-view video and audio is as follows: when the user views the multi-view video, the viewing behavior recording unit 605 automatically records the viewing behavior of the user, such as viewing which viewing angle, viewing length, etc. The information is transmitted back to the viewing behavior record analysis collection server 601. The viewing behavior record analysis server 601 transmits the collected information to the user. The multi-view viewing behavior record analysis module 602. Community behavior information 607 is to store information from various perspectives in the community, such as the number of discussions, positive evaluation, negative evaluation and other information. After the user multi-view viewing behavior record analysis module 602 obtains the user's viewing behavior and the community behavior information 607, for example, when the user selects to manually switch the viewing angle, the user spends 70% of the time viewing the first-view video, 20%. Time to watch the video of the second view, 10% time to view the third view, the weight of this information is set to 0.5. In the social networking site, 60% recommend the first-view audio and video, 10% recommend the second-view audio-visual, and 30% recommend the third-view audio and video. The weight of this information is set to 0.3. Input this information into the channel selection weight information that produces the video of each view. The weight of the first view video and audio can be 0.7*0.5+0.6*0.3=0.53, the weight of the second view video and audio is 0.2*0.5+0.6*0.3=0.28, and the weight of the third view video and audio is 0.1*0.5+0.3*0.3 = 0.14 and these weights are stored to storage device 603. If the audio and video of a certain perspective does not have enough information to generate weights, the preset weights are given. As shown in Table 1 below.
當觀看多視角影音時，用戶可以選擇自動切換或者手動切換。當選擇手動切換時，用戶多視角自動切換功能 模組606不作用，而此時用戶多視角觀看行為紀錄模組605會開始記錄使用者的觀看行為並傳回多視角觀看行為紀錄蒐集伺服器601。當用戶選擇自動切換時，用戶多視角自動切換功能模組606會透過多視角觀看行為紀錄資訊伺服器604取得儲存在儲存裝置603之權重資料，決定各視角影音的排序後，由最高排序開始選擇(在上述之範例，第一順序為第一視角之影音(權重為0.53)，第二順序為第二視角之影音(權重為0.28)，第三順序為第三視角之影音(權重為0.14))。當選擇到某個視角的影音後，用戶多視角自動切換功能模組606，會再取得裝置的狀態與效能，如CPU使用率、用戶是否設定排除某個視角影音等。在評估目前裝置的效能(如目前選擇之影音擁有較佳畫質，需要較高之CPU處理能力，檢視目前CPU的使用率評估是否有能力播放目前選擇之影音)以及裝置的狀態(如是否有設定某些視角不予播放後，如果符合本次選擇視角之影音，則切換到該視角之影音播放)，否則，則切換到次一順序視角之影音後，重新做裝置效能與狀態的評估，直到找到符合之視角之影音為止，然後播放此視角之影音。若皆找不到時，則播放預設視角之影音。 When viewing multi-view video, the user can choose to switch automatically or manually. User multi-view automatic switching function when manual switching is selected The module 606 does not work, and at this time, the user multi-view viewing behavior recording module 605 starts to record the user's viewing behavior and returns to the multi-view viewing behavior record collecting server 601. When the user selects the automatic switching, the user multi-view automatic switching function module 606 obtains the weight data stored in the storage device 603 through the multi-view viewing behavior information server 604, determines the sorting of the audio and video in each viewing angle, and selects from the highest sorting. (In the above example, the first sequence is the video of the first view (weight is 0.53), the second sequence is the video of the second view (weight is 0.28), and the third order is the video of the third view (weight is 0.14) ). After selecting the video to a certain angle of view, the user automatically switches the function module 606 to the multi-view, and then obtains the state and performance of the device, such as the CPU usage rate, whether the user sets a certain angle of view, and the like. In assessing the performance of the current device (such as the currently selected audio and video has better image quality, requires higher CPU processing power, check the current CPU usage evaluation to have the ability to play the currently selected video and audio) and the status of the device (if there is After setting certain viewing angles to not play, if the video of the selected viewing angle is met, switch to the video and audio playback of the viewing angle. Otherwise, switch to the video of the next sequential viewing angle, and then re-evaluate the device performance and status. Until you find the audio and video that matches the perspective, then play the video of this perspective. If none can be found, the video of the preset viewing angle is played.
上列詳細說明乃針對本發明之一可行實施例進行具體說明，惟該實施例並非用以限制本發明之專利範圍，凡未脫離本發明技藝精神所為之等效實施或變更，均應包含於本案之專利範圍中。 The detailed description of the present invention is intended to be illustrative of a preferred embodiment of the invention, and is not intended to limit the scope of the invention. The patent scope of this case.
綜上所述，本案不僅於技術思想上確屬創新，並具備習用之傳統方法所不及之上述多項功效，已充分符合新穎性及進步性之法定發明專利要件，爰依法提出申請，懇請貴局核准本件發明專利申請案，以勵發明，至感德便。 To sum up, this case is not only innovative in terms of technical thinking, but also has many of the above-mentioned functions that are not in the traditional methods of the past. It has fully complied with the statutory invention patent requirements of novelty and progressiveness, and applied for it according to law. Approved this invention patent application, in order to invent invention, to the sense of virtue.
101‧‧‧多視角觀看行為紀錄分析蒐集伺服器 101‧‧‧Multi-view viewing behavior record analysis collection server
102‧‧‧社群行為資訊資料庫 102‧‧‧Community Behavior Information Library
103‧‧‧用戶社群行為資訊 103‧‧‧User community behavior information
104‧‧‧用戶多視角觀看行為資訊 104‧‧‧Users viewing behavior information from multiple perspectives
105‧‧‧選台權重資訊 105‧‧‧Selection weight information
106‧‧‧選台權重資料庫+ 106‧‧‧Selection weight database +
107‧‧‧多視角觀看行為記錄資訊伺服器 107‧‧‧Multi-view viewing behavior record information server
108‧‧‧視角最佳化資訊 108‧‧‧Viewpoint Optimization Information
109‧‧‧最佳化視角錄製儲存伺服器 109‧‧‧Optimized perspective recording storage server
110‧‧‧平台端 110‧‧‧ platform side
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW104119917A TWI554094B (en) | 2015-06-22 | 2015-06-22 | Multi - view audio - visual intelligent switching system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW104119917A TWI554094B (en) | 2015-06-22 | 2015-06-22 | Multi - view audio - visual intelligent switching system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TWI554094B true TWI554094B (en) | 2016-10-11 |
| TW201701680A TW201701680A (en) | 2017-01-01 |
Family
ID=57848307
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW104119917A TWI554094B (en) | 2015-06-22 | 2015-06-22 | Multi - view audio - visual intelligent switching system and method |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI554094B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200425084A (en) * | 2002-12-16 | 2004-11-16 | Samsung Electronics Co Ltd | Information storage medium having multi-angle data structure and method therefor |
| TW200842837A (en) * | 2007-04-30 | 2008-11-01 | Cyberlink Corp | A video playback system and method thereof |
| EP2536142A1 (en) * | 2011-06-15 | 2012-12-19 | NEC CASIO Mobile Communications, Ltd. | Method and a system for encoding multi-view video content |
| TW201349848A (en) * | 2012-05-22 | 2013-12-01 | Chunghwa Telecom Co Ltd | Video and audio streaming method of multi-view interactive TV |
| TW201415430A (en) * | 2012-10-05 | 2014-04-16 | Wistron Corp | Video entertainment system and method thereof |
-
2015
- 2015-06-22 TW TW104119917A patent/TWI554094B/en active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200425084A (en) * | 2002-12-16 | 2004-11-16 | Samsung Electronics Co Ltd | Information storage medium having multi-angle data structure and method therefor |
| TW200842837A (en) * | 2007-04-30 | 2008-11-01 | Cyberlink Corp | A video playback system and method thereof |
| EP2536142A1 (en) * | 2011-06-15 | 2012-12-19 | NEC CASIO Mobile Communications, Ltd. | Method and a system for encoding multi-view video content |
| US20140111611A1 (en) * | 2011-06-15 | 2014-04-24 | Nec Casio Mobile Communications, Ltd. | Method and system for encoding multi-view video content |
| TW201349848A (en) * | 2012-05-22 | 2013-12-01 | Chunghwa Telecom Co Ltd | Video and audio streaming method of multi-view interactive TV |
| TW201415430A (en) * | 2012-10-05 | 2014-04-16 | Wistron Corp | Video entertainment system and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201701680A (en) | 2017-01-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11082722B2 (en) | Method and system for generating highlights from scored data streams | |
| US8995823B2 (en) | Method and system for content relevance score determination | |
| EP2820852B1 (en) | Recommender control system, apparatus, method and related aspects | |
| US20160199742A1 (en) | Automatic generation of a game replay video | |
| CN108650558B (en) | Method and device for generating video precondition based on interactive video | |
| CN109769128A (en) | Video recommendation method, video recommendations device and computer readable storage medium | |
| CN107038213A (en) | A kind of method and device of video recommendations | |
| US20160234556A1 (en) | System and Method for Organizing, Ranking and Identifying Users as Official Mobile Device Video Correspondents | |
| WO2014176470A1 (en) | Video service with automated video timeline curation | |
| US20150066583A1 (en) | Content discovery with friend and analytic data | |
| Chen et al. | A study of user behavior in online VoD services | |
| KR20180063051A (en) | METHODS, SYSTEMS AND APPARATUS FOR CONTROLLING MEDIA CONTENT BASED ON ATTENTION DETECTION | |
| US11888951B2 (en) | Systems and methods for adjusting storage based on determining content item popularity | |
| TWI629899B (en) | Method and device for evaluating quality of multimedia resources | |
| JPWO2013061497A1 (en) | Content evaluation and playback system | |
| CN103442270B (en) | A kind of method and device for the viewing-data for gathering user | |
| CN109688217B (en) | Message pushing method and device and electronic equipment | |
| Wang et al. | Context-dependent viewpoint sequence recommendation system for multi-view video | |
| Ameri et al. | Word-of-mouth, observational learning, and product adoption: Evidence from an anime platform | |
| WO2016206035A1 (en) | Information recommendation method and user terminal | |
| TWI554094B (en) | Multi - view audio - visual intelligent switching system and method | |
| CN103517150B (en) | Blu-ray player is representing method and system that Internet video is loading | |
| CN110545451A (en) | stream media card pause identification method, server and system | |
| KR102177488B1 (en) | Method for determining stock item index using media and System for carrying out the same | |
| CN113920464B (en) | A method for improving VR video interaction efficiency |