CN1301619C - Method and interface system for assisting user to detect advertisement segment by displaying interface - Google Patents
Method and interface system for assisting user to detect advertisement segment by displaying interface Download PDFInfo
- Publication number
- CN1301619C CN1301619C CNB2004100637406A CN200410063740A CN1301619C CN 1301619 C CN1301619 C CN 1301619C CN B2004100637406 A CNB2004100637406 A CN B2004100637406A CN 200410063740 A CN200410063740 A CN 200410063740A CN 1301619 C CN1301619 C CN 1301619C
- Authority
- CN
- China
- Prior art keywords
- frames
- user
- interface
- video signal
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 238000001514 detection method Methods 0.000 claims description 14
- 238000001914 filtration Methods 0.000 claims description 4
- 230000000750 progressive effect Effects 0.000 claims 1
- 238000005070 sampling Methods 0.000 description 29
- 238000003780 insertion Methods 0.000 description 21
- 230000037431 insertion Effects 0.000 description 21
- 238000010586 diagram Methods 0.000 description 10
- 230000007246 mechanism Effects 0.000 description 8
- 239000012634 fragment Substances 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000000605 extraction Methods 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
Description
技术领域technical field
本发明涉及一种协助使用者在一视频信号中检测出广告片段的方法与相关接口系统,特别涉及一种能依序以不同时间间隔取样/撷取各帧画面呈现予使用者以协助使用者快速精确地定位广告片段的方法与相关接口系统。The present invention relates to a method and a related interface system for assisting users in detecting advertisement segments in a video signal, in particular to a method capable of sequentially sampling/capturing each frame at different time intervals to present to the user to assist the user A method for quickly and accurately locating an advertisement segment and a related interface system.
背景技术Background technique
由有线或无线广电媒体提供的影音节目服务是现代信息社会最重要的信息来源之一。观众可从影音节目服务中获得有用的新闻、知识、信息、或是能舒解身心的视听娱乐。然而,在商业的考量下,广电媒体所提供的影音节目常会有广告片段穿插于正常节目之间。对观众来说,这些广告片段常会干扰正常节目的连贯性,造成观众收视正常节目时的困扰,也浪费观众的时间。当观众要将正常节目录下来作为日后的参考时(或要录下来于稍后播放时),这些广告片段更会耗费使用者录制视频信号的资源,并导致使用者无法方便、快速地检索、管理、存取其所录制的视频信号。要在视频信号中搜寻广告片段,进而将其跳过、滤除,势必需要一个有效率的接口系统来协助使用者快速、有系统地搜寻广告片段。然而,在已知技术中,却缺乏相关的接口系统,也就无法协助使用者快速、方便地定位出广告片段的所在。The audio-visual program service provided by cable or wireless broadcast media is one of the most important sources of information in the modern information society. Viewers can obtain useful news, knowledge, information, or audio-visual entertainment that can relax their bodies and minds from audio-visual program services. However, under commercial considerations, audio-visual programs provided by radio and television media often have commercial segments interspersed between normal programs. For viewers, these advertisement clips often interfere with the continuity of normal programs, cause trouble for viewers to watch normal programs, and waste the time of viewers. When the viewer wants to record the normal program as a future reference (or to record it and play it later), these commercial segments will consume the resources of the user to record the video signal, and cause the user to be unable to conveniently and quickly retrieve, Manage and access the recorded video signals. To search for advertising segments in video signals, and then skip and filter them, an efficient interface system is necessary to assist users to search for advertising segments quickly and systematically. However, in the known technology, there is no related interface system, and it is impossible to assist the user to quickly and conveniently locate the location of the advertisement segment.
发明内容Contents of the invention
因此,本发明提供一种能协助使用者快速搜寻广告片段的方法及相关的接口系统,以方便使用者定位广告片段的所在,进一步跳过或滤除这些广告片段。Therefore, the present invention provides a method and a related interface system that can assist users to quickly search for advertisement fragments, so as to facilitate users to locate advertisement fragments, and further skip or filter these advertisement fragments.
如熟知技术者所知,视频信号能以一定的帧速率(frame rate)在不同的时间提供不同的帧来呈现动态图像,而在本发明中,即是以不同尺度的取样时间来取样/撷取视频信号中的帧;在较大尺度的取样时间下,使用者能先大略地定位出广告片段的所在,而在较小尺度的取样时间下,使用者就能更精确地定位出广告片段的位置。举例来说,当使用者要对一段总长(播放时间总长)为一小时的视频信号进行广告检测时,本发明接口系统可先以一分钟为取样时间,将每隔一分钟的画面撷取出来当作参考帧,并以缩图的方式将各个参考帧同时呈现给使用者。使用者可在这些参考帧中选出广告片段的帧。举例来说,若使用者发现第18个参考帧(在第18分钟播出的帧)为正常节目的帧,而第19个参考帧(在第19分钟播出的帧)就转变为广告画面的帧,就表示广告片段开始之处是落在第18分钟与第19分钟之间。接下来,本发明的接口系统就能以尺度更小的一秒钟为取样时间,从第18分钟与第19分钟的视频信号中,进一步将每隔一秒钟的画面撷取出来当作第二层次的参考画面。这些第二层次的参考画面也会同时以缩图的方式呈现予使用者,让使用者能更精确地以秒为单位,定位出广告片段的所在。举例来说,若使用者在各个第二层次的参考帧中,发现第24个第二层次参考帧为正常节目,而在第25个第二层次参考帧为广告片段,就代表广告片段是在第18分钟又24秒后才出现的。这样,广告片段的所在就能精确地被定位出来了。As known to those skilled in the art, video signals can present dynamic images by providing different frames at different times with a certain frame rate (frame rate), and in the present invention, sampling/capturing is performed with sampling times of different scales Take the frame in the video signal; at a larger scale sampling time, the user can roughly locate the location of the advertisement segment first, and at a smaller scale sampling time, the user can more precisely locate the advertisement segment s position. For example, when a user wants to perform advertisement detection on a video signal with a total length (total playing time) of one hour, the interface system of the present invention can first use one minute as the sampling time to capture pictures every other minute. As a reference frame, each reference frame is presented to the user at the same time in the form of thumbnails. The user can select the frame of the advertisement segment from these reference frames. For example, if the user finds that the 18th reference frame (the frame broadcasted at the 18th minute) is a frame of a normal program, and the 19th reference frame (the frame broadcasted at the 19th minute) is changed to an advertisement frame frames, it means that the beginning of the commercial segment falls between the 18th minute and the 19th minute. Next, the interface system of the present invention can use a smaller scale of one second as the sampling time, and further capture pictures every second from the video signals of the 18th minute and the 19th minute as the first Second level reference picture. These second-level reference images will also be presented to the user in the form of thumbnails at the same time, so that the user can more accurately locate the location of the advertisement segment in seconds. For example, if the user finds that the 24th second-level reference frame is a normal program among the second-level reference frames, and the 25th second-level reference frame is an advertisement segment, it means that the advertisement segment is in It didn't appear until 18 minutes and 24 seconds later. In this way, the location of the advertisement segment can be accurately located.
换句话说,随着取样时间的时间尺度由大变小,使用者只要快速地浏览不同取样时间下的参考帧,就能逐步地精确定位出广告片段的所在,进而对广告片段进行必要的处理,像是将其跳过、滤除或剪辑删去。本发明的接口系统与方法可架构于录/放装置(像是硬盘、光盘或是录影带式的录/放影机)或是可录制/播放影音视频信号的多媒体计算机上,协助使用者在录制好的视频信号中检测广告片段。除了检测广告片段外,本发明也可当作是一种快速检索图像内容的方法,以协助使用者在一视频信号中快速、精确地找出具有特定内容的片段。In other words, as the time scale of the sampling time changes from large to small, the user can gradually and accurately locate the location of the advertisement segment by quickly browsing the reference frames at different sampling time, and then perform necessary processing on the advertisement segment , like skipping, filtering, or clipping it out. The interface system and method of the present invention can be structured on a recording/playback device (such as a hard disk, a CD or a video tape recorder/player) or a multimedia computer capable of recording/playing video, audio and video signals to assist users in Detection of commercial segments in recorded video signals. In addition to detecting commercial segments, the present invention can also be regarded as a method for quickly retrieving image content, so as to assist users to quickly and accurately find out segments with specific content in a video signal.
附图说明Description of drawings
图1为广告片段穿插于一视频信号中的示意图。FIG. 1 is a schematic diagram of advertisement segments interspersed in a video signal.
图2为本发明接口系统一实施例的功能方块示意图。FIG. 2 is a functional block diagram of an embodiment of the interface system of the present invention.
图3、4为图2中接口系统运作原理的示意图。3 and 4 are schematic diagrams of the operating principle of the interface system in FIG. 2 .
图5、图6为图2中显示接口以接口画面协助使用者定位广告片段的示意图。FIG. 5 and FIG. 6 are schematic diagrams of the display interface in FIG. 2 to assist the user in locating the advertisement segment through the interface screen.
图7为图2中接口系统与其他自动广告检测机制搭配运用的示意图。FIG. 7 is a schematic diagram of the collocation of the interface system in FIG. 2 with other automatic advertisement detection mechanisms.
附图符号说明Description of reference symbols
10 接口系统 12 缓冲模块10 interface system 12 buffer module
14 处理模块 16 显示接口14 processing module 16 display interface
18 操控接口18 control interface
20A-20B、22A-22B、42 接口画面20A-20B, 22A-22B, 42 interface screen
24、34 缩图 26、36 游标24, 34
28A、38A-38D、48A-48B 指令列28A, 38A-38D, 48A-48B instruction line
28B、38E、48C 状态列28B, 38E, 48C status column
V 视频信号 F(a1)-F(a3)、F(.) 帧V Video signal F(a1)-F(a3), F(.) frame
P1、P2 正常节目 Ad 广告片段P1, P2 normal program Ad commercial segment
R(0)-R(K)、S(0)-S(P) 参考帧R(0)-R(K), S(0)-S(P) reference frame
PA(1)-PA(4) 可能插入处Where PA(1)-PA(4) may be inserted
具体实施方式Detailed ways
请参考图1;图1为一典型视频信号V的示意图。视频信号V可不同的时间依序提供不同的帧F(a1)、F(a1+1)、F(a1+2)等等,以组合各帧的图像画面而呈现出动态图像。就如前面提到过的,在广电媒体提供的视频信号中,会在正常节目之间穿插广告片段;而在图1中,帧F(a1)至F(a2)、帧F(a3+1)至F(a4)等等即分别用来呈现正常节目P1、P2的动态图像,而帧F(a2+1)至F(a3)就是广告片段Ad的帧,用来组合呈现出广告片段Ad的动态图像。Please refer to FIG. 1; FIG. 1 is a schematic diagram of a typical video signal V. As shown in FIG. The video signal V can sequentially provide different frames F(a1), F(a1+1), F(a1+2), etc. at different times, so as to combine the image frames of each frame to present a dynamic image. As mentioned above, in the video signal provided by broadcasting media, commercial segments will be interspersed between normal programs; and in Figure 1, frames F(a1) to F(a2), frame F(a3+1 ) to F(a4) etc. are respectively used to present dynamic images of normal programs P1 and P2, and frames F(a2+1) to F(a3) are the frames of the advertisement segment Ad, which are used to combine and present the advertisement segment Ad dynamic image.
请参考图2。图2为本发明接口系统一实施例10的功能方块示意图。接口系统10可架构于一录影装置或放影装置,像是磁带式、硬盘式或光盘式的录影机或放影机,以协助使用者从录制好的视频信号中检测出广告片段的所在。另外,接口系统10也可架构于一多媒体计算机中。如图1中所示,接口系统10中可设有一缓冲模块12、处理模块14、一显示接口16以及一操控接口18。当使用者要在一视频信号V中检测出广告片段的所在时,缓冲模块12就可暂存并提供该视频信号V的各个帧。处理模块14能从缓冲模块12提供的视频信号V中,以不同尺度的取样时间撷取出各个层次的参考帧。在本发明的较佳实施例中,处理模块14还能额外实现一缩图模块的功能,以将这些撷取出来的参考帧处理成缩图的形式;而显示接口16就能将这些参考帧的缩图以图像画面的形式呈现予使用者。操控接口18能接收使用者的操控指令,并将操控指令转换为电子信号,传输至处理模块14,以操控处理模块14转换取样的时间。举例来说,若接口系统10是架构于一录影装置中,因录影装置会搭配一显示装置(像是电视)来显示其录制的视频信号,本发明即可利用该显示装置来当作显示接口16,并以该录制装置的操控接口来实现操控接口18。像是一般录影装置会搭配遥控器作为操控接口,而本发明接口系统10就能沿用遥控器来实现操控接口18。若接口系统10是架构于多媒体计算机中的,则显示接口16就可实现于多媒体计算机的显示器,而操控接口18的功能也可沿用多媒体计算机既有的操控接口(像是键盘、鼠标)来实现。Please refer to Figure 2. FIG. 2 is a functional block diagram of an embodiment 10 of the interface system of the present invention. The interface system 10 can be built on a video recording device or a video playback device, such as a tape, hard disk or optical disc video recorder or player, to assist users to detect the location of the advertisement segment from the recorded video signal. In addition, the interface system 10 can also be implemented in a multimedia computer. As shown in FIG. 1 , the interface system 10 may be provided with a buffer module 12 , a processing module 14 , a display interface 16 and a control interface 18 . When the user wants to detect the location of the advertisement segment in a video signal V, the buffer module 12 can temporarily store and provide each frame of the video signal V. The processing module 14 is capable of extracting reference frames of various levels from the video signal V provided by the buffering module 12 with sampling times of different scales. In a preferred embodiment of the present invention, the processing module 14 can additionally realize the function of a thumbnail module, so as to process these extracted reference frames into a thumbnail form; and the display interface 16 can display these reference frames The thumbnail of the image is presented to the user in the form of an image screen. The control interface 18 can receive a user's control command, convert the control command into an electronic signal, and transmit it to the processing module 14 to control the processing module 14 to convert the sampling time. For example, if the interface system 10 is built in a video recording device, because the video recording device will be equipped with a display device (such as a TV) to display its recorded video signal, the present invention can use the display device as a display interface 16, and implement the control interface 18 with the control interface of the recording device. For example, a general video device is equipped with a remote control as a control interface, but the interface system 10 of the present invention can continue to use the remote control to implement the control interface 18 . If the interface system 10 is built in a multimedia computer, then the display interface 16 can be implemented on the display of the multimedia computer, and the function of the control interface 18 can also be realized by using the existing control interface (such as a keyboard and a mouse) of the multimedia computer. .
请参考图3至图4(并一并参考图2)。图3、图4即为本发明接口系统10(图2)运作原理的示意图。首先,如图3所示,当接口系统10开始要协助使用者从视频信号V中找出广告片段时,接口系统10的处理模块14就可在视频信号V的各个帧中,以N1个帧为取样的间隔,于每N1个帧中撷取出一个帧作为参考帧。像在图3中,视频信号V中间隔有N1个帧的帧F(c0)、F(c0+N1)、F(c0+2×N1)、F(c0+3×N1)…F(c0+k×N1)直到F(c0+K×N1),就会被分别取样/撷取出来,并成为参考帧R(0)、R(1)、R(2)、R(3)…R(k)至R(K);其中c0、K、N1为固定的整数值常数。而接口系统10就能将各个参考帧通过显示接口16显示予使用者。在本发明的较佳实施例中,可以将各个参考帧的画面内容以缩图的形式同时显示于显示接口16上;图3中的接口画面20A,就代表此种实施例下显示接口16所显示出来的画面。如接口画面20A所示,本发明可将各参考帧R(0)至R(K)的缩图排依矩阵的顺序排列,方便使用者浏览、比较各参考帧的画面内容。Please refer to FIG. 3 to FIG. 4 (and refer to FIG. 2 together). FIG. 3 and FIG. 4 are schematic diagrams of the operating principle of the interface system 10 ( FIG. 2 ) of the present invention. First, as shown in FIG. 3 , when the interface system 10 starts to assist the user to find advertisement segments from the video signal V, the processing module 14 of the interface system 10 can use N1 frames in each frame of the video signal V As the sampling interval, one frame is extracted from every N1 frames as a reference frame. As in Figure 3, there are N1 frames of frames F(c0), F(c0+N1), F(c0+2×N1), F(c0+3×N1)…F(c0 +k×N1) until F(c0+K×N1), they will be sampled/extracted separately and become reference frames R(0), R(1), R(2), R(3)...R (k) to R(K); where c0, K, N1 are fixed integer-valued constants. The interface system 10 can display each reference frame to the user through the display interface 16 . In a preferred embodiment of the present invention, the picture content of each reference frame can be simultaneously displayed on the display interface 16 in the form of a thumbnail; the
延续图3的例子,请继续参考图4。在浏览、比较接口画面20A所呈现出来的参考帧后,使用者就可先初步地找出哪些参考帧是广告片段的帧。在图4的例子中,假设使用者发现某一给定的参考帧R(k0-1)为正常节目(k0为一给定值),而次一参考帧R(k0)却是广告片段的帧,这就表示视频信号V中的广告片段是起始于帧F(c0+(k0-1)×N1)与帧F(c0+k0×N1)之间,因为参考帧R(k0-1)与R(k0)就分别对应于视频信号V中的帧F(c0+(k0-1)×N1)与F(c0+k0×N1)。接下来,使用者就能通过操控接口18(图3)来控制处理模块14,由处理模块14针对参考帧R(k0)来进一步地进行次一层次(第二层次)的帧取样/撷取。在第二层次的取样/撷取中,处理模块14会以帧F(c0+(k0-1)×N1)到F(c0+k0×N1)之间的帧作为目标帧,在这些目标帧中每间隔N2个帧取样/撷取出一个第二层次的参考帧;而此处的N2会小于图3中的N1。换句话说,在第二层次的取样/撷取中,本发明会以更细密的间隔来更精确地进行取样/撷取,以协助使用者更精确地定位出广告片段的所在。Continuing the example in FIG. 3 , please continue to refer to FIG. 4 . After browsing and comparing the reference frames displayed on the
如图4中所示,在帧F(c0+(k0-1)×N1)与F(c0+k0×N1)之间的帧F(c1)、F(c1+N2)、F(c1+2×N2)…F(c1+p×N2)直到F(c1+P×N2),就分别被撷取出来成为第二层次的参考帧S(0)、S(1)、S(2)…S(p)直到S(P);其中,c1、P、N2为固定的整数值常数。而本发明的接口系统10也就能进一步地将这些参考帧S(0)至S(P)通过显示接口16(图2)显示予使用者。图4中的接口画面20B就示意了各个第二层次参考帧以矩阵排列的缩图形式而由显示接口16呈现给使用者浏览的情形。使用者浏览、比较各个第二层次的参考帧S(0)至S(P)后,就能进一步精确地定位出广告片段的所在。举例来说,假设使用者在看了接口画面20B之后,发现参考帧S(0)、S(1)还是正常节目的帧,但在参考帧S(2)以后就变为广告片段的帧,这就代表广告片段是起始于帧F(c1+N2)与F(c1+2×N2)之间,因为参考帧S(1)及S(2)就分别对应于帧F(c1+N2)及F(c1+2×N2)。由于N2小于N1,能进一步确认广告片段起始于帧F(c1+N2)与F(c1+2×N2)之间,就代表本发明能以这第二层次的接口画面20B来进一步协助使用者更精确地定位出广告片段的开始之处。当然,依据类似的原理及程序,使用者也能精确地定位出广告片段结束之处。As shown in FIG. 4, frames F(c1), F(c1+N2), F(c1+2) between frames F(c0+(k0-1)×N1) and F(c0+k0×N1) ×N2)…F(c1+p×N2) up to F(c1+P×N2), which are respectively extracted to become the second-level reference frames S(0), S(1), S(2)… S(p) to S(P); wherein, c1, P, N2 are fixed integer-valued constants. The interface system 10 of the present invention can further display these reference frames S(0) to S(P) to the user through the display interface 16 ( FIG. 2 ). The
由图3、图4的说明可知,本发明是先以较大的取样间隔N1来协助使用者粗略地分辨出广告片段的所在(即开始、结束的帧)。当使用者初步找出广告片段的所在时,再进一步以较小的取样间隔N2来协助使用者更精确地定位出广告片段。当然,延续上述图3、图4的例子,本发明还可进一步进行第三层次的取样撷取。假设使用者发现广告片段是从参考帧S(1)与S(2)间开始的,本发明还可在帧F(c1+N2)与F(c1+2×N2)之间以更小的N3(N3<N2<N1)来取样/撷取出第三层次的参考帧,以协助使用者将广告片段的开始处进一步限制于某个F(c3)与F(c3+N3)之间。在以较大取样间隔的层次进行初步的比较、浏览,使用者能快速地在大范围(多帧)、长时间的视频信号中初步定位出广告片段;根据初步定位的结果,在取样间隔较小的次级层次中,使用者就能进一步精确定位出广告片段的所在。It can be seen from the description of FIG. 3 and FIG. 4 that the present invention uses a relatively large sampling interval N1 to assist the user to roughly distinguish the location of the advertisement segment (ie, the start and end frames). When the user initially finds the location of the advertisement segment, a smaller sampling interval N2 is further used to assist the user to locate the advertisement segment more precisely. Certainly, continuing the above-mentioned examples in FIG. 3 and FIG. 4 , the present invention can further perform third-level sampling extraction. Assuming that the user finds that the advertisement segment starts between the reference frames S(1) and S(2), the present invention can also use a smaller N3 (N3<N2<N1) is used to sample/retrieve the reference frame of the third level, so as to help the user to further limit the beginning of the advertisement segment between a certain F(c3) and F(c3+N3). By performing preliminary comparison and browsing at the level of larger sampling intervals, users can quickly initially locate advertisement segments in large-scale (multi-frame) and long-term video signals; In the small sub-level, the user can further precisely locate the location of the advertisement segment.
在本发明中,可由一般广电媒体插入广告片段的实际情况来决定各项取样间隔。举例来说,若广电媒体插入的广告片段不会短于一分钟,而视频信号每秒有30个帧,则图3中的取样间隔N1就可订为60×30;也就是说,将视频信号中将每间隔一分钟播出的帧撷取为第一层次的参考帧。由于广告片段一定长于一分钟,若以一分钟作为取样间隔时间,广告片段就一定会至少有一个帧被撷取出来作为第一层次参考帧。而图4中第二层次的取样间隔N2可以订为1×30,也就是在两个第一层次的参考帧之间,进一步以一秒钟的时间间隔来撷取出第二层次的参考帧。换句话说,根据第一层次的参考帧,本发明可协助使用者以“分钟”为单位而定位广告片段开始/结束之处;而在第二层次,本发明就可进一步协助使用者以“秒”为单位而更精确地定位广告片段。In the present invention, various sampling intervals can be determined by the actual situation of inserting advertisement segments in general broadcast media. For example, if the advertising segment inserted by the radio and television media will not be shorter than one minute, and the video signal has 30 frames per second, then the sampling interval N1 in Figure 3 can be set as 60×30; that is to say, the video signal In the signal, the frames broadcast every minute are extracted as the reference frames of the first level. Since the commercial segment must be longer than one minute, if one minute is used as the sampling interval, at least one frame of the commercial segment must be extracted as the first-level reference frame. In FIG. 4, the sampling interval N2 of the second level can be set as 1×30, that is, between two first level reference frames, the second level reference frame is further extracted at a time interval of one second. In other words, according to the reference frame of the first level, the present invention can assist the user to locate the start/end of the advertisement segment in the unit of "minute"; and at the second level, the present invention can further assist the user in "minute" seconds" to more precisely position ad segments.
至于图3、图4中接口画面20A、20B的样式,则可决定缩图的大小及使用者每次可浏览的参考画面个数。举例来说,若一个接口画面可容纳六十个参考帧的缩图,而在第一层次中是以一分钟为取样的间隔时间来撷取出参考帧,则使用者就可以在同一个接口画面中涵盖六十分钟的视频信号,在六十分钟的视频信号中以分钟为单位定位出广告片段开头或结尾的位置。关于此情形,请参考图5(并一并参考图2)。图5中的接口画面22A即为上述情况下显示接口16(图2)显示画面的示意图。如图5所示,接口画面22A是以各个缩图24来分别呈现各个第一层次参考帧的画面,而每个缩图24之下也可对应地标示出各个参考帧是在视频信号的那个时刻撷取出来的;像是“0:0.1”代表其对应的参考帧是第1分钟的帧,“0:0.2”代表其对应的参考帧是视频信号中第2分钟的帧,而“0:59”就代表对应的参考帧为视频信号中第59分钟的帧。As for the styles of the
当使用者由接口画面22A浏览、比较出广告片段开始或结束的帧时,就可利用操控接口18(图2)来加以标示,并操控接口系统10开始进行次一层次参考帧的取样/撷取与呈现。在现行的多功能光盘(DVD)播放装置中,已经具有游标移动的选项操控接口;若本发明接口系统10是架构于一般家用的录放影装置上,就能沿用这种操控接口来实现操控接口18的功能。举例来说,在多功能光盘播放装置搭配的遥控器上,会具有上下左右的游标移动控制键,并具有指令输入(enter)键。而在实现本发明时,图5中的接口画面22A就可配合显示一框选游标26来标示使用者选择的参考帧。举例来说,当接口画面22A一开始呈现时,此框选游标26可以位于“0:00”标示的参考帧。若使用者发现“0:04”标示的参考帧为正常节目的帧,但“0:05”标示的参考帧却为广告片段的帧,此时使用者就可以使用游标移动控制键进行左移的操控,将框选游标26移动至“0:05”标示的参考帧,再按下指令输入键。这样,处理模块14就能将“0:04”及“0:05”两参考帧间的各个作为目标帧,以对这些目标帧进行第二层次的参考帧撷取。当然,若本发明系统是实现于多媒体计算机中,多媒体计算机本身就具有键盘、滑鼠、触控板、轨迹球等多种操控接口,都能用来实现操控接口18的功能。When the user browses through the interface screen 22A and compares the start or end frame of the advertisement segment, he can use the control interface 18 (FIG. 2) to mark it, and control the interface system 10 to start sampling/capturing the next-level reference frame Take and present. In the existing multifunctional optical disk (DVD) playback device, there is already an option control interface for cursor movement; if the interface system 10 of the present invention is built on a general household video recording and playback device, this control interface can be used to realize the control interface. 18 functions. For example, on the remote controller matched with the multifunctional optical disc player, there will be cursor movement control keys up, down, left, and right, and a command input (enter) key. When implementing the present invention, the interface screen 22A in FIG. 5 can display a frame selection cursor 26 to mark the reference frame selected by the user. For example, when the interface screen 22A is initially presented, the frame selection cursor 26 may be located at the reference frame indicated by "0:00". If the user finds that the reference frame marked by "0:04" is a frame of a normal program, but the reference frame marked by "0:05" is a frame of an advertisement clip, then the user can use the cursor movement control keys to move left Move the selection cursor 26 to the reference frame marked "0:05", and then press the instruction input key. In this way, the processing module 14 can use each of the two reference frames "0:04" and "0:05" as the target frame to perform second-level reference frame extraction on these target frames. Of course, if the system of the present invention is implemented in a multimedia computer, the multimedia computer itself has various control interfaces such as a keyboard, a mouse, a touch panel, and a trackball, all of which can be used to realize the functions of the control interface 18 .
除了各个第一层次的参考帧(可称为第一参考帧)之外,接口画面22A也可呈现出别的指令或状态。举例来说,若视频信号本身的长度超过一小时,但以分钟为取样间隔,在同一接口画面只能呈现对应于一小时的参考帧,此时接口画面22A就可显示出一指令列28A(可显示为“more…”的字样,或“next page”的字样)。当使用者操控框选游标26至指令28A并以指令输入键操控时,接口系统10就可以针对视频信号内超过一小时的其他部分,继续以分钟为取样隔来进行参考帧的撷取,而接口画面22A也可以状态列28BN来显示出视频信号的时间总长、广告检测进行状态等等信息。In addition to each first-level reference frame (which may be referred to as a first reference frame), the interface screen 22A may also present other instructions or states. For example, if the length of the video signal itself exceeds one hour, but the sampling interval is minutes, only the reference frame corresponding to one hour can be presented on the same interface screen, and at this time, the interface screen 22A can display a command line 28A ( Can be displayed as the words "more...", or the words "next page"). When the user manipulates the frame selection cursor 26 to the command 28A and manipulates the command input key, the interface system 10 can continue to capture reference frames at sampling intervals of minutes for other parts of the video signal that exceed one hour. The interface screen 22A can also use the status column 28BN to display information such as the total time length of the video signal, the status of the advertisement detection, and the like.
延续图5中的例子,请参考图6。当使用者在图5中选定“0:05”标示的参考帧并操控接口系统10进行第二层次的参考帧撷取后,显示接口16就会以图6显示的接口画面22B来显示第二层次的参考帧。类似图5中的例子,假设一个画面能容纳六十个参考帧的缩图,在第二层次的参考帧撷取中,接口系统10就能将第4分钟与第5分钟间的视频信号以一秒钟为间隔时间而进行取样/撷取,成为第二层次的参考帧(可称为第二参考帧),并以缩图34来呈现各个第二层次的参考帧。同样地,各个参考帧的缩图下也可标示出撷取的时刻。举例来说,标示“0:04:01”代表对应的参考帧为视频信号中第4分钟第1秒的画面,标示“0:04:51就代表对应的参考帧为视频信号中第4分钟第51秒的画面,以此类推。Continuing the example in FIG. 5 , please refer to FIG. 6 . When the user selects the reference frame marked "0:05" in FIG. 5 and manipulates the interface system 10 to capture the reference frame of the second level, the display interface 16 will display the
使用者浏览、比较各个第二参考帧,就能以秒为单位精确地定位出广告片段。同样地,接口画面24B可显示一框选游标36来,标示使用者选定的第二参考帧。举例来说,若使用者发现,标示“0:04:50”的参考帧为正常节目,而标示“0:04:51”的参考帧就转变为广告片段的帧,就代表广告片段是开始于视频信号的第4分钟第50秒与第51秒之间。而使用者就能通过操控接口18来操控框选游标36移动至“0:04:51”的参考帧上,并进行必要的操控;而接口系统10(图2)就能进行对应的运作。类似于图5中的接口画面24A,接口画面24B也可显示多个指令列38A至38D,以及状态列38E。举例来说,当使用者装框选游标36移动至“0:04:51”的参考帧,可先按指令输入键确认其选择;若使用者觉得以秒为单位已经足以精确地定位出广告片段,就可继续将游标36移动至指令列38C(其可显示“mark AD”等字样),以指令输入键触发该指令,而本发明的接口系统10就能配合一暂存模块(未示于图2)来将“0:04:51”的帧标示、记录为一广告片段起始点。而使用者稍后就可利用这些记录,来将广告片段跳过、剪辑或予以删除。By browsing and comparing each second reference frame, the user can accurately locate the advertisement segment in seconds. Likewise, the interface screen 24B can display a
相对地,若使用者在确认“0:04:51”的参考帧后,还想要更精确地进行广告片段的定位,就可触发指令列38B(其可显示为“down one layer”等字样),则接口系统10就会以视频信号中第4分钟第50秒、第51秒间的帧当作是第三层次的目标帧,以短于一秒钟的时间间隔来对这些第三层次目标帧进行第三层次的参考帧撷取,协助使用者以低于一秒的精确度来定位广告片段。当然,使用者也可触发指令列38A(其可显示“up one layer”等字样),而接口系统10就会重新呈现图5中的接口画面24A,让使用者可以重新浏览第一层次的参考帧。此外,使用者也可触发指令列38D(其可显示“setup”的字样),来进行接口系统10的相关设定。举例来说,可设定同一接口画面所呈现的参考帧的数目,或缩图的大小等等。不论是图5或图6的接口画面,都能设置有指令列38D。接口画面24B的状态列38E则可进一步显示广告检测进行的状态,譬如说以“second layer”来代表广告检测已进行至第二层次等等。Relatively, if the user wants to more accurately locate the advertisement segment after confirming the reference frame of "0:04:51", the
除了显示不同阶层的参考帧来协助使用者定位出广告片段之外,本发明的接口系统10(图2)也可和别的自动广告检测机制一同搭配使用。举例来说,由于广告片段和正常节目的内容不同,在正常节目与广告片段衔接之处,必定会发生画面内容的不连续。以图1的例子来说,广告片段的插入会使帧F(a2)与帧F(a2+1)之间具有不连续的画面内容,而帧F(a3)与F(a3+1)之间同样也会发生画面不连续。因此,在视频信号中检测画面不连续之处,可能就可以找出广告片段开始/结束之处,实现出某种自动广告检测机制。然而,画面不连续也可能发生于正常节目中场景转换之时;所以,画面不连续处只是广告片段“可能”的插入处,是否是真正的广告片段插入处,还需要进一步的确定,譬如说是由使用者自行比较确定。此时,本发明的接口系统10就能与其搭配,将广告片段可能插入处前后的帧通过显示接口16而显示予使用者,协助使用者进一步确认广告片段真正的插入处。In addition to displaying different levels of reference frames to assist users in locating advertisement segments, the interface system 10 ( FIG. 2 ) of the present invention can also be used in conjunction with other automatic advertisement detection mechanisms. For example, since the content of the commercial segment is different from that of the normal program, discontinuity of picture content will inevitably occur at the junction of the normal program and the commercial segment. Taking the example in FIG. 1 as an example, the insertion of the advertisement segment will cause discontinuous picture content between the frame F(a2) and the frame F(a2+1), while the frame F(a3) and F(a3+1) will have discontinuous picture content. There will also be picture discontinuity. Therefore, by detecting picture discontinuities in the video signal, it may be possible to find out where an ad segment starts/ends, implementing some kind of automatic ad detection mechanism. However, picture discontinuity may also occur when scenes change in normal programs; therefore, the picture discontinuity is only a "possible" insertion place of an advertisement segment, and whether it is a real insertion place of an advertisement segment needs to be further determined, for example It is determined by the user's own comparison. At this time, the interface system 10 of the present invention can be used in conjunction with it to display to the user the frames before and after the possible insertion of the advertisement segment through the display interface 16, helping the user to further confirm the real insertion position of the advertisement segment.
请参考图7(并一并参考图2);图7即为本发明搭配自动广告检测机制运作的示意图。假设一自动广告检测机制(可以是前述的画面不连续检测机制,或是其他的检测机制)在视频信号V中检测出了数个广告片段的可能插入处PA(1)至PA(4)等等,本发明的接口系统10(图2)就可将这些可能插入处前后的帧撷取为参考帧,再通过显示接口16将这些参考帧以缩图的形式显示予使用者。而图7中的接口画面42就是此种应用下显示接口16显示予使用者的图形画面;其中,广告片段可能插入处PA(1)对应于两个相邻帧F(a1)、F(a1+1),而这两个帧就会被当成参考帧,以相邻的缩图方式呈现予使用者。同理,广告片段可能插入处PA(2)、PA(3)、PA(4)所分别对应的相邻帧F(a2)及F(a2+1)、帧F(a3)及F(a3+1)、以及帧F(a4)及F(a4+1)也都可以用缩图的方式呈现予使用者。Please refer to FIG. 7 (and refer to FIG. 2 together); FIG. 7 is a schematic diagram of the operation of the present invention with the automatic advertisement detection mechanism. Assume that an automatic advertisement detection mechanism (which may be the aforementioned discontinuous detection mechanism, or other detection mechanisms) detects the possible insertion places PA(1) to PA(4) of several advertisement segments in the video signal V, etc. etc., the interface system 10 ( FIG. 2 ) of the present invention can capture the frames before and after these possible insertion positions as reference frames, and then display these reference frames to the user in the form of thumbnails through the display interface 16 . And the interface picture 42 in Fig. 7 is exactly the graphics picture that the display interface 16 shows to the user under this kind of application; Wherein, the possible insertion place PA (1) of the advertisement fragment corresponds to two adjacent frames F (a1), F (a1 +1), and these two frames will be used as reference frames and presented to the user as adjacent thumbnails. Similarly, adjacent frames F(a2) and F(a2+1), frames F(a3) and F(a3 +1), and frames F(a4) and F(a4+1) can also be presented to the user in the form of thumbnails.
使用者在浏览两相邻帧后,就能比较出对应的可能插入处是否为真正的广告片段插入处。举例来说,若帧F(a1)、F(a1+1)同为正常节目的帧,可能插入处PA(1)就不是真正的广告片段插入处。相对地,若帧F(a2)为正常节目的帧,但相邻的帧F(a2+1)却为广告片段的帧,就代表可能插入处PA(2)的确是广告片段的插入处。此时,使用者就可通过操控接口18来选择可能插入处PA(2),并触发接口画面42中的指令列48A,确认此一可能插入处PA(2)为广告片段真正的插入处之一。当然,接口画面42也可另外显示其他功能的指令列,让使用者进行其他的操控。举例来说,使用者触发指令列48B后,可以将可能插入处附近更多的帧撷取出来当作参考帧,像是进一步显示出F(a1-1)、F(a1)、F(a1+1)、F(a1+2)等帧,让使用者能更方便地确认可能插入处PA(1)是否为真正的广告片段插入处。另外,接口画面42也能以状态列等等来显示其他的相关信息,像是以状态列48C来显示可能插入处PA(1)相对于视频信号V中的时间。After viewing two adjacent frames, the user can compare whether the corresponding possible insertion is a real advertisement segment insertion. For example, if the frames F(a1) and F(a1+1) are both frames of a normal program, the insertion point PA(1) may not be the real insertion point of the advertisement segment. In contrast, if the frame F(a2) is a frame of a normal program, but the adjacent frame F(a2+1) is a frame of an advertisement segment, it means that the possible insertion point PA(2) is indeed the insertion point of the advertisement segment. At this point, the user can select the possible insertion point PA (2) by manipulating the interface 18, and trigger the command line 48A in the interface screen 42 to confirm that the possible insertion point PA (2) is one of the real insertion points of the advertisement segment. one. Certainly, the interface screen 42 may additionally display command lines of other functions, allowing the user to perform other operations. For example, after the user triggers the instruction bar 48B, more frames near the possible insertion point can be extracted as reference frames, such as further displaying F(a1-1), F(a1), F(a1 +1), F(a1+2) and other frames allow the user to more easily confirm whether the possible insertion point PA(1) is the real insertion point of the advertisement segment. In addition, the interface screen 42 can also display other relevant information in the status column, etc., such as the status column 48C to display the time of the possible insertion location PA( 1 ) relative to the video signal V.
总结来说,本发明可以通过显示接口的接口画面来显示不同层次的参考帧,以协助使用者快速、精确地定位出广告片段。在初始层次的参考帧中,本发明能协助使用者快速浏览大范围的视频信号,进行初步的定位;而在后续层次的参考帧中,本发明能进一步协助使用者精确地定位出广告片段。当然,本发明上述的运作原理也可协助使用者快速、精确地在大范围的视频信号中找出具有特定内容的片段。另外,本发明也可搭配自动广告检测机制来使用。相较于已知技术,本发明可协助使用者更方便地定位广告片段,进而将广告片段跳过、剪辑或滤除,让使用者能更有效率地运用视频信号中有用的信息。In summary, the present invention can display reference frames of different levels through the interface screen of the display interface, so as to assist the user to quickly and accurately locate the advertisement segment. In the reference frame of the initial level, the present invention can assist the user to quickly browse a wide range of video signals for preliminary positioning; and in the reference frame of the subsequent level, the present invention can further assist the user to accurately locate the advertisement segment. Certainly, the above-mentioned operation principle of the present invention can also assist the user to quickly and accurately find a segment with specific content in a wide range of video signals. In addition, the present invention can also be used in conjunction with an automatic advertisement detection mechanism. Compared with the prior art, the present invention can help the user locate the advertisement segment more conveniently, and then skip, edit or filter the advertisement segment, so that the user can use the useful information in the video signal more efficiently.
以上所述仅为本发明的较佳实施例,凡依本发明权利要求所做的均等变化与修饰,皆应属本发明专利的涵盖范围。The above descriptions are only preferred embodiments of the present invention, and all equivalent changes and modifications made according to the claims of the present invention shall fall within the scope of the patent of the present invention.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100637406A CN1301619C (en) | 2004-07-07 | 2004-07-07 | Method and interface system for assisting user to detect advertisement segment by displaying interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100637406A CN1301619C (en) | 2004-07-07 | 2004-07-07 | Method and interface system for assisting user to detect advertisement segment by displaying interface |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1589003A CN1589003A (en) | 2005-03-02 |
| CN1301619C true CN1301619C (en) | 2007-02-21 |
Family
ID=34603824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100637406A Expired - Lifetime CN1301619C (en) | 2004-07-07 | 2004-07-07 | Method and interface system for assisting user to detect advertisement segment by displaying interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1301619C (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105763884A (en) * | 2014-12-18 | 2016-07-13 | 广州市动景计算机科技有限公司 | Video processing method, device and apparatus |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1130004A (en) * | 1993-08-31 | 1996-08-28 | 联合企业股份有限公司和无线电产业保护两合公司 | Method and apparatus for detecting unwanted television pictures |
| WO2001035409A2 (en) * | 1999-11-10 | 2001-05-17 | Thomson Licensing S.A. | Commercial skip and chapter delineation feature on recordable media |
-
2004
- 2004-07-07 CN CNB2004100637406A patent/CN1301619C/en not_active Expired - Lifetime
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1130004A (en) * | 1993-08-31 | 1996-08-28 | 联合企业股份有限公司和无线电产业保护两合公司 | Method and apparatus for detecting unwanted television pictures |
| WO2001035409A2 (en) * | 1999-11-10 | 2001-05-17 | Thomson Licensing S.A. | Commercial skip and chapter delineation feature on recordable media |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1589003A (en) | 2005-03-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20050033758A1 (en) | Media indexer | |
| CN101513048B (en) | Method for controlling receiver and receiver therefor | |
| CN101051516B (en) | Device and method for playing content based on last viewing point of serial drama content | |
| US20060062549A1 (en) | Non-linear reproduction control method of multimedia stream and apparatus thereof | |
| CN1910693A (en) | Method and system for marking one or more parts of a recorded data sequence | |
| US20070206923A1 (en) | Information processing apparatus, display method thereof, and program thereof | |
| CN1666510A (en) | Enhanced bookmarks for digital video playback | |
| CN101843096A (en) | Method of displaying recording material and display device using the same | |
| CN102547193A (en) | Information processing apparatus, information processing method, and program | |
| CN1461484A (en) | Method and system for selecting position in image sequence | |
| US20090063981A1 (en) | Display control apparatus and control method thereof, program, and recording medium | |
| CN1836287A (en) | Video abstracting | |
| CN101568968B (en) | Method for creating a new summary of an audiovisual document that already includes a summary and reports and a receiver that can implement said method | |
| CN1398485A (en) | System and method for playback of video with closed captioned test | |
| JPWO1996005696A1 (en) | Video signal recording device and video signal editing device | |
| WO1996005696A1 (en) | Video signal recording device and video signal editing device | |
| CN1725835A (en) | Apparatus for making playlist and method for making same, device for making playlist and method for making same | |
| CN1301619C (en) | Method and interface system for assisting user to detect advertisement segment by displaying interface | |
| CN1190958C (en) | eGuide to Digital Content | |
| CN101048726A (en) | Method for selecting a button in a graphic bar and receiver for carrying out said method | |
| TWI240579B (en) | Method and related interface system for facilitating advertisings detection through visual interface | |
| CN1828507A (en) | User interface method for activating clickable object and playback apparatus for performing the method | |
| JP2009124408A (en) | Video recording/playback device | |
| CN1912988A (en) | Subtitle playback system and method | |
| CN1704933A (en) | Multimedia data indexing method and device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CX01 | Expiry of patent term |
Granted publication date: 20070221 |
|
| CX01 | Expiry of patent term |