TWI571119B - Method and system of displaying and controlling, breakaway judging apparatus and video/audio processing apparatus - Google Patents

Description

Display control method and system, advertisement break determination device, audio and video processing device

The present invention relates to a display control method, and more particularly to a method for performing display by judging an advertisement break.

The popularity of mobile devices and the increase of online multimedia content have enabled users to have more and more personal channels for media viewing and viewing, and the TV industry is facing enormous challenges. Televisions that used to play the role of information and entertainment centers in the home seem to have gradually lost their status as media centers and entertainment platforms, but they are not. According to a survey by research firm TNS (Taylor Nelson Sofres), viewers around the world still have the habit of watching TV. However, due to the development of network media and handheld electronic devices, users can use the mobile phone or tablet to search or receive information while watching TV, thereby generating "Screen-stacking" phenomenon.

TNS surveyed more than 55,000 respondents worldwide and found that Modern people have an average of 4 digital devices, and even 5 in Hong Kong, Australia and the UK. Coupled with the viewer's need for TV and anytime, anywhere viewing of video content, the rise of "multi-screen viewing" or "multi-screen use" viewing mode (ie the simultaneous use of multiple digital devices) has been promoted. The TNS survey also found that nearly half of the respondents (48%) were using other electronic devices while watching TV in the evening. For example, use social media, check email or online shopping, and more. 72% of respondents use "multiple screens" while watching TV, and many people will also comment on programs, games, and performances on social media. This phenomenon has become a norm in the world.

In view of this, various manufacturers have launched connected TV or smart TV to meet this demand. But the industry also found that more than 40% of users only browse TV programs through smart TV, and do not use social software, browsing web pages or communication software to watch functions other than TV on smart TV. NPD (National Purchase Diary) conducted a survey and presented a report showing that less than 15% of people with smart TV at home use smart TV to listen to music. The main reason for watching TV programs, such as browsing websites or making online shopping, is that the interface of smart TV is complex, and related apps or applications are not designed specifically for TV platforms. In addition, other devices owned by users (such as tablets, smart phones, notebooks, etc.) already have the same functions, and the operation interface and experience of the above devices is superior to smart TV. Furthermore, the lack of quality content and poorly operated experience is why users do not use the OTT (Over The Top) service. The aforementioned OTT service is a service delivered by the Internet through the Internet, for example, audio and video media, email communication, messaging, and the like. Therefore, the experience of the products on the market In the case of general unhealthy conditions, it is difficult for users to operate according to the service process originally designed by the operator, so that it is difficult to achieve the intended purpose and efficacy of the smart TV.

Taking the above analysis, the existing TV usage model is still dominated by a single content source and a single layer. When users want to obtain information other than the content of the TV channel or the information service provided by the OTT provider, it is difficult to obtain the same information on the same screen at the same time, and it needs to be obtained by using additional equipment (for example, a personal computer, a handheld device, etc.). In addition, if the TV itself provides networking functions or if there is an external smart TV stick, it is necessary to manually switch the TV source through more than two remote controllers before receiving external information. Furthermore, the above situation depends on the user's own actions that are initiated when they are aware of the need for external information. Most TVs do not provide a mechanism for automatically notifying and delivering messages.

The present invention provides a display control method, a display control system, an advertisement break determination device, and a video processing device to increase user convenience in viewing using a display device.

The invention provides a display control method suitable for a display device. The method comprises: receiving a display signal source and obtaining a play content according to the display signal source. The method further includes: determining, according to the at least one advertisement fingerprint, whether the play time corresponding to the play content is in an advertisement break period, wherein the advertisement fingerprint is a feature message corresponding to the played content, and the advertisement break period is playing at least one advertisement in the play content. At least one time interval. The method further includes: if the playing time corresponding to the playing content is in the advertising break period, the overlay prompt message is played on the content.

The invention provides a display control method suitable for a display device. The method comprises: receiving a display signal source and obtaining a play content according to the display signal source. The method further includes: determining, according to the at least one advertisement fingerprint, whether the play time corresponding to the play content is in an advertisement break period, wherein the advertisement fingerprint is a feature message corresponding to the played content, and the advertisement break period is playing at least one advertisement in the play content. At least one time interval. The method further includes: determining whether the advertisement breach period ends, and if the advertisement breach period ends, sending another prompt message and displaying the another prompt message to the display device.

The present invention provides a display control system. The display control system includes a display device, a video processing device, and an advertisement break determination device. The audio processing device is coupled to the display device. The advertisement breaking determination device is coupled to the audio processing device for receiving the playback content message from the audio processing device. In addition, the advertisement breach judging device judges whether the play time of the play content corresponding to the play content message is in the advertisement break period according to the at least one advertisement fingerprint, wherein the advertisement fingerprint is a feature message corresponding to the play content, and the advertisement break period is playing. Playing at least one time interval of the at least one advertisement in the content, if the playing time corresponding to the playing content is in the advertising break period, the advertisement breaking determining device transmits the notification message to the video processing device, and the audio processing device superimposes a prompt message to play the content .

The present invention provides a display control system. The display control system includes a display device, a video processing device, and an advertisement break determination device. The audio processing device is coupled to the display device. The advertisement breaking determination device is coupled to the audio processing device for receiving the playback content message from the audio processing device. In addition, the ad breach judgment According to at least one advertisement fingerprint, it is determined whether the playing time of the playing content corresponding to the playing content message is in an advertisement breach period, wherein the advertising fingerprint is a feature message corresponding to the playing content, and the advertisement breaking period is at least one advertisement played in the playing content. At least one time interval, the audio-visual processing device determines whether the advertisement breach period is over. If the advertisement breach period ends, the video processing device sends another prompt message, and the display device displays the other prompt message.

The invention provides an advertisement breach judging device, which comprises an input and output interface and a processing unit. The input and output interface is used to receive the display signal source. The processing unit is coupled to the input/output interface, configured to obtain the play content according to the display signal source, and determine, according to the at least one advertisement fingerprint, whether the play time corresponding to the play content is in an advertisement break period, wherein the advertisement fingerprint is a feature corresponding to the play content The message break period is at least one time interval in which at least one advertisement is played in the play content. If the play time corresponding to the play content is in the advertisement break period, an advertisement break judgment notice is sent through the input and output interface.

The invention provides an audio and video processing device, which comprises an input and output interface and a processing unit. The processing unit is coupled to the input and output unit, wherein the processing unit is configured to output a playback content message through the input/output interface, and receive a notification message by using the input/output interface, wherein the notification message is used to indicate the playback corresponding to the playback content message. Whether the play time of the content is in the advertisement break period, wherein the advertisement break period is at least one time interval in which at least one advertisement is played in the play content, and if the play time corresponding to the play content is in the advertisement break period, the processing unit superimposes a prompt The message plays the content.

The invention provides an audio and video processing device, which comprises an input and output interface and a processing unit. The processing unit is coupled to the input and output unit, wherein the processing unit is configured to output a playback content message through the input/output interface, and receive a notification message by using the input/output interface, wherein the notification message is used to indicate the playback corresponding to the playback content message. Whether the playing time of the content is in the advertising breach period, wherein the advertising breach period is at least one time interval in which the at least one advertisement is played in the playing content, and the processing unit determines whether the advertising breach period ends, and if the advertising breach period ends, the processing unit borrows Another prompt message is sent by the input/output interface, and the other prompt message is displayed on a display device.

Based on the above, the user can receive an external information service notification, and can browse and control in the same screen to achieve the purpose of multi-screen information single screen fusion. Users do not need to manually cut to another screen source or use other devices to obtain external information, greatly increasing the convenience of the user to use the display device.

The above described features and advantages of the invention will be apparent from the following description.

10a‧‧‧Play content

10b‧‧‧ reminder message

1000‧‧‧Control system

100‧‧‧ display device

120‧‧‧OTT service provider

140‧‧‧Handheld devices

160‧‧‧Video processing device

180‧‧‧Advertising breach judgment device

20, 30‧‧‧Communication unit

22, 32‧‧‧ input and output interface

24, 34‧‧‧ storage unit

26, 36‧‧‧ processing unit

401~421‧‧‧Steps

500‧‧‧ system

50‧‧‧Send/receive module

52‧‧‧Control Module

54‧‧‧ display module

56‧‧‧Channel Detection Module

58‧‧‧Mobile device discovery module

S601, S603, S605, S607, S609‧‧ steps

71a‧‧ channel mark

71b‧‧‧News

71c‧‧‧Other overlays

73‧‧‧Main display area

801‧‧‧Ad clip

802(0), 802(1), 802(2)‧‧‧ image frames

803‧‧‧ hash function

804‧‧‧Advertising fingerprint database

900‧‧‧Storage media

90‧‧‧Advertising Breaking Rules Database

92‧‧‧Advertising fingerprint database

94‧‧‧Play content

94a‧‧‧break start point

94b‧‧‧ The end of the breach

94c‧‧‧Ad break time interval

94c(1), 94c(2), 94c(4)‧‧‧ Known advertisements

94c(3), 94c(5)‧‧‧Unknown advertisement

95(0), 95(1), 95(2)‧‧‧ image frames

96, 97, 98 ‧ ‧ steps

1000‧‧‧ display device

1010, 1020‧‧‧ fields

101(0)~101(N)‧‧‧APP

102(0)~102(N)‧‧‧ Tools

1100‧‧‧ display device

111a, 111b, 112a, 112b, 113a, 113b, 114‧‧‧ areas

S1201, S1203, S1205, S1207, S1209, S1211, S1213‧‧

S1301, S1303, S1305, S1307‧‧‧ steps

S1401, S1403, S1405, S1407‧‧‧ steps

S1501, S1503, S1505, S1507‧‧‧ steps

S1600, S1601, S1603, S1605, S1607, S1609, S1611, S1613, S1615, S1617‧‧

FIG. 1 is a schematic diagram of a display control system according to an exemplary embodiment.

FIG. 2 is a schematic block diagram of a video processing device according to an exemplary embodiment.

FIG. 3 is a schematic diagram of an advertisement breach judging device according to an exemplary embodiment. Block diagram.

FIG. 4 is a schematic flow chart of signal transmission according to an exemplary embodiment.

FIG. 5 is a diagram of a software architecture of an implementation according to an exemplary embodiment.

FIG. 6 is a flowchart of establishing an advertisement fingerprint database according to an exemplary embodiment.

7A-7B are schematic diagrams of a screen for capturing a main display area, according to an exemplary embodiment.

FIG. 8 is a schematic diagram of inputting an image frame into a hash function to generate a corresponding string according to an exemplary embodiment.

FIG. 9 is a schematic diagram of determining whether a play period of a currently played content is in an advertisement break period according to an exemplary embodiment.

FIG. 10 is a schematic diagram of displaying a prompt message on a display device according to an exemplary embodiment.

11A-11D are schematic diagrams showing a manner of displaying a message according to an exemplary embodiment.

FIG. 12 is a schematic flow chart of displaying a prompt message according to an exemplary embodiment.

FIG. 13 is a schematic flowchart of displaying a prompt message according to an exemplary embodiment.

FIG. 14 is a schematic flow chart of a display control method according to an exemplary embodiment.

FIG. 15 is a flow of a channel return reminder function according to an exemplary embodiment. Schematic diagram.

FIG. 16 is a schematic flowchart of a processing mechanism of an advertisement breach judging device for an unknown advertisement according to an exemplary embodiment.

The present invention provides a display and control method for determining whether a play time of a content currently viewed by a user is an advertisement break period. The breakaway represents an advertisement segment inserted in the content, and the advertisement breach period represents a time interval in which the at least one advertisement is scheduled to be played in the content, that is, a time period during which the advertisement is played. If the playing time of the content currently viewed by the user is the advertising break period, the prompt message may be superimposed on the screen, and the user can interact with the prompt message. This method provides superimposed information other than the playing content (for example, a television program) on the same screen without affecting or interrupting the user's viewing. Through this technology, multi-screen information single-screen fusion and two-way interactive optimization can be achieved on a display device (for example, a television).

FIG. 1 is a schematic diagram of a display control system according to an exemplary embodiment.

Referring to FIG. 1, the display control system 1000 includes a display device 100, an OTT service provider 120, a handheld device 140, a video processing device 160, and an advertisement breach determining device 180. In the exemplary embodiment, the display device 100 is a digital television. However, in other embodiments, the display device 100 may be, for example, an analog television, a digital photo frame display device, a desktop computer, a notebook computer, a tablet computer, mobile phone, Smart phones, e-books or multimedia display devices. The OTT service provider 120 can be a provider of network services for one or more devices such as a desktop computer, a notebook computer, or a server that can provide users with a message or send via a wired or wireless network. Messages, social network interactions, audio and video playback, or other services that interact with users. In the exemplary embodiment, the handheld device 140 is a smart phone. However, in other exemplary embodiments, the handheld device 140 may be, for example, a digital photo frame display device, a desktop computer, a notebook computer, a tablet computer, an e-book, Mobile phone or multimedia display device, etc.

In the present exemplary embodiment, the audio-visual processing device 160 is a set top box. However, in other exemplary embodiments, the audio-visual processing device 160 may also be a smart TV stick, or may be disposed in the display device 100. Form a product or device, for example, a smart TV.

As shown in FIG. 1, in the exemplary embodiment, the audio processing device 160 can be configured to provide the playback content 10a and the prompt message 10b for display on the display device 100. The display device 100 can display the above-described broadcast content 10a and the prompt message 10b. The advertisement breaking device 180 can be used to provide a determination result of whether the audio-visual processing device 160 is currently the advertisement content 10a of the display device 100. The OTT service provider 120 can be configured to provide a predetermined playback message to the video processing device 160. The audio processing device 160 generates a prompt message 10b corresponding to the message to the display device 100, where the predetermined message can be subscribed by the user. , email, social network content, text or voice messages, etc., are not limited here.

In addition, the OTT service provider 120 can also directly transmit the message scheduled to be dialed. It is sent to the handheld device 140 for display. Alternatively, the user can also click the prompt message 10b in the display device 100; then, the video processing device 160 transmits the message corresponding to the prompt message 10b to the handheld device 140, so that the handheld device 140 displays the message.

FIG. 2 is a schematic block diagram of a video processing device according to an exemplary embodiment.

Referring to FIG. 1 and FIG. 2 simultaneously, the audio processing device 160 includes a communication unit 20, an input/output interface 22, a storage unit 24, and a processing unit 26.

The communication unit 20 may be, for example, a wireless transceiver unit supporting a wireless communication standard such as 802.11n/b/g of the Institute of Electrical and Electronics Engineers (IEEE), which can wirelessly establish a network with other external devices. link. In addition, the communication unit 20 may also include a third generation mobile communication (Third Generation Telecommunication (3G) module, a Long Term Evolution (LTE) network communication interface, a Wi-Fi module, or a Bluetooth device. And other agreements to establish a network connection with other external devices through wireless means. For example, the communication unit 20 may have a wireless transceiving unit such as an antenna. In addition, the communication unit 20 can also support a wired network, such as a network card, and is not limited herein.

The input and output interface 22 can be, for example, a device that supports a twisted pair, a coaxial cable, an optical fiber, or other transmission medium transmission. In addition, the input and output interface 22 can also be compliant with the Parallel Advanced Technology Attachment (PATA) standard, electrical and Institute of Electrical and Electronic Engineers (IEEE) 1394 standard, Peripheral Component Interconnect Express (PCI Express) standard, Universal Serial Bus (USB) standard, Ultra-high-speed generation (Ultra) High Speed-I, UHS-I) interface standard, Ultra High Speed-II (UHS-II) interface standard, Serial Advanced Technology Attachment (SATA) standard, Memory Stick (MS) Interface standard, Multi Media Card (MMC) interface standard, Compact Flash (CF) interface standard, Integrated Device Electronics (IDE) standard or other suitable standards. In the present exemplary embodiment, the input/output interface 22 is a device that supports coaxial cable transmission, and supports data transmission and reception of a TCP/IP transmission protocol by the communication unit 20. Specifically, the input/output interface 22 can be used to receive a signal source of the coaxial cable, transmit a signal processed by the processing unit 26, or send a related message transmitted by the coaxial cable (for example, a channel station number of the currently played content, Current playback content, etc.).

The storage unit 24 can be, for example, a static random access memory (SRAM), a dynamic random access memory (Dynamic Random Access Memory), a hard disk, a flash memory, or any of the available A memory or storage device for storing electronic signals or data. In this embodiment, the storage unit 24 can be used to temporarily store messages from the OTT service provider or the APP to be presented to the user. When the messages are not immediately displayed to the user (for example, when the content is not in the advertisement break period), the storage unit 24 is temporarily stored.

The processing unit 26 is coupled to the communication unit 20, the input/output interface 22, and the storage unit 24, for outputting a play content message to the advertisement breach determination device 180 by the input/output interface 22, wherein the playback content message corresponds to The information of the playback content 10a of the display device 100 is displayed. The play content message may include extended information related to the play content 10a in the embodiment. For example, in the exemplary embodiment, the play content message is a channel station number of the play content currently viewed by the user. In this exemplary embodiment, the play content 10a may be a streaming video, a content stream of a television channel, or other types of digital or analog video content, which may be provided by a fourth carrier (system vendor) or a channel provider. . The processing unit 26 can also be used to convert the signal received by the input/output interface 22 into a playback format supported by the display device 100, and output the signal (ie, the playback content 10a in FIG. 1) to the display device through the input/output interface 22. 100.

The processing unit 26 can receive a notification message from the advertisement breach determining device 180 (described in detail later) through the input/output interface 22, wherein the notification message is used to indicate the content information (for example, the current channel number) Whether the playing time of the corresponding playing content is in the advertising break period. If the playing time corresponding to the current playing content is not in the advertising break period, the storage unit 24 temporarily stores the message from the OTT service provider or the APP to be presented to the user; and if the currently playing content corresponds to the playing time in the advertising break period The processing unit 26 can superimpose the prompt message 10b in the content to be played. The prompt message 10b may be a message corresponding to the OTT service provider 120, such as an event notification, an advertisement push, an additional content of a television program, or the like, or may be a message provided by the OTT service provider 120. The prompt message 10b can also be used The content of the channel currently viewed or other information, for example, assuming that the content is a gourmet program, the prompt message 10b may be the store name, address or contact telephone number of the store. In addition, the prompt message 10b may also be a function or a program set by the user, such as a calendar notification, an alarm clock, a timer reminder, and a prompt message corresponding to a specific channel program/advertisement notification. The processing unit 26 can superimpose the prompt message 10b and the play content 10a, and send it to the display device 100 through the input/output interface 22. Next, the display device 100 displays the superimposed play content 10a and the prompt message 10b, and the user can complete the operation or interaction according to the prompt message 10b during the advertisement break period.

It should be noted that the content corresponding to the prompt message 10b is, for example, the message provided by the OTT service provider 120 or the function or program set by the user. In an exemplary embodiment, processing unit 26 further determines the immediacy of the message to be provided to the user to determine the timing of the display. For example, the processing unit 26 further determines whether the message is an immediacy message or a non-instant message. If it is an immediacy message, the processing unit 26 immediately transmits the prompt message 10b corresponding to the message to the display device 100, and the display device 100 can immediately display the content currently viewed by the user. If it is a non-instant message, the display device 100 displays the prompt message 10b when, for example, the playing time of the playing content viewed by the user is in the advertising break period. By judging the immediacy of the message, it can be determined whether the prompt message 10b needs to be displayed to the user as soon as possible, and the interference of the user when viewing the content can be reduced to avoid affecting or interrupting the user's viewing.

The input and output interface 22 can be further used to receive the user's prompt message. The operation of 10b. For example, the user can operate the prompt message 10b by a remote controller or other device. The processing unit 26 can determine whether to superimpose the message corresponding to the prompt message 10b in the play content 10a according to the operation, and transmit the play content of the overlay message to the display device 100 through the input/output interface 22 for display on the display device 100. . In other exemplary embodiments, the audio processing device 160 can also send the prompt message 10b to the handheld device 140 through the input/output interface 22 to display the prompt message 10b on the handheld device 140 other than the display device 100. For example, the user can receive the prompt message 10b through the handheld device (eg, a mobile phone) and display it on the screen of the handheld device.

In an exemplary embodiment, the processing unit 26 can further determine whether the currently playing content in the display device 100 is in a sequential switching channel state. The sequential switching channel state is a state in which the user arbitrarily switches and browses a plurality of channels in a short time, and the user does not select to switch to a specific channel. For example, the user can switch channels in a sequential increment or decrement, and each channel has a dwell time within a predetermined time, such as three or three seconds. If the playback content 10a is in the sequential switching channel state, the processing unit 26 may also superimpose the prompt message 10b in the playback content 10a.

In addition, in another exemplary embodiment, the prompt message 10b may also be displayed to the user when the audio processing device 160 has just turned on the playback function. For example, the video processing device 160 displays the prompt message 10b just after the playback function is turned on, and a buffer time for playing the content 10a has not yet started. Alternatively, the prompt message 10b may be displayed for a period of time after the audio processing device 160 has just turned on the playback function. The user can respond, operate or select the prompt message 10b to end the display of the prompt message 10b. In addition, the prompt message 10b can also be automatically hidden after a period of time after the power is turned on. In another exemplary embodiment, the prompt message 10b may also be displayed to the user within a buffer time after the video processing device 160 is turned off.

It should be understood that the processing unit 26 may employ a hardware device such as a logic circuit component to perform the functions of the processing unit 26 described above; in addition, the processing unit 26 may also load the storage unit 24 stored in the audio processing device 160. The program in the above, to perform the above functions, there is no limit here. In this embodiment, the processing unit 26 can be a central processing unit, a Field-Programmable Gate Array (FPGA), or a multi-purpose wafer that can load a programming language to perform the corresponding functions.

Referring to FIG. 1 again, the advertisement breach determining device 180 is, for example, one or more desktop computers, notebook computers, or servers, for determining whether the playing time of a broadcast content is in an advertisement breach period. It should be understood that although the advertisement breach determination device 180 of FIG. 1 is a separate device, in other exemplary embodiments, the advertisement breach determination device 180 may also be combined with the audiovisual processing device 160 to form a single device.

FIG. 3 is a schematic block diagram of an advertisement breach determining apparatus according to an exemplary embodiment.

Referring to FIG. 1 and FIG. 3 simultaneously, the advertisement breach judging device 180 includes a communication unit 30, an input/output interface 32, a storage unit 34, and a processing unit 36. Communication list The function of element 30 and the supported communication protocol are as described above for communication unit 20. The function of the input/output interface 32 and the supported data transmission format are as described above for the input/output interface 22, and will not be described herein. The storage unit 34 can be a static random access memory (SRAM), a dynamic random access memory (Dynamic Random Access Memory), a hard disk, a flash memory, or any of A memory or storage device that stores electronic signals or data. The processing unit 36 can perform the functions of the processing unit 36 by using a hardware device such as a logic circuit component. Further, the processing unit 36 can also load the program stored in the storage unit 34 of the advertisement breach determining device 180. In order to perform its functions, there is no limit here. In this embodiment, the processing unit 36 can be a central processing unit, a field-programmable gate array (FPGA), or a multi-purpose wafer that can load a programming language to perform the corresponding functions.

The processing unit 36 is coupled to the communication unit 30, the input and output interface 32, and the storage unit 34. In the present exemplary embodiment, the advertisement breach judging device 180 receives a play content through the input/output interface 32, and the processing unit 36 can analyze the play content to create one or more advertisement breach databases in the storage unit 34. in. In addition, the advertisement breach judging device 180 can also receive a play content message (for example, the current channel station number) through the input/output interface 22, and the processing unit 36 can follow the advertisement fingerprint (Fingerprint) of the play content to be analyzed, and the advertisement. One or more advertisement fingerprints of the breach database and an advertisement breach rule are compared in similarity (described in detail later) to determine whether the playback time corresponding to the currently played content is in an advertisement breach period. If the playing time corresponding to the currently playing content is in the break period of the advertisement, it can be input by The output interface 32 sends an advertisement break determination notice. The advertisement fingerprint is a feature message corresponding to the played content, and the feature message may be an image about the played content, an audio of the played content, or other features corresponding to the played content.

FIG. 4 is a schematic flow chart of signal transmission according to an exemplary embodiment.

Referring to FIG. 4, in an exemplary embodiment, as shown in state 1, in step 401, when the OTT service provider 120 has a message to provide to the user, the message can be transmitted through, for example, network transmission. To the audio processing device 160. In the present exemplary embodiment, the video processing device 160 is in a standby state in step 401, and the function for receiving a message in the audio processing device 160 is not turned off. That is to say, the video processing device 160 can still receive and store the message from the OTT service provider 120 while the AV processing device 160 is in the standby state. Next, in step 402, when the user turns on the display device 100 and turns on the playing function of the video processing device 160 (for example, the playing function of the fourth station), in step 403, the video processing device 160 may receive the OTT service provider 120. The message is displayed on the display device 100, and the user can operate the message to end the display of the message, or the message automatically disappears after a time interval, and the user can watch the content. In step 404, the video processing device 160 returns the channel (i.e., the broadcast content message) viewed by the current user to the advertisement breach judging device 180. Next, in step 405, the advertisement breach determining means 180 determines whether the playing time of the playing content of the channel currently viewed by the user is an advertising breach period. Based on the result of the determination, in step 406, the advertisement breach determining means 180 transmits an advertisement break determination notification to the video processing device 160. Hypothesis At present, in the step 407, the video processing device 160 superimposes a prompt message about the message of the OTT service provider 120 in the play content, and displays it by the display device 100. The prompt message. In step 408, the user can browse through the handheld device or the remote control, and can also decide whether to display the message. In step 409, the user may also select to transfer the message to be displayed by the display device 100 to other handheld devices, such as the handheld device 140. In step 410, the video processing device 160 transfers the message provided by the OTT service provider to the handheld device 140 for display, and in step 411, the user can access the message or service of the OTT service provider 120 by using the handheld device 140. . If in step 412, the OTT service provider 120 transmits a new message to the video processing device 160, and in step 413, when the user turns off the playback function of the video processing device 160, in step 414, the audio processing device 160 may The message from the OTT service provider 120 is displayed on the display device 100.

In another exemplary embodiment, as shown in the state 2, when the playing function of the video processing device 160 is in the on state, and the user switches the playing content, for example, in step 415, the user performs the display device 100. The channel processing device 160 can receive a message about the channel from the display device 100. Next, in step 416, the video processing device 160 determines whether the current channel switching state is the user switching the channel state sequentially. If the display device 100 is currently in the sequential switching channel state, the video processing device 160 may superimpose the prompt message and display it on the screen. In the display device 100; if the playback content of the display device 100 is switched to a specific channel, the user desires to view the channel. Then in step 417, the shadow The tone processing device 160 returns the current channel to the advertisement breach judging device 180. Next, in step 418, the advertisement breach determining means 180 determines whether the channel currently viewed by the user is an advertisement breach period. In accordance with the result of the determination, in step 419, the advertisement breach determining means 180 transmits an advertisement break determination notification to the video processing device 160. In step 420, the video processing device 160 determines whether there is a message to be displayed to the user, for example, whether the storage unit has a message to be displayed to the user, or whether to receive the message from the OTT service provider 120. Wait. Assuming that the playing time of the currently viewed content of the user is an advertisement breach period and there is a message to be displayed to the user, in step 421, the video processing device 160 superimposes a prompt message about the message in the playing content, and The prompt message is displayed by the display device 100. In another exemplary embodiment, steps 417-419 may be omitted, that is, in step 416, the audio processing device 160 determines whether the current channel switching state is the user sequentially switching the channel state, provided that the display device 100 is currently in the sequence. Switching the channel state, that is, proceeding to step 420, the video processing device 160 determines whether there is a message to be displayed to the user. If there is a message to be displayed to the user, then in step 421, the video processing device 160 superimposes one of the messages. The prompt message is displayed in the content, and the prompt message is displayed by the display device 100.

FIG. 5 is a diagram of a software architecture of an implementation according to an exemplary embodiment.

Referring to FIG. 5, in an exemplary embodiment, the video processing device 160 may include a system 500. The system 500 may be implemented in a software format, where the system 500 may be an application interface constructed in an Android system. (Application Programming Interface, API for short). As shown in Figure 5, The system 500 includes a transmit/receive module 50, a control module 52, a display module 54, a channel detection module 56, and a mobile device discovery module 58.

The sending/receiving module 50 can be used for sending or receiving the playing content, the information related to the playing content, the information provided by the OTT service provider, the prompt message provided by the user APP, or the operation or setting message of the user. The control module 52 is configured to receive a user's operation and perform a corresponding function. The display module 54 is configured to provide a signal for playing the content or a signal for providing the playback content including the overlay message. The channel detection module 56 is configured to detect whether the playback content is in a sequential switching channel state. In addition, the sending/receiving module 50 can notify the display module 54 according to the message provided by the OTT service provider 120 or the event provided by the user APP, and according to the judgment result of the channel detecting module 56 on the playing content and the channel, Decide when to prompt the message to be displayed. In addition, the mobile device discovery module 58 is configured to find whether a handheld device (eg, a tablet or a mobile phone) can receive the message sent by the system 500 and push it around the periphery of the system 500.

FIG. 6 is a flowchart of establishing an advertisement fingerprint database according to an exemplary embodiment.

Referring to FIG. 6, an input signal source is received at step S601, and the input signal source has corresponding playback content. In step S603, a plurality of advertisement segments are obtained by marking (for example, manually marking) the manner in which the advertisement segments in the content are played. In another exemplary embodiment, multiple advertisement segments may also be provided by an advertiser or a channel provider to obtain multiple advertisement segments. Next, in step S605, each advertisement segment is captured at a frequency of at least one screen per second to capture a picture of the main display area (described in detail later) of the advertisement segment to generate a plurality of image frames (frame ); in another In an embodiment, the entire screen of the commercial segment may be intercepted instead of capturing the primary display area. Then, in step S607, the image frames are input into a hash function to generate a corresponding feature message for each image frame. The feature message may be a string or a value corresponding to the image frame, and each string or value belongs to one of the segments. Finally, in step S609, the feature information (such as the strings or values) and their corresponding advertisement information are stored in the advertisement fingerprint database.

7A-7B are schematic diagrams of a screen for capturing a main display area, according to an exemplary embodiment.

Referring to FIG. 7A and FIG. 7B, as shown in FIG. 7A, for a channel operator, the channel operator often superimposes additional information on the screen of the channel, such as channel flag 71a, instant news message 71b or other overlay content 71c. and many more. However, the overlays of these channels will vary from channel to channel. When the same commercial segment is broadcast on different channels, the advertising fingerprint generated by the hash function may also be different due to the difference in the overlay content. Therefore, if the entire screen of the advertisement segment is used to construct an advertisement fingerprint, the judgment of the advertisement fingerprint comparison may be incorrect.

Therefore, in order to avoid the occurrence of the above-mentioned advertisement fingerprint determination error, as shown in FIG. 7B, when the screen for generating the advertisement fingerprint is captured, the screen of a main display area 73 of the playback content may be captured as the image for generating the advertisement fingerprint. Image frame. The range of the main display area 73 may be a range or size customized by the system developer. The main display area 73 may not include information additionally superimposed by the channel provider or the service provider in the played content.

FIG. 8 is a diagram of inputting an image frame into a hash letter according to an exemplary embodiment. Number to generate a schematic of the corresponding string.

Referring to FIG. 8, the advertisement segment 801 is, for example, a plurality of advertisement segments obtained by manually marking an advertisement segment in the content in step S603 in FIG. Then, each advertisement segment 801 periodically captures the picture of the main display area of each of the advertisement segments periodically (for example, at a frequency of capturing at least one picture per second) to generate a plurality of image frames 802 ( 0)~802(2). Then, the image frames 802(0)-802(2) are input into the hash function 803 to obtain corresponding advertising fingerprints. In this exemplary embodiment, the advertising fingerprint is a string of a plurality of bits. Finally, the advertisement fingerprints and their corresponding advertisement information are stored in the advertisement fingerprint database 804 for subsequent comparison. The advertisement information corresponding to the advertisement fingerprint mentioned above includes the length of the advertisement, the date of the broadcast, and/or the time of the broadcast, and the like. In addition, the advertising fingerprint is in units of image frames, that is, each image frame corresponds to one advertising fingerprint, and each advertisement has multiple image frames and corresponding advertising fingerprints.

FIG. 9 is a schematic diagram of determining whether a play period of a currently played content is in an advertisement break period according to an exemplary embodiment.

Referring to FIG. 9 , in the exemplary embodiment, the manner in which the advertisement breach period is determined may be obtained by the advertisement breach rule database 90 stored in the storage medium 900 and/or the advertisement fingerprint in the comparison fingerprint database 92. It is known that the storage medium 900 can be the storage unit 34 of the advertisement breach judging device 180. The advertisement breaking rule may be determined according to the program type and/or the length of the advertisement break of the program period and/or the frequency of the advertisement playing or a combination thereof.

Specifically, the advertising breach rules include the distribution of advertisements and advertisements. Breaking strategy. For example, in the case of a drama with a length of 60 minutes, the advertisement is based on five passages and four breaks; for a program with a length of 75 minutes, there are six paragraphs. A break; while a 90-minute show usually has seven passages and six breaches. That is to say, the channel operator will distribute the advertisement break evenly according to the length of the broadcast content, so as to profit by playing the advertisement during the advertisement break period.

The advertising breach strategy is about the time and frequency of advertising breaches. Specifically, the channel operator may, in order to attract viewers to continue watching the program or develop the habit of viewers’ viewing, so that the first advertisement in the content may appear later, or the number of advertisements may be reduced in order to obtain ratings. .

Based on the culture and unspoken rules of the above-mentioned television industry, by collecting such relevant information (for example, the advertisement breach distribution and advertisement breach strategy), the distribution of known advertisements is summarized through statistical or machine learning methods. The advertisement breaks the rules.

As shown in FIG. 9, assuming that the current user is watching the play content 94, the advertisement break period of the play content 94 can be analyzed according to the advertisement break rule in the advertisement break rule database 90, for example, The mouth start time point 94a and the break end time point 94b, and the advertisement break time interval is 94c. Next, in step 96, the image frames in the currently played content 94 are retrieved, such as image frames 95(0)-95(2). As described above, the image frame captures an image of the main display area of the playback content 94 at a frequency of at least one per second to generate a plurality of image frames corresponding to the image. The description of the main display area is as described above with respect to the contents of FIGS. 7A and 7B, and will not be described herein.

Then, in step 97, the system inputs each captured image frame into a hash function to generate a corresponding advertising fingerprint for each image frame. In the present exemplary embodiment, the advertisement fingerprint is a string of length 10. Next, in step 98, the advertising fingerprints are compared with a plurality of advertising fingerprints in the advertising fingerprint database 92. If the advertisement fingerprint database has at least one advertisement fingerprint, according to the similarity comparison, the advertisement fingerprint is similar to the comparison advertisement fingerprint, and then the current playback time of the playback content 94 is determined to be in the advertisement breach period. . In the present exemplary embodiment, the similarity comparison is performed by comparing the Hamming distances of the two advertising fingerprints to calculate the degree of difference between the two strings, provided that the similarity between the two strings is higher than one. The threshold value is determined to be the same as the advertisement corresponding to the two strings, and it is determined that the currently playing time of the playback content 94 is in the advertisement breach period. However, the present invention is not limited thereto, and other different similarity comparison algorithms may be used in other exemplary embodiments.

It should be noted here that since the advertisement break rule is only for reference, it is not 100% accurate to judge whether the current play time is an advertisement break period. When the advertisement fingerprint obtained by capturing the screen of the playback content 94 is compared with the advertisement fingerprint in the advertisement fingerprint database 92, if there is no similar advertisement fingerprint in the advertisement fingerprint database 92, the playback content is represented. The current play time is not at the time of the ad break. That is to say, the comparison of the advertisement fingerprints can be used to determine whether the play time of the currently played content 94 is in the advertisement break period. Moreover, when comparing the captured advertising fingerprints with the advertising fingerprints in the advertising fingerprint database, if the advertising fingerprint database has similar advertising fingerprints, it may also determine the current location. What is the advertisement for the broadcast.

In another exemplary embodiment, taking FIG. 9 as an example, 94c(1), 94c(2), and 94c(4) are known advertisements, and the advertisement fingerprints thereof are stored in the advertisement fingerprint database 92; 94c(3), 94c(5) is an unknown advertisement whose advertising fingerprint has not been stored in the advertising fingerprint database 92. When the user views the play content 94, the advertisement break period of the play content 94 is not analyzed according to the advertisement break rule, but the image frame in the currently played content 94, such as the image frame, is captured according to the set frequency (for example, one per second). 95 (0) ~ 95 (2). Then, as in the foregoing, in step 97, the system inputs each captured image frame into a hash function to generate a corresponding advertising fingerprint for each image frame, thereby determining that the current playing time of the playing content 94 is in the advertisement. In the breach period, when an advertisement segment (for example, 94c(1)) is judged according to the similarity comparison, the length of the advertisement is determined according to the length of the advertisement break rule, and the length of time (for example, 94c) is broken. In the mouth period, when encountering unknown advertisements (such as 94c (3) and 94c (5)), although there is no advertising fingerprint of these advertisements in the advertising fingerprint database, the time period can be judged as the advertisement breach period, and The advertising fingerprint database 92 is trained based on these unknown advertisements.

FIG. 10 is a schematic diagram of displaying a prompt message on a display device according to an exemplary embodiment.

Referring to FIG. 10, if the current OTT service provider or user APP has a message to provide to the user, it is assumed that the status of the currently displayed content of the display device 1000 is in the advertisement break period, just turned on, or the user continuously switches the channel. The status or the like can provide a status of the prompt message, and the display device 1000 can display a prompt message to remind the user. In an exemplary embodiment, the display device 1000 prompts a message. The display manners may be displayed on the left and right sides of the display device 1000, such as the field 1010 and the field 1020, respectively. Field 1010 includes, for example, APP 101(0)~101(N). On the assumption that the APP 101(1) has a message to be presented to the user, the prompt message 104 is displayed at the upper right of the APP 101(1) image to prompt the user to click and read the corresponding message. Additionally, field 1020 can include tools 102(0)-102(N) for assisting a user in using display device 1000. However, the present invention is not limited to the display manner of the field 1010, the field 1020, and the options and functions corresponding to the fields. In other exemplary embodiments, other fields, display modes, and corresponding functions may be included.

11A-11D are schematic diagrams showing the manner of displaying a message according to an exemplary embodiment.

Referring to FIG. 11A to FIG. 11D , if the user performs a selection operation according to the prompt message, the message corresponding to the prompt message may be displayed in the device 1100 .

As shown in FIG. 11A, in an exemplary embodiment, the message corresponding to the prompt message is superimposed and displayed in the right area 111b of the display device 1100 for the user to browse or interact. For example, the play content viewed by the original user is compressed and displayed in the area 111a, or only the screen corresponding to the area 111a in the original play content is displayed. In addition, the transparency of the prompt message in the area 111b may be increased so that the message corresponding to the prompt message is displayed in the area 111b. That is to say, in this case, the foreground displayed by the area 111b is the message corresponding to the prompt message, and the background is the play content corresponding to the playback content in the area 111b.

As shown in FIG. 11B, in an exemplary embodiment, the prompt message corresponds to The message is superimposed and displayed in the lower area 112b of the display device 1100 for the user to browse or interact. For example, the playback content viewed by the original user is compressed and displayed in the area 112a, or only the screen corresponding to the area 112a in the original playback content is displayed. In addition, the transparency of the prompt message in the area 112b may be increased so that the message corresponding to the prompt message is displayed in the area 112b. That is to say, the foreground displayed by the area 112b is the message corresponding to the prompt message, and the background is the play content corresponding to the playback content in the area 112b.

As shown in FIG. 11C, in an exemplary embodiment, the message corresponding to the prompt message is displayed in the entire display area 113b of the display device 1100, so that the user can browse or interact, and the original play content is displayed in a reduced size. In the area 113a.

As shown in FIG. 11D, in an exemplary embodiment, the message corresponding to the prompt message is superimposed and displayed on the entire display area 114 of the display device 1100 for the user to browse or interact. In addition, the transparency of the prompt message in the area may be increased so that the message corresponding to the prompt message is displayed in the overall display area 114 of the display device 1110. That is to say, the foreground displayed by the area 114 is the message corresponding to the prompt message, and the background is the play content corresponding to the playback content in the area 114.

It should be understood that the manner in which the message corresponding to the above prompt message is displayed is for example only and is not intended to limit the present invention. The invention may further include other display modes in other embodiments.

FIG. 12 is a flowchart of displaying a prompt message according to an exemplary embodiment. schematic diagram.

Referring to FIG. 12, in step S1201, when the user turns on the display device, in step S1203, the audio-visual processing device determines whether there is a message in the storage unit for storing the OTT service provider or the user APP to provide to the user. . If there is no OTT service provider or a message that the user APP wants to provide to the user in the storage unit of the audio-visual processing device, step S1207 is directly executed to allow the user to view the content played in the display device. If the storage unit of the audio-visual processing device has an OTT service provider or a message that the user APP wants to provide to the user, in step S1205, the video processing device superimposes the prompt message corresponding to the message in the playing content, and borrows The display device displays the prompt content to the user, and allows the user to respond or operate the prompt message.

When the user finishes the prompt message or ends the corresponding operation, the user can view the playback content of the display device in step S1207. Next, in step S1209, the video processing device sends a play content message (for example, the channel number of the channel) of the currently played content to the advertisement break determination device to determine whether the current play content is in the advertisement break period, and the video processing The device also determines whether the playback content is in a sequential switching channel state. If the current playing content is in the advertising break period or sequentially switching the channel state, step S1203 is performed to determine whether a new prompt message needs to be displayed for display to the user. If the current playback content is not in the advertisement breach period or the channel switching state is sequentially changed, then in step S1211, it is determined whether the user turns off the display device. Assuming that the user does not want to turn off the display device, step 1209 is performed, and it is determined whether the playback content viewed by the user is in an advertisement breach period. Or switch channel status sequentially. Assuming that the user wants to turn off the display device, the display device will be turned off in step S1213.

FIG. 13 is a schematic flowchart of displaying a prompt message according to an exemplary embodiment.

Referring to FIG. 13, the flowchart of FIG. 13 is a detailed flow of step S1205 of FIG. In step S1301, the video processing device receives the user's selection operation for the prompt message, for example, the user controls by the handheld device or the remote controller. Next, in step S1303, the video processing device determines whether the message corresponding to the prompt message is displayed on the display device according to the user's operation. If the user wants to display the message corresponding to the prompt message in the currently displayed display device, the video processing device displays the message on the display device in step S1305. If the user does not display the message corresponding to the prompt message on the display device for playing the content, then in step S1307, the video processing device displays the message on the display area of the other handheld device of the user according to the user's operation.

FIG. 14 is a schematic flow chart of a display control method according to an exemplary embodiment.

Referring to FIG. 14, in step S1401, the advertisement breach determining device receives a display signal source. In step S1403, the advertisement breach judging device obtains a play content according to the display signal source. Next, in step S1405, the advertisement break determination device determines whether a play time corresponding to the play content is in the advertisement according to one or more advertisement fingerprints of the played content, for example, compared with the advertisement fingerprint in the advertisement fingerprint database. Breaking time. If the playback time corresponding to the content is at In the advertisement breach period, in step S1407, the advertisement breach judging device sends a notification message to the video processing device, and the video processing device superimposes the prompt message in the playback content. If a play time corresponding to the play content is not in the advertisement break period, step S1405 is repeatedly executed to wait for the occurrence of the advertisement break period.

FIG. 15 is a schematic flowchart of a channel return reminding function according to an exemplary embodiment.

Referring to FIG. 15, in an exemplary embodiment of the present invention, the determination of whether the playback time of the playback content is in the advertisement breach period may also be applied to the channel back reminder function (Call Back) of the display device. This feature allows users to freely browse multiple channels without missing a particular channel. That is, the processing unit of the audio-visual processing device can determine whether the advertisement breach period is over. If the advertisement breach period ends, the processing unit of the audio-visual processing device sends another prompt message and displays the prompt message in the display device. Remind users that the ad break period ends. The detailed procedure flow is as follows.

In step S1501, the video processing device determines the channel that the user wants to return. Specifically, the user can set to monitor a specific channel through the audio processing device. At the end of the channel's ad break period, an instant notification is sent and the message is superimposed on the screen to remind the user to return to view the channel they have set. The monitoring mode of the specific channel may be manually set by the user through the interface provided by the system, or the audio-visual processing device may be automatically set according to the behavior of the user, such as the length or frequency of each channel being viewed. For example, when a channel is continuously watched by the user for a period of time, for example, more than 20 minutes, the video processing device will automatically The channel is set to be monitored and reminded. When the user switches to another channel, as long as the advertisement break period of the channel ends, the video processing device will issue a prompt notification and display it on the display device.

In step S1503, when the video processing device determines the channel to be returned, the advertisement breach judging device detects the advertisement break period of the channel to be returned.

In step S1505, when the advertisement breach period of the channel to be returned ends, the advertisement breach judging device sends a notification to the video processing device, and the video processing device provides a prompt message to the user according to the message. If the advertisement break period of the channel to be returned ends, then in step S1507, the video processing device displays the channel return message through the display device. If the advertisement break period of the channel to be returned has not ended yet, the process proceeds to step S1503, so that the advertisement breach device continues to detect the advertisement breach of the channel to be returned.

FIG. 16 is a schematic flowchart of a processing mechanism of an advertisement breach judging device for an unknown advertisement according to an exemplary embodiment.

Referring to FIG. 16, in step S1600, the advertisement breach determining means starts the processing mechanism flow of the unknown advertisement. Next, in step S1601, the advertisement breach determination device detects the advertisement in the playback content according to the advertisement breach rule and the advertisement fingerprint database, wherein the detection manner of the advertisement in the playback content is as shown in FIG. 9 and the above content. , will not repeat them here. Next, in step S1603, the advertisement breach determining means determines whether the advertisement in the content being played is a known advertisement stored in a known advertisement database. Specifically, in this exemplary embodiment, the advertisement breach database of the advertisement breach judging device further includes a known advertisement database (for example, the first of the storage unit) a region) and an unknown advertisement database (eg, a second region of the storage unit), wherein the known advertisement database stores advertisement fingerprints, category information, and names of a plurality of known advertisements, and the unknown advertisement database stores a plurality of The advertising fingerprint of an unknown ad. The advertisement breach judging device searches for a first advertisement fingerprint in the known advertisement database, wherein the similarity between the first advertisement fingerprint and the characteristic information of the unknown advertisement is higher than a first threshold.

If the advertisement breach judging device judges that the advertisement to be detected is a known advertisement, then in step S1605, the advertisement breach judging device returns the category corresponding to the currently detected advertisement according to the content of the known advertisement database. And the name information is given to the video processing device, and it is determined that the playing time corresponding to the playing content is in the advertising break period. Next, in step S1607, the advertisement breach judging device updates the content of the advertisement breach database. For example, the number of times this ad was played.

If the advertisement breach judging device judges that the currently detected advertisement is not a known advertisement, then in step S1609, the advertisement breach judging device retrieves the main screen area of the unknown advertisement, and calculates the unknown advertisement in step S1611. The feature information, wherein the feature information is calculated as shown in FIG. 8 and the above content, will not be described here. Next, in step S1613, the advertisement breach judging device judges whether the unknown advertisement is stored in the unknown advertisement database according to the feature message of the unknown advertisement. For example, the advertisement breach judging device searches for a second advertisement fingerprint in the unknown advertisement database, wherein the similarity between the second advertisement fingerprint and the characteristic information of the unknown advertisement is higher than a second threshold. Step S1617 is then executed to end the flow of FIG.

If this unknown ad is not stored in an unknown ad library, then at the step In S1615, the advertisement breach judging device stores the feature information of the unknown advertisement in the unknown advertisement database. In an embodiment, the system provider, channel provider or user may identify, classify and/or name a plurality of advertisements stored in an unknown advertisement database, and classify and/or name the advertisements and feature messages. Join a known ad library. Step S1617 is then executed to end the flow of FIG.

Furthermore, embodiments of the invention may also be applied to shopping channels. When the user browses the shopping channel, the technology can be used to issue discount information for the product during the period, and supplementary information about the product. If the user has the willingness to purchase, the purchase can be completed by pressing the button, and the procedure of purchasing can be completed on the television without calling or surfing the Internet, which can greatly improve the convenience of the TV shopping process. In addition, when users browse other channels, they can also promptly send out a reminder message to inform the shopping channel that they have the goods they need, in order to increase the exposure rate of the shopping channel, increase the chance of product and consumer matchmaking, create and stimulate more. consumption.

The present invention can also be used to display the playback content without disturbing or interrupting the user. Therefore, after receiving the prompt message on the display device, the user can transfer the message to the handheld device (for example, a smart phone or a tablet), and then continue to watch the television. the behavior of. The content of the playback content is behind, and the handheld device browses the related operation corresponding to the message; in addition, when multiple people view the same display device, the mode does not interrupt the viewing behavior of other people. Users can directly operate their own handheld devices, allowing other viewers to continue to retain the right to view and control the display device.

The present invention can also display the playing content currently viewed by the user and the playing content. Whether it is currently information such as advertising time, and provides the required vendors and operators in the form of cloud services, so that the operators can understand the channel content viewed by the users and deliver and receive the viewing content in the advertising time period without disturbing their viewing behavior. Information about it.

Based on the above, the present invention provides a display and control method for determining whether a play time of a content currently viewed by a user is an advertisement break period. If the playing time of the content currently viewed by the user is the advertising break period, the prompt message may be superimposed on the screen, and the user can interact with the prompt message. This method provides superimposed information other than the playback content on the same screen without affecting or interrupting the user's viewing. Through this technology, multi-screen information single-screen fusion and two-way interactive optimization can be achieved on the display device.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and any one of ordinary skill in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.

S1301, S1303, S1305, S1307‧‧‧ steps

Claims (36)

A display control method is applicable to a display device, wherein the method includes: receiving a display signal source; obtaining a play content according to the display signal source; determining, according to the at least one advertisement fingerprint, whether a play time corresponding to the play content is An advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content, and the advertisement break period is at least one time interval in which at least one advertisement is played in the play content; and if the play content corresponds to The playing time is in the advertising breach period, and a prompt message is superimposed on the playing content, wherein the at least one advertising fingerprint is obtained by capturing a plurality of image frames of the playing content, and generating a pair according to the image frames respectively. It should be obtained from multiple feature messages of the image frame. A display control method is applicable to a display device, wherein the method includes: receiving a display signal source; obtaining a play content according to the display signal source; determining, according to the at least one advertisement fingerprint, whether a play time corresponding to the play content is An advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content, and the advertisement break period is at least one time interval in which at least one advertisement is played in the play content; Determining whether the advertisement breach period ends; and if the advertisement breach period ends, sending another prompt message and displaying the another prompt message to the display device, wherein the at least one advertisement fingerprint is obtained by capturing the playback content A plurality of image frames are obtained, and according to the image frames, respectively, a plurality of feature messages corresponding to the image frames are generated. The display control method of claim 1 or 2, wherein the step of determining, according to the at least one advertisement fingerprint, whether the play time corresponding to the play content is in the advertisement break period comprises: borrowing Determining, by an advertisement breaking rule, whether the playing time corresponding to the playing content is in the advertising break period, wherein the advertisement breaking rule is an advertising break length according to a program type and/or a program time period and / or an advertising play frequency or a combination of them. The display control method according to claim 1 or 2, wherein the at least one advertisement fingerprint is obtained by periodically capturing the image frames of the playback content, and inputting the image frames separately A hash function is obtained by respectively generating the feature messages corresponding to the image frames. The display control method of claim 4, wherein each of the image frames is an image of a main display area of the play content, wherein the main display area is a part of each of the image frames The area, and the image does not include a channel mark superimposed on the played content. The display control method of claim 1, wherein the step of determining whether the play time corresponding to the play content is in the advertisement break period according to the at least one advertisement fingerprint comprises: Comparing the at least one advertisement fingerprint with one or more advertisement fingerprints in an advertisement fingerprint database; and if the advertisement fingerprint database has a first advertisement fingerprint, wherein the first advertisement fingerprint and the at least one advertisement If the similarity of the fingerprint is higher than a first threshold, it is determined that the playing time corresponding to the playing content is in the advertising breach period. A display control method is applicable to a display device, wherein the method includes: receiving a display signal source; obtaining a play content according to the display signal source; determining, according to the at least one advertisement fingerprint, whether a play time corresponding to the play content is An advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content, and the advertisement break period is at least one time interval in which at least one advertisement is played in the play content; the at least one advertisement fingerprint is Aligning one or more advertisement fingerprints in an advertisement fingerprint database; if the advertisement fingerprint database has a first advertisement fingerprint, wherein a similarity between the first advertisement fingerprint and the at least one advertisement fingerprint is higher than one The first threshold, determining that the played content is a known advertisement; If the first advertisement fingerprint is not included in the advertisement fingerprint database, it is determined that the playback content is an unknown advertisement. The display control method of claim 7, comprising: determining whether a second advertisement fingerprint is included in an unknown advertisement database of the advertisement fingerprint database, wherein the second advertisement fingerprint and the at least one advertisement fingerprint The similarity is higher than a second threshold; if the second advertisement fingerprint is not in the unknown advertisement database, the at least one advertisement fingerprint is added to the unknown advertisement database. The display control method of claim 8, comprising: identifying the at least one advertisement fingerprint; and adding the identified at least one advertisement fingerprint to a known advertisement database. A display control method is applicable to a display device, wherein the method includes: receiving a display signal source; obtaining a play content according to the display signal source; determining, according to the at least one advertisement fingerprint, whether a play time corresponding to the play content is An advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content, and the advertisement break period is at least one time interval in which at least one advertisement is played in the play content; determining whether the play content is in a Switching the channel status sequentially; and if the playing content is in the sequential switching channel state, superimposing a prompt message on the playing content. The display control method according to claim 1 or 10, comprising: receiving a selection operation corresponding to the prompt message, and superimposing a message corresponding to the prompt message on the play content. The display control method according to claim 1 or 10, comprising: receiving a selection operation corresponding to the prompt message, and displaying a message corresponding to the prompt message in a display area of a handheld device. A display control system, comprising: a display device; an audio-visual processing device coupled to the display device; and an advertisement break determination device coupled to the audio-visual processing device for receiving a video processing device And playing a content message, determining, according to the at least one advertisement fingerprint, whether a play time of a play content corresponding to the play content message is in an advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content. The advertisement break period is at least one time interval in which at least one advertisement is played in the play content, and if the play time corresponding to the play content is in the advertisement break period, the advertisement break determination device transmits a notification message to the a video processing device, wherein the video processing device superimposes a prompt message on the content to be played, and the display device displays the prompt message and the played content, The at least one advertisement fingerprint is obtained by the advertisement breach determination device capturing a plurality of image frames of the playback content, and respectively obtaining a plurality of feature messages corresponding to the image frames according to the image frames. A display control system, comprising: a display device; an audio-visual processing device coupled to the display device; and an advertisement break determination device coupled to the audio-visual processing device for receiving a video processing device And playing a content message, determining, according to the at least one advertisement fingerprint, whether a play time of a play content corresponding to the play content message is in an advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content. The advertisement break period is at least one time interval in which at least one advertisement is played in the play content, and the video processing device determines whether the advertisement break period ends. If the advertisement break period ends, the video processing device sends another prompt message. The display device displays the other prompt message, wherein the at least one advertisement fingerprint is obtained by the advertisement breach determination device to capture the plurality of image frames of the playback content, and corresponding image frames are respectively generated according to the image frames. Multiple feature messages are obtained. The display control system of claim 13 or 14, wherein the determining whether the play time of the play content corresponding to the play content message is in the advertisement break period according to the at least one advertisement fingerprint In operation, including: The advertisement breach judging device judges whether the play time corresponding to the play content is in the advertisement break period by an advertisement break rule, wherein the advertisement break rule is based on a program type and/or a program period The length of an advertisement break and/or an advertisement play frequency or a combination thereof. The display control system of claim 13 or 14, wherein the at least one advertising fingerprint periodically captures the image frames of the playing content by the advertising breach determining device, and the images are The boxes respectively input a hash function to generate the feature information corresponding to the image frames respectively. The display control system of claim 16, wherein each of the image frames is an image displayed in a main display area of the play content, wherein the main display area is one of each of the image frames. Part of the area, and the image does not include a channel mark superimposed on the played content. The display control system of claim 13 or 14, wherein the determining whether the play time of the play content corresponding to the play content message is in the advertisement break period according to the at least one advertisement fingerprint In operation, the advertisement breach determination device compares the at least one advertisement fingerprint with one or more advertisement fingerprints in an advertisement fingerprint database in the advertisement breach determination device, if the advertisement database is in the advertisement database Having a first advertising fingerprint, wherein a similarity between the first advertising fingerprint and the at least one advertising fingerprint is higher than a first threshold, and the advertisement breach determining device determines that the playing time corresponding to the playing content is in the advertisement Breaking time. A display control system, comprising: a display device; an audio-visual processing device coupled to the display device; and an advertisement break determination device coupled to the audio-visual processing device for receiving a video processing device And playing a content message, determining, according to the at least one advertisement fingerprint, whether a play time of a play content corresponding to the play content message is in an advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content. The advertisement breach period is at least one time interval in which at least one advertisement is played in the play content, and the advertisement breach determination device compares the at least one advertisement fingerprint with one of an advertisement fingerprint database in the advertisement breach determination device Or comparing the plurality of advertisement fingerprints, if the advertisement database has a first advertisement fingerprint, wherein a similarity between the first advertisement fingerprint and the at least one advertisement fingerprint is higher than a first threshold, the advertisement is broken. The determining device determines that the played content is a known advertisement, and if the first advertising fingerprint is not in the advertising fingerprint database, Ad break determining means determines that an unknown broadcast content is advertising. The display control system of claim 19, comprising: the advertisement breach determining means determining whether a second advertisement fingerprint is included in an unknown advertisement database of the advertisement fingerprint database, wherein the second advertisement fingerprint and The similarity of the at least one advertising fingerprint is higher than a second threshold; if the second advertising fingerprint is not in the unknown advertising database, the advertisement breach determining device adds the at least one advertising fingerprint to the unknown advertising database. The display control system of claim 20, comprising: the advertisement breach judging device identifying the at least one advertisement fingerprint; and the advertisement breach judging device adding the identified at least one advertisement fingerprint to the Know the advertising database. A display control system, comprising: a display device; an audio-visual processing device coupled to the display device; and an advertisement break determination device coupled to the audio-visual processing device for receiving a video processing device And playing a content message, determining, according to the at least one advertisement fingerprint, whether a play time of a play content corresponding to the play content message is in an advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content. The advertisement break period is at least one time interval in which at least one advertisement is played in the play content, and the video processing device determines whether the play content is in a sequential switching channel state, and if the play content is in the sequential switching channel state, the video and audio The processing device superimposes a prompt message on the played content. The display control system of claim 13 or 22, comprising: the video processing device receiving a selection operation corresponding to the prompt message, and superimposing a message corresponding to the prompt message on the play content. The display control system according to claim 13 or 22, further comprising: A handheld device is configured to display a message corresponding to the prompt message in a display area of the handheld device when the video processing device receives a selection operation corresponding to the prompt message. An advertisement breach judging device, the device comprising: an input/output interface for receiving a display signal source; and a processing unit coupled to the input/output interface, the processing unit configured to obtain a play according to the display signal source And determining, according to the at least one advertisement fingerprint, whether a play time corresponding to the play content is in an advertisement break period, wherein the at least one advertisement fingerprint is a feature message corresponding to the play content, and the advertisement break period is the Playing at least one time interval of the at least one advertisement in the play content, if the play time corresponding to the play content is in the advertisement break period, sending an advertisement break determination notice by the input and output interface, wherein the at least one The advertisement fingerprint is obtained by the processing unit capturing a plurality of image frames of the playback content, and respectively obtaining a plurality of feature messages corresponding to the image frames according to the image frames. The advertisement breach judging device of claim 25, wherein the determining, according to the at least one advertisement fingerprint, whether the play time corresponding to the play content is in the operation of the advertisement break period comprises: The processing unit determines, by an advertisement breaking rule, whether the playing time corresponding to the playing content is in the advertising breach period, wherein the advertisement breaking rule is a root It is determined according to a program type and/or an advertisement break length of a program period and/or an advertisement play frequency or a combination thereof. The advertisement breach judging device of claim 25, wherein the at least one advertisement fingerprint is obtained by the processing unit periodically capturing the image frames of the playback content and inputting the image frames into a hash. The function is obtained by respectively generating the feature information corresponding to the image frames. The advertisement breakage judging device of claim 27, wherein each of the image frames is an image of a main display area of the play content, wherein the main display area is one of each of the image frames Part of the area, and the image does not include a channel mark superimposed on the played content. The advertisement breach judging device of claim 25, further comprising: a storage unit, wherein the processing unit compares the at least one advertisement fingerprint with one or more advertisement fingerprints of the storage unit, If the advertising fingerprints of the storage unit include a first advertising fingerprint, the processing unit determines that the playing time corresponding to the playing content is in the advertising breach period, wherein the first advertising fingerprint and the at least one advertising fingerprint The similarity is higher than a first threshold. The advertising breach judging device of claim 25, further comprising: a storage unit, wherein The processing unit compares the at least one advertising fingerprint with one or more advertising fingerprints of the storage unit, and if the advertising fingerprints of the storage unit include a first advertising fingerprint, the processing unit determines that the playing content is one An advertisement is known, wherein a similarity between the first advertisement fingerprint and the at least one advertisement fingerprint is higher than a first threshold, and if the first advertisement fingerprint is not in the storage unit, the processing unit determines that the playback content is an unknown ad. The advertisement breach judging device of claim 30, wherein the processing unit determines whether the plurality of advertisement fingerprints in an unknown advertisement storage area of the storage unit include a second advertisement fingerprint, wherein the unknown advertisement Whether the plurality of advertisement fingerprints of the storage area include the second advertisement fingerprint is determined according to whether the similarity is higher than a second threshold, wherein if the second advertisement fingerprint is not in the unknown advertisement storage area, the processing unit At least one advertising fingerprint is added to the unknown advertisement storage area. The advertisement breach judging device according to claim 31, wherein the processing unit includes: the processing unit identifies the at least one advertisement fingerprint; and the processing unit adds the identified at least one advertisement fingerprint to the storage unit. Known in the ad storage area. An audio-visual processing device, the device comprising: an input/output interface; a processing unit is coupled to the input/output interface, wherein the processing unit is configured to output a playback content message through the input/output interface, and receive a notification message by using the input/output interface, wherein the notification message is used to indicate the Whether a play time of a play content corresponding to the play content message is in an advertisement break period, wherein the advertisement break time period is at least one time interval in which the at least one advertisement is played in the play content, if the play content corresponds to the The playing time is in the break period of the advertisement, and the processing unit superimposes a prompt message on the playing content, wherein the notification message is sent by an advertisement breach determining device, and the advertisement breach determining device generates the notification according to the at least one advertising fingerprint. The message, the at least one advertisement fingerprint is obtained by the advertisement breach judging device capturing the plurality of image frames of the playback content, and respectively obtaining the plurality of feature messages corresponding to the image frames according to the image frames. An audio-visual processing device, comprising: an input/output interface; and a processing unit coupled to the input/output interface, wherein the processing unit is configured to output a playback content message by using the input/output interface, and by using the input The output interface receives a notification message, wherein the notification message is used to indicate whether a play time of a play content corresponding to the play content message is in an advertisement break period, wherein the advertisement break period is at least one played in the play content. At least one time interval of the advertisement, The processing unit determines whether the advertisement breach period is over. If the advertisement breach period ends, the processing unit sends another prompt message through the input/output interface, and the other prompt message is displayed on a display device, where the The notification message is sent by an advertisement breach judging device, and the advertisement breach judging device generates the notification message according to the at least one advertisement fingerprint, wherein the at least one advertisement fingerprint is obtained by the advertisement breach judging device. Image frames, and according to the image frames, respectively, a plurality of feature messages corresponding to the image frames are generated. An audio-visual processing device, comprising: an input/output interface; and a processing unit coupled to the input/output interface, wherein the processing unit is configured to output a playback content message by using the input/output interface, and by using the input The output interface receives a notification message, wherein the notification message is used to indicate whether a play time of a play content corresponding to the play content message is in an advertisement break period, wherein the advertisement break period is at least one played in the play content. At least one time interval of the advertisement, the processing unit determines whether the playback content is in a sequential switching channel state, and if the playback content is in the sequential switching channel state, the processing unit superimposes a prompt message on the playback content. The audio-visual processing device of claim 33 or 35, comprising: The input/output interface receives a selection operation corresponding to the prompt message, and the processing unit superimposes a message corresponding to the prompt message on the play content according to the selection operation.