CN104581224B - Switch the method, apparatus and terminal of broadcasting content - Google Patents

Abstract

The application discloses a method, device and terminal for switching and playing content. A specific implementation manner of the method includes: determining whether the foreground is currently playing the content of the specified channel; whether the content is an advertisement; and in response to the content being an advertisement, switching the content to play in the background. This embodiment combines subtitle features and user behavior to identify advertisements, and intelligently switches channels according to the identification results, thereby improving the accuracy of advertisement identification and expanding product functions.

Description

Method, device and terminal for switching playback content

technical field

The present application relates to the field of computer technology, in particular to the field of digital television technology, and in particular to a method, device and terminal for switching and playing content.

Background technique

In recent years, digital TV has gradually entered thousands of households. However, when users watch TV, most channels will insert too many advertisements, and the advertisements are often played repeatedly, which affects the user experience and wastes the user's time. time. How to detect TV advertisements is becoming more and more important.

Existing advertisement recognition methods mainly focus on the matching of audio and video features and advertisement feature database and machine learning. The former mainly judges whether the current screen is an advertisement based on the match between the current audio and video features and the advertisement feature library, but it is necessary to manually enter the advertisement features of each advertisement into the advertisement video library. The principle of identifying advertisements through machine learning is: to collect advertisement feature sets for training, and use the trained classifier to classify, which makes up for the problem of manually entering advertisement features to a certain extent, but because machine learning methods rely heavily on training data, If the training samples are not typical and sufficient, the judgment results will vary greatly.

Contents of the invention

The present application provides a method, device and terminal for switching and playing content.

In a first aspect, the present application provides a method for switching content to be played, the method comprising: determining whether the foreground is currently playing content of a specified channel; if so, at least partially based on user behavior information related to the content and/or Or judge whether the content is an advertisement based on the subtitle feature information of the content; and switch the content to background play in response to the content being an advertisement.

In some implementations, the determining whether the content is an advertisement based at least in part on user behavior information related to the content and/or information on subtitle features of the content includes: obtaining information on the content of the currently designated channel related data; judging whether the related data satisfies the matching condition based on the stored reference data; if the matching condition is met, determining that the content is an advertisement.

In some preferred embodiments, the judging whether the content is an advertisement based at least in part on the user behavior information related to the content and/or the subtitle feature information of the content further includes: if the matching condition is not met Obtaining user behavior information related to the content and/or subtitle feature information of the content; judging whether the user behavior information related to the content and/or subtitle feature information of the content satisfies a predetermined condition ; determining that the content is an advertisement in response to satisfying the predetermined condition.

In some preferred embodiments, the judging whether the content is an advertisement based at least in part on user behavior information related to the content and/or subtitle feature information of the content further includes: in response to satisfying the Predetermining conditions, storing the related data as reference data.

In some preferred embodiments, the user behavior information related to the content includes: the switching ratio of multiple users switching the content played in the foreground when the content is played in the foreground; the information of the subtitle feature of the content, At least one of the following items is included: information about the size of the subtitle corresponding to the content; and information about the position of the subtitle corresponding to the content.

In some preferred implementations, the acquisition of user behavior information related to the content includes: acquisition of relevant information collected by the cloud platform on content played by users switching to the foreground; information about user behavior.

In some preferred implementations, the acquisition of the subtitle feature information of the content includes at least one of the following: extracting the subtitle feature information from the video stream corresponding to the specified channel; The image corresponding to the specified channel is processed to obtain the information of the subtitle feature.

In some preferred embodiments, the predetermined condition includes: within a predetermined period of time, when multiple users play the content in the foreground, the switching ratio of switching the content played in the foreground is greater than or equal to a predetermined switching ratio threshold; and/or within a predetermined time period During the time period, the change of the subtitle feature is greater than or equal to a predetermined feature change threshold.

In some preferred embodiments, the method further includes: if the background is currently playing the content of the specified channel, in response to the fact that the content is not an advertisement, switching the content back to the foreground to play.

In some preferred implementation manners, the method further includes: when switching the content to play in the background, playing the predetermined content in the foreground.

In some preferred embodiments, the predetermined content includes at least one of the following: the content of a channel pre-selected by the user; the content of a channel selected according to predetermined rules from a plurality of channels pre-selected by the user; audio or video files.

In some preferred embodiments, the matching condition includes: there is reference data matching the relevant data in the stored reference data.

In some preferred embodiments, the reference data that matches the related data includes: reference data whose similarity with the related data is greater than or equal to a predetermined similarity threshold.

In some preferred embodiments, the relevant data includes at least one of the following: image characteristic data; and audio characteristic data.

In some preferred embodiments, the acquisition of relevant data of the content of the currently designated channel includes at least one of the following: acquiring the image feature data based on accelerated robust feature extraction; The feature extraction obtains the audio feature data.

In a second aspect, the present application provides a device for switching playing content, the device comprising: a determining unit, used to determine whether the foreground is currently playing the content of a specified channel; a judging unit, used in the determining unit to determine whether the foreground is currently playing When the content of the specified channel is being played, it is determined whether the content is an advertisement based at least in part on information about user behavior related to the content and/or information on subtitle features of the content; the switching unit is configured to respond to the determination The unit determines that the content is an advertisement, and switches the content to play in the background.

In some embodiments, the judging unit includes: a related data acquiring subunit, configured to acquire related data of the content of the currently designated channel; a matching subunit, configured to determine whether the related data acquiring subunit is based on stored reference data. Whether the relevant data obtained by the unit satisfies the matching condition; the advertisement determination subunit is configured to determine that the content is an advertisement when the matching subunit judges that the relevant data meets the matching condition.

In some preferred embodiments, the judging unit further includes a related information acquiring subunit and a condition judging subunit; the related information acquiring subunit is configured to, when the matching subunit judges that the related data does not satisfy the matching condition, Acquiring user behavior information related to the content and/or subtitle feature information of the content; a condition judgment subunit, configured to judge the user behavior information related to the content obtained by the relevant information acquisition subunit And/or whether the subtitle feature information of the content satisfies a predetermined condition; the advertisement determining subunit is further configured to determine that the content is an advertisement in response to the condition judging subunit judging that the predetermined condition is satisfied.

In some preferred embodiments, the judging unit further includes: a storage subunit, configured to store the relevant data as reference data in response to the condition judging subunit judging that the predetermined condition is met.

In some preferred embodiments, the user behavior information related to the content includes: the switching ratio of multiple users switching the content played in the foreground when the content is played in the foreground; the information of the subtitle feature of the content, At least one of the following items is included: information about the size of the subtitle corresponding to the content; and information about the position of the subtitle corresponding to the content.

In some preferred embodiments, the relevant information acquisition subunit is configured to: obtain relevant information collected by the cloud platform on the content played by the user switching to the foreground; determine user behavior information related to the content based on the relevant information .

In some preferred embodiments, the relevant information acquisition subunit is further configured to: extract the subtitle feature information from the video stream corresponding to the designated channel; Processing is performed to obtain the information of the subtitle feature.

In some preferred embodiments, the predetermined condition includes: within a predetermined period of time, when multiple users play the content in the foreground, the switching ratio of switching the content played in the foreground is greater than or equal to a predetermined switching ratio threshold; and/or within a predetermined time period During the time period, the change of the subtitle feature is greater than or equal to a predetermined feature change threshold.

In some preferred embodiments, the switching unit is further configured to switch the content in response to the judging unit judging that the content is not an advertisement when the determining unit determines that the content of the specified channel is currently being played in the background. Return to the foreground to play.

In a third aspect, the present application provides a terminal, including: a user interface and a processor; wherein the user interface is used for the user to interact with the terminal, and the processor is based on the user interacting with the terminal through the user interface The interaction performed by the terminal to determine the specified channel, and determine whether the foreground is currently playing the content of the specified channel, and if so, at least partly based on the user behavior information related to the content and/or the subtitle feature information of the content. Whether the content is an advertisement, and in response to the content being an advertisement, switching the content to play in the background.

The method, device and terminal for switching playback content provided by this application identify advertisements by combining subtitle features and user behaviors, and intelligently switch channels based on the recognition results, thereby improving the accuracy of advertisement recognition and expanding product functions. .

Description of drawings

Other characteristics, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

Fig. 1 is a flow chart of an embodiment of the method for switching playback content provided by the present application;

FIG. 2 is a flow chart of an embodiment of a method for judging whether the content of a currently designated channel is an advertisement provided by an embodiment of the present application;

FIG. 3 is a flow chart of an embodiment of a method for obtaining user behavior information related to the content of the currently designated channel provided by the embodiment of the present application;

FIG. 4 is a schematic structural diagram of an embodiment of a device for switching and playing content provided by the present application;

Fig. 5 is a schematic structural diagram of an embodiment of a terminal for switching and playing content provided by the present application.

Detailed ways

The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, rather than to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

The method for switching playing content of the present application can be applied to various terminals, and these terminals have screens for displaying image content. For example description purposes and for the sake of brevity, in the ensuing discussion, exemplary embodiments of the present application are described in conjunction with a terminal capable of playing video programs. Terminals may include, but are not limited to, smart phones, tablet computers, laptop computers, desktop computers, smart TVs, Internet TV boxes connected to digital TVs, and the like.

Please refer to FIG. 1 , which shows a flow 100 of an embodiment of a method for switching playback content according to the present application.

As shown in FIG. 1 , in step 101 , it is determined whether the foreground is currently playing content of a specified channel.

In this embodiment, the specified channel includes the channel that the user wants to play on the terminal within a certain period of time including the current time. Therefore, the specified channel reflects the user's willingness to watch the broadcast content within a certain period of time including the current moment. For example, if a user wants to watch a TV series broadcast on a certain channel at 8-9 pm, the user can choose to play the content of the channel on the terminal at any time before 9 pm. When the user chooses to play the content of the channel on the terminal After that, the channel becomes the designated channel.

In this embodiment, the specified channel may include a channel directly selected by the user, for example, a channel directly selected by the user to be played by using a remote control, a mouse, or a keyboard at any time. The specified channel can also include a preset channel that is automatically played within a certain time period. For example, if the user wants to watch a certain variety show broadcast on a certain channel at 9 o'clock in the evening, the user can pre-set the timing of the terminal so that the terminal will play at night. At 9 o'clock, the channel will be automatically switched to this channel. This application does not limit the selection method of the specified channel.

Next, if it is determined that the foreground is currently playing the content of the specified channel, in step 102, it is determined whether the content is an advertisement based at least in part on information about user behavior related to the content and/or information on subtitle features of the content.

In an implementation of this embodiment, it may be determined whether the above content is an advertisement based only on the user behavior information related to the above content and/or the subtitle feature information of the above content. In another implementation, it is also possible to first use other methods to determine whether the above content is an advertisement, and if the result cannot be determined, then judge the above content based on the information of user behavior related to the above content and/or the information of the subtitle characteristics of the above content. Whether the content is an advertisement. In yet another implementation, other methods may also be combined to simultaneously determine whether the above content is an advertisement based on information about user behavior related to the above content and/or information about subtitle features of the above content. It can be understood that there may also be other methods of judging whether the above content is an advertisement based at least in part on user behavior information related to the above content and/or information on subtitle features of the above content, and this application is not limited in this regard.

In this embodiment, the user behavior information related to the content of the specified channel that is currently being played includes: the switching ratio of multiple users switching the content played in the foreground when the above content is played in the foreground. Specifically, within a certain period of time, when multiple users play the above content in the foreground, the ratio of channel switching is calculated. For example, within one month, there are a total of 1,000 times of playing the above-mentioned content in the foreground of the terminals of several users, and 600 of them switch the content to be played in the foreground during the playing process, so the above-mentioned ratio of channel switching is 60%.

It should be noted that the aforementioned channel switching may be manual channel switching by the user, or automatic channel switching by the terminal, and this application is not limited to channel switching.

In this embodiment, the subtitle feature information of the content of the specified channel currently being played includes at least one of the following: information about the size of the subtitle corresponding to the above content; and information about the position of the subtitle corresponding to the above content.

Then, in step 103, in response to the above-mentioned content being an advertisement, the above-mentioned content is switched to play in the background.

In this embodiment, if the content of the specified channel currently being played by the terminal is an advertisement, the above content is switched to background play. The foreground can play any other content, for example, the foreground can randomly play the content of any channel. For another example, the foreground may also play predetermined content.

The method provided by the above embodiments of the present application recognizes advertisements by combining subtitle features and user behaviors, and intelligently switches channels according to the recognition results, thereby improving the accuracy of advertisement recognition and expanding product functions.

In a further embodiment, the predetermined content includes at least one of the following: the content of a channel pre-selected by the user; the content of a channel selected according to predetermined rules from the multiple channels pre-selected by the user; and the audio pre-selected by the user or video files.

In an implementation of this embodiment, the predetermined content may be the content of a channel pre-selected by the user. Specifically, the user can pre-select a channel (such as a music channel, etc.) according to his or her preferences, and whenever the content of the specified channel being played by the terminal is an advertisement, the content of the channel selected by the user will be played in the foreground.

In another implementation, the predetermined content may also be the content of a channel selected according to predetermined rules from multiple channels pre-selected by the user. Specifically, the user can pre-select multiple channels according to his or her preferences, and whenever the content of the specified channel being played by the terminal is an advertisement, one channel will be selected from the multiple channels to play in the foreground according to predetermined rules. Wherein, the predetermined rule may be a rule for selecting a channel arbitrarily. For example, the user can pre-set priorities for these multiple channels, and the predetermined rules can include judging whether the content of a channel in the current channels is an advertisement one by one according to the order of the priorities, and if the content of the channel is an advertisement, continue to judge Whether the content of the lower priority channel is an advertisement, and so on. If the content of the channel is not an advertisement, the channel is selected to play in the foreground. It can be understood that the predetermined rule may also be other rules for channel selection, which is not limited in this application.

In yet another implementation, the predetermined content may also be an audio or video file pre-selected by the user. The user can pre-select one or more audio files (such as a piece of music or a song, etc.) or video files (such as funny video clips, etc.), and whenever the content of the specified channel being played by the terminal is an advertisement, a file is selected in the foreground play. The above-mentioned audio or video files may be files stored locally, files found on the Internet according to a predetermined address, or files shared on other terminals, which is not limited in this application.

It can be understood that the predetermined content may also be other content, which is not limited in this application.

Further referring to FIG. 2 , it shows a flow chart 200 of an embodiment of the method for judging whether the content of the currently designated channel is an advertisement provided by the present application.

As shown in FIG. 2 , in step 201 , relevant data about the content of the currently designated channel is obtained.

In this embodiment, the relevant data may include at least one of the following: image characteristic data; and audio characteristic data. Among them, the image feature data is obtained based on the feature extraction method of accelerated robust features. The audio feature data is obtained based on the feature extraction method based on the line spectrum feature as the perceptual feature.

Next, in step 202, it is judged based on the stored reference data whether the related data satisfies the matching condition.

In this embodiment, reference data includes at least the same kind of data as related data. For example, if the relevant data includes image characteristic data, the reference data also includes at least image characteristic data for reference. Therefore, the reference data may only include image feature data for reference, or may also include other types of data (such as audio feature data) for reference in addition to image feature data for reference.

In this embodiment, the matching condition includes reference data that matches the above-mentioned related data in the stored reference data. Specifically, an advertisement content database may be established in advance, and a plurality of reference data related to advertisement contents are stored in the database. These reference data may be added manually, or may be added automatically after a certain broadcast content is recognized as an advertisement through some advertisement recognition method. It can be understood that reference data related to advertisement content can also be added to the database in other ways, which is not limited in this application.

Further, the reference data matching the above-mentioned relevant data includes reference data whose similarity with the relevant data is greater than or equal to a predetermined similarity threshold. It should be noted that when the relevant data includes at least two types of data (for example, the relevant data includes image feature data and audio feature data), it can be considered that the matching of the reference data with the above-mentioned relevant data includes: the relevant data contains at least two The similarity between the data and the corresponding type of data in the reference data is greater than or equal to the corresponding predetermined similarity threshold.

Next, in step 203a, if the matching condition is met, it is determined that the above content is an advertisement.

In this embodiment, if there is reference data matching the above-mentioned relevant data in the stored reference data related to the advertisement content, it means that the content corresponding to the above-mentioned relevant data is an advertisement.

Then, in step 203b, if the matching condition is not met, the user behavior information related to the content of the currently designated channel and/or the subtitle feature information of the content are acquired.

In this embodiment, if the matching condition is not met, it may be further determined whether the content of the currently designated channel is an advertisement in combination with information about user behavior related to the content of the currently designated channel and/or information about subtitle features of the content.

In this embodiment, the user behavior information related to the content of the currently designated channel includes: a switching ratio of multiple users switching the content played in the foreground when the above content is played in the foreground. The information about the subtitle feature of the content of the currently designated channel includes at least one of the following: information about the size of the subtitle corresponding to the above content; and information about the position of the subtitle corresponding to the above content.

Then, in step 204, it is judged whether the user behavior information related to the content of the currently designated channel and/or the subtitle feature information of the content meet a predetermined condition.

Generally speaking, for movies, TV dramas, variety shows, or news, etc., the subtitle feature changes little. For example, the position of subtitles is generally located in a predetermined area below the screen, or at the left or right edge of the screen, and the position does not change much, nor does the size of the area occupied by the subtitles change much. However, the variation of subtitle features in commercial programs is usually large, therefore, the variation of subtitle features can be used as a basis for judging whether the content being played is an advertisement.

On the other hand, usually most users do not like to watch advertisements, especially when advertisements are played intensively, a large proportion of users will switch channels. Therefore, the user behavior information related to the content of the currently designated channel can also be used as another basis for judging whether the content being played is an advertisement.

In this embodiment, if the user behavior information related to the content of the currently designated channel includes a switching ratio for multiple users to switch the content played in the foreground when the content is played in the foreground. And the information about the subtitle feature of the content of the currently designated channel includes at least one of the following: information about the size of the subtitle corresponding to the above content; and information about the position of the subtitle corresponding to the above content. Then the predetermined conditions include: within a predetermined period of time, when multiple users play the content of the specified channel in the foreground, the switching ratio of switching the foreground content is greater than or equal to the predetermined switching ratio threshold; and/or within the predetermined period of time, the subtitle feature changes greater than or equal to a predetermined feature change threshold.

It can be understood that when only judging whether the user behavior information related to the content of the currently designated channel satisfies the predetermined condition, the predetermined condition includes within a predetermined time period, when multiple users play the content of the designated channel in the foreground, the switching ratio of switching the foreground content greater than or equal to a predetermined switching ratio threshold. When it is only judged whether the subtitle feature information of the content of the currently designated channel satisfies a predetermined condition, the predetermined condition includes that within a predetermined time period, the change of the subtitle feature is greater than or equal to a predetermined feature change threshold.

When judging whether the user behavior information related to the content of the currently designated channel and the subtitle feature information of the content meet the predetermined condition, the predetermined condition may only include the predetermined condition including multiple users playing the specified channel in the foreground within a predetermined time period When the switching ratio of switching the foreground content is greater than or equal to the predetermined switching ratio threshold. The predetermined condition may also include only that within a predetermined time period, the change of the subtitle feature is greater than or equal to a predetermined feature change threshold. The predetermined condition may also include that within a predetermined period of time, when multiple users play the content of a specified channel in the foreground, the switching ratio of switching the foreground content is greater than or equal to a predetermined switching ratio threshold; equal to a predetermined feature change threshold.

It should be noted that if the subtitle feature includes more than two types of features (for example, the subtitle feature includes the size of the subtitle and the position of the subtitle). In one implementation, as long as one of the characteristic changes is greater than or equal to its corresponding predetermined characteristic change threshold, it is considered that the predetermined condition is met. In another implementation, the predetermined condition is considered to be satisfied only when all characteristic changes are greater than or equal to their corresponding predetermined characteristic change thresholds. In yet another implementation, as long as the characteristic change of the predetermined category is greater than or equal to its corresponding predetermined characteristic change threshold, the predetermined condition is considered to be satisfied. For example, assuming that the subtitle features include 6 features, it can be set that as long as the change of any 3 features is greater than or equal to its corresponding predetermined feature change threshold, the predetermined condition is considered to be met.

Finally, in step 205, in response to satisfying the aforementioned predetermined condition, it is determined that the content of the currently designated channel is an advertisement.

In this embodiment, if the user behavior information related to the content of the currently designated channel and/or the subtitle feature information of the content satisfy a predetermined condition, it is determined that the content of the currently designated channel is an advertisement.

In some optional implementation manners, judging whether the content is an advertisement based at least in part on user behavior information related to the content of the currently designated channel and/or information on subtitle features of the content, further includes responding to satisfying the above predetermined conditions, sending Data related to the content of the currently designated channel is stored as reference data.

In this embodiment, if there is no reference data matching the above-mentioned relevant data in the stored reference data related to the advertisement content, it may not mean that the content corresponding to the above-mentioned relevant data is not an advertisement, and the content may also be It is a new advertising content that has just been launched. Therefore, it is also possible to judge whether the above content is an advertisement in other ways. If it is judged by other means that the above content is an advertisement, it means that the above content may be a new advertisement content that has just been launched, and has not been stored as reference data related to the advertisement content (such as not added to the advertisement content database). At this point, the above content can be stored as reference data related to the advertisement content (for example, added to the advertisement content database).

It should be noted that the reference data related to the advertisement content can be stored on the local terminal or on the network server, and this application does not limit the storage location of the reference data.

Further referring to FIG. 3 , it shows a flow 300 of an embodiment of the method for acquiring user behavior information related to the content of the currently designated channel provided by the present application.

As shown in FIG. 3 , in step 301 , the information collected by the cloud platform about the content played by the user switching the foreground is acquired.

In this embodiment, the cloud platform related to video playback will collect information about the content played by the user in real time, that is, which channels the user played in the foreground at what time. According to the information collected by the cloud platform, it is possible to determine the relevant information of the content played by the user switching the foreground, that is, at what time the user switched the content of which channels the foreground was played.

Finally, in step 302, user behavior information related to the above content is determined based on the above relevant information.

In this embodiment, the user behavior information related to the above content can be determined according to what time period the user switches the content of which channels are played in the foreground. For example, within a predetermined period of time, when multiple users play the content of the specified channel in the foreground, the switching ratio of the content played in the foreground is switched.

In some optional implementation manners, obtaining the subtitle feature information of the content of the currently specified channel includes at least one of the following: extracting the subtitle feature information from the video stream corresponding to the specified channel; The corresponding image is processed to obtain the information of the subtitle feature.

In some optional implementation manners, the method for switching playing content provided in the present application further includes: if the background is currently playing the content of the specified channel, in response to the content not being an advertisement, switching the content back to the foreground for playing.

In this embodiment, if the content of the specified channel is an advertisement, after being switched to the background to play, the content of the specified channel is monitored in real time to determine whether the content of the specified channel is still an advertisement. When it is detected that the content of the specified channel is not an advertisement, the content of the specified channel is switched back to the foreground to play.

It should be noted that whether the content of the specified channel is an advertisement can be determined based on information about user behavior related to the content of the specified channel and/or information about subtitle features of the content of the specified channel. It is also possible to determine whether the content of the specified channel is an advertisement through other methods for identifying advertisements. It is also possible to determine whether the content of the designated channel is a advertise. It can be understood that in this embodiment, it may be determined in any manner whether the content of the specified channel is an advertisement, and this application is not limited in this regard.

It should be noted that, although operations of the methods of the present invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in that particular order, or that all illustrated operations must be performed to achieve the desired results. . Conversely, the steps depicted in the flowcharts may be performed in an altered order. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution.

Further refer to FIG. 4 , which shows a schematic structural diagram of an embodiment of an apparatus for switching playback content according to the present application.

As shown in FIG. 4 , the apparatus 400 of this embodiment includes: a determining unit 401 , a judging unit 402 and a switching unit 403 . Wherein, the determining unit 401 is configured to determine whether the foreground is currently playing the content of the specified channel. The judging unit 402 is configured to determine, at least in part, based on user behavior information related to the content of the currently playing designated channel and/or information on subtitle features of the content when the determining unit 401 determines that the content of the specified channel is currently being played in the foreground. Whether the content is an advertisement. The switching unit 403 is configured to switch the content to be played in the background in response to the judging unit 402 judging that the content is an advertisement.

In some optional implementation manners, the judgment unit 402 includes: a relevant data acquisition subunit, a matching subunit and an advertisement determination subunit (not shown). Wherein, the relevant data obtaining subunit is used for obtaining relevant data of the content of the currently designated channel. The matching subunit is used for judging whether the above-mentioned related data obtained by the above-mentioned related data obtaining sub-unit satisfies the matching condition based on the stored reference data. The advertisement determination subunit is configured to determine that the above content is an advertisement when the matching subunit judges that the above relevant data meets the matching condition.

In some optional implementation manners, the judging unit 402 further includes: a relevant information acquiring subunit and a condition judging subunit. Wherein, the relevant information obtaining subunit is used to obtain user behavior information related to the content of the specified channel currently being played and/or subtitle feature information of the content when the matching subunit judges that the above relevant data does not meet the matching condition. The condition judging subunit is configured to judge whether the user behavior information related to the content and/or the subtitle feature information of the content obtained by the relevant information obtaining subunit satisfy a predetermined condition. The advertisement determining subunit is further configured to determine that the above content is an advertisement in response to the condition judging subunit judging that the above predetermined condition is met.

In some optional implementation manners, the judging unit 402 further includes: a storage subunit, configured to store the above related data as reference data in response to the condition judging subunit judging that the above predetermined condition is met.

In some optional implementations, the user behavior information related to the content of the specified channel currently being played includes: the switching ratio of multiple users switching the content played in the foreground when the content is played in the foreground; information about the subtitle characteristics of the content , including at least one of the following: information about the size of the subtitle corresponding to the above content; and information about the position of the subtitle corresponding to the above content.

In some optional implementation manners, the relevant information obtaining subunit is configured to: obtain relevant information collected by the cloud platform on the content played by the user switching to the foreground; and determine user behavior information related to the above content based on the relevant information.

In some optional implementation manners, the relevant information acquisition subunit is further configured to: extract the subtitle feature information from the video stream corresponding to the specified channel; and process the image corresponding to the specified channel by using an edge algorithm to obtain Get information about its subtitle characteristics.

In some optional implementations, the aforementioned predetermined conditions include: within a predetermined time period, the change of subtitle characteristics is greater than or equal to a predetermined characteristic change threshold; and/or within a predetermined time period, multiple users switch when playing the above content in the foreground The switching ratio of the content played in the foreground is greater than or equal to a predetermined switching ratio threshold.

In some optional implementation manners, the switching unit 403 is further configured to, when the determining unit 401 determines that the content of the specified channel is currently being played in the background, in response to the judging unit 402 judging that the content of the specified channel currently being played is not an advertisement, the content Switch back to foreground playback.

It should be understood that the units or modules recorded in the device 400 correspond to the steps in the method described with reference to FIGS. 1-3 . Therefore, the operations and features described above for the method are also applicable to the device 400 and the units contained therein, and will not be repeated here. The device 400 can be pre-set in the terminal, and can also be loaded into the terminal by means of downloading or the like. Corresponding units in the apparatus 400 may cooperate with units in the terminal to implement a content sharing solution.

Further refer to FIG. 5 , which shows a schematic structural diagram of an embodiment of a terminal according to the present application. It can be understood that the terminal includes, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart TV, an Internet TV box connected to a digital TV, and the like.

As shown in Figure 5, the terminal 500 of this embodiment includes: at least one processor 501, such as CPU (Central Processing Unit, central processing unit), at least one communication interface 502, at least one user interface 503, memory 504, at least one communication bus 505. The communication bus 505 is used to realize connection and communication among the above-mentioned components. The terminal 500 optionally includes a user interface 503, such as a display component, a keyboard or a pointing device (for example, a mouse, a trackball (trackball), a touch-sensitive panel or a touch-sensitive display screen, a remote controller) and the like. The memory 504 may include a high-speed RAM (Random Access Memory, random access memory), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 504 may optionally include at least one storage device located away from the aforementioned processor 501 .

In some implementations, the memory 504 stores the following elements, executable modules or data structures, or their subsets, or their extended sets:

The operating system 514 includes various system programs for implementing various basic services and processing hardware-based tasks.

The application program 524 includes various application programs for realizing various application services.

Specifically, the application program 524 may include, but is not limited to:

A determining unit is used to determine whether the foreground is currently playing the content of the specified channel;

A judging unit, configured to, when the determining unit determines that the content of a designated channel is currently being played in the foreground, at least partially based on information about user behavior related to the content and/or information about subtitle features of the content to determine whether the content is for advertising;

A switching unit, configured to switch the content to play in the background in response to the judging unit judging that the content is an advertisement.

Further, the judging unit includes: a related data acquiring subunit, configured to acquire related data of the content of the currently designated channel;

a matching subunit, configured to judge whether the related data acquired by the related data acquiring subunit satisfies a matching condition based on the stored reference data;

The advertisement determination subunit is configured to determine that the content is an advertisement when the matching subunit judges that the relevant data satisfies a matching condition.

Further, the judging unit further includes a related information acquiring subunit and a condition judging subunit; a related information acquiring subunit is used to acquire the information related to the content when the matching subunit judges that the related data does not meet the matching condition. Information about relevant user behavior and/or subtitle features of the content;

A condition judging subunit, configured to judge whether the user behavior information related to the content and/or the subtitle feature information of the content obtained by the related information acquisition subunit meet a predetermined condition;

The advertisement determining subunit is further configured to determine that the content is an advertisement in response to the condition judging subunit judging that the predetermined condition is met.

Further, the judging unit further includes: a storage subunit, configured to store the relevant data as reference data in response to the condition judging subunit judging that the predetermined condition is met.

Further, the user behavior information related to the content includes: when multiple users play the content in the foreground, switch the switching ratio of the content played in the foreground;

Information about subtitle features of the content, including at least one of the following:

Information about the size of subtitles corresponding to the content; and

Information about the position of the subtitle corresponding to the content.

Further, the related information acquisition subunit is configured to: acquire the related information collected by the cloud platform about the content played by the user switching the foreground;

Information on user behavior related to the content is determined based on the related information.

Further, the relevant information obtaining subunit is further configured to: extract the subtitle feature information from the video stream corresponding to the specified channel; and

The edge algorithm is used to process the image corresponding to the specified channel to obtain the information of the subtitle feature.

Further, the predetermined condition includes: within a predetermined time period, the change of the subtitle feature is greater than or equal to a predetermined feature change threshold; and/or

During the predetermined period of time, when multiple users play the content in the foreground, the switching ratio of switching the content played in the foreground is greater than or equal to a predetermined switching ratio threshold.

Further, the switching unit is further configured to switch the content back to the foreground to play in response to the judging unit judging that the content is not an advertisement when the determining unit determines that the content of the specified channel is currently being played in the background.

In this embodiment, the processor 501 executes corresponding steps by calling programs or instructions stored in the memory 504 . Specifically, the user interface is used for the user to interact with the terminal, and the processor determines the specified channel based on the interaction between the user and the terminal through the user interface, and determines whether the foreground is currently playing the specified channel. content, if yes, judging whether the content is an advertisement based at least in part on information about user behavior related to the content and/or information about subtitle features of the content, and switching the content in response to the content being an advertisement to play in the background.

The unit modules involved in the embodiments described in the present application may be implemented by means of software, or may be implemented by means of hardware. The described unit modules can also be set in the processor. For example, it can be described as: a processor includes an operation interface unit, a selection unit, a location parameter acquisition unit, a shared content determination unit, and a shared content sending unit. Wherein, the names of these unit modules do not constitute a limitation on the unit module itself under certain circumstances, for example, the operation interface unit may also be described as "a unit for providing an operation interface for users to select a shared area".

As another aspect, the present application also provides a computer-readable storage medium, which may be the computer-readable storage medium contained in the device described in the above-mentioned embodiments; A computer-readable storage medium assembled in a terminal. The computer-readable storage medium stores one or more programs, and the programs are used by one or more processors to execute the method for switching playback content described in this application.

The above description is only a preferred embodiment of the present application and an illustration of the applied technical principle. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solution formed by the specific combination of the above-mentioned technical features, but should also cover the technical solution formed by the above-mentioned technical features without departing from the inventive concept. Other technical solutions formed by any combination of or equivalent features thereof. For example, a technical solution formed by replacing the above-mentioned features with technical features with similar functions disclosed in (but not limited to) this application.

Claims (25)

1. A kind of 1. method for switching broadcasting content, which is characterized in that the described method includes：

   Determine whether foreground is currently playing the content of specified channel；

   If so, it is at least partially based on the subtitles appearances with the information of the relevant user behavior of the content and/or the content Information judge whether the content is advertisement；And

   It is advertisement in response to the content, the content is switched to backstage plays；

   Wherein, the information with the relevant user behavior of the content, including：Multiple users are when foreground plays the content Switch the switching ratio of foreground broadcasting content.
2. 2. according to the method described in claim 1, it is characterized in that, described be at least partially based on and the relevant user of the content The information of the subtitles appearances of the information of behavior and/or the content judges whether the content is advertisement, including：

   Obtain the related data of the content of currently assigned channel；

   Judge whether the related data meets matching condition based on stored reference data；

   If meeting matching condition, it is advertisement to determine the content.
3. 3. according to the method described in claim 2, it is characterized in that, described be at least partially based on and the relevant user of the content The information of the subtitles appearances of the information of behavior and/or the content judges whether the content is advertisement, further includes：

   If not meeting matching condition, obtain and the information of the relevant user behavior of the content and/or the subtitle of the content The information of feature；

   Judge whether to meet with the information of the subtitles appearances of the information and/or content of the relevant user behavior of the content pre- Fixed condition；

   In response to meeting the predetermined condition, it is advertisement to determine the content.
4. 4. according to the method described in claim 3, it is characterized in that, described be at least partially based on and the relevant user of the content The information of the subtitles appearances of the information of behavior and/or the content judges whether the content is advertisement, further includes：

   In response to meeting the predetermined condition, the related data is stored as reference data.
5. 5. according to the method described in claim 3, it is characterized in that,

   The information of the subtitles appearances of the content, including at least one of following：

   The information of the size of the corresponding subtitle of the content；And

   The information of the position of the corresponding subtitle of the content.
6. 6. according to the method described in claim 3, it is characterized in that, the acquisition and the letter of the relevant user behavior of the content Breath, including：

   Obtain the relevant information that the user that cloud platform collects switches foreground broadcasting content；

   Information with the relevant user behavior of the content is determined based on the relevant information.
7. 7. according to the method described in claim 5, it is characterized in that, the information of the subtitles appearances for obtaining the content, bag It includes at least one of following：

   The information of the subtitles appearances is extracted from video flowing corresponding with the specified channel；And

   It is handled using edge algorithms pair image corresponding with specified channel, to obtain the information of the subtitles appearances.
8. 8. according to the method described in claim 3, it is characterized in that, the predetermined condition includes：

   Within a predetermined period of time, multiple users switching ratio of switching foreground broadcasting content when foreground plays the content is more than Equal to predetermined switching rate threshold；And/or

   Within a predetermined period of time, the variation of subtitles appearances is more than or equal to predetermined changing features threshold value.
9. 9. according to the method described in claim 1, it is characterized in that, the method further includes：

   If the content of specified channel is currently played in backstage, it is not advertisement in response to the content, the content is switched Foreground is gone back to play.
10. 10. according to the method described in claim 1, it is characterized in that, the method further includes：

    It is played when the content is switched to backstage, predetermined content is played on the foreground.
11. 11. according to the method described in claim 10, it is characterized in that, the predetermined content is including at least one of following：

    The content for the channel that user is pre-selected；

    The content for the channel chosen in the multiple channels being pre-selected from user according to pre-defined rule；

    The audio or video file that user is pre-selected.
12. 12. according to the method described in claim 2, it is characterized in that, the matching condition includes：In stored reference data It is middle to there is the reference data to match with the related data.
13. 13. according to the method for claim 12, which is characterized in that the reference data to match with the related data Including：

    It is more than or equal to the reference data of predetermined similarity threshold with the similarity of the related data.
14. 14. according to the method for claim 13, which is characterized in that the related data includes at least one of following：

    Image feature data；And

    Audio characteristic data.
15. 15. according to the method for claim 14, which is characterized in that the dependency number of the content for obtaining currently assigned channel According to including at least one of following：

    Described image characteristic is obtained based on the feature extraction of robust features is accelerated；And

    The audio characteristic data is obtained based on the feature extraction using line spectrum feature as basic Perception Features.
16. 16. a kind of device for switching broadcasting content, which is characterized in that described device includes：

    Determination unit, for determining whether foreground is currently playing the content of specified channel；

    Judging unit, for when the determination unit determines that the content of specified channel is currently played in foreground, at least partly The information of subtitles appearances based on information and/or the content with the relevant user behavior of the content judges that the content is No is advertisement；

    The content for judging the content in response to the judging unit for advertisement, is switched to backstage and broadcast by switch unit It puts；

    Wherein, the information with the relevant user behavior of the content, including：Multiple users are when foreground plays the content Switch the switching ratio of foreground broadcasting content.
17. 17. device according to claim 16, which is characterized in that the judging unit includes：

    Related data obtains subelement, for obtaining the related data of the content of currently assigned channel；

    Coupling subelement, for judging that the related data obtains the phase that subelement obtains based on stored reference data Close whether data meet matching condition；

    Advertisement determination subelement, for when the coupling subelement judges that the related data meets matching condition, determining institute Content is stated as advertisement.
18. 18. device according to claim 17, which is characterized in that the judging unit further includes relevant information and obtains son list Member and condition judgment subelement；

    Relevant information obtains subelement, for when the coupling subelement judges that the related data does not meet matching condition, Obtain the information with the information of the relevant user behavior of the content and/or the subtitles appearances of the content；

    Condition judgment subelement, for judging that the relevant information obtains that subelement obtains and the relevant user's row of the content For information and/or the information of subtitles appearances of the content whether meet predetermined condition；

    Advertisement determination subelement is additionally operable to meet the predetermined condition in response to condition judgment subelement judgement, determines institute Content is stated as advertisement.
19. 19. device according to claim 18, which is characterized in that the judging unit further includes：

    Storing sub-units, for meeting the predetermined condition in response to condition judgment subelement judgement, by the dependency number According to being stored as reference data.
20. 20. device according to claim 18, which is characterized in that

    The information of the subtitles appearances of the content, including at least one of following：

    The information of the size of the corresponding subtitle of the content；And

    The information of the position of the corresponding subtitle of the content.
21. 21. device according to claim 16, which is characterized in that the relevant information obtains subelement and is configured to：

    Obtain the relevant information that the user that cloud platform collects switches foreground broadcasting content；

    Information with the relevant user behavior of the content is determined based on the relevant information.
22. 22. device according to claim 20, which is characterized in that the relevant information obtains subelement and is also configured to：

    The information of the subtitles appearances is extracted from video flowing corresponding with the specified channel；And

    It is handled using edge algorithms pair image corresponding with specified channel, to obtain the information of the subtitles appearances.
23. 23. device according to claim 18, which is characterized in that the predetermined condition includes：

    Within a predetermined period of time, multiple users switching ratio of switching foreground broadcasting content when foreground plays the content is more than Equal to predetermined switching rate threshold；And/or

    Within a predetermined period of time, the variation of subtitles appearances is more than or equal to predetermined changing features threshold value.
24. 24. device according to claim 16, which is characterized in that the switch unit is additionally operable to true in the determination unit When determining the content of specified channel is currently played from the background, the content is judged not for advertisement in response to the judging unit, it will The content switches back into foreground broadcasting.
25. 25. a kind of terminal, which is characterized in that including：User interface, processor；

    Wherein, the user interface interacts for user with the terminal, and the processor passes through the use based on user The interaction that family interface and the terminal carry out determines specified channel, and determines whether foreground is currently playing specified channel Content, if so, being at least partially based on the subtitles appearances with the information of the relevant user behavior of the content and/or the content Information judge whether the content is advertisement, in response to the content be advertisement, by the content switch to backstage play；

    Wherein, the information with the relevant user behavior of the content, including：Multiple users are when foreground plays the content Switch the switching ratio of foreground broadcasting content.