CN106203300A - Content item display packing and device - Google Patents

Abstract

The disclosure discloses a method and device for displaying content items, which belong to the technical field of the Internet. The content item display method includes: identifying predetermined feature points in the video image; determining the position of the identified feature point in the video image; superimposing the received content item on the position for display. By identifying the feature points in the video image, superimposing the received content items on the position of the feature points for display, it solves the problem that the interactive form in the related technology is only a mechanical display, resulting in an excessively single interactive form, and achieves the goal based on the video image. The position of the feature point in determines the display position of the content item, so that the content item is associated with the video image, and the effect of the interactive form is enriched.

Description

Content item display method and device

technical field

The present disclosure relates to the field of Internet technologies, and in particular to a method and device for displaying content items.

Background technique

With the development of technology, people can make video calls or live video through some applications.

In a live video broadcast, the person who records the video is called the anchor, and the person who watches the video is called the audience. During the process of watching the video, the audience can have a certain form of interaction with the anchor, which may be on the interface of the application Display static pictures, or send animations that move according to a predetermined trajectory, such as sending dynamic emoticons or throwing flowers, blowing kisses, etc.

These interactive forms are usually just a mechanical display, and the interactive form is too single.

Contents of the invention

The present disclosure provides a method and device for displaying content items. Described technical scheme is as follows:

According to the first aspect of an embodiment of the present disclosure, there is provided a content item display method, the method comprising: identifying predetermined feature points in a video image; determining the position of the identified feature point in the video image; The received content item is displayed superimposed on said location. By identifying the position of the feature point in the video image, using the position of the feature point to determine the display position of the content item, it solves the technical problem in the related art that the interaction form is single due to only mechanical display, and achieves the integration of the content item and the video image. Correlation, enriching the effect of interactive forms.

Optionally, the superimposing the received content item on the position for display includes: when the position of the feature point changes, moving the content item, at the specified point of the content item and the Stop moving the content item after the changed positions of the feature points coincide. By moving the specified point of the content item until it coincides with the position of the feature point when the position of the feature point changes, the content item can be kept consistent with the position of the feature point of the video and adjusted in real time.

Optionally, the method further includes: obtaining in real time the direction of gravity of the terminal device playing the video image; determining the display direction of the content item in real time according to the direction of gravity, so that the display direction of the content item conforms to the Gravity direction. By obtaining the gravity direction of the terminal device in real time and adjusting the display direction of the content item according to the gravity direction, when the terminal device rotates, the video image will also be rotated accordingly, so that the content item can also be adjusted in the corresponding direction, and can be displayed according to the predetermined effect in the video image.

Optionally, the identifying predetermined feature points in the video image includes: identifying a face area in the video image; identifying predetermined feature points in the face area, and the predetermined feature The points include the center point of the face area. By identifying the center point of the face area in the video image, the center point of the face area is used as the feature point when the content item is displayed.

Optionally, the method further includes: obtaining the size of the face area in real time; adjusting the size of the content item in real time according to a predetermined ratio between the size of the face area and the size of the content item, so that the person The size of the face area and the adjusted size of the content item conform to the predetermined ratio. By adjusting the size of the content item according to a predetermined ratio between the size of the face area and the size of the content item, when the size of the face area changes, the size of the content item is adjusted to match the size of the face area.

Optionally, the method further includes: accumulating the display duration of the content item; and clearing the displayed content item when the display duration of the content item reaches a predetermined duration threshold. By setting the display duration of each content item and clearing the content items reaching the predetermined duration, one content item will not be continuously displayed on the video image, and other content items can also have a chance to be displayed.

According to a second aspect of an embodiment of the present disclosure, there is provided a content item display device, the device comprising: an identification module configured to identify predetermined feature points in a video image; a first determination module configured to determine the The position of the feature point identified by the identification module in the video image; the display module configured to superimpose the received content item on the position determined by the first determination module for display.

Optionally, the display module is further configured to move the content item when the position of the feature point changes, and stop moving when the specified point of the content item coincides with the changed position of the feature point said content item.

Optionally, the apparatus further includes: a first obtaining module configured to obtain in real time the direction of gravity of the terminal device playing the video image; a second determining module configured to obtain the gravity direction according to the first obtaining module The direction of gravity determines the display direction of the content item in real time, so that the display direction of the content item conforms to the direction of gravity.

Optionally, the recognition module includes: a first recognition submodule configured to recognize a human face area in the video image; a second recognition submodule configured to recognize A predetermined feature point is identified in the detected face area, and the predetermined feature point includes a center point of the face area.

Optionally, the device further includes: a second acquisition module configured to acquire the size of the face area in real time; an adjustment module configured to obtain the size according to a predetermined ratio between the size of the face area and the size of the content , adjusting the size of the content item in real time, so that the size of the face area and the adjusted size of the content item conform to the predetermined ratio.

Optionally, the device further includes: an accumulating module, configured to accumulate the display duration of the content item; a clearing module, configured to, when the display duration of the content item accumulated by the accumulating module reaches a predetermined duration threshold to clear the display of said content item.

According to a third aspect of an embodiment of the present disclosure, there is provided a content item display device, the device comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to: Identifying predetermined feature points in the video image; determining the position of the identified feature point in the video image; superimposing the received content item on the position for display.

It is to be understood that both the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.

Fig. 1 is a flowchart of a method for displaying content items according to an exemplary embodiment;

Fig. 2A is a flowchart of a method for displaying content items according to another exemplary embodiment;

Fig. 2B is a flow chart of identifying predetermined feature points in a video image according to an exemplary embodiment;

Fig. 2C is a schematic diagram of the direction of gravity in a vertically placed position of a terminal device according to an exemplary embodiment;

Fig. 2D is a schematic diagram of the direction of gravity after the terminal device is rotated 90 degrees from the vertical placement position according to an exemplary embodiment;

Fig. 3 is a block diagram of a content item display device according to an exemplary embodiment;

Fig. 4 is a block diagram of a content item display device according to another exemplary embodiment;

Fig. 5 is a block diagram of an apparatus for displaying content items according to an exemplary embodiment;

Fig. 6 is a block diagram of an apparatus for displaying content items according to another exemplary embodiment.

detailed description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present disclosure as recited in the appended claims.

Fig. 1 is a flow chart showing a method for displaying a content item according to an exemplary embodiment. The method for displaying a content item can be applied to a terminal device that generates a video image, and can also be applied to a terminal device that receives a video image. Can be applied to the server. The terminal devices mentioned here include smart phones, tablet computers, multimedia playback devices, and the like. The server mentioned here can be one server or a collection of multiple servers, and information can be shared between multiple servers. As shown in FIG. 1 , the method for displaying content items may include the following steps.

In step 110, predetermined feature points in the video image are identified.

In step 120, the positions of the identified feature points in the video image are determined.

In step 130, the received content item is superimposed on the position for display.

Optionally, when the method for displaying content items is applied to a terminal device receiving video images, a video image is received and played on the terminal device, feature points in the video image are determined, and content items to be displayed are superimposed on the feature points location is displayed.

Optionally, when the method for displaying content items is applied to a terminal device that generates video images, and the user wishes to add some effects to the video image after recording a video image, he may choose to add the content item to the video image for superimposed display.

Optionally, when the method for displaying content items is applied to the server, the server superimposes the acquired video image and the content item according to the method, and sends the superimposed video image to the terminal device that needs to be played.

In a possible implementation manner, multiple terminal devices share the video image data transmitted by the server, and one terminal device can select the content item to be displayed, and send the display request of the content item to the server, and the server will display the content item according to the display request. Content items and video images are superimposed according to this method, and the superimposed video images are sent to each terminal device for playback and display.

In summary, the content item display method provided by the embodiment of the present disclosure, by identifying the position of the feature point in the video image, using the position of the feature point to determine the position of the content item display, solves the problem of only mechanical display in the related art. The technical problem that leads to a single form of interaction achieves the effect of associating content items with video images and enriching the form of interaction.

Fig. 2A is a flow chart showing a method for displaying content items according to another exemplary embodiment. The method for displaying content items can be applied to a terminal device that generates video images, and can also be applied to a terminal device that receives video images. It can also be used in servers. The terminal devices mentioned here include smart phones, tablet computers, multimedia playback devices, and the like. The server mentioned here can be one server or a collection of multiple servers, and information can be shared between multiple servers. As shown in FIG. 2A, the method for displaying content items may include the following steps.

In step 201, predetermined feature points in a video image are identified.

In a possible implementation, the video image here may be a video image played on a live broadcast application program or a live broadcast website. This type of video image is recorded by a terminal device and synchronized to the established live broadcast room. The user of the video image is generally called the anchor. As long as the audience enters the live broadcast room, they can watch the live video synchronously. The audience can interact with the anchor through text, pictures, animations, etc.

In another possible implementation, the video image mentioned here may also be a video image when at least two parties are in a video call, and the two parties in the call may also interact through pictures and animations.

The feature points mentioned here can be the center point of the face area, or physiological feature points such as eyes, mouth, nose, etc., or collars, pockets, or other feature points that meet predetermined conditions.

In practical applications, the interaction is usually between people. Therefore, in practical applications, it is usually possible to recognize faces to increase the fun of the interaction. As shown in FIG. 2B , when identifying predetermined feature points in a video image, the following steps may be included.

In step 201a, the face area in the video image is identified.

The recognition of face area belongs to the face recognition technology that can be realized by those skilled in the art. The methods in the domain are searched to determine whether it contains a face, and if so, information such as the position and size of the face is returned; another example is to build a face model in advance, by comparing the graphics in the video image with the model, if it is If the matching degree reaches a predetermined value, it is considered that the video image contains a human face, and information such as the position and size of the human face in the video image is returned. In practical applications, other technologies can also be used for face recognition, which will not be repeated here.

In step 201b, predetermined feature points are identified in the face area.

The predetermined feature point mentioned here may be the center point of the face area, and may also be physiological feature points such as eyes, mouth, and nose.

Take the face area as an example. Generally speaking, when the face is facing the camera, the face area in the collected video image is usually a symmetrical figure, and the center point of the face area can be selected from the farthest point in the face area. The position of the midpoint of the line connecting two points.

Taking eye recognition as an example, an eye model can be established through training. When recognizing an image, the position of the human eye can be determined by comparing it with the model.

For the recognition of feature points such as faces or eyes, those skilled in the art can also use other methods, which will not be repeated here.

In step 202, the positions of the identified feature points in the video image are determined.

Since the video image is dynamically changing during video playback, the positions of the feature points in the video image may be different in different video frames. Therefore, for each frame of video image, the identified feature points can be determined first. position in the image.

In step 203, when the position of the feature point changes, the content item is moved, and the content item is stopped after the designated point of the content item coincides with the changed position of the feature point.

The content item mentioned here can be a virtual item picture designed according to a predetermined shape, such as a picture of glasses, which can be used to display the anchor’s eye position in the video image, or a beard picture, which is displayed at the position of the anchor’s mouth. It can also be a badge picture, which is displayed on the anchor's collar.

The content item may also be other types of marking information, such as text information referring to a name, micro-video, and the like.

In order to make the position of the content item always coincide with the position of the feature point, when the position of the feature point changes, the position of the content item should be adjusted accordingly until the position of the content item coincides with the position of the feature point.

In step 204, the direction of gravity of the terminal device playing the video image is acquired in real time.

Generally, a terminal device playing video images can automatically rotate the screen to adapt to the direction in which the user watches the screen of the terminal device. That is to say, when the placement direction of the terminal device changes, the direction of gravity will also change, and correspondingly, the video image will also change according to the direction of gravity.

As shown in FIG. 2C , the terminal device usually has a horizontal frame 22 and a vertical frame 21 , and the length of the vertical frame 21 is usually greater than the length of the horizontal frame 22 . When the terminal device is placed vertically, the gravity direction G of the terminal device is vertically downward, and the gravity direction G at this time is parallel to the longitudinal frame 21 of the terminal device. When the terminal device has been rotated by 90 degrees to be placed horizontally as shown in Figure 2D, the direction of gravity G' at this time is still vertically downward, but compared to the terminal device, the direction of gravity G' is perpendicular to the longitudinal frame 21 of the terminal device. Wherein, after the terminal device is rotated, the display direction of the content item 23 is correspondingly adjusted to adapt to the change of the display direction of the video image.

In step 205, the display direction of the content item is determined in real time according to the direction of gravity, so that the display direction of the content item conforms to the direction of gravity.

In order to make the user always watch a positive video image when viewing the video image facing the terminal device, the video image played in the terminal device will also be automatically adjusted to be consistent with the placement direction of the terminal device. At this time, in order to make the content item match the content of the video image, the orientation of the content item will also be adjusted accordingly.

In practical applications, if a face appears in a video image, the size of the face area in the video image will change with the distance between the face and the camera. In order to make the content items displayed in the face area consistent with the face The size of the face area matches the size of the content item. Generally, a predetermined ratio between the size of the face area and the size of the content item is set. When the size of the face area changes, in order to maintain the stability of the predetermined ratio, the size of the content item will be adjusted. Please refer to The description of step 206 to step 208 is as follows.

In step 206, the size of the face area is acquired in real time.

If you want to determine the size of the face area, you can draw a closed figure corresponding to the recognized face area, calculate the area of the closed figure, or calculate the number of pixels in the recognized face area, according to the number of pixels How much to judge the size of the face area.

In step 207, according to the predetermined ratio between the size of the face area and the size of the content item, the size of the content item is adjusted in real time, so that the size of the face area and the adjusted size of the content item meet the predetermined ratio.

A predetermined ratio needs to be set between the size of the face area and the size of the content item, so that the content item can match the size of the face area. For example, when the content item is a mask picture, the size of the face area and the size of the mask picture are 1:1, so it looks like a mask is put on the face. When the size of the face area changes due to the distance between the person and the camera, the content item is adjusted according to a predetermined ratio so that the size of the content item matches the size of the face area.

In step 208, the received content item is superimposed on the position for display.

After the above adjustments about the position, direction and size of the content item are completed, the content item is superimposed on the video image for display. During the display process, according to the change of the content of the video image, the content item needs to be adjusted in real time.

It should be noted that, in this embodiment, steps 204 to 207 are performed before step 208 . Optionally, steps 204 to 207 may also be performed after step 208 . Optionally, step 204 and step 207 may also be executed in parallel with step 208 .

In practical applications, such as in a live broadcast scene, there may be more than one viewer sending a display request for a content item, so each content item will be cleared after being displayed for a period of time to meet the interactive needs of more viewers, please refer to the following steps 209 and description of step 210.

In step 209, the display duration of the content item is accumulated.

In step 210, when the display duration of the content item reaches a predetermined duration threshold, the displayed content item is cleared.

Generally speaking, after the content item is displayed at the position of the feature point, a timer is set for the content item, and the duration of the timer is set to a predetermined duration threshold. When the timer expires, it indicates that the display duration of the content item reaches the predetermined duration threshold, and at this time, the displayed content item is cleared.

Optionally, the content item may also be timed, and when the timed display duration reaches a predetermined duration threshold, the displayed content item is cleared.

In order to keep the screen cleanness of the video image and ensure the viewing effect of the video image, the content items here can be set to prohibit simultaneous display, so that the next content item can only be displayed after one content item is cleared.

Optionally, it can also be set to display a predetermined number of content items at the same time. For the viewing effect of video images, it can be set that the content items displayed at the same time correspond to different feature point positions.

To sum up, the content item display method provided in the embodiment of the present disclosure, by identifying the position of the feature point in the video image, using the position of the feature point to determine the position of the content item display, solves the problem of only mechanical Displaying the technical problems that lead to a single form of interaction has achieved the effect of associating content items with video images and enriching the form of interaction.

In addition, when the position of the feature point changes, the specified point of the content item is moved until it coincides with the position of the feature point, so that the content item can be kept consistent with the position of the feature point of the video and adjusted in real time.

In addition, by obtaining the gravity direction of the terminal device in real time, and adjusting the display direction of the content item according to the gravity direction, when the terminal device rotates, the video image will also be rotated accordingly, so that the content item will also be adjusted in the corresponding direction, and the content item can be adjusted according to the predetermined direction. The effect is shown in the video image.

In addition, by identifying the center point of the face area in the video image, the center point of the face area is used as the feature point when the content item is displayed.

In addition, the size of the content item is adjusted according to the predetermined ratio between the size of the face area and the size of the content item, so that when the size of the face area changes, the size of the content item is adjusted to match the size of the face area.

In addition, by setting the display duration of each content item and clearing the content items reaching the predetermined duration, one content item will not be continuously displayed on the video image, and other content items can also have a chance to be displayed.

The following are device embodiments of the present disclosure, which can be used to implement the method embodiments of the present disclosure. For details not disclosed in the disclosed device embodiments, please refer to the disclosed method embodiments.

Fig. 3 is a block diagram showing an apparatus for displaying content items according to an exemplary embodiment. The apparatus for displaying content items can be applied in a terminal device that generates video images, or in a terminal device that receives video images. applied in the server. The terminal devices mentioned here include smart phones, tablet computers, multimedia playback devices, and the like. The server mentioned here can be one server or a collection of multiple servers, and information can be shared between multiple servers. As shown in FIG. 3 , the content item display device includes but not limited to: an identification module 310 , a first determination module 320 and a display module 330 .

The identification module 310 is configured to identify predetermined feature points in the video image.

The first determination module 320 is configured to determine the position of the feature point identified by the identification module 310 in the video image.

The display module 330 is configured to superimpose the received content item on the position determined by the first determination module 320 for display.

To sum up, the content item display device provided in the embodiment of the present disclosure, by identifying the position of the feature point in the video image, using the position of the feature point to determine the position of the content item display, solves the problem of only mechanical Displaying the technical problems that lead to a single form of interaction has achieved the effect of associating content items with video images and enriching the form of interaction.

Fig. 4 is a block diagram of an apparatus for displaying content items according to another exemplary embodiment. The apparatus for displaying content items can be applied in a terminal device that generates video images, or in a terminal device that receives video images. Can be applied to the server. The terminal devices mentioned here include smart phones, tablet computers, multimedia playback devices, and the like. The server mentioned here can be one server or a collection of multiple servers, and information can be shared between multiple servers. As shown in FIG. 4 , the content item display device includes but not limited to: an identification module 410 , a first determination module 420 and a display module 430 .

The identification module 410 is configured to identify predetermined feature points in the video image.

The feature points mentioned here can be the center point of the face area, or physiological feature points such as eyes, mouth, nose, etc., or collars, pockets, or other feature points that meet predetermined conditions.

The first determination module 420 is configured to determine the position of the feature point identified by the identification module 410 in the video image.

Since the video image is dynamically changing during video playback, the positions of the feature points in the video image may be different in different video frames. Therefore, for each frame of video image, the identified feature points can be determined first. position in the image.

The display module 430 is configured to superimpose the received content item on the position determined by the first determination module 420 for display.

The content item mentioned here may be a virtual item picture designed according to a predetermined shape, and may also be other types of marking information.

In practical applications, the interaction is usually between people. Therefore, in practical applications, it is usually possible to recognize faces to increase the fun of the interaction. In this case, the identification module 410 may include: a first identification submodule 411 and a second identification submodule 412 .

The first identification sub-module 411 is configured to identify the human face area in the video image.

The second recognition submodule 412 is configured to recognize predetermined feature points in the face area recognized by the first recognition submodule 411 .

The predetermined feature point mentioned here may be the center point of the face area, and may also be physiological feature points such as eyes, mouth, and nose.

Optionally, the display module 430 is further configured to move the content item when the position of the feature point changes, and stop moving the content item after the specified point of the content item coincides with the changed position of the feature point.

In order to make the position of the content item always coincide with the position of the feature point, when the position of the feature point changes, the position of the content item should be adjusted accordingly until the position of the content item coincides with the position of the feature point.

Generally, a terminal device playing video images can automatically rotate the screen to adapt to the direction in which the user watches the screen of the terminal device. That is to say, when the placement direction of the terminal device changes, the direction of gravity will also change, and correspondingly, the video image will also change according to the direction of gravity.

Correspondingly, the apparatus for displaying content items may further include: a first acquiring module 440 and a second determining module 450 .

The first obtaining module 440 is configured to obtain in real time the direction of gravity of the terminal device playing the video image.

In order to make the user always watch a positive video image when viewing the video image facing the terminal device, the video image played in the terminal device will also be automatically adjusted to be consistent with the placement direction of the terminal device. At this time, in order to make the content item match the content of the video image, the orientation of the content item will also be adjusted accordingly.

The second determination module 450 is configured to determine the display direction of the content item in real time according to the gravity direction acquired by the first acquisition module 440, so that the display direction of the content item conforms to the gravity direction.

In practical applications, if a face appears in a video image, the size of the face area in the video image will change with the distance between the face and the camera. In order to make the content items displayed in the face area consistent with the face To match the size of the area, a predetermined ratio between the size of the face area and the size of the content item is generally set. When the size of the face area changes, in order to keep the predetermined ratio stable, the size of the content item will be adjusted. Correspondingly, the device for displaying content items may further include: a second acquiring module 460 and an adjusting module 470 .

The second obtaining module 460 is configured to obtain the size of the face area in real time.

If you want to determine the size of the face area, you can draw a closed figure corresponding to the recognized face area, calculate the area of the closed figure, or calculate the number of pixels in the recognized face area, according to the number of pixels How much to judge the size of the face area.

The adjustment module 470 is configured to adjust the size of the content item in real time according to the predetermined ratio between the size of the face area and the size of the content item, so that the size of the face area and the adjusted size of the content item meet the predetermined ratio.

A predetermined ratio needs to be set between the size of the face area and the size of the content item, so that the content item can match the size of the face area. When the size of the face area changes due to the distance between the person and the camera, the content item is adjusted according to a predetermined ratio so that the size of the content item matches the size of the face area.

In practical applications, such as live broadcasting, there may be more than one viewer sending a display request for a content item, so each content item will be cleared after being displayed for a period of time, so as to meet the interaction needs of more viewers. In this case, the content item display device may further include: an accumulating module 480 and a clearing module 490 .

The accumulation module 480 is configured to accumulate the display duration of the content item.

The clearing module 490 is configured to clear the displayed content item when the display duration of the content item accumulated by the accumulating module 480 reaches a predetermined duration threshold.

Generally speaking, after the content item is displayed at the position of the feature point, a timer is set for the content item, and the duration of the timer is set to a predetermined duration threshold. When the timer expires, it indicates that the display duration of the content item reaches the predetermined duration threshold, and at this time, the displayed content item is cleared.

Optionally, the content item may also be timed, and when the timed display duration reaches a predetermined duration threshold, the displayed content item is cleared.

In order to keep the screen cleanness of the video image and ensure the viewing effect of the video image, the content items here can be set to prohibit simultaneous display, so that the next content item can only be displayed after one content item is cleared.

Optionally, it can also be set to display a predetermined number of content items at the same time. For the viewing effect of video images, it can be set that the content items displayed at the same time correspond to different feature point positions.

To sum up, the content item display device provided in the embodiment of the present disclosure, by identifying the position of the feature point in the video image, using the position of the feature point to determine the position of the content item display, solves the problem of only mechanical Displaying the technical problems that lead to a single form of interaction has achieved the effect of associating content items with video images and enriching the form of interaction.

In addition, when the position of the feature point changes, the specified point of the content item is moved until it coincides with the position of the feature point, so that the content item can be kept consistent with the position of the feature point of the video and adjusted in real time.

In addition, by obtaining the gravity direction of the terminal device in real time, and adjusting the display direction of the content item according to the gravity direction, when the terminal device rotates, the video image will also be rotated accordingly, so that the content item will also be adjusted in the corresponding direction, and the content item can be adjusted according to the predetermined direction. The effect is shown in the video image.

In addition, by identifying the center point of the face area in the video image, the center point of the face area is used as the feature point when the content item is displayed.

In addition, the size of the content item is adjusted according to the predetermined ratio between the size of the face area and the size of the content item, so that when the size of the face area changes, the size of the content item is adjusted to match the size of the face area.

In addition, by setting the display duration of each content item and clearing the content items reaching the predetermined duration, one content item will not be continuously displayed on the video image, and other content items can also have a chance to be displayed.

An exemplary embodiment of the present disclosure provides a content item display device capable of implementing the content item display method provided in the present disclosure, and the content item display device includes: a processor and a memory for storing processor-executable instructions;

where the processor is configured as:

Recognize predetermined feature points in the video image;

Determine the position of the identified feature point in the video image;

The received content item is superimposed on the position for display.

Fig. 5 is a block diagram of an apparatus for displaying content items according to an exemplary embodiment. For example, the apparatus 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.

5, apparatus 500 may include one or more of the following components: processing component 502, memory 504, power supply component 506, multimedia component 508, audio component 510, input/output (I/O) interface 512, sensor component 514, and Communication component 516 .

The processing component 502 generally controls the overall operations of the device 500, such as those associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 502 may include one or more processors 518 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 502 may include one or more modules that facilitate interaction between processing component 502 and other components. For example, processing component 502 may include a multimedia module to facilitate interaction between multimedia component 508 and processing component 502 .

The memory 504 is configured to store various types of data to support operations at the device 500 . Examples of such data include instructions for any application or method operating on device 500, contact data, phonebook data, messages, pictures, videos, and the like. The memory 504 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

The power supply component 506 provides power to various components of the device 500 . Power components 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for device 500 .

The multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or a swipe action, but also detect duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 508 includes a front camera and/or a rear camera. When the device 500 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capability.

The audio component 510 is configured to output and/or input audio signals. For example, the audio component 510 includes a microphone (MIC), which is configured to receive external audio signals when the device 500 is in operation modes, such as call mode, recording mode and voice recognition mode. Received audio signals may be further stored in memory 504 or sent via communication component 516 . In some embodiments, the audio component 510 also includes a speaker for outputting audio signals.

The I/O interface 512 provides an interface between the processing component 502 and a peripheral interface module. The peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: a home button, volume buttons, start button, and lock button.

Sensor assembly 514 includes one or more sensors for providing status assessments of various aspects of device 500 . For example, the sensor component 514 can detect the open/closed state of the device 500, the relative positioning of components, such as the display and keypad of the device 500, the sensor component 514 can also detect a change in the position of the device 500 or a component of the device 500, the user Presence or absence of contact with device 500 , device 500 orientation or acceleration/deceleration and temperature change of device 500 . Sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 514 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

The communication component 516 is configured to facilitate wired or wireless communication between the apparatus 500 and other devices. The device 500 can access wireless networks based on communication standards, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 516 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, communication component 516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, apparatus 500 may be programmed by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable Realized by a gate array (FPGA), controller, microcontroller, microprocessor or other electronic components for performing the above content item display method.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as the memory 504 including instructions, which can be executed by the processor 518 of the device 500 to implement the above content item display method. For example, the non-transitory computer readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

Fig. 6 is a block diagram of an apparatus for displaying content items according to another exemplary embodiment. For example, the apparatus 600 may be provided as a network side device. 6, apparatus 600 includes processing component 602, which further includes one or more processors, and memory resources represented by memory 604 for storing instructions executable by processing component 602, such as application programs. The application program stored in memory 604 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 602 is configured to execute instructions to perform the above content item display method.

Device 600 may also include a power component 606 configured to perform power management of device 600 , a wired or wireless network interface 608 configured to connect device 600 to a network, and an input-output (I/O) interface 610 . The apparatus 600 may operate based on an operating system stored in the memory 604, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.

Other embodiments of the present disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, and these modifications, uses or adaptations follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The specification and examples are to be considered exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It should be understood that the present disclosure is not limited to the precise constructions which have been described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (13)

1. a content item display packing, it is characterised in that described method includes:

Characteristic point predetermined in video image is identified；

Determine the characteristic point identified position in described video image；

The content item received is superimposed upon on described position and shows.

Method the most according to claim 1, it is characterised in that described the content item received is superimposed upon on described position Show, including:

When the change in location of described characteristic point, mobile described content item, in specified point and the described characteristic point of described content item Position after change stops mobile described content item after overlapping.

Method the most according to claim 1, it is characterised in that described method also includes:

Obtain the gravity direction of the terminal unit playing described video image in real time；

The display direction of described content item is determined in real time so that the display direction of described content item meets according to described gravity direction Described gravity direction.

Method the most according to claim 1, it is characterised in that described characteristic point predetermined in video image is known Not, including:

Identify the human face region in described video image；

Identifying predetermined characteristic point in described human face region, described predetermined characteristic point includes the central point of human face region.

Method the most according to claim 4, it is characterised in that described method also includes:

Obtain the size of described human face region in real time；

The predetermined ratio between size and content item size according to human face region, adjusts described content item size in real time, Described content item size after making the size of described human face region and adjusting meets described predetermined ratio.

6. according to described method arbitrary in claim 1 to 5, it is characterised in that described method also includes:

The display duration of cumulative described content item；

When the display duration of described content item reaches scheduled duration threshold value, remove the described content item of display.

7. a content item display device, it is characterised in that described device includes:

Identification module, is configured to be identified characteristic point predetermined in video image；

First determines module, is configured to determine that characteristic point that described identification module the identifies position in described video image Put；

Display module, is configured to that the content item received is superimposed upon described first and determines on the described position that module is determined Show.

Device the most according to claim 7, it is characterised in that described display module, is additionally configured to when described characteristic point Change in location time, mobile described content item, the specified point at described content item overlaps with the position after the change of described characteristic point Rear stopping moves described content item.

Device the most according to claim 7, it is characterised in that described device also includes:

First acquisition module, is configured to obtain in real time the gravity direction of the terminal unit playing described video image；

Second determines module, is configured to determine in real time according to the described gravity direction that described first acquisition module gets described The display direction of content item so that the display direction of described content item meets described gravity direction.

Device the most according to claim 7, it is characterised in that described identification module, including:

First identifies submodule, is configured to identify the human face region in described video image；

Second identifies submodule, be configured to described first identify the described human face region that recognizes of submodule identifies pre- Fixed characteristic point, described predetermined characteristic point includes the central point of human face region.

11. devices according to claim 10, it is characterised in that described device also includes:

Second acquisition module, is configured to obtain in real time the size of described human face region；

Adjusting module, is configured to the predetermined ratio between the size according to human face region and content item size, adjusts in real time Described content item size so that the described content item size after the size of described human face region and adjustment meets described predetermined Ratio.

12. according to described device arbitrary in claim 7 to 11, it is characterised in that described device also includes:

Accumulator module, is configured to the display duration of cumulative described content item；

Remove module, be configured to the display duration at the cumulative described content item of described accumulator module and reach scheduled duration threshold value Time, remove the described content item of display.

13. 1 kinds of content item display devices, it is characterised in that described device includes:

Processor；

For storing the memorizer of described processor executable；

Wherein, described processor is configured to:

Characteristic point predetermined in video image is identified；

Determine the characteristic point identified position in described video image；

The content item received is superimposed upon on described position and shows.