WO2019206077A1 - Video call processing method and mobile terminal - Google Patents

Abstract

Provided are a video call processing method and a mobile terminal. The method comprises: determining a target object to be monitored by a first mobile terminal during a video call; carrying out object identification on a first image, wherein the first image is an image collected by the first mobile terminal by means of a camera during the video call; and outputting prompt information where the first image does not comprise the target object.

Description

Video call processing method and mobile terminal

Cross-reference to related applications

The present application claims priority to Chinese Patent Application No. 20181036788, filed on Jan. 23, 2011, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present disclosure relates to the field of mobile terminal technologies, and in particular, to a video call processing method and a mobile terminal.

Background technique

With the continuous development of electronic information technology, the functions of mobile terminals (such as smart phones, tablet computers, etc.) are becoming more and more powerful. Currently, mobile terminals usually have cameras, and video calls have gradually become one of the main ways for people to communicate. Even if they are separated by a thousand miles, both parties can see objects of interest (such as people or objects) through video calls, which can effectively narrow the sense of distance between the two parties.

However, due to the portability of the mobile terminal, the mobile terminal is often easily moved, so that the camera of the mobile terminal is not aimed at the target object (for example, a person or object that the caller is interested in). In addition, since the human body also moves frequently, the above situation is likely to occur even if the mobile terminal is not moved. It can be seen that during the video call, the target object is not easily in the video picture, which affects the quality of the video call.

Summary of the invention

The embodiment of the present disclosure provides a video call processing method and a mobile terminal, to solve the problem that the target object is not in the video picture and affects the quality of the video call during the related video call.

In order to solve the above technical problems, the present disclosure is implemented as follows:

In a first aspect, an embodiment of the present disclosure provides a video call processing method, which is applied to a first mobile terminal, where the method includes:

Determining a target object to be monitored by the first mobile terminal during a video call;

Performing object recognition on the first image, where the first image is an image collected by the first mobile terminal through a camera during a video call;

In the case where the target object is not included in the first image, the prompt information is output.

In a second aspect, an embodiment of the present disclosure provides a video call processing method, which is applied to a second mobile terminal, where the method includes:

Identifying and displaying an outline of an object in the received video picture during the video call between the second mobile terminal and the first mobile terminal;

Receiving a second input for selecting a target profile;

Determining an object in the target contour as a second object in response to the second input;

And transmitting, to the first mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object.

In a third aspect, an embodiment of the present disclosure provides a mobile terminal, where the mobile terminal is a first mobile terminal, and the first mobile terminal includes:

a first determining module, configured to determine a target object to be monitored by the first mobile terminal during a video call;

a first identification module, configured to perform object recognition on the first image, where the first image is an image collected by the first mobile terminal through a camera during a video call;

And a prompting module, configured to output prompt information if the target object is not included in the first image.

In a fourth aspect, an embodiment of the present disclosure provides a mobile terminal, where the mobile terminal is a second mobile terminal, and the second mobile terminal includes:

a second identification module, configured to identify and display an outline of an object in the received video picture during the video call between the second mobile terminal and the first mobile terminal;

a receiving module, configured to receive a second input for selecting a target contour;

a second determining module, configured to determine an object in the target contour as a second object in response to the second input;

And a sending module, configured to send, to the first mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object.

In a fifth aspect, an embodiment of the present disclosure provides another mobile terminal, including a processor, a memory, a computer program stored on the memory and executable on the processor, the computer program being the processor The steps of the above video call processing method are implemented at the time of execution.

In a sixth aspect, an embodiment of the present disclosure provides a computer readable storage medium, where the computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the video call processing method are implemented.

In the embodiment of the present disclosure, the video call processing method determines a target object to be monitored by the first mobile terminal during a video call; performs object recognition on the first image, where the first image is the first mobile terminal An image captured by the camera during a video call; in the case where the target object is not included in the first image, the prompt information is output. In this way, the target object can be monitored during the video call. When the target object is not in the video screen, the prompt information is output to prompt the user to avoid the situation that the target object is not in the video screen for a long time, thereby effectively improving the quality of the video call.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings used in the description of the embodiments of the present disclosure will be briefly described. It is obvious that the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings may be obtained from these drawings without the inventive labor.

FIG. 1 is a flowchart of a video call processing method according to an embodiment of the present disclosure;

2 is a flowchart of another video call processing method according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a user interface according to an embodiment of the present disclosure;

4 is a schematic diagram of another user interface provided by an embodiment of the present disclosure;

FIG. 5 is a flowchart of another video call processing method according to an embodiment of the present disclosure;

FIG. 6 is a flowchart of another video call processing method according to an embodiment of the present disclosure;

FIG. 7 is a structural diagram of a first mobile terminal according to an embodiment of the present disclosure;

FIG. 8 is a second structural diagram of a first mobile terminal according to an embodiment of the present disclosure;

FIG. 9 is a third structural diagram of a first mobile terminal according to an embodiment of the present disclosure;

FIG. 10 is a fourth structural diagram of a first mobile terminal according to an embodiment of the present disclosure;

FIG. 11 is a fifth structural diagram of a first mobile terminal according to an embodiment of the present disclosure;

FIG. 12 is a structural diagram of a second mobile terminal according to an embodiment of the present disclosure;

FIG. 13 is a schematic structural diagram of hardware of a mobile terminal according to an embodiment of the present disclosure.

detailed description

The technical solutions in the embodiments of the present disclosure are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present disclosure. It is obvious that the described embodiments are a part of the embodiments of the present disclosure, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present disclosure without departing from the inventive scope are the scope of the disclosure.

It should be noted that the first mobile terminal and the second mobile terminal mentioned in the embodiments of the present disclosure may be mobile terminals having the same structure, or may be mobile terminals having different structures, the first mobile terminal and the second mobile terminal. Just to distinguish the naming of different mobile terminals, not limited to this.

Referring to FIG. 1 , FIG. 1 is a flowchart of a video call processing method according to an embodiment of the present disclosure. The video call processing method is applied to a first mobile terminal. As shown in FIG. 1 , the method includes the following steps:

Step 101: Determine a target object to be monitored by the first mobile terminal during a video call.

In this step, the method determines that the first mobile terminal is in the video call process, the target object to be monitored, and the method may receive the second mobile terminal that establishes a video call connection with the first mobile terminal. The target object to be monitored is determined after the sent monitoring request, and the target object to be monitored may also be determined after receiving the first input for selecting the target object. In other words, the method for determining the target object to be monitored may be triggered when the second mobile terminal sends a monitoring request, or may be actively triggered by the first mobile terminal. This is not specifically limited. Determining the target object to be monitored by the first mobile terminal during the video call may be determined during a video call or may be determined before the video call.

Step 102: Perform object recognition on the first image, where the first image is an image collected by the first mobile terminal through a camera during a video call.

In this step, the method performs object recognition on the first image, where the first image is an image acquired by the first mobile terminal through a camera during a video call. It can be understood that, as the image of the first mobile terminal is captured by the camera during the video call, the first image is also in an updated state, and the first image is updated every time. The method performs object recognition on the first image. Specifically, the method identifies whether the target object is included in the first image.

In some embodiments of the present disclosure, the method may extract contour information of the target object, and then, based on the contour information, identify whether an object having a similarity with the contour information greater than a preset threshold is included in the first image, If the first image includes an object whose similarity with the contour information is greater than a preset threshold, the method determines that the object whose similarity with the contour information is greater than a preset threshold is the target object.

In other embodiments of the present disclosure, considering that the target object may be a dynamic object, that is, an object whose contour changes at any time, the method may extract feature information of the target object, and then identify the first image based on the feature information. Whether the object with the matching degree of the feature information is greater than the first preset threshold, if the first image includes an object whose matching degree with the feature information is greater than a first preset threshold, the method determines the The object whose feature information matching degree is greater than the first preset threshold is the target object. The feature information is information that the target object is different from other objects. For example, if the target object is a person, the feature information may be face feature information or iris feature information of the character.

Step 103: When the target object is not included in the first image, the prompt information is output.

In this step, the method outputs prompt information if the target object is not included in the first image. Specifically, for the method, based on the contour information of the target object, identifying whether the first image includes an object whose similarity with the contour information is greater than a preset threshold, the method is in the first image In the case where an object having a similarity to the contour information greater than a preset threshold is not included, the prompt information is output. For the method, based on the feature information of the target object, identifying whether the first image includes an object having a degree of matching with the feature information that is greater than a first preset threshold, the method being in the first image In the case where the object whose degree of matching with the feature information is greater than the first preset threshold is not included, the prompt information is output. In this way, the method can output a prompt message prompting the user to adjust the camera to align the target object in time when the target object is not in the first image.

The manner of outputting the prompt information by the method may include one or more of: controlling the first mobile terminal to vibrate, lighting an indicator light of the first mobile terminal, controlling a flash of the flash of the first mobile terminal, Output voice prompt information. It should be understood that any prompting method that can prompt the user is within the scope of the disclosure, and the foregoing is merely illustrative and not limited thereto.

It can be understood that, in the embodiment of the present disclosure, in the process of monitoring the target object, the user may stop monitoring at any time according to actual conditions, that is, the user may perform a stop operation on the first mobile terminal, The method stops monitoring the target object in response to the stopping operation.

In the embodiment of the present disclosure, the mobile terminal may be any mobile terminal, such as a mobile phone, a tablet personal computer, a laptop computer, a personal digital assistant (PDA), and a mobile Internet access device. Device (Mobile Internet Device, MID) or Wearable Device.

In this embodiment, the video call processing method determines a target object to be monitored by the first mobile terminal during a video call; and performs object recognition on the first image, where the first image is the first mobile terminal An image captured by the camera during a video call; in the case where the target object is not included in the first image, the prompt information is output. In this way, the target object can be monitored during the video call. When the target object is not in the video screen, the prompt information is output to prompt the user to avoid the situation that the target object is not in the video screen for a long time, thereby effectively improving the quality of the video call.

Optionally, after the determining the target object to be monitored, the method further includes:

Extracting feature information of the target object;

Performing object recognition on the first image includes:

Identifying whether an object that matches the feature information is greater than a first preset threshold is included in the first image;

In the case that the target object is not included in the first image, the prompt information is output, including:

In a case where the first image does not include an object whose degree of matching with the feature information is greater than the first preset pre-threshold, the prompt information is output.

In this embodiment, the method extracts feature information of the target object, and then identifies whether the first image includes an object whose matching degree with the feature information is greater than a first preset threshold, if the first image is Including an object whose degree of matching with the feature information is greater than the first preset threshold, indicating that the target object does not need to do any processing in the image collected by the camera of the first mobile terminal; And if the first image does not include an object whose matching degree with the feature information is greater than the first preset threshold, the target object does not appear or does not appear completely in the camera collection of the first mobile terminal. In the obtained image, the method outputs prompt information, that is, in a case where the first image does not include a screen whose matching degree with the feature information is greater than the first preset threshold, the method outputs prompt information, And a camera for prompting the user to adjust the first mobile terminal to align the target object in time.

Optionally, if the first image does not include an object whose matching degree is greater than the first preset pre-threshold, the outputting the prompt information includes:

And determining, in the first image, whether the matching degree of the feature information is greater than the first preset threshold, and determining whether the first image includes a matching degree with the feature information is greater than a second pre- a first object of the threshold, wherein the first preset threshold is greater than the second preset threshold;

Determining location information of the first object in the first image, where the first image includes a first object that has a degree of matching with the feature information that is greater than a second preset threshold;

The direction prompt information is output according to the position information of the first object in the first image.

In this embodiment, if the method does not include an object that matches the feature information by the first preset threshold, the method includes whether the first image is included and The first object whose feature information is greater than the second preset threshold, wherein the first preset threshold is greater than the second preset threshold. And if the first image includes a first object whose degree of matching with the feature information is greater than a second preset threshold, determining location information of the first object in the first image, and then according to the location The position information of the first object in the first image is output, and the direction prompt information is output. In this way, the method outputs direction prompt information, which is convenient for the user to determine the moving direction of the camera moving the first mobile terminal according to the prompt information, and does not require the user to further determine the direction that needs to be moved after receiving the prompt information, thereby providing convenience to the user.

In this embodiment, if the object that does not match the feature information with the first preset threshold is not included in the first image, the method further identifies whether the first image includes The first object whose feature information matching degree is greater than the second preset threshold is smaller than the first preset threshold, if the matching degree of the feature information in the first image is greater than the The first object of the second preset threshold indicates that the target object may partially appear in the image collected by the camera of the first mobile terminal, that is, the target object is collected by the camera of the first mobile terminal. There is a deviation in the image, the method acquires position information of the first object in the first image, and outputs direction prompt information according to position information of the first object in the first image.

For example, assuming that the first object is at a left edge position of the video frame, the method may determine that the target object is biased to a left direction of a collection range of a camera of the first mobile terminal, the method output direction The prompt information prompts the user to move the camera of the first mobile terminal to the left side. Assuming that the second object is at a right edge position of the video frame, the method may determine that the target object is biased to a right direction of a collection range of a camera of the first mobile terminal, and the method output direction prompt information prompts the user Moving the camera of the first mobile terminal to the right side.

The method may pre-define different prompt modes corresponding to different direction information, and then output corresponding prompt information according to the determined direction information. For example, the method may pre-define different colors of the prompt light corresponding to different direction prompts (eg, red corresponds to left direction, green corresponds to right direction), and the method may light a red prompt light to prompt the user to move the first move. The camera of the terminal moves to the left side, and the green prompt light is illuminated to prompt the user to move the camera of the first mobile terminal to the right. Similarly, the method may also define different vibration modes, different flash modes of the flash, or different voice information corresponding to different direction prompts, which are not described herein.

Referring to FIG. 2, FIG. 2 is a flowchart of another video call processing method according to an embodiment of the present disclosure. The method is applied to a first mobile terminal. As shown in FIG. 2, the method includes the following steps:

Step 201: Receive a monitoring request that is sent by the second mobile terminal and that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object during a video call.

In this step, the method receives a monitoring request that is sent by the second mobile terminal and carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object during the video call. In this embodiment, the second mobile terminal is a mobile terminal that establishes a video call connection with the first mobile terminal, and the user may select an object of interest on the video call interface of the second mobile terminal as the second object. The second mobile terminal sends a monitoring request carrying the second object information to the first mobile terminal.

Specifically, the second mobile terminal may identify and display an outline of an object in a video picture sent by the first mobile terminal during a video call with the first mobile terminal, and then based on selecting an target contour. a second input, determining an object in the target profile as a second object, and transmitting, to the first mobile terminal, a monitoring request carrying the second object information, for requesting the first mobile terminal to monitor Said second object. The second object information may be the screen content in the target contour, or may be the target contour information, or may be the feature information of the object in the target contour, which is not specifically limited in this embodiment of the present disclosure. .

For example, referring to FIG. 3, it is assumed that the video call interface of the second mobile terminal 300 is as shown in FIG. 3, wherein the video picture displayed in the area 301 is the received video picture sent by the first mobile terminal, and is displayed in the area 302. The video picture is an image captured by the camera of the second mobile terminal. The second mobile terminal can identify an object in the picture in the area 301 and display the contour of the identified object. As shown by the dotted line in FIG. 3, the user can select any one in the interface as shown in FIG. a second input (ie, a click, a double tap, a long press operation, etc.) of an outline of the object of interest (ie, a target outline), the second mobile terminal determining an object in the target outline as The second object then sends a monitoring request carrying the second object information to the first mobile terminal. It can be understood that the target object may include one object, and may also include multiple objects, that is, the user may select only one contour as the target contour, or may select multiple contours as the target contour at the same time.

In some embodiments of the present disclosure, the second mobile terminal may further display a user interface on the second mobile terminal after receiving the second input, the user interface including whether to confirm that the notification partner device monitors the target object The button, as shown in Figure 4, the user can click the "confirm" button in the user interface as shown in Figure 4, or click the "cancel" button. If the user clicks the "confirm" button, the second mobile terminal generates a monitoring request carrying the second object information in response to a click operation on the "confirm" button, and transmits the monitoring request to the first mobile terminal. Monitor requests.

Step 202: Determine, according to the monitoring request, that the second object is a target object to be monitored by the first mobile terminal during a video call.

In this step, the method determines, according to the monitoring request, that the second object is a target object to be monitored by the first mobile terminal during a video call. Specifically, the method may acquire second object information carried in the monitoring request, and then determine, according to the second object information, a target object to be monitored by the first mobile terminal during a video call.

In some embodiments of the present disclosure, after receiving the monitoring request, the method further displays, on the first mobile terminal, a user interface including a confirmation whether to monitor a button, and the user may select to monitor the target object or not to monitor the target object, if The user selects to monitor the target object, and the method determines the target object to be monitored based on the monitoring request; conversely, if the user chooses not to monitor the target object, the method does not respond to the monitoring request, and the process ends.

Step 203: Perform object recognition on the first image, where the first image is an image that is collected by the first mobile terminal through a camera during a video call.

Step 204: When the target object is not included in the first image, the prompt information is output.

The steps 203 and 204 are the same as the steps 102 and 103 in the embodiment shown in FIG. 1 of the present disclosure, and details are not described herein again.

In this embodiment, the video call processing method receives a monitoring request that is sent by the second mobile terminal and carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the first part during the video call. And determining, according to the monitoring request, the second object is a target object to be monitored by the first mobile terminal during a video call; performing object recognition on the first image, where the first image is An image captured by the mobile terminal during the video call by the camera; in the case where the target object is not included in the first image, the prompt information is output. In this way, after receiving the monitoring request that carries the second object information sent by the second mobile terminal, the target object to be monitored during the video passing process is determined, and when the target object is not in the video screen, the prompt information is output to prompt the user to avoid When the target object is not in the video screen for a long time, the video call quality is effectively improved.

Referring to FIG. 5, FIG. 5 is a flowchart of another video call processing method according to an embodiment of the present disclosure. The method is applied to a first mobile terminal. As shown in FIG. 5, the method includes the following steps:

Step 501: Identify and display an outline of an object in the second image collected by the first mobile terminal during the video call.

In this step, the method identifies and displays an outline of an object in the second image collected by the first mobile terminal during the video call.

Step 502: Receive a first input for selecting a target contour in the second image.

In this step, the method monitors the first image based on a triggering operation of the user on the first mobile terminal. Specifically, a user may perform a first input for selecting a target contour in the second image on the first mobile terminal, and selecting a target in a second image collected by a camera of the first mobile terminal Object. In other embodiments of the present disclosure, the method may not recognize and display an outline of an object in the second screen, and the first input may be a circle selection operation performed by a user on the second image.

Step 503: Determine an object in the target contour as a target object in response to the first input.

In this step, the method determines an object in the target contour as a target object in response to the first input. In other embodiments of the present disclosure, when the first input is a circle selection operation performed by the user on the second image, the method identifies an object in the circle selected by the circle selection operation, and determines The object in the circled picture is the target object.

In some embodiments of the present disclosure, after receiving the first input, the method further displays, at the first mobile terminal, a user interface including a confirmation whether to monitor a button, and the user may select to monitor the target object or not to monitor the target object. If the user selects to monitor the target object, the method determines the target object to be monitored based on the first input; conversely, if the user chooses not to monitor the target object, the method does not respond to the first input, and the process ends.

Step 504: Perform object recognition on the first image, where the first image is an image captured by the first mobile terminal through a camera during a video call after determining the target object to be monitored.

Step 505: When the target object is not included in the first image, the prompt information is output.

The steps 504 and 505 are the same as the steps 102 and 103 in the embodiment shown in FIG. 1 of the present disclosure, and details are not described herein again.

In this embodiment, the video call processing method identifies and displays an outline of an object in a second image collected by the first mobile terminal during a video call, and is received for selecting in the second image. a first input of the target contour; determining, in response to the first input, an object in the target contour as a target object; performing object recognition on the first image, the first image being determining the target object to be monitored After the first mobile terminal captures the image through the camera during the video call; if the target object is not included in the first image, the prompt information is output. In this way, after receiving the first input for selecting the target object, the target object is monitored. When the target object is not in the video screen, the prompt information is output to prompt the user to avoid the situation that the target object is not in the video screen for a long time, and the video is effectively improved. conversation quality.

Referring to FIG. 6, FIG. 6 is a flowchart of another video call processing method according to an embodiment of the present disclosure. The method is applied to a second mobile terminal. As shown in FIG. 6, the method includes the following steps:

Step 601: Identify and display an outline of an object in the received video picture during the video call between the second mobile terminal and the first mobile terminal.

Step 602: Receive a second input for selecting a target contour.

Step 603: Determine an object in the target contour as a second object in response to the second input.

Step 604: Send, to the first mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object.

6 is a flowchart of a second mobile terminal side of the video call processing method according to the present disclosure, and the steps performed by the second mobile terminal side and functions that can be implemented have been detailed in the embodiment shown in FIG. 2. Description, no longer repeat here.

In this embodiment, the video call processing method identifies and displays an outline of an object in the received video picture during the video call of the second mobile terminal and the first mobile terminal; and receives a feature for selecting a target contour. Two inputs; determining, in response to the second input, an object in the target profile as a second object; transmitting, to the first mobile terminal, a monitoring request carrying the second object information, the monitoring request The first mobile terminal is requested to monitor the second object. In this way, the second mobile terminal can generate a monitoring request carrying information of the target object that the user is interested in in response to the user's input, and send the monitoring request to the first mobile terminal, for triggering the first mobile terminal to monitor the location. When the target object is not in the video screen, the prompt information is output to prompt the user to avoid the situation that the target object is not in the video screen for a long time, thereby effectively improving the quality of the video call.

Referring to FIG. 7, FIG. 7 is a structural diagram of a first mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 7, the first mobile terminal 700 includes:

The first determining module 701 is configured to determine a target object to be monitored by the first mobile terminal during a video call;

The first identification module 702 is configured to perform object recognition on the first image, where the first image is an image collected by the first mobile terminal through a camera during a video call;

The prompting module 703 is configured to output prompt information if the target object is not included in the first image.

Optionally, referring to FIG. 8, FIG. 8 is a structural diagram of a first mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 8, the first mobile terminal 700 further includes:

An extraction module 704, configured to extract feature information of the target object;

The first identification module 702 is specifically configured to:

Identifying whether an object having a degree of matching with the feature information greater than a first preset threshold is included in the first image;

The prompting module 703 is specifically configured to:

In a case where the first image does not include an object whose degree of matching with the feature information is greater than the first preset pre-threshold, the prompt information is output.

Optionally, referring to FIG. 9, FIG. 9 is a third structural diagram of a first mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 9, the prompting module 703 includes:

a first identifying unit 7031, configured to identify, in the first image, whether the first image includes an object that matches the feature information by the first preset threshold. The first object whose feature information is greater than the second preset threshold, wherein the first preset threshold is greater than the second preset threshold;

a first determining unit 7032, configured to determine, in the first image, that the first object is in the first image, where a first object that matches a feature information greater than a second preset threshold is included in the first image. Location information;

The prompting unit 7033 is configured to output direction prompt information according to the location information of the first object in the first image.

Optionally, referring to FIG. 10, FIG. 10 is a fourth structural diagram of a first mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 10, the first determining module 701 includes:

The first receiving unit 7011 is configured to receive, by the second mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object during a video call;

The second determining unit 7012 is configured to determine, according to the monitoring request, that the second object is a target object to be monitored by the first mobile terminal during a video call.

Optionally, referring to FIG. 11 , FIG. 11 is a structural diagram of a first mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 11 , the first determining module 701 includes:

a second identifying unit 7013, configured to identify and display an outline of an object in the second image collected by the first mobile terminal during the video call by the camera;

a second receiving unit 7014, configured to receive a first input for selecting a target contour in the second image;

a third determining unit 7015, configured to determine an object in the target contour as a target object in response to the first input;

The first identification module 702 is specifically configured to:

Performing object recognition on the first image, where the first image is an image captured by the first mobile terminal through a camera during a video call after determining the target object to be monitored.

In this embodiment, the first mobile terminal determines a target object to be monitored by the first mobile terminal during a video call; performs object recognition on the first image, where the first image is the first mobile terminal An image captured by the camera during a video call; in the case where the target object is not included in the first image, the prompt information is output. In this way, the first mobile terminal can monitor the target object during the video call, and when the target object is not in the video screen, output prompt information to prompt the user to avoid the situation that the target object is not in the video screen for a long time, thereby effectively improving the video call. quality.

Referring to FIG. 12, FIG. 12 is a structural diagram of a second mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 12, the second mobile terminal 1200 includes:

The second identification module 1201 is configured to identify and display an outline of an object in the received video picture during the video call between the second mobile terminal and the first mobile terminal;

The receiving module 1202 is configured to receive a second input for selecting a target contour;

a second determining module 1203, configured to determine, in response to the second input, an object in the target contour as a second object;

The sending module 1204 is configured to send, to the first mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object.

In this embodiment, the two mobile terminals identify and display the contour of the object in the received video picture during the video call between the second mobile terminal and the first mobile terminal, and receive the second object for selecting the target contour. Inputting; determining, in response to the second input, an object in the target profile as a second object; transmitting, to the first mobile terminal, a monitoring request carrying the second object information, the monitoring request being used for The first mobile terminal is requested to monitor the second object. In this way, the second mobile terminal can generate a monitoring request carrying information of the target object that the user is interested in in response to the user's input, and send the monitoring request to the first mobile terminal, for triggering the first mobile terminal to monitor the location. When the target object is not in the video screen, the prompt information is output to prompt the user to avoid the situation that the target object is not in the video screen for a long time, thereby effectively improving the quality of the video call.

FIG. 13 is a schematic diagram of a hardware structure of a mobile terminal that implements various embodiments of the present disclosure. It may be understood that FIG. 13 may be a schematic diagram of a hardware structure of a first mobile terminal in the embodiment of the present disclosure, or may be an embodiment of the present disclosure. A schematic diagram of the hardware structure of the second mobile terminal. As shown in FIG. 13 , the mobile terminal 1300 includes but is not limited to: a radio frequency unit 1301 , a network module 1302 , an audio output unit 1303 , an input unit 1304 , a sensor 1305 , a display unit 1306 , a user input unit 1307 , an interface unit 1308 , and a memory 1309 . , processor 1310, and power supply 1311 and other components. It will be understood by those skilled in the art that the mobile terminal structure shown in FIG. 13 does not constitute a limitation of the mobile terminal, and the mobile terminal may include more or less components than those illustrated, or combine some components, or different components. Arrangement. In the embodiments of the present disclosure, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle terminal, a wearable device, a pedometer, and the like.

Wherein, when the mobile terminal shown in FIG. 13 is the first mobile terminal, the processor 1310 is configured to:

Determining a target object to be monitored by the first mobile terminal during a video call;

Performing object recognition on the first image, where the first image is an image collected by the first mobile terminal through a camera during a video call;

In the case where the target object is not included in the first image, the prompt information is output.

Optionally, after the processor 1310 performs determining the target object to be monitored by the first mobile terminal during the video call, the following steps may also be implemented:

Extracting feature information of the target object;

Performing object recognition on the first image performed by the processor 1310 includes:

Identifying whether an object having a degree of matching with the feature information greater than a first preset threshold is included in the first image;

And outputting, by the processor 1310, the prompt information, if the target object is not included in the first image, includes:

In a case where the first image does not include an object whose degree of matching with the feature information is greater than the first preset pre-threshold, the prompt information is output.

Optionally, if the first image that is executed by the processor 1310 does not include an object that matches the feature information by the first preset pre-threshold, the outputting the prompt information includes:

And determining, in the first image, whether the matching degree of the feature information is greater than the first preset threshold, and determining whether the first image includes a matching degree with the feature information is greater than a second pre- a first object of the threshold, wherein the first preset threshold is greater than the second preset threshold;

Determining location information of the first object in the first image, where the first image includes a first object that has a degree of matching with the feature information that is greater than a second preset threshold;

The direction prompt information is output according to the position information of the first object in the first image.

Optionally, the determining, by the processor 1310, the target object to be monitored by the first mobile terminal during a video call includes:

Receiving, by the second mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object during a video call;

And determining, according to the monitoring request, the second object is a target object to be monitored by the first mobile terminal during a video call.

Optionally, the determining, by the processor 1310, the target object to be monitored by the first mobile terminal during a video call includes:

Identifying and displaying an outline of an object in the second image collected by the first mobile terminal during the video call by the camera;

Receiving a first input for selecting a target contour in the second image;

Determining an object in the target contour as a target object in response to the first input;

The processor 1310 performs object recognition on the first image, where the first image is an image collected by the first mobile terminal through the camera during a video call, and includes:

Performing object recognition on the first image, where the first image is an image captured by the first mobile terminal through a camera during a video call after determining the target object to be monitored.

In the embodiment of the present disclosure, the first mobile terminal can monitor the target object during the video call, and when the target object is not in the video screen, outputting the prompt information prompting the user to adjust the camera to avoid the situation that the target object is not in the video screen for a long time, and is effective. Improve the quality of video calls.

It can be understood that, when the mobile terminal shown in FIG. 13 is the second mobile terminal, the processor 1310 is configured to:

Identifying and displaying an outline of an object in the received video picture during the video call between the second mobile terminal and the first mobile terminal;

Receiving a second input for selecting a target profile;

Determining an object in the target contour as a second object in response to the second input;

And transmitting, to the first mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object.

It should be understood that, in the embodiment of the present disclosure, the radio frequency unit 1301 can be used for receiving and transmitting signals during the transmission and reception of information or during a call, and specifically, after receiving downlink data from the base station, processing the processor 1310; The uplink data is sent to the base station. In general, radio frequency unit 1301 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio unit 1301 can also communicate with the network and other devices through a wireless communication system.

The mobile terminal provides the user with wireless broadband Internet access through the network module 1302, such as helping the user to send and receive emails, browse web pages, and access streaming media.

The audio output unit 1303 may convert the audio data received by the radio frequency unit 1301 or the network module 1302 or stored in the memory 1309 into an audio signal and output as a sound. Moreover, the audio output unit 1303 can also provide audio output (eg, call signal reception sound, message reception sound, etc.) related to a specific function performed by the mobile terminal 1300. The audio output unit 1303 includes a speaker, a buzzer, a receiver, and the like.

The input unit 1304 is for receiving an audio or video signal. The input unit 1304 may include a graphics processing unit (GPU) 13041 and a microphone 13042, and the graphics processor 13041 images an still picture or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The data is processed. The processed image frame can be displayed on display unit 1306. The image frames processed by the graphics processor 13041 may be stored in the memory 1309 (or other storage medium) or transmitted via the radio unit 1301 or the network module 1302. The microphone 13042 can receive sound and can process such sound as audio data. The processed audio data can be converted to a format output that can be transmitted to the mobile communication base station via the radio unit 1301 in the case of a telephone call mode.

Mobile terminal 1300 also includes at least one type of sensor 1305, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 13061 according to the brightness of the ambient light, and the proximity sensor can close the display panel 13061 when the mobile terminal 1300 moves to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the attitude of the mobile terminal (such as horizontal and vertical screen switching, related games). , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; sensor 1305 can also include fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, Infrared sensors and the like are not described here.

The display unit 1306 is for displaying information input by the user or information provided to the user. The display unit 1306 can include a display panel 13061. The display panel 13061 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

The user input unit 1307 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 1307 includes a touch panel 13071 and other input devices 13072. The touch panel 13071, also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 13071 or near the touch panel 13071. operating). The touch panel 13071 may include two parts of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 1310 receives the commands from the processor 1310 and executes them. In addition, the touch panel 13071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 13071, the user input unit 1307 can also include other input devices 13072. Specifically, other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which are not described herein again.

Further, the touch panel 13071 can be overlaid on the display panel 13061. After the touch panel 13071 detects a touch operation thereon or nearby, the touch panel 13071 transmits to the processor 1310 to determine the type of the touch event, and then the processor 1310 according to the touch. The type of event provides a corresponding visual output on display panel 13061. Although in FIG. 13 , the touch panel 13071 and the display panel 13061 are used as two independent components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 13071 and the display panel 13061 may be integrated. The input and output functions of the mobile terminal are implemented, and are not limited herein.

The interface unit 1308 is an interface in which an external device is connected to the mobile terminal 1300. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The interface unit 1308 can be configured to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more components within the mobile terminal 1300 or can be used at the mobile terminal 1300 and externally Data is transferred between devices.

Memory 1309 can be used to store software programs as well as various data. The memory 1309 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.). Moreover, memory 1309 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 1310 is a control center of the mobile terminal that connects various portions of the entire mobile terminal using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 1309, and recalling data stored in the memory 1309. The mobile terminal performs various functions and processing data to perform overall monitoring on the mobile terminal. The processor 1310 may include one or more processing units; preferably, the processor 1310 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application, etc., and performs modulation and demodulation. The processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 1310.

The mobile terminal 1300 may further include a power source 1311 (such as a battery) for supplying power to various components. Preferably, the power source 1311 may be logically connected to the processor 1310 through a power management system to manage charging, discharging, and power management through the power management system. And other functions.

In addition, the mobile terminal 1300 includes some functional modules not shown, and details are not described herein again.

Preferably, the embodiment of the present disclosure further provides a mobile terminal, including a processor 1310, a memory 1309, a computer program stored on the memory 1309 and executable on the processor 1310, when the computer program is executed by the processor 1310. The processes of the foregoing video call processing method are implemented, and the same technical effects can be achieved. To avoid repetition, details are not described herein again.

The embodiment of the present disclosure further provides a computer readable storage medium, where the computer readable storage medium stores a computer program, and when the computer program is executed by the processor, implements various processes of the video call processing method embodiment, and can achieve the same Technical effects, to avoid repetition, will not be repeated here. The computer readable storage medium, such as a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present disclosure, which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal (which may be a cell phone, computer, server, air conditioner, or network device, etc.) to perform the methods described in various embodiments of the present disclosure.

The above is only the specific embodiment of the present disclosure, but the scope of the present disclosure is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the disclosure. It should be covered within the scope of protection of the present disclosure. Therefore, the scope of protection of the disclosure should be determined by the scope of the claims.

Claims (14)

A video call processing method is applied to a first mobile terminal, including: Determining a target object to be monitored by the first mobile terminal during a video call; Performing object recognition on the first image, where the first image is an image collected by the first mobile terminal through a camera during a video call; In the case where the target object is not included in the first image, the prompt information is output. The video call processing method of claim 1, wherein the method further comprises: after determining the target object to be monitored by the first mobile terminal during a video call, the method further comprising: Extracting feature information of the target object; The object recognition of the first image includes: Identifying whether an object having a degree of matching with the feature information greater than a first preset threshold is included in the first image; In the case that the target object is not included in the first image, the prompt information is output, including: In a case where the first image does not include an object whose degree of matching with the feature information is greater than the first preset pre-threshold, the prompt information is output. The video call processing method according to claim 2, wherein in the case where the first image does not include an object whose matching degree with the feature information is greater than the first preset pre-threshold, the prompt information is output. ,include: And determining, in the first image, whether the matching degree of the feature information is greater than the first preset threshold, and determining whether the first image includes a matching degree with the feature information is greater than a second pre- a first object of the threshold, wherein the first preset threshold is greater than the second preset threshold; Determining location information of the first object in the first image, where the first image includes a first object that has a degree of matching with the feature information that is greater than a second preset threshold; The direction prompt information is output according to the position information of the first object in the first image. The video call processing method according to claim 1, wherein the determining the target object to be monitored by the first mobile terminal during a video call comprises: Receiving, by the second mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object during a video call; And determining, according to the monitoring request, the second object is a target object to be monitored by the first mobile terminal during a video call. The video call processing method according to claim 1, wherein the determining the target object to be monitored by the first mobile terminal during a video call comprises: Identifying and displaying an outline of an object in the second image collected by the first mobile terminal during the video call by the camera; Receiving a first input for selecting a target contour in the second image; Determining an object in the target contour as a target object in response to the first input; Performing object recognition on the first image, where the first image is an image collected by the first mobile terminal through a camera during a video call, including: Performing object recognition on the first image, where the first image is an image captured by the first mobile terminal through a camera during a video call after determining the target object to be monitored. A video call processing method is applied to a second mobile terminal, including: Identifying and displaying an outline of an object in the received video picture during the video call between the second mobile terminal and the first mobile terminal; Receiving a second input for selecting a target profile; Determining an object in the target contour as a second object in response to the second input; And transmitting, to the first mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object. A mobile terminal, where the mobile terminal is a first mobile terminal, where the first mobile terminal includes: a first determining module, configured to determine a target object to be monitored by the first mobile terminal during a video call; a first identification module, configured to perform object recognition on the first image, where the first image is an image collected by the first mobile terminal through a camera during a video call; And a prompting module, configured to output prompt information if the target object is not included in the first image. The mobile terminal of claim 7, further comprising: An extraction module, configured to extract feature information of the target object; The first identification module is specifically configured to: Identifying whether an object having a degree of matching with the feature information greater than a first preset threshold is included in the first image; The prompting module is specifically configured to: In a case where the first image does not include an object whose degree of matching with the feature information is greater than the first preset pre-threshold, the prompt information is output. The mobile terminal of claim 8, wherein the prompting module comprises: a first identifying unit, configured to identify, in the first image, whether the first image includes the object with a matching degree of the feature information that is greater than the first preset threshold The first object whose information matching degree is greater than the second preset threshold, wherein the first preset threshold is greater than the second preset threshold; a first determining unit, configured to determine, in the first image, a first object that has a matching degree with the feature information that is greater than a second preset threshold, determining that the first object is in the first image location information; a prompting unit, configured to output direction prompt information according to position information of the first object in the first image. The mobile terminal of claim 7, wherein the first determining module comprises: a first receiving unit, configured to receive a monitoring request that is sent by the second mobile terminal and that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object during a video call; And a second determining unit, configured to determine, according to the monitoring request, that the second object is a target object to be monitored by the first mobile terminal during a video call. The mobile terminal of claim 7, wherein the first determining module comprises: a second identifying unit, configured to identify and display an outline of the object in the second image collected by the first mobile terminal during the video call by the camera; a second receiving unit, configured to receive a first input for selecting a target contour in the second image; a third determining unit, configured to determine an object in the target contour as a target object in response to the first input; The first identification module is specifically configured to: Performing object recognition on the first image, where the first image is an image captured by the first mobile terminal through a camera during a video call after determining the target object to be monitored. A mobile terminal, where the mobile terminal is a second mobile terminal, where the second mobile terminal includes: a second identification module, configured to identify and display an outline of an object in the received video picture during the video call between the second mobile terminal and the first mobile terminal; a receiving module, configured to receive a second input for selecting a target contour; a second determining module, configured to determine an object in the target contour as a second object in response to the second input; And a sending module, configured to send, to the first mobile terminal, a monitoring request that carries the second object information, where the monitoring request is used to request the first mobile terminal to monitor the second object. A mobile terminal comprising a processor, a memory, a computer program stored on the memory and operable on the processor, the computer program being executed by the processor to implement any of claims 1 to 5 A step of the video call processing method described, or the step of implementing the video call processing method of claim 6. A computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the video call processing method according to any one of claims 1 to 5. The step of implementing the video call processing method of claim 6.

Images