CN107563168A - Unlocking method and device for mobile terminal and mobile terminal - Google Patents

Abstract

The application discloses a mobile terminal unlocking method and device and a mobile terminal. The method comprises the following steps: under the condition that the mobile terminal is in a screen locking state, if the motion state of the mobile terminal is detected to meet a first preset condition, starting a camera; acquiring a face image of a target user through a camera; detecting whether the face image of the target user is matched with the face image of the registered user; and if the face image of the target user is matched with the face image of the registered user, controlling the mobile terminal to be switched from the screen locking state to the unlocking state. According to the unlocking method and the unlocking device, unlocking is performed based on face recognition, and compared with the existing unlocking method, the unlocking method is more convenient and efficient.

Description

Unlocking method and device for mobile terminal and mobile terminal

technical field

The embodiments of the present application relate to the technical field of human-computer interaction, and in particular, to a method and device for unlocking a mobile terminal, and a mobile terminal.

Background technique

Mobile terminals such as mobile phones and tablet computers usually have a screen locking function. When the user operates the mobile terminal, it is necessary to unlock the screen of the mobile terminal first, so as to achieve the purpose of authenticating the user.

At present, common unlocking methods include two types, one is password unlocking, and the other is fingerprint unlocking. The password unlocking method requires the user to enter a digital password or a gesture password, and the user successfully unlocks after entering the correct password. The fingerprint unlocking method requires the user's finger to press a specific area for the mobile terminal to collect fingerprints, and it will be successfully unlocked after the fingerprints are matched.

There are some problems in the above two unlocking methods. The password unlocking method is more complicated and requires the user to manually enter the password, while the fingerprint unlocking method puts forward higher requirements on the cleanliness of the user's fingers, pressing position, and pressing force. It often happens that the fingerprint collection is unsuccessful, and the user needs to re-press the fingerprint many times. Therefore, the current unlocking method is not convenient enough, which affects the efficiency of unlocking.

Contents of the invention

Embodiments of the present application provide an unlocking method and device for a mobile terminal, and a mobile terminal, which can be used to solve the problems that the current unlocking methods are not convenient enough and have low efficiency. Described technical scheme is as follows:

In a first aspect, a method for unlocking a mobile terminal is provided, the method comprising:

When the mobile terminal is in a locked screen state, if it is detected that the motion state of the mobile terminal meets the first preset condition, then start the camera;

Collecting the face image of the target user through the camera;

Detecting whether the face image of the target user matches the face image of the registered user;

If the face image of the target user matches the face image of the registered user, the mobile terminal is controlled to switch from the locked screen state to an unlocked state.

Optionally, before the controlling the mobile terminal to switch from the locked screen state to the unlocked state, further includes:

If the face image of the target user matches the face image of the registered user, an unlock prompt message is displayed on the unlock interface, and the unlock prompt message is used to prompt the execution of an unlock operation;

When the unlocking operation signal input in the unlocking interface is obtained and the unlocking operation signal meets a second preset condition, the step of controlling the mobile terminal to switch from the locked screen state to the unlocked state is executed.

Optionally, when the mobile terminal is in a locked screen state, if it is detected that the motion state of the mobile terminal meets the first preset condition, then starting the camera includes:

When the mobile terminal is in the locked screen state, acquiring angular velocity data collected by the gyroscope;

determining the motion state of the mobile terminal according to the angular velocity data;

If the motion state of the mobile terminal meets the first preset condition, start the camera; wherein the first preset condition refers to a state that the mobile terminal rotates around an axis.

Optionally, the detecting whether the face image of the target user matches the face image of the registered user includes:

extracting the face features of the target user from the face image of the target user;

Calculating the similarity between the facial features of the target user and the facial features of the registered user, where the facial features of the registered user are extracted from the facial images of the registered user;

If the similarity is greater than a preset threshold, it is determined that the face image of the target user matches the face image of the registered user.

Optionally, before the detecting whether the face image of the target user matches the face image of the registered user, it may further include:

collecting multiple facial images of the registered user through the camera, and the multiple facial images of the registered user correspond to multiple different angles of the registered user's face;

The face features of the registered user are extracted from the multiple face images of the registered user.

Optionally, the camera is a front camera, and after starting the camera, it also includes:

The image captured by the front camera is displayed on the screen.

Optionally, after detecting whether the face image of the target user matches the face image of the registered user, the method further includes:

If the face image of the target user does not match the face image of the registered user, then obtain the number of consecutive times that the detection result is a mismatch;

When the number of consecutive times reaches a preset threshold, a password input interface is displayed;

Obtain the unlocking password input in the password input interface;

If the unlocking password is correct, then controlling the mobile terminal to switch from the locked screen state to the unlocked state;

If the unlock password is incorrect, then save the target image collected by the camera, and lock the mobile terminal; wherein, the target image is the face image of the target user, or the target image is determined at The image in front of the screen captured by the camera after the unlock password is incorrect.

In a second aspect, an unlocking device for a mobile terminal is provided, the device comprising:

The motion detection module is configured to start the camera if it is detected that the motion state of the mobile terminal meets the first preset condition when the mobile terminal is in a locked screen state;

A face collection module, configured to collect a face image of a target user through the camera;

The face matching module is used to detect whether the face image of the target user matches the face image of the registered user;

An unlocking module, configured to control the mobile terminal to switch from the locked screen state to an unlocked state when the face image of the target user matches the face image of the registered user.

Optionally, the device also includes:

A first display module, configured to display unlocking prompt information on an unlocking interface when the face image of the target user matches the face image of the registered user, and the unlocking prompt information is used to prompt the execution of an unlocking operation;

The unlocking module is further configured to control the mobile terminal to switch from the locked screen state to The unlocked state.

Optionally, the motion detection module is used for:

When the mobile terminal is in the locked screen state, acquiring angular velocity data collected by the gyroscope;

determining the motion state of the mobile terminal according to the angular velocity data;

When the motion state of the mobile terminal meets the first preset condition, start the camera; wherein the first preset condition refers to a state that the mobile terminal rotates around an axis.

Optionally, the face matching module is used for:

extracting the face features of the target user from the face image of the target user;

Calculating the similarity between the facial features of the target user and the facial features of the registered user, where the facial features of the registered user are extracted from the facial images of the registered user;

When the similarity is greater than a preset threshold value, it is determined that the face image of the target user matches the face image of the registered user.

Optionally, the face collection module is further configured to collect multiple face images of the registered user through the camera, and the multiple face images of the registered user correspond to the faces of the registered user. many different angles;

The face matching module is further configured to extract the face features of the registered user from multiple face images of the registered user.

Optionally, the camera is a front camera, and the device also includes:

The second display module is used to display the image captured by the front camera on the screen.

Optionally, the device also includes:

The number of times acquisition module is used to obtain the consecutive times that the detection result is a mismatch when the face image of the target user does not match the face image of the registered user;

The third display module is used to display a password input interface when the number of consecutive times reaches a preset number of times;

A password acquisition module, which acquires the unlock password input in the password input interface;

A security protection module, configured to save the target image collected by the camera and lock the mobile terminal when the unlock password is incorrect; wherein the target image is a face image of the target user, or the The target image is an image in front of the screen collected by the camera after determining that the unlock password is incorrect;

The unlocking module is further configured to control the mobile terminal to switch from the locked screen state to the unlocked state when the unlock password is correct.

In a third aspect, a mobile terminal is provided, wherein the mobile terminal includes a processor and a memory, the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the following: The unlocking method of the mobile terminal described in the first aspect.

In a fourth aspect, a computer-readable storage medium is provided, at least one instruction is stored in the computer-readable storage medium, and the at least one instruction is loaded and executed by a processor to implement the mobile terminal as described in the first aspect unlock method.

The technical solutions provided in the embodiments of the present application can bring the following beneficial effects:

The embodiment of the present application provides an unlocking method based on face recognition. Compared with the password unlocking method, the user does not need to manually enter the password, which simplifies the operation. Compared with the fingerprint unlocking method, the operation requirements for the user are reduced, and the user only needs to face the camera of the mobile terminal. Therefore, the unlocking method provided by the embodiment of the present application is more convenient than the current unlocking method, and helps to improve the efficiency of unlocking.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without creative effort.

Fig. 1 is a flow chart showing a method for unlocking a mobile terminal according to an exemplary embodiment;

FIG. 2 exemplarily shows a schematic diagram of a process of turning on the screen of a mobile terminal;

FIG. 3 exemplarily shows a schematic diagram of a mobile terminal displaying an unlocking interface;

Fig. 4 is a flowchart of a method for unlocking a mobile terminal according to another exemplary embodiment;

Fig. 5 is a block diagram of an unlocking device for a mobile terminal according to an exemplary embodiment;

Fig. 6 is a schematic structural diagram of a mobile terminal according to an exemplary embodiment;

7A and 7B are schematic structural diagrams of a mobile terminal according to another exemplary embodiment;

8A to 8F are schematic structural diagrams of a terminal touch screen according to an exemplary embodiment.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

In the embodiment of the present application, a manner of unlocking based on face recognition is provided. Compared with the password unlocking method, the user does not need to manually enter the password, which simplifies the operation. Compared with the fingerprint unlocking method, the operation requirements for the user are reduced, and the user only needs to face the camera of the mobile terminal. Therefore, the unlocking method provided by the embodiment of the present application is more convenient than the current unlocking method, and helps to improve the efficiency of unlocking.

In the method provided in the embodiment of the present application, each step is executed by a mobile terminal, which may be a portable electronic device such as a mobile phone, a tablet computer, an e-book reader, a multimedia playback device, or a wearable device. The mobile terminal has a camera and a touch screen.

The camera is used to collect the face image of the user. The touch display screen is used to receive a user's touch operation on or near it using any suitable object such as a finger or a touch pen, and to display user interfaces of various application programs. The touch screen is usually set on the front panel of the terminal. The touch display screen can be designed as a full screen, a curved screen or a special-shaped screen, and can also be set as a screen in other forms, which is not limited this time. The touch display screen can also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in this embodiment. For the introduction of full screen, curved screen and special-shaped screen, please refer to the following.

Fig. 1 is a flowchart showing a method for unlocking a mobile terminal according to an exemplary embodiment. The method may include the following steps:

Step 101, when the mobile terminal is in a screen-locked state, if it is detected that the motion state of the mobile terminal meets a first preset condition, start the camera.

When the mobile terminal is in the locked screen state, the screen of the mobile terminal is in the locked screen state, and the user cannot use the mobile terminal. If the mobile terminal is to be used, the mobile terminal must be unlocked, which is to switch the mobile terminal from the locked screen state to the unlocked state. When the mobile terminal is in a screen-locked state, it will detect whether its own motion state meets the first preset condition. Optionally, the first preset condition refers to a state that the mobile terminal rotates around an axis. When the user picks up the mobile terminal and prepares to unlock it for use, the mobile terminal will be in a motion state of rotating around an axis, wherein the axis around which the mobile terminal revolves can be any axis in the plane where the mobile terminal is located. When the mobile terminal detects that its own motion state meets the first preset condition, it indicates that the mobile terminal is picked up, and then starts the camera.

In a possible implementation manner, the above-mentioned step 101 includes the following several sub-steps:

1. Obtain the angular velocity data collected by the gyroscope when the mobile terminal is in the lock screen state;

The gyroscope is used to collect the angular velocity data of the mobile terminal. The gyroscope is a sensor used to collect the angular velocity of an object. In the embodiment of the present application, the gyroscope of the mobile terminal is a low-power gyroscope. Because the mobile terminal is always collecting angular velocity data when the screen is locked, the low-power gyroscope can be used. Save power consumption.

2. Determine the motion state of the mobile terminal according to the angular velocity data;

The mobile terminal can determine its own motion state according to the angular velocity data collected by the gyroscope. The mobile terminal records the correspondence between the angular velocity data and the motion state, and through the correspondence and the angular velocity data collected by the gyroscope, the motion state of the mobile terminal can be determined.

3. If the motion state of the mobile terminal meets the first preset condition, start the camera.

Through the above method, the camera can be restarted when it is confirmed that the mobile terminal is picked up by the user for use, and the situation of mistakenly starting the camera can be avoided.

Optionally, when it is detected that the motion state of the mobile terminal meets the first preset condition, the mobile terminal lights up the screen and displays the unlock interface. If the motion state of the mobile terminal meets the first preset condition, the screen of the mobile terminal is turned on while the camera is started. For example, please refer to FIG. 2 , the mobile terminal 201 is in a locked screen state. When the user picks up the mobile terminal 201, the mobile terminal 201 determines that its own motion state is to revolve around a certain point in the plane where it is located according to the acquired angular velocity data. If the axis is rotating, the mobile terminal lights up the screen to display the unlock interface 202, and starts the camera. By turning on the screen while starting the camera, the camera can use the screen light source to collect clearer face images in an environment with insufficient light.

Optionally, the aforementioned camera is a front camera. The front camera may be a camera arranged on the front panel above the screen of the mobile terminal, or may be a camera integrated in the screen of a mobile terminal with a full screen.

Step 102, collect the face image of the target user through the camera.

After starting the camera, the mobile terminal collects the face image of the target user through the camera, and the target user refers to the user currently using the mobile terminal to unlock. Optionally, during the process of collecting images by the front camera, the mobile terminal displays the images captured by the front camera on the screen. For example, when the screen of the mobile terminal is already turned on when the face image of the target user is collected by the front camera, the image captured by the front camera is displayed on the unlock interface.

Optionally, if the mobile terminal does not collect the face image of the target user within the preset time period after starting the camera, then turn off the camera and stop the collection to avoid waste of power in the mobile terminal, wherein the preset time length can be a preset experience value, for example, the default duration is 8 seconds.

Step 103, detecting whether the face image of the target user matches the face image of the registered user.

After the mobile terminal obtains the face image of the target user, it detects whether the face image of the target user matches the face image of the registered user, performs identity verification on the target user through face matching, and detects whether the target user is It is one of the registered users who have the authority to unlock the mobile terminal to determine whether the mobile terminal can be unlocked, wherein the face image of the registered user has been collected and recorded by the camera of the mobile terminal in advance. It should be mentioned that the mobile terminal may have multiple registered users, as long as the face image of the target user matches any one of the face images of the multiple registered users, it is considered that the face image of the target user matches that of the registered user. Face images are matched.

In a possible implementation manner, the above-mentioned step 103 includes the following several sub-steps:

1. Extract the face features of the target user from the face image of the target user;

The mobile terminal obtains feature points in the face image of the target user, and obtains face features of the target user according to the above feature points. Among them, the feature points refer to feature points in the human face such as the corners of the eyes, the center of the eyeballs, the tip of the nose, and the corners of the mouth. Facial features include the distance from the center of the eyeball to the tip of the nose, the distance between the corners of the mouth on both sides, the width of the corners of the eyes, and so on.

2. Calculate the similarity between the face features of the target user and the face features of the registered user. The face features of the registered user are extracted from the face image of the registered user;

After acquiring the feature points in the face image of the target user, the mobile terminal acquires the feature points from the face image of the registered user, and obtains the face image of the registered user according to the position of the feature points in the face image of the registered user. facial features. For example, the mobile terminal obtains 30 feature points from the target user's face image, and then obtains the 30 feature points from the registered user's face image, and according to the 30 feature points in the registered user's face image Location, to obtain the facial features of the registered user. Afterwards, the mobile terminal calculates the similarity between the face features of the target user and the face features of the registered user. Exemplarily, algorithms such as an eigen face (Eigen face) algorithm and a local feature analysis algorithm may be used to calculate the similarity, which is not limited in this embodiment of the present application.

3. If the similarity is greater than the preset threshold value, it is determined that the face image of the target user matches the face image of the registered user.

If the similarity is greater than the preset threshold value, then determine that the face image of the target user matches the face image of the registered user; if the similarity is not greater than the preset threshold value, then determine that the face image of the target user matches the registered user The face image of the target user does not match, that is, the target user is not one of the registered users. Wherein, the preset threshold value is set according to actual experience, for example, it can be set to 70%, and when the similarity is greater than 70%, it is determined that the face image of the target user matches the face image of the registered user.

In a possible implementation manner, the face image of the registered user is acquired in the following manner: multiple face images of the registered user are collected by a camera, and the multiple face images of the registered user correspond to multiple face images of the registered user. Different angles; extract the facial features of the registered user from multiple face images of the registered user. In the registration phase, the registration is collected from multiple different angles of the registered user's face (such as six different angles: front, right, left, obliquely above, obliquely below, right front, and left front) Multiple face images of the user, so as to ensure that more complete facial features of the registered user can be extracted. In this way, in the subsequent unlocking process, the face image of the target user can be collected from any angle of the target user's face to complete face matching, which reduces the requirements for face angle and posture in the unlocking process, and helps Improve unlocking efficiency.

Step 104, if the face image of the target user matches the face image of the registered user, control the mobile terminal to switch from the locked screen state to the unlocked state.

If the face image of the target user matches the face image of the registered user, it is determined that the target user is one of the registered users, that is, the identity of the target user has been verified, and it is determined that it is one of the registered users who can unlock the mobile terminal , at this time, the mobile terminal is controlled to switch from the locked screen state to the unlocked state, and the mobile terminal is successfully unlocked.

Optionally, before the above step 104, the following steps are also included:

1. If the face image of the target user matches the face image of the registered user, an unlock prompt message will be displayed on the unlock interface.

After it is determined that the target user's face image matches the registered user's face image, the mobile terminal is not directly unlocked, but an unlocking prompt message is displayed on the unlocking interface, and the unlocking prompt message is used to prompt to perform an unlocking operation.

For example, please refer to FIG. 3 , the mobile terminal 201 collects the face image of the target user, and after detecting that the face image of the target user matches the face image of the registered user, the unlock prompt information displayed on the unlock interface 202 includes The arrow 203 and the text 204, wherein the content of the text 204 is to slide to unlock, thereby prompting the target user to perform an upward sliding operation in the direction indicated by the arrow 203 to complete the unlocking.

2. When the unlocking operation signal input in the unlocking interface is obtained, and the unlocking operation signal meets the second preset condition, control the mobile terminal to switch from the locked screen state to the unlocked state.

When the user performs the corresponding unlocking operation according to the unlocking prompt information, the mobile terminal obtains the unlocking operation signal, and if the unlocking operation signal meets the second preset condition, the mobile terminal switches from the locked screen state to the unlocked state; if the unlocking operation signal does not meet the second preset condition Two preset conditions, the mobile terminal continues to maintain the lock screen state. The above-mentioned unlocking operation refers to a simple and easy operation that can be performed on the mobile terminal for the user, such as clicking on the screen of the mobile terminal, sliding on the screen of the mobile terminal, wherein the second preset condition is set to enable unlocking The condition that the unlocking operation of the mobile terminal is simple and feasible, for example, the second preset condition is that the unlocking operation signal is a sliding operation signal along a specified direction, and another example is that the second preset condition is that the unlocking operation signal acts on a specified area of the screen Click action signal etc.

Optionally, if the face image of the target user does not match the face image of the registered user, the face matching fails, and the mobile terminal does not display the unlock prompt information in the unlock interface, but collects the face image of the target user again for verification. The face matches. Optionally, if the face image of the target user does not match the face image of the registered user, the mobile terminal obtains the number of consecutive times that the detection result does not match, and when the number of consecutive times reaches a preset threshold, the password input interface is displayed; When the number of consecutive times does not reach the preset threshold, the execution starts from the above step 102 again. Wherein, the preset threshold is set according to actual experience, for example, set to 3 times. The mobile terminal obtains the unlocking password input by the target user in the password input interface, and detects whether the unlocking password is correct. Registered users can pre-set the unlock password. The mobile terminal detects whether the unlocking password input by the target user is consistent with the unlocking password preset by the registered user; if so, the unlocking password input by the target user is correct; if not, the unlocking password input by the target user is incorrect. If the unlocking password is correct, then control the mobile terminal to switch from the locked screen state to the unlocking state; if the unlocking password is incorrect, then save the target image collected by the camera and lock the mobile terminal, wherein the target image is the face image of the target user, or , the target image is the image in front of the screen captured by the camera after the unlock password is determined to be incorrect. Through the above method, when the face matching fails, the user can be provided with other ways to unlock the mobile terminal, and in the case that the provided methods for identity verification fail, by locking the mobile terminal, it is possible to ensure that the user's mobile terminal is unlocked. data security.

Optionally, during the process of collecting the face image of the target user through the camera or detecting whether the face image of the target user matches the face image of the registered user, the unlocking interface displayed by the mobile terminal includes a password input control. When a trigger signal corresponding to the password input control in the unlocking interface is received, the password input interface is displayed, and the mobile terminal is unlocked by inputting the unlocking password for authentication. The mobile terminal obtains the unlock password entered in the password input interface; if the unlock password is correct, the mobile terminal switches from the locked screen state to the unlocked state; if the unlock password is incorrect, saves the image in front of the screen captured by the camera, and locks the mobile terminal terminal.

To sum up, in the embodiment of the present application, an unlocking method based on face recognition is provided. Compared with the password unlocking method, the user does not need to manually enter the password, which simplifies the operation. Compared with the fingerprint unlocking method, the operation requirements for the user are reduced, and the user only needs to face the camera of the mobile terminal. Therefore, the unlocking method provided by the embodiment of the present application is more convenient than the current unlocking method, and helps to improve the efficiency of unlocking.

In addition, in the embodiment of the present application, after the face matching is passed, it is not directly unlocked, but unlocked when an unlock operation signal triggered by the user is received, which can avoid the occurrence of accidental unlocking.

Fig. 4 is a flowchart showing a method for unlocking a mobile terminal according to another exemplary embodiment. The method may include the following steps:

Step 401, when the mobile terminal is in a screen-locked state, if it is detected that the motion state of the mobile terminal meets the first preset condition, start the camera.

Step 402, collecting the face image of the target user through the camera.

Step 403, detecting whether the face image of the target user matches the face image of the registered user.

Step 404, if the face image of the target user matches the face image of the registered user, turn on the screen, display an unlock interface, and display unlock prompt information on the unlock interface.

Step 405, when the unlocking operation signal input in the unlocking interface is acquired, and the unlocking operation signal meets the second preset condition, control the mobile terminal to switch from the locked screen state to the unlocked state.

The difference from the embodiment in FIG. 1 is that in this embodiment, when the mobile terminal detects that it is picked up for use, it only starts the camera to collect the face image of the target user. During the process of collecting the face image of the target user The screen is not turned on, and the screen is turned on after the face matching is passed, which helps to save the power of the mobile terminal.

Optionally, the mobile terminal is provided with a brightness sensor, and the brightness sensor is used to collect ambient light brightness. When the mobile terminal is in the locked screen state and detects that its own motion state meets the first preset condition, if the currently collected ambient light brightness is less than the preset brightness, the mobile terminal lights up the screen and starts the camera, and provides the camera with the help of the screen. Sufficient light ensures that the camera can capture clear and usable facial images. In addition, if the brightness of the currently collected ambient light is greater than the preset brightness, the mobile terminal only starts the camera but does not turn on the screen, and turns on the screen after the subsequent face matching is passed, so as to save the power of the mobile terminal. The aforementioned preset brightness may be a preset empirical value, which shall prevail to ensure that the camera can capture a clear and usable face image.

The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

Fig. 5 is a block diagram showing an unlocking device for a mobile terminal according to an exemplary embodiment. The device has the function of realizing the above-mentioned method example, and the function may be realized by hardware, or may be realized by executing corresponding software by the hardware. The device may include: a motion detection module 510 , a face collection module 520 , a face matching module 530 and an unlocking module 540 .

The motion detection module 510 is configured to activate the camera if it is detected that the motion state of the mobile terminal meets the first preset condition when the mobile terminal is in a screen-locked state.

The face collection module 520 is configured to collect the face image of the target user through the camera.

The face matching module 530 is configured to detect whether the face image of the target user matches the face image of the registered user.

An unlocking module 540, configured to control the mobile terminal to switch from the locked screen state to an unlocked state when the face image of the target user matches the face image of the registered user.

To sum up, in the embodiment of the present application, an unlocking method based on face recognition is provided. Compared with the password unlocking method, the user does not need to manually enter the password, which simplifies the operation. Compared with the fingerprint unlocking method, the operation requirements for the user are reduced, and the user only needs to face the camera of the mobile terminal. Therefore, the unlocking method provided by the embodiment of the present application is more convenient than the current unlocking method, and helps to improve the efficiency of unlocking.

In an optional embodiment provided based on the embodiment in FIG. 5 , the device further includes: a first display module (not shown in the figure).

The first display module is configured to display unlocking prompt information on an unlocking interface when the face image of the target user matches the face image of the registered user, and the unlocking prompt information is used to prompt to perform an unlocking operation.

The unlocking module 540 is further configured to control the mobile terminal to switch from the locked screen state when the unlocking operation signal input in the unlocking interface is acquired and the unlocking operation signal meets a second preset condition to the unlocked state.

In another optional embodiment provided based on the embodiment in FIG. 5 , the motion detection module 510 is configured to: acquire the angular velocity data collected by the gyroscope when the mobile terminal is in the lock screen state; The angular velocity data determines the motion state of the mobile terminal; when the motion state of the mobile terminal meets the first preset condition, start the camera; wherein the first preset condition refers to the movement The state in which the terminal rotates about an axis.

In another optional embodiment provided based on the embodiment in FIG. 5 , the face matching module 530 is configured to: extract the face features of the target user from the face image of the target user; calculate the The similarity between the facial features of the target user and the facial features of the registered user, the facial features of the registered user are extracted from the facial image of the registered user; when the similarity is greater than the preset When a threshold is set, it is determined that the face image of the target user matches the face image of the registered user.

In another optional embodiment provided based on the embodiment in FIG. 5 , the face collection module 520 is also configured to collect multiple face images of the registered user through the camera, and the multiple face images of the registered user The face image corresponds to multiple different angles of the face of the registered user; the face matching module 530 is also used to extract the face features of the registered user from the multiple face images of the registered user .

In another optional embodiment provided based on the embodiment in FIG. 5 , the camera is a front camera, and the device further includes: a second display module. The second display module is used to display the image captured by the front camera on the screen.

In another optional embodiment provided based on the embodiment in FIG. 5 , the device further includes: a count acquisition module, a third display module, a password acquisition module, and a security protection module (not shown in the figure).

The number of times acquisition module is used to acquire the continuous number of times that the detection result is a mismatch when the face image of the target user does not match the face image of the registered user.

The third display module is configured to display a password input interface when the number of consecutive times reaches a preset threshold.

A password obtaining module, configured to obtain the unlocking password input in the password input interface.

A security protection module, configured to save the target image collected by the camera and lock the mobile terminal when the unlock password is incorrect, wherein the target image is the face image of the target user, or the The target image is an image in front of the screen captured by the camera after it is determined that the unlock password is incorrect.

The unlocking module 540 is further configured to control the mobile terminal to switch from the locked screen state to the unlocked state when the unlock password is correct.

It should be noted that when the device provided by the above embodiment realizes its functions, it only uses the division of the above-mentioned functional modules as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional modules according to actual needs. That is, the content structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and the method embodiment provided by the above embodiment belong to the same idea, and the specific implementation process thereof is detailed in the method embodiment, and will not be repeated here.

Referring to FIG. 6 , it shows a structural block diagram of a terminal 100 provided by an exemplary embodiment of the present application. The terminal 100 may be a portable electronic device such as a mobile phone, a tablet computer, or a wearable device. The terminal 100 in this embodiment of the present application may include one or more of the following components: a processor 110 , a memory 120 and a touch display 130 .

Processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire terminal 100, and executes the terminal by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. 100's of various functions and processing data. Optionally, the processor 110 may use at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable LogicArray, PLA). implemented in the form of hardware. The processor 110 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly processes the operating system, user interface and application programs, etc.; the GPU is responsible for rendering and drawing the content that needs to be displayed on the touch screen 130 ; the modem is used for processing wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 110, but implemented by a single chip.

The memory 120 may include a random access memory (Random Access Memory, RAM), and may also include a read-only memory (Read-Only Memory). Optionally, the memory 120 includes a non-transitory computer-readable storage medium. The memory 120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the following method embodiments; the storage data area can store data created according to the use of the terminal 100 (such as audio data, phonebook) and the like.

Taking the operating system as an Android system as an example, the programs and data stored in the memory 120 are as shown in Figure 7A, the memory 120 is stored with a Linux kernel layer 220, a system runtime layer 240, an application framework layer 260 and an application layer 280 . The Linux kernel layer 220 provides underlying drivers for various hardware of the terminal 100, such as display drivers, audio drivers, camera drivers, Bluetooth drivers, Wi-Fi drivers, power management, and so on. The system runtime layer 240 provides main feature support for the Android system through some C/C++ libraries. For example, the SQLite library provides database support, the OpenGL/ES library provides 3D drawing support, and the Webkit library provides browser kernel support. The Android runtime library (Android Runtime) is also provided in the system runtime library layer 240, which mainly provides some core libraries and can allow developers to use the Java language to write Android applications. The application framework layer 260 provides various APIs that may be used when building applications. Developers can also use these APIs to build their own applications, such as activity management, window management, view management, notification management, content providers, Package management, call management, resource management, location management. There is at least one application program running in the application layer 280, and these application programs can be contact programs, SMS programs, clock programs, camera applications, etc. Communication programs, photo beautification programs, etc.

Taking the operating system as the IOS system as an example, the program and data stored in the memory 120 are as shown in Figure 7B, the IOS system includes: a core operating system layer 320 (Core OS layer), a core service layer 340 (Core Services layer), a media layer 360 (Media layer), touchable layer 380 (Cocoa Touch Layer). The core operating system layer 320 includes an operating system kernel, drivers, and underlying program frameworks. These underlying program frameworks provide functions closer to hardware for use by the program frameworks located in the core service layer 340 . The core service layer 340 provides system services and/or program frameworks required by applications, such as foundation framework, account framework, advertisement framework, data storage framework, network connection framework, geographic location framework, exercise framework and so on. The media layer 360 provides audio-visual interfaces for applications, such as interfaces related to graphics and images, interfaces related to audio technology, interfaces related to video technology, and wireless playback (AirPlay) interfaces of audio and video transmission technologies. The touchable layer 380 provides various commonly used interface-related frameworks for application development, and the touchable layer 380 is responsible for the user's touch interaction operation on the terminal 100 . Such as local notification service, remote push service, advertisement framework, game tool framework, message user interface interface (User Interface, UI) framework, user interface UIKit framework, map framework and so on.

Among the frameworks shown in FIG. 7B , frameworks related to most applications include, but are not limited to: the basic framework in the core service layer 340 and the UIKit framework in the touchable layer 380 . The basic framework provides many basic object classes and data types, and provides the most basic system services for all applications, regardless of UI. The class provided by the UIKit framework is a basic UI class library for creating a touch-based user interface. iOS applications can provide UI based on the UIKit framework, so it provides the infrastructure of the application for building user interfaces, drawing , Handle and user interaction events, respond to gestures, and more.

The touch display screen 130 is used to receive a user's touch operation on or near it using any suitable object such as a finger or a touch pen, and to display user interfaces of various application programs. The touch display screen 130 is usually arranged on the front panel of the terminal 130 . The touch display screen 130 can be designed as a full screen, a curved screen or a special-shaped screen. The touch display screen 130 can also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in this embodiment. in:

full screen

The full screen may refer to a screen design in which the screen-to-body ratio occupied by the touch display screen 130 on the front panel of the terminal 100 exceeds a threshold (such as 80% or 90% or 95%). One calculation method of the screen-to-body ratio is: (area of the touch screen 130/area of the front panel of the terminal 100)*100%; another calculation method of the screen-to-body ratio is: (the actual display area in the touch screen 130 Area of the screen/area of the front panel of the terminal 100)*100%; another calculation method of the screen-to-body ratio is: (diagonal line of the touch display screen 130/diagonal line of the front panel of the terminal 100)*100%. In the schematic example shown in FIG. 8A , almost all areas on the front panel of the terminal 100 are touch display screens 130 , and on the front panel 40 of the terminal 100 , other areas except the edge generated by the middle frame 41 , all of which are touch screens 130 . The four corners of the touch display screen 130 may be right angles or rounded corners.

The full screen may also be a screen design in which at least one front panel component is integrated inside or under the touch display screen 130 . Optionally, the at least one front panel component includes: a camera, a fingerprint sensor, a proximity light sensor, a distance sensor, and the like. In some embodiments, other components on the front panel of the traditional terminal are integrated into all or part of the area of the touch display 130, for example, after splitting the photosensitive element in the camera into multiple photosensitive pixels, each photosensitive Pixels are integrated in the black area of each display pixel in the touch display screen 130 . Since at least one front panel component is integrated inside the touch display screen 130 , the full screen has a higher screen-to-body ratio.

Of course, in some other embodiments, the front panel components on the front panel of the traditional terminal can also be arranged on the side or back of the terminal 100, for example, the ultrasonic fingerprint sensor is arranged under the touch screen 130, the bone conduction The handset is disposed inside the terminal 130, and the camera is disposed on a side of the terminal in a pluggable structure.

In some optional embodiments, when the terminal 100 adopts a full screen, a single side of the middle frame of the terminal 100, or two sides (such as left and right sides), or four sides (such as Edge touch sensors 120 are arranged on the upper, lower, left, and right sides), and the edge touch sensors 120 are used to detect touch operations, click operations, press operations, and slide operations of the user on the middle frame. at least one action. The edge touch sensor 120 may be any one of a touch sensor, a heat sensor, a pressure sensor, and the like. The user can perform operations on the edge touch sensor 120 to control the application programs in the terminal 100 .

curved screen

The curved screen refers to a screen design in which the screen area of the touch display 130 is not in a plane. Generally, the curved screen has at least one section: the section is curved, and the projection of the curved screen on any plane direction perpendicular to the section is a planar screen design, wherein the curved shape can be U-shaped. Optionally, the curved screen refers to a screen design in which at least one side is curved. Optionally, the curved screen means that at least one side of the touch display screen 130 extends to cover the middle frame of the terminal 100 . Since the side of the touch display screen 130 extends to cover the middle frame of the terminal 100, that is, the middle frame that originally does not have a display function and a touch function is covered as a displayable area and/or an operable area, so that the curved screen has more features. High screen-to-body ratio. Optionally, in the example shown in FIG. 8B , a curved screen refers to a screen design in which the left and right sides 42 are curved; or, a curved screen refers to a screen design in which the upper and lower sides are curved; or, A curved screen refers to a screen design in which the upper, lower, left, and right sides are curved. In an optional embodiment, the curved screen is made of a touch screen material with certain flexibility.

Shaped screen

A shaped screen is a touch display screen with an irregular appearance, and the irregular shape is not a rectangle or a rounded rectangle. Optionally, the special-shaped screen refers to a screen design in which protrusions, notches and/or holes are provided on the rectangular or rounded rectangular touch display screen 130 . Optionally, the protrusion, notch and/or hole can be located on the edge of the touch display screen 130, in the center of the screen or both. When the protrusion, notch and/or digging hole is set on one edge, it can be set in the middle or both ends of the edge; when the protrusion, notch and/or digging hole is set in the center of the screen, it can be set on the top of the screen region, upper left region, left region, lower left region, lower region, lower right region, right region, upper right region. When arranged in multiple regions, the protrusions, notches and digging holes can be distributed in a concentrated manner or in a dispersed manner; they can be distributed symmetrically or asymmetrically. Optionally, the number of the protrusions, notches and/or holes is not limited.

Since the special-shaped screen covers the upper forehead area and/or the lower forehead area of the touch display screen as a displayable area and/or an operable area, the touch display screen occupies more space on the front panel of the terminal, so the special-shaped screen also has Larger screen-to-body ratio. In some embodiments, the notch and/or the hole is used to accommodate at least one front panel component, the front panel component includes a camera, a fingerprint sensor, a proximity light sensor, a distance sensor, an earpiece, an ambient light sensor, a physical button, etc. at least one of .

Exemplarily, the notch can be provided on one or more edges, and the notch can be a semicircular notch, a right-angled rectangular notch, a rounded rectangular notch or an irregular-shaped notch. In the schematic example shown in FIG. 8C , the special-shaped screen may be a screen design in which a semicircular notch 43 is provided at the central position of the upper edge of the touch display 130, and the position vacated by the semicircular notch 43 is used for It is used to accommodate at least one front panel component in a camera, a distance sensor (also known as a proximity sensor), an earpiece, and an ambient light brightness sensor; as shown schematically in FIG. A screen design with a semicircular notch 44 in the central position, the position vacated by the semicircular notch 44 is used to accommodate at least one of the physical buttons, fingerprint sensor, and microphone; schematically shown in Figure 8E In an example, the special-shaped screen may be a screen design in which a semi-elliptical notch 45 is provided at the center of the lower edge of the touch display 130, and at the same time, a semi-elliptical notch is formed on the front panel of the terminal 100, and two semi-elliptical notches are formed. Shaped gaps form an elliptical area, which is used to accommodate physical keys or fingerprint recognition modules; in the example shown in Figure 8F, the special-shaped screen can be in the upper half of the touch display screen 130 The screen design is provided with at least one small hole 45, and the position vacated by the small hole 45 is used to accommodate at least one front panel component among the camera, the distance sensor, the earpiece, and the ambient light brightness sensor.

In addition, those skilled in the art can understand that the structure of the terminal 100 shown in the above drawings does not constitute a limitation on the terminal 100, and the terminal may include more or less components than those shown in the figure, or combine some components, or different component arrangements. For example, the terminal 100 also includes components such as a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (Wireless Fidelity, WiFi) module, a power supply, and a Bluetooth module, which will not be repeated here.

In an exemplary embodiment, a computer-readable storage medium is also provided, and at least one instruction is stored in the storage medium, and when the instruction is executed by the processor of the mobile terminal, the unlocking method provided by the above-mentioned embodiment is implemented. . Optionally, the above-mentioned computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

In an exemplary embodiment, a computer program product is also provided, and when the computer program product is executed, it is used to implement the unlocking method provided in the above method embodiments.

It should be understood that the "plurality" mentioned herein refers to two or more than two. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

The above are only exemplary embodiments of the application, and are not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application shall be included in the protection of the application. within range.

Claims (16)

1. a kind of unlocking method of mobile terminal, it is characterised in that methods described includes：

In the case where mobile terminal is in screen lock state, if detecting, the motion state of the mobile terminal meets first and preset Condition, then start camera；

The facial image of targeted customer is gathered by the camera；

Whether the facial image for detecting the targeted customer matches with the facial image of registered user；

If the facial image of the targeted customer and the facial image of the registered user match, the mobile terminal is controlled Released state is switched to by the screen lock state.

2. according to the method for claim 1, it is characterised in that the control mobile terminal is cut by the screen lock state Shift to before released state, in addition to：

If the facial image of the targeted customer and the facial image of the registered user match, shown in unlock interface Prompt message is unlocked, the unblock prompt message is used to prompt to perform unblock operation；

When getting the unblock operation signal that is inputted in the unlock interface, and to meet second default for the unblock operation signal During condition, the step of control mobile terminal switches to released state by the screen lock state is performed.

3. according to the method for claim 1, it is characterised in that it is described in the case where mobile terminal is in screen lock state, If detecting, the motion state of the mobile terminal meets the first preparatory condition, starts camera, including：

In the case where the mobile terminal is in the screen lock state, the angular velocity data of gyroscope collection is obtained；

The motion state of the mobile terminal is determined according to the angular velocity data；

If the motion state of the mobile terminal meets first preparatory condition, start the camera；Wherein, described One preparatory condition refers to the state that the mobile terminal rotates around axle.

4. according to the method for claim 1, it is characterised in that the facial image of the detection targeted customer whether with The facial image of registered user matches, including：

The face characteristic of the targeted customer is extracted from the facial image of the targeted customer；

The similarity between the face characteristic of the targeted customer and the face characteristic of the registered user is calculated, the registration is used The face characteristic at family is extracted from the facial image of the registered user；

If the similarity is more than predetermined threshold value, it is determined that the facial image of the targeted customer and the people of the registered user Face image matches.

5. according to the method for claim 4, it is characterised in that the facial image of the detection targeted customer whether with Before the facial image of registered user matches, in addition to：

Multiple facial images of the registered user, multiple facial images pair of the registered user are gathered by the camera Multiple different angles of the face of registered user described in Ying Yu；

The face characteristic of the registered user is extracted from multiple facial images of the registered user.

6. according to the method described in any one of claim 1 to 5, it is characterised in that the camera is front camera, described After starting camera, in addition to：

The image of the front camera shooting is shown in screen.

7. according to the method described in any one of claim 1 to 5, it is characterised in that the face of the detection targeted customer After whether image matches with the facial image of registered user, in addition to：

If the facial image of the targeted customer and the facial image of the registered user mismatch, testing result is obtained as not The read-around ratio of matching；

When the read-around ratio reaches predetermined threshold value, interface for password input is shown；

Obtain the unlocking pin inputted in the interface for password input；

If the unlocking pin is correct, the mobile terminal is controlled to switch to the released state by the screen lock state；

If the unlocking pin is incorrect, the target image of the camera collection is preserved, and locks the mobile terminal；Its In, the target image is the facial image of the targeted customer, or, the target image is it is determined that the unlocking pin The image in front of screen gathered after incorrect by the camera.

8. a kind of tripper of mobile terminal, it is characterised in that described device includes：

Motion detection block, in the case of being in screen lock state in mobile terminal, if detecting the fortune of the mobile terminal Dynamic state meets the first preparatory condition, then starts camera；

Face acquisition module, for gathering the facial image of targeted customer by the camera；

Face matching module, for detect the targeted customer facial image whether the facial image phase with registered user Match somebody with somebody；

Unlocked state, for when the facial image of the targeted customer matches with the facial image of the registered user, controlling Make the mobile terminal and released state is switched to by the screen lock state.

9. device according to claim 8, it is characterised in that described device also includes：

First display module, match for the facial image and the facial image of the registered user as the targeted customer When, unblock prompt message is shown in unlock interface, the unblock prompt message is used to prompt to perform unblock operation；

The unlocked state, it is additionally operable to work as the unblock operation signal for getting and inputting in the unlock interface, and the unblock When operation signal meets the second preparatory condition, the mobile terminal is controlled to switch to the released state by the screen lock state.

10. device according to claim 8, it is characterised in that the motion detection block, be used for：

In the case where the mobile terminal is in the screen lock state, the angular velocity data of gyroscope collection is obtained；

The motion state of the mobile terminal is determined according to the angular velocity data；

When the motion state of the mobile terminal meets first preparatory condition, start the camera；Wherein, described One preparatory condition refers to the state that the mobile terminal rotates around axle.

11. device according to claim 8, it is characterised in that the face matching module, be used for：

The face characteristic of the targeted customer is extracted from the facial image of the targeted customer；

The similarity between the face characteristic of the targeted customer and the face characteristic of the registered user is calculated, the registration is used The face characteristic at family is extracted from the facial image of the registered user；

When the similarity is more than predetermined threshold value, the facial image of the targeted customer and the people of the registered user are determined Face image matches.

12. device according to claim 11, it is characterised in that

The face acquisition module, it is additionally operable to gather multiple facial images of the registered user by the camera, it is described Multiple facial images of registered user correspond to multiple different angles of the face of the registered user；

The face matching module, it is additionally operable to extract the people of the registered user from multiple facial images of the registered user Face feature.

13. according to the device described in any one of claim 8 to 12, it is characterised in that the camera is front camera, institute Stating device also includes：

Second display module, for showing the image of the front camera shooting in screen.

14. according to the device described in any one of claim 8 to 12, it is characterised in that described device also includes：

Number acquisition module, for being mismatched when the facial image of the targeted customer and the facial image of the registered user When, acquisition testing result is unmatched read-around ratio；

3rd display module, for when the read-around ratio reaches predetermined threshold value, showing interface for password input；

Password acquisition module, obtain the unlocking pin inputted in the interface for password input；

Security protection module, for when the unlocking pin is incorrect, preserving the target image of the camera collection, and lock The fixed mobile terminal；Wherein, the target image is the facial image of the targeted customer, or, the target image is The image in front of screen gathered after it is determined that the unlocking pin is incorrect by the camera；

The unlocked state, it is additionally operable to, when the unlocking pin is correct, control the mobile terminal to be cut by the screen lock state Shift to the released state.

15. a kind of mobile terminal, it is characterised in that the mobile terminal includes processor and memory, the memory storage There is at least one instruction, at least one instruction is loaded by the processor and performed to realize as claim 1 to 7 is any The unlocking method of mobile terminal described in.

16. a kind of computer-readable recording medium, it is characterised in that at least one is stored with the computer-readable recording medium Bar is instructed, and at least one instruction is loaded as processor and performed to realize the movement as described in any one of claim 1 to 7 The unlocking method of terminal.