CN108229420B - Face recognition method and mobile terminal - Google Patents

Abstract

The invention discloses a face recognition method and a mobile terminal. The method includes: when a face recognition triggering operation is detected, photographing a face to be recognized to obtain an image of the face to be recognized; First scene information in the face image to be recognized; according to the first scene information, determine whether the scene mode corresponding to the face image to be recognized is a preset scene mode; if so, then according to the face template image corresponding to the preset scene mode, Perform face recognition on the face to be recognized; wherein, the first scene information includes at least one of the following: first sensor parameters in the mobile terminal when shooting the face image to be recognized, first depth information in the face image to be recognized, The proportion of the first face in the face image to be recognized. The invention can avoid the influence of the shooting scene on the face recognition process, effectively improve the face recognition efficiency, and improve the user experience.

Description

A face recognition method and mobile terminal

technical field

The present invention relates to the technical field of terminals, and in particular, to a face recognition method and a mobile terminal.

Background technique

With the development of intelligent terminal technology, face recognition technology is widely used in people's daily life. For example, in a smart terminal, face recognition technology is used to perform identity verification in the process of screen unlocking, electronic payment, and account login.

In practical applications, the user pre-enters the face template image in the smart terminal. During the face recognition process, the smart terminal captures the user's face image to be tested, and then compares the captured face image to be tested with the pre-recorded face image. The template image is matched, and if the match is successful, the user authentication is passed. However, the existing face recognition process has high requirements for shooting the face image to be measured. For example, the user needs to adjust the position of the camera for multiple times to shoot, resulting in low face recognition recognition efficiency and poor user experience.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a method for face recognition and a mobile terminal, so as to solve the problem of low recognition efficiency of existing face recognition.

In order to solve the above-mentioned technical problems, the present invention is realized as follows: a face recognition method, comprising:

When a triggering operation of face recognition is detected, the face to be recognized is photographed to obtain an image of the face to be recognized;

According to the to-be-recognized face image, determine the first scene information in the to-be-recognized face image;

According to the first scene information, determine whether the scene mode corresponding to the face image to be recognized is a preset scene mode;

If so, perform face recognition on the to-be-recognized face according to the face template image corresponding to the preset scene mode;

Wherein, the first scene information includes at least one of the following:

The first sensor parameters in the mobile terminal when the to-be-recognized face image is captured, the first depth information in the to-be-recognized face image, and the first face proportion in the to-be-recognized face image.

An embodiment of the present invention further provides a mobile terminal, including: a photographing module, a determining module, a judging module, and an identifying module, wherein:

The photographing module is used for photographing a face to be recognized to obtain an image of the face to be recognized when a triggering operation of face recognition is detected;

The determining module is configured to determine the first scene information in the to-be-recognized face image according to the to-be-recognized face image;

The judgment module is configured to judge whether the scene mode corresponding to the face image to be recognized is a preset scene mode according to the first scene information;

The recognition module is configured to, when the scene mode corresponding to the to-be-recognized face image is the preset scene mode, perform the processing on the to-be-recognized face according to the face template image corresponding to the preset scene mode. face recognition;

Wherein, the first scene information includes at least one of the following:

The first sensor parameters in the mobile terminal when the to-be-recognized face image is captured, the first depth information in the to-be-recognized face image, and the first face proportion in the to-be-recognized face image.

An embodiment of the present invention further provides a mobile terminal, including a processor, a memory, and a face recognition program stored on the memory and running on the processor, the face recognition program being executed by the processor The steps of implementing the above-described face recognition method when executed.

Embodiments of the present invention also provide a computer-readable storage medium, where a face recognition program is stored on the computer-readable storage medium, and when the face recognition program is executed by a processor, the above-mentioned face recognition method is implemented. step.

In this embodiment of the present invention, when a face recognition triggering operation is detected, a face to be recognized is photographed to obtain an image of the face to be recognized, and first scene information in the face image to be recognized is determined, wherein the first scene information Including at least one of the following: the first sensor parameter in the mobile terminal when shooting the face image to be recognized, the first depth information in the face image to be recognized, and the proportion of the first face in the face image to be recognized; The first scene information is used to determine whether the scene mode corresponding to the face image to be recognized is the preset scene mode, and then when it is determined that the scene mode corresponding to the face image to be recognized is the preset scene mode, according to the preset scene mode The face template image is used for face recognition of the face to be recognized, so as to avoid the influence of the shooting scene on the face recognition process, effectively improve the face recognition efficiency, and improve the user experience.

Description of drawings

The accompanying drawings described herein are used to provide further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

FIG. 1 is a schematic flowchart of a face recognition method according to an embodiment of the present invention;

2 is a schematic diagram of a face template image corresponding to a preset scene mode provided by an embodiment of the present invention;

3 is a schematic diagram of a face template image corresponding to a conventional face recognition mode provided by an embodiment of the present invention;

4 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention.

Detailed ways

The technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the corresponding drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The technical solutions provided by the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

Example 1

FIG. 1 is a schematic flowchart of a face recognition method according to an embodiment of the present invention. The method can be as follows.

Step 102: When a face recognition triggering operation is detected, the face to be recognized is photographed to obtain an image of the face to be recognized.

In practical applications, users may have the need to perform face recognition in specific scenarios. For example, when the mobile phone is placed flat on the table, the user wants to not pick up the mobile phone, but lean forward to enable the camera of the mobile phone to capture the face to be recognized. The face recognition operation can be realized when the face is part of the face.

The face template image corresponding to the existing conventional face recognition mode is obtained by shooting all the faces of the target face, because the face image to be recognized obtained by shooting in a specific scene may only contain part of the face to be recognized. face, so that the matching rate between the face image to be recognized and the corresponding face template image in the conventional face recognition mode is low, and the recognition accuracy rate of face recognition is low.

In order to meet the user's face recognition requirements in a specific scene, a preset scene mode is established in the mobile terminal before face recognition, that is, before a face recognition triggering operation is detected.

It should be noted that the preset scene mode can be established according to the actual face recognition scene needs of the user.

In what special scene the user wishes to perform face recognition in the future, that is, a preset scene mode corresponding to the special scene can be established in the mobile terminal. For example, the user needs to unlock the phone with face recognition when he wakes up in the morning. In the regular face recognition mode, the success rate of face recognition while lying down is low. Therefore, the user can use the unlocking scene while lying down in the morning, and then The face template image is entered in the unlocking scene, and then a preset scene mode corresponding to the unlocking scene is established in the mobile terminal according to the face template image entered in the unlocking scene.

In this embodiment of the present invention, before the face recognition triggering operation is detected, the method further includes:

Create preset scene modes;

Create preset scene modes, including:

When receiving the face template input instruction, photograph the target face to obtain the face template image;

According to the face template image, determine the second scene information and the first face feature information in the face template image;

A preset scene mode is established according to the second scene information and the first face feature information.

Specifically, the second scene information includes: second sensor parameters in the mobile terminal when the face template image is captured, second depth information in the face template image, and second face proportion in the face template image.

Wherein, the second sensor parameters include at least one of the following: gyroscope sensor parameters in the mobile terminal when the face template image is captured, and gravity sensor parameters in the mobile terminal when the face template image is captured.

FIG. 2 is a schematic diagram of a face template image corresponding to a preset scene mode provided by an embodiment of the present invention.

As shown in FIG. 2 , the face template image obtained by shooting in the shooting scene corresponding to the preset scene mode may only include part of the face of the target face.

After the mobile terminal captures the face template image, the second scene information and the first face feature information in the face template image are determined according to the face template image.

The mobile terminal acquires second sensor parameters (eg, gyro sensor parameters, gravity sensor parameters, etc.) in the mobile terminal when the face template image is captured, and the second sensor parameter can be used to determine the state of the mobile terminal when the face template image is captured , for example, lay flat, upright, etc.

For the face template image obtained by shooting, the mobile terminal determines the second face proportion in the face template image (that is, the area ratio of the face part in the whole image), and determines the second face proportion in the face template image. Depth information (eg distance, angle, etc. of face parts relative to background parts).

Determining the above-determined second sensor parameters, the second face proportion, and the second depth information as the second scene information in the face template image, wherein the second scene information is used to perform scene mode in the subsequent face recognition process judge.

Further, for the face template image obtained by shooting, the mobile terminal collects the pixel feature points of the face part in the face template image, and can focus on collecting the pixel feature points in the central area of the face part, and according to the collected data. The pixel feature points determine the first face feature information in the face template image, where the first face feature information is used for face matching and recognition in the subsequent face recognition process.

The mobile terminal establishes a preset scene mode according to the second scene information and the first face feature information in the face template image, so that the subsequent face recognition can be performed for the shooting scene corresponding to the preset scene mode, so as to meet the needs of users in special scenes. Facial recognition needs.

In the mobile terminal, the face template image corresponding to the conventional face recognition mode is also included. The face template image corresponding to the conventional face recognition mode does not include scene information, but only includes the face template image corresponding to the conventional face recognition mode. , the determined third face feature information is used to meet the user's face recognition needs in a conventional face recognition scene.

The face template image corresponding to the conventional face recognition mode includes all the target face, and it is necessary to ensure that the target face is entered as a frontal face, avoiding situations such as looking up, bowing, or tilting the head, and it is necessary to ensure that the target person in the face template image is entered. The face is relatively clear, that is to say, in the conventional face recognition mode, the input requirements of the face template image are relatively high.

FIG. 3 is a schematic diagram of a face template image corresponding to a conventional face recognition mode provided by an embodiment of the present invention.

The mobile terminal turns on the camera in the mobile terminal when detecting the face recognition triggering operation triggered by the user. The user aligns the camera of the mobile terminal, so that the camera takes pictures of the face to be recognized corresponding to the user within the viewing range, and obtains an image of the face to be recognized.

It should be noted that the face recognition trigger operation may be pressing a preset function key of the mobile terminal (for example, the power button, the main button, etc.), or it may be triggered by a preset operation (for example, tapping the screen, double-clicking the screen, raising the wrist) etc.), it can be a click payment control or a login control, or other face recognition trigger operations, which are not specifically limited here.

Step 104: Determine the first scene information in the to-be-recognized face image according to the to-be-recognized face image.

Specifically, the first scene information includes at least one of the following: first sensor parameters in the mobile terminal when the face image to be recognized is captured, first depth information in the face image to be recognized, and first depth information in the face image to be recognized. The proportion of a person's face.

Wherein, the first sensor parameters include at least one of the following: gyroscope sensor parameters in the mobile terminal when the face image to be recognized is captured, and gravity sensor parameters in the mobile terminal when the face image to be recognized is captured.

The mobile terminal acquires the first sensor parameters (for example, gyro sensor parameters, gravity sensor parameters, etc.) in the mobile terminal when the face image to be recognized is captured, and determines the proportion of the first face in the to-be-recognized face image (that is, to be recognized). Recognizing the area ratio of the face part in the whole image), and determining the first depth information in the face image to be recognized (for example, the distance, angle, etc. of the face part to be recognized relative to the background part).

At least one of the above-determined first sensor parameters, the first face proportion, and the first depth information is determined as the first scene information in the face image to be recognized.

By determining the first scene information in the face image to be recognized, the mobile terminal can determine the shooting scene when shooting the face image to be recognized.

In the embodiment of the present invention, it also includes:

When the preset activation conditions are met, the preset scene mode is activated;

Determine the first scene information in the to-be-recognized face image according to the to-be-recognized face image, including:

When the preset scene mode is turned on, the first scene information in the to-be-recognized face image is determined according to the to-be-recognized face image.

Compared with the third face feature information corresponding to the conventional face recognition mode, the first face feature information corresponding to the preset scene mode contains less face feature information. The security of face recognition is ensured, and the opening of the preset scene mode is restricted, so that the mobile terminal can start the preset scene mode for face recognition only when the preset activation conditions are met.

It should be noted that, the preset start condition may be set according to the actual needs of the user, which is not specifically limited here.

The preset activation condition may include: location a, time period b-c, and the mobile terminal automatically activates the preset scene mode when it is determined that the preset activation condition is satisfied. For example, the user can set the preset scene mode that enables the user to perform face recognition while lying down when the mobile terminal determines that the current geographic location is the preset home address every morning from 7:00 to 8:00, so that the user can When you wake up every morning, you can lie down and pick up your phone to unlock it through face recognition.

In addition, the preset activation condition may also be a verification password input by the user, and the mobile terminal starts the preset scene mode after receiving the verification password input by the user.

In the face recognition process, the mobile terminal first determines whether the preset scene mode is activated, and only when it is determined that the preset scene mode is activated does it further determine the first scene corresponding to the face image to be recognized according to the face image to be recognized information.

If the mobile terminal determines that the preset scene mode is not activated, it does not need to determine the first scene information, but performs face recognition on the face to be recognized according to the face template image corresponding to the conventional face recognition mode.

Step 106: According to the first scene information, determine whether the scene mode corresponding to the face image to be recognized is a preset scene mode.

Specifically, according to the first scene information, judging whether the scene mode corresponding to the face image to be recognized is a preset scene mode, including:

If the first scene information and the second scene information satisfy the preset matching condition, determine that the scene mode corresponding to the face image to be recognized is the preset scene mode;

Corresponding to the first scene information, the preset matching conditions include at least one of the following:

the first sensor parameter matches the second sensor parameter;

the first depth information matches the second depth information;

The proportion of the first face and the proportion of the second face match.

Match the first scene information in the to-be-recognized face image captured in the face recognition process with the second scene information in the face template image corresponding to the preset scene mode to obtain the first scene information and the second scene The matching degree between the information, if the matching degree is greater than the preset threshold, it means that the shooting scene when the face image to be recognized is captured and the shooting scene when the face template image is entered can correspond, and it can be determined that the face image to be recognized corresponds to The scene mode is the preset scene mode.

It should be noted that, the first scene information and the second scene information may be matched according to the above-mentioned one preset matching condition, or the first scene information and the second taste information may be comprehensively matched according to the above-mentioned multiple preset matching conditions. , no specific restrictions are made here.

Step 108: If the scene mode corresponding to the face image to be recognized is a preset scene mode, perform face recognition on the face to be recognized according to the face template image corresponding to the preset scene mode.

Specifically, performing face recognition on the face to be recognized according to the face template image corresponding to the preset scene mode, including:

determining the second face feature information in the face image to be recognized;

determining the degree of matching between the first face feature information and the second face feature information;

If the matching degree is greater than the preset threshold, it is determined that the face recognition to be recognized has passed.

After determining that the scene mode corresponding to the face image to be recognized is the preset scene mode, for the face image to be recognized, the mobile terminal collects the pixel feature points of the face part in the face image to be recognized, and can focus on collecting the face Part of the pixel feature points of the central area, and determine the second face feature information in the face image to be recognized according to the collected pixel feature points.

Matching the first face feature information and the second face feature information to determine the matching degree between the first face feature information and the second face feature information, if the matching degree is greater than a preset threshold, it means the person to be identified If the face is consistent with the target face, it can be determined that the face recognition to be recognized has passed.

If the matching degree between the first face feature information and the second face feature information is not greater than the preset threshold, that is, the face image to be recognized does not match the face template image corresponding to the preset scene mode.

At this time, in order to improve the fault tolerance rate of face recognition and avoid recognition errors caused by wrong scene judgment, the image to be recognized is matched with the face template image corresponding to the conventional face recognition mode, that is, the second person in the image to be recognized is judged. The face feature information, whether it matches the third face feature information in the face template image corresponding to the conventional face recognition mode. If it matches, it is determined that the recognition of the face to be recognized has passed; if it does not match, it is determined that the recognition of the face to be recognized has failed.

In the embodiment of the present invention, if according to the first scene information, it is determined that the scene mode corresponding to the face image to be recognized is not the preset scene mode, then the face template image corresponding to the conventional face mode is used to perform a face analysis of the face to be recognized. identify.

Specifically, it is determined whether the second face feature information in the face image to be recognized matches the third face feature information in the face template image corresponding to the conventional face recognition mode. If it matches, it is determined that the recognition of the face to be recognized has passed; if it does not match, it is determined that the recognition of the face to be recognized has failed.

According to the technical solution described in the embodiment of the present invention, when a triggering operation of face recognition is detected, the face to be recognized is photographed to obtain an image of the face to be recognized, and the first scene information in the image of the face to be recognized is determined, wherein the first The scene information includes at least one of the following: the first sensor parameter in the mobile terminal when the face image to be recognized is captured, the first depth information in the face image to be recognized, and the proportion of the first face in the face image to be recognized According to the first scene information, determine whether the scene mode corresponding to the face image to be recognized is a preset scene mode, and then when determining that the scene mode corresponding to the face image to be recognized is the preset scene mode, according to the preset scene mode The corresponding face template image is used for face recognition of the face to be recognized, so as to avoid the influence of the shooting scene on the face recognition process, effectively improve the face recognition efficiency, and improve the user experience.

Example 2

FIG. 4 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal 400 includes: a photographing module 401, a determining module 402, a judging module 403 and an identifying module 404, wherein:

The photographing module 401 is used for photographing a face to be identified to obtain an image of the face to be identified when a triggering operation of face recognition is detected;

A determination module 402, configured to determine the first scene information in the to-be-recognized face image according to the to-be-recognized face image;

The judgment module 403 is configured to judge whether the scene mode corresponding to the face image to be recognized is a preset scene mode according to the first scene information;

The identification module 404 is configured to, when the scene mode corresponding to the face image to be identified is a preset scene mode, perform face recognition on the face to be identified according to the face template image corresponding to the preset scene mode;

Wherein, the first scene information includes at least one of the following:

The first sensor parameters in the mobile terminal when shooting the face image to be recognized, the first depth information in the face image to be recognized, and the proportion of the first face in the face image to be recognized.

Optionally, the mobile terminal 400 further includes: a building module, wherein:

establishing a module for establishing a preset scene mode before detecting the triggering operation of face recognition;

The establishing module further includes: a photographing unit, a first determining unit and a establishing unit, wherein:

a photographing unit for photographing a target face to obtain a face template image when receiving a face template input instruction;

a first determining unit, configured to determine the second scene information and the first face feature information in the face template image according to the face template image;

a establishing unit for establishing a preset scene mode according to the second scene information and the first face feature information;

The second scene information includes: second sensor parameters in the mobile terminal when the face template image is captured, second depth information in the face template image, and second face proportion in the face template image.

Optionally, the judgment module 403 is specifically used for:

If the first scene information and the second scene information satisfy the preset matching condition, determine that the scene mode corresponding to the face image to be recognized is the preset scene mode;

Corresponding to the first scene information, the preset matching conditions include at least one of the following:

the first sensor parameter matches the second sensor parameter;

the first depth information matches the second depth information;

The proportion of the first face and the proportion of the second face match.

Optionally, the identification module 404 further includes: a second determining unit and a matching unit, wherein:

a second determining unit, configured to determine the second face feature information in the face image to be identified;

a matching unit for determining the degree of matching between the first face feature information and the second face feature information;

The second determining unit is further configured to determine that the face recognition to be recognized has passed when the matching degree is greater than the preset threshold.

Optionally, the first sensor parameters include at least one of the following: parameters of a gyroscope sensor in the mobile terminal when photographing a face image to be recognized, and parameters of a gravity sensor in the mobile terminal when photographing a face image to be recognized;

The second sensor parameters include at least one of the following: gyroscope sensor parameters in the mobile terminal when the face template image is captured, and gravity sensor parameters in the mobile terminal when the face template image is captured.

Optionally, the mobile terminal 400 further includes: a startup module, wherein:

a startup module, used to start the preset scene mode when the preset startup condition is met;

The determining module is specifically configured to: when the preset scene mode is turned on, determine the first scene information in the to-be-recognized face image according to the to-be-recognized face image.

The mobile terminal provided in the embodiment of the present invention can implement each process implemented by the mobile terminal in the foregoing method embodiment, and to avoid repetition, details are not described here.

5 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention,

The mobile terminal 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and Power 511 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in FIG. 5 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than the one shown, or combine some components, or different components layout. In this embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

Wherein, the processor 510 is configured to photograph a face to be recognized to obtain an image of the face to be recognized when a triggering operation of face recognition is detected; determine the first scene information in the face image to be recognized according to the image of the face to be recognized According to the first scene information, determine whether the scene mode corresponding to the face image to be recognized is a preset scene mode; if so, then according to the face template image corresponding to the preset scene mode, face recognition is performed on the face to be recognized; wherein, The first scene information includes at least one of the following: the first sensor parameter in the mobile terminal when the face image to be recognized is captured, the first depth information in the face image to be recognized, the first face in the face image to be recognized proportion.

When a face recognition trigger operation is detected, the face to be recognized is photographed to obtain an image of the face to be recognized, and the first scene information in the face image to be recognized is determined, wherein the first scene information includes at least one of the following: The first sensor parameters in the mobile terminal when shooting the face image to be recognized, the first depth information in the face image to be recognized, and the proportion of the first face in the face image to be recognized; according to the first scene information, determine Whether the scene mode corresponding to the face image to be recognized is the preset scene mode, and then when it is determined that the scene mode corresponding to the face image to be recognized is the preset scene mode, according to the face template image corresponding to the preset scene mode, the scene mode to be recognized Face recognition is performed on the face, so as to avoid the influence of the shooting scene on the face recognition process, effectively improve the face recognition efficiency, and improve the user experience.

It should be understood that, in this embodiment of the present invention, the radio frequency unit 501 can be used for receiving and sending signals during sending and receiving of information or during a call. Specifically, after receiving the downlink data from the base station, it is processed by the processor 510; The uplink data is sent to the base station. Generally, the radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with the network and other devices through a wireless communication system.

The mobile terminal provides the user with wireless broadband Internet access through the network module 502, such as helping the user to send and receive emails, browse web pages, access streaming media, and the like.

The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into audio signals and output as sound. Also, the audio output unit 503 may also provide audio output related to a specific function performed by the mobile terminal 500 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.

The input unit 504 is used to receive audio or video signals. The input unit 504 may include a graphics processor (Graphics Processing Unit, GPU) 5041 and a microphone 5042, and the graphics processor 5041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on the display unit 506 . The image frames processed by the graphics processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502 . The microphone 5042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 501 for output in the case of a telephone call mode.

The mobile terminal 500 also includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 5061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 5061 and the proximity sensor when the mobile terminal 500 is moved to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of mobile terminals (such as horizontal and vertical screen switching, related games , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 505 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, Infrared sensors, etc., are not repeated here.

The display unit 506 is used to display information input by the user or information provided to the user. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 507 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the mobile terminal. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072 . The touch panel 5071, also referred to as a touch screen, can collect the user's touch operations on or near it (such as the user's finger, stylus, etc., any suitable object or accessory on or near the touch panel 5071). operate). The touch panel 5071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 510, the command sent by the processor 510 is received and executed. In addition, the touch panel 5071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 5071 , the user input unit 507 may also include other input devices 5072 . Specifically, other input devices 5072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

Further, the touch panel 5071 can be covered on the display panel 5061. When the touch panel 5071 detects a touch operation on or near it, it transmits it to the processor 510 to determine the type of the touch event, and then the processor 510 determines the type of the touch event according to the touch The type of event provides a corresponding visual output on display panel 5061. Although in FIG. 5, the touch panel 5071 and the display panel 5061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 5071 and the display panel 5061 may be integrated The input and output functions of the mobile terminal are implemented, which is not specifically limited here.

The interface unit 508 is an interface for connecting an external device to the mobile terminal 500 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 508 may be used to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 500 or may be used between the mobile terminal 500 and the external Transfer data between devices.

The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function, and the like; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally, memory 509 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 510 is the control center of the mobile terminal, uses various interfaces and lines to connect various parts of the entire mobile terminal, runs or executes the software programs and/or modules stored in the memory 509, and calls the data stored in the memory 509. , perform various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 510.

The mobile terminal 500 may also include a power supply 511 (such as a battery) for supplying power to various components. Preferably, the power supply 511 may be logically connected to the processor 510 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system. and other functions.

In addition, the mobile terminal 500 includes some functional modules not shown, which will not be repeated here.

Preferably, an embodiment of the present invention also provides a mobile terminal, including a processor 510, a memory 509, a face recognition program stored in the memory 509 and runnable on the processor 510, the face recognition program being executed by the processor 510 During execution, each process of the above-mentioned embodiment of the face recognition method is implemented, and the same technical effect can be achieved. In order to avoid repetition, details are not repeated here.

Embodiments of the present invention further provide a computer-readable storage medium, where a face recognition program is stored on the computer-readable storage medium. When the face recognition program is executed by a processor, each process of the above-mentioned face recognition method embodiment is implemented, and can To achieve the same technical effect, in order to avoid repetition, details are not repeated here. The computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk, or an optical disk.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (11)

1. A face recognition method, comprising:

when the face recognition triggering operation is detected, shooting a face to be recognized to obtain a face image to be recognized;

determining first scene information in the facial image to be recognized according to the facial image to be recognized;

judging whether a scene mode corresponding to the face image to be recognized is a preset scene mode or not according to the first scene information;

if so, carrying out face recognition on the face to be recognized according to a face template image corresponding to the preset scene mode, wherein the face template image comprises a part of face of the target face;

wherein the first scene information includes at least one of:

when the face image to be recognized is shot, a first sensor parameter in a mobile terminal, first depth information in the face image to be recognized and a first face occupation ratio in the face image to be recognized are obtained;

before detecting the face recognition trigger operation, the method further comprises:

establishing the preset scene mode;

the establishing of the preset scene mode comprises:

when a face template input instruction is received, shooting a target face to obtain a face template image;

determining second scene information and first face characteristic information in the face template image according to the face template image;

establishing the preset scene mode according to the second scene information and the first face characteristic information;

wherein the second scenario information includes: and when the face template image is shot, the second sensor parameters in the mobile terminal, the second depth information in the face template image and the second face in the face template image account for a ratio, and the first face characteristic information is determined by carrying out pixel characteristic point acquisition on the face part in the face template image.

2. The method of claim 1, wherein the determining whether the scene mode corresponding to the face image to be recognized is a preset scene mode according to the first scene information comprises:

if the first scene information and the second scene information meet a preset matching condition, determining a scene mode corresponding to the face image to be recognized as the preset scene mode;

corresponding to the first scene information, the preset matching condition includes at least one of:

the first sensor parameter and the second sensor parameter match;

the first depth information and the second depth information are matched;

the first face occupation ratio and the second face occupation ratio are matched.

3. The method of claim 2, wherein the performing face recognition on the face to be recognized according to the face template image corresponding to the preset scene mode comprises:

determining second face feature information in the face image to be recognized;

determining the matching degree between the first face feature information and the second face feature information;

and if the matching degree is greater than a preset threshold value, determining that the face to be recognized passes the recognition.

4. The method of claim 1, wherein the first sensor parameter comprises at least one of: shooting parameters of a gyroscope sensor in the mobile terminal when the face image to be recognized is shot, and shooting parameters of a gravity sensor in the mobile terminal when the face image to be recognized is shot;

the second sensor parameter comprises at least one of: and parameters of a gyroscope sensor in the mobile terminal when the face template image is shot and parameters of a gravity sensor in the mobile terminal when the face template image is shot.

5. The method of claim 1, wherein the method further comprises:

when a preset starting condition is met, starting the preset scene mode;

the determining the first scene information in the facial image to be recognized according to the facial image to be recognized comprises the following steps:

and when the preset scene mode is started, determining the first scene information in the face image to be recognized according to the face image to be recognized.

6. A mobile terminal, comprising: shooting module, confirm module, judge module, identification module and establish the module, wherein:

the shooting module is used for shooting a face to be recognized to obtain a face image to be recognized when the face recognition triggering operation is detected;

the determining module is used for determining first scene information in the face image to be recognized according to the face image to be recognized;

the judging module is used for judging whether the scene mode corresponding to the face image to be recognized is a preset scene mode or not according to the first scene information;

the recognition module is used for carrying out face recognition on the face to be recognized according to a face template image corresponding to the preset scene mode when the scene mode corresponding to the face image to be recognized is the preset scene mode, wherein the face template image comprises a part of the face of a target face;

wherein the first scene information includes at least one of:

when the face image to be recognized is shot, a first sensor parameter in a mobile terminal, first depth information in the face image to be recognized and a first face occupation ratio in the face image to be recognized are obtained;

the establishing module is used for establishing the preset scene mode before the face recognition triggering operation is detected;

the establishing module further comprises: shooting unit, first confirm unit and set up the unit, wherein:

the shooting unit is used for shooting a target face to obtain a face template image when a face template input instruction is received;

the first determining unit is configured to determine, according to the face template image, second scene information and first face feature information in the face template image, where the first face feature information is determined by performing pixel feature point acquisition on a face part in the face template image;

the establishing unit is used for establishing the preset scene mode according to the second scene information and the first face characteristic information;

wherein the second scenario information includes: and when the face template image is shot, the second sensor parameters in the mobile terminal, the second depth information in the face template image and the second face in the face template image account for a ratio, and the first face characteristic information is determined by carrying out pixel characteristic point acquisition on the face part in the face template image.

7. The mobile terminal of claim 6, wherein the determining module is specifically configured to:

if the first scene information and the second scene information meet a preset matching condition, determining a scene mode corresponding to the face image to be recognized as the preset scene mode;

corresponding to the first scene information, the preset matching condition includes at least one of:

the first sensor parameter and the second sensor parameter match;

the first depth information and the second depth information are matched;

the first face occupation ratio and the second face occupation ratio are matched.

8. The mobile terminal of claim 7, wherein the identification module further comprises: a second determination unit and a matching unit, wherein:

the second determining unit is used for determining second face feature information in the face image to be recognized;

the matching unit is used for determining the matching degree between the first face feature information and the second face feature information;

the second determining unit is further configured to determine that the face to be recognized passes through recognition when the matching degree is greater than a preset threshold.

9. The mobile terminal of claim 6, wherein the first sensor parameter comprises at least one of: shooting parameters of a gyroscope sensor in the mobile terminal when the face image to be recognized is shot, and shooting parameters of a gravity sensor in the mobile terminal when the face image to be recognized is shot;

the second sensor parameter comprises at least one of: and parameters of a gyroscope sensor in the mobile terminal when the face template image is shot and parameters of a gravity sensor in the mobile terminal when the face template image is shot.

10. The mobile terminal of claim 6, further comprising: a start module, wherein:

the starting module is used for starting the preset scene mode when a preset starting condition is met;

the determining module is specifically configured to: and when the preset scene mode is started, determining the first scene information in the face image to be recognized according to the face image to be recognized.

11. A mobile terminal comprising a processor, a memory and a face recognition program stored on the memory and executable on the processor, the face recognition program when executed by the processor implementing the steps of the face recognition method according to any one of claims 1 to 5.

Images