CN107657167A - Face unlocking method, device, computer-readable storage medium and electronic device - Google Patents

Abstract

The application relates to a face unlocking method and device, a computer readable storage medium and an electronic device, which judge whether an unlocking action instruction of the electronic device is received or not by detecting the starting of a camera of the electronic device, control the camera to enter a first mode with low power consumption if the unlocking action instruction of the electronic device is judged to be received, use the first mode with low power consumption to identify the face, automatically unlock the electronic device if the face is identified and verified, control the camera of the electronic device to enter the first mode with low power consumption by judging the face identification needing face unlocking when the camera is started, unlock the face through the first mode, reduce the power consumption of the electronic device when the electronic device unlocks the face, not influence the face unlocking, especially when the face unlocking is needed frequently, the power consumption of the electronic equipment is obviously reduced when the face is unlocked, and the cost of the electronic equipment is not increased.

Description

Face unlocking method, device, computer-readable storage medium and electronic device

technical field

The present application relates to the technical field of electronic equipment application, and in particular to a face unlocking method, device, computer-readable storage medium and electronic equipment.

Background technique

With the development of smart electronic devices, in order to provide a better experience, there are various ways to unlock electronic devices, such as fingerprint unlocking, password unlocking, etc. With the development of artificial intelligence, face unlocking is also used more and more . When using face unlocking, in the traditional technology, the camera of the front camera is used for face recognition, and then deep learning and liveness detection are performed, so as to realize the safe and fast unlocking of electronic devices. However, when the face is unlocked, the front camera must be activated every time, resulting in excessive power consumption of the face unlock of the electronic device.

Contents of the invention

Embodiments of the present application provide a face unlocking method, device, computer-readable storage medium, and electronic device, which can reduce power consumption of the electronic device for face unlocking when the electronic device performs face unlocking.

A method for face unlocking, the method comprising:

If it is detected that the camera of the electronic device is activated, it is judged whether an instruction for unlocking the electronic device is received;

If it is judged that an instruction to unlock the electronic device is received, control the camera to enter a first mode, where the first mode is a low power consumption mode of the camera;

Using the first mode, face recognition is performed, and if the face recognition verification is passed, the electronic device is automatically unlocked.

A face unlocking device, said device comprising:

A judging module, configured to judge whether an instruction to unlock the electronic device is received if it is detected that the camera of the electronic device is activated;

A starting module, configured to control the camera to enter a first mode if it is judged that an unlocking action instruction of the electronic device is received, and the first mode is a low power consumption mode of the camera;

The unlocking module is configured to use the first mode to perform face recognition, and if the face recognition verification is passed, the electronic device is automatically unlocked.

A computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method are realized.

An electronic device includes a memory and a processor, wherein computer-readable instructions are stored in the memory, and when the instructions are executed by the processor, the processor executes the face unlocking method.

The face unlocking method, device, computer-readable storage medium, and electronic device of the embodiments of the present application determine whether an instruction to unlock the electronic device has been received by detecting that the camera of the electronic device is activated. Judging that the instruction for unlocking the electronic device has been received, controlling the camera to enter the first mode with low power consumption, and using the first mode with low power consumption to perform face recognition, if the face recognition verification is passed, the The electronic device is automatically unlocked, and the camera of the electronic device is controlled to enter the first mode of low power consumption by judging that the camera needs to be unlocked when the camera is started. The power consumption of the electronic device when the device performs face unlocking without affecting the face unlocking. On the basis of not changing the original hardware of the electronic device, especially when the electronic device needs to be unlocked frequently during the use of the electronic device, the power consumption of the electronic device during face unlocking is significantly reduced, and the cost of the electronic device is not increased.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic diagram of the internal structure of an electronic device in an embodiment of the present application;

Fig. 2 is a flowchart of an embodiment of the applicant's face unlocking method;

Fig. 3 is a flow chart of another specific embodiment of the applicant's face unlocking method;

FIG. 4 is a program module architecture diagram of an embodiment of the face unlocking device provided by the present application;

Fig. 5 is a block diagram of a partial structure of a mobile phone related to the electronic device provided by the embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

It can be understood that the terms "first", "second" and the like used in this application may be used to describe various elements herein, but these elements are not limited by these terms. These terms are only used to distinguish one element from another element. For example, a first mode could be termed a second mode, and, similarly, a second mode could be termed a first mode, without departing from the scope of the present application. Both the first mode and the second mode are mode ends, but they are not the same mode.

Fig. 1 is a schematic diagram of the internal structure of an electronic device in one embodiment. As shown in FIG. 1, the electronic device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor is used to provide calculation and control capabilities, and support the operation of the entire computer equipment. The memory is used to store data, programs, etc., and at least one computer program is stored on the memory, and the computer program can be executed by the processor to implement the face unlocking method suitable for electronic devices provided in the embodiments of the present application. The memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random-access-memory (Random-Access-Memory, RAM). For example, in one embodiment, the memory includes non-volatile storage media and internal memory. Nonvolatile storage media store operating systems and computer programs. The computer program can be executed by a processor, so as to implement a face unlocking method provided in the following embodiments. The internal memory provides a high-speed running environment for the operating system computer program in the non-volatile storage medium. The network interface can be an Ethernet card or a wireless network card, etc., and is used for communicating with external computer equipment. The electronic device may be a mobile phone, a notebook computer, a tablet computer, a personal digital assistant, a wearable device, or the like.

When an electronic device is unlocked by face, the traditional method of the electronic device is that when the screen of the electronic device is turned on, the front camera of the electronic device will be started, and after the front camera is started, the entire ISP ( Image Signal Processing, image signal processing) processors will be started, so that the entire power consumption of the bright screen will soar instantly, and as the user continues to brighten the screen and unlock the higher the frequency, the power consumption will become greater. Wherein, the ISP processor, which may also be called an ISP image signal processor, is mainly used to process the image signal output by the image sensor of the camera of the electronic device, so as to match the image sensors of different manufacturers.

The image sensor is an important part of a digital camera. According to the different components, it can be divided into two categories: CCD (Charge Coupled Device, charge-coupled device) and CMOS (Complementary Metal-Oxide Semiconductor, metal oxide semiconductor device). In order to reduce the power consumption of the electronic device when the electronic device performs face unlocking, taking the front camera as an example, two modes are designed for the image sensor of the front camera, which can also be referred to as the two modes of the camera:

(1) The first type is the low power consumption mode of the camera, which is called the first mode in the embodiment of this application. The image sensor of the camera is mainly used for portrait detection. When the camera of the electronic device is started, the Other functions of the image sensor of the above-mentioned camera are not turned on, such as the anti-shake function and the noise reduction function of the image sensor are not turned on, and only the portrait detection function of the image sensor is turned on, or the portrait detection function of the image sensor is turned on. On the detection function, add one or two other functions, such as only starting the portrait detection function and anti-shake function of the image sensor, or only starting the portrait detection function and noise reduction function of the image sensor.

(2) The second mode of the camera, referred to as the second mode in the embodiment of the present application, may also be called the normal mode of the camera, which belongs to the high power consumption mode. In order to ensure that the image sensor of the camera acquires high-quality images and meet the needs of taking pictures or videos, various functions of the image sensor of the camera are turned on, such as face detection, anti-shake and noise reduction.

Please refer to Figure 2, Figure 2 is a flowchart of an embodiment of the applicant's face unlocking method, the method includes:

Step 200, if it is detected that the camera of the electronic device is activated, determine whether an instruction to unlock the electronic device is received.

Specifically, the camera of the electronic device, if the electronic device is provided with a fixed front camera and rear camera, may refer to the front camera or the rear camera of the electronic device; if the electronic device is provided with a fixed A rotatable camera, especially when the camera is rotatable to face the face of the face unlocker, may refer to the rotatable camera. In short, the camera of the electronic device refers to a camera capable of face unlocking.

The instruction of the unlocking action refers to that when the electronic device is in the bright screen state, any action that can trigger the display of the screen unlocking interface is included in the instruction range of the unlocking action, including the instruction of pressing the display unlocking interface button, or sliding An instruction on the screen, or an instruction to open an application set on the unlocking display interface, such as an application for making a call, or an unlocked virtual key.

If the electronic device detects that the camera of the electronic device is activated, it indicates that the electronic device is in a bright screen state. At this time, the electronic device judges whether an unlocking action instruction has been received, for example, whether it has received an instruction to press and display an unlock interface button, Or an instruction to slide the screen, or an instruction to open an application program set on the unlocking display interface, such as an application program for making a call, or a virtual key for unlocking, etc., which can trigger the display of the screen unlocking interface.

If the electronic device determines that an unlocking instruction is received, go to step 220 .

Step 220: If it is determined that an instruction to unlock the electronic device is received, control the camera to enter a first mode, where the first mode is a low power consumption mode of the camera.

Specifically, if the electronic device detects that the camera of the electronic device is activated, and further judges that an instruction to unlock the electronic device has been received, indicating that the camera of the electronic device is activated for face unlocking, then the electronic device is activated. The camera enters the low power consumption mode of the camera, and uses the low power consumption mode of the first mode of the camera to process the detected face image, thereby reducing the power consumption of the electronic device when the electronic device performs face unlocking. power consumption.

If the electronic device judges that it has received the instruction of the unlocking action of the electronic device, it indicates that the electronic device will perform face unlocking, and at this time start the camera to enter the low power consumption mode of the camera to perform face unlocking, thereby realizing When the electronic device performs face unlocking, the power consumption of the electronic device for face unlocking is reduced.

Step 240, use the first mode to perform face recognition, and if the face recognition verification is passed, the electronic device is automatically unlocked.

Specifically, the electronic device uses the low power consumption of the first mode of the camera to process the image for face recognition, and if the detected face information matches the face information for face unlocking pre-stored in the electronic device, It is determined that the electronic device is automatically unlocked through the face recognition verification, so that when the electronic device is unlocked by the face, low power consumption of the electronic device is realized.

In one embodiment, the first mode only includes the portrait detection function.

Specifically, in order to reduce the power consumption of the electronic device when the electronic device is unlocked by the face, only the portrait detection function of the image sensor in the camera is enabled, and other functions of the image sensor in the camera are not enabled, such as the The noise reduction function and the anti-shake function of the image sensor are not turned on, so as to reduce the power consumption of the camera for face unlocking and face detection, thereby reducing the power consumption of the entire electronic device when performing face unlocking .

Further, the electronic device adds one or two other functions to the portrait detection function of the image sensor, such as only enabling the portrait detection function and anti-shake function of the image sensor, or only enabling the The portrait detection function and noise reduction function, etc., can also achieve the purpose of reducing power consumption compared with when the functions of the image sensor described in the traditional technology are activated.

Wherein, the camera of the electronic device refers to an imaging device of the electronic device, or called a camera, and the camera mainly includes a lens and an image sensor.

In one embodiment, the step of judging whether an instruction to unlock the electronic device is received includes:

judging whether an instruction to open the application program corresponding to the camera of the electronic device is received;

If it is determined that the instruction to open the application program corresponding to the camera of the electronic device is not received, it is determined that an instruction to unlock the electronic device is received.

Specifically, the electronic device judges whether an instruction to unlock the electronic device has been received, in addition to judging whether an action that triggers the display of the screen unlock interface is received, such as an instruction to press a button to display the unlock interface, or an instruction to slide the screen, or The command to open the application program set on the unlock display interface can also be determined by judging whether to receive the command to open the application program corresponding to the camera of the electronic device, such as the application program related to the camera on the electronic device, such as camera, video APP (application program, the abbreviation of Application), live broadcast APP, or camera APP and other applications. If the electronic device determines that it has received an instruction to open the application program corresponding to the camera of the electronic device, then it is determined that the camera is started due to the opening of the above application program; otherwise, if the electronic device determines that it has not received the instruction to open the electronic device If the instruction of the application program corresponding to the camera is used, it is determined that the instruction of the unlocking action of the electronic device is received.

In one embodiment, the method also includes:

If it is determined that an instruction to open the application program corresponding to the camera of the electronic device is received, the camera is started to enter a second mode, and the power consumption of the second mode is greater than the power consumption of the first mode.

Specifically, if the electronic device determines that an instruction to open the application program corresponding to the camera of the electronic device is received, it is determined that the camera is started due to the opening of the above-mentioned application program. In order to meet the high-quality requirements of the application program for images, For example, to meet the requirements of clear and beautiful images, start the image sensor of the camera to enter the second mode. The second mode is a mode that includes functions other than portrait detection, such as noise reduction and anti-shake functions. Therefore, the The power consumption of the second mode is greater than the power consumption of the first mode.

In one embodiment, the portrait size of the portrait detection in the first mode is set to be equal to or smaller than a preset size threshold.

Specifically, in order to further reduce the power consumption of the electronic device when the face is unlocked, the electronic device can control the size of the portrait detected by the image sensor of the camera of the electronic device to be equal to or smaller than the preset size threshold to meet the needs of face unlocking. That is, the pixels of the preset size threshold may be 640x480, that is, the size of the image detected by the portrait is less than or equal to 640x480 pixels, may be 640x480 pixels, or may be 320x240 pixels. Since the image size of face detection is controlled within a preset small range, the image size output by the image sensor of the camera becomes very small, which can not only meet the needs of face detection when face unlocking, but also reduce the size of the face. The power consumption of the electronic device when unlocking can also increase the image output speed of the electronic device for face unlocking.

In one embodiment, the image output frame rate of the portrait detection in the first mode is set to be output at a preset frame rate.

Specifically, frame rate (Frame rate) is a metric used to measure the number of displayed frames. The so-called measurement unit is the number of display frames per second (Frames per Second, referred to as: FPS) or "Hertz" (Hz). Frames per second (fps), or frame rate, indicates how many times per second the graphics processor can update a field. If the frame rate is too high, the power of the graphics processing processor will be wasted.

Therefore, in order to further reduce the power consumption of the electronic device during face unlocking, the electronic device may also control the frame rate of the image output by the image sensor of the camera of the electronic device to meet the needs of face unlocking. The frame rate ranges from 10 to 20 frames per second, and the frame rate can also be controlled at 12 to 18 frames per second. In general, the frame rate selection is controlled at 15 frames per second to achieve image quality and performance. The better balanced state of power consumption can also meet the use requirements of face unlocking. Compared with the normal output frame rate of 30 frames per second, the power consumption of the electronic device can be greatly reduced.

In one embodiment, the clock frequency of the portrait detection in the first mode is set to be lower than the original clock frequency by a preset ratio.

Specifically, the clock frequency (also translated: clock frequency speed, English: clock rate) refers to the basic frequency of the clock in the synchronous circuit, which is measured by "several cycles per second", and the measurement unit adopts the SI unit Hertz (Hz) . There are many semiconductor chips in electronic equipment, and each chip works at a specific clock frequency. The clock signal provided by the clock generator to the chip is a continuous pulse signal, and the pulse is equivalent to the pulse of the chip. Every time a pulse arrives, the transistor in the chip changes state once, allowing the entire chip to complete a certain task.

In order to further reduce the power consumption of the electronic device when the face is unlocked, the electronic device can also reduce the clock frequency of the image sensor of the camera of the electronic device when performing portrait detection, so as to meet the needs of the face unlock. Reducing the clock frequency of the image sensor of the camera of the electronic device can control the clock frequency of the electronic device by using an IIC (Inter-Integrated Circuit, integrated circuit bus) communication protocol through programming. The clock frequency of the portrait detection in the first mode is set to be reduced from the original clock frequency by a preset ratio, for example, the clock frequency of the portrait detection in the first mode can be reduced by 40% on the basis of the original clock frequency, that is The clock frequency of the portrait detection in the first mode is 60% of the original clock frequency, thereby reducing the speed of image output frequency during face detection, thereby reducing the power consumption of the electronic device.

Please refer to Figure 3, Figure 3 is a flowchart of another specific embodiment of the applicant's face unlocking method, the method includes:

Step 301, the electronic device detects that the camera is started, and enters step 302;

Step 302, the electronic device judges whether it has received an instruction to unlock the electronic device, if the electronic device has received an instruction to unlock the electronic device, go to step 303, otherwise go to step 304;

Step 303: If the electronic device judges that an instruction to unlock the electronic device has been received, control the camera of the electronic device to enter the first mode to perform portrait detection for face unlocking. The portrait size of the portrait detection in the first mode is determined by Set to be equal to or less than the preset size threshold, the frame rate of the image output of the portrait detection in the first mode is output at the preset frame rate, and the clock frequency of the portrait detection in the first mode is equal to the original clock frequency by a preset ratio lower on the basis;

Step 304, if the electronic device judges that the instruction for unlocking the electronic device has not been received, the camera of the electronic device enters the second mode to take photos or videos normally;

Step 305, the camera of the electronic device uses the first mode to perform face recognition, and matches the detected face recognition information with the face information of face unlocking pre-stored in the electronic device to perform face verification , go to step 306;

Step 306, if the electronic device passes the face recognition verification of portrait detection, go to step 307, otherwise, go back to step 305;

Step 307: If the electronic device passes the face recognition verification of the portrait detection, the electronic device is automatically unlocked.

In the face unlocking method of the embodiment of the present application, by detecting that the camera of the electronic device is activated, it is judged whether an instruction to unlock the electronic device has been received, and if it is determined that an instruction to unlock the electronic device has been received, the control unit The camera enters the first mode of low power consumption, and uses the first mode of low power consumption to perform face recognition. If the face recognition verification is passed, the electronic device is automatically unlocked. By judging that the camera needs to perform face recognition when it is started, Face recognition for unlocking, thereby controlling the camera of the electronic device to enter the first mode of low power consumption, and performing face unlocking through the first mode, which reduces the power consumption of the electronic device when the electronic device performs face unlocking, and Does not affect face unlock. On the basis of not changing the original hardware of the electronic device, especially when the electronic device needs to be unlocked frequently during the use of the electronic device, the power consumption of the electronic device during face unlocking is significantly reduced, and the cost of the electronic device is not increased.

Please refer to Figure 4, Figure 4 is a program module architecture diagram of an embodiment of the face unlocking device provided by the present application, the device includes:

The judging module 40 is configured to judge whether an instruction of an unlocking action of the electronic device is received if it is detected that the camera of the electronic device is activated.

Specifically, the camera of the electronic device, if the electronic device is provided with a fixed front camera, may refer to the front camera of the electronic device; if the electronic device is provided with a rotatable camera, especially when the When the camera can be rotated to an angle facing the face for face unlocking, it may refer to the rotatable camera. In short, the camera of the electronic device refers to a camera capable of face unlocking.

The instruction of the unlocking action refers to that when the electronic device is in the bright screen state, any action that can trigger the display of the screen unlocking interface is included in the instruction range of the unlocking action, including the instruction of pressing the display unlocking interface button, or sliding An instruction on the screen, or an instruction to open an application set on the unlocking display interface, such as an application for making a call, or an unlocked virtual key.

If the electronic device detects that the camera of the electronic device is activated, it indicates that the electronic device is in a bright screen state. At this time, the electronic device judges whether an unlocking action instruction has been received, for example, whether it has received an instruction to press and display an unlock interface button, Or an instruction to slide the screen, or an instruction to open an application program set on the unlocking display interface, such as an application program for making a call, or a virtual key for unlocking, etc., which can trigger the display of the screen unlocking interface.

The starting module 42, if it is determined that an instruction of an unlocking action of the electronic device is received, controls the camera to enter a first mode, and the first mode is a low power consumption mode of the camera.

Specifically, if the electronic device detects that the camera of the electronic device is activated, and further judges that an instruction to unlock the electronic device has been received, indicating that the camera of the electronic device is activated for face unlocking, then the electronic device is activated. The camera enters the low power consumption mode of the camera, and uses the low power consumption mode of the first mode of the camera to process the detected face image, thereby reducing the power consumption of the electronic device when the electronic device performs face unlocking. power consumption.

If the electronic device judges that it has received the instruction of the unlocking action of the electronic device, it indicates that the electronic device will perform face unlocking, and at this time start the camera to enter the low power consumption mode of the camera to perform face unlocking, thereby realizing When the electronic device performs face unlocking, the power consumption of the electronic device for face unlocking is reduced.

The unlocking module 44 uses the first mode to perform face recognition, and if the face recognition verification is passed, the electronic device is automatically unlocked.

Specifically, the electronic device uses the low power consumption of the first mode of the camera to process the image for face recognition, and if the detected face information matches the face information for face unlocking pre-stored in the electronic device, It is determined that the electronic device is automatically unlocked through the face recognition verification, so that when the electronic device is unlocked by the face, low power consumption of the electronic device is realized.

In one embodiment, the first mode only includes the portrait detection function.

Specifically, in order to reduce the power consumption of the electronic device when the electronic device is unlocked by the face, only the portrait detection function of the image sensor in the camera is enabled, and other functions of the image sensor in the camera are not enabled, such as the The noise reduction function and the anti-shake function of the image sensor are not turned on, so as to reduce the power consumption of the camera for face unlocking and face detection, thereby reducing the power consumption of the entire electronic device when performing face unlocking .

Wherein, the camera of the electronic device refers to an imaging device of the electronic device, or called a camera, and the camera mainly includes a lens and an image sensor.

In one embodiment, the judging module 40 includes:

A first judging unit, configured to judge whether an instruction to open an application program corresponding to the camera of the electronic device is received;

The second judging unit is configured to judge that an instruction to unlock the electronic device is received if it is judged that the instruction to open the application program corresponding to the camera of the electronic device is not received.

Specifically, the electronic device judges whether an instruction to unlock the electronic device has been received, in addition to judging whether an action that triggers the display of the screen unlock interface is received, such as an instruction to press a button to display the unlock interface, or an instruction to slide the screen, or The command to open the application program set on the unlock display interface can also be determined by judging whether to receive the command to open the application program corresponding to the camera of the electronic device, such as the application program related to the camera on the electronic device, such as camera, video APP (application program, the abbreviation of Application), live broadcast APP, or camera APP and other applications. If the electronic device determines that it has received an instruction to open the application program corresponding to the camera of the electronic device, then it is determined that the camera is started due to the opening of the above application program; otherwise, if the electronic device determines that it has not received the instruction to open the electronic device If the instruction of the application program corresponding to the camera is used, it is determined that the instruction of the unlocking action of the electronic device is received.

In one embodiment, the method also includes:

The second mode entry module is used to start the camera to enter the second mode if it is determined that an application program corresponding to the camera of the electronic device is received, and the power consumption of the second mode is greater than that of the first mode. power consumption.

Specifically, if the electronic device determines that an instruction to open the application program corresponding to the camera of the electronic device is received, it is determined that the camera is started due to the opening of the above-mentioned application program. In order to meet the high-quality requirements of the application program for images, For example, to meet the requirements of clear and beautiful images, start the image sensor of the camera to enter the second mode. The second mode is a mode that includes functions other than portrait detection, such as noise reduction and anti-shake functions. Therefore, the The power consumption of the second mode is greater than the power consumption of the first mode.

In one embodiment, the portrait size of the portrait detection in the first mode is set to be equal to or smaller than a preset size threshold.

Specifically, in order to further reduce the power consumption of the electronic device when the face is unlocked, the electronic device can control the size of the portrait detected by the image sensor of the camera of the electronic device to be equal to or smaller than the preset size threshold to meet the needs of face unlocking. That is, the pixels of the preset size threshold may be 640x480, that is, the size of the image detected by the portrait is less than or equal to 640x480 pixels, may be 640x480 pixels, or may be 320x240 pixels. Since the image size of face detection is controlled within a preset small range, the image size output by the image sensor of the camera becomes very small, which can not only meet the needs of face detection when face unlocking, but also reduce the size of the face. The power consumption of the electronic device when unlocking can also increase the image output speed of the electronic device for face unlocking.

In one embodiment, the image output frame rate of the portrait detection in the first mode is set to be output at a preset frame rate.

Specifically, frame rate (Frame rate) is a metric used to measure the number of displayed frames. The so-called measurement unit is the number of display frames per second (Frames per Second, referred to as: FPS) or "Hertz" (Hz). Frames per second (fps), or frame rate, indicates how many times per second the graphics processor can update a field. If the frame rate is too high, the power of the graphics processing processor will be wasted.

Therefore, in order to further reduce the power consumption of the electronic device during face unlocking, the electronic device may also control the frame rate of the image output by the image sensor of the camera of the electronic device to meet the needs of face unlocking. The frame rate ranges from 10 to 20 frames per second, and the frame rate can also be controlled at 12 to 18 frames per second. In general, the frame rate selection is controlled at 15 frames per second to achieve image quality and performance. The better balanced state of power consumption can also meet the use requirements of face unlocking. Compared with the normal output frame rate of 30 frames per second, the power consumption of the electronic device can be greatly reduced.

In one embodiment, the clock frequency of the portrait detection in the first mode is set to be lower than the original clock frequency by a preset ratio.

Specifically, the clock frequency (also translated: clock frequency speed, English: clock rate) refers to the basic frequency of the clock in the synchronous circuit, which is measured by "several cycles per second", and the measurement unit adopts the SI unit Hertz (Hz) . There are many semiconductor chips in electronic equipment, and each chip works at a specific clock frequency. The clock signal provided by the clock generator to the chip is a continuous pulse signal, and the pulse is equivalent to the pulse of the chip. Every time a pulse arrives, the transistor in the chip changes state once, allowing the entire chip to complete a certain task.

In order to further reduce the power consumption of the electronic device when the face is unlocked, the electronic device can also reduce the clock frequency of the image sensor of the camera of the electronic device when performing portrait detection, so as to meet the needs of the face unlock. Reducing the clock frequency of the image sensor of the camera of the electronic device can control the clock frequency of the electronic device by using an IIC (Inter-Integrated Circuit, integrated circuit bus) communication protocol through programming. The clock frequency of the portrait detection in the first mode is set to be reduced from the original clock frequency by a preset ratio, for example, the clock frequency of the portrait detection in the first mode can be reduced by 40% on the basis of the original clock frequency, that is The clock frequency of the portrait detection in the first mode is 60% of the original clock frequency, thereby reducing the speed of image output frequency during face detection, thereby reducing the power consumption of the electronic device.

The division of each module in the above-mentioned face unlocking device is only for illustration. In other embodiments, the face unlocking device can be divided into different modules according to needs, so as to complete all or part of the above-mentioned face unlocking device. Function.

The above-mentioned face unlocking device can be implemented in the form of a computer program, and the computer program can run on the electronic device as shown in FIG. 1 .

The embodiment of the present application also provides a computer-readable storage medium. One or more non-transitory computer-readable storage media containing a computer program that, when executed by one or more processors, causes the processors to:

A computer program product containing instructions, when running on a computer, causes the computer to execute the steps of the face unlocking method described in the above embodiments.

The embodiment of the present application also provides an electronic device. The above computer equipment includes an image processing circuit, which may be implemented by hardware and/or software components, and may include various processing units defining an ISP (Image Signal Processing, image signal processing) pipeline. Fig. 5 is a schematic diagram of an image processing circuit in one embodiment. As shown in FIG. 5 , for ease of description, only various aspects of the image processing technology related to the embodiment of the present application are shown.

As shown in FIG. 5 , the image processing circuit includes an ISP image signal processor 540 and a control logic 550 . Image data captured by imaging device 510 is first processed by ISP image signal processor 540, which analyzes the image data to capture image statistics that can be used to determine and/or control one or more parameters of imaging device 510 . Imaging device 510 may include a camera having one or more lenses 512 and an image sensor 514 . The image sensor 514 can include a color filter array (such as a Bayer filter), and the image sensor 514 can obtain light intensity and wavelength information captured by each imaging pixel of the image sensor 514, and provide a color filter that can be processed by the ISP image signal processor 540. Group raw image data. The sensor 520 (such as a gyroscope) can provide the collected image processing parameters (such as anti-shake parameters) to the ISP image signal processor 540 based on the interface type of the sensor 520 . The interface of the sensor 520 may utilize a SMIA (Standard Mobile Imaging Architecture, Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the above interfaces.

In addition, the image sensor 514 can also send raw image data to the sensor 520, and the sensor 520 can provide the raw image data to the ISP image signal processor 540 based on the interface type of the sensor 520, or the sensor 520 can store the raw image data in the image memory 530 .

The ISP image signal processor 540 processes raw image data pixel by pixel in various formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP image signal processor 540 may perform one or more image processing operations on raw image data, collect statistical information about the image data. Among other things, image processing operations can be performed with the same or different bit depth precision.

The ISP image signal processor 540 may also receive image data from the image memory 530 . For example, the sensor 520 interface sends the original image data to the image memory 530, and the original image data in the image memory 530 is provided to the ISP image signal processor 540 for processing. The image memory 530 may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include a DMA (Direct Memory Access, Direct Memory Access) feature.

When receiving raw image data from the image sensor 514 interface or from the sensor 520 interface or from the image memory 930, the ISP image signal processor 540 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to image memory 530 for additional processing before being displayed. The ISP image signal processor 540 receives processed data from the image memory 530 and performs image data processing in the original domain and in the RGB and YCbCr color spaces on the processed data. The image data processed by the ISP image signal processor 540 may be output to the display 570 for viewing by the user and/or for further processing by a graphics engine or a GPU (Graphics Processing Unit, graphics processor). In addition, the output of the ISP image signal processor 540 may also be sent to the image memory 530 , and the display 570 may read image data from the image memory 530 . In one embodiment, image memory 530 may be configured to implement one or more frame buffers. Also, the output of the ISP image signal processor 540 may be sent to an encoder/decoder 560 for encoding/decoding image data. The encoded image data may be saved and decompressed prior to display on the display 570 device. Encoder/decoder 560 may be implemented by a CPU or GPU or a coprocessor.

The statistical data determined by the ISP image signal processor 540 may be sent to the control logic 550 unit. For example, statistical data may include image sensor 514 statistical information such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, lens 512 shading correction, and the like. Control logic 550 may include a processor and/or microcontroller executing one or more routines (e.g., firmware) that may determine control parameters for imaging device 510 and ISP image based on received statistical data. Control parameters of the signal processor 540 . For example, the control parameters of the imaging device 510 may include sensor 520 control parameters (such as gain, integration time for exposure control, anti-shake parameters, etc.), camera flash control parameters, lens 512 control parameters (such as focal length for focusing or zooming), or these combination of parameters. ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), as well as lens 512 shading correction parameters.

The following are the steps of using the image processing technology in Figure 5 to realize the method of face unlocking:

If it is detected that the camera of the electronic device is activated, it is judged whether an instruction for unlocking the electronic device is received;

If it is judged that an instruction to unlock the electronic device is received, control the camera to enter a first mode, where the first mode is a low power consumption mode of the camera;

Using the first mode, face recognition is performed, and if the face recognition verification is passed, the electronic device is automatically unlocked.

In one embodiment, the step of judging whether an instruction to unlock the electronic device is received includes:

judging whether an instruction to open the application program corresponding to the camera of the electronic device is received;

If it is determined that the instruction to open the application program corresponding to the camera of the electronic device is not received, it is determined that an instruction to unlock the electronic device is received.

In one embodiment, the method also includes:

If it is determined that an instruction to open the application program corresponding to the camera of the electronic device is received, the camera is started to enter a second mode, and the power consumption of the second mode is greater than the power consumption of the first mode.

In one embodiment, the first mode includes only portrait detection.

In one embodiment, the portrait size of the portrait detection in the first mode is set to be equal to or smaller than a preset size threshold.

In one embodiment, the image output frame rate of the portrait detection in the first mode is set to be output at a preset frame rate.

In one embodiment, the clock frequency of the portrait detection in the first mode is set to be lower than the original clock frequency by a preset ratio.

The embodiment of the present application also provides a computer program product. A computer program product containing instructions, when running on a computer, causes the computer to execute the steps of the face unlocking method described in the above embodiments.

Any reference to memory, storage, database, or other medium as used herein may include non-volatile and/or volatile memory. Suitable nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Synchlink DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM).

The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the scope of protection of the patent application should be based on the appended claims.

Claims (10)

1. A method for face unlocking, said method comprising: If it is detected that the camera of the electronic device is activated, it is judged whether an instruction for unlocking the electronic device is received; If it is judged that an instruction to unlock the electronic device is received, control the camera to enter a first mode, where the first mode is a low power consumption mode of the camera; Using the first mode, face recognition is performed, and if the face recognition verification is passed, the electronic device is automatically unlocked. 2. The method according to claim 1, wherein the step of judging whether an instruction to unlock the electronic device is received comprises: judging whether an instruction to open the application program corresponding to the camera of the electronic device is received; If it is determined that the instruction to open the application program corresponding to the camera of the electronic device is not received, it is determined that an instruction to unlock the electronic device is received. 3. The method according to claim 2, wherein the method further comprises: If it is determined that an instruction to open the application program corresponding to the camera of the electronic device is received, the camera is started to enter a second mode, and the power consumption of the second mode is greater than the power consumption of the first mode. 4. The method according to claim 1 or 2, wherein the first mode only includes a portrait detection function. 5. The method according to claim 1 or 2, characterized in that the portrait size of the portrait detection in the first mode is set to be equal to or smaller than a preset size threshold. 6. The method according to claim 1 or 2, wherein the image output frame rate of the portrait detection in the first mode is set to be output at a preset frame rate. 7. The method according to claim 1 or 2, wherein the clock frequency of the portrait detection in the first mode is set to be lower than the original clock frequency by a preset ratio. 8. A face unlocking device, characterized in that the device comprises: A judging module, configured to judge whether an instruction to unlock the electronic device is received if it is detected that the camera of the electronic device is activated; A starting module, configured to start the camera to enter a first mode if it is judged that an unlocking action instruction of the electronic device is received, and the first mode is a low power consumption mode of the camera; The unlocking module is configured to use the first mode to perform face recognition, and if the face recognition verification is passed, the electronic device is automatically unlocked. 9. A computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the method according to any one of claims 1-7 are realized. 10. An electronic device, comprising a memory and a processor, wherein computer-readable instructions are stored in the memory, and when the instructions are executed by the processor, the processor executes any one of claims 1-7. The face unlocking method described in item.