CN107657166A - Unlock control method and related products - Google Patents

Abstract

The embodiment of the invention discloses an unlocking control method and a related product, wherein the method comprises the following steps: acquiring a face image; when the face image is a fog-containing image, determining a target fog level corresponding to the face image; carrying out fogging treatment on a preset face template according to the target fogging grade to obtain an atomized face template; matching the face image with the atomized face template; and when the face image is successfully matched with the atomized face template, carrying out unlocking operation. According to the embodiment of the invention, when the face image contains fog, the corresponding fog-containing degree can be determined, and then the preset face template can be subjected to fog-adding treatment, so that the template image is weakened through the fog-adding treatment, and the face recognition efficiency can be improved.

Description

Unlock control method and related products

technical field

The invention relates to the technical field of mobile terminals, in particular to an unlocking control method and related products.

Background technique

With the popularization and application of mobile terminals (mobile phones, tablet computers, etc.), mobile terminals can support more and more applications, and their functions are becoming more and more powerful. Missing electronics.

At present, face recognition is more and more favored by mobile terminal manufacturers. Due to the great changes in environmental factors, the success rate of face recognition is difficult to guarantee, especially in foggy environments, because the image is blocked by fog. , resulting in a large difference between the captured face image and the face image in the fog-free environment. Therefore, the success rate of face recognition is low. Therefore, the problem of how to improve the efficiency of face recognition in the foggy environment needs to be solved urgently. .

Contents of the invention

Embodiments of the present invention provide an unlocking control method and related products, which can improve the efficiency of face recognition in a foggy environment.

In the first aspect, an embodiment of the present invention provides a mobile terminal, including an application processor (Application Processor, AP), and a face recognition device connected to the AP, wherein,

The face recognition device is used to acquire a face image;

The AP is used to determine the target fogging level corresponding to the human face image when the human face image is a foggy image; perform fogging processing on a preset human face template according to the target fogging level to obtain Atomizing the face template; matching the face image with the atomized face template; and performing an unlocking operation when the face image is successfully matched with the atomized face template.

In a second aspect, an embodiment of the present invention provides an unlocking control method applied to a mobile terminal including an application processor AP and a face recognition device connected to the AP, the method comprising:

The face recognition device acquires a face image;

When the face image is a foggy image, the AP determines the target atomization level corresponding to the face image; performs fogging processing on the preset face template according to the target atomization level to obtain an atomized person a face template; matching the face image with the atomized face template; and performing an unlocking operation when the face image is successfully matched with the atomized face template.

In a third aspect, an embodiment of the present invention provides an unlocking control method, including:

Get face image;

When the face image is a foggy image, determine the target fogging level corresponding to the face image;

Perform fogging processing on the preset face template according to the target atomization level to obtain an atomized face template;

Matching the face image with the atomized face template;

When the face image matches the atomized face template successfully, an unlocking operation is performed.

In a fourth aspect, an embodiment of the present invention provides an unlocking control device, including:

a first acquiring unit, configured to acquire a face image;

A determining unit, configured to determine a target fogging level corresponding to the face image when the face image is a foggy image;

A fogging processing unit, configured to perform fogging processing on a preset face template according to the target atomization level to obtain an atomized face template;

A matching unit, configured to match the face image with the atomized face template;

An unlocking unit, configured to perform an unlocking operation when the face image matches the atomized face template successfully.

In a fifth aspect, an embodiment of the present invention provides a mobile terminal, including: an application processor AP and a memory; and one or more programs, the one or more programs are stored in the memory and configured to Executed by the AP, the program includes instructions for some or all of the steps as described in the third aspect.

In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, wherein the computer program enables the computer to execute the third aspect of the present invention. instructions for some or all of the steps described in .

In a seventh aspect, an embodiment of the present invention provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute the Part or all of the steps described in the third aspect of the invention embodiment. The computer program product may be a software installation package.

Implementing the embodiment of the present invention has the following beneficial effects:

It can be seen that the unlocking control method described in the embodiment of the present invention acquires a face image, and when the face image is a foggy image, determines the target fogging level corresponding to the face image, and sets the preset value according to the target fogging level. The face template is subjected to fogging processing to obtain an atomized face template, and the face image is matched with the atomized face template. When the face image and the atomized face template are successfully matched, the unlocking operation is performed. When the face image is foggy, the corresponding fogging degree can be determined, and then, the preset face template can be fogged, and the fogging process can weaken the template image, which can improve the efficiency of face recognition.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1A is a schematic structural diagram of an example mobile terminal provided by an embodiment of the present invention;

FIG. 1B is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention;

Fig. 1C is a schematic flowchart of an unlocking control method disclosed in an embodiment of the present invention;

Fig. 2 is a schematic flowchart of another unlocking control method disclosed in an embodiment of the present invention;

FIG. 3 is another schematic structural diagram of a mobile terminal provided by an embodiment of the present invention;

Fig. 4A is a schematic structural diagram of an unlocking control device provided by an embodiment of the present invention;

Fig. 4B is a schematic structural diagram of a determination unit of the unlocking control device described in Fig. 4A provided by an embodiment of the present invention;

Fig. 4C is another structural schematic diagram of an unlocking control device provided by an embodiment of the present invention;

FIG. 4D is a schematic structural diagram of a matching unit of the unlocking control device described in FIG. 4A provided by an embodiment of the present invention;

Fig. 5 is a schematic structural diagram of another mobile terminal disclosed in an embodiment of the present invention.

Detailed ways

In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

The terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally further includes For other steps or units inherent in these processes, methods, products or devices.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present invention. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.

The mobile terminals involved in the embodiments of the present invention may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems, as well as various forms of user equipment (User Equipment, UE), mobile station (Mobile Station, MS), terminal device (terminal device) and so on. For convenience of description, the devices mentioned above are collectively referred to as mobile terminals.

The following describes the embodiments of the present invention in detail. An example mobile terminal 1000 as shown in Figure 1A, the face recognition device of the mobile terminal 1000 can be a camera module 21, and the camera module can be a dual camera, and one of the above dual cameras can be a visible light camera and the other can be an infrared camera. camera, or both are visible light cameras, for example, one camera is a visible light camera, the other camera is an infrared camera, and for example, one camera is a visible light camera and the other camera is also a visible light camera, or the above camera module can be A single camera, for example, a visible light camera, or an infrared camera. The aforementioned camera module 21 may be a front camera or a rear camera.

Please refer to FIG. 1B. FIG. 1B is a schematic structural diagram of a mobile terminal 100 shown. The mobile terminal 100 includes: an application processor AP110, a face recognition device 120, and a smoke detection sensor 130. 150 connects the face recognition device 120 and the smoke detection sensor 130 .

Based on the mobile terminal described in Fig. 1A-Fig. 1B, it can be used to realize the following functions:

The face recognition device 120 is used to acquire a face image;

The AP110 is used to determine the target fogging level corresponding to the human face image when the human face image is a foggy image; perform fogging processing on a preset human face template according to the target fogging level to obtain Atomizing the face template; matching the face image with the atomized face template; and performing an unlocking operation when the face image is successfully matched with the atomized face template.

In a possible example, in terms of determining the target fogging level corresponding to the face image, the AP110 is specifically used to:

Carrying out image segmentation to the face image to obtain a face region image;

Determine the target fogging level of the face area image.

In a possible example, the smoke detection sensor 130 is used to obtain the current smoke concentration through the smoke detection sensor;

In terms of determining the target fogging level corresponding to the face image, the AP is specifically used for:

Obtain the fogging level corresponding to the current smoke density as the target fogging level corresponding to the face image.

In a possible example, in terms of fogging the preset face template according to the fog level, the AP110 is specifically used for:

According to the mapping relationship between the preset fogging level and the fogging processing parameters, the target fogging processing parameters corresponding to the target fogging processing are determined, and the preset face is processed according to the target fogging processing parameters The template is fogged.

In a possible example, in terms of matching the face image with the atomized face template, the AP110 is specifically used to:

Divide the face area image in the face image into P area blocks, the P area blocks are area blocks with the same area, and the P is an integer greater than 1;

Parallelly matching the P area blocks with the atomized face template to obtain P matching values;

Selecting a matching value greater than a preset recognition threshold from the P matching values to obtain Q matching values, the Q being a positive integer less than or equal to the P;

When the ratio between the Q and the P is greater than a preset threshold, it is determined that the face image matches the atomized face template successfully.

Based on the mobile terminal described above in FIG. 1A-FIG. 1B, it can be used to perform an unlocking control method as described below, specifically as follows:

The face recognition device 120 acquires a face image;

When the face image is a foggy image, the AP110 determines the target atomization level corresponding to the face image; performs fogging processing on the preset face template according to the target atomization level to obtain an atomized person a face template; matching the face image with the atomized face template; and performing an unlocking operation when the face image is successfully matched with the atomized face template.

It can be seen that the unlocking control method described in the embodiment of the present invention acquires a face image, and when the face image is a foggy image, determines the target fogging level corresponding to the face image, and sets the preset value according to the target fogging level. The face template is subjected to fogging processing to obtain an atomized face template, and the face image is matched with the atomized face template. When the face image and the atomized face template are successfully matched, the unlocking operation is performed. When the face image is foggy, the corresponding fogging degree can be determined, and then, the preset face template can be fogged, and the fogging process can weaken the template image, which can improve the efficiency of face recognition.

Based on the mobile terminal described in FIGS. 1A-1B , please refer to FIG. 1C , which is a schematic flowchart of an embodiment of an unlocking control method provided by an embodiment of the present invention. The unlocking control method described in this embodiment may include the following steps:

101. Acquire a face image.

Wherein, the face image may be obtained by focusing on the face, and the face image may be an image containing a face, or a cutout image only having a face.

Wherein, above-mentioned step 101, obtain face image, can comprise the following steps:

11. Obtain target environment parameters;

12. Determine target shooting parameters corresponding to the target environment parameters;

13. Shooting the face according to the target shooting parameters to obtain the face image.

Wherein, the above-mentioned target environment parameters can be obtained by detecting the environment sensor, and the above-mentioned environment sensor can be used to detect the environment parameter, and the environment sensor can be at least one of the following: breathing detection sensor, ambient light sensor, electromagnetic detection sensor, environmental color temperature detection sensor, positioning sensor , temperature sensor, humidity sensor, etc., the environmental parameters can be at least one of the following: respiratory parameters, ambient brightness, environmental color temperature, environmental magnetic field interference coefficient, weather conditions, the number of environmental light sources, geographical location, etc., the respiratory parameters can be at least one of the following One: breath count, breath rate, breath sound, breath curve, etc.

Further, the mobile terminal may pre-store the corresponding relationship between shooting parameters and environmental parameters, and then determine the target shooting parameters corresponding to the target environmental parameters according to the corresponding relationship. The above shooting parameters may include but not limited to: focal length, exposure time length , aperture size, camera mode, sensitivity ISO, white balance parameters, etc. In this way, the best image under the environment can be obtained.

102. When the face image is a foggy image, determine a target fogging level corresponding to the face image.

Wherein, when the face image is a foggy image, the level of fog in the face image, or the degree of fogging, may be further analyzed.

Optionally, between the above step 101 and step 102, the following steps may be included:

Detect whether the face image contains fog, and if so, confirm that the face image is a fog image.

Among them, it is possible to judge whether the face image is a foggy image through detection technology, for example, through the detection of a smoke detection sensor, if there is smoke or fog in the environment, the face image will contain fog to a large extent. In addition, it is possible to detect whether there is fog in the image through image processing. For example, feature extraction can be performed on the image to obtain various features of the image, such as: fractal features, gray features, wavelet coefficient changes or gray co-occurrence matrix , and then judge whether these features conform to the characteristics of the foggy image, if so, it means that the image contains fog.

Optionally, in the above step 102, determining the target fogging level corresponding to the face image may include the following steps:

21. Perform image segmentation on the face image to obtain a face region image;

22. Determine a target fogging level of the face region image.

Among them, in the process of face recognition, the most concerned is of course the face area. Therefore, the background can be ignored. Therefore, the image of the face image can be segmented to obtain the image of the face area, and the face area can be determined. The fog level corresponding to the image.

Optionally, in the above-mentioned step 22, determining the fogging level of the face region image may include the following steps:

221. Perform feature extraction on the face region image to obtain a target feature set;

222. Perform quantization processing on the target feature set to obtain quantized feature values;

223. Determine the target fog level corresponding to the quantified feature value according to a preset mapping relationship between the feature value and the fog level.

Among them, the above-mentioned feature extraction can be realized by the following algorithms: Harris corner detection algorithm, scale-invariant feature transformation, SUSAN corner detection algorithm, fractal, wavelet transform, etc., which will not be repeated here. The above preset mapping relationship between the characteristic value and the atomization level may be stored in the memory in advance. Furthermore, after the feature extraction is performed on the face area image, the target feature set can be obtained, and the target feature set can be quantified to obtain the quantized feature value, and according to the mapping relationship between the preset feature value and the atomization level A target fogging level corresponding to the quantized feature value is determined.

Optionally, between the above step 101 and step 102, the following steps may also be included:

Obtain the current smoke concentration through the smoke detection sensor;

Then, in step 102, determining the target fogging level corresponding to the face image can be implemented in the following manner:

Obtain the fogging level corresponding to the current smoke density as the target fogging level corresponding to the face image.

Among them, the current smoke concentration can be obtained through the smoke detection sensor, and different fog-containing images will be captured under different concentrations. Certainly, the mapping relationship between the smoke concentration and the atomization level may be stored in advance in the mobile terminal, and further, the target atomization level corresponding to the current smoke concentration may be determined according to the mapping relationship.

103. Perform fogging processing on a preset face template according to the target atomization level to obtain an atomized face template.

Wherein, the above-mentioned preset face template can be pre-stored in the memory, and the preset face template can be fogged according to the target atomization level. Face template, that is, in the above step 103, the preset face template can be fogged according to the target atomization level to obtain a template with the same blur as the face image, so that the quality of the preset face template can be weakened, reverse Improved face recognition efficiency. For the aforementioned fogging processing algorithm, reference may be made to the prior art, for example, an image fogging and hiding algorithm based on fog theory.

Optionally, in the above step 103, the fogging process is performed on the preset face template according to the fogging level, which can be implemented in the following manner:

According to the mapping relationship between the preset fogging level and the fogging processing parameters, the target fogging processing parameters corresponding to the target fogging processing are determined, and the preset face is processed according to the target fogging processing parameters The template is fogged.

Wherein, the above-mentioned fogging processing parameters are processing parameters in the fogging processing algorithm, and different processing parameters have different degrees of image fogging, for example: the fogging processing parameters of the image fogging concealment algorithm based on the fog theory. The memory of the mobile terminal can pre-store the mapping relationship between the preset atomization level and the fogging processing parameters, and then, according to the mapping relationship, the target fogging processing parameters corresponding to the target fogging processing can be determined, and according to the target fogging processing The fog processing parameter performs fog processing on the preset face template.

104. Match the face image with the atomized face template.

Among them, the face image can be matched with the atomized face, if the matching value between the two is greater than the face recognition threshold, the unlocking operation is performed, if the matching value between the two is less than or equal to the face recognition threshold, Then the user may be prompted to perform face recognition again, and the above-mentioned preset recognition threshold may be set by the user or defaulted by the system.

Optionally, in the above step 104, matching the face image with the atomized face template may include the following steps:

41. Divide the face area image in the face image into P area blocks, the P area blocks are area blocks with the same area, and the P is an integer greater than 1;

42. Matching the P area blocks with the atomized face template in parallel to obtain P matching values;

43. Select a matching value greater than a preset recognition threshold from the P matching values to obtain Q matching values, and the Q is a positive integer less than or equal to the P;

44. When the ratio between the Q and the P is greater than a preset threshold, determine that the face image matches the atomized face template successfully.

Wherein, the above-mentioned preset recognition threshold may be set by the user or defaulted by the system, for example, the preset recognition threshold=face recognition threshold/P. The aforementioned preset thresholds may also be set by the user or defaulted by the system. Furthermore, the face region image in the face image can be divided into P regions, where P is an integer greater than 1, and the areas of the P regions are the same. P processes or threads can be used to match P area blocks with the atomized face template to obtain P matching values, and a matching value greater than the preset recognition threshold can be selected from the P matching values to obtain Q matching values. When the ratio between Q and P is greater than the preset threshold, it is determined that the face image matches the fogged face template successfully. In this way, fast face recognition can be realized.

105. When the face image matches the atomized face template successfully, perform an unlocking operation.

Wherein, when the face image is successfully matched with the atomized face template, the unlocking operation is performed. The above-mentioned unlocking operation may be at least one of the following situations: For example, when the mobile terminal is in a state of turning off the screen, the unlocking operation may be, screen, and enter the main page of the mobile terminal, or a specified page; when the mobile terminal is in the bright state, the unlocking operation can be to enter the main page of the mobile terminal, or a specified page; the unlocking page of an application of the mobile terminal, the unlocking operation can be Yes, complete the unlocking and enter the unlocked page. For example, the mobile terminal can be on the payment page, and the unlocking operation can be to make a payment. The above specified page may be at least one of the following: a page of a certain application, or a page specified by the user.

It can be seen that the unlocking control method described in the embodiment of the present invention acquires a face image, and when the face image is a foggy image, determines the target fogging level corresponding to the face image, and sets the preset value according to the target fogging level. The face template is subjected to fogging processing to obtain an atomized face template, and the face image is matched with the atomized face template. When the face image and the atomized face template are successfully matched, the unlocking operation is performed. When the face image is foggy, the corresponding fogging degree can be determined, and then, the preset face template can be fogged, and the fogging process can weaken the template image, which can improve the efficiency of face recognition.

Consistent with the above, please refer to FIG. 2 , which is a schematic flowchart of an embodiment of an unlocking control method provided by an embodiment of the present invention. The unlocking control method described in this embodiment may include the following steps:

201. Acquire a face image.

202. Obtain the current smoke concentration through the smoke detection sensor.

203. When the face image is a foggy image, acquire a fog level corresponding to the current smoke concentration as a target fog level corresponding to the face image.

204. Perform fogging processing on a preset face template according to the target fog level to obtain an atomized face template.

205. Match the face image with the atomized face template.

206. When the face image matches the atomized face template successfully, perform an unlocking operation.

Wherein, for the specific description of the above-mentioned steps 201-206, reference may be made to the corresponding steps of the unlocking control method described in FIG. 1C , which will not be repeated here.

It can be seen that the unlocking control method described in the embodiment of the present invention obtains the face image, obtains the current smoke concentration through the smoke detection sensor, and obtains the atomization level corresponding to the current smoke concentration when the face image is a foggy image As the target atomization level corresponding to the face image, the preset face template is fogged according to the target atomization level to obtain the atomized face template, and the face image is matched with the atomized face template, When the image is successfully matched with the atomized face template, the unlocking operation is performed, so that when the face image is foggy, the corresponding degree of fogging can be determined, and then the preset face template can be fogged to increase the fogging effect. Fog processing weakens the template image, which can improve the efficiency of face recognition.

Please refer to FIG. 3. FIG. 3 is a mobile terminal provided by an embodiment of the present invention, including: an application processor AP and a memory; and one or more programs, the one or more programs are stored in the memory, And configured to be executed by the AP, the program includes instructions for performing the following steps:

Get face image;

When the face image is a foggy image, determine the target fogging level corresponding to the face image;

Perform fogging processing on the preset face template according to the target atomization level to obtain an atomized face template;

Matching the face image with the atomized face template;

When the face image matches the atomized face template successfully, an unlocking operation is performed.

In a possible example, in terms of determining the target fogging level corresponding to the face image, the program includes instructions for performing the following steps:

Carrying out image segmentation to the face image to obtain a face region image;

Determine the target fogging level of the face area image.

In one possible example, the program further includes instructions for performing the following steps:

Obtain the current smoke concentration through the smoke detection sensor;

For determining the target fogging level corresponding to the face image, the program includes instructions for performing the following steps:

Obtain the fogging level corresponding to the current smoke density as the target fogging level corresponding to the face image.

In a possible example, the fogging process is performed on the preset face template according to the fogging level, and the program includes instructions for performing the following steps:

According to the mapping relationship between the preset fogging level and the fogging processing parameters, the target fogging processing parameters corresponding to the target fogging processing are determined, and the preset face is processed according to the target fogging processing parameters The template is fogged.

In a possible example, the matching the face image with the atomized face template, the program includes instructions for performing the following steps:

Divide the face area image in the face image into P area blocks, the P area blocks are area blocks with the same area, and the P is an integer greater than 1;

Parallelly matching the P area blocks with the atomized face template to obtain P matching values;

Selecting a matching value greater than a preset recognition threshold from the P matching values to obtain Q matching values, the Q being a positive integer less than or equal to the P;

When the ratio between the Q and the P is greater than a preset threshold, it is determined that the face image matches the atomized face template successfully.

Please refer to FIG. 4A . FIG. 4A is a schematic structural diagram of an unlocking control device provided in this embodiment. The unlocking control device includes a first acquiring unit 401, a determining unit 402, a fogging processing unit 403, a matching unit 404 and an unlocking unit 405, wherein,

A first acquisition unit 401, configured to acquire a face image;

A determining unit 402, configured to determine a target fog level corresponding to the face image when the face image is a foggy image;

A fogging processing unit 403, configured to perform fogging processing on a preset face template according to the target atomization level to obtain an atomized face template;

A matching unit 404, configured to match the face image with the atomized face template;

The unlocking unit 405 is configured to perform an unlocking operation when the face image matches the atomized face template successfully.

Optionally, as shown in FIG. 4B, FIG. 4B is a specific detailed structure of the determination unit 402 of the unlock control device described in FIG. 4A, and the determination unit 402 may include: a division module 4021 and a determination module 4022, specifically as follows:

A segmentation module 4021, configured to perform image segmentation on the face image to obtain a face region image;

Determining module 4022, determining the target fogging level of the face area image.

Optionally, as shown in FIG. 4C, FIG. 4C is a modified structure of the unlocking control device described in FIG. 4A. Compared with FIG. 4A, it may further include: a second acquisition unit 406, specifically as follows:

The second acquisition unit 406 is configured to acquire the current smoke concentration through the smoke detection sensor;

In terms of determining the target fogging level corresponding to the face image, the determining unit 402 is specifically configured to:

Obtain the fogging level corresponding to the current smoke density as the target fogging level corresponding to the face image.

Optionally, in terms of performing fogging processing on the preset face template according to the fogging level, the fogging processing unit 403 is specifically configured to:

According to the mapping relationship between the preset fogging level and the fogging processing parameters, the target fogging processing parameters corresponding to the target fogging processing are determined, and the preset face is processed according to the target fogging processing parameters The template is fogged.

Optionally, as shown in Fig. 4D, Fig. 4D is the specific detailed structure of the matching unit 404 of the unlocking control device described in Fig. 4A, and the matching unit 404 may include: a division module 4041, a matching module 4042, a selection module 4043 and a confirmation module 4044, as follows:

A dividing module 4041, configured to divide the face area image in the face image into P area blocks, the P area blocks are area blocks with the same area, and the P is an integer greater than 1;

A matching module 4042, configured to match the P area blocks with the atomized face template in parallel to obtain P matching values;

A selection module 4043, configured to select a matching value greater than a preset recognition threshold from the P matching values to obtain Q matching values, where the Q is a positive integer less than or equal to the P;

A confirming module 4044, configured to determine that the face image matches the atomized face template successfully when the ratio between the Q and the P is greater than a preset threshold.

It can be seen that the unlocking control device described in the embodiment of the present invention can acquire a face image, and when the face image is a foggy image, determine the target fog level corresponding to the face image, and predict the preset fog level according to the target fog level. Set the face template for fogging processing to obtain the atomized face template, match the face image with the atomized face template, and perform the unlocking operation when the face image and the atomized face template are successfully matched, so that When the face image is foggy, the corresponding fogging degree can be determined, and further, fogging processing can be performed on the preset face template to weaken the template image by fogging processing, which can improve the efficiency of face recognition.

It can be understood that the functions of the program modules of the unlocking control device in this embodiment can be specifically implemented according to the method in the above method embodiment, and the specific implementation process can refer to the relevant description of the above method embodiment, and will not be repeated here.

The embodiment of the present invention also provides another mobile terminal, as shown in Fig. 5, for the convenience of description, only the parts related to the embodiment of the present invention are shown, and the specific technical details are not disclosed, please refer to the method of the embodiment of the present invention part. The mobile terminal can be any terminal device including a mobile phone, tablet computer, PDA (Personal Digital Assistant, personal digital assistant), POS (Point of Sales, sales terminal), vehicle-mounted computer, etc. Taking the mobile terminal as a mobile phone as an example:

FIG. 5 shows a block diagram of a partial structure of a mobile phone related to the mobile terminal provided by the embodiment of the present invention. Referring to FIG. 5 , the mobile phone includes: a radio frequency (Radio Frequency, RF) circuit 910, a memory 920, an input unit 930, a sensor 950, an audio circuit 960, a wireless fidelity (Wireless Fidelity, WiFi) module 970, an application processor AP980, and a power supply 990 and other components. Those skilled in the art can understand that the structure of the mobile phone shown in FIG. 5 is not limited to the mobile phone, and may include more or less components than shown in the figure, or combine some components, or arrange different components.

The following is a specific introduction to each component of the mobile phone in conjunction with Figure 5:

The input unit 930 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile phone. Specifically, the input unit 930 may include a touch screen 933 , a face recognition device 931 and other input devices 932 . The face recognition device 931 may refer to the above-mentioned structure, and the specific structural composition may refer to the above-mentioned description, which will not be repeated here. The input unit 930 may also include other input devices 932 . Specifically, other input devices 932 may include but not limited to one or more of physical keys, function keys (such as volume control keys, switch keys, etc.), trackball, mouse, joystick, and the like.

Wherein, the AP980 is used to perform the following steps:

Get face image;

When the face image is a foggy image, determine the target fogging level corresponding to the face image;

Perform fogging processing on the preset face template according to the target atomization level to obtain an atomized face template;

Matching the face image with the atomized face template;

When the face image matches the atomized face template successfully, an unlocking operation is performed.

AP980 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and/or modules stored in the memory 920, and calling data stored in the memory 920, the mobile phone is executed. Various functions and processing data, so as to monitor the mobile phone as a whole. Optionally, the AP980 may include one or more processing units, which may be artificial intelligence chips or quantum chips; preferably, the AP980 may integrate an application processor and a modem processor, wherein the application processor mainly handles operations systems, user interfaces, and applications, etc., the modem processor mainly handles wireless communications. It can be understood that the above-mentioned modem processor may not be integrated into the AP980.

In addition, the memory 920 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

RF circuitry 910 may be used for the reception and transmission of information. Generally, the RF circuit 910 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, and the like. In addition, RF circuitry 910 may also communicate with networks and other devices via wireless communications. The above wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (Global System of Mobilecommunication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (Short Messaging Service, SMS), etc.

The handset may also include at least one sensor 950, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor can include an environment sensor and a proximity sensor, wherein the environment sensor can adjust the brightness of the touch display screen according to the brightness of the ambient light, and the proximity sensor can turn off the touch display screen and/or when the mobile phone is moved to the ear. or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of mobile phone posture (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. repeat.

The audio circuit 960, the speaker 961, and the microphone 962 can provide an audio interface between the user and the mobile phone. The audio circuit 960 can transmit the electrical signal converted from the received audio data to the loudspeaker 961, and the loudspeaker 961 converts it into a sound signal for playback; After being received, it is converted into audio data, and then the audio data is processed by the playback AP980, and then sent to another mobile phone through the RF circuit 910, or the audio data is played to the memory 920 for further processing.

WiFi is a short-distance wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 970. It provides users with wireless broadband Internet access. Although Fig. 5 shows the WiFi module 970, it can be understood that it is not an essential component of the mobile phone, and can be completely omitted according to needs without changing the essence of the invention.

The mobile phone also includes a power supply 990 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the AP980 through the power management system, so that functions such as charging, discharging, and power consumption management can be realized through the power management system.

Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be repeated here.

In the aforementioned embodiment shown in FIG. 1C or FIG. 2 , the method flow of each step can be realized based on the structure of the mobile phone.

In the aforementioned embodiments shown in FIG. 3 and FIG. 4A to FIG. 4D , the functions of each unit can be realized based on the structure of the mobile phone.

An embodiment of the present invention also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables the computer to execute any part of the unlocking control method described in the above method embodiments or all steps.

An embodiment of the present invention also provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the method described in the above method embodiments. Part or all of the steps of any unlocking control method.

It should be noted that for the foregoing method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence. Because of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or can be Integrate into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented not only in the form of hardware, but also in the form of software program modules.

The integrated units may be stored in a computer-readable memory if implemented in the form of a software program module and sold or used as an independent product. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory. Several instructions are included to make a computer device (which may be a personal computer, server or network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory (English: Read-Only Memory, abbreviated: ROM), random access device (English: Random Access Memory, abbreviated: RAM), magnetic disk or optical disk, etc.

The embodiments of the present invention have been described in detail above, and specific examples have been used in this paper to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only used to help understand the method and core idea of the present invention; at the same time, for Those skilled in the art will have changes in the specific implementation and scope of application according to the idea of the present invention. In summary, the contents of this specification should not be construed as limiting the present invention.

Claims (14)

1. A kind of 1. mobile terminal, it is characterised in that including application processor AP, and the recognition of face dress being connected with the AP Put, wherein,

   The face identification device, for obtaining facial image；

   The AP, for when the facial image is image containing mist, determining that target corresponding to the facial image is atomized grade； Grade is atomized according to the target default face template is carried out to add mist processing, atomized face template；By the face figure As being matched with the atomization face template；And the facial image with it is described atomization face template the match is successful when, It is unlocked operation.
2. 2. mobile terminal according to claim 1, it is characterised in that determine target corresponding to the facial image described In terms of being atomized grade, the AP is specifically used for：

   Image segmentation is carried out to the facial image, obtains human face region image；

   Determine the target atomization grade of the human face region image.
3. 3. mobile terminal according to claim 1, it is characterised in that the mobile terminal also includes：

   Smoke Detection sensor, for obtaining current smokescope by Smoke Detection sensor；

   In terms of target atomization grade corresponding to the determination facial image, the AP is specifically used for：

   Obtain the grade that is atomized corresponding with the current smokescope and be atomized grade as target corresponding to the facial image.
4. 4. according to the mobile terminal described in any one of claims 1 to 3, it is characterised in that described according to the atomization grade Default face template is carried out plus mist processing aspect, the AP are specifically used for：

   According to default atomization grade and add the mapping relations between mist processing parameter, it is determined that adding mist processing corresponding with the target Target add mist processing parameter, and add mist processing parameter to be carried out to the default face template plus mist processing according to the target.
5. 5. according to the mobile terminal described in any one of Claims 1-4, it is characterised in that it is described by the facial image with In terms of the atomization face template is matched, the AP is specifically used for：

   Human face region image in the facial image is divided into P region unit, the P region unit is area identical area Domain block, the P are the integer more than 1；

   And be about to the P region unit and matched with the atomization face template, obtain P matching value；

   The matching value for being more than default recognition threshold is chosen from the P matching value, obtains Q matching value, the Q be less than or Equal to the positive integer of the P；

   When ratio between the Q and the P is more than predetermined threshold value, the facial image and the atomization face template are determined The match is successful.
6. 6. one kind solution lock control method, it is characterised in that applied to including application processor AP, and the people being connected with the AP The mobile terminal of face identification device, methods described include：

   The face identification device obtains facial image；

   The AP determines that target corresponding to the facial image is atomized grade when the facial image is image containing mist；According to Default face template is carried out the target atomization grade plus mist processing, atomized face template；By the facial image with The atomization face template is matched；And the facial image with it is described atomization face template the match is successful when, carry out Unblock operation.
7. 7. one kind solution lock control method, it is characterised in that including：

   Obtain facial image；

   When the facial image is image containing mist, determine that target corresponding to the facial image is atomized grade；

   Grade is atomized according to the target default face template is carried out to add mist processing, atomized face template；

   The facial image is matched with the atomization face template；

   When the match is successful for the facial image and the atomization face template, operation is unlocked.
8. 8. according to the method for claim 7, it is characterised in that described to determine target atomization etc. corresponding to the facial image Level, including：

   Image segmentation is carried out to the facial image, obtains human face region image；

   Determine the target atomization grade of the human face region image.
9. 9. according to the method for claim 7, it is characterised in that methods described also includes：

   Current smokescope is obtained by Smoke Detection sensor；

   It is described to determine that target corresponding to the facial image is atomized grade, including：

   Obtain the grade that is atomized corresponding with the current smokescope and be atomized grade as target corresponding to the facial image.
10. 10. according to the method described in any one of claim 7 to 9, it is characterised in that it is described according to the atomization grade to default Face template carries out plus mist processing, including：

    According to default atomization grade and add the mapping relations between mist processing parameter, it is determined that adding mist processing corresponding with the target Target add mist processing parameter, and add mist processing parameter to be carried out to the default face template plus mist processing according to the target.
11. 11. according to the method described in any one of claim 7 to 10, it is characterised in that it is described by the facial image with it is described Atomization face template is matched, including：

    Human face region image in the facial image is divided into P region unit, the P region unit is area identical area Domain block, the P are the integer more than 1；

    And be about to the P region unit and matched with the atomization face template, obtain P matching value；

    The matching value for being more than default recognition threshold is chosen from the P matching value, obtains Q matching value, the Q be less than or Equal to the positive integer of the P；

    When ratio between the Q and the P is more than predetermined threshold value, the facial image and the atomization face template are determined The match is successful.
12. 12. one kind solution lock control device, it is characterised in that including：

    First acquisition unit, for obtaining facial image；

    Determining unit, for when the facial image is image containing mist, determining target atomization etc. corresponding to the facial image Level；

    Add mist processing unit, default face template is carried out to add mist processing for being atomized grade according to the target, it is atomized Face template；

    Matching unit, for the facial image to be matched with the atomization face template；

    Unlocking unit, for the facial image with it is described atomization face template the match is successful when, be unlocked operation.
13. A kind of 13. mobile terminal, it is characterised in that including：Application processor AP and memory；And one or more programs, One or more of programs are stored in the memory, and are configured to be performed by the AP, and described program includes Instruction for such as any one of claim 7-11 methods.
14. A kind of 14. computer-readable recording medium, it is characterised in that it is used to store computer program, wherein, the computer Program causes computer to perform the method as described in claim any one of 7-11.