HK1247010B - Image processing method and related products - Google Patents

Description

Image processing methods and related products

Technical Field

The present invention relates to the technical field of mobile terminals, and in particular to an image processing method and related products.

Background Art

With the widespread application of mobile terminals (mobile phones, tablet computers, etc.), mobile terminals can support more and more applications and have more and more powerful functions. Mobile terminals are developing in the direction of diversification and personalization, becoming an indispensable electronic product in users' lives.

At present, iris recognition is increasingly favored by mobile terminal manufacturers. Currently, the iris images collected are all infrared images. In many cases, users prefer to view color images, so the display effect is not good.

Summary of the Invention

The embodiments of the present invention provide an image processing method and related products, which can obtain a color iris image and improve the display effect of the iris image.

In a first aspect, an embodiment of the present invention provides an image processing method, the method comprising:

Collect color information of the target object;

determining a target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters;

During iris acquisition, the iris is compensated based on the target compensation parameter to obtain a color iris image.

In a second aspect, an embodiment of the present invention provides a mobile terminal, comprising an iris recognition device, a memory, and an application processor AP, wherein the iris recognition device and the memory are both connected to the AP, wherein:

The iris recognition device is used to collect color information of the target object;

The memory is used to store a plurality of compensation parameters;

The AP is configured to determine a target compensation parameter corresponding to the color information from the multiple compensation parameters; and when the iris recognition device captures the iris, compensate the iris based on the target compensation parameter corresponding to the color information to obtain a color iris image.

In a third aspect, an embodiment of the present invention provides a mobile terminal comprising: an iris recognition device, an application processor AP and a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the AP, the programs comprising instructions for executing some or all of the steps described in the first aspect.

In a fourth aspect, an embodiment of the present invention provides an image processing device, comprising a color acquisition unit, a compensation parameter determination unit, and an iris acquisition unit, wherein:

The color acquisition unit is used to acquire color information of the target object;

The compensation parameter determination unit is configured to determine a target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters;

The iris acquisition unit is configured to compensate the iris based on the target compensation parameter to obtain a color iris image during iris acquisition.

In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, wherein the computer program enables a computer to execute some or all of the steps described in the first aspect of the embodiment of the present invention.

In a sixth aspect, embodiments of the present invention provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, wherein the computer program is operable to cause a computer to perform some or all of the steps described in the first aspect of the embodiments of the present invention. The computer program product may be a software installation package.

The implementation of the embodiments of the present invention has the following beneficial effects:

It can be seen that in the embodiment of the present invention, the color information of the target object is collected, and the target compensation parameters corresponding to the color information are determined from multiple pre-stored compensation parameters. When the iris is collected, the iris is compensated based on the target compensation parameters to obtain a color iris image. It can be seen that the corresponding compensation parameters can be obtained through the color information of the target object, and then, the iris is collected according to the compensation parameters, and finally a color iris image can be obtained, which has a better display effect.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

FIG1A is a schematic structural diagram of a smart phone provided by an embodiment of the present invention;

FIG1B is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention;

FIG1C is a schematic structural diagram of another mobile terminal provided by an embodiment of the present invention;

FIG2 is a schematic flow chart of an image processing method disclosed in an embodiment of the present invention;

FIG3 is a schematic flow chart of another image processing method disclosed in an embodiment of the present invention;

FIG4 is a schematic structural diagram of another mobile terminal provided by an embodiment of the present invention;

FIG5A is a schematic structural diagram of an image processing device disclosed in an embodiment of the present invention;

FIG5B is a schematic structural diagram of a compensation parameter determination unit of the image processing apparatus described in FIG5A according to an embodiment of the present invention;

FIG5C is a schematic structural diagram of an iris acquisition unit of the image processing device described in FIG5A according to an embodiment of the present invention;

FIG5D is a schematic diagram of the structure of the first image fusion module of the iris acquisition unit described in FIG5C according to an embodiment of the present invention;

FIG5E is another schematic structural diagram of the image processing device described in FIG5A according to an embodiment of the present invention;

FIG6 is a schematic structural diagram of another mobile terminal disclosed in an embodiment of the present invention.

DETAILED DESCRIPTION

In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

The terms "first," "second," and so on, in the description and claims of the present invention and the accompanying drawings are used to distinguish between different objects, not to describe a specific order. Furthermore, the terms "including," "having," and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute a separate or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

The mobile terminals involved in the embodiments of the present invention may include various handheld devices with wireless communication capabilities, vehicle-mounted devices, wearable devices, computing devices, or other processing devices connected to a wireless modem, as well as various forms of user equipment (UE), mobile stations (MS), terminal devices, etc. For ease of description, the above-mentioned devices are collectively referred to as mobile terminals. The embodiments of the present invention are described in detail below. As shown in Figure 1A, an example smartphone 100 has an iris recognition device that may include an infrared fill light 21, an infrared camera 22, and a front camera 23. During operation of the iris recognition device, light from the infrared fill light 21 hits the iris and is reflected back to the infrared camera 22 by the iris. The iris recognition device captures an infrared iris image, and the front camera 23 can be used to capture a visible light image. The iris image is then fused with the visible light image to obtain a final iris image, which can be displayed to the user.

Please refer to Figure 1B, which is a structural diagram of a mobile terminal 100 provided in accordance with an embodiment of the present invention. The mobile terminal 100 includes: an application processor AP110, an iris recognition device 130, and a memory 140. The iris recognition device 130 may be integrated with the touch screen, or the iris recognition device 130 may exist independently. The AP110 is connected to the touch screen, the iris recognition device 130, and the memory 140 via a bus 150. Further, please refer to Figure 1C, which is a variant structure of the mobile terminal 100 described in Figure 1B. Compared with Figure 1B, Figure 1C also includes an environmental sensor 160.

In some possible embodiments, the iris recognition device 130 is used to collect color information of the target object; the memory 140 is used to store multiple compensation parameters;

The AP 110 is configured to determine a target compensation parameter corresponding to the color information from the multiple compensation parameters; and when the iris recognition device 130 captures the iris, compensate the iris based on the target compensation parameter corresponding to the color information to obtain a color iris image.

In some possible embodiments, in determining the target compensation parameter corresponding to the color information from the multiple compensation parameters, the AP 110 is specifically configured to:

The color information is analyzed to obtain abnormal color information; a target representation color corresponding to the abnormal color information is determined; and a target compensation parameter corresponding to the target representation color is determined from the multiple compensation parameters according to a preset correspondence between the representation color and the compensation parameter.

In some possible embodiments, the iris recognition device 130 includes a visible light camera, an infrared fill light, and an infrared camera;

In terms of compensating the iris based on the target compensation parameter to obtain a color iris image during iris acquisition, the iris recognition device 130 is specifically configured to:

The visible light camera of the iris recognition device 130 captures an image of the target object according to the target compensation parameters to obtain a visible light image; the infrared fill light and infrared camera of the iris recognition device 130 capture an image of the target object to obtain an infrared image, and instructs the AP110 to fuse the visible light image and the infrared image to obtain the color iris image.

In some possible embodiments, in fusing the visible light image and the infrared image to obtain the color iris image, the AP 110 is specifically configured to:

Performing image segmentation on the visible light image to obtain a visible light iris image; performing image segmentation on the infrared image to obtain an infrared iris image; performing spatial transformation on the visible light iris image and the infrared iris image so that the transformed visible light iris image and the infrared iris image are consistent in size and angle; and performing image fusion on the transformed visible light iris image and the infrared iris image to obtain the color iris image.

In some possible embodiments, the mobile terminal is further provided with an environmental sensor 160;

The environmental sensor 160 is used to obtain environmental parameters;

In terms of compensating the iris based on the target compensation parameter to obtain a color iris image during iris acquisition, the iris recognition device 130 is specifically configured to:

During iris acquisition, the iris is compensated based on the target compensation parameter and the environmental parameter to obtain a color iris image.

Please refer to FIG. 2 , which is a flow chart of an image processing method according to an embodiment of the present invention. The method is applied to a mobile terminal including an iris recognition device, a memory, and an application processor AP. For a physical diagram and a structural diagram of the mobile terminal, refer to FIG. 1A to FIG. 1C . The image processing method includes:

201. Collect color information of the target object.

The target object may be a human face or iris, or an object containing an iris. The color information of the target object may be collected by an iris recognition device, which may also include a visible light camera. The visible light camera is used to obtain a color image corresponding to the target object, and the color information is then extracted from the color image.

202. Determine a target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters.

The mobile terminal's memory may pre-store multiple compensation parameters. These compensation parameters may include, but are not limited to, iris acquisition current, iris acquisition voltage, iris acquisition power, and color correction coefficients. The iris acquisition current refers to the current used when acquiring the iris, the iris acquisition voltage refers to the voltage used when acquiring the iris, and the iris acquisition power refers to the power used when acquiring the iris. The color correction coefficient is used to extract the color of the acquired iris image and then perform color cast correction on the color based on the color correction coefficient. Typically, color distortion occurs, and therefore, the distorted color needs to be restored to make the processed color more natural or realistic. Therefore, a mapping relationship between color information and compensation parameters may be pre-set, and a target compensation parameter corresponding to the color information obtained in step 201 may be determined from the pre-stored multiple compensation parameters.

In a possible example, in step 202, determining a target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters may include the following steps:

221. Analyze the color information to obtain abnormal color information;

222. Determine the target representation color corresponding to the abnormal color information;

223. Determine a target compensation parameter corresponding to the target representative color from the multiple compensation parameters according to a preset correspondence between representative colors and compensation parameters.

The color information refers to the color information of the entire scene. Based on real-life experience, it is known that color distortion often occurs only in certain areas of a scene. Therefore, the color information of this area, i.e., abnormal color information, can be obtained. This abnormal color information can be used to analyze the color bias of the scene, or the actual color of the scene, and then the target representative color can be obtained. The target representative color can be understood as the color information of the actual scene. The mobile terminal's memory can pre-store a correspondence between representative colors and compensation parameters. Based on this correspondence, a target compensation parameter corresponding to the target representative color can be determined. The target compensation parameter is one of multiple pre-stored compensation parameters.

203. When collecting the iris, compensate the iris based on the target compensation parameter and the environmental parameter to obtain a color iris image.

Different compensation parameters will result in different colors of the iris image. Therefore, the iris of the target object can be captured according to the target compensation parameters to obtain a final iris image, which is a color image.

In one possible example, the iris recognition device includes a visible light camera, an infrared fill light, and an infrared camera. In step 203, when collecting the iris, compensating the iris based on the target compensation parameter and the environmental parameter to obtain a color iris image may include the following steps:

31. Capturing an image of the target object according to the target compensation parameter using a visible light camera to obtain a visible light image;

32. Capture an image of the target object using the infrared fill light and infrared camera of the iris recognition device to obtain an infrared image;

33. Perform image fusion on the visible light image and the infrared image to obtain the color iris image.

1A-1C , the iris recognition device in an embodiment of the present invention may be comprised of a visible light camera, an infrared fill light, and an infrared camera. Steps 31 and 32 may be performed in parallel, or step 31 may be performed first and then step 32, or step 32 may be performed first and then step 31. The visible light camera may be controlled to capture an image of the target object based on the target compensation parameters to obtain a visible light image. The infrared fill light and infrared camera of the iris recognition device may be controlled to capture an image of the target object to obtain an infrared image. The visible light image and infrared image are then fused to obtain a color iris image.

Optionally, in step 33, fusing the visible light image and the infrared image to obtain the color iris image may include the following steps:

A1. performing image segmentation on the visible light image to obtain a visible light iris image;

A2. performing image segmentation on the infrared image to obtain an infrared iris image;

A3. spatially transforming the visible light iris image and the infrared iris image so that the transformed visible light iris image and the infrared iris image have the same size and angle;

A4. Fusing the transformed visible light iris image with the infrared iris image to obtain the color iris image.

The image segmentation method can be one of the following: grayscale threshold segmentation, maximum inter-class variance method, peak-valley method of image grayscale histogram, minimum error method, maximum entropy automatic threshold method, graph theory segmentation method, etc. The spatial transformation can be an affine transformation, a rigid transformation, or a non-rigid transformation. The visible light image can be segmented to obtain a visible light iris image, and the infrared image can be segmented to obtain an infrared iris image. The visible light iris image and the infrared iris image can then be spatially transformed to ensure that the transformed visible light iris image and the infrared iris image are consistent in size and angle, facilitating subsequent image fusion. The transformed visible light iris image and the infrared iris image are then fused to obtain a color iris image. In this way, the final iris image can be obtained.

Optionally, in step 33, fusing the visible light image and the infrared image to obtain the color iris image may include the following steps:

B1. performing a multi-scale transformation on the visible light image to obtain a first low-frequency component and a first high-frequency component set;

B2. performing multi-scale decomposition on the infrared image to obtain a second low-frequency component and a second high-frequency component set;

B3. performing a weighted operation on the first low-frequency component and the second low-frequency component to obtain a target low-frequency component;

B4. synthesizing the first high-frequency component set and the second high-frequency component set according to the principle of taking the larger neighborhood energy to obtain a target high-frequency component set;

B5. Perform multi-scale inverse transformation on the target low-frequency component and the target high-frequency component set to obtain the color iris image.

A multiscale decomposition algorithm can be used to perform a multiscale transform on the visible light image to obtain a first low-frequency component and a first high-frequency component set. The first high-frequency component set may include multiple high-frequency components. The multiscale decomposition algorithm may include, but is not limited to, wavelet transform, Laplace transform, contourlet transform (CT), non-subsampled contourlet transform (NSCT), shearlet transform, and the like. For example, using contourlet transform to perform multiscale decomposition on the visible light image can produce a low-frequency component and multiple high-frequency components, each of which has a different size. For example, using NSCT to perform multiscale decomposition on the visible light image can produce a low-frequency component and multiple high-frequency components, each of which has a uniform size. The high-frequency component contains more detailed information from the original image. Similarly, a multiscale decomposition algorithm can be used to perform multiscale decomposition on the infrared image to obtain a second low-frequency component and a second high-frequency component set. The neighborhood can be of a specified size, such as 3*3, 5*5, 7*7, 11*11, and so on. Neighborhood considerations fully account for the correlation between surrounding pixels, thereby preserving more detailed information. During high-frequency component synthesis, pixels at corresponding positions are synthesized using the principle of maximizing the neighborhood energy. The first high-frequency component image and the second high-frequency component image correspond to each other, meaning their hierarchical and scale positions are the same. For example, if the first high-frequency component image is at the second layer and the third scale, then the second high-frequency component image is also at the second layer and the third scale. For example, at position A, the energy corresponding to the high-frequency component of the infrared image is 10, while the energy corresponding to the high-frequency component of the visible light image is 11. Therefore, the high-frequency coefficient corresponding to the high-frequency component of the visible light image is selected at position A. Specifically, steps B1 and B2 can be executed in parallel or sequentially. The visible light image can be multi-scale transformed to obtain a first low-frequency component and a first high-frequency component set. The infrared image can be multi-scale decomposed to obtain a second low-frequency component and a second high-frequency component set. The AP is controlled to perform a weighted operation on the first low-frequency component and the second low-frequency component to obtain a target low-frequency component. The first high-frequency component set and the second high-frequency component set are synthesized according to the principle of taking the largest neighborhood energy to obtain a target high-frequency component set. The AP is controlled to perform a multi-scale inverse transform on the target low-frequency component and the target high-frequency component set to obtain a color iris image. The obtained iris image is a color iris image, which can be better viewed by users.

It can be seen that in the embodiment of the present invention, the color information of the target object is collected, the target compensation parameters corresponding to the color information are determined from a plurality of pre-stored compensation parameters, and the iris of the target object is collected according to the target compensation parameters to obtain a color iris image. It can be seen that the corresponding compensation parameters can be obtained through the color information of the target object, and then, the iris is collected according to the compensation parameters, and finally a color iris image can be obtained, which has a better display effect.

Please refer to FIG3 , which is a flowchart of an image processing method according to an embodiment of the present invention. The method is applied to a mobile terminal including an iris recognition device, a memory, and an application processor AP. For a physical diagram and a structural diagram of the mobile terminal, refer to FIG1C . The image processing method includes:

301. Collect color information of the target object.

302. Acquire environmental parameters through environmental sensors.

The above steps 301 and 302 may be performed in parallel, or step 301 may be performed first and then step 302, or step 302 may be performed first and then step 301.

Optionally, the environmental sensor may be an ambient light sensor for detecting ambient brightness, or a magnetic field sensor for detecting magnetic field strength, or a humidity sensor for detecting ambient humidity, or a temperature sensor for detecting ambient temperature. A mapping relationship between environmental parameters and iris acquisition parameters may be pre-set. After determining the current environmental parameters, the iris acquisition parameters corresponding to the current environmental parameters may be determined based on the mapping relationship. The iris acquisition parameters may include, but are not limited to, acquisition current, acquisition voltage, and the like.

303. Determine a target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters.

304. When collecting the iris, compensate the iris based on the target compensation parameter and the environmental parameter to obtain a color iris image.

A mapping relationship between target compensation parameters, environmental parameters, and iris acquisition parameters can be pre-set. Based on this mapping relationship, the iris acquisition parameters corresponding to the target compensation parameters in step 303 and the environmental parameters in step 302 can be determined. Iris acquisition is then performed based on these iris acquisition parameters to obtain a color iris image. The iris acquisition parameters may include, but are not limited to, acquisition current, acquisition voltage, and the like.

It can be seen that in the embodiment of the present invention, the color information of the target object is collected, the target compensation parameters corresponding to the color information are determined from a plurality of pre-stored compensation parameters, and the iris of the target object is collected according to the target compensation parameters and the environmental parameters to obtain a color iris image. It can be seen that the corresponding compensation parameters can be obtained through the color information of the target object, and then, the iris is collected according to the compensation parameters, and finally a color iris image can be obtained, which has a better display effect.

Please refer to FIG. 4 , which shows a mobile terminal provided by an embodiment of the present invention. The mobile terminal mainly includes: an application processor (AP) and a memory, and may also include an iris recognition device; and one or more programs stored in the memory and configured to be executed by the AP. The programs include instructions for performing the following steps:

Collect color information of the target object;

determining a target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters;

During iris acquisition, the iris is compensated based on the target compensation parameter and the environmental parameter to obtain a color iris image.

In one possible example, in determining the target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters, the program includes instructions for executing the following steps:

Analyzing the color information to obtain abnormal color information;

Determining a target representative color corresponding to the abnormal color information;

A target compensation parameter corresponding to the target representative color is determined from the plurality of compensation parameters according to a preset correspondence relationship between the representative color and the compensation parameter.

In one possible example, the iris recognition device includes a visible light camera, an infrared fill light, and an infrared camera; in the aspect of compensating the iris based on the target compensation parameter to obtain a color iris image during iris acquisition, the program includes instructions for executing the following steps:

Capturing an image of the target object using a visible light camera according to the target compensation parameter to obtain a visible light image;

Capturing the target object through an infrared fill light and an infrared camera to obtain an infrared image;

The visible light image and the infrared image are fused to obtain the color iris image.

In one possible example, in the aspect of fusing the visible light image and the infrared image to obtain the color iris image, the program includes instructions for executing the following steps:

performing image segmentation on the visible light image to obtain a visible light iris image;

performing image segmentation on the infrared image to obtain an infrared iris image;

Performing spatial transformation on the visible light iris image and the infrared iris image so that the transformed visible light iris image and the infrared iris image have the same size and angle;

The transformed visible light iris image and the infrared iris image are fused to obtain the color iris image.

In a possible example, the mobile terminal is further provided with an environmental sensor; and the program further includes instructions for executing the following steps:

Acquiring environmental parameters through the environmental sensor;

In the aspect of compensating the iris based on the target compensation parameter to obtain a color iris image during iris acquisition, the program includes instructions for executing the following steps:

During iris acquisition, the iris is compensated based on the target compensation parameter and the environmental parameter to obtain a color iris image.

Please refer to FIG5A, which is a schematic diagram of the structure of an image processing device provided by this embodiment. The image processing device is applied to a mobile terminal and includes a color acquisition unit 501, a compensation parameter determination unit 502, and an iris acquisition unit 503, wherein:

The color acquisition unit 501 is used to acquire color information of the target object;

The compensation parameter determination unit 502 is configured to determine a target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters;

The iris acquisition unit 503 is configured to compensate the iris based on the target compensation parameter and the environmental parameter to obtain a color iris image during iris acquisition.

Optionally, as shown in FIG5B , FIG5B is a detailed structure of the compensation parameter determination unit 502 of the image processing apparatus described in FIG5A . The compensation parameter determination unit 502 may include an analysis module 5021 and a determination module 5022 , as follows:

An analysis module 5021 is configured to analyze the color information to obtain abnormal color information;

A determination module 5022 is configured to determine a target representative color corresponding to the abnormal color information;

The determining module 5022 is further configured to determine a target compensation parameter corresponding to the target representative color from the plurality of compensation parameters according to a preset correspondence between representative colors and compensation parameters.

Optionally, as shown in FIG5C , FIG5C is a detailed structure of the iris acquisition unit 503 of the image processing device described in FIG5A . The iris recognition device includes a visible light camera, an infrared fill light, and an infrared camera. The iris acquisition unit 503 may include: a visible light image acquisition module 5031, an infrared image acquisition module 5032, and a first image fusion module 5033, as follows:

A visible light image acquisition module 5031 is configured to acquire an image of the target object using a visible light camera according to the target compensation parameter to obtain a visible light image;

The infrared image acquisition module 5032 is used to acquire an image of the target object through an infrared fill light and an infrared camera to obtain an infrared image;

The first image fusion module 5033 is configured to fuse the visible light image and the infrared image to obtain the color iris image.

Optionally, as shown in FIG5D , FIG5D is a detailed structure of the first image fusion module 5033 described in FIG5C . The first image fusion module 5033 may include: an image segmentation module 601 , a spatial transformation module 602 , and a second image fusion module 603 , specifically as follows:

An image segmentation module 601 is configured to segment the visible light image to obtain a visible light iris image;

The image segmentation module 601 is further configured to: perform image segmentation on the infrared image to obtain an infrared iris image;

A spatial transformation module 602 is configured to perform spatial transformation on the visible light iris image and the infrared iris image so that the transformed visible light iris image and the infrared iris image have the same size and angle;

The second image fusion module 603 is configured to fuse the transformed visible light iris image with the infrared iris image to obtain the color iris image.

Optionally, as shown in FIG5E , FIG5E is another variant structure of the image processing device described in FIG5A . Compared with FIG5A , the image processing device described in FIG5E further includes: an environmental parameter acquisition unit 504, and the mobile terminal is further provided with an environmental sensor; specifically:

An environmental parameter acquisition unit 504 is configured to acquire environmental parameters via the environmental sensor;

The iris acquisition unit 503 is specifically configured to: during iris acquisition, compensate the iris based on the target compensation parameter and the environmental parameter to obtain a color iris image.

It can be seen that the image processing device described in the embodiment of the present invention collects color information of the target object, determines the target compensation parameters corresponding to the color information from multiple pre-stored compensation parameters, and collects the iris of the target object according to the target compensation parameters to obtain a color iris image. It can be seen that the corresponding compensation parameters can be obtained through the color information of the target object, and then, the iris is collected according to the compensation parameters. Finally, a color iris image can be obtained, which can improve the viewing experience of the iris image.

It can be understood that the functions of each program module of the image processing device of this embodiment can be specifically implemented according to the method in the above method embodiment. The specific implementation process can refer to the relevant description of the above method embodiment and will not be repeated here.

The present invention also provides another mobile terminal, as shown in FIG6 . For ease of explanation, only the portion relevant to the present invention is shown. For specific technical details not disclosed, please refer to the method section of the present invention. The mobile terminal can be any terminal device including a mobile phone, tablet computer, PDA (Personal Digital Assistant), POS (Point of Sales), in-vehicle computer, etc. Taking a mobile phone as an example:

Figure 6 is a block diagram illustrating a portion of the structure of a mobile phone related to a mobile terminal provided by an embodiment of the present invention. Referring to Figure 6 , the mobile phone includes components such as a radio frequency (RF) circuit 910, a memory 920, an input unit 930, a sensor 950, an audio circuit 960, a wireless fidelity (WiFi) module 970, an application processor (AP) 980, and a power supply 990. Those skilled in the art will appreciate that the mobile phone structure shown in Figure 6 does not limit the mobile phone, and the mobile phone may include more or fewer components than shown, or may combine certain components or arrange the components differently.

The following is a detailed introduction to the various components of the mobile phone in conjunction with Figure 6:

The input unit 930 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the mobile phone. Specifically, the input unit 930 may include a touch screen 933, an iris recognition device 931, and other input devices 932. The input unit 930 may also include other input devices 932. Specifically, the other input devices 932 may include, but are not limited to, one or more of physical keys, function keys (such as volume control keys, power keys, etc.), trackballs, mice, joysticks, and the like.

The AP80 may be configured to perform the following steps:

Collect color information of the target object;

determining a target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters;

During iris acquisition, the iris is compensated based on the target compensation parameter to obtain a color iris image.

The AP980 is the control center of the mobile phone, connecting all parts of the phone using various interfaces and circuits. By running or executing software programs and/or modules stored in memory 920 and accessing data stored in memory 920, it executes various functions of the phone and processes data, thereby providing overall monitoring of the phone. The AP980 may optionally include one or more processing units; preferably, the AP980 integrates an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor does not need to be integrated into the AP980.

In addition, the memory 920 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device.

The RF circuit 910 can be used to receive and send information. Typically, the RF circuit 910 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 910 can also communicate with a network and other devices via wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), and the like.

The mobile phone may also include at least one sensor 950, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the touch screen according to the brightness of the ambient light, and the proximity sensor can turn off the touch screen and/or backlight when the mobile phone is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the mobile phone, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be described here.

Audio circuit 960, speaker 961, and microphone 962 provide an audio interface between the user and the phone. Audio circuit 960 converts received audio data into electrical signals and transmits them to speaker 961, which then converts them into sound signals for playback. Microphone 962, on the other hand, converts collected sound signals into electrical signals, which are then received by audio circuit 960 and converted into audio data. This audio data is then processed by playback AP 980 and transmitted via RF circuit 910 to, for example, another phone. Alternatively, the audio data can be played to memory 920 for further processing.

WiFi is a short-range wireless transmission technology. A mobile phone uses WiFi module 970 to help users send and receive emails, browse the web, and access streaming media, providing wireless broadband Internet access. Although FIG6 shows WiFi module 970, it is understood that it is not a required component of the mobile phone and can be omitted as needed without changing the essence of the invention.

The mobile phone also includes a power supply 990 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the AP 980 through a power management system, thereby managing charging, discharging, and power consumption through the power management system.

Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

In the embodiments shown in FIG. 2 and FIG. 3 , each step of the method flow can be implemented based on the structure of the mobile phone.

In the embodiments shown in FIG. 4 and FIG. 5A to FIG. 5E , the functions of each unit can be implemented based on the structure of the mobile phone.

An embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium is used to store a computer program, which enables a computer to execute part or all of the steps of any image processing method described in the above method embodiments.

An embodiment of the present invention also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute part or all of the steps of any image processing method described in the above method embodiments.

It should be noted that for the aforementioned method embodiments, for simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that the present invention is not limited by the order of the actions described, because according to the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software program modules.

If the integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a memory and includes several instructions for enabling a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned memory includes: various media that can store program codes, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program. The program can be stored in a computer-readable memory, and the memory can include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

The embodiments of the present invention are described in detail above. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core ideas. At the same time, for those skilled in the art, according to the ideas of the present invention, there may be changes in the specific implementation methods and application scopes. In summary, the contents of this specification should not be understood as limiting the present invention.

Claims (11)

1. An image processing method, characterized in that the method comprises: Collect color information of the target object; The target compensation parameter corresponding to the color information is determined from a plurality of pre-stored compensation parameters; During iris acquisition, the iris is compensated based on the target compensation parameters to obtain a color iris image; The step of determining the target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters includes: The color information is analyzed to obtain abnormal color information; Determine the target representation color corresponding to the abnormal color information; According to the preset correspondence between the representation color and the compensation parameter, the target compensation parameter corresponding to the target representation color is determined from the plurality of compensation parameters. 2. The method according to claim 1, wherein during iris acquisition, compensating the iris based on the target compensation parameter to obtain a color iris image includes: A visible light image is obtained by acquiring an image of the target object using a visible light camera based on the target compensation parameters. The target object is imaged using an infrared fill light and an infrared camera to obtain an infrared image; The visible light image and the infrared image are fused together to obtain the color iris image. 3. The method according to claim 2, characterized in that, the step of image fusion of the visible light image and the infrared image to obtain the color iris image includes: The visible light image is segmented to obtain a visible light iris image; The infrared image is segmented to obtain an infrared iris image; The visible light iris image and the infrared iris image are spatially transformed so that the transformed visible light iris image and the infrared iris image are the same in size and angle; The transformed visible light iris image is fused with the infrared iris image to obtain the color iris image. 4. The method according to any one of claims 1-3, characterized in that the mobile terminal is further provided with an environmental sensor; the method further includes: Environmental parameters are acquired through the environmental sensors; The step of compensating the iris based on the target compensation parameters during iris acquisition to obtain a color iris image includes: During iris acquisition, the iris is compensated based on the target compensation parameters and the environmental parameters to obtain a color iris image. 5. A mobile terminal, characterized in that it includes an iris recognition device, a memory, and an application processor (AP), wherein the iris recognition device and the memory are both connected to the AP, wherein: The iris recognition device is used to collect color information of the target object; The memory is used to store multiple compensation parameters; The AP is used to determine a target compensation parameter corresponding to the color information from the plurality of compensation parameters; and when the iris recognition device acquires the iris, it compensates the iris based on the target compensation parameter corresponding to the color information to obtain a color iris image. Specifically, in determining the target compensation parameter corresponding to the color information from the plurality of compensation parameters, the AP is used to: The color information is analyzed to obtain abnormal color information; the target representation color corresponding to the abnormal color information is determined; and the target compensation parameter corresponding to the target representation color is determined from the plurality of compensation parameters according to the preset correspondence between the representation color and the compensation parameter. 6. The mobile terminal according to claim 5, wherein the iris recognition device comprises a visible light camera, an infrared fill light, and an infrared camera; In terms of compensating the iris based on the target compensation parameters to obtain a color iris image during iris acquisition, the iris recognition device is specifically used for: The visible light camera of the iris recognition device acquires an image of the target object according to the target compensation parameters, thereby obtaining a visible light image. The infrared fill light and infrared camera of the iris recognition device acquire an image of the target object to obtain an infrared image. The AP is then instructed to fuse the visible light image and the infrared image to obtain the color iris image. 7. The mobile terminal according to claim 6, wherein, in the aspect of image fusion of the visible light image and the infrared image to obtain the color iris image, the AP is specifically used for: The visible light image is segmented to obtain a visible light iris image; the infrared image is segmented to obtain an infrared iris image; the visible light iris image and the infrared iris image are spatially transformed to make the size and angle of the transformed visible light iris image consistent with those of the infrared iris image; the transformed visible light iris image and the infrared iris image are image fused to obtain the color iris image. 8. The mobile terminal according to any one of claims 5-7, wherein the mobile terminal is further provided with an environmental sensor; The environmental sensor is used to acquire environmental parameters; In terms of compensating the iris based on the target compensation parameters to obtain a color iris image during iris acquisition, the iris recognition device is specifically used for: During iris acquisition, the iris is compensated based on the target compensation parameters and the environmental parameters to obtain a color iris image. 9. A mobile terminal, characterized in that it comprises: an iris recognition device, an application processor (AP), and a memory; and one or more programs, said one or more programs being stored in the memory and configured to be executed by the AP, said programs comprising instructions for performing the method as claimed in any one of claims 1-4. 10. An image processing apparatus, characterized in that the image processing apparatus comprises a color acquisition unit, a compensation parameter determination unit, and an iris acquisition unit, wherein, The color acquisition unit is used to acquire the color information of the target object; The compensation parameter determination unit is used to determine the target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters; The iris acquisition unit is used to compensate the iris based on the target compensation parameters during iris acquisition to obtain a color iris image; Specifically, in determining the target compensation parameter corresponding to the color information from a plurality of pre-stored compensation parameters, the compensation parameter determining unit is used for: The color information is analyzed to obtain abnormal color information; Determine the target representation color corresponding to the abnormal color information; According to the preset correspondence between the representation color and the compensation parameter, the target compensation parameter corresponding to the target representation color is determined from the plurality of compensation parameters. 11. A computer-readable storage medium, characterized in that it is used to store a computer program, wherein the computer program causes a computer to perform the method as described in any one of claims 1-4.