CN111951176A - A method and device for removing partial shadows from face images - Google Patents
A method and device for removing partial shadows from face images Download PDFInfo
- Publication number
- CN111951176A CN111951176A CN202010621308.3A CN202010621308A CN111951176A CN 111951176 A CN111951176 A CN 111951176A CN 202010621308 A CN202010621308 A CN 202010621308A CN 111951176 A CN111951176 A CN 111951176A
- Authority
- CN
- China
- Prior art keywords
- processed
- preset
- area
- shadow
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Image Processing (AREA)
Abstract
本发明公开了一种去除人脸图像局部阴影的方法和设备,该方法基于预设人脸照片获取包含阴影区域的待处理区域,所述预设人脸照片包括待处理人脸图像,所述待处理人脸图像包括所述待处理区域,根据预设像素阈值从所述待处理区域中提取所述阴影区域,基于预设伽马系数对所述阴影区域进行伽马校正,并基于所述伽马校正的结果获取结果区域,根据所述结果区域生成去除局部阴影的人脸照片,从而减小在去除人脸图像的局部阴影时的处理痕迹,进而提高3D人脸模型的质量。The invention discloses a method and device for removing partial shadows of a face image. The method obtains a to-be-processed area including a shadow area based on a preset face photo, the preset face photo includes the to-be-processed face image, and the The face image to be processed includes the area to be processed, the shadow area is extracted from the area to be processed according to a preset pixel threshold, the shadow area is gamma corrected based on a preset gamma coefficient, and the shadow area is gamma corrected based on the preset gamma coefficient. The result of the gamma correction obtains a result area, and generates a face photo with partial shadows removed according to the result area, thereby reducing the processing traces when removing the partial shadows of the face image, thereby improving the quality of the 3D face model.
Description
技术领域technical field
本申请涉及图像处理领域,更具体地,涉及一种去除人脸图像局部阴影的方法和设备。The present application relates to the field of image processing, and more particularly, to a method and device for removing partial shadows from a face image.
背景技术Background technique
通过相机扫描人脸形成3D人脸重建的过程中,采集人脸照片中的像素信息需要尽可能的除去光照信息。然而有些局部区域的光照信息通过全局去光照的方法是无法去除的。比如鼻孔在照片中产生的阴影,往往会被全局去光照的算法忽略掉,而无法实现除去阴影的目的。这些阴影会导致3D人脸模型在3D场景中出现多余的阴影信息。如图1所示,圈中部分就是没有对鼻孔位置的阴影进行处理而产生的效果。In the process of scanning a face with a camera to form a 3D face reconstruction, it is necessary to remove the illumination information as much as possible to collect the pixel information in the face photo. However, the illumination information of some local areas cannot be removed by the global de-illumination method. For example, the shadow generated by the nostrils in the photo is often ignored by the global de-illumination algorithm, and the purpose of removing the shadow cannot be achieved. These shadows will cause the 3D face model to appear redundant shadow information in the 3D scene. As shown in Figure 1, the part in the circle is the effect of not processing the shadow of the nostril position.
为了实现局部区域去阴影,现有技术中有通过目标识别的算法找到局部位置的阴影,然后通过统计图片中像素的组成去更换阴影处的像素。这种方式生成的新的图片在原先阴影位置出现明显的痕迹,边缘也特别突出,给人的视觉感观不好。如图2中圈中部分所示,鼻孔处被改动过的痕迹过于明显。In order to remove shadows in local areas, in the prior art, an algorithm of target recognition is used to find the shadows at local locations, and then the pixels in the shadows are replaced by counting the composition of pixels in the image. The new image generated in this way has obvious traces in the original shadow position, and the edges are also particularly prominent, giving people a bad visual perception. As shown in the circled part in Figure 2, the altered marks at the nostrils are too obvious.
在学术界也有广泛的研究,Kumar提出了一种假设检验来检测图像中的阴影,然后使用能量函数概念从图像中去除阴影。这种方法在阴影检测时间较长,处理阴影的痕迹明显。Kaushik Deb提出了一个使用亮度色度的简单框架:蓝色,色度:红色(YCbCr)色彩空间,用于检测并消除图像中的阴影。虽然这种方法在检测和处理速度上有所提升,但是去除阴影的最终效果仍不理想,如图3所示。Also widely studied in academia, Kumar proposes a hypothesis test to detect shadows in images and then remove shadows from images using the energy function concept. In this method, the shadow detection time is longer, and the traces of shadow processing are obvious. Kaushik Deb proposes a simple framework using the luminance-chroma:blue, chroma:red (YCbCr) color space for detecting and eliminating shadows in images. Although this method improves the detection and processing speed, the final effect of removing shadows is still not ideal, as shown in Figure 3.
综上,现有技术在去除人脸图像的局部阴影时,由于无法保留局部区域的轮廓信息和阴影内仍然存在的皮肤像素信息,造成了明显的处理痕迹,降低了3D人脸模型的质量。To sum up, when the prior art removes the partial shadow of the face image, since the contour information of the local area and the skin pixel information still existing in the shadow cannot be preserved, obvious processing marks are caused and the quality of the 3D face model is reduced.
因此,如何减小在去除人脸图像的局部阴影时的处理痕迹,进而提高3D人脸模型的质量,是目前有待解决的技术问题。Therefore, how to reduce the processing traces when removing the partial shadows of the face image, thereby improving the quality of the 3D face model, is a technical problem to be solved at present.
发明内容SUMMARY OF THE INVENTION
由于现有技术去除人脸图像局部阴影时会出现明显的痕迹的技术问题,本发明提供了一种去除人脸图像局部阴影的方法,所述方法包括:Due to the technical problem that obvious traces will appear when removing partial shadows from face images in the prior art, the present invention provides a method for removing partial shadows from face images, the method comprising:
基于预设人脸照片获取包含阴影区域的待处理区域,所述预设人脸照片包括待处理人脸图像,所述待处理人脸图像包括所述待处理区域;Acquiring a to-be-processed area including a shadow area based on a preset face photo, where the preset face photo includes a to-be-processed face image, and the to-be-processed face image includes the to-be-processed area;
根据预设像素阈值从所述待处理区域中提取所述阴影区域;Extracting the shadow area from the to-be-processed area according to a preset pixel threshold;
基于预设伽马系数对所述阴影区域进行伽马校正,并基于所述伽马校正的结果获取结果区域;Perform gamma correction on the shadow area based on a preset gamma coefficient, and obtain a result area based on a result of the gamma correction;
根据所述结果区域生成去除局部阴影的人脸照片。A face photo with partial shadows removed is generated according to the result area.
优选的,基于预设人脸照片获取包含阴影区域的待处理区域,具体为:Preferably, the to-be-processed area including the shadow area is obtained based on the preset face photo, specifically:
基于第一预设级联分类器从所述预设人脸照片中提取所述待处理人脸图像;extracting the to-be-processed face image from the preset face photo based on the first preset cascade classifier;
基于第二预设级联分类器从所述待处理人脸图像中提取所述待处理区域。The to-be-processed region is extracted from the to-be-processed face image based on a second preset cascaded classifier.
优选的,基于第二预设级联分类器从所述待处理人脸图像中提取所述待处理区域,具体为:Preferably, the to-be-processed region is extracted from the to-be-processed face image based on a second preset cascade classifier, specifically:
基于所述第二预设级联分类器从所述待处理人脸图像中获取与所述待处理区域对应的多个识别结果;Obtaining a plurality of recognition results corresponding to the to-be-processed area from the to-be-processed face image based on the second preset cascade classifier;
根据预设校验规则从多个所述识别结果中提取所述待处理区域,所述预设校验规则是根据五官的预设位置关系和或五官的预设比例关系确定的。The to-be-processed area is extracted from a plurality of the identification results according to a preset verification rule, and the preset verification rule is determined according to a preset positional relationship of the facial features or a preset proportional relationship of the facial features.
优选的,根据预设像素阈值从所述待处理区域中提取所述阴影区域,具体为:Preferably, the shadow area is extracted from the to-be-processed area according to a preset pixel threshold, specifically:
根据所述预设像素阈值从所述待处理区域的灰度图中分割出二值图像,所述预设像素阈值是根据大津法确定的;A binary image is segmented from the grayscale image of the region to be processed according to the preset pixel threshold, which is determined according to the Otsu method;
根据所述二值图像提取所述阴影区域。The shaded area is extracted from the binary image.
优选的,基于预设伽马系数对所述阴影区域进行伽马校正,具体为:Preferably, gamma correction is performed on the shadow area based on a preset gamma coefficient, specifically:
基于所述预设伽马系数迭代调整所述阴影区域的阴影像素数量,直至所述阴影像素数量小于预设数量时确定所述伽马校正的结果。Iteratively adjusts the number of shaded pixels in the shaded area based on the preset gamma coefficient, until the number of shaded pixels is less than the preset number to determine a result of the gamma correction.
优选的,根据所述结果区域生成去除局部阴影的人脸照片,具体为:Preferably, a face photo with partial shadows removed is generated according to the result area, specifically:
基于将所述结果区域替换所述阴影区域生成已处理区域;generating a processed region based on replacing the shadow region with the result region;
基于将所述已处理区域替换所述待处理区域生成已处理人脸图像;generating a processed face image based on replacing the processed region with the to-be-processed region;
基于将所述已处理人脸图像替换所述待处理人脸图像生成所述去除局部阴影的人脸照片。The partial shadow-removed face photo is generated based on replacing the processed face image with the to-be-processed face image.
相应的,本发明还提供了一种去除人脸图像局部阴影的设备,所述设备包括:Correspondingly, the present invention also provides a device for removing partial shadows from a face image, the device comprising:
第一获取模块,用于基于预设人脸照片获取包含阴影区域的待处理区域,所述预设人脸照片包括待处理人脸图像,所述待处理人脸图像包括所述待处理区域;a first obtaining module, configured to obtain a to-be-processed area including a shadow area based on a preset face photo, where the preset face photo includes a to-be-processed face image, and the to-be-processed face image includes the to-be-processed area;
提取模块,用于根据预设像素阈值从所述待处理区域中提取所述阴影区域;an extraction module, configured to extract the shadow area from the to-be-processed area according to a preset pixel threshold;
第二获取模块,用于基于预设伽马系数对所述阴影区域进行伽马校正,并基于所述伽马校正的结果获取结果区域;a second obtaining module, configured to perform gamma correction on the shadow area based on a preset gamma coefficient, and obtain a result area based on the result of the gamma correction;
生成模块,用于根据所述结果区域生成去除局部阴影的人脸照片。A generating module is configured to generate a face photo with partial shadow removed according to the result area.
优选的,所述第一获取模块,具体用于:Preferably, the first acquisition module is specifically used for:
基于第一预设级联分类器从所述预设人脸照片中提取所述待处理人脸图像;extracting the to-be-processed face image from the preset face photo based on the first preset cascade classifier;
基于第二预设级联分类器从所述待处理人脸图像中提取所述待处理区域。The to-be-processed region is extracted from the to-be-processed face image based on a second preset cascaded classifier.
优选的,所述第一获取模块,还具体用于:Preferably, the first acquisition module is also specifically used for:
基于所述第二预设级联分类器从所述待处理人脸图像中获取与所述待处理区域对应的多个识别结果;Obtaining a plurality of recognition results corresponding to the to-be-processed area from the to-be-processed face image based on the second preset cascade classifier;
根据预设校验规则从多个所述识别结果中提取所述待处理区域,所述预设校验规则是根据五官的预设位置关系和或五官的预设比例关系确定的。The to-be-processed area is extracted from a plurality of the identification results according to a preset verification rule, and the preset verification rule is determined according to a preset positional relationship of the facial features or a preset proportional relationship of the facial features.
优选的,所述提取模块,具体用于:Preferably, the extraction module is specifically used for:
根据所述预设像素阈值从所述待处理区域的灰度图中分割出二值图像,所述预设像素阈值是根据大津法确定的;A binary image is segmented from the grayscale image of the region to be processed according to the preset pixel threshold, which is determined according to the Otsu method;
根据所述二值图像提取所述阴影区域。The shaded area is extracted from the binary image.
优选的,所述第二获取模块,具体用于:Preferably, the second acquisition module is specifically used for:
基于所述预设伽马系数迭代调整所述阴影区域的阴影像素数量,直至所述阴影像素数量小于预设数量时确定所述伽马校正的结果。Iteratively adjusts the number of shaded pixels in the shaded area based on the preset gamma coefficient, until the number of shaded pixels is less than the preset number to determine a result of the gamma correction.
优选的,所述生成模块,具体用于:Preferably, the generation module is specifically used for:
基于将所述结果区域替换所述阴影区域生成已处理区域;generating a processed region based on replacing the shadow region with the result region;
基于将所述已处理区域替换所述待处理区域生成已处理人脸图像;generating a processed face image based on replacing the processed region with the to-be-processed region;
基于将所述已处理人脸图像替换所述待处理人脸图像生成所述去除局部阴影的人脸照片。The partial shadow-removed face photo is generated based on replacing the processed face image with the to-be-processed face image.
相应的,本申请还提出了一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,当所述指令在终端设备上运行时,使得所述终端设备执行如上所述的去除人脸图像局部阴影的方法。Correspondingly, the present application also proposes a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a terminal device, the terminal device is caused to perform the above-mentioned removal. Methods for local shading of face images.
相应的,本申请还提出了一种计算机程序产品,所述计算机程序产品在终端设备上运行时,使得所述终端设备执行如上所述的去除人脸图像局部阴影的方法。Correspondingly, the present application also proposes a computer program product, which, when running on a terminal device, enables the terminal device to execute the above-described method for removing partial shadows from a face image.
与现有技术对比,本发明具备以下有益效果:Compared with the prior art, the present invention has the following beneficial effects:
本发明公开了一种去除人脸图像局部阴影的方法和设备,基于预设人脸照片获取包含阴影区域的待处理区域,所述预设人脸照片包括待处理人脸图像,所述待处理人脸图像包括所述待处理区域,根据预设像素阈值从所述待处理区域中提取所述阴影区域,基于预设伽马系数对所述阴影区域进行伽马校正,并基于所述伽马校正的结果获取结果区域,根据所述结果区域生成去除局部阴影的人脸照片,通过去除人脸图像局部阴影,可以减小在去除人脸图像的局部阴影时的处理痕迹,提高3D人脸模型的质量,进而满足3D人脸重建在高画质中的需求。The invention discloses a method and a device for removing partial shadows of a face image. A to-be-processed area including a shadow area is obtained based on a preset face photo, the preset face photo includes a to-be-processed face image, and the to-be-processed face image is obtained. The face image includes the area to be processed, the shadow area is extracted from the area to be processed according to a preset pixel threshold, gamma correction is performed on the shadow area based on a preset gamma coefficient, and based on the gamma The result of the correction obtains a result area, and generates a face photo with partial shadows removed according to the result area. By removing the partial shadows of the face image, processing traces when removing the partial shadows of the face image can be reduced, and the 3D face model can be improved. The quality of 3D face reconstruction in high image quality is satisfied.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.
图1示出了现有技术中未除去鼻孔阴影的3D人脸效果图;Fig. 1 shows the 3D human face renderings without removing the nostril shadow in the prior art;
图2示出了现有技术中朴素阴影检测和去除效果图;Fig. 2 shows the naive shadow detection and removal effect diagram in the prior art;
图3示出了现有技术中基于YCbCr色彩空间检测并消除图像中的阴影;Fig. 3 shows the prior art based on YCbCr color space to detect and eliminate the shadow in the image;
图4示出了本发明实施例提出的一种去除人脸图像局部阴影的方法的流程示意图;4 shows a schematic flowchart of a method for removing partial shadows from a face image provided by an embodiment of the present invention;
图5示出了本发明又一实施例中提出的一种去除人脸图像局部阴影方法的流程示意图;5 shows a schematic flowchart of a method for removing partial shadows from a face image proposed in another embodiment of the present invention;
图6示出了本发明实施例中级联分类器获得脸部和鼻子的区域图;Fig. 6 shows the region diagram of the face and nose obtained by the cascade classifier in the embodiment of the present invention;
图7示出了本发明实施例中阴影去除效果图;FIG. 7 shows a shadow removal effect diagram in an embodiment of the present invention;
图8示出了本发明实施例中鼻孔去阴影后效果图;Fig. 8 shows the effect diagram after the nostril is removed shadow in the embodiment of the present invention;
图9示出了本发明实施例提出的一种去除人脸图像局部阴影设备的结构示意图。FIG. 9 shows a schematic structural diagram of a device for removing partial shadows from a face image according to an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.
如背景技术所述,现有技术在去除人脸图像的局部阴影时,由于无法保留局部区域的轮廓信息和阴影内仍然存在的皮肤像素信息,造成了明显的处理痕迹,降低了3D人脸模型的质量。As described in the background art, when removing the partial shadow of a face image in the prior art, since the contour information of the local area and the skin pixel information still existing in the shadow cannot be preserved, obvious processing traces are caused, and the 3D face model is reduced. the quality of.
为解决上述问题,本发明实施例提供了一种去除人脸图像局部阴影的方法,基于预设人脸照片获取包含阴影区域的待处理区域,所述预设人脸照片包括待处理人脸图像,所述待处理人脸图像包括所述待处理区域,根据预设像素阈值从所述待处理区域中提取所述阴影区域,基于预设伽马系数对所述阴影区域进行伽马校正,并基于所述伽马校正的结果获取结果区域,根据所述结果区域生成去除局部阴影的人脸照片,减小了在去除人脸图像的局部阴影时的处理痕迹,提高了3D人脸模型的质量。In order to solve the above problem, an embodiment of the present invention provides a method for removing partial shadows from a face image, and obtains a to-be-processed area including a shadow area based on a preset face photo, where the preset face photo includes the to-be-processed face image. , the to-be-processed face image includes the to-be-processed area, extracts the shadow area from the to-be-processed area according to a preset pixel threshold, performs gamma correction on the shadow area based on a preset gamma coefficient, and Obtaining a result area based on the result of the gamma correction, and generating a face photo with partial shadows removed from the result area, reducing the processing traces when removing the partial shadows of the face image, and improving the quality of the 3D face model .
如图4所示为本发明实施例提出的一种去除人脸图像局部阴影的方法的流程示意图,所述方法包括以下步骤:FIG. 4 is a schematic flowchart of a method for removing partial shadows from a face image proposed by an embodiment of the present invention, and the method includes the following steps:
S401,基于预设人脸照片获取包含阴影区域的待处理区域,所述预设人脸照片包括待处理人脸图像,所述待处理人脸图像包括所述待处理区域。在具体的实施场景中,首先获取人脸照片中包含阴影区域的待处理区域,人脸照片可以为待处理人脸图像或其他包含人脸的图片,待处理区域可以为鼻孔区域或其他区域。S401. Acquire a to-be-processed area including a shadow area based on a preset face photo, where the preset face photo includes a to-be-processed face image, and the to-be-processed face image includes the to-be-processed area. In a specific implementation scenario, first obtain the to-be-processed area including the shadow area in the face photo. The face photo can be a to-be-processed face image or other pictures including a human face, and the to-be-processed area can be the nostril area or other areas.
为了能准确的获取包含阴影区域的待处理区域,在本申请的优选实施例中,基于预设人脸照片获取包含阴影区域的待处理区域,具体为:In order to accurately obtain the to-be-processed area including the shadow area, in a preferred embodiment of the present application, the to-be-processed area including the shadow area is obtained based on a preset face photo, specifically:
基于第一预设级联分类器从所述预设人脸照片中提取所述待处理人脸图像;extracting the to-be-processed face image from the preset face photo based on the first preset cascade classifier;
基于第二预设级联分类器从所述待处理人脸图像中提取所述待处理区域。The to-be-processed region is extracted from the to-be-processed face image based on a second preset cascaded classifier.
在具体的实施场景中,由于人脸图像的特征更为明显,而且在人脸图像上再获取所述待处理区域效率更高,所以先根据人脸照片获取待处理人脸图像,然后再在人脸图像上获取所述待处理区域,目标图像检测方法主要分为两大类,基于规则和基于统计。由于基于规则的方式比较复杂,需要大量专家和专业人员参与,因此选择基于统计的方式。虽然神经网络具有非常高的准确率,但是为了能在移动设备上也使用该功能,需要更小的模型,更小的CPU/GPU的消耗。因此,采用传统机器学习中的级联分类器来识别图片中目标图像所处的位置。其中,级联分类器识别图片中目标图像的步骤包括:通过Harr提取图片特征,再通过使用Adaboost算法训练强分类器,最后区分出目标图像和非目标图像。In a specific implementation scenario, since the features of the face image are more obvious, and it is more efficient to obtain the area to be processed on the face image, the face image to be processed is first obtained according to the face photo, and then For obtaining the to-be-processed area on the face image, the target image detection methods are mainly divided into two categories, rule-based and statistics-based. Because the rule-based method is more complicated and requires the participation of a large number of experts and professionals, the statistics-based method is chosen. Although the neural network has a very high accuracy, in order to use this function on mobile devices, a smaller model and less CPU/GPU consumption are required. Therefore, cascade classifiers in traditional machine learning are used to identify the location of the target image in the picture. The steps of identifying the target image in the image by the cascade classifier include: extracting image features through Harr, then using the Adaboost algorithm to train a strong classifier, and finally distinguishing between the target image and the non-target image.
为了方便区分,在本申请的优选实施例中,通过第一预设级联分类器从所述预设人脸照片中提取所述待处理人脸图像,通过第二预设级联分类器从所述待处理人脸图像中提取所述待处理区域。In order to facilitate the distinction, in a preferred embodiment of the present application, the face image to be processed is extracted from the preset face photo by the first preset cascade classifier, and the face image to be processed is extracted from the preset face photo by the second preset cascade classifier. The to-be-processed area is extracted from the to-be-processed face image.
需要说明的是,以上优选实施例的方案仅为本申请所提出的一种具体实现方案,其他基于预设人脸照片获取包含阴影区域的待处理区域的方式均属于本申请的保护范围。It should be noted that the solution of the above preferred embodiment is only a specific implementation solution proposed by the present application, and other methods of obtaining the to-be-processed area including the shadow area based on the preset face photo all belong to the protection scope of the present application.
为了提高提取所述待处理区域的准确性,在本申请的优选实施例中,基于第二预设级联分类器从所述待处理人脸图像中提取所述待处理区域,具体为:In order to improve the accuracy of extracting the to-be-processed area, in a preferred embodiment of the present application, the to-be-processed area is extracted from the to-be-processed face image based on a second preset cascade classifier, specifically:
基于所述第二预设级联分类器从所述待处理人脸图像中获取与所述待处理区域对应的多个识别结果;Obtaining a plurality of recognition results corresponding to the to-be-processed area from the to-be-processed face image based on the second preset cascade classifier;
根据预设校验规则从多个所述识别结果中提取所述待处理区域,所述预设校验规则是根据五官的预设位置关系和或五官的预设比例关系确定的。The to-be-processed area is extracted from a plurality of the identification results according to a preset verification rule, and the preset verification rule is determined according to a preset positional relationship of the facial features or a preset proportional relationship of the facial features.
在具体的实施场景中,由于本优选实施例采用传统的机器学习算法,通过第二预设级联分类器从所述待处理人脸图像中获取待处理区域,会产生多个识别结果,这时需要再设置校验规则,根据设置的校验规则从多个所述识别结果中提取正确的待处理区域,作为唯一结果。由于所述待处理区域是在人脸图像上获取的,所以在本申请优选的实施例中,所述预设校验规则是根据五官的预设位置关系和或五官的预设比例关系确定的。当然也可以根据实际情况通过其他预设校验规则从多个所述识别结果中提取所述待处理区域,如可以通过所述待处理区域的预设颜色、预设大小和预设形状等来进行提取所述待处理区域。In a specific implementation scenario, since the traditional machine learning algorithm is adopted in this preferred embodiment, the region to be processed is obtained from the face image to be processed through the second preset cascade classifier, and multiple recognition results will be generated, which is When the verification rule needs to be set again, the correct to-be-processed area is extracted from the plurality of identification results according to the set verification rule as the unique result. Since the to-be-processed area is obtained from a face image, in a preferred embodiment of the present application, the preset verification rule is determined according to the preset positional relationship of the facial features or the preset proportional relationship of the facial features . Of course, the to-be-processed area can also be extracted from a plurality of the identification results through other preset verification rules according to the actual situation. Extract the to-be-processed area.
需要说明的是,以上优选实施例的方案仅为本申请所提出的一种具体实现方案,其他基于第二预设级联分类器从所述待处理人脸图像中提取所述待处理区域的方式均属于本申请的保护范围。It should be noted that the solution of the above preferred embodiment is only a specific implementation solution proposed in this application, and the other is based on the second preset cascade classifier to extract the to-be-processed area from the to-be-processed face image. All methods belong to the protection scope of the present application.
S402,根据预设像素阈值从所述待处理区域中提取所述阴影区域。S402: Extract the shadow area from the to-be-processed area according to a preset pixel threshold.
在具体的实施场景中,在获取到的包含阴影区域的待处理区域中,阴影区域与非阴影区域的像素值是不同的,通过预设的阈值来将不在阈值内的非阴影区域排除得到所述阴影区域。In a specific implementation scenario, in the acquired to-be-processed area including the shadow area, the pixel values of the shadow area and the non-shadow area are different, and the non-shadow area that is not within the threshold value is excluded by a preset threshold to obtain the result. the shaded area.
为了精确的提取阴影区域,在本申请的优选实施例中,根据预设像素阈值从所述待处理区域中提取所述阴影区域,具体为:In order to accurately extract the shadow area, in a preferred embodiment of the present application, the shadow area is extracted from the to-be-processed area according to a preset pixel threshold, specifically:
根据所述预设像素阈值从所述待处理区域的灰度图中分割出二值图像,所述预设像素阈值是根据大津法确定的;A binary image is segmented from the grayscale image of the region to be processed according to the preset pixel threshold, which is determined according to the Otsu method;
根据所述二值图像提取所述阴影区域。The shaded area is extracted from the binary image.
在具体的实施场景中,二值图像是指将图像上的每一个像素只有两种可能的取值或灰度等级状态,根据所述预设像素阈值将所述待处理区域的灰度图中的各个像素分为两种,即满足阈值的一种,不满足阈值的一种,然后就可以得到该待处理区域灰度图的二值图像。In a specific implementation scenario, a binary image means that each pixel on the image has only two possible values or gray-level states, and the gray-scale image of the to-be-processed area is divided according to the preset pixel threshold Each pixel of is divided into two types, that is, one that meets the threshold, and one that does not meet the threshold, and then the binary image of the grayscale image of the area to be processed can be obtained.
大津法是一种确定图像二值化分割阈值的算法,按照大津法求得的阈值进行图像二值化分割后,前景与背景图像的类间方差最大。为了对所述待处理区域的灰度图中的各个像素进行分割时,错分的概率最小,在本申请优选的实施例中,所述预设像素阈值是根据大津法确定的。The Otsu method is an algorithm for determining the threshold value of image binarization. After the image binarization segmentation is performed according to the threshold obtained by the Otsu method, the inter-class variance of the foreground and background images is the largest. In order to minimize the probability of misclassification when segmenting each pixel in the grayscale image of the region to be processed, in a preferred embodiment of the present application, the preset pixel threshold is determined according to the Otsu method.
在根据所述预设像素阈值从所述待处理区域的灰度图中分割出的二值图像中,非阴影区域一种颜色,阴影区域一种颜色,这时很容易从所述二值图像提取所述阴影区域。In the binary image segmented from the grayscale image of the area to be processed according to the preset pixel threshold, there is one color for the non-shaded area and one color for the shaded area. At this time, it is easy to extract the binary image from the The shaded area is extracted.
需要说明的是,以上优选实施例的方案仅为本申请所提出的一种具体实现方案,其他根据预设像素阈值从所述待处理区域中提取所述阴影区域的方式均属于本申请的保护范围。It should be noted that the solution of the above preferred embodiment is only a specific implementation solution proposed by the present application, and other methods of extracting the shadow area from the to-be-processed area according to the preset pixel threshold all belong to the protection of the present application. scope.
S403,基于预设伽马系数对所述阴影区域进行伽马校正,并基于所述伽马校正的结果获取结果区域。S403, perform gamma correction on the shadow area based on a preset gamma coefficient, and obtain a result area based on a result of the gamma correction.
在具体的实施场景中,伽马校正是用来针对影片或影像系统里对于光线的辉度或三色刺激值所进行非线性的运算或反运算,因为人眼对亮度的感知和物理功率不成正比,而是幂函数的关系,所以在本申请的优先实施例中,采用预设伽马系数对所述阴影区域进行伽马校正,校正后可以增加所述阴影区域的亮度,然后根据所述伽马校正的结果获取结果区域。In a specific implementation scenario, gamma correction is used to perform nonlinear operations or inverse operations on the brightness or tristimulus values of light in a film or imaging system, because the human eye's perception of brightness is not related to physical power. is proportional to the power function, so in the preferred embodiment of the present application, a preset gamma coefficient is used to perform gamma correction on the shadow area, after the correction, the brightness of the shadow area can be increased, and then according to the The result of the gamma correction is obtained in the result area.
为了提高伽马校正的结果,在本申请的优选实施例中,基于预设伽马系数对所述阴影区域进行伽马校正,具体为:In order to improve the result of gamma correction, in a preferred embodiment of the present application, gamma correction is performed on the shadow area based on a preset gamma coefficient, specifically:
基于所述预设伽马系数迭代调整所述阴影区域的阴影像素数量,直至所述阴影像素数量小于预设数量时确定所述伽马校正的结果。Iteratively adjusts the number of shaded pixels in the shaded area based on the preset gamma coefficient, until the number of shaded pixels is less than the preset number to determine a result of the gamma correction.
在具体的实施场景中,为了渐进式提高所述阴影区域的亮度,一般预设伽马系数选取小于1且足够接近1的数值,为了保持足够好的轮廓信息,一般需要根据所述预设伽马系数迭代调整多次所述阴影区域的阴影像素数量,当所述阴影像素数量小于预设数量时,停止迭代并该次迭代结果为最终所述伽马校正的结果。需要说明的是,为了使最后结果无限接近理想化,每次迭代时进行预设伽马系数的调整幅度不能太大,在不影响校正速度的情况下,调整幅度越小越好。In a specific implementation scenario, in order to gradually increase the brightness of the shadow area, the preset gamma coefficient is generally selected as a value less than 1 and close enough to 1. The horse coefficient iteratively adjusts the number of shadow pixels in the shadow area for several times. When the number of shadow pixels is less than the preset number, the iteration is stopped and the result of this iteration is the final result of the gamma correction. It should be noted that, in order to make the final result infinitely close to ideal, the adjustment range of the preset gamma coefficient in each iteration should not be too large, and the smaller the adjustment range, the better without affecting the correction speed.
需要说明的是,以上优选实施例的方案仅为本申请所提出的一种具体实现方案,其他基于预设伽马系数对所述阴影区域进行伽马校正的方式均属于本申请的保护范围。It should be noted that the solution of the above preferred embodiment is only a specific implementation solution proposed by the present application, and other methods of performing gamma correction on the shadow area based on preset gamma coefficients all belong to the protection scope of the present application.
S404,根据所述结果区域生成去除局部阴影的人脸照片。S404, generating a face photo with partial shadows removed according to the result area.
在具体的实施场景中,在获得所述结果区域后,用所述结果区域将人脸照片中的阴影区域替换掉,得到去除局部阴影的人脸照片。In a specific implementation scenario, after the result area is obtained, the shadow area in the face photo is replaced with the result area to obtain a face photo with partial shadow removed.
为了准确的生成去除局部阴影的人脸照片,在本申请的优选实施例中,根据所述结果区域生成去除局部阴影的人脸照片,具体为:In order to accurately generate a face photo with partial shadow removed, in a preferred embodiment of the present application, a face photo with partial shadow removed is generated according to the result area, specifically:
基于将所述结果区域替换所述阴影区域生成已处理区域;generating a processed region based on replacing the shadow region with the result region;
基于将所述已处理区域替换所述待处理区域生成已处理人脸图像;generating a processed face image based on replacing the processed region with the to-be-processed region;
基于将所述已处理人脸图像替换所述待处理人脸图像生成所述去除局部阴影的人脸照片。The partial shadow-removed face photo is generated based on replacing the processed face image with the to-be-processed face image.
在具体的实施场景中,在获得所述结果区域后,先将所述结果区域替换所述阴影区域,在替换完所述阴影区域后得到所述待处理区域对应的已处理区域,接着将所述已处理区域替换所述待处理区域生成已处理人脸图像,最后将所述已处理人脸图像替换所述待处理人脸图像生成最终所述去除局部阴影的人脸照片。In a specific implementation scenario, after obtaining the result area, first replace the shadow area with the result area, obtain the processed area corresponding to the to-be-processed area after replacing the shadow area, and then replace the shadow area with the result area. The processed area replaces the to-be-processed area to generate a processed face image, and finally replaces the processed face image with the to-be-processed face image to generate the final partial shadow-removed face photo.
需要说明的是,以上优选实施例的方案仅为本申请所提出的一种具体实现方案,其他根据所述结果区域生成去除局部阴影的人脸照片的方式均属于本申请的保护范围。It should be noted that the solution of the above preferred embodiment is only a specific implementation solution proposed by the present application, and other methods of generating face photos with partial shadows removed according to the result area all belong to the protection scope of the present application.
通过应用以上技术方案,基于预设人脸照片获取包含阴影区域的待处理区域,所述预设人脸照片包括待处理人脸图像,所述待处理人脸图像包括所述待处理区域,根据预设像素阈值从所述待处理区域中提取所述阴影区域,基于预设伽马系数对所述阴影区域进行伽马校正,并基于所述伽马校正的结果获取结果区域,根据所述结果区域生成去除局部阴影的人脸照片,可以减小在去除人脸图像的局部阴影时的处理痕迹,提高3D人脸模型的质量,进而满足3D人脸重建在手机游戏、手机APP和虚拟现实中的高画质的要求。By applying the above technical solutions, a to-be-processed area including a shadow area is obtained based on a preset face photo, the preset face photo includes a to-be-processed face image, and the to-be-processed face image includes the to-be-processed area, according to Extracting the shadow area from the to-be-processed area with a preset pixel threshold, performing gamma correction on the shadow area based on a preset gamma coefficient, and obtaining a result area based on a result of the gamma correction, and according to the result Regional generation of face photos with partial shadows removed can reduce the processing traces when removing partial shadows of face images, improve the quality of 3D face models, and then meet the needs of 3D face reconstruction in mobile games, mobile APPs and virtual reality. high-definition requirements.
为了进一步阐述本发明的技术思想,现结合具体的应用场景,对本发明的技术方案进行说明。In order to further illustrate the technical idea of the present invention, the technical solutions of the present invention are now described with reference to specific application scenarios.
本发明实施例提出了一种三维人脸模型的生成方法,在图片中识别人脸,获取人脸中鼻子的位置,检测阴影区域并利用伽马校正,生成去人脸阴影照片,实现过程如图5所示,上述方法具体步骤如下:The embodiment of the present invention proposes a method for generating a three-dimensional face model. The face is recognized in a picture, the position of the nose in the face is obtained, the shadow area is detected, and gamma correction is used to generate a shadow-free photo of the face. The implementation process is as follows: As shown in Figure 5, the specific steps of the above method are as follows:
S501,在图像中识别人脸。S501, recognize the face in the image.
为了准确的在图像中识别人脸,在本申请的优选实施例中,由于人脸特征更为明显,在人脸的区域识别鼻子的准确率更高,所以本发明中需要先在图像中识别人脸,具体为采用传统机器学习中的级联分类器来识别图片中人脸所处的位置。即通过Harr提取图片特征,再通过使用Adaboost算法训练强分类器,区分出人脸和非人脸。In order to accurately recognize the face in the image, in the preferred embodiment of the present application, since the features of the face are more obvious, the accuracy of recognizing the nose in the area of the face is higher, so in the present invention, it is necessary to first identify Face, specifically, using the cascade classifier in traditional machine learning to identify the position of the face in the picture. That is, the image features are extracted by Harr, and then a strong classifier is trained by using the Adaboost algorithm to distinguish between human faces and non-human faces.
S502,获取人脸中鼻子的位置。S502, obtain the position of the nose in the human face.
为了准确的在人脸中定位鼻子的位置,在本申请的优选实施例中,如图6所示,采用同S201中相同的算法来获得鼻子的区域。图6中的红框为识别出来的鼻子区域。由于采用传统的机器学习算法,为了提高准确性,需要人工预设一些限定的规则,例如只采用机器学习会识别多个鼻子,所以本申请中增加先验知识来确定哪一个才是真正的鼻子,并且必须符合五官之间的位置关联关系,比例关系等。In order to accurately locate the position of the nose in the face, in a preferred embodiment of the present application, as shown in FIG. 6 , the same algorithm as in S201 is used to obtain the area of the nose. The red box in Figure 6 is the identified nose area. Due to the use of traditional machine learning algorithms, in order to improve accuracy, it is necessary to manually preset some limited rules. For example, only using machine learning will recognize multiple noses. Therefore, in this application, prior knowledge is added to determine which one is the real nose. , and must conform to the positional relationship, proportional relationship, etc. between the facial features.
需要说明的是,以上优选实施例的方案仅为本申请所提出的一种具体实现方案,其他预设的限定的规则不同均属于本申请的保护范围。It should be noted that, the solution of the above preferred embodiment is only a specific implementation solution proposed by the present application, and other predetermined and limited rules are different within the protection scope of the present application.
S503,检测阴影区域并利用伽马校正。S503, the shadow area is detected and corrected by gamma.
为了更准确的校正阴影区域,在本申请的优选实施例中,如图7(A)先使用阈值从灰度图像中获取二值图像,或者用于去除噪声,即滤除过小或过大值的像素,然后使用大津法算法来获取最优的阈值,最后提取出来的阴影区域如图7(B)所示。In order to more accurately correct the shadow area, in a preferred embodiment of the present application, as shown in Figure 7(A), a threshold is first used to obtain a binary image from a grayscale image, or it is used to remove noise, that is, to filter out too small or too large Then use the Otsu method algorithm to obtain the optimal threshold value, and finally the extracted shadow area is shown in Figure 7(B).
需要说明的是,以上优选实施例的方案仅为本申请所提出的一种具体实现方案,其他获取阈值的方式的不同均属于本申请的保护范围。It should be noted that, the solution of the above preferred embodiment is only a specific implementation solution proposed by the present application, and other different ways of obtaining the threshold value all belong to the protection scope of the present application.
在本步骤中,RGB值与功率并非简单的线性关系,而是幂函数关系,所以采用伽马校正来调节阴影区域的亮度。伽马校正用来针对影片或是影像系统里对于光线的辉度或是三色刺激值所进行非线性的运算或反运算。通过公式(1)来改变阴影区域的RGB像素值。In this step, the RGB value and the power are not in a simple linear relationship, but in a power function relationship, so gamma correction is used to adjust the brightness of the shadow area. Gamma correction is used to perform nonlinear operations or inverse operations on the luminance or tristimulus values of light in a film or imaging system. The RGB pixel value of the shadow area is changed by formula (1).
Vout=A×Vinγ (1)Vout=A×Vin γ (1)
经过第一次迭代计算的效果,即同一方法处理多次,如图7(C)所示,在保留皮肤色彩的基础上,阴影区域变小了。而再经过一次迭代计算阴影区域变的更小,如图7(D)。直到阴影区域小到一定阴影像素的数量结束迭代。After the first iterative calculation, that is, the same method is processed multiple times, as shown in Figure 7(C), on the basis of retaining the skin color, the shadow area becomes smaller. After another iteration, the shadow area becomes smaller, as shown in Figure 7(D). End the iteration until the shadow area is small enough to a certain number of shadow pixels.
S504,生成人脸去阴影照片。S504, generate a face shadow removal photo.
为了生成去阴影的人脸照片,在本申请的优选实施例中,获得去除阴影的区域并通过像素替换原来鼻孔阴影的区域,鼻子的区域通过像素替换原来鼻子的区域,人脸的区域通过像素替换原来人脸的区域,最后获得一张去除鼻孔阴影的人脸照片,如图8左图所示。而图8右图是通过去阴影后照片生成的3D人脸模型在3D场景下的效果,在鼻孔周围已经没有了阴影导致的不良情况。In order to generate a shadow-removed face photo, in a preferred embodiment of the present application, the shadow-removed area is obtained and the original nostril shadowed area is replaced by pixels, the nose area is replaced by pixels, the original nose area is replaced by pixels, and the face area is replaced by pixels Replace the original face area, and finally obtain a face photo with the nostril shadow removed, as shown in the left image of Figure 8. The right picture in Figure 8 is the effect of the 3D face model generated by the photo after de-shading in the 3D scene, and there is no bad situation caused by shadows around the nostrils.
需要说明的是,以上优选实施例的方案仅为本申请所提出的一种具体实现方案,其他替换原有图像的方式均属于本申请的保护范围。It should be noted that, the solution of the above preferred embodiment is only a specific implementation solution proposed by the present application, and other ways of replacing the original image belong to the protection scope of the present application.
通过应用以上技术方案,在图片中识别人脸,获取人脸中鼻子的位置,检测阴影区域并利用伽马校正,生成去人脸阴影照片,减小了在去除人脸图像的局部阴影时的处理痕迹,提高了3D人脸模型的质量By applying the above technical solutions, the face is recognized in the picture, the position of the nose in the face is obtained, the shadow area is detected and the gamma correction is used to generate a face shadow-removed photo, which reduces the problem of removing the partial shadow of the face image. Processed traces to improve the quality of 3D face models
与本申请实施例提出的人脸图像的处理方法相对应,本申请实施例还提出了一种人脸图像的处理设备,如图9所示,所述设备包括:Corresponding to the method for processing a face image proposed by the embodiment of the present application, the embodiment of the present application also proposes a device for processing a face image. As shown in FIG. 9 , the device includes:
第一获取模块901,基于预设人脸照片获取包含阴影区域的待处理区域,所述预设人脸照片包括待处理人脸图像,所述待处理人脸图像包括所述待处理区域;The first obtaining
提取模块902,根据预设像素阈值从所述待处理区域中提取所述阴影区域;The
第二获取模块903,基于预设伽马系数对所述阴影区域进行伽马校正,并基于所述伽马校正的结果获取结果区域;The second obtaining
生成模块904,根据所述结果区域生成去除局部阴影的人脸照片。The
在本申请具体的应用场景中,所述第一获取模块901,具体用于:In the specific application scenario of the present application, the
基于第一预设级联分类器从所述预设人脸照片中提取所述待处理人脸图像;extracting the to-be-processed face image from the preset face photo based on the first preset cascade classifier;
基于第二预设级联分类器从所述待处理人脸图像中提取所述待处理区域。The to-be-processed region is extracted from the to-be-processed face image based on a second preset cascaded classifier.
在本申请具体的应用场景中,所述第一获取模块901,还具体用于:In the specific application scenario of the present application, the
基于所述第二预设级联分类器从所述待处理人脸图像中获取与所述待处理区域对应的多个识别结果;Obtaining a plurality of recognition results corresponding to the to-be-processed area from the to-be-processed face image based on the second preset cascade classifier;
根据预设校验规则从多个所述识别结果中提取所述待处理区域,所述预设校验规则是根据五官的预设位置关系和或五官的预设比例关系确定的。在本申请具体的应用场景中,所述提取模块902,具体用于:The to-be-processed area is extracted from a plurality of the identification results according to a preset verification rule, and the preset verification rule is determined according to a preset positional relationship of the facial features or a preset proportional relationship of the facial features. In the specific application scenario of the present application, the
根据所述预设像素阈值从所述待处理区域的灰度图中分割出二值图像,所述预设像素阈值是根据大津法确定的;A binary image is segmented from the grayscale image of the region to be processed according to the preset pixel threshold, which is determined according to the Otsu method;
根据所述二值图像提取所述阴影区域。The shaded area is extracted from the binary image.
在本申请具体的应用场景中,所述第二获取模块903,具体用于:In the specific application scenario of the present application, the
基于所述预设伽马系数迭代调整所述阴影区域的阴影像素数量,直至所述阴影像素数量小于预设数量时确定所述伽马校正的结果。Iteratively adjusts the number of shaded pixels in the shaded area based on the preset gamma coefficient, until the number of shaded pixels is less than the preset number to determine a result of the gamma correction.
在本申请具体的应用场景中,所述生成模块904,具体用于:In the specific application scenario of the present application, the
基于将所述结果区域替换所述阴影区域生成已处理区域;generating a processed region based on replacing the shadow region with the result region;
基于将所述已处理区域替换所述待处理区域生成已处理人脸图像;generating a processed face image based on replacing the processed region with the to-be-processed region;
基于将所述已处理人脸图像替换所述待处理人脸图像生成所述去除局部阴影的人脸照片。The partial shadow-removed face photo is generated based on replacing the processed face image with the to-be-processed face image.
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不驱使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims (9)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010621308.3A CN111951176A (en) | 2020-06-30 | 2020-06-30 | A method and device for removing partial shadows from face images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010621308.3A CN111951176A (en) | 2020-06-30 | 2020-06-30 | A method and device for removing partial shadows from face images |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111951176A true CN111951176A (en) | 2020-11-17 |
Family
ID=73337370
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010621308.3A Pending CN111951176A (en) | 2020-06-30 | 2020-06-30 | A method and device for removing partial shadows from face images |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111951176A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115358960A (en) * | 2022-08-31 | 2022-11-18 | 北京字跳网络技术有限公司 | Image processing method, apparatus, device and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160037481A (en) * | 2014-09-29 | 2016-04-06 | 에스케이텔레콤 주식회사 | Shadow removal method for image recognition and apparatus using the same |
| CN106056079A (en) * | 2016-05-31 | 2016-10-26 | 中国科学院自动化研究所 | Image acquisition device and facial feature occlusion detection method |
| CN106815587A (en) * | 2015-11-30 | 2017-06-09 | 浙江宇视科技有限公司 | Image processing method and device |
| CN107392866A (en) * | 2017-07-07 | 2017-11-24 | 武汉科技大学 | A kind of facial image local grain Enhancement Method of illumination robust |
| CN108846807A (en) * | 2018-05-23 | 2018-11-20 | Oppo广东移动通信有限公司 | Light efficiency processing method, device, terminal and computer readable storage medium |
| CN109639958A (en) * | 2017-10-05 | 2019-04-16 | 卡西欧计算机株式会社 | Image processing apparatus, image processing method and recording medium |
-
2020
- 2020-06-30 CN CN202010621308.3A patent/CN111951176A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160037481A (en) * | 2014-09-29 | 2016-04-06 | 에스케이텔레콤 주식회사 | Shadow removal method for image recognition and apparatus using the same |
| CN106815587A (en) * | 2015-11-30 | 2017-06-09 | 浙江宇视科技有限公司 | Image processing method and device |
| CN106056079A (en) * | 2016-05-31 | 2016-10-26 | 中国科学院自动化研究所 | Image acquisition device and facial feature occlusion detection method |
| CN107392866A (en) * | 2017-07-07 | 2017-11-24 | 武汉科技大学 | A kind of facial image local grain Enhancement Method of illumination robust |
| CN109639958A (en) * | 2017-10-05 | 2019-04-16 | 卡西欧计算机株式会社 | Image processing apparatus, image processing method and recording medium |
| CN108846807A (en) * | 2018-05-23 | 2018-11-20 | Oppo广东移动通信有限公司 | Light efficiency processing method, device, terminal and computer readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 吴镇扬等译: "《数字信号与图像处理》", 高等教育出版社, pages: 550 - 557 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115358960A (en) * | 2022-08-31 | 2022-11-18 | 北京字跳网络技术有限公司 | Image processing method, apparatus, device and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9928601B2 (en) | Automatic segmentation of hair in images | |
| CN104794693B (en) | A kind of portrait optimization method of face key area automatic detection masking-out | |
| CN110268442B (en) | Computer-implemented method of detecting a foreign object on a background object in an image, device for detecting a foreign object on a background object in an image, and computer program product | |
| CN110268420B (en) | Computer-implemented method of detecting a foreign object on a background object in an image, device for detecting a foreign object on a background object in an image, and computer program product | |
| CN110390677B (en) | A method and system for defect localization based on sliding self-matching | |
| CN107368806B (en) | Image rectification method, image rectification device, computer-readable storage medium and computer equipment | |
| CN106447638A (en) | Beauty treatment method and device thereof | |
| CN108764328A (en) | The recognition methods of Terahertz image dangerous material, device, equipment and readable storage medium storing program for executing | |
| CN111091109A (en) | Method, system and device for age and gender prediction based on face images | |
| CN114898434B (en) | Training method, device, equipment and storage medium for mask recognition model | |
| WO2021139167A1 (en) | Method and apparatus for facial recognition, electronic device, and computer readable storage medium | |
| CN105809089A (en) | Multi-face detection method and device under complex background | |
| CN107292307A (en) | One kind is inverted Chinese character identifying code automatic identifying method and system | |
| CN110458012B (en) | Multi-angle face recognition method and device, storage medium and terminal | |
| CN112270683B (en) | IHC digital preview image identification and organization foreground segmentation method and system | |
| CN117197064B (en) | A contactless automatic analysis method for red eye degree | |
| CN118038515A (en) | A face recognition method | |
| CN109993090A (en) | The iris center positioning method of forest and image grayscale feature is returned based on cascade | |
| CN110321778B (en) | Face image processing method and device and storage medium | |
| CN108764230A (en) | A kind of bank's card number automatic identifying method based on convolutional neural networks | |
| CN111951176A (en) | A method and device for removing partial shadows from face images | |
| CN101447026B (en) | Pinkeye detecting device and detection method | |
| Liang et al. | Applying Image Processing Technology to Face Recognition. | |
| CN110472490A (en) | Based on the action identification method and device, storage medium and terminal for improving VGGNet | |
| CN114973384A (en) | Electronic face photo collection method based on key point and visual salient target detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201117 |
|
| RJ01 | Rejection of invention patent application after publication |