CN110473156B - Image information processing method, device, storage medium and electronic device - Google Patents
Image information processing method, device, storage medium and electronic device Download PDFInfo
- Publication number
- CN110473156B CN110473156B CN201910741627.5A CN201910741627A CN110473156B CN 110473156 B CN110473156 B CN 110473156B CN 201910741627 A CN201910741627 A CN 201910741627A CN 110473156 B CN110473156 B CN 110473156B
- Authority
- CN
- China
- Prior art keywords
- object area
- tone
- contrast
- difference
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
- G06V10/464—Salient features, e.g. scale invariant feature transforms [SIFT] using a plurality of salient features, e.g. bag-of-words [BoW] representations
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20208—High dynamic range [HDR] image processing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域technical field
本申请涉及图像处理技术领域,尤其涉及一种图像信息的处理方法、装置、存储介质及电子设备。The present application relates to the technical field of image processing, and in particular, to a method, apparatus, storage medium and electronic device for processing image information.
背景技术Background technique
随着电子技术的不断发展,电子设备如手机的摄像头像素和图像处理功能越来越强大,人们对于图像的处理效果的要求也越来越高,尤其是对于高动态范围(High DynamicRange Imaging,HDR)图像的处理效果的关注。With the continuous development of electronic technology, the camera pixels and image processing functions of electronic devices such as mobile phones are becoming more and more powerful, and people's requirements for image processing effects are getting higher and higher, especially for high dynamic range (High Dynamic Range Imaging, HDR). ) of the image processing effect.
目前,一般通过色调映射(Tone Mapping)方式对于高动态范围图像进行处理,使得图像的整体视觉效果更好,但是,对高动态范围图像进行统一映射处理,会导致处理后的图像中不同区域的处理效果不一致,影响处理效率。At present, the high dynamic range image is generally processed by tone mapping, which makes the overall visual effect of the image better. The processing effect is inconsistent, which affects the processing efficiency.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供一种图像信息的处理方法、装置、存储介质及电子设备,可以提升图像信息的处理效率。Embodiments of the present application provide an image information processing method, apparatus, storage medium, and electronic device, which can improve the processing efficiency of image information.
第一方面,本申请实施例了提供了一种图像信息的处理方法,包括:In a first aspect, an embodiment of the present application provides a method for processing image information, including:
获取待处理图像,并对所述待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;acquiring an image to be processed, and performing object recognition on the image to be processed to obtain the associated first object area and second object area;
基于所述第一对象区域和第二对象区域确定出相应的第一色调调整信息;determining corresponding first tone adjustment information based on the first object area and the second object area;
对所述第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;Perform tone mapping processing on the first object area to generate the first target object area after tone mapping processing;
计算所述第一目标对象区域与第一对象区域的第二色调调整信息,并根据所述第一色调调整信息和第二色调调整信息确定所述第二对象区域的色调映射处理策略。Calculate the second tone adjustment information of the first target object area and the first object area, and determine a tone mapping processing strategy for the second object area according to the first tone adjustment information and the second tone adjustment information.
第二方面,本申请实施例了提供了的一种图像信息的处理装置,包括:In a second aspect, an embodiment of the present application provides an apparatus for processing image information, including:
识别单元,用于获取待处理图像,并对所述待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;an identification unit for acquiring an image to be processed, and performing object recognition on the image to be processed to obtain the associated first object area and second object area;
确定单元,用于基于所述第一对象区域和第二对象区域确定出相应的第一色调调整信息;a determining unit, configured to determine corresponding first tone adjustment information based on the first object area and the second object area;
处理单元,用于对所述第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;a processing unit, configured to perform tone mapping processing on the first object area, and generate the first target object area after tone mapping processing;
计算单元,用于计算所述第一目标对象区域与第一对象区域的第二色调调整信息,并根据所述第一色调调整信息和第二色调调整信息确定所述第二对象区域的色调映射处理策略。a calculation unit, configured to calculate the second tone adjustment information of the first target object area and the first object area, and determine the tone mapping of the second object area according to the first tone adjustment information and the second tone adjustment information processing strategy.
第三方面,本申请实施例提供的存储介质,其上存储有计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行如本申请任一实施例提供的图像信息的处理方法。In a third aspect, a storage medium provided by an embodiment of the present application stores a computer program thereon, and when the computer program runs on a computer, the computer is made to execute the image information processing method provided by any embodiment of the present application. .
第四方面,本申请实施例提供的电子设备,包括处理器和存储器,所述存储器有计算机程序,所述处理器通过调用所述计算机程序,用于执行如本申请任一实施例提供的图像信息的处理方法。In a fourth aspect, an electronic device provided by an embodiment of the present application includes a processor and a memory, the memory has a computer program, and the processor is configured to execute the image provided by any embodiment of the present application by invoking the computer program. Information processing method.
本申请实施例获取待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;基于第一对象区域和第二对象区域确定出相应的第一色调调整信息;对第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;计算第一目标对象区域与第一对象区域的第二色调调整信息,并根据第一色调调整信息和第二色调调整信息确定第二对象区域的色调映射处理策略。以此根据关联的第一对象区域和第二对象区域在色调映射处理前的第一色调调整信息以及第一对象区域在色调映射前后的第二色调调整信息结合确定适合第二对象区域的色调映射处理策略,使得关联区域处理效果真实,极大的提升了图像信息的处理效率。The embodiment of the present application acquires the image to be processed for object recognition, and obtains the associated first object area and the second object area; determines the corresponding first color tone adjustment information based on the first object area and the second object area; Perform tone mapping processing to generate the first target object area after tone mapping processing; calculate the second tone adjustment information of the first target object area and the first object area, and determine the first tone adjustment information according to the first tone adjustment information and the second tone adjustment information. Tone-mapping processing strategy for two-object regions. In this way, a tone mapping suitable for the second object area is determined according to the combination of the first tone adjustment information of the associated first object area and the second object area before tone mapping processing and the second tone adjustment information of the first object area before and after tone mapping. The processing strategy makes the processing effect of the associated area real, and greatly improves the processing efficiency of image information.
附图说明Description of drawings
下面结合附图,通过对本申请的具体实施方式详细描述,将使本申请的技术方案及其它有益效果显而易见。The technical solutions and other beneficial effects of the present application will be apparent through the detailed description of the specific embodiments of the present application in conjunction with the accompanying drawings.
图1是本申请实施例提供的图像信息的处理方法的流程示意图。FIG. 1 is a schematic flowchart of a method for processing image information provided by an embodiment of the present application.
图2为本申请实施例提供的图像信息的处理方法的另一流程示意图。FIG. 2 is another schematic flowchart of a method for processing image information provided by an embodiment of the present application.
图3为本申请实施例提供的图像信息的处理方法的场景示意图。FIG. 3 is a schematic scene diagram of a method for processing image information provided by an embodiment of the present application.
图4为本申请实施例提供的图像信息的处理装置的模块示意图。FIG. 4 is a schematic block diagram of an apparatus for processing image information according to an embodiment of the present application.
图5为本申请实施例提供的图像信息的处理装置的另一模块示意图。FIG. 5 is a schematic diagram of another module of the image information processing apparatus provided by the embodiment of the present application.
图6为本申请实施例提供的电子设备的结构示意图。FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
图7为本申请实施例提供的电子设备的另一结构示意图。FIG. 7 is another schematic structural diagram of an electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
请参照图式,其中相同的组件符号代表相同的组件,本申请的原理是以实施在一适当的运算环境中来举例说明。以下的说明是基于所例示的本申请具体实施例,其不应被视为限制本申请未在此详述的其它具体实施例。Please refer to the drawings, wherein the same component symbols represent the same components, and the principles of the present application are exemplified by being implemented in a suitable computing environment. The following description is based on illustrated specific embodiments of the present application and should not be construed as limiting other specific embodiments of the present application not detailed herein.
本文所使用的术语「模块」可看做为在该运算系统上执行的软件对象。本文该的不同组件、模块、引擎及服务可看做为在该运算系统上的实施对象。而本文该的装置及方法优选的以软件的方式进行实施,当然也可在硬件上进行实施,均在本申请保护范围之内。As used herein, the term "module" can be thought of as a software object that executes on the computing system. The various components, modules, engines and services mentioned herein can be considered as implementation objects on the computing system. While the apparatus and method herein are preferably implemented in software, of course, they can also be implemented in hardware, which are all within the protection scope of the present application.
本申请实施例提供一种图像信息的处理方法,该图像信息的处理方法的执行主体可以是本申请实施例提供的图像信息的处理装置,或者集成了该图像信息的处理装置的电子设备,其中该图像信息的处理装置可以采用硬件或者软件的方式实现。其中,电子设备可以是智能手机、平板电脑、掌上电脑(PDA,Personal Digital Assistant)等。An embodiment of the present application provides a method for processing image information, and the execution body of the method for processing image information may be the image information processing apparatus provided in the embodiment of the present application, or an electronic device integrating the image information processing apparatus, wherein The image information processing apparatus can be implemented in hardware or software. The electronic device may be a smart phone, a tablet computer, a PDA (Personal Digital Assistant), and the like.
以下进行具体分析说明。The specific analysis is described below.
本申请实施例提供一种图像信息的处理方法,如图1所示,图1为本申请实施例提供的图像信息的处理方法的流程示意图,该图像信息的处理方法可以包括以下步骤:An embodiment of the present application provides a method for processing image information, as shown in FIG. 1 , which is a schematic flowchart of the method for processing image information provided by an embodiment of the present application, and the method for processing image information may include the following steps:
在步骤S101中,获取待处理图像,并对待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域。In step S101, an image to be processed is acquired, and object recognition is performed on the image to be processed to obtain an associated first object area and a second object area.
其中,该待处理图像的格式可以为位图(BitMaP,BMP)和联合照片专家组(JointPhotographic Expert Group,JPEG)等等,该待识别图像可以为高动态范围图像,该高动态范围图像,相比普通的图像,可以提供更多的动态范围和图像细节,但是由于高动态范围图像的灰度分布值很不均匀,部分像素点过亮,部分像素点过暗,所以需要对通过色调映射方式,对图像颜色进行映射变换,将图像的颜色值从高动态范围映射到低动态范围,使其颜色分布均匀,看上去更舒服,整体呈现效果更好,而在这一操作过程中将较亮的像素点进行压暗为最常见的操作。Wherein, the format of the image to be processed may be a bitmap (BitMaP, BMP), a joint photographic expert group (Joint Photographic Expert Group, JPEG), etc., and the image to be recognized may be a high dynamic range image, the high dynamic range image, phase Compared with ordinary images, it can provide more dynamic range and image details, but due to the uneven grayscale distribution of high dynamic range images, some pixels are too bright, and some pixels are too dark, so it is necessary to use tone mapping. , map the color of the image, map the color value of the image from high dynamic range to low dynamic range, so that the color distribution is uniform, it looks more comfortable, and the overall rendering effect is better, and in the process of this operation, it will be brighter The most common operation is to darken the pixels.
但是在图像的色调映射处理方式中,通过会对预设对象区域进行保护,如人脸对象区域的保护机制,避免人脸对象区域在色调映射处理中被压暗过多,导致人脸呈现不自然,然而仅仅对人脸对象区域进行保护会导致人脸对象区域周围的物体仍然按照原来的色调映射方式处理,如人的头发,当头发是黑色的时候,对头发进行压暗不会导致与人脸对象区域的过分不协调,但是如今随着生活的多元化,越来越多的人喜欢染发,这其中不乏把头发染成非黑色的亮色,或者欧美人天生非黑色的头发,在此情况下,如果对人脸对象区域进行保护,而对关联的头发对象区域仍然按照原来的色调映射方式进行处理,会导致进行保护处理的人脸对象区域和正常的色调映射方式处理后的头发对象区域差异过大,使得色调处理后的整个人像不自然。However, in the tone mapping processing method of the image, the preset object area is protected, such as the protection mechanism of the face object area, so as to prevent the face object area from being darkened too much during the tone mapping process, resulting in the appearance of the face not appearing. Naturally, however, only protecting the face object area will cause the objects around the face object area to still be processed in the original tone-mapping way, such as human hair. When the hair is black, darkening the hair will not cause the same The face object area is too uncoordinated, but now with the diversification of life, more and more people like to dye their hair, and many of them dye their hair into bright colors that are not black, or Europeans and Americans are born with non-black hair. Here In this case, if the face object area is protected, but the associated hair object area is still processed according to the original tone mapping method, the protected face object area and the hair object processed by the normal tone mapping method will result. The regional differences are too large, making the entire portrait after tone processing unnatural.
可选的,可以通过图像识别算法,例如卷积神经网络(Convolutional NeuralNetworks,CNN)算法对待处理图像进行图像识别,识别得到待处理图像中的不同的对象,从不同的对象中确定出相互关联的第一对象区域和第二对象区域,如人脸对象区域和头发对象区域为强相关的,或者树干对象区域和叶子对象区域为强相关的,该关联的第一对象区域和第二对象区域在色调映射处理中需要进行合理处理,避免出现图像处理不真实的情形。Optionally, an image recognition algorithm, such as a convolutional neural network (Convolutional Neural Networks, CNN) algorithm, can be used to perform image recognition on the image to be processed, identify different objects in the image to be processed, and determine the interrelated objects from different objects. The first object region and the second object region, such as the face object region and the hair object region are strongly correlated, or the trunk object region and the leaf object region are strongly correlated, and the associated first object region and the second object region are in Reasonable processing is required in tone mapping processing to avoid unrealistic image processing.
在步骤S102中,基于第一对象区域和第二对象区域确定出相应的第一色调调整信息。In step S102, corresponding first color tone adjustment information is determined based on the first object area and the second object area.
其中,可以基于该第一对象区域和第二对象区域计算出相应的第一色调调整信息,该第一色调调整信息为第一对象区域和第二对象区域在未进行色调映射处理之前的表现度差异范围,如第一对象区域和第二对象区域在亮度和对比度的差值,根据该差值确定出相应的差值范围,该差值范围即为第一色调调整信息,该第一色调调整信息即体现原始图像中第一对象区域和第二对象区域的图像表现度差异,后续即使进行色调映射处理,也需要保留该图像表现度差异,以保留图像的真实度值。Wherein, corresponding first tone adjustment information may be calculated based on the first object area and the second object area, where the first tone adjustment information is the expressiveness of the first object area and the second object area before tone mapping processing is performed The difference range, such as the difference in brightness and contrast between the first object area and the second object area, the corresponding difference range is determined according to the difference, and the difference range is the first tone adjustment information. The first tone adjustment The information reflects the difference in image representation between the first object area and the second object area in the original image. Even if tone mapping is performed subsequently, the difference in image representation needs to be preserved to preserve the authenticity value of the image.
在步骤S103中,对第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域。In step S103, tone mapping processing is performed on the first target area to generate a first target target area after tone mapping processing.
其中,常规的色调映射方法为根据像素本身的亮度和对比度进行调整,容易导致调整后整个图像中不同区域区物体的亮度和对比度不能同时达到要求,比如在有人像的图像中,背景是较亮的天空,这个时候如果想把该图像色调映射到低动态图像,就需要把像素值高的像素点进行压缩,这样虽然可以把天空的动态范围降低,但是同时也会导致人像中像素值较高的点也会同时被压缩,使得人像不真实,局部之间的对比度会较差,此时,一般会对人脸对象区域进行保护,避免人脸对象区域在色调映射过程中被压暗过多导致人脸显示不正常。Among them, the conventional tone mapping method is to adjust according to the brightness and contrast of the pixel itself, which easily leads to the adjustment of the brightness and contrast of objects in different areas of the entire image cannot meet the requirements at the same time. For example, in an image of a person, the background is brighter At this time, if you want to tone-map the image to a low dynamic image, you need to compress the pixels with high pixel values. Although the dynamic range of the sky can be reduced, it will also lead to higher pixel values in the portrait. The points will also be compressed at the same time, making the portrait unreal, and the contrast between parts will be poor. At this time, the face object area is generally protected to prevent the face object area from being darkened too much during the tone mapping process. Causes the face to display abnormally.
可选的,将类似人脸对象区域等等需要进行色调映射保护机制的区域确定为第一对象区域,依据保护机制下的色调映射处理进行色调映射处理,生成色调映射后的第一目标对象区域。Optionally, a region similar to a face object region that needs a tone-mapping protection mechanism is determined as the first object region, and tone-mapping processing is performed according to the tone-mapping processing under the protection mechanism to generate the first target object region after tone-mapping. .
在步骤S104中,计算第一目标对象区域与第一对象区域的第二色调调整信息,并根据第一色调调整信息和第二色调调整信息确定第二对象区域的色调映射处理策略。In step S104, the first target object area and the second tone adjustment information of the first object area are calculated, and the tone mapping processing strategy of the second object area is determined according to the first tone adjustment information and the second tone adjustment information.
其中,基于依据保护机制下的色调映射处理后的第一目标对象区域和未依据保护机制下的色调映射处理的第一对象区域的表现度差异范围,如第一目标对象区域和第一对象区域在亮度和对比度的差值,根据该差值确定出相应的差值范围,该差值范围即为第二调整信息,该第二色调调整信息即体现原始图像中第一对象区域和依据保护机制下的色调映射处理后的第一目标对象区域的图像表现度差异,后续第二对象区域进行色调映射处理,需要遵循该第一对象区域的色调映射处理的处理度差异。Wherein, based on the performance difference range of the first target object area after tone mapping processing under the protection mechanism and the first object area without tone mapping processing under the protection mechanism, such as the first target object area and the first object area In the difference between brightness and contrast, a corresponding difference range is determined according to the difference, and the difference range is the second adjustment information, and the second tone adjustment information reflects the first object area in the original image and the protection mechanism according to The difference in the image representation of the first target object area after the tone mapping processing in
进一步的,结合该第一色调调整信息和第二色调调整信息确定出第二对象区域相应的色调映射处理策略,使得该第二对象区域基于该色调映射处理策略进行色调映射处理后,得到的色调映射处理后的第二目标对象区域的表现度既符合原待处理图像中第一对象区域和第二对象区域的表现度差异,也符合第一对象区域的色调映射处理的处理幅度,使得色调映射处理后的第一目标对象区域和第二目标对象区域的表现度符合真实场景的要求。Further, the corresponding tone mapping processing strategy of the second object area is determined in combination with the first tone adjustment information and the second tone adjustment information, so that after the second object area is subjected to tone mapping processing based on the tone mapping processing strategy, the obtained tone The expressiveness of the second target object area after the mapping processing conforms to the difference in expressiveness between the first object area and the second object area in the original to-be-processed image, and also conforms to the processing range of the tone mapping processing of the first object area, so that tone mapping is performed. The expressiveness of the processed first target object region and the second target object region meets the requirements of the real scene.
由上述可知,本实施例提供的一种图像信息的处理方法,通过获取待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;基于第一对象区域和第二对象区域确定出相应的第一色调调整信息;对第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;计算第一目标对象区域与第一对象区域的第二色调调整信息,并根据第一色调调整信息和第二色调调整信息确定第二对象区域的色调映射处理策略。以此根据关联的第一对象区域和第二对象区域在色调映射处理前的第一色调调整信息以及第一对象区域在色调映射前后的第二色调调整信息结合确定适合第二对象区域的色调映射处理策略,使得关联区域处理效果真实,极大的提升了图像信息的处理效率。It can be seen from the above that, in a method for processing image information provided by this embodiment, object recognition is performed by acquiring an image to be processed, and the associated first object area and second object area are obtained; based on the first object area and the second object area, determine obtain the corresponding first tone adjustment information; perform tone mapping processing on the first object area to generate the first target object area after tone mapping processing; calculate the second tone adjustment information of the first target object area and the first object area, and A tone mapping processing strategy for the second object area is determined according to the first tone adjustment information and the second tone adjustment information. In this way, a tone mapping suitable for the second object area is determined according to the combination of the first tone adjustment information of the associated first object area and the second object area before tone mapping processing and the second tone adjustment information of the first object area before and after tone mapping. The processing strategy makes the processing effect of the associated area real, and greatly improves the processing efficiency of image information.
根据上述实施例所描述的方法,以下将举例作进一步详细说明。According to the methods described in the above embodiments, the following examples will be used for further detailed description.
请参阅图2,图2为本申请实施例提供的图像信息的处理方法的另一流程示意图。Please refer to FIG. 2 , which is another schematic flowchart of a method for processing image information provided by an embodiment of the present application.
具体而言,该方法包括:Specifically, the method includes:
在步骤S201中,获取待处理图像,提取待处理图像中的关键特征点信息。In step S201, an image to be processed is acquired, and key feature point information in the image to be processed is extracted.
需要说明的是,为了更好的说明本申请,以下将电子设备以手机进行举例说明。It should be noted that, in order to better illustrate the present application, the electronic device is exemplified by a mobile phone in the following.
其中,手机获取高动态范围图像,如图3所示,处理图像1即为高动态范围图像,该处理图像1中可以包括天空和人物,由于光线折射问题,拍摄的处理图像1中的天空的亮度和对比度势必高于人物的亮度和对比度。Among them, the mobile phone obtains a high dynamic range image. As shown in Figure 3, the processed image 1 is the high dynamic range image. The processed image 1 may include the sky and people. Due to the problem of light refraction, the sky in the processed image 1 is captured Brightness and contrast are bound to be higher than the brightness and contrast of characters.
可选的,可以通过卷积神经网络按照从上至下的顺序对待处理图像的像素进行逐一特征识别,提取出待处理图像中的关键特征点信息。Optionally, the convolutional neural network can perform feature recognition on the pixels of the image to be processed one by one in a top-to-bottom order, and extract key feature point information in the image to be processed.
在步骤S202中,根据关键特征点信息确定关联的人脸对象区域和头发对象区域。In step S202, the associated face object region and hair object region are determined according to the key feature point information.
其中,可以根据关键特征点信息确定出人脸对象区域,由于人脸对象区域中包含的特征十分丰富和特别,如眼睛、嘴巴、眉毛、鼻子和头发等关键特征点,根据该关键特征点确定出人脸对象区域和相关联的头发对象区域。Among them, the face object area can be determined according to the key feature point information. Since the features contained in the face object area are very rich and special, such as key feature points such as eyes, mouth, eyebrows, nose and hair, the key feature points are determined according to the key feature points. Out face object regions and associated hair object regions.
由于目前的常规色调映射方法为对于整个待处理图像中不同对象区域的亮度和对比度同时进行处理,如图3所示,常规的色调映射方法为对头发对象区域A、人脸对象区域B和天空对象区域C一起进行色调映射处理,而背景为较亮的天空,这时候如果想将处理图像1色调映射到低动态图像,就需要把像素值高的像素点进行压缩,这样虽然可以把天空的动态范围降低,但同时也会导致人像中的像素值如同天空处理程度一样被过度压缩,使得人像不真实,局部之间的对比度比较差,所以往往需要对图像进行人脸保护,对于人脸对象区域进行单独的色调映射处理,其他对象区域如头发对象区域仍然按照如同天空处理程度进行处理,以此,在人脸对象区域和头发对象区域强相关的情况下,会导致色调映射处理之后人脸对象区域和头发对象区域的亮度和对比度之间相差较大,使得人像呈现不真实。Since the current conventional tone mapping method is to simultaneously process the brightness and contrast of different object regions in the entire image to be processed, as shown in Figure 3, the conventional tone mapping method is to process the hair object region A, the face object region B and the sky. The object area C is subjected to tone-mapping processing together, and the background is a brighter sky. At this time, if you want to tone-map the processed image 1 to a low-dynamic image, you need to compress the pixels with high pixel values. The dynamic range is reduced, but at the same time, the pixel values in the portrait will be over-compressed like the sky processing degree, making the portrait unreal and the contrast between parts is relatively poor, so it is often necessary to protect the face of the image. The area is subjected to separate tone mapping processing, and other object areas such as the hair object area are still processed according to the same degree as the sky. Therefore, in the case of strong correlation between the face object area and the hair object area, it will cause the face after tone mapping processing. There is a large difference between the brightness and contrast of the object area and the hair object area, making the portrait appear unreal.
在步骤S203中,获取人脸对象区域的第一亮度值和第一对比度值,获取头发对象区域的第二亮度值和第二对比度值。In step S203, a first brightness value and a first contrast value of the face object region are obtained, and a second brightness value and a second contrast value of the hair object region are obtained.
其中,获取人脸对象区域在未进行色调映射处理之前的第一亮度值和第一对比度值,获取头发对象区域在未进行色调映射处理之前的第二亮度值和第二对比度值,该第一亮度值和第一对比度值以及第二亮度值和第二对比度值代表原始图像中人脸对象区域和头发对象区域的表现度差异范围,为较为真实的人像表现形式。Among them, the first brightness value and the first contrast value of the face object area before tone mapping processing are obtained, and the second brightness value and the second contrast value of the hair object area before tone mapping processing are obtained. The brightness value, the first contrast value, and the second brightness value and the second contrast value represent the expressiveness difference range between the face object region and the hair object region in the original image, which are more realistic representations of portraits.
在步骤S204中,计算第一亮度值和第二亮度值的第一亮度差以及第一对比度值和第二对比度值的第一对比度差,将第一亮度差和第一对比度差确定为第一色调调整信息。In step S204, a first brightness difference between the first brightness value and the second brightness value and a first contrast difference between the first contrast value and the second contrast value are calculated, and the first brightness difference and the first contrast difference are determined as the first Hue adjustment information.
其中,计算第一亮度值和第二亮度值的第一亮度差以及第一对比度值和第二对比度的第一对比度差,该第一亮度差和第一对比度差为正数,如第一亮度差和第一对比度差为负数,那么需要相应进行绝对值处理。The first brightness difference between the first brightness value and the second brightness value and the first contrast difference between the first contrast value and the second contrast are calculated, and the first brightness difference and the first contrast difference are positive numbers, such as the first brightness If the difference and the first contrast difference are negative numbers, absolute value processing needs to be performed accordingly.
可选的,可以将根据第一亮度差确定出第一亮度差范围和根据第一对比度差确定出第一对比度差范围,该范围的大小为根据实际的情况进行上下波动,如上下变化幅度为5等等,基于该第一亮度差范围和第一对比度差范围确定出相应的第一色调调整信息,该第一色调调整信息即体现了原始图像中人脸对象区域和头发对象区域的图像表示度差异范围。Optionally, the first brightness difference range may be determined according to the first brightness difference and the first contrast difference range may be determined according to the first contrast difference, and the size of the range fluctuates up and down according to the actual situation. 5 and so on, the corresponding first tone adjustment information is determined based on the first brightness difference range and the first contrast difference range, and the first tone adjustment information reflects the image representation of the face object area and the hair object area in the original image degree difference range.
在步骤S205中,对人脸对象区域进行色调映射处理,生成色调映射处理后的第一目标人脸对象区域。In step S205, tone mapping processing is performed on the face object region to generate a first target face object region after tone mapping processing.
其中,如图3所示,对人脸对象区域B进行带有人脸保护机制的色调映射处理,生成色调映射处理后的第一目标人脸对象区域。Wherein, as shown in FIG. 3 , a tone mapping process with a face protection mechanism is performed on the face object region B, and a first target face object region after tone mapping processing is generated.
在步骤S206中,获取第一目标人脸对象区域的第三亮度值和第三对比度值。In step S206, a third brightness value and a third contrast value of the first target face object region are obtained.
其中,获取在进行带有人脸保护机制的色调映射处理后的第一目标人脸对象区域的第三亮度值和第三对比度值。Wherein, the third brightness value and the third contrast value of the first target face object region after the tone mapping process with the face protection mechanism is performed are acquired.
在步骤S207中,计算第三亮度值和第一亮度值的第二亮度差以及第三对比度值和第一对比度值的第二对比度差,将第二亮度差和第二对比度差确定为第二色调调整信息。In step S207, the second brightness difference between the third brightness value and the first brightness value and the second contrast difference between the third contrast value and the first contrast value are calculated, and the second brightness difference and the second contrast difference are determined as the second brightness difference Hue adjustment information.
其中,无论对高动态图像如何进行色调映射处理,最后的呈现效果都应该要符合原动态图像的呈现规律,因此,计算带有人脸保护机制的色调映射处理后的目标人脸对象区域的第三亮度值和原始图像的人脸对象区域的第一亮度值的第二亮度差以及带有人脸保护机制的色调映射处理后的目标人脸对象区域的第三对比度值和原始图像的人脸对象区域的第一对比度值的第二对比度差,该第二亮度差和第二对比度差为正数,如第二亮度差和第二对比度差为负数,那么需要相应进行绝对值处理。Among them, no matter how the tone-mapping process is performed on the high-dynamic image, the final rendering effect should conform to the rendering law of the original dynamic image. Therefore, the third step of calculating the target face object area after tone-mapping processing with the face protection mechanism is calculated. The second luminance difference between the luminance value and the first luminance value of the face object region of the original image and the third contrast value of the target face object region after tone-mapping processing with the face protection mechanism and the face object region of the original image The second contrast difference of the first contrast value, the second brightness difference and the second contrast difference are positive numbers, if the second brightness difference and the second contrast difference are negative numbers, then the absolute value processing needs to be performed accordingly.
可选的,可以将根据第二亮度差确定出第二亮度差范围和根据第二对比度差确定出第二对比度差范围,该范围的大小为根据实际的情况进行上下波动,如上下变化幅度为5等等,基于该第二亮度差范围和第二对比度差范围确定出相应的第二色调调整信息,该第二色调调整信息,该第二色调调整信息即体现原始图像中人脸对象区域和依据人脸保护机制的色调映射处理后的目标人脸对象区域的图像表现度差以范围。Optionally, the second brightness difference range may be determined according to the second brightness difference and the second contrast difference range may be determined according to the second contrast difference. The size of the range fluctuates up and down according to the actual situation. 5 and so on, based on the second brightness difference range and the second contrast difference range to determine the corresponding second tone adjustment information, the second tone adjustment information, the second tone adjustment information that reflects the face object area and The image representation degree of the target face object region after the tone mapping processing according to the face protection mechanism is in the range.
在步骤S208中,根据第一亮度差和第一对比度差确定出区域色调对比范围,根据第二亮度差和第二对比度差确定出人脸色调调节范围,结合区域色调对比范围和人脸色调调节范围确定头发对象区域相应的色调映射处理策略。In step S208, the regional tone contrast range is determined according to the first brightness difference and the first contrast difference, the face tone adjustment range is determined according to the second brightness difference and the second contrast difference, and the regional tone contrast range and the face tone adjustment are combined. The range determines the corresponding tone-mapping processing strategy for the hair object area.
其中,根据第一亮度差相应的第一亮度差范围和第一对比度相应的第一对比度差范围确定出原始待处理图像中的人脸对象区域和头发对象区域之间的区域色调对比范围,该区域色调对比范围为原始待处理图像的人脸对象区域和头发对象区域的对比范围,后续的色调映射处理之后的目标人脸对象区域和目标头发对象区域需要满足该对比范围,使得人脸和头发保持原始的呈现方式,保持真实性。Wherein, according to the first brightness difference range corresponding to the first brightness difference and the first contrast difference range corresponding to the first contrast, the regional tone contrast range between the face object region and the hair object region in the original to-be-processed image is determined. The regional tone contrast range is the contrast range between the face object area and the hair object area of the original image to be processed. The target face object area and the target hair object area after subsequent tone mapping processing need to meet this contrast range, so that the face and hair Keep the original presentation, keep it authentic.
进一步的,根据第二亮度差相应的第二亮度差范围和第二对比度相应的第二对比度差范围确定出带有人脸保护机制的色调映射处理后的目标人脸对象区域和原始待处理图像中的人脸对象区域之间的人脸色调调节范围,该人脸调节范围为在进行人脸保护机制的色调映射处理后的目标人脸对象区域和原始待处理图像的人脸对象的调节范围,后续的原始待处理图像中的头发对象区域和色调映射处理之后的目标头发头对象区域需要满足该调节范围,使得头发对象区域的色调映射处理效果与带有人脸保护机制的色调映射处理的处理效果接近。Further, according to the second brightness difference range corresponding to the second brightness difference and the second contrast difference range corresponding to the second contrast, determine the target face object area after tone mapping processing with the face protection mechanism and the original image to be processed. The face tone adjustment range between the face object regions, the face adjustment range is the adjustment range of the target face object region and the face object of the original to-be-processed image after the tone mapping process of the face protection mechanism is performed, The hair object region in the subsequent original to-be-processed image and the target hair head object region after tone-mapping processing need to satisfy this adjustment range, so that the tone-mapping processing effect of the hair object region is the same as the processing effect of tone-mapping processing with a face protection mechanism near.
因此,结合该区域色调对比范围和人脸色调调节范围确定出头发对象区域的色调映射处理策略,使得该头发对象区域根据该色调映射处理策略进行色调映射处理后,得到的目标头发对象区域符合待处理图像中人脸对象区域和头发对象区域的原始呈现差异度以及人脸保护机制的色调映射处理后的调节处理效果,使得色调映射后的目标人脸对象区域和目标头发对象区域的表现度符合真实性,避免了在人脸对象区域在进行人脸保护的色调映射处理下,和之关联的头发对象区域在色调映射处理下呈现效果差距较大,使得人像呈现不真实的情况。Therefore, the tone mapping processing strategy of the hair object area is determined in combination with the tone contrast range of the area and the face tone adjustment range, so that after the hair object area is subjected to tone mapping processing according to the tone mapping processing strategy, the obtained target hair object area meets the requirements to be The difference between the original appearance of the face object area and the hair object area in the image and the adjustment processing effect after the tone mapping processing of the face protection mechanism are processed, so that the expression degree of the target face object area and the target hair object area after tone mapping are consistent with each other. Authenticity, which avoids the large difference in the rendering effect of the associated hair object area under the tone mapping processing of face protection under the face object area, which makes the portrait appear unreal.
由上述可知,本实施例提供的一种图像信息的处理方法,通过获取待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;基于第一对象区域和第二对象区域确定出相应的第一色调调整信息;对第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;计算第一目标对象区域与第一对象区域的第二色调调整信息,并根据第一色调调整信息和第二色调调整信息确定第二对象区域的色调映射处理策略。以此根据关联的第一对象区域和第二对象区域在色调映射处理前的第一色调调整信息以及第一对象区域在色调映射前后的第二色调调整信息结合确定适合第二对象区域的色调映射处理策略,使得关联区域处理效果真实,极大的提升了图像信息的处理效率。It can be seen from the above that, in a method for processing image information provided by this embodiment, object recognition is performed by acquiring an image to be processed, and the associated first object area and second object area are obtained; based on the first object area and the second object area, determine obtain the corresponding first tone adjustment information; perform tone mapping processing on the first object area to generate the first target object area after tone mapping processing; calculate the second tone adjustment information of the first target object area and the first object area, and A tone mapping processing strategy for the second object area is determined according to the first tone adjustment information and the second tone adjustment information. In this way, a tone mapping suitable for the second object area is determined according to the combination of the first tone adjustment information of the associated first object area and the second object area before tone mapping processing and the second tone adjustment information of the first object area before and after tone mapping. The processing strategy makes the processing effect of the associated area real, and greatly improves the processing efficiency of image information.
为便于更好的实施本申请实施例提供的图像信息的处理方法,本申请实施例还提供一种基于上述图像信息的处理方法的装置。其中名词的含义与上述图像信息的处理方法中相同,具体实现细节可以参考方法实施例中的说明。In order to facilitate better implementation of the image information processing method provided by the embodiment of the present application, the embodiment of the present application further provides a device based on the above-mentioned image information processing method. The meanings of the nouns are the same as those in the above-mentioned image information processing method, and the specific implementation details can refer to the description in the method embodiment.
请参阅图4,图4为本申请实施例提供的图像信息的处理装置的模块示意图。具体而言,该图像信息的处理装置300,包括:识别单元31、确定单元32、处理单元33以及计算单元34。Please refer to FIG. 4 , which is a schematic block diagram of an apparatus for processing image information according to an embodiment of the present application. Specifically, the image
识别单元31,用于获取待处理图像,并对所述待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域。The
其中,识别单元31可以通过图像识别算法,例如卷积神经网络算法对待处理图像进行图像识别,识别得到待处理图像中的不同的对象,从不同的对象中确定出相互关联的第一对象区域和第二对象区域,如人脸对象区域和头发对象区域为强相关的,或者树干对象区域和叶子对象区域为强相关的,该关联的第一对象区域和第二对象区域在色调映射处理中需要进行合理处理,避免出现图像处理不真实的情形。The
在一些实施方式中,如图5所示,该识别单元31,包括:In some embodiments, as shown in FIG. 5 , the
提取子单元311,用于获取待处理图像,提取所述待处理图像中的关键特征点信息;The
确定子单元312,用于根据所述关键特征点信息确定关联的人脸对象区域和头发对象区域。The determining
确定单元32,用于基于所述第一对象区域和第二对象区域确定出相应的第一色调调整信息。The determining
其中,确定单元32可以基于该第一对象区域和第二对象区域计算出相应的第一色调调整信息,该第一色调调整信息为第一对象区域和第二对象区域在未进行色调映射处理之前的表现度差异范围,如第一对象区域和第二对象区域在亮度和对比度的差值,根据该差值确定出相应的差值范围,该差值范围即为第一色调调整信息,该第一色调调整信息即体现原始图像中第一对象区域和第二对象区域的图像表现度差异,后续即使进行色调映射处理,也需要保留该图像表现度差异,以保留图像的真实度值。Wherein, the determining
在一些实施方式中,该确定单元32,具体用于获取人脸对象区域的第一亮度值和第一对比度值;获取头发对象区域的第二亮度值和第二对比度值;计算所述第一亮度值和第二亮度值的第一亮度差以及第一对比度值和第二对比度值的第一对比度差;将所述第一亮度差和所述第一对比度差确定为第一色调调整信息。In some embodiments, the determining
处理单元33,用于对所述第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域。The
其中,处理单元33将类似人脸对象区域等等需要进行色调映射保护机制的区域确定为第一对象区域,依据保护机制下的色调映射处理进行色调映射处理,生成色调映射后的第一目标对象区域。Wherein, the
在一些实施方式中,该处理单元33,具体用于:对所述人脸对象区域进行色调映射处理,生成色调映射处理后的第一目标人脸对象区域。In some embodiments, the
计算单元34,用于计算所述第一目标对象区域与第一对象区域的第二色调调整信息,并根据所述第一色调调整信息和第二色调调整信息确定所述第二对象区域的色调映射处理策略。A
其中,计算单元34基于依据保护机制下的色调映射处理后的第一目标对象区域和未依据保护机制下的色调映射处理的第一对象区域的表现度差异范围,如第一目标对象区域和第一对象区域在亮度和对比度的差值,根据该差值确定出相应的差值范围,该差值范围即为第二调整信息,该第二色调调整信息即体现原始图像中第一对象区域和依据保护机制下的色调映射处理后的第一目标对象区域的图像表现度差异,后续第二对象区域进行色调映射处理,需要遵循该第一对象区域的色调映射处理的处理度差异。Wherein, the
进一步的,计算单元34结合该第一色调调整信息和第二色调调整信息确定出第二对象区域相应的色调映射处理策略,使得该第二对象区域基于该色调映射处理策略进行色调映射处理后,得到的色调映射处理后的第二目标对象区域的表现度既符合原待处理图像中第一对象区域和第二对象区域的表现度差异,也符合第一对象区域的色调映射处理的处理幅度,使得色调映射处理后的第一目标对象区域和第二目标对象区域的表现度符合真实场景的要求。Further, the
在一些实施方式中,该计算单元34,具体用于:获取第一目标人脸对象区域的第三亮度值和第三对比度值;计算所述第三亮度值和第一亮度值的第二亮度差以及第三对比度值和第一对比度值的第二对比度差;将所述第二亮度差和所述第二对比度差确定为第二色调调整信息;根据所述第一亮度差和第一对比度差确定出区域色调对比范围;根据所述第二亮度差和第二对比度差确定出人脸色调调节范围;结合所述区域色调对比范围和所述人脸色调调节范围确定头发对象区域相应的色调映射处理策略。In some embodiments, the
由上述可知,本实施例提供的一种图像信息的处理装置,通过识别单元31获取待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;确定单元32基于第一对象区域和第二对象区域确定出相应的第一色调调整信息;处理单元33对第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;计算单元34计算第一目标对象区域与第一对象区域的第二色调调整信息,并根据第一色调调整信息和第二色调调整信息确定第二对象区域的色调映射处理策略。以此根据关联的第一对象区域和第二对象区域在色调映射处理前的第一色调调整信息以及第一对象区域在色调映射前后的第二色调调整信息结合确定适合第二对象区域的色调映射处理策略,使得关联区域处理效果真实,极大的提升了图像信息的处理效率。It can be seen from the above that the image information processing device provided in this embodiment obtains the image to be processed through the
本申请实施例还提供一种电子设备。请参阅图6,电子设备500包括处理器501以及存储器502。其中,处理器501与存储器502电性连接。The embodiments of the present application also provide an electronic device. Referring to FIG. 6 , the
该处理器500是电子设备500的控制中心,利用各种接口和线路连接整个电子设备的各个部分,通过运行或加载存储在存储器502内的计算机程序,以及调用存储在存储器502内的数据,执行电子设备500的各种功能并处理数据,从而对电子设备500进行整体监控。The
该存储器502可用于存储软件程序以及模块,处理器501通过运行存储在存储器502的计算机程序以及模块,从而执行各种功能应用以及图像信息的处理。存储器502可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的计算机程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据电子设备的使用所创建的数据等。此外,存储器502可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。相应地,存储器502还可以包括存储器控制器,以提供处理器501对存储器502的访问。The
在本申请实施例中,电子设备500中的处理器501会按照如下的步骤,将一个或一个以上的计算机程序的进程对应的指令加载到存储器502中,并由处理器501运行存储在存储器502中的计算机程序,从而实现各种功能,如下:In this embodiment of the present application, the
获取待处理图像,并对所述待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;acquiring an image to be processed, and performing object recognition on the image to be processed to obtain the associated first object area and second object area;
基于所述第一对象区域和第二对象区域确定出相应的第一色调调整信息;determining corresponding first tone adjustment information based on the first object area and the second object area;
对所述第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;Perform tone mapping processing on the first object area to generate the first target object area after tone mapping processing;
计算所述第一目标对象区域与第一对象区域的第二色调调整信息,并根据所述第一色调调整信息和第二色调调整信息确定所述第二对象区域的色调映射处理策略。Calculate the second tone adjustment information of the first target object area and the first object area, and determine a tone mapping processing strategy for the second object area according to the first tone adjustment information and the second tone adjustment information.
在某些实施方式中,所述第一对象区域为人脸对象区域,所述第二对象区域为头发对象区域,在对所述待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域时,处理器501可以具体执行以下步骤:In some embodiments, the first object region is a face object region, and the second object region is a hair object region, and the associated first object region and second object region are obtained by performing object recognition on the to-be-processed image. When the object area is selected, the
提取所述待处理图像中的关键特征点信息;extracting key feature point information in the to-be-processed image;
根据所述关键特征点信息确定关联的人脸对象区域和头发对象区域。The associated face object region and hair object region are determined according to the key feature point information.
在某些实施方式中,在基于所述第一对象区域和第二对象区域确定出相应的第一色调调整信息时,处理器501可以具体执行以下步骤:In some embodiments, when the corresponding first color tone adjustment information is determined based on the first object area and the second object area, the
获取人脸对象区域的第一亮度值和第一对比度值;obtaining the first brightness value and the first contrast value of the face object area;
获取头发对象区域的第二亮度值和第二对比度值;obtaining the second brightness value and the second contrast value of the hair object area;
计算所述第一亮度值和第二亮度值的第一亮度差以及第一对比度值和第二对比度值的第一对比度差;calculating a first brightness difference between the first brightness value and the second brightness value and a first contrast difference between the first contrast value and the second contrast value;
将所述第一亮度差和所述第一对比度差确定为第一色调调整信息。The first brightness difference and the first contrast difference are determined as first tone adjustment information.
在某些实施方式中,在计算所述第一目标对象区域与第一对象区域的第二色调调整信息时,处理器501可以具体执行以下步骤:In some embodiments, when calculating the second color tone adjustment information of the first target object area and the first object area, the
获取第一目标人脸对象区域的第三亮度值和第三对比度值;obtaining the third brightness value and the third contrast value of the first target face object area;
计算所述第三亮度值和第一亮度值的第二亮度差以及第三对比度值和第一对比度值的第二对比度差;calculating a second brightness difference between the third brightness value and the first brightness value and a second contrast difference between the third contrast value and the first contrast value;
将所述第二亮度差和所述第二对比度差确定为第二色调调整信息。The second luminance difference and the second contrast difference are determined as second hue adjustment information.
在某些实施方式中,在根据所述第一色调调整信息和第二色调调整信息确定所述第二对象区域的色调映射处理策略时,处理器501可以具体执行以下步骤:In some embodiments, when determining the tone mapping processing strategy of the second object area according to the first tone adjustment information and the second tone adjustment information, the
根据所述第一亮度差和第一对比度差确定出区域色调对比范围;determining a regional hue contrast range according to the first brightness difference and the first contrast difference;
根据所述第二亮度差和第二对比度差确定出人脸色调调节范围;determining a face tone adjustment range according to the second brightness difference and the second contrast difference;
结合所述区域色调对比范围和所述人脸色调调节范围确定头发对象区域相应的色调映射处理策略。The corresponding tone mapping processing strategy for the hair object area is determined in combination with the regional tone contrast range and the face tone adjustment range.
在某些实施方式中,在对所述第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域时,处理器501可以具体执行以下步骤:In some embodiments, when performing tone mapping processing on the first object area to generate the first target object area after tone mapping processing, the
对所述人脸对象区域进行色调映射处理,生成色调映射处理后的第一目标人脸对象区域。Tone-mapping processing is performed on the face object region to generate a first target face object region after tone-mapping processing.
由上述可知,本申请实施例的电子设备,通过获取待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;基于第一对象区域和第二对象区域确定出相应的第一色调调整信息;对第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;计算第一目标对象区域与第一对象区域的第二色调调整信息,并根据第一色调调整信息和第二色调调整信息确定第二对象区域的色调映射处理策略。以此根据关联的第一对象区域和第二对象区域在色调映射处理前的第一色调调整信息以及第一对象区域在色调映射前后的第二色调调整信息结合确定适合第二对象区域的色调映射处理策略,使得关联区域处理效果真实,极大的提升了图像信息的处理效率。It can be seen from the above that the electronic device according to the embodiment of the present application performs object recognition by acquiring the image to be processed to obtain the associated first object area and the second object area; based on the first object area and the second object area, the corresponding first object area is determined. tone adjustment information; perform tone mapping processing on the first object area to generate the first target object area after tone mapping processing; calculate the second tone adjustment information of the first target object area and the first object area, and adjust the tone according to the first tone The information and the second tone adjustment information determine a tone mapping processing strategy for the second object area. In this way, a tone mapping suitable for the second object area is determined according to the combination of the first tone adjustment information of the associated first object area and the second object area before tone mapping processing and the second tone adjustment information of the first object area before and after tone mapping. The processing strategy makes the processing effect of the associated area real, and greatly improves the processing efficiency of image information.
请一并参阅图7,在某些实施方式中,电子设备500还可以包括:显示器503、射频电路504、音频电路505以及电源506。其中,其中,显示器503、射频电路504、音频电路505以及电源506分别与处理器501电性连接。Please also refer to FIG. 7 , in some embodiments, the
该显示器503可以用于显示由用户输入的信息或提供给用户的信息以及各种图形用户接口,这些图形用户接口可以由图形、文本、图标、视频和其任意组合来构成。显示器503可以包括显示面板,在某些实施方式中,可以采用液晶显示器(Liquid CrystalDisplay,LCD)、或者有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板。The
该射频电路504可以用于收发射频信号,以通过无线通信与网络设备或其他终端建立无线通讯,与网络设备或其他终端之间收发信号。The
该音频电路505可以用于通过扬声器、传声器提供用户与电子设备之间的音频接口。The
该电源506可以用于给电子设备500的各个部件供电。在一些实施例中,电源506可以通过电源管理系统与处理器501逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The
本申请实施例还提供一种存储介质,该存储介质存储有计算机程序,当该计算机程序在计算机上运行时,使得该计算机执行上述任一实施例中的图像信息的处理方法,比如:获取待处理图像,并对所述待处理图像进行对象识别,得到关联的第一对象区域和第二对象区域;基于所述第一对象区域和第二对象区域确定出相应的第一色调调整信息;对所述第一对象区域进行色调映射处理,生成色调映射处理后的第一目标对象区域;计算所述第一目标对象区域与第一对象区域的第二色调调整信息,并根据所述第一色调调整信息和第二色调调整信息确定所述第二对象区域的色调映射处理策略。Embodiments of the present application further provide a storage medium, where a computer program is stored in the storage medium, and when the computer program runs on a computer, the computer is made to execute the image information processing method in any of the above-mentioned embodiments, such as: processing the image, and performing object recognition on the to-be-processed image to obtain the associated first object region and second object region; determining corresponding first tone adjustment information based on the first object region and the second object region; The first object area is subjected to tone mapping processing to generate the first target object area after tone mapping processing; the second tone adjustment information of the first target object area and the first object area is calculated, and the The adjustment information and the second tone adjustment information determine a tone mapping processing strategy for the second object area.
在本申请实施例中,存储介质可以是磁碟、光盘、只读存储器(Read Only Memory,ROM,)、或者随机存取记忆体(Random Access Memory,RAM)等。In this embodiment of the present application, the storage medium may be a magnetic disk, an optical disk, a read only memory (Read Only Memory, ROM,), or a random access memory (Random Access Memory, RAM), or the like.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.
需要说明的是,对本申请实施例的图像信息的处理方法而言,本领域普通测试人员可以理解实现本申请实施例的图像信息的处理方法的全部或部分流程,是可以通过计算机程序来控制相关的硬件来完成,该计算机程序可存储于一计算机可读取存储介质中,如存储在电子设备的存储器中,并被该电子设备内的至少一个处理器执行,在执行过程中可包括如图像信息的处理方法的实施例的流程。其中,该的存储介质可为磁碟、光盘、只读存储器、随机存取记忆体等。It should be noted that, for the image information processing method of the embodiment of the present application, ordinary testers in the art can understand that all or part of the process of realizing the image information processing method of the embodiment of the present application can be controlled by a computer program. The computer program can be stored in a computer-readable storage medium, such as a memory of an electronic device, and executed by at least one processor in the electronic device, and the execution process can include images such as images Flow of an embodiment of a method for processing information. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory, a random access memory, or the like.
对本申请实施例的图像信息的处理装置而言,其各功能模块可以集成在一个处理芯片中,也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。该集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中,该存储介质譬如为只读存储器,磁盘或光盘等。For the image information processing apparatus according to the embodiment of the present application, each functional module may be integrated in one processing chip, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a magnetic disk or an optical disk.
以上对本申请实施例所提供的一种图像信息的处理方法、装置、存储介质及电子设备进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The image information processing method, device, storage medium, and electronic device provided by the embodiments of the present application have been described in detail above. The principles and implementations of the present application are described with specific examples. The description is only used to help understand the method of the present application and its core idea; meanwhile, for those skilled in the art, according to the idea of the present application, there will be changes in the specific embodiment and the scope of application. In summary, The contents of this specification should not be construed as limiting the application.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910741627.5A CN110473156B (en) | 2019-08-12 | 2019-08-12 | Image information processing method, device, storage medium and electronic device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910741627.5A CN110473156B (en) | 2019-08-12 | 2019-08-12 | Image information processing method, device, storage medium and electronic device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110473156A CN110473156A (en) | 2019-11-19 |
CN110473156B true CN110473156B (en) | 2022-08-02 |
Family
ID=68510191
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910741627.5A Active CN110473156B (en) | 2019-08-12 | 2019-08-12 | Image information processing method, device, storage medium and electronic device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110473156B (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112351195B (en) * | 2020-09-22 | 2022-09-30 | 北京迈格威科技有限公司 | Image processing method, device and electronic system |
CN114463191B (en) * | 2021-08-26 | 2023-01-31 | 荣耀终端有限公司 | Image processing method and electronic equipment |
CN114676360B (en) * | 2022-03-23 | 2024-09-17 | 腾讯科技(深圳)有限公司 | Image processing method, device, electronic equipment and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101389039A (en) * | 2007-09-11 | 2009-03-18 | 佳能株式会社 | Image processing apparatus and image processing method and imaging apparatus |
CN101621702A (en) * | 2009-07-30 | 2010-01-06 | 北京海尔集成电路设计有限公司 | Method and device for automatically adjusting chroma and saturation |
CN103400342A (en) * | 2013-07-04 | 2013-11-20 | 西安电子科技大学 | Mixed color gradation mapping and compression coefficient-based high dynamic range image reconstruction method |
CN105913373A (en) * | 2016-04-05 | 2016-08-31 | 广东欧珀移动通信有限公司 | Image processing method and device |
CN107862657A (en) * | 2017-10-31 | 2018-03-30 | 广东欧珀移动通信有限公司 | Image processing method, device, computer equipment and computer-readable recording medium |
WO2019028700A1 (en) * | 2017-08-09 | 2019-02-14 | 深圳市大疆创新科技有限公司 | Image processing method, device and computer readable storage medium |
-
2019
- 2019-08-12 CN CN201910741627.5A patent/CN110473156B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101389039A (en) * | 2007-09-11 | 2009-03-18 | 佳能株式会社 | Image processing apparatus and image processing method and imaging apparatus |
CN101621702A (en) * | 2009-07-30 | 2010-01-06 | 北京海尔集成电路设计有限公司 | Method and device for automatically adjusting chroma and saturation |
CN103400342A (en) * | 2013-07-04 | 2013-11-20 | 西安电子科技大学 | Mixed color gradation mapping and compression coefficient-based high dynamic range image reconstruction method |
CN105913373A (en) * | 2016-04-05 | 2016-08-31 | 广东欧珀移动通信有限公司 | Image processing method and device |
WO2019028700A1 (en) * | 2017-08-09 | 2019-02-14 | 深圳市大疆创新科技有限公司 | Image processing method, device and computer readable storage medium |
CN107862657A (en) * | 2017-10-31 | 2018-03-30 | 广东欧珀移动通信有限公司 | Image processing method, device, computer equipment and computer-readable recording medium |
Non-Patent Citations (4)
Title |
---|
《Dynamic range enhancement for Medical Image Processing》;Gian DL et al;《2017 7th IEEE International Workshop on Advances in Sensors and Interfaces》;20170713;全文 * |
《不完整的模糊人脸图像修复方法的研究》;李美怡;《中国优秀博硕士学位论文全文数据库 (硕士) 信息科技辑》;20061015(第2006年第10期);全文 * |
《基于标准肤色的人脸图像纹理合成与三维重建应用》;阳策等;《计算机系统应用》;20190603;全文 * |
《基于边缘保持平滑滤波与编辑传播的快速人脸美化方法及系统实现》;许少杰;《中国优秀硕士学位论文全文数据库 信息科技辑》;20160315;全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN110473156A (en) | 2019-11-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113112505B (en) | Image processing method, device and equipment | |
CN109961453B (en) | An image processing method, device and equipment | |
CN112449120B (en) | High dynamic range video generation method and device | |
CN112262563B (en) | Image processing method and electronic device | |
CN113421189B (en) | Image super-resolution processing method and device and electronic equipment | |
US11138695B2 (en) | Method and device for video processing, electronic device, and storage medium | |
CN112669197A (en) | Image processing method, image processing device, mobile terminal and storage medium | |
CN112950499B (en) | Image processing method, device, electronic equipment and storage medium | |
CN110473156B (en) | Image information processing method, device, storage medium and electronic device | |
CN117241145A (en) | Terminal device and method for creating/displaying HDR image | |
CN107147851B (en) | Photo processing method, apparatus, computer-readable storage medium, and electronic device | |
CN114298935B (en) | Image enhancement method, device and computer readable storage medium | |
CN117496391B (en) | Image processing method and electronic equipment | |
US20250139741A1 (en) | Stroboscopic image processing method and apparatus, electronic device, and readable storage medium | |
CN107690804A (en) | A kind of image processing method and user terminal | |
CN113132696A (en) | Image tone mapping method, device, electronic equipment and storage medium | |
WO2024251062A1 (en) | Gain map generation method and apparatus, electronic device and medium | |
CN110163816B (en) | Image information processing method, device, storage medium and electronic device | |
CN108259771A (en) | Image processing method, image processing apparatus, storage medium, and electronic device | |
CN118474553B (en) | Image processing method and electronic equipment | |
CN116051440A (en) | An image enhancement processing method and system | |
CN114363507A (en) | Image processing method and device | |
CN116721257A (en) | Image processing method, electronic device and computer-readable storage medium | |
CN107430769A (en) | The system and method for refined image data | |
CN117119316B (en) | Image processing method, electronic device and readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |