[go: up one dir, main page]

CN111814840A - Method, system, equipment and medium for evaluating quality of face image - Google Patents

Method, system, equipment and medium for evaluating quality of face image Download PDF

Info

Publication number
CN111814840A
CN111814840A CN202010554425.2A CN202010554425A CN111814840A CN 111814840 A CN111814840 A CN 111814840A CN 202010554425 A CN202010554425 A CN 202010554425A CN 111814840 A CN111814840 A CN 111814840A
Authority
CN
China
Prior art keywords
face
score
quality evaluation
quality
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010554425.2A
Other languages
Chinese (zh)
Inventor
姚志强
周曦
张滔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hengrui Chongqing Artificial Intelligence Technology Research Institute Co ltd
Original Assignee
Hengrui Chongqing Artificial Intelligence Technology Research Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hengrui Chongqing Artificial Intelligence Technology Research Institute Co ltd filed Critical Hengrui Chongqing Artificial Intelligence Technology Research Institute Co ltd
Priority to CN202010554425.2A priority Critical patent/CN111814840A/en
Publication of CN111814840A publication Critical patent/CN111814840A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217Validation; Performance evaluation; Active pattern learning techniques
    • G06F18/2193Validation; Performance evaluation; Active pattern learning techniques based on specific statistical tests
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2415Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)

Abstract

本发明提出一种人脸图像质量评估方法、系统、设备和介质,包括:人脸图像对应的人脸总分在预设的阈值范围内时,根据获得的各人脸质量评估模型得到的分数,输出人脸图像质量评估结果;本发明通过调整质量评估策略,极大地提高了人脸图像质量评估的速度和效率。

Figure 202010554425

The present invention provides a face image quality assessment method, system, equipment and medium, including: when the total face score corresponding to the face image is within a preset threshold range, the scores obtained according to the obtained face quality assessment models , and output the face image quality assessment result; the present invention greatly improves the speed and efficiency of the face image quality assessment by adjusting the quality assessment strategy.

Figure 202010554425

Description

一种人脸图像质量评估方法、系统、设备和介质A face image quality assessment method, system, device and medium

技术领域technical field

本发明涉及人工智能与图像处理领域,尤其涉及一种人脸图像质量评估方法、 系统、设备和介质。The present invention relates to the fields of artificial intelligence and image processing, and in particular, to a method, system, device and medium for evaluating the quality of a face image.

背景技术Background technique

随着人工智能的发展,人脸识别技术在实际生活中的应用越来越广泛。人脸 质量评估是人脸识别流程中十分重要的一环,如何快速并准确地给出人脸的质量 分是一个难题。With the development of artificial intelligence, face recognition technology is more and more widely used in real life. Face quality assessment is a very important part of the face recognition process. How to quickly and accurately give the face quality score is a difficult problem.

现有的人脸质量评估需要计算关键点、清晰度、亮度、角度、总分等等模型 的结果,对这些分数取加权平均进而得到总分,评估耗时与图片所含人脸数正相 关。因而遇到大的人流量情况,如视频流中某一时间段出现100人,那么连续多 帧的抓拍图都会包含100张人脸,人脸质量评估耗时会很长,影响人脸识别的效 率。The existing face quality assessment needs to calculate the results of the key points, sharpness, brightness, angle, total score, etc., and take the weighted average of these scores to obtain the total score. The evaluation time is positively related to the number of faces contained in the picture. . Therefore, in the case of a large flow of people, such as 100 people in a certain period of time in the video stream, then the snapshots of multiple consecutive frames will contain 100 faces, and the face quality evaluation will take a long time, which will affect the face recognition. efficiency.

发明内容SUMMARY OF THE INVENTION

鉴于以上现有技术存在的问题,本发明提出一种人脸图像质量评估方法、系 统、设备和介质,主要解决传统质量评估方法在处理大人流量的数据是处理速度 慢的问题。In view of the above problems in the prior art, the present invention proposes a face image quality assessment method, system, device and medium, which mainly solves the problem that the processing speed of the traditional quality assessment method is slow in processing the data of large traffic.

为了实现上述目的及其他目的,本发明采用的技术方案如下。In order to achieve the above objects and other objects, the technical solutions adopted in the present invention are as follows.

一种人脸图像质量评估方法,包括:A face image quality assessment method, comprising:

人脸图像对应的人脸总分在预设的阈值范围内时,根据获得的各人脸质量评 估模型得到的分数,输出人脸图像质量评估结果。When the total face score corresponding to the face image is within the preset threshold range, the face image quality assessment result is output according to the scores obtained by each face quality assessment model.

可选地,人脸图像对应的人脸总分超出所述预设的阈值范围时,根据所述人 脸总分输出人脸图像质量评估结果。Optionally, when the face total score corresponding to the face image exceeds the preset threshold range, output the face image quality assessment result according to the face total score.

可选地,预先根据人脸总分质量评估模型获取所述人脸图像对应的人脸总分。Optionally, the total face score corresponding to the face image is obtained in advance according to a quality evaluation model for the total face score.

可选地,所述人脸总分质量评估模型对预先标注的人脸图像特征区域进行识 别,输出人脸总分。Optionally, the face total score quality assessment model identifies the pre-marked face image feature regions, and outputs the face total score.

可选地,对于同一目标对象的多帧图像,按照确定的帧间隔数,确定待评估 目标帧;Optionally, for the multi-frame images of the same target object, according to the determined frame interval number, determine the target frame to be evaluated;

通过所述人脸质量评估模型,对所述待评估目标帧包含的所述目标对象的人 脸图像进行质量评估。Through the face quality assessment model, quality assessment is performed on the face image of the target object contained in the target frame to be assessed.

可选地,确定帧间隔数的过程为:Optionally, the process of determining the number of frame intervals is:

设置初始帧间隔数,并根据所述初始帧间隔数获取同一目标对象的间隔帧; 获取所述间隔帧中同一目标对象的人脸图像质量分误差;判断所述质量分误差是 否在设置的允许范围内;Set the initial frame interval number, and obtain the interval frame of the same target object according to the initial frame interval number; Obtain the face image quality error of the same target object in the interval frame; Determine whether the quality error is within the allowable setting of the setting within the range;

若超出所述允许范围,则调整所述初始帧间隔数,直至所述质量分误差在所 述允许范围内。If it exceeds the allowable range, adjust the initial frame interval number until the quality score error is within the allowable range.

可选地,所述人脸质量评估模型至少包括:Optionally, the face quality assessment model includes at least:

人脸总分质量评估模型、人脸关键点质量评估模型、人脸清晰度质量评估模 型、人脸角度质量评估模型、人脸亮度质量评估模型。Face total score quality assessment model, face key point quality assessment model, face definition quality assessment model, face angle quality assessment model, face brightness quality assessment model.

可选地,根据图像质量参数预设范围确定所述阈值范围:Optionally, the threshold range is determined according to a preset range of image quality parameters:

若所述人脸总分小于所述预设范围的下界,则将所述人脸总分作为所述阈值 范围的下界;If the total score of the human face is less than the lower bound of the preset range, then the total score of the human face is used as the lower bound of the threshold range;

若所述人脸总分大于所述预设范围的上界,则将所述人脸总分作为所述阈值 范围的上界。If the total score of the human face is greater than the upper bound of the preset range, the total score of the human face is used as the upper bound of the threshold range.

可选地,所述图像质量参数包括以下至少之一:图像亮度值、图像灰度值、 图像清晰度值。Optionally, the image quality parameter includes at least one of the following: an image brightness value, an image gray value, and an image sharpness value.

可选地,当所述人脸总分大于所述阈值范围的上界时,获取所述人脸总分加 上预设常数后与所有人脸质量评估模型综合分数的误差,判断所述误差是否小于 所述预设常数,若是,则将所述人脸总分加上所述预设常数用于更新所述阈值范 围的上界。Optionally, when the total face score is greater than the upper bound of the threshold range, obtain the error between the total face score plus a preset constant and the comprehensive score of all face quality assessment models, and judge the error. Whether it is less than the preset constant, and if so, adding the preset constant to the total face score is used to update the upper bound of the threshold range.

可选地,将各人脸质量评估模型的分数进行加权处理,获取所述综合分数。Optionally, weighting is performed on the scores of each face quality assessment model to obtain the comprehensive score.

一种人脸图像质量评估系统,包括:A face image quality assessment system, comprising:

质量评估模块,用于人脸图像对应的人脸总分在预设的阈值范围内时,根据 获得的各人脸质量评估模型得到的分数,输出人脸图像质量评估结果。The quality assessment module is used to output the quality assessment result of the face image according to the scores obtained by the obtained face quality assessment models when the total face score corresponding to the face image is within the preset threshold range.

可选地,人脸图像对应的人脸总分超出所述预设的阈值范围时,根据所述人 脸总分输出人脸图像质量评估结果。Optionally, when the face total score corresponding to the face image exceeds the preset threshold range, output the face image quality assessment result according to the face total score.

可选地,包括总分评估模块,用于预先根据人脸总分质量评估模型获取所述 人脸图像对应的人脸总分。Optionally, a total score evaluation module is included, which is used to obtain the total face score corresponding to the face image according to the total score quality evaluation model of the human face in advance.

可选地,所述人脸总分质量评估模型对预先标注的人脸图像特征区域进行识 别,输出人脸总分。Optionally, the face total score quality assessment model identifies the pre-marked face image feature regions, and outputs the face total score.

可选地,包括间隔评估模块,用于对于同一目标对象的多帧图像,按照确定 的帧间隔数,确定待评估目标帧;Optionally, include interval evaluation module, for the multi-frame image of same target object, according to the frame interval number determined, determine the target frame to be evaluated;

通过所述人脸质量评估模型,对所述待评估目标帧包含的所述目标对象的人 脸图像进行质量评估。Through the face quality assessment model, quality assessment is performed on the face image of the target object contained in the target frame to be assessed.

可选地,确定帧间隔数的过程为:Optionally, the process of determining the number of frame intervals is:

设置初始帧间隔数,并根据所述初始帧间隔数获取同一目标对象的间隔帧; 获取所述间隔帧中同一目标对象的人脸图像质量分误差;判断所述质量分误差是 否在设置的允许范围内;Set the initial frame interval number, and obtain the interval frame of the same target object according to the initial frame interval number; Obtain the face image quality error of the same target object in the interval frame; Determine whether the quality error is within the allowable setting of the setting within the range;

若超出所述允许范围,则调整所述初始帧间隔数,直至所述质量分误差在所 述允许范围内。If it exceeds the allowable range, adjust the initial frame interval number until the quality score error is within the allowable range.

可选地,所述人脸质量评估模型至少包括:Optionally, the face quality assessment model includes at least:

人脸总分质量评估模型、人脸关键点质量评估模型、人脸清晰度质量评估模 型、人脸角度质量评估模型、人脸亮度质量评估模型。Face total score quality assessment model, face key point quality assessment model, face definition quality assessment model, face angle quality assessment model, face brightness quality assessment model.

可选地,所述预设的阈值范围的确定过程为:Optionally, the process of determining the preset threshold range is:

根据图像质量参数预设范围确定所述阈值范围:The threshold range is determined according to the preset range of image quality parameters:

若所述人脸总分小于所述预设范围的下界,则将所述人脸总分作为所述阈值 范围的下界;If the total score of the human face is less than the lower bound of the preset range, then the total score of the human face is used as the lower bound of the threshold range;

若所述人脸总分大于所述预设范围的上界,则将所述人脸总分作为所述阈值 范围的上界。If the total score of the human face is greater than the upper bound of the preset range, the total score of the human face is used as the upper bound of the threshold range.

可选地,所述图像质量参数包括以下至少之一:图像亮度值、图像灰度值、 图像清晰度值。Optionally, the image quality parameter includes at least one of the following: an image brightness value, an image gray value, and an image sharpness value.

可选地,包括阈值更新模块,用于当所述人脸总分大于所述阈值范围的上界 时,获取所述人脸总分加上预设常数后与所有人脸质量评估模型综合分数的误差, 判断所述误差是否小于所述预设常数,若是,则将所述人脸总分加上所述预设常 数用于更新所述阈值范围的上界。Optionally, a threshold update module is included, for when the total score of the human face is greater than the upper bound of the threshold range, the total score of the human face is obtained after adding a preset constant and the comprehensive score of all face quality evaluation models. The error is determined, whether the error is smaller than the preset constant, and if so, the total face score plus the preset constant is used to update the upper bound of the threshold range.

可选地,包括综合评分模块,用于将各人脸质量评估模型的分数进行加权处 理,获取所述综合分数。Optionally, a comprehensive scoring module is included to perform weighting processing on the scores of each face quality assessment model to obtain the comprehensive score.

一种设备,包括:A device comprising:

一个或多个处理器;和one or more processors; and

其上存储有指令的一个或多个机器可读介质,当所述一个或多个处理器执行 时,使得所述设备执行所述的人脸图像质量评估方法。One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the apparatus to perform the method for assessing the quality of a human face image.

一个或多个机器可读介质,其上存储有指令,当由一个或多个处理器执行时, 使得设备执行所述的人脸图像质量评估方法。One or more machine-readable media having instructions stored thereon that, when executed by one or more processors, cause an apparatus to perform the described method for assessing the quality of a human face image.

如上所述,本发明一种人脸图像质量评估方法、系统、介质和设备,具有以 下有益效果。As described above, the present invention provides a method, system, medium and device for evaluating the quality of a face image, which have the following beneficial effects.

通过人脸总分评估人脸图像质量,减少不必要的模型评估计算,降低CPU 的使用率,提高质量评估效率。Evaluate face image quality through total face score, reduce unnecessary model evaluation calculations, reduce CPU usage, and improve quality evaluation efficiency.

附图说明Description of drawings

图1为本发明一实施例中人脸图像质量评估方法的流程图。FIG. 1 is a flowchart of a method for evaluating the quality of a face image according to an embodiment of the present invention.

图2为本发明一实施例中人脸图像质量评估系统的模块图。FIG. 2 is a block diagram of a face image quality assessment system according to an embodiment of the present invention.

图3为本发明一实施例中终端设备的结构示意图。FIG. 3 is a schematic structural diagram of a terminal device in an embodiment of the present invention.

图4为本发明另一实施例中终端设备的结构示意图。FIG. 4 is a schematic structural diagram of a terminal device in another embodiment of the present invention.

具体实施方式Detailed ways

以下通过特定的具体实例说明本发明的实施方式,本领域技术人员可由本说 明书所揭露的内容轻易地了解本发明的其他优点与功效。本发明还可以通过另外 不同的具体实施方式加以实施或应用,本说明书中的各项细节也可以基于不同观 点与应用,在没有背离本发明的精神下进行各种修饰或改变。需说明的是,在不 冲突的情况下,以下实施例及实施例中的特征可以相互组合。The embodiments of the present invention are described below through specific specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other under the condition of no conflict.

需要说明的是,以下实施例中所提供的图示仅以示意方式说明本发明的基本 构想,遂图式中仅显示与本发明中有关的组件而非按照实际实施时的组件数目、 形状及尺寸绘制,其实际实施时各组件的型态、数量及比例可为一种随意的改变, 且其组件布局型态也可能更为复杂。It should be noted that the drawings provided in the following embodiments are only used to illustrate the basic concept of the present invention in a schematic way, so the drawings only show the components related to the present invention rather than the number, shape and number of components in actual implementation. For dimension drawing, the type, quantity and proportion of each component can be arbitrarily changed in actual implementation, and the component layout may also be more complicated.

请参阅图1,本发明提供一种人脸图像质量评估方法,包括人脸图像对应的 人脸总分在预设的阈值范围内时,根据获得的各人脸质量评估模型得到的分数, 输出人脸图像质量评估结果。Referring to FIG. 1, the present invention provides a method for evaluating the quality of a face image, which includes, when the total face score corresponding to the face image is within a preset threshold range, according to the scores obtained by the obtained face quality evaluation models, outputting Face image quality assessment results.

在一实施例中,可预先训练多种人脸质量评估模型,其中人脸质量评估模型 至少包括人脸总分质量评估模型、人脸关键点质量评估模型、人脸清晰度质量评 估模型、人脸角度质量评估模型、人脸亮度质量评估模型。根据各人脸质量评估 模型分别对人脸图像进行质量评分。In one embodiment, a variety of face quality assessment models can be pre-trained, wherein the face quality assessment models include at least a face total score quality assessment model, a face key point quality assessment model, a face clarity quality assessment model, and a human face quality assessment model. Face angle quality assessment model, face brightness quality assessment model. According to each face quality assessment model, the quality of face images is scored separately.

具体地,在训练人脸总分评分模型时,可预先对训练样本图像的进行人脸标 注,并对标注后的人脸图像特征区域采用人脸识别算法进行识别,如可将人脸图 像特征区域与标准人脸模板进行比对,判断特征区域关键特征点的清晰度、特征 区域的模糊度、亮度等,输出人脸总分。经过大量样本图像训练的到人脸总分评 估模型。其中,人脸识别算法可采用深度神经网络算法、基于特征的人脸识别算 法、基于模板的人脸识别算法等。Specifically, when training the face total score scoring model, the training sample images can be marked with faces in advance, and the marked face image feature areas can be identified by using a face recognition algorithm. For example, the face image features can be identified. The area is compared with the standard face template, and the sharpness of key feature points in the feature area, the ambiguity and brightness of the feature area, etc. are judged, and the total score of the face is output. A face-to-face total score evaluation model trained on a large number of sample images. Among them, the face recognition algorithm can use deep neural network algorithm, feature-based face recognition algorithm, template-based face recognition algorithm, etc.

针对人脸关键特征点进行质量评分时,可通过深度卷积神经网络建立关键点 评分模型,分别针对眼睛、眉毛、鼻子、嘴巴等人脸特征进行检测并打分,对各 关键特征点的分数进行加权平均,获取关键点评分模型的评分结果。When scoring the quality of the key feature points of the face, a key point scoring model can be established through a deep convolutional neural network, and the facial features such as eyes, eyebrows, nose, mouth and other facial features can be detected and scored respectively, and the scores of each key feature point. Weighted average to obtain the scoring results of the keypoint scoring model.

在进行清晰度评分时,可通过常规的灰度方差算法(SMD)、能量梯度算法、 拉普拉斯算法等清晰度计算方法训练清晰度评分模型,以拉普拉斯算法为例,通 过拉普拉斯算子与人脸图像中的像素点进行卷积,分别提取人脸图像水平和垂直 方向的梯度值,当人脸图像中较暗区域出现一个亮点时,通过拉普拉斯算子可使 连点变得更亮,通过计算出的亮点数及亮点区域大小对清晰度进行评分,获取清 晰度评分模型的评分结果。其中,拉普拉斯算子可表示如下。During sharpness scoring, the sharpness scoring model can be trained by conventional sharpness calculation methods such as grayscale variance algorithm (SMD), energy gradient algorithm, and Laplace algorithm. The Laplace operator is convolved with the pixels in the face image, and the gradient values in the horizontal and vertical directions of the face image are extracted respectively. When a bright spot appears in the darker area of the face image, the Laplacian operator is used. The connected points can be made brighter, and the sharpness is scored by the calculated number of bright spots and the size of the bright spot area, and the scoring result of the sharpness scoring model is obtained. Among them, the Laplacian can be expressed as follows.

00 11 00 11 -4-4 11 00 11 0 0

在进行角度评分时,可构建训练样本集,样本集中分别包含对应人脸的正面 图像和侧面图像,通过BP神经网络等常规的神经网络算法,以正面图像和侧面 图像角度的偏差构建误差函数,进行模型训练,获取角度评分模型,误差函数值 越小,角度评分越高。When performing angle scoring, a training sample set can be constructed. The sample set contains the frontal image and side image of the corresponding face, respectively. Through conventional neural network algorithms such as BP neural network, an error function is constructed based on the deviation of the angle of the frontal image and the side image. Perform model training to obtain an angle score model. The smaller the error function value, the higher the angle score.

在进行亮度评分时,可通过灰度直方图法将人脸图像中所有像素按照灰度大 小统计其出现的频率,可设置灰度范围为80-200,统计这一灰度级范围内的像素 出现的频率,并根据统计频率对人脸图像亮度进行打分,频率越高,亮度评分则 越高。When scoring brightness, the frequency of occurrence of all pixels in the face image can be counted according to the gray scale by the gray histogram method. The gray scale range can be set to 80-200, and the pixels within this gray level range can be counted The frequency of occurrence, and the brightness of the face image is scored according to the statistical frequency. The higher the frequency, the higher the brightness score.

得到各人脸质量评估模型后,可预先只通过人脸总分质量评估模型对视频流 中人脸进行评分,得到人脸总分。After each face quality assessment model is obtained, the face in the video stream can be scored only through the face total score quality assessment model in advance, and the total face score can be obtained.

在一实施例中,可设置人脸总分阈值范围,具体地,可通过图像质量参数评 估人脸总分阈值范围的上/下界。其中图像质量参数可包括图像亮度值、图像灰 度值、图像清晰度值等。图像质量参数可分别采用对应的识别算法如灰度均值归 一化方法等得到。可预先获取图像质量参数的预设范围,当人脸总分小于预设范 围的下界时,则判定人脸图像质量差,将预设范围的下界作为人脸总分阈值范围 的下界;当人脸总分大于预设范围上界时,则判定人脸图像质量好,并将预设范 围上界作为人脸总分阈值范围的上界。在另一实施例中,也可预先通过各人脸质 量评估模型统计样本图像的综合分数,具体的,可设置各人脸质量评估模型的权 重,采用加权平均获取各人脸质量评估模型的综合评分。并设置综合分数的取值 范围,以区分质量好的图像和质量差的图像,当样本图像人脸总分小于综合分数的下界时,图像质量差,直接将综合分数的下界作为人脸总分阈值范围的下界; 当样本图像人脸总分大于综合分数的上界时,图像质量好,直接将综合分数的上 界作为人脸总分阈值范围的上界。In one embodiment, the threshold range of the total face score can be set, and specifically, the upper/lower bounds of the threshold range of the total face score can be evaluated through the image quality parameter. The image quality parameters may include image brightness value, image gray value, image sharpness value, and the like. Image quality parameters can be obtained by using corresponding identification algorithms such as gray mean normalization method. The preset range of image quality parameters can be obtained in advance. When the total face score is less than the lower bound of the preset range, it is determined that the quality of the face image is poor, and the lower bound of the preset range is used as the lower bound of the threshold range of the total face score; When the total face score is greater than the upper bound of the preset range, it is determined that the quality of the face image is good, and the upper bound of the preset range is taken as the upper bound of the threshold range of the total score of the face. In another embodiment, the comprehensive scores of the sample images can also be counted through each face quality assessment model in advance. Specifically, the weight of each face quality assessment model can be set, and the comprehensive score of each face quality assessment model can be obtained by using a weighted average. score. And set the value range of the comprehensive score to distinguish images of good quality and poor quality. When the total score of the sample image is less than the lower bound of the comprehensive score, the image quality is poor, and the lower bound of the comprehensive score is directly used as the total score of the face. The lower bound of the threshold range; when the total face score of the sample image is greater than the upper bound of the comprehensive score, the image quality is good, and the upper bound of the comprehensive score is directly used as the upper bound of the threshold range of the total score of the face.

具体的阈值范围取值及确定方法可根据实际应用场景进行灵活选择。The specific threshold range value and determination method can be flexibly selected according to the actual application scenario.

在一实施例中,在实际应用中,当人脸总分大于阈值范围的上界时,可将人 脸总分加上一预设的常数,计算各人脸质量评估模型的综合分数与加上预设常数 后的人脸总分之间的误差,若误差小于该预设常数的置信度为95%,则将人脸总 分与预设常数之和作为阈值范围的上界,更新人脸总分的阈值范围上界。In one embodiment, in practical applications, when the total face score is greater than the upper bound of the threshold range, a preset constant can be added to the total face score to calculate the comprehensive score of each face quality assessment model and add The error between the total score of the face after the preset constant is set. If the confidence level of the error is less than the preset constant is 95%, the sum of the total score of the face and the preset constant is used as the upper bound of the threshold range, and the human face is updated. The upper bound of the threshold range for the total face score.

在一实施例中,当待评估的人脸图像的人脸总分超出设定的阈值范围时,可 将人脸总分作为人脸质量评估结果,筛除低于阈值范围下界的人脸图像或选出高 于阈值范围上界的优质人脸图像。In one embodiment, when the total face score of the face image to be evaluated exceeds the set threshold range, the total face score can be used as the face quality evaluation result, and the face images below the lower bound of the threshold range are filtered out. Or select high-quality face images above the upper bound of the threshold range.

当待评估的人脸图像的人脸总分在阈值范围内时,将可将各人脸质量评估模 型的分数进行加权平均得到的结果作为待评估人脸图像的质量评估结果。When the total face score of the face image to be evaluated is within the threshold range, the result obtained by the weighted average of the scores of each face quality evaluation model is used as the quality evaluation result of the face image to be evaluated.

在一实施例中,在对抓拍的视频流进行人脸质量评估时,可根据人脸ID追 踪连续多帧图像中同一人的人脸。按照确定的帧间隔数,从同一人的多帧人脸中 确定待评估的多个目标帧图像。仅对按照确定帧间隔获取的多帧人脸图像进行人 脸质量评估,以提高人脸质量评估速度。In one embodiment, when the face quality assessment is performed on the captured video stream, the face of the same person in consecutive multiple frames of images can be tracked according to the face ID. According to the determined number of frame intervals, multiple target frame images to be evaluated are determined from multiple frames of faces of the same person. The face quality assessment is only performed on the multi-frame face images obtained according to the determined frame interval, so as to improve the face quality assessment speed.

在一实施例中,帧间隔的确定可包括以下步骤:In one embodiment, the determination of the frame interval may include the following steps:

设置初始帧间隔数,并根据所述初始帧间隔数获取同一目标对象的间隔帧; 获取所述间隔帧中同一目标对象的人脸图像质量分误差;判断所述质量分误差是 否在设置的允许范围内;Set the initial frame interval number, and obtain the interval frame of the same target object according to the initial frame interval number; Obtain the face image quality error of the same target object in the interval frame; Determine whether the quality error is within the allowable setting of the setting within the range;

若超出所述允许范围,则调整所述初始帧间隔数,直至所述质量分误差在所 述允许范围内。具体地,可设同一人的连续帧图像为7帧,初始帧间隔为2,即 每隔两帧获取同一人的人脸帧图像按前述步骤进行人脸质量评估。计算得到的第 一帧、第四帧及第七帧图像的质量分之间的误差,设误差允许范围为[-0.1,0.1], 则统计置信度为95%的情况下,3帧图像的质量分的误差是否落在允许范围内, 若在允许范围内,则可按照初始帧间隔获取同一人的间隔帧图像进行质量评分; 若超出所述允许范围,则缩小帧间隔,重新计算误差,直到误差落入允许范围内。If it exceeds the allowable range, adjust the initial frame interval number until the quality score error is within the allowable range. Specifically, it can be set that the continuous frame images of the same person are 7 frames, and the initial frame interval is 2, that is, the face frame images of the same person are obtained every two frames and the face quality assessment is performed according to the aforementioned steps. The calculated error between the quality scores of the first frame, the fourth frame and the seventh frame image, if the allowable error range is set to [-0.1, 0.1], then when the statistical confidence is 95%, the Whether the error of the quality score falls within the allowable range, if it is within the allowable range, the interval frame images of the same person can be obtained according to the initial frame interval for quality scoring; if it exceeds the allowable range, reduce the frame interval and recalculate the error, until the error falls within the allowable range.

请参阅图2,本实施例提供了一种人脸图像质量评估系统,用于执行前述方 法实施例中所述的人脸图像质量评估方法。由于系统实施例的技术原理与前述方 法实施例的技术原理相似,因而不再对同样的技术细节做重复性赘述。Referring to Fig. 2, this embodiment provides a system for evaluating the quality of a human face image, which is used to perform the method for evaluating the quality of a human face image described in the foregoing method embodiments. Since the technical principles of the system embodiments are similar to the technical principles of the foregoing method embodiments, the same technical details will not be repeated.

在一实施例中,一种人脸图像质量评估系统,包括:质量评估模块,用于人 脸图像对应的人脸总分在预设的阈值范围内时,根据获得的各人脸质量评估模型 得到的分数,输出人脸图像质量评估结果。In one embodiment, a face image quality assessment system includes: a quality assessment module configured to assess the quality of each face according to the obtained face quality assessment model when the total face score corresponding to the face image is within a preset threshold range. The obtained score, output the face image quality evaluation result.

可选地,人脸图像对应的人脸总分超出所述预设的阈值范围时,根据所述人 脸总分输出人脸图像质量评估结果。Optionally, when the face total score corresponding to the face image exceeds the preset threshold range, output the face image quality assessment result according to the face total score.

可选地,包括总分评估模块,用于预先根据人脸总分质量评估模型获取所述 人脸图像对应的人脸总分。Optionally, a total score evaluation module is included, which is used to obtain the total face score corresponding to the face image according to the total score quality evaluation model of the human face in advance.

可选地,所述人脸总分质量评估模型对预先标注的人脸图像特征区域进行识 别,输出人脸总分。Optionally, the face total score quality assessment model identifies the pre-marked face image feature regions, and outputs the face total score.

可选地,包括间隔评估模块,用于对于同一目标对象的多帧图像,按照确定 的帧间隔数,确定待评估目标帧;Optionally, include interval evaluation module, for the multi-frame image of same target object, according to the frame interval number determined, determine the target frame to be evaluated;

通过所述人脸质量评估模型,对所述待评估目标帧包含的所述目标对象的人 脸图像进行质量评估。Through the face quality assessment model, quality assessment is performed on the face image of the target object contained in the target frame to be assessed.

可选地,确定帧间隔数的过程为:Optionally, the process of determining the number of frame intervals is:

设置初始帧间隔数,并根据所述初始帧间隔数获取同一目标对象的间隔帧; 获取所述间隔帧中同一目标对象的人脸图像质量分误差;判断所述质量分误差是 否在设置的允许范围内;Set the initial frame interval number, and obtain the interval frame of the same target object according to the initial frame interval number; Obtain the face image quality error of the same target object in the interval frame; Determine whether the quality error is within the allowable setting of the setting within the range;

若超出所述允许范围,则调整所述初始帧间隔数,直至所述质量分误差在所 述允许范围内。If it exceeds the allowable range, adjust the initial frame interval number until the quality score error is within the allowable range.

可选地,所述人脸质量评估模型至少包括:Optionally, the face quality assessment model includes at least:

人脸总分质量评估模型、人脸关键点质量评估模型、人脸清晰度质量评估模 型、人脸角度质量评估模型、人脸亮度质量评估模型。Face total score quality assessment model, face key point quality assessment model, face definition quality assessment model, face angle quality assessment model, face brightness quality assessment model.

可选地,所述预设的阈值范围的确定过程为:Optionally, the process of determining the preset threshold range is:

根据图像质量参数预设范围确定所述阈值范围:The threshold range is determined according to the preset range of image quality parameters:

若所述人脸总分小于所述预设范围的下界,则将所述人脸总分作为所述阈值 范围的下界;If the total score of the human face is less than the lower bound of the preset range, then the total score of the human face is used as the lower bound of the threshold range;

若所述人脸总分大于所述预设范围的上界,则将所述人脸总分作为所述阈值 范围的上界。If the total score of the human face is greater than the upper bound of the preset range, the total score of the human face is used as the upper bound of the threshold range.

可选地,所述图像质量参数包括以下至少之一:图像亮度值、图像灰度值、 图像清晰度值。Optionally, the image quality parameter includes at least one of the following: an image brightness value, an image gray value, and an image sharpness value.

可选地,包括阈值更新模块,用于当所述人脸总分大于所述阈值范围的上界 时,获取所述人脸总分加上预设常数后与所有人脸质量评估模型综合分数的误差, 判断所述误差是否小于所述预设常数,若是,则将所述人脸总分加上所述预设常 数用于更新所述阈值范围的上界。Optionally, a threshold update module is included, for when the total score of the human face is greater than the upper bound of the threshold range, the total score of the human face is obtained after adding a preset constant and the comprehensive score of all face quality evaluation models. The error is determined, whether the error is smaller than the preset constant, and if so, the total face score plus the preset constant is used to update the upper bound of the threshold range.

可选地,包括综合评分模块,用于将各人脸质量评估模型的分数进行加权处 理,获取所述综合分数。Optionally, a comprehensive scoring module is included to perform weighting processing on the scores of each face quality assessment model to obtain the comprehensive score.

本申请实施例还提供了一种设备,该设备可以包括:一个或多个处理器;和 其上存储有指令的一个或多个机器可读介质,当由所述一个或多个处理器执行时, 使得所述设备执行图1所述的方法。在实际应用中,该设备可以作为终端设备, 也可以作为服务器,终端设备的例子可以包括:智能手机、平板电脑、电子书阅 读器、MP3(动态影像专家压缩标准语音层面3,Moving Picture Experts Group Audio Layer III)播放器、MP4(动态影像专家压缩标准语音层面4,Moving Picture Experts Group Audio Layer IV)播放器、膝上型便携计算机、车载电脑、台式计算 机、机顶盒、智能电视机、可穿戴设备等等,本申请实施例对于具体的设备不加 以限制。Embodiments of the present application also provide a device, which may include: one or more processors; and one or more machine-readable media on which instructions are stored, when executed by the one or more processors At the time, the device is caused to execute the method described in FIG. 1 . In practical applications, the device can be used as a terminal device or a server. Examples of terminal devices can include: smart phones, tablet computers, e-book readers, MP3 (Motion Picture Experts Compression Standard Voice Layer 3, Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop computers, car computers, desktop computers, set-top boxes, smart TVs, wearable devices Etc., the embodiments of the present application do not limit specific devices.

本申请实施例还提供了一种非易失性可读存储介质,该存储介质中存储有一 个或多个模块(programs),该一个或多个模块被应用在设备时,可以使得该设备 执行本申请实施例的图1中人脸图像质量评估方法所包含步骤的指令 (instructions)。Embodiments of the present application further provide a non-volatile readable storage medium, where one or more modules (programs) are stored in the storage medium, and when the one or more modules are applied to a device, the device can be executed by the device. Instructions for steps included in the method for evaluating the quality of a face image in FIG. 1 according to the embodiment of the present application.

图3为本申请一实施例提供的终端设备的硬件结构示意图。如图所示,该终 端设备可以包括:输入设备1100、第一处理器1101、输出设备1102、第一存储 器1103和至少一个通信总线1104。通信总线1104用于实现元件之间的通信连 接。第一存储器1103可能包含高速RAM存储器,也可能还包括非易失性存储 NVM,例如至少一个磁盘存储器,第一存储器1103中可以存储各种程序,用于 完成各种处理功能以及实现本实施例的方法步骤。FIG. 3 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present application. As shown, the terminal device may include: an input device 1100, a first processor 1101, an output device 1102, a first memory 1103, and at least one communication bus 1104. A communication bus 1104 is used to enable communication connections between elements. The first memory 1103 may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and various programs may be stored in the first memory 1103 for completing various processing functions and implementing this embodiment. method steps.

可选的,上述第一处理器1101例如可以为中央处理器(Central ProcessingUnit, 简称CPU)、应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设 备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制 器、微处理器或其他电子元件实现,该处理器1101通过有线或无线连接耦合到 上述输入设备1100和输出设备1102。Optionally, the first processor 1101 may be, for example, a central processing unit (Central Processing Unit, CPU for short), an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable A logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation, the processor 1101 is coupled to the aforementioned input device 1100 and output device 1102 through wired or wireless connections .

可选的,上述输入设备1100可以包括多种输入设备,例如可以包括面向用 户的用户接口、面向设备的设备接口、软件的可编程接口、摄像头、传感器中至 少一种。可选的,该面向设备的设备接口可以是用于设备与设备之间进行数据传 输的有线接口、还可以是用于设备与设备之间进行数据传输的硬件插入接口(例 如USB接口、串口等);可选的,该面向用户的用户接口例如可以是面向用户的 控制按键、用于接收语音输入的语音输入设备以及用户接收用户触摸输入的触摸 感知设备(例如具有触摸感应功能的触摸屏、触控板等);可选的,上述软件的可 编程接口例如可以是供用户编辑或者修改程序的入口,例如芯片的输入引脚接口 或者输入接口等;输出设备1102可以包括显示器、音响等输出设备。Optionally, the above-mentioned input device 1100 may include a variety of input devices, for example, may include at least one of a user-oriented user interface, a device-oriented device interface, a software programmable interface, a camera, and a sensor. Optionally, the device-oriented device interface may be a wired interface for data transmission between devices, or a hardware plug-in interface (such as a USB interface, serial port, etc.) for data transmission between devices. ); optionally, the user-oriented user interface may be, for example, a user-oriented control button, a voice input device for receiving voice input, and a touch-sensing device (such as a touch screen with a touch-sensing function, a touch-sensitive device for receiving user touch input) Control panel, etc.); Optionally, the programmable interface of the above-mentioned software can be, for example, an entry for users to edit or modify programs, such as an input pin interface or an input interface of a chip, etc.; the output device 1102 can include output devices such as a display and audio .

在本实施例中,该终端设备的处理器包括用于执行各设备中语音识别装置各 模块的功能,具体功能和技术效果参照上述实施例即可,此处不再赘述。In this embodiment, the processor of the terminal device includes functions for executing each module of the speech recognition device in each device, and the specific functions and technical effects may refer to the above-mentioned embodiments, which will not be repeated here.

图4为本申请的另一个实施例提供的终端设备的硬件结构示意图。图4是对 图3在实现过程中的一个具体的实施例。如图所示,本实施例的终端设备可以包 括第二处理器1201以及第二存储器1202。FIG. 4 is a schematic diagram of a hardware structure of a terminal device according to another embodiment of the present application. Fig. 4 is a specific embodiment of Fig. 3 in the implementation process. As shown in the figure, the terminal device in this embodiment may include a second processor 1201 and a second memory 1202.

第二处理器1201执行第二存储器1202所存放的计算机程序代码,实现上述 实施例中图1所述方法。The second processor 1201 executes the computer program code stored in the second memory 1202 to implement the method described in FIG. 1 in the above embodiment.

第二存储器1202被配置为存储各种类型的数据以支持在终端设备的操作。 这些数据的示例包括用于在终端设备上操作的任何应用程序或方法的指令,例如 消息,图片,视频等。第二存储器1202可能包含随机存取存储器(random access memory,简称RAM),也可能还包括非易失性存储器(non-volatile memory),例 如至少一个磁盘存储器。The second memory 1202 is configured to store various types of data to support operations at the terminal device. Examples of such data include instructions for any application or method operating on the end device, such as messages, pictures, videos, etc. The second memory 1202 may include random access memory (random access memory, RAM for short), and may also include non-volatile memory (non-volatile memory), such as at least one disk storage.

可选地,第一处理器1201设置在处理组件1200中。该终端设备还可以包括: 通信组件1203,电源组件1204,多媒体组件1205,语音组件1206,输入/输出 接口1207和/或传感器组件1208。终端设备具体所包含的组件等依据实际需求设 定,本实施例对此不作限定。Optionally, the first processor 1201 is provided in the processing component 1200 . The terminal device may further include: a communication component 1203, a power supply component 1204, a multimedia component 1205, a voice component 1206, an input/output interface 1207 and/or a sensor component 1208. Components and the like specifically included in the terminal device are set according to actual requirements, which are not limited in this embodiment.

处理组件1200通常控制终端设备的整体操作。处理组件1200可以包括一个 或多个第二处理器1201来执行指令,以完成上述图1所示方法的全部或部分步 骤。此外,处理组件1200可以包括一个或多个模块,便于处理组件1200和其他 组件之间的交互。例如,处理组件1200可以包括多媒体模块,以方便多媒体组 件1205和处理组件1200之间的交互。The processing component 1200 generally controls the overall operation of the terminal device. The processing component 1200 may include one or more second processors 1201 to execute instructions to perform all or some of the steps of the method shown in FIG. 1 above. Additionally, processing component 1200 may include one or more modules that facilitate interaction between processing component 1200 and other components. For example, processing component 1200 may include a multimedia module to facilitate interaction between multimedia component 1205 and processing component 1200.

电源组件1204为终端设备的各种组件提供电力。电源组件1204可以包括电 源管理系统,一个或多个电源,及其他与为终端设备生成、管理和分配电力相关 联的组件。Power component 1204 provides power to various components of the terminal device. Power components 1204 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to end devices.

多媒体组件1205包括在终端设备和用户之间的提供一个输出接口的显示屏。 在一些实施例中,显示屏可以包括液晶显示器(LCD)和触摸面板(TP)。如果显示 屏包括触摸面板,显示屏可以被实现为触摸屏,以接收来自用户的输入信号。触 摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述 触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动 操作相关的持续时间和压力。The multimedia component 1205 includes a display screen that provides an output interface between the terminal device and the user. In some embodiments, the display screen may include a liquid crystal display (LCD) and a touch panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action.

语音组件1206被配置为输出和/或输入语音信号。例如,语音组件1206包 括一个麦克风(MIC),当终端设备处于操作模式,如语音识别模式时,麦克风被 配置为接收外部语音信号。所接收的语音信号可以被进一步存储在第二存储器 1202或经由通信组件1203发送。在一些实施例中,语音组件1206还包括一个 扬声器,用于输出语音信号。Speech component 1206 is configured to output and/or input speech signals. For example, the speech component 1206 includes a microphone (MIC) that is configured to receive external speech signals when the terminal device is in an operational mode, such as a speech recognition mode. The received speech signal may be further stored in the second memory 1202 or transmitted via the communication component 1203. In some embodiments, the speech component 1206 also includes a speaker for outputting speech signals.

输入/输出接口1207为处理组件1200和外围接口模块之间提供接口,上述 外围接口模块可以是点击轮,按钮等。这些按钮可包括但不限于:音量按钮、启 动按钮和锁定按钮。The input/output interface 1207 provides an interface between the processing component 1200 and a peripheral interface module, which may be a click wheel, a button, or the like. These buttons may include, but are not limited to: volume buttons, start button, and lock button.

传感器组件1208包括一个或多个传感器,用于为终端设备提供各个方面的 状态评估。例如,传感器组件1208可以检测到终端设备的打开/关闭状态,组件 的相对定位,用户与终端设备接触的存在或不存在。传感器组件1208可以包括 接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在,包括检 测用户与终端设备间的距离。在一些实施例中,该传感器组件1208还可以包括 摄像头等。Sensor assembly 1208 includes one or more sensors for providing various aspects of the status assessment for the end device. For example, the sensor assembly 1208 can detect the open/closed state of the end device, the relative positioning of the assembly, the presence or absence of user contact with the end device. The sensor assembly 1208 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact, including detecting the distance between the user and the end device. In some embodiments, the sensor assembly 1208 may also include a camera or the like.

通信组件1203被配置为便于终端设备和其他设备之间有线或无线方式的通 信。终端设备可以接入基于通信标准的无线网络,如WiFi,2G或3G,或它们 的组合。在一个实施例中,该终端设备中可以包括SIM卡插槽,该SIM卡插槽 用于插入SIM卡,使得终端设备可以登录GPRS网络,通过互联网与服务器建 立通信。Communication component 1203 is configured to facilitate wired or wireless communications between end devices and other devices. Terminal devices can access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In one embodiment, the terminal device may include a SIM card slot, and the SIM card slot is used for inserting a SIM card, so that the terminal device can log in to the GPRS network and establish communication with the server through the Internet.

由上可知,在图4实施例中所涉及的通信组件1203、语音组件1206以及输 入/输出接口1207、传感器组件1208均可以作为图3实施例中的输入设备的实现 方式。As can be seen from the above, the communication component 1203, the voice component 1206, the input/output interface 1207, and the sensor component 1208 involved in the embodiment of Fig. 4 can all be implemented as the input device in the embodiment of Fig. 3 .

综上所述,本发明一种人脸图像质量评估方法、系统、设备和介质,在超出 人脸总分阈值范围时,选择人脸总分作为影响因子,简化评分过程的同时,提高 评分效率;通过各人脸质量评分模型调整人脸总分阈值并通过误差估计人脸总分 阈值,可保障较优的图像具有较高的质量分数的同时,保证得到的质量分数在可 接受的误差范围内;通过设置帧间隔减少参与质量评估的图像数据,可极大减少 人脸质量评估耗时。所以,本发明有效克服了现有技术中的种种缺点而具高度产 业利用价值。To sum up, the present invention provides a method, system, device and medium for evaluating the quality of a face image. When the total face score threshold is exceeded, the total face score is selected as an influencing factor, which simplifies the scoring process and improves the scoring efficiency. ;Adjusting the total face score threshold through each face quality scoring model and estimating the total face score threshold through the error can ensure that the better image has a higher quality score and the obtained quality score is within the acceptable error range. Within; by setting the frame interval to reduce the image data involved in the quality assessment, the time-consuming face quality assessment can be greatly reduced. Therefore, the present invention effectively overcomes various shortcomings in the prior art and has high industrial application value.

上述实施例仅例示性说明本发明的原理及其功效,而非用于限制本发明。任 何熟悉此技术的人士皆可在不违背本发明的精神及范畴下,对上述实施例进行修 饰或改变。因此,举凡所属技术领域中具有通常知识者在未脱离本发明所揭示的 精神与技术思想下所完成的一切等效修饰或改变,仍应由本发明的权利要求所涵 盖。The above-mentioned embodiments merely illustrate the principles and effects of the present invention, but are not intended to limit the present invention. Any person skilled in the art can modify or change the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by those with ordinary knowledge in the technical field without departing from the spirit and technical idea disclosed in the present invention should still be covered by the claims of the present invention.

Claims (24)

1. A method for evaluating the quality of a face image is characterized by comprising the following steps:
and when the total face score corresponding to the face image is within a preset threshold range, outputting a face image quality evaluation result according to the score obtained by each obtained face quality evaluation model.
2. The face image quality evaluation method according to claim 1,
and when the total face score corresponding to the face image exceeds the preset threshold range, outputting a face image quality evaluation result according to the total face score.
3. The method for evaluating the quality of a face image according to claim 1, characterized in that the face total score corresponding to the face image is obtained in advance according to a face total score quality evaluation model.
4. The method for evaluating the quality of the face image according to claim 3, wherein the face total score quality evaluation model identifies a pre-labeled face image characteristic region and outputs a face total score.
5. The face image quality evaluation method according to claim 1,
determining a target frame to be evaluated according to the determined frame interval number for the multi-frame images of the same target object;
and performing quality evaluation on the face image of the target object contained in the target frame to be evaluated through the face quality evaluation model.
6. The method for evaluating the quality of a face image according to claim 5, wherein the process of determining the number of frame intervals is:
setting an initial frame interval number, and acquiring interval frames of the same target object according to the initial frame interval number; acquiring the quality difference error of the face image of the same target object in the interval frame; judging whether the mass component error is within a set allowable range;
and if the quality score exceeds the allowable range, adjusting the initial frame interval number until the quality score error is within the allowable range.
7. The method according to claim 1, wherein the face image quality evaluation model at least comprises:
the system comprises a face total score quality evaluation model, a face key point quality evaluation model, a face definition quality evaluation model, a face angle quality evaluation model and a face brightness quality evaluation model.
8. The face image quality evaluation method according to claim 7,
determining the threshold range according to the preset range of the image quality parameters:
if the total face score is smaller than the lower bound of the preset range, taking the total face score as the lower bound of the threshold range;
and if the total face score is larger than the upper bound of the preset range, taking the total face score as the upper bound of the threshold range.
9. The method according to claim 8, wherein the image quality parameter comprises at least one of: image brightness value, image gray scale value and image definition value.
10. The method according to claim 8, wherein when the total score of the face is greater than the upper bound of the threshold range, an error between the total score of the face plus a preset constant and the comprehensive scores of all face quality evaluation models is obtained, whether the error is smaller than the preset constant is judged, and if yes, the total score of the face plus the preset constant is used for updating the upper bound of the threshold range.
11. The method according to claim 10, wherein the scores of the face quality evaluation models are weighted to obtain the composite score.
12. A face image quality evaluation system, comprising:
and the quality evaluation module is used for outputting the quality evaluation result of the face image according to the obtained scores obtained by the face quality evaluation models when the total face score corresponding to the face image is within the preset threshold range.
13. The facial image quality evaluation system according to claim 12,
and when the total face score corresponding to the face image exceeds the preset threshold range, outputting a face image quality evaluation result according to the total face score.
14. The system for evaluating the quality of a human face image according to claim 12, comprising a total score evaluation module for obtaining a total score of a human face corresponding to the human face image in advance according to a total score quality evaluation model of the human face.
15. The system for evaluating the quality of a facial image according to claim 14, wherein the model for evaluating the quality of the total score of a facial image identifies a characteristic region of a facial image labeled in advance and outputs the total score of the facial image.
16. The facial image quality evaluation system of claim 12, characterized by comprising an interval evaluation module for determining a target frame to be evaluated according to the determined frame interval number for a plurality of frames of images of the same target object;
and performing quality evaluation on the face image of the target object contained in the target frame to be evaluated through the face quality evaluation model.
17. The system for evaluating the quality of a human face image according to claim 16, wherein the process of determining the number of frame intervals is:
setting an initial frame interval number, and acquiring interval frames of the same target object according to the initial frame interval number; acquiring the quality difference error of the face image of the same target object in the interval frame; judging whether the mass component error is within a set allowable range;
and if the quality score exceeds the allowable range, adjusting the initial frame interval number until the quality score error is within the allowable range.
18. The facial image quality evaluation system according to claim 12, wherein said facial quality evaluation model comprises at least:
the system comprises a face total score quality evaluation model, a face key point quality evaluation model, a face definition quality evaluation model, a face angle quality evaluation model and a face brightness quality evaluation model.
19. The system for evaluating the quality of a human face image according to claim 18, wherein the predetermined threshold range is determined by:
determining the threshold range according to the preset range of the image quality parameters:
if the total face score is smaller than the lower bound of the preset range, taking the total face score as the lower bound of the threshold range;
and if the total face score is larger than the upper bound of the preset range, taking the total face score as the upper bound of the threshold range.
20. The facial image quality evaluation system according to claim 19, wherein said image quality parameters comprise at least one of: image brightness value, image gray scale value and image definition value.
21. The system according to claim 19, comprising a threshold updating module, configured to, when the total score of the face is greater than the upper bound of the threshold range, obtain an error between the total score of the face and a combined score of all face quality evaluation models after adding a preset constant, determine whether the error is smaller than the preset constant, and if so, add the preset constant to the total score of the face to update the upper bound of the threshold range.
22. The system according to claim 21, comprising a comprehensive scoring module configured to perform weighting processing on the scores of the respective face quality evaluation models to obtain the comprehensive scores.
23. An apparatus, comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method recited by one or more of claims 1-11.
24. One or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause an apparatus to perform the method recited by one or more of claims 1-11.
CN202010554425.2A 2020-06-17 2020-06-17 Method, system, equipment and medium for evaluating quality of face image Pending CN111814840A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010554425.2A CN111814840A (en) 2020-06-17 2020-06-17 Method, system, equipment and medium for evaluating quality of face image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010554425.2A CN111814840A (en) 2020-06-17 2020-06-17 Method, system, equipment and medium for evaluating quality of face image

Publications (1)

Publication Number Publication Date
CN111814840A true CN111814840A (en) 2020-10-23

Family

ID=72844731

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010554425.2A Pending CN111814840A (en) 2020-06-17 2020-06-17 Method, system, equipment and medium for evaluating quality of face image

Country Status (1)

Country Link
CN (1) CN111814840A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113822171A (en) * 2021-08-31 2021-12-21 苏州中科先进技术研究院有限公司 A pet face value scoring method, device, storage medium and equipment
CN116432152A (en) * 2023-04-18 2023-07-14 山东广电信通网络运营有限公司 A cross-platform collaborative production system

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140254680A1 (en) * 2013-03-11 2014-09-11 Mediatek Inc. Video coding method using at least evaluated visual quality and related video coding apparatus
US20190172494A1 (en) * 2013-05-28 2019-06-06 Apple Inc. Reference and non-reference video quality evaluation
CN110097001A (en) * 2019-04-30 2019-08-06 恒睿(重庆)人工智能技术研究院有限公司 Generate method, system, equipment and the storage medium of best plurality of human faces image
CN110751043A (en) * 2019-09-19 2020-02-04 平安科技(深圳)有限公司 Face recognition method and device based on face visibility and storage medium
CN110837750A (en) * 2018-08-15 2020-02-25 华为技术有限公司 Human face quality evaluation method and device
CN110874547A (en) * 2018-08-30 2020-03-10 富士通株式会社 Method and device for identifying object from video
CN110996169A (en) * 2019-07-12 2020-04-10 北京达佳互联信息技术有限公司 Method, device, electronic equipment and computer-readable storage medium for clipping video
CN111241927A (en) * 2019-12-30 2020-06-05 新大陆数字技术股份有限公司 Cascading type face image optimization method, system and equipment and readable storage medium
CN111241925A (en) * 2019-12-30 2020-06-05 新大陆数字技术股份有限公司 Face quality evaluation method, system, electronic equipment and readable storage medium
CN111275683A (en) * 2020-01-20 2020-06-12 上海云从汇临人工智能科技有限公司 Image quality grading processing method, system, device and medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140254680A1 (en) * 2013-03-11 2014-09-11 Mediatek Inc. Video coding method using at least evaluated visual quality and related video coding apparatus
US20190172494A1 (en) * 2013-05-28 2019-06-06 Apple Inc. Reference and non-reference video quality evaluation
CN110837750A (en) * 2018-08-15 2020-02-25 华为技术有限公司 Human face quality evaluation method and device
CN110874547A (en) * 2018-08-30 2020-03-10 富士通株式会社 Method and device for identifying object from video
CN110097001A (en) * 2019-04-30 2019-08-06 恒睿(重庆)人工智能技术研究院有限公司 Generate method, system, equipment and the storage medium of best plurality of human faces image
CN110996169A (en) * 2019-07-12 2020-04-10 北京达佳互联信息技术有限公司 Method, device, electronic equipment and computer-readable storage medium for clipping video
CN110751043A (en) * 2019-09-19 2020-02-04 平安科技(深圳)有限公司 Face recognition method and device based on face visibility and storage medium
CN111241927A (en) * 2019-12-30 2020-06-05 新大陆数字技术股份有限公司 Cascading type face image optimization method, system and equipment and readable storage medium
CN111241925A (en) * 2019-12-30 2020-06-05 新大陆数字技术股份有限公司 Face quality evaluation method, system, electronic equipment and readable storage medium
CN111275683A (en) * 2020-01-20 2020-06-12 上海云从汇临人工智能科技有限公司 Image quality grading processing method, system, device and medium

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
AYMAN ABAZA 等: "Quality Metrics for Practical Face Recognition", 《21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012)》 *
KAMAL NASROLLAHI 等: "Face Quality Assessment System in Video Sequences", 《BIOID 2008: BIOMETRICS AND IDENTITY MANAGEMENT》 *
尹思璐 等: "级联型多测度可见光虹膜图像质量评价方法", 《微处理机》 *
邹国锋 等: "融合二级评价指标的人脸图像质量评价方法", 《山东大学学报(工学版)》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113822171A (en) * 2021-08-31 2021-12-21 苏州中科先进技术研究院有限公司 A pet face value scoring method, device, storage medium and equipment
CN116432152A (en) * 2023-04-18 2023-07-14 山东广电信通网络运营有限公司 A cross-platform collaborative production system

Similar Documents

Publication Publication Date Title
US20210382542A1 (en) Screen wakeup method and apparatus
CN111814620B (en) Face image quality evaluation model establishment method, optimization method, medium and device
CN104049760B (en) The acquisition methods and system of a kind of man-machine interaction order
CN108711161A (en) Image segmentation method, image segmentation device and electronic equipment
CN108205685A (en) Video classification methods, visual classification device and electronic equipment
CN113076903A (en) Target behavior detection method and system, computer equipment and machine readable medium
CN110347876A (en) Video classification method, apparatus, terminal device, and computer-readable storage medium
CN111402177A (en) Definition detection method, system, device and medium
CN112580472A (en) Rapid and lightweight face recognition method and device, machine readable medium and equipment
CN111814840A (en) Method, system, equipment and medium for evaluating quality of face image
CN112131957A (en) Document type picture identification method, device and storage medium
CN112333385B (en) Electronic anti-shake control method and device
WO2021087746A1 (en) Push content processing method and apparatus, and electronic device and storage medium
CN111401242B (en) Credential detection method, apparatus, electronic device and storage medium
CN108763491B (en) Picture processing method and device and terminal equipment
CN115937933A (en) Expression driving method, device, equipment and storage medium
CN114943872A (en) Training method and device of target detection model, target detection method and device, medium and equipment
CN114283479A (en) Age segmentation attribute prediction method, device, medium and equipment
CN112257561B (en) Human face living body detection method and device, machine readable medium and equipment
CN114581951A (en) Gesture recognition method, system, device and medium
CN118470690A (en) Driver attention analysis method, device and medium using eye tracking technique
CN114821089A (en) Target detection method, device, medium and equipment based on convolutional neural network
CN116453230A (en) Living body detection method, living body detection device, terminal equipment and storage medium
CN116684526A (en) A Smartphone Control Method Based on Eye Gaze and Facial Micro-motion
CN115660969A (en) Image processing method, model training method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20201023

RJ01 Rejection of invention patent application after publication