[go: up one dir, main page]

CN114495194B - Information comparison method, device, electronic device and storage medium - Google Patents

Information comparison method, device, electronic device and storage medium Download PDF

Info

Publication number
CN114495194B
CN114495194B CN202111549194.7A CN202111549194A CN114495194B CN 114495194 B CN114495194 B CN 114495194B CN 202111549194 A CN202111549194 A CN 202111549194A CN 114495194 B CN114495194 B CN 114495194B
Authority
CN
China
Prior art keywords
image
compared
target object
similarity
threshold
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111549194.7A
Other languages
Chinese (zh)
Other versions
CN114495194A (en
Inventor
姚佳俊
阮学武
周道利
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Dahua Technology Co Ltd
Original Assignee
Zhejiang Dahua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Dahua Technology Co Ltd filed Critical Zhejiang Dahua Technology Co Ltd
Priority to CN202111549194.7A priority Critical patent/CN114495194B/en
Publication of CN114495194A publication Critical patent/CN114495194A/en
Application granted granted Critical
Publication of CN114495194B publication Critical patent/CN114495194B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)

Abstract

本申请涉及一种信息比对方法、装置、电子装置和存储介质,其中,该信息比对方法包括:获取对目标对象进行第一信息验证过程中,采集的目标对象的待比对图像,将与待比对图像之间的相似度最大的参考图像设置为待比对图像的类比图像,在类比图像与待比对图像之间的相似度大于预设的第一阈值的情况下,获取类比图像的匹配图像集,在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,对目标对象进行第二信息验证,得到目标对象的身份信息。其实现了利用多个相似度阈值对人员信息进行过滤,从而避免了单一的相似度阈值造成的识别结果的误报或漏报,进而提高了基于人脸识别的人员信息比对的准确度。

The present application relates to an information comparison method, device, electronic device and storage medium, wherein the information comparison method comprises: obtaining a target object to be compared image collected during a first information verification process for the target object, setting a reference image with the greatest similarity to the image to be compared as an analog image of the image to be compared, obtaining a matching image set of the analog image when the similarity between the analog image and the image to be compared is greater than a preset first threshold, performing a second information verification on the target object when there are multiple reference images belonging to different objects in the matching image set and having a similarity with the image to be compared greater than the first threshold, and obtaining the identity information of the target object. It realizes filtering of personnel information using multiple similarity thresholds, thereby avoiding false positives or false negatives of recognition results caused by a single similarity threshold, thereby improving the accuracy of personnel information comparison based on face recognition.

Description

信息比对方法、装置、电子装置和存储介质Information comparison method, device, electronic device and storage medium

技术领域Technical Field

本申请涉及人脸识别领域,特别是涉及信息比对方法、装置、电子装置和存储介质。The present application relates to the field of face recognition, and in particular to an information comparison method, device, electronic device and storage medium.

背景技术Background Art

随着经济的发展和科技的进步,目前人脸识别技术已经在生产生活中得到了广泛应用。例如,在消费系统中可以借助人脸识别技术对消费者的人脸进行识别,从而获得消费者的身份信息以实现扣费操作。然而,目前基于人脸识别对人员进行身份信息比对的过程中,主要基于人脸图像的相似度进行身份识别。通过设置单一的相似度阈值,将人脸图像与人员库图像之间的相似度与该单一相似度阈值进行一次比较,在相似度大于该相似度阈值的情况下即确定该人脸图像的识别结果。该种方式产生误报或者漏报的概率较高,因此人员身份信息识别的准确度不高。With the development of economy and the advancement of science and technology, face recognition technology has been widely used in production and life. For example, in the consumption system, the face of the consumer can be identified with the help of face recognition technology, so as to obtain the identity information of the consumer to realize the deduction operation. However, in the process of comparing the identity information of personnel based on face recognition, the identity recognition is mainly based on the similarity of face images. By setting a single similarity threshold, the similarity between the face image and the image in the personnel library is compared with the single similarity threshold, and the recognition result of the face image is determined when the similarity is greater than the similarity threshold. This method has a high probability of false alarm or missed alarm, so the accuracy of personnel identity information recognition is not high.

针对相关技术中存在基于人脸识别的信息比对的准确度不高的问题,目前还没有提出有效的解决方案。With regard to the problem of low accuracy of information comparison based on face recognition in related technologies, no effective solution has been proposed so far.

发明内容Summary of the invention

在本实施例中提供了一种信息比对方法、装置、电子装置和存储介质,以解决相关技术中基于人脸识别的信息比对的准确度不高的问题。In this embodiment, an information comparison method, device, electronic device and storage medium are provided to solve the problem of low accuracy of information comparison based on face recognition in the related art.

第一个方面,在本实施例中提供了一种信息比对方法,包括:In a first aspect, an information comparison method is provided in this embodiment, including:

获取对目标对象进行第一信息验证过程中,采集的所述目标对象的待比对图像;Acquire an image to be compared of the target object collected during the process of verifying the first information of the target object;

将参考库中与所述待比对图像之间的相似度最大的参考图像,设置为所述待比对图像的类比图像,在所述类比图像与所述待比对图像之间的相似度大于预设的第一阈值的情况下,获取所述参考库中预先确定的所述类比图像的匹配图像集;其中,所述匹配图像集由所述参考库中与所述类比图像的相似度满足预设相似度条件的参考图像组成;The reference image in the reference library with the greatest similarity to the image to be compared is set as the analog image of the image to be compared, and when the similarity between the analog image and the image to be compared is greater than a preset first threshold, a matching image set of the analog image predetermined in the reference library is obtained; wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets a preset similarity condition;

在所述匹配图像集中存在多个属于不同对象,且与所述待比对图像的相似度大于所述第一阈值的参考图像的情况下,对所述目标对象进行第二信息验证,得到所述目标对象的身份信息。When there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than the first threshold, second information verification is performed on the target object to obtain identity information of the target object.

在其中一些实施例中,所述将参考库中与所述待比对图像之间的相似度最大的参考图像,设置为所述待比对图像的类比图像,包括:In some embodiments, setting the reference image in the reference library with the greatest similarity to the image to be compared as the analog image of the image to be compared includes:

根据所述待比对图像的图像特征和所述参考库中的参考图像的图像特征,得到所述待比对图像与所述参考图像之间的相似度;Obtaining the similarity between the image to be compared and the reference image according to the image features of the image to be compared and the image features of the reference images in the reference library;

将所述参考库中与所述待比对图像之间的相似度最大的参考图像设置为所述待比对图像的类比图像。The reference image in the reference library having the greatest similarity to the image to be compared is set as the analog image of the image to be compared.

在其中的一些实施例中,所述将参考库中与所述待比对图像之间的相似度最大的参考图像,设置为所述待比对图像的类比图像,还包括:In some embodiments, the step of setting the reference image in the reference library having the greatest similarity to the image to be compared as the analog image of the image to be compared further comprises:

在所述参考库中存在与所述待比对图像之间的相似度大于预设的第二阈值的参考图像的情况下,将所述参考库中与所述待比对图像之间的相似度最大的参考图像设置为所述待比对图像的类比图像;其中,所述第二阈值小于所述第一阈值。In the case where there is a reference image in the reference library whose similarity with the image to be compared is greater than a preset second threshold, the reference image in the reference library with the greatest similarity with the image to be compared is set as the analog image of the image to be compared; wherein the second threshold is smaller than the first threshold.

在其中一些实施例中,所述在所述匹配图像集中存在多个属于不同对象,且与所述待比对图像的相似度大于所述第一阈值的参考图像的情况下,对所述目标对象进行第二信息验证,得到所述目标对象的身份信息,包括:In some embodiments, when there are multiple reference images in the matching image set that belong to different objects and whose similarity to the image to be compared is greater than the first threshold, performing second information verification on the target object to obtain the identity information of the target object includes:

根据所述目标对象的身份标识,和所述匹配图像集中与所述待比对图像的相似度大于所述第一阈值的参考图像的身份标识,对所述目标对象的身份信息进行验证,得到所述目标对象的身份信息。The identity information of the target object is verified based on the identity identifier of the target object and the identity identifier of a reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold to obtain the identity information of the target object.

在其中一些实施例中,所述方法还包括:In some embodiments, the method further comprises:

在所述类比图像与所述待比对图像之间的相似度小于所述第一阈值的情况下,根据所述类比图像关联的身份信息确定所述目标对象的身份信息。When the similarity between the analog image and the image to be compared is less than the first threshold, the identity information of the target object is determined according to the identity information associated with the analog image.

在其中一些实施例中,所述方法还包括:In some embodiments, the method further comprises:

在所述匹配图像集中的所有参考图像均与所述待比对图像之间的相似度小于所述第一阈值的情况下,对所述目标对象进行所述第二信息验证。When the similarities between all reference images in the matching image set and the image to be compared are less than the first threshold, the second information verification is performed on the target object.

在其中一些实施例中,所述方法还包括:In some embodiments, the method further comprises:

在所述匹配图像集中存在唯一与所述待比对图像之间相似度大于所述第一阈值的参考图像的情况下,根据所述匹配图像集中唯一与所述待比对图像之间的相似度大于所述第一阈值的参考图像关联的身份信息,和所述类比图像关联的身份信息,确认所述目标对象的身份信息。When there is a unique reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold, the identity information of the target object is confirmed based on the identity information associated with the unique reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold, and the identity information associated with the analog image.

在其中一些实施例中,所述方法还包括:In some embodiments, the method further comprises:

在确定所述目标对象的身份信息后,将所述目标对象的身份信息输出至关联的业务系统。After determining the identity information of the target object, the identity information of the target object is output to an associated business system.

第二个方面,在本实施例中提供了一种信息比对装置,其特征在于,包括:获取模块、比对模块、以及验证模块,其中:In a second aspect, an information comparison device is provided in this embodiment, characterized in that it includes: an acquisition module, a comparison module, and a verification module, wherein:

所述获取模块,用于获取对目标对象进行第一信息验证过程中,采集的所述目标对象的待比对图像;The acquisition module is used to acquire the image to be compared of the target object collected during the process of verifying the first information of the target object;

所述比对模块,用于将参考库中与所述待比对图像之间的相似度最大的参考图像,设置为所述待比对图像的类比图像,在所述类比图像与所述待比对图像之间的相似度大于预设的第一阈值的情况下,获取所述参考库中预先确定的所述类比图像的匹配图像集;其中,所述匹配图像集由所述参考库中与所述类比图像的相似度满足预设相似度条件的参考图像组成;The comparison module is used to set the reference image with the greatest similarity to the image to be compared in the reference library as the analog image of the image to be compared, and to obtain a matching image set of the analog image predetermined in the reference library when the similarity between the analog image and the image to be compared is greater than a preset first threshold; wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets a preset similarity condition;

所述验证模块,用于在所述匹配图像集中存在多个属于不同对象,且与所述待比对图像的相似度大于所述第一阈值的参考图像的情况下,对所述目标对象进行第二信息验证,得到所述目标对象的身份信息。The verification module is used to perform second information verification on the target object to obtain the identity information of the target object when there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than the first threshold.

第三个方面,在本实施例中提供了一种电子装置,包括存储器、处理器以及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述第一个方面所述的信息比对方法。In a third aspect, an electronic device is provided in this embodiment, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the information comparison method described in the first aspect when executing the computer program.

第四个方面,在本实施例中提供了一种存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述第一个方面所述的信息比对方法。In a fourth aspect, a storage medium is provided in this embodiment, on which a computer program is stored, and when the program is executed by a processor, the information comparison method described in the first aspect is implemented.

上述信息比对方法、装置、电子装置和存储介质,获取对目标对象进行第一信息验证过程中,采集的目标对象的待比对图像,将参考库中与待比对图像之间的相似度最大的参考图像设置为待比对图像的类比图像,在类比图像与待比对图像之间的相似度大于预设的第一阈值的情况下,获取参考库中预先确定的类比图像的匹配图像集,其中,匹配图像集由参考库中与类比图像的相似度满足预设相似度条件的参考图像组成,在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,对目标对象进行第二信息验证,得到目标对象的身份信息。其实现了利用多个相似度阈值对人员信息进行过滤,从而避免了单一的相似度阈值造成的识别结果的误报或漏报,进而提高了基于人脸识别的人员信息比对的准确度。The above-mentioned information comparison method, device, electronic device and storage medium obtain the target object to be compared image collected during the first information verification process of the target object, set the reference image with the greatest similarity with the image to be compared in the reference library as the analog image of the image to be compared, and obtain the matching image set of the analog image predetermined in the reference library when the similarity between the analog image and the image to be compared is greater than a preset first threshold, wherein the matching image set is composed of reference images in the reference library whose similarity with the analog image meets the preset similarity condition, and when there are multiple reference images belonging to different objects in the matching image set and whose similarity with the image to be compared is greater than the first threshold, the target object is subjected to the second information verification to obtain the identity information of the target object. It realizes filtering of personnel information by using multiple similarity thresholds, thereby avoiding the false positive or false negative of the recognition result caused by a single similarity threshold, thereby improving the accuracy of personnel information comparison based on face recognition.

本申请的一个或多个实施例的细节在以下附图和描述中提出,以使本申请的其他特征、目的和优点更加简明易懂。Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。在附图中:The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

图1是相关技术的信息比对方法的终端的硬件结构框图;FIG1 is a hardware structure block diagram of a terminal of an information comparison method of the related art;

图2是本实施例的一种信息比对方法的流程图;FIG2 is a flow chart of an information comparison method of the present embodiment;

图3是本优选实施例的人员信息比对方法的流程图;FIG3 is a flow chart of a personnel information comparison method according to a preferred embodiment of the present invention;

图4是本实施例提供的一种人员注册流程图;FIG4 is a personnel registration flow chart provided in this embodiment;

图5是本实施例的信息比对装置的结构框图。FIG5 is a structural block diagram of the information comparison device of this embodiment.

具体实施方式DETAILED DESCRIPTION

为更清楚地理解本申请的目的、技术方案和优点,下面结合附图和实施例,对本申请进行了描述和说明。In order to more clearly understand the purpose, technical solutions and advantages of the present application, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

除另作定义外,本申请所涉及的技术术语或者科学术语应具有本申请所属技术领域具备一般技能的人所理解的一般含义。在本申请中的“一”、“一个”、“一种”、“该”、“这些”等类似的词并不表示数量上的限制,它们可以是单数或者复数。在本申请中所涉及的术语“包括”、“包含”、“具有”及其任何变体,其目的是涵盖不排他的包含;例如,包含一系列步骤或模块(单元)的过程、方法和系统、产品或设备并未限定于列出的步骤或模块(单元),而可包括未列出的步骤或模块(单元),或者可包括这些过程、方法、产品或设备固有的其他步骤或模块(单元)。在本申请中所涉及的“连接”、“相连”、“耦接”等类似的词语并不限定于物理的或机械连接,而可以包括电气连接,无论是直接连接还是间接连接。在本申请中所涉及的“多个”是指两个或两个以上。“和/或”描述关联对象的关联关系,表示可以存在三种关系,例如,“A和/或B”可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。通常情况下,字符“/”表示前后关联的对象是一种“或”的关系。在本申请中所涉及的术语“第一”、“第二”、“第三”等,只是对相似对象进行区分,并不代表针对对象的特定排序。Unless otherwise defined, the technical terms or scientific terms involved in this application shall have the general meaning understood by people with ordinary skills in the technical field to which this application belongs. The words "one", "a", "a", "the", "these" and the like in this application do not represent quantitative restrictions, and they can be singular or plural. The terms "include", "comprise", "have" and any variants thereof involved in this application are intended to cover non-exclusive inclusions; for example, a process, method and system, product or device comprising a series of steps or modules (units) is not limited to the listed steps or modules (units), but may include unlisted steps or modules (units), or may include other steps or modules (units) inherent to these processes, methods, products or devices. The words "connect", "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether directly or indirectly. The "multiple" involved in this application refers to two or more. "And/or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, "A and/or B" can mean: A exists alone, A and B exist at the same time, and B exists alone. Usually, the character "/" indicates that the objects associated with each other are in an "or" relationship. The terms "first", "second", "third", etc. involved in this application are only used to distinguish similar objects and do not represent a specific ordering of the objects.

在本实施例中提供的方法实施例可以在终端、计算机或者类似的运算装置中执行。比如在终端上运行,图1是本实施例的信息比对方法的终端的硬件结构框图。如图1所示,终端可以包括一个或多个(图1中仅示出一个)处理器102和用于存储数据的存储器104,其中,处理器102可以包括但不限于微处理器MCU或可编程逻辑器件FPGA等的处理装置。上述终端还可以包括用于通信功能的传输设备106以及输入输出设备108。本领域普通技术人员可以理解,图1所示的结构仅为示意,其并不对上述终端的结构造成限制。例如,终端还可包括比图1中所示更多或者更少的组件,或者具有与图1所示出的不同配置。The method embodiment provided in this embodiment can be executed in a terminal, a computer or a similar computing device. For example, when running on a terminal, FIG. 1 is a hardware structure block diagram of a terminal of the information comparison method of this embodiment. As shown in FIG. 1 , the terminal may include one or more (only one is shown in FIG. 1 ) processors 102 and a memory 104 for storing data, wherein the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA. The above-mentioned terminal may also include a transmission device 106 and an input and output device 108 for communication functions. It can be understood by those skilled in the art that the structure shown in FIG. 1 is only for illustration, and it does not limit the structure of the above-mentioned terminal. For example, the terminal may also include more or fewer components than those shown in FIG. 1 , or have a different configuration than that shown in FIG. 1 .

存储器104可用于存储计算机程序,例如,应用软件的软件程序以及模块,如在本实施例中的信息比对方法对应的计算机程序,处理器102通过运行存储在存储器104内的计算机程序,从而执行各种功能应用以及数据处理,即实现上述的方法。存储器104可包括高速随机存储器,还可包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器104可进一步包括相对于处理器102远程设置的存储器,这些远程存储器可以通过网络连接至终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the information comparison method in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

传输设备106用于经由一个网络接收或者发送数据。上述的网络包括终端的通信供应商提供的无线网络。在一个实例中,传输设备106包括一个网络适配器(NetworkInterface Controller,简称为NIC),其可通过基站与其他网络设备相连从而可与互联网进行通讯。在一个实例中,传输设备106可以为射频(Radio Frequency,简称为RF)模块,其用于通过无线方式与互联网进行通讯。The transmission device 106 is used to receive or send data via a network. The above network includes a wireless network provided by the communication provider of the terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly.

在本实施例中提供了一种信息比对方法,图2是本实施例的信息比对方法的流程图,如图2所示,该流程包括如下步骤:In this embodiment, an information comparison method is provided. FIG. 2 is a flow chart of the information comparison method of this embodiment. As shown in FIG. 2 , the flow chart includes the following steps:

步骤S210,获取对目标对象进行第一信息验证过程中,采集的目标对象的待比对图像。Step S210: obtaining an image to be compared of the target object collected during the first information verification process of the target object.

该目标对象可以为任意需要利用图像识别进行身份确认的对象。例如人脸识别场景下的待识别人员。第一信息验证具体为图像验证,通过采集该目标对象的图像信息,对该目标对象的身份信息进行确认。其中,目标对象的待比对图像为包含该目标对象用于识别身份信息的特征的图像。例如待识别人员的人脸图像。进一步地,该目标对象的待比对图像可以通过前端设备采集的视频流获得。通过对前端采集的包含目标对象的视频流进行活体检测,确定采集到的目标对象的待比对图像为实时采集的图像,而非该目标对象在进行第一信息验证之前已拍摄过的照片。该活体检测具体为对所采集的待比对图像的色彩度的检测,基于对色彩度的分析结果确定所采集的待比对图像为目标对象实时拍摄得到的图像。The target object can be any object that needs to be identified by image recognition. For example, a person to be identified in a face recognition scenario. The first information verification is specifically image verification, and the identity information of the target object is confirmed by collecting image information of the target object. Among them, the image to be compared of the target object is an image containing features of the target object for identifying identity information. For example, a facial image of a person to be identified. Further, the image to be compared of the target object can be obtained through a video stream collected by a front-end device. By performing liveness detection on the video stream containing the target object collected by the front end, it is determined that the collected image to be compared of the target object is an image collected in real time, rather than a photo of the target object taken before the first information verification is performed. The liveness detection is specifically a detection of the color of the collected image to be compared, and based on the analysis result of the color, it is determined that the collected image to be compared is an image obtained by real-time shooting of the target object.

另外地,在进行信息比对之前,还可以完成目标对象的注册和信息录入。具体地,可以向后台服务器中输入实时采集的待注册对象的待注册图像。根据该待注册图像与已构建的参考库中的参考图像进行比对,得到待注册图像与参考库中所有参考图像之间的相似度,根据预先设定的相似度阈值,确定该待注册图像在该参考库中的相似图像。具体地,在待注册图像与参考图像之间的相似度大于预先设定的相似度阈值的情况下,将该参考图像设置为该待注册图像的相似图像,并将该待注册图像的图像特征和关联的待注册对象的身份信息记录至参考库中。该参考库可以为预先构建的用于存储已注册的对象的图像信息和身份信息的数据库,该参考库中已注册的对象的图像为参考图像。In addition, before performing information comparison, the registration and information entry of the target object can also be completed. Specifically, the image to be registered of the object to be registered that is collected in real time can be input into the background server. According to the comparison between the image to be registered and the reference image in the constructed reference library, the similarity between the image to be registered and all the reference images in the reference library is obtained, and according to a pre-set similarity threshold, the similar image of the image to be registered in the reference library is determined. Specifically, when the similarity between the image to be registered and the reference image is greater than the pre-set similarity threshold, the reference image is set as the similar image of the image to be registered, and the image features of the image to be registered and the identity information of the associated object to be registered are recorded in the reference library. The reference library can be a pre-constructed database for storing image information and identity information of registered objects, and the image of the registered object in the reference library is the reference image.

步骤S220,将参考库中与待比对图像之间的相似度最大的参考图像,设置为待比对图像的类比图像,在类比图像与待比对图像之间的相似度大于预设的第一阈值的情况下,获取参考库中预先确定的类比图像的匹配图像集;其中,匹配图像集由参考库中与类比图像的相似度满足预设相似度条件的参考图像组成。Step S220, setting the reference image in the reference library with the greatest similarity to the image to be compared as the analog image of the image to be compared, and obtaining a matching image set of analog images predetermined in the reference library when the similarity between the analog image and the image to be compared is greater than a preset first threshold; wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets a preset similarity condition.

可以通过提取待比对图像的图像特征,将该待比对图像的图像特征与参考库中其他参考图像的图像特征进行比对,从而得到参考库中各参考图像与该待比对图像之间的相似度。其中,待比对图像的图像特征可以根据实际应用场景进行确定。例如,在待比对图像为人脸时,可以基于关键点检测算法提取该待比对图像中的图像特征。The image features of the image to be compared can be extracted and compared with the image features of other reference images in the reference library, so as to obtain the similarity between each reference image in the reference library and the image to be compared. The image features of the image to be compared can be determined according to the actual application scenario. For example, when the image to be compared is a face, the image features in the image to be compared can be extracted based on the key point detection algorithm.

在确定待比对图像在参考库中的类比图像之后,可以进一步判断该类比图像与待比对图像之间的相似度是否大于预设的第一阈值。其中,该第一阈值同样为根据实际应用场景进行设置的相似度阈值,示例性地,在基于关键点检测的人脸识别中,该第一阈值可以为95%。若两幅图像之间的相似度大于该第一阈值,则该两幅图像所属对象存在极大概率为同一对象。在确定类比图像与待比对图像之间的相似度大于预设的第一阈值的情况下,为了避免误检或漏检,以提高人脸识别的准确度,可以获取该类比图像在参考库中的匹配图像集。其中,该匹配图像集具体可以通过该类比图像所属对象在注册过程中,通过与参考库中的参考图像进行比对而建立,且该匹配图像集包括该类比图像。进一步地,该预设的相似度条件,具体可以为参考库中与类比图像的相似度是否大于根据实际应用场景确定的相似度阈值。其中,该相似度阈值具体可以为第一阈值,也可以为其他阈值。另外地,若类比图像与待比对图像之间的相似度小于第一阈值,则可以获取该类比图像所关联的身份信息,将其作为待比对图像的身份信息,并结束该信息比对。After determining the analog image of the image to be compared in the reference library, it can be further determined whether the similarity between the analog image and the image to be compared is greater than a preset first threshold. The first threshold is also a similarity threshold set according to the actual application scenario. For example, in face recognition based on key point detection, the first threshold can be 95%. If the similarity between the two images is greater than the first threshold, there is a high probability that the objects to which the two images belong are the same object. In the case of determining that the similarity between the analog image and the image to be compared is greater than the preset first threshold, in order to avoid false detection or missed detection and improve the accuracy of face recognition, a matching image set of the analog image in the reference library can be obtained. The matching image set can be specifically established by comparing the object to which the analog image belongs with the reference image in the reference library during the registration process, and the matching image set includes the analog image. Further, the preset similarity condition can specifically be whether the similarity with the analog image in the reference library is greater than the similarity threshold determined according to the actual application scenario. The similarity threshold can specifically be the first threshold or other thresholds. In addition, if the similarity between the analog image and the image to be compared is less than the first threshold, the identity information associated with the analog image can be obtained and used as the identity information of the image to be compared, and the information comparison is terminated.

步骤S230,在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,对目标对象进行第二信息验证,得到目标对象的身份信息。Step S230: When there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than a first threshold, second information verification is performed on the target object to obtain identity information of the target object.

若匹配图像集中存在多个与待比对图像之间的相似度大于第一阈值的参考图像,且该多个参考图像属于不同对象,则表明该第一信息验证过程未能对目标对象的信息进行比对,从而需要对该目标对象进行第二信息验证。具体地,可以获取该目标对象输入的身份标识,例如证件号、手机号或者卡号的其中几位。基于该目标对象输入的身份标识,从匹配图像集中与该待比对图像之间的相似度大于第一阈值的图像所关联的身份标识中进行比对,从而得到该目标对象的身份信息。在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,通过对目标对象进行第二信息验证,能够避免第一阈值造成的误报或漏报,从而提高信息比对的准确度。If there are multiple reference images in the matching image set whose similarity with the image to be compared is greater than the first threshold, and the multiple reference images belong to different objects, it indicates that the first information verification process fails to compare the information of the target object, and thus the target object needs to be subjected to a second information verification. Specifically, the identity identifier input by the target object, such as several digits of an ID number, a mobile phone number, or a card number, can be obtained. Based on the identity identifier input by the target object, a comparison is performed from the identity identifiers associated with the images in the matching image set whose similarity with the image to be compared is greater than the first threshold, thereby obtaining the identity information of the target object. In the case where there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than the first threshold, by performing a second information verification on the target object, false positives or negatives caused by the first threshold can be avoided, thereby improving the accuracy of information comparison.

进一步地,在确定目标对象的身份信息后,可以将该身份信息发送至关联的其他业务系统,执行对应的业务。例如,在基于人脸识别的消费业务中,在完成人脸识别,确定消费者的身份信息后,可以将身份信息发送至关联的消费系统,以完成交易、扣费等操作。在基于人脸识别的考勤业务中,在完成人脸识别,确定考勤人员的身份信息后,可以将身份信息发送至关联的考勤系统执行对应的考勤操作。Furthermore, after the identity information of the target object is determined, the identity information can be sent to other associated business systems to execute the corresponding business. For example, in a consumer business based on face recognition, after completing face recognition and determining the identity information of the consumer, the identity information can be sent to the associated consumer system to complete transactions, deductions, and other operations. In an attendance business based on face recognition, after completing face recognition and determining the identity information of the attendance personnel, the identity information can be sent to the associated attendance system to execute the corresponding attendance operation.

上述步骤S210至S230,获取对目标对象进行第一信息验证过程中,采集的目标对象的待比对图像,将参考库中与待比对图像之间的相似度最大的参考图像设置为待比对图像的类比图像,在类比图像与待比对图像之间的相似度大于预设的第一阈值的情况下,获取参考库中预先确定的类比图像的匹配图像集,其中,匹配图像集由参考库中与类比图像的相似度满足预设相似度条件的参考图像组成,在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,对目标对象进行第二信息验证,得到目标对象的身份信息。其实现了利用多个相似度阈值对人员信息进行过滤,从而避免了单一的相似度阈值造成的识别结果的误报或漏报,进而提高了基于人脸识别的人员信息比对的准确度。In the above steps S210 to S230, in the process of performing the first information verification on the target object, the image to be compared of the target object collected is obtained, and the reference image with the greatest similarity to the image to be compared in the reference library is set as the analog image of the image to be compared. When the similarity between the analog image and the image to be compared is greater than a preset first threshold, a matching image set of analog images predetermined in the reference library is obtained, wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets the preset similarity condition. When there are multiple reference images belonging to different objects in the matching image set and whose similarity to the image to be compared is greater than the first threshold, the target object is subjected to the second information verification to obtain the identity information of the target object. It realizes filtering of personnel information by using multiple similarity thresholds, thereby avoiding the false positive or false negative of the recognition result caused by a single similarity threshold, thereby improving the accuracy of personnel information comparison based on face recognition.

进一步地,在一个实施例中,基于上述步骤S220,将参考库中与待比对图像之间的相似度最大的参考图像,设置为待比对图像的类比图像,具体包括以下步骤:Further, in one embodiment, based on the above step S220, the reference image in the reference library with the greatest similarity to the image to be compared is set as the analog image of the image to be compared, which specifically includes the following steps:

步骤S221,根据待比对图像的图像特征和参考库中的参考图像的图像特征,得到待比对图像与参考图像之间的相似度。Step S221 , obtaining the similarity between the image to be compared and the reference image according to the image features of the image to be compared and the image features of the reference images in the reference library.

步骤S222,将参考库中与待比对图像之间的相似度最大的参考图像设置为待比对图像的类比图像。Step S222: setting the reference image in the reference library with the greatest similarity to the image to be compared as the analog image of the image to be compared.

另外地,在一个实施例中,基于上述步骤S220,将参考库中与待比对图像之间的相似度最大的参考图像,设置为待比对图像的类比图像,还可以包括以下步骤:Additionally, in one embodiment, based on the above step S220, the reference image in the reference library having the greatest similarity to the image to be compared is set as the analog image of the image to be compared, and the following steps may also be included:

步骤S223,在参考库中存在与待比对图像之间的相似度大于预设的第二阈值的参考图像的情况下,将参考库中与待比对图像之间的相似度最大的参考图像设置为待比对图像的类比图像;其中,第二阈值小于第一阈值。Step S223, when there is a reference image in the reference library whose similarity with the image to be compared is greater than a preset second threshold, the reference image in the reference library with the greatest similarity with the image to be compared is set as the analog image of the image to be compared; wherein the second threshold is less than the first threshold.

该第二阈值可以为根据实际应用场景设置的经验值,两幅图像之间的相似度大于该第二阈值,则表明该两幅图像中所包含的对象较为相似。例如,在人脸识别中,该第二阈值可以设置为89%,当两幅人脸图像之间的相似度大于89%时,该两幅人脸图像可能属于同一人员。因此通过预先设置第二阈值,可以用于确定该目标对象是否在参考库中存在相似对象,从而完成对信息比对的初步筛选。另外地,该第二阈值小于第一阈值,用于在通过第一阈值进行过滤得到目标对象的相似人员之前,对参考库中的参考图像进行初步筛选。The second threshold value may be an empirical value set according to the actual application scenario. If the similarity between the two images is greater than the second threshold value, it indicates that the objects contained in the two images are relatively similar. For example, in face recognition, the second threshold value may be set to 89%. When the similarity between two face images is greater than 89%, the two face images may belong to the same person. Therefore, by presetting the second threshold value, it can be used to determine whether there are similar objects to the target object in the reference library, thereby completing the preliminary screening of information comparison. In addition, the second threshold value is less than the first threshold value, and is used to perform preliminary screening of the reference images in the reference library before filtering through the first threshold value to obtain similar persons to the target object.

在参考库中存在与待比对图像之间的相似度大于预设的第二阈值的参考图像的情况下,则该参考库中存在与目标对象较为相似的对象,从而可以将该参考库中与该待比对图像之间的相似度最大的参考图像,设置为该待比对图像的类比图像。可以理解,在该种情况下,该类比图像与待比对图像之间的相似度大于第二阈值,从而可以确定该类比图像中所包含的对象与该目标对象较为相似。另外地,若参考库中所有参考图像与该待比对图像之间的相似度均小于预设的第二阈值,则表明该参考库中不存在与目标对象相似的对象,进而可以确定该参考库中不存在该目标对象在先注册的图像信息和身份信息,因此可以结束该目标对象在该参考库中的信息比对。In the case where there is a reference image in the reference library whose similarity with the image to be compared is greater than a preset second threshold, there is an object relatively similar to the target object in the reference library, so the reference image in the reference library with the greatest similarity with the image to be compared can be set as the analog image of the image to be compared. It can be understood that in this case, the similarity between the analog image and the image to be compared is greater than the second threshold, so it can be determined that the object contained in the analog image is relatively similar to the target object. In addition, if the similarity between all reference images in the reference library and the image to be compared is less than the preset second threshold, it indicates that there is no object similar to the target object in the reference library, and it can be determined that the image information and identity information of the target object previously registered do not exist in the reference library, so the information comparison of the target object in the reference library can be terminated.

在一个实施例中,基于上述步骤S230,在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,对目标对象进行第二信息验证,得到目标对象的身份信息,具体包括以下步骤:In one embodiment, based on the above step S230, when there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than a first threshold, the second information verification is performed on the target object to obtain the identity information of the target object, which specifically includes the following steps:

步骤S231,根据目标对象的身份标识,和匹配图像集中与待比对图像的相似度大于第一阈值的参考图像关联的身份标识,对目标对象的身份信息进行验证,得到目标对象的身份信息。具体地,基于目标对象的身份标识,在匹配图像集中与待比对图像的相似度大于第一阈值的参考图像的范围内进行身份标识的比对,从而确定该目标对象的身份信息。Step S231, based on the identity identifier of the target object and the identity identifier associated with the reference image in the matching image set whose similarity with the image to be compared is greater than a first threshold, the identity information of the target object is verified to obtain the identity information of the target object. Specifically, based on the identity identifier of the target object, the identity identifier is compared within the range of the reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold, thereby determining the identity information of the target object.

在一个实施例中,该方法还包括以下步骤:In one embodiment, the method further comprises the following steps:

步骤S240,在类比图像与待比对图像之间的相似度小于第一阈值的情况下,根据类比图像关联的身份信息确定目标对象的身份信息。具体地,在类比图像与待比对图像之间的相似度小于第一阈值,则该参考库中所有参考图像均与待比对图像之间的相似度小于第一阈值,则可以确定其中相似度最高,且大于第一阈值的类比图像与待比对图像属于同一对象,从而根据类比图像所关联的对象的身份信息确定目标对象的身份信息。Step S240, when the similarity between the analog image and the image to be compared is less than the first threshold, the identity information of the target object is determined according to the identity information associated with the analog image. Specifically, when the similarity between the analog image and the image to be compared is less than the first threshold, the similarity between all reference images in the reference library and the image to be compared is less than the first threshold, and it can be determined that the analog image with the highest similarity and greater than the first threshold belongs to the same object as the image to be compared, thereby determining the identity information of the target object according to the identity information of the object associated with the analog image.

进一步地,在一个实施例中,该方法还可以包括以下步骤:Furthermore, in one embodiment, the method may further include the following steps:

步骤S250,在匹配图像集中的所有参考图像均与待比对图像之间的相似度小于第一阈值的情况下,对目标对象进行第二信息验证。Step S250: When the similarity between all reference images in the matching image set and the image to be compared is less than a first threshold, second information verification is performed on the target object.

另外地,在一个实施例中,该方法还可以包括以下步骤:Additionally, in one embodiment, the method may further include the following steps:

步骤S260,在匹配图像集中存在唯一与待比对图像之间相似度大于第一阈值的参考图像的情况下,根据匹配图像集中唯一与待比对图像之间的相似度大于第一阈值的参考图像关联的身份信息,和类比图像关联的身份信息,确认目标对象的身份信息。具体地,若匹配图像集中存在唯一与待比对图像之间相似度大于第一阈值的参考图像,则可以确定该参考图像与类比图像属于同一对象的概率较高,可以基于该参考图像与待比对图像的身份信息,确认目标对象的身份信息。Step S260, in the case that there is a unique reference image in the matching image set whose similarity with the image to be compared is greater than a first threshold, the identity information of the target object is confirmed based on the identity information associated with the unique reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold, and the identity information associated with the analog image. Specifically, if there is a unique reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold, it can be determined that the probability that the reference image and the analog image belong to the same object is high, and the identity information of the target object can be confirmed based on the identity information of the reference image and the image to be compared.

在一个实施例中,该方法还包括以下步骤:In one embodiment, the method further comprises the following steps:

步骤S270,在确定目标对象的身份信息后,将目标对象的身份信息输出至关联的业务系统。具体地,该业务系统可以为消费系统,在确定目标对象的身份信息后,可以基于该目标对象的身份信息,在所关联的消费系统中进行扣费操作。同样地,该业务系统还可以为考勤系统,在确定该目标对象的身份信息后,可以基于该目标对象的身份信息在所关联的考勤信息中进行预设的考勤操作,例如考勤打卡。Step S270, after determining the identity information of the target object, output the identity information of the target object to the associated business system. Specifically, the business system may be a consumption system, and after determining the identity information of the target object, a deduction operation may be performed in the associated consumption system based on the identity information of the target object. Similarly, the business system may also be an attendance system, and after determining the identity information of the target object, a preset attendance operation may be performed in the associated attendance information based on the identity information of the target object, such as clocking in for attendance.

上述步骤,根据待比对图像的图像特征和参考图像的图像特征得到待比对图像与参考图像之间的相似度,在该相似度大于预设的第二阈值的情况下,将参考库中与待比对图像之间的相似度最大的参考图像设置为待比对图像的类比图像,从而基于第二阈值实现了对参考图像的过滤;在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,根据目标对象的身份标识,和匹配图像集中与待比对图像的相似度大于第一阈值的参考图像的身份标识,对目标对象的身份信息进行验证,得到目标对象的身份信息,从而利用第二信息验证提高了目标对象的身份信息比对的准确度;在匹配图像集中存在唯一与待比对图像之间相似度大于第一阈值的参考图像的情况下,根据匹配图像集中唯一与待比对图像之间的相似度大于第一阈值的参考图像关联的身份信息,和类比图像关联的身份信息,确认目标对象的身份信息,从而基于多个相似度阈值实现了对目标对象的身份信息的确认,避免了单一的相似度阈值造成的识别结果的误报或漏报,进而提高了基于人脸识别的人员信息比对的准确度。In the above steps, the similarity between the image to be compared and the reference image is obtained based on the image features of the image to be compared and the image features of the reference image. When the similarity is greater than a preset second threshold, the reference image in the reference library with the greatest similarity to the image to be compared is set as the analog image of the image to be compared, thereby filtering the reference image based on the second threshold. In the case where there are multiple reference images in the matching image set that belong to different objects and whose similarity to the image to be compared is greater than the first threshold, the identity information of the target object is filtered based on the identity identifier of the target object and the identity identifier of the reference image in the matching image set whose similarity to the image to be compared is greater than the first threshold. Verification is performed to obtain the identity information of the target object, thereby improving the accuracy of the target object's identity information comparison by using the second information verification; when there is a unique reference image in the matching image set whose similarity with the image to be compared is greater than a first threshold, the identity information of the target object is confirmed based on the identity information associated with the unique reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold, and the identity information associated with the analog image, thereby realizing the confirmation of the target object's identity information based on multiple similarity thresholds, avoiding the false positive or false negative of the recognition result caused by a single similarity threshold, and thus improving the accuracy of personnel information comparison based on face recognition.

下面通过优选实施例对本实施例进行描述和说明。The present embodiment is described and illustrated below through preferred embodiments.

图3是本优选实施例的人员信息比对方法的流程图。如图4所示,该人员信息比对方法包括如下步骤:Fig. 3 is a flow chart of the personnel information comparison method of the preferred embodiment. As shown in Fig. 4, the personnel information comparison method includes the following steps:

步骤S310,将包含待比对人员的人脸信息的待比对图像的人脸特征与人脸库中的人脸特征进行比对;Step S310, comparing the facial features of the image to be compared containing the facial information of the person to be compared with the facial features in the face database;

步骤S320,判断人脸库中是否存在与待比对图像的相似度大于第二阈值的参考图像,若是则执行步骤S330,否则执行步骤S410;Step S320, determining whether there is a reference image in the face database whose similarity with the image to be compared is greater than a second threshold, if yes, executing step S330, otherwise executing step S410;

步骤S330,取人脸库中与待比对图像的相似度最高的参考图像,作为待比对图像的类比图像;Step S330, taking the reference image in the face database with the highest similarity to the image to be compared as the analog image of the image to be compared;

步骤S340,判断类比图像与待比对图像的相似度是否大于第一阈值,若是则执行步骤S350,否则执行步骤S420;Step S340, determining whether the similarity between the analog image and the image to be compared is greater than a first threshold, if so, executing step S350, otherwise executing step S420;

步骤S350,获取人脸库中类比图像的匹配图像集;Step S350, obtaining a matching image set of analog images in the face database;

步骤S360,获取匹配图像集与待比对图像之间相似度的比对结果;Step S360, obtaining a comparison result of the similarity between the matching image set and the image to be compared;

步骤S370,取大于预设的第一阈值的比对结果;Step S370, taking the comparison result that is greater than a preset first threshold;

步骤S380,判断比对结果数量是否大于0,若是则执行步骤S390,否则执行步骤S430;Step S380, determine whether the number of comparison results is greater than 0, if so, execute step S390, otherwise execute step S430;

步骤S390,判断比对结果数量是否大于1,若是则执行步骤S400,否则执行步骤S440;Step S390, determining whether the number of comparison results is greater than 1, if so, executing step S400, otherwise executing step S440;

步骤S400,将与待比对图像的相似度大于第一阈值的匹配图像集关联的人员信息送入二次验证模块;Step S400, sending the personnel information associated with the set of matching images whose similarity with the image to be compared is greater than a first threshold to a secondary verification module;

步骤S410,提示人员信息比对失败;Step S410, prompting that personnel information comparison fails;

步骤S420,将类比图像关联的人员信息送入计费模块;Step S420, sending the personnel information associated with the analog image to the billing module;

步骤S430,将匹配图像集中与待比对图像的相似度大于第二阈值的参考图像关联的人员信息送入二次验证模块;Step S430, sending the personnel information associated with the reference image in the matching image set whose similarity with the image to be compared is greater than a second threshold to the secondary verification module;

步骤S440,将匹配图像集中与待比对图像的相似度大于第一阈值的参考图像关联的人员信息送入计费模块。Step S440: sending the personnel information associated with the reference image in the matching image set whose similarity with the image to be compared is greater than a first threshold to the billing module.

图4为本实施例提供的一种人员注册流程图,包括以下步骤:FIG4 is a flow chart of personnel registration provided by this embodiment, including the following steps:

步骤S41,输入待注册人脸图像;Step S41, inputting a face image to be registered;

步骤S42,从待注册人脸图像中提取待注册人脸特征;Step S42, extracting facial features of the person to be registered from the facial image to be registered;

步骤S43,确定图像比对相似度的第一阈值为X;Step S43, determining a first threshold of image comparison similarity as X;

步骤S44,检索人脸库;Step S44, searching the face database;

步骤S45,判断人脸库是否存在与待注册人脸特征相似度大于X的参考图像,若是则执行步骤S46,否则执行步骤S47;Step S45, determining whether there is a reference image in the face database whose similarity with the face feature to be registered is greater than X, if so, executing step S46, otherwise executing step S47;

步骤S46,将与待注册人脸特征相似度大于X的参考图像与待注册人脸图像记录为一组匹配图像集;Step S46, recording the reference image having a similarity greater than X with the facial features of the person to be registered and the facial image to be registered as a set of matching images;

步骤S47,将待注册人脸图像的人脸特征及人员信息添加至人脸库。Step S47, adding the facial features and person information of the face image to be registered to the face database.

需要说明的是,在上述流程中或者附图的流程图中示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行,并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。It should be noted that the steps shown in the above process or the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

在本实施例中还提供了一种信息比对装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。以下所使用的术语“模块”、“单元”、“子单元”等可以实现预定功能的软件和/或硬件的组合。尽管在以下实施例中所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。In this embodiment, an information comparison device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. The terms "module", "unit", "subunit" and the like used below can implement a combination of software and/or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware is also possible and conceived.

图5是本实施例的信息比对装置50的结构框图,如图5所示,该信息比对装置50包括:获取模块52、比对模块54、以及验证模块56,其中:FIG5 is a structural block diagram of an information comparison device 50 of this embodiment. As shown in FIG5 , the information comparison device 50 includes: an acquisition module 52, a comparison module 54, and a verification module 56, wherein:

获取模块52,用于获取对目标对象进行第一信息验证过程中,采集的目标对象的待比对图像;An acquisition module 52 is used to acquire an image to be compared of the target object collected during the first information verification process of the target object;

比对模块54,用于将参考库中与待比对图像之间的相似度最大的参考图像,设置为待比对图像的类比图像,在类比图像与待比对图像之间的相似度大于预设的第一阈值的情况下,获取参考库中预先确定的类比图像的匹配图像集;其中,匹配图像集由参考库中与类比图像的相似度满足预设相似度条件的参考图像组成;The comparison module 54 is used to set the reference image with the greatest similarity to the image to be compared in the reference library as the analog image of the image to be compared, and when the similarity between the analog image and the image to be compared is greater than a preset first threshold, obtain a matching image set of the analog image predetermined in the reference library; wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets a preset similarity condition;

验证模块56,用于在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,对目标对象进行第二信息验证,得到目标对象的身份信息。The verification module 56 is used to perform second information verification on the target object to obtain the identity information of the target object when there are multiple reference images belonging to different objects in the matching image set and whose similarity with the image to be compared is greater than a first threshold.

上述信息比对装置50,获取对目标对象进行第一信息验证过程中,采集的目标对象的待比对图像,将参考库中与待比对图像之间的相似度最大的参考图像设置为待比对图像的类比图像,在类比图像与待比对图像之间的相似度大于预设的第一阈值的情况下,获取参考库中预先确定的类比图像的匹配图像集,其中,匹配图像集由参考库中与类比图像的相似度满足预设相似度条件的参考图像组成,在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,对目标对象进行第二信息验证,得到目标对象的身份信息。其实现了利用多个相似度阈值对人员信息进行过滤,从而避免了单一的相似度阈值造成的识别结果的误报或漏报,进而提高了基于人脸识别的人员信息比对的准确度。The above-mentioned information comparison device 50 obtains the target object to be compared image collected during the first information verification process of the target object, sets the reference image with the greatest similarity to the image to be compared in the reference library as the analog image of the image to be compared, and obtains a matching image set of analog images predetermined in the reference library when the similarity between the analog image and the image to be compared is greater than a preset first threshold, wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets the preset similarity condition, and when there are multiple reference images belonging to different objects in the matching image set and whose similarity to the image to be compared is greater than the first threshold, the target object is subjected to second information verification to obtain the identity information of the target object. It realizes filtering of personnel information by using multiple similarity thresholds, thereby avoiding false positives or false negatives of recognition results caused by a single similarity threshold, thereby improving the accuracy of personnel information comparison based on face recognition.

需要说明的是,上述各个模块可以是功能模块也可以是程序模块,既可以通过软件来实现,也可以通过硬件来实现。对于通过硬件来实现的模块而言,上述各个模块可以位于同一处理器中;或者上述各个模块还可以按照任意组合的形式分别位于不同的处理器中。It should be noted that the above modules can be functional modules or program modules, and can be implemented by software or hardware. For modules implemented by hardware, the above modules can be located in the same processor; or the above modules can be located in different processors in any combination.

在本实施例中还提供了一种电子装置,包括存储器和处理器,该存储器中存储有计算机程序,该处理器被设置为运行计算机程序以执行上述任一项方法实施例中的步骤。In this embodiment, an electronic device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

可选地,上述电子装置还可以包括传输设备以及输入输出设备,其中,该传输设备和上述处理器连接,该输入输出设备和上述处理器连接。Optionally, the electronic device may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.

可选地,在本实施例中,上述处理器可以被设置为通过计算机程序执行以下步骤:Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

获取对目标对象进行第一信息验证过程中,采集的目标对象的待比对图像;Acquire an image of the target object to be compared collected during the process of verifying the first information of the target object;

将参考库中与待比对图像之间的相似度最大的参考图像,设置为待比对图像的类比图像,在类比图像与待比对图像之间的相似度大于预设的第一阈值的情况下,获取参考库中预先确定的类比图像的匹配图像集;其中,匹配图像集由参考库中与类比图像的相似度满足预设相似度条件的参考图像组成;The reference image with the greatest similarity to the image to be compared in the reference library is set as the analog image of the image to be compared, and when the similarity between the analog image and the image to be compared is greater than a preset first threshold, a matching image set of the analog image predetermined in the reference library is obtained; wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets a preset similarity condition;

在匹配图像集中存在多个属于不同对象,且与待比对图像的相似度大于第一阈值的参考图像的情况下,对目标对象进行第二信息验证,得到目标对象的身份信息。When there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than a first threshold, the second information of the target object is verified to obtain the identity information of the target object.

需要说明的是,在本实施例中的具体示例可以参考上述实施例及可选实施方式中所描述的示例,在本实施例中不再赘述。It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementation modes, and will not be repeated in this embodiment.

此外,结合上述实施例中提供的信息比对方法,在本实施例中还可以提供一种存储介质来实现。该存储介质上存储有计算机程序;该计算机程序被处理器执行时实现上述实施例中的任意一种信息比对方法。In addition, in combination with the information comparison method provided in the above embodiments, a storage medium may be provided in this embodiment to implement the information comparison method. The storage medium stores a computer program; when the computer program is executed by a processor, any one of the information comparison methods in the above embodiments is implemented.

应该明白的是,这里描述的具体实施例只是用来解释这个应用,而不是用来对它进行限定。根据本申请提供的实施例,本领域普通技术人员在不进行创造性劳动的情况下得到的所有其它实施例,均属本申请保护范围。It should be understood that the specific embodiments described herein are only used to explain the application, rather than to limit it. Based on the embodiments provided in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the protection scope of this application.

显然,附图只是本申请的一些例子或实施例,对本领域的普通技术人员来说,也可以根据这些附图将本申请适用于其他类似情况,但无需付出创造性劳动。另外,可以理解的是,尽管在此开发过程中所做的工作可能是复杂和漫长的,但是,对于本领域的普通技术人员来说,根据本申请披露的技术内容进行的某些设计、制造或生产等更改仅是常规的技术手段,不应被视为本申请公开的内容不足。Obviously, the drawings are only some examples or embodiments of the present application. For ordinary technicians in the field, the present application can also be applied to other similar situations based on these drawings without creative work. In addition, it is understandable that although the work done in this development process may be complicated and lengthy, for ordinary technicians in the field, certain changes in design, manufacturing or production based on the technical content disclosed in this application are only conventional technical means and should not be regarded as insufficient content disclosed in this application.

“实施例”一词在本申请中指的是结合实施例描述的具体特征、结构或特性可以包括在本申请的至少一个实施例中。该短语出现在说明书中的各个位置并不一定意味着相同的实施例,也不意味着与其它实施例相互排斥而具有独立性或可供选择。本领域的普通技术人员能够清楚或隐含地理解的是,本申请中描述的实施例在没有冲突的情况下,可以与其它实施例结合。The term "embodiment" in this application refers to a specific feature, structure or characteristic described in conjunction with the embodiment that can be included in at least one embodiment of the present application. The appearance of this phrase in various locations in the specification does not necessarily mean the same embodiment, nor does it mean that it is mutually exclusive with other embodiments and is independent or optional. It is clearly or implicitly understood by those of ordinary skill in the art that the embodiments described in this application can be combined with other embodiments without conflict.

以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对专利保护范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of patent protection. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the scope of protection of the present application. Therefore, the scope of protection of the present application shall be subject to the attached claims.

Claims (11)

1.一种信息比对方法,其特征在于,包括:1. An information comparison method, characterized by comprising: 获取对目标对象进行第一信息验证过程中,采集的所述目标对象的待比对图像;Acquire an image to be compared of the target object collected during the process of verifying the first information of the target object; 将参考库中与所述待比对图像之间的相似度最大的参考图像,设置为所述待比对图像的类比图像,在所述类比图像与所述待比对图像之间的相似度大于预设的第一阈值的情况下,获取所述参考库中预先确定的所述类比图像的匹配图像集;其中,所述匹配图像集由所述参考库中与所述类比图像的相似度满足预设相似度条件的参考图像组成;The reference image in the reference library with the greatest similarity to the image to be compared is set as the analog image of the image to be compared, and when the similarity between the analog image and the image to be compared is greater than a preset first threshold, a matching image set of the analog image predetermined in the reference library is obtained; wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets a preset similarity condition; 在所述匹配图像集中存在多个属于不同对象,且与所述待比对图像的相似度大于所述第一阈值的参考图像的情况下,对所述目标对象进行第二信息验证,得到所述目标对象的身份信息。When there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than the first threshold, second information verification is performed on the target object to obtain identity information of the target object. 2.根据权利要求1所述的信息比对方法,其特征在于,所述将参考库中与所述待比对图像之间的相似度最大的参考图像,设置为所述待比对图像的类比图像,包括:2. The information comparison method according to claim 1, characterized in that the step of setting the reference image in the reference library having the greatest similarity to the image to be compared as the analog image of the image to be compared comprises: 根据所述待比对图像的图像特征和所述参考库中的参考图像的图像特征,得到所述待比对图像与所述参考图像之间的相似度;Obtaining the similarity between the image to be compared and the reference image according to the image features of the image to be compared and the image features of the reference images in the reference library; 将所述参考库中与所述待比对图像之间的相似度最大的参考图像设置为所述待比对图像的类比图像。The reference image in the reference library having the greatest similarity to the image to be compared is set as the analog image of the image to be compared. 3.根据权利要求1所述的信息比对方法,其特征在于,所述将参考库中与所述待比对图像之间的相似度最大的参考图像,设置为所述待比对图像的类比图像,还包括:3. The information comparison method according to claim 1, characterized in that the step of setting the reference image in the reference library with the greatest similarity to the image to be compared as the analog image of the image to be compared further comprises: 在所述参考库中存在与所述待比对图像之间的相似度大于预设的第二阈值的参考图像的情况下,将所述参考库中与所述待比对图像之间的相似度最大的参考图像设置为所述待比对图像的类比图像;其中,所述第二阈值小于所述第一阈值。In the case where there is a reference image in the reference library whose similarity with the image to be compared is greater than a preset second threshold, the reference image in the reference library with the greatest similarity with the image to be compared is set as the analog image of the image to be compared; wherein the second threshold is smaller than the first threshold. 4.根据权利要求1所述的信息比对方法,其特征在于,所述在所述匹配图像集中存在多个属于不同对象,且与所述待比对图像的相似度大于所述第一阈值的参考图像的情况下,对所述目标对象进行第二信息验证,得到所述目标对象的身份信息,包括:4. The information comparison method according to claim 1, characterized in that, when there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than the first threshold, performing a second information verification on the target object to obtain the identity information of the target object comprises: 根据所述目标对象的身份标识,和所述匹配图像集中与所述待比对图像的相似度大于所述第一阈值的参考图像关联的身份标识,对所述目标对象的身份信息进行验证,得到所述目标对象的身份信息。The identity information of the target object is verified based on the identity identifier of the target object and the identity identifier associated with the reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold to obtain the identity information of the target object. 5.根据权利要求1所述的信息比对方法,其特征在于,所述方法还包括:5. The information comparison method according to claim 1, characterized in that the method further comprises: 在所述类比图像与所述待比对图像之间的相似度小于所述第一阈值的情况下,根据所述类比图像关联的身份信息确定所述目标对象的身份信息。When the similarity between the analog image and the image to be compared is less than the first threshold, the identity information of the target object is determined according to the identity information associated with the analog image. 6.根据权利要求1所述的信息比对方法,其特征在于,所述方法还包括:6. The information comparison method according to claim 1, characterized in that the method further comprises: 在所述匹配图像集中的所有参考图像均与所述待比对图像之间的相似度小于所述第一阈值的情况下,对所述目标对象进行所述第二信息验证。When the similarities between all reference images in the matching image set and the image to be compared are less than the first threshold, the second information verification is performed on the target object. 7.根据权利要求1所述的信息比对方法,其特征在于,所述方法还包括:7. The information comparison method according to claim 1, characterized in that the method further comprises: 在所述匹配图像集中存在唯一与所述待比对图像之间相似度大于所述第一阈值的参考图像的情况下,根据所述匹配图像集中唯一与所述待比对图像之间的相似度大于所述第一阈值的参考图像关联的身份信息,和所述类比图像关联的身份信息,确认所述目标对象的身份信息。When there is a unique reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold, the identity information of the target object is confirmed based on the identity information associated with the unique reference image in the matching image set whose similarity with the image to be compared is greater than the first threshold, and the identity information associated with the analog image. 8.根据权利要求1所述的信息比对方法,其特征在于,所述方法还包括:8. The information comparison method according to claim 1, characterized in that the method further comprises: 在确定所述目标对象的身份信息后,将所述目标对象的身份信息输出至关联的业务系统。After determining the identity information of the target object, the identity information of the target object is output to an associated business system. 9.一种信息比对装置,其特征在于,包括:获取模块、比对模块、以及验证模块,其中:9. An information comparison device, characterized in that it comprises: an acquisition module, a comparison module, and a verification module, wherein: 所述获取模块,用于获取对目标对象进行第一信息验证过程中,采集的所述目标对象的待比对图像;The acquisition module is used to acquire the image to be compared of the target object collected during the process of verifying the first information of the target object; 所述比对模块,用于将参考库中与所述待比对图像之间的相似度最大的参考图像,设置为所述待比对图像的类比图像,在所述类比图像与所述待比对图像之间的相似度大于预设的第一阈值的情况下,获取所述参考库中预先确定的所述类比图像的匹配图像集;其中,所述匹配图像集由所述参考库中与所述类比图像的相似度满足预设相似度条件的参考图像组成;The comparison module is used to set the reference image with the greatest similarity to the image to be compared in the reference library as the analog image of the image to be compared, and to obtain a matching image set of the analog image predetermined in the reference library when the similarity between the analog image and the image to be compared is greater than a preset first threshold; wherein the matching image set is composed of reference images in the reference library whose similarity to the analog image meets a preset similarity condition; 所述验证模块,用于在所述匹配图像集中存在多个属于不同对象,且与所述待比对图像的相似度大于所述第一阈值的参考图像的情况下,对所述目标对象进行第二信息验证,得到所述目标对象的身份信息。The verification module is used to perform second information verification on the target object to obtain the identity information of the target object when there are multiple reference images in the matching image set that belong to different objects and whose similarity with the image to be compared is greater than the first threshold. 10.一种电子装置,包括存储器和处理器,其特征在于,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行权利要求1至8中任一项所述的信息比对方法。10. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the information comparison method according to any one of claims 1 to 8. 11.一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至8中任一项所述的信息比对方法的步骤。11. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the information comparison method according to any one of claims 1 to 8 are implemented.
CN202111549194.7A 2021-12-17 2021-12-17 Information comparison method, device, electronic device and storage medium Active CN114495194B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111549194.7A CN114495194B (en) 2021-12-17 2021-12-17 Information comparison method, device, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111549194.7A CN114495194B (en) 2021-12-17 2021-12-17 Information comparison method, device, electronic device and storage medium

Publications (2)

Publication Number Publication Date
CN114495194A CN114495194A (en) 2022-05-13
CN114495194B true CN114495194B (en) 2024-11-08

Family

ID=81493935

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111549194.7A Active CN114495194B (en) 2021-12-17 2021-12-17 Information comparison method, device, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN114495194B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118769240B (en) * 2024-06-17 2025-09-05 北京积加科技有限公司 Object picking method, intelligent robot, computer readable medium and program product

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110059560A (en) * 2019-03-18 2019-07-26 阿里巴巴集团控股有限公司 The method, device and equipment of recognition of face

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010006367A1 (en) * 2008-07-16 2010-01-21 Imprezzeo Pty Ltd Facial image recognition and retrieval
CN113705462B (en) * 2021-08-30 2023-07-14 平安科技(深圳)有限公司 Face recognition method, device, electronic equipment and computer readable storage medium

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110059560A (en) * 2019-03-18 2019-07-26 阿里巴巴集团控股有限公司 The method, device and equipment of recognition of face

Also Published As

Publication number Publication date
CN114495194A (en) 2022-05-13

Similar Documents

Publication Publication Date Title
TWI752418B (en) Server, client, user authentication method and system
CN109886222B (en) Face recognition method, neural network training method, device and electronic equipment
CN110866443B (en) Portrait storage method, face recognition equipment and storage medium
CN204576535U (en) A kind of bank slip recognition device
CN110298667A (en) Payment processing method, device and storage medium based on recognition of face
WO2019153504A1 (en) Group creation method and terminal thereof
CN110232784A (en) A kind of shared charger baby leasing method, device and equipment
CN112418189B (en) Face recognition method, device and equipment for wearing mask and storage medium
CN112199530A (en) Multi-dimensional face library picture automatic updating method, system, equipment and medium
CN113591603B (en) Certificate verification method, device, electronic device and storage medium
CN113344132A (en) Identity recognition method, system, device, computer equipment and storage medium
CN105426835A (en) Fingerprint registration method and apparatus and mobile terminal
CN110033388B (en) Social relationship establishing method and device and server
CN114495194B (en) Information comparison method, device, electronic device and storage medium
CN108288025A (en) A kind of car video monitoring method, device and equipment
CN114596618A (en) Face recognition training method and device for mask wearing, electronic equipment and storage medium
CN117478928A (en) Video processing method, device and equipment
CN107451543A (en) Event processing method and related products
CN115527241A (en) Fingerprint template updating method and device, embedded equipment and storage medium
CN103188391A (en) A mobile phone security payment method based on mobile phone identification
CN105389564A (en) Fingerprint registration method, device and mobile terminal
CN111738181A (en) Object association method and device, and object retrieval method and device
CN111783677A (en) Face recognition method, face recognition device, server and computer readable medium
TWM591664U (en) Electronic device for performing identity registration procedure
CN114913357A (en) Information comparison method and device, electronic device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant