CN111292455B - Customs gate detection system based on face and fingerprint identification - Google Patents
Customs gate detection system based on face and fingerprint identification Download PDFInfo
- Publication number
- CN111292455B CN111292455B CN202010148724.6A CN202010148724A CN111292455B CN 111292455 B CN111292455 B CN 111292455B CN 202010148724 A CN202010148724 A CN 202010148724A CN 111292455 B CN111292455 B CN 111292455B
- Authority
- CN
- China
- Prior art keywords
- module
- gate
- data
- customs
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B5/02055—Simultaneously evaluating both cardiovascular condition and temperature
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
- A61B5/024—Measuring pulse rate or heart rate
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Cardiology (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Physiology (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Surgery (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Pulmonology (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention discloses a customs gate detection system based on face and fingerprint identification.A gate module is arranged on a customs channel, and a camera module is arranged on the gate module and is used for acquiring video data of a user; the customs management server comprises a capturing module, a face recognition module and a face recognition module, wherein the capturing module is used for carrying out face detection on each frame of image information in the acquired video data, and recognizing and acquiring a face image in the image information; the micro expression judging module is used for calculating and acquiring micro expression baseline data of the user according to the micro expression data of the user captured by the face image, and further comparing the micro expression data of the current frame face image with the micro expression baseline data to obtain a normal micro expression result or an abnormal micro expression result; and the gate control module is used for controlling the gate module to act according to the normal micro-expression result or the abnormal micro-expression result. The invention aims to solve the problems that customs clearance is large and customs personnel cannot observe the condition of each customs personnel in the prior art.
Description
Technical Field
The invention relates to a customs gate detection system based on face and fingerprint identification.
Background
Customs is a national administrative organ for supervising and managing authority of driving import and export according to the laws and administrative laws of the country.
Customs is in order to go out the mode of entering customs by oneself when going out to enter, can set up twice customs gate usually, be A gate and B gate respectively, and the user need brush the pass earlier when passing through the A gate, and then carries out the type-in of face image and the type-in of fingerprint information when brushing the B gate, passes after face image and fingerprint information pass through the verification and compare successfully.
When customs enters and exits, customs personnel can temporarily perform sampling inspection and questioning according to the expression of passers-by or people with strange behaviors so as to prevent passers-by from entering and exiting with prohibited articles, however, the daily traffic of people passing by customs is very large, and the customs personnel cannot observe the condition of each customs, so that certain improvement exists.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a customs gate detection system based on face and fingerprint identification, and solves the problems that in the prior art, the flow of customs clearance is large, and customs personnel cannot observe the condition of each customs clearance.
The technical purpose of the invention is realized by the following technical scheme:
a customs gate detection system based on face and fingerprint identification comprises a customs channel and a customs management server;
the customs passageway is provided with a gate module, and the gate module is provided with a camera module, wherein the camera module is used for acquiring video data of a user;
the customs management server includes:
the capturing module is used for carrying out face detection on each frame of image information in the acquired video data, and identifying and acquiring a face image in the image information;
the micro expression judging module is used for calculating and acquiring micro expression baseline data of the user according to the micro expression data of the user captured by the face image, and further comparing the micro expression data of the current frame face image with the micro expression baseline data to obtain a normal micro expression result or an abnormal micro expression result;
and the gate control module is used for controlling the gate module to act according to the normal micro-expression result or the abnormal micro-expression result.
Preferably, the micro-expression baseline data includes eyebrow morphology, eyelid palpebral fissure, and interlabial line, wherein normal micro-expression outcomes include natural state, happiness, sadness, and anger, and abnormal micro-expression outcomes include surprise, fear, disgust, and slight.
Preferably, the customs management server further includes:
the selecting module is used for selecting a heart rate detection area based on the face image;
the heart rate value extraction module is used for extracting the heart rate value of the heart rate detection area according to the pixel data in the heart rate detection area; the judgment module is used for calculating and acquiring heart rate value change information in a video data time period according to the heart rate value extracted by the heart rate value extraction module, and obtaining a normal heart rate value result or an abnormal heart rate value result based on the heart rate value change information;
and the gate machine control module is also used for controlling the action of the gate machine module according to the result of the normal heart rate value or the result of the abnormal heart rate value.
Preferably, the gate module is further provided with a fingerprint module, the fingerprint module is used for collecting fingerprint data of a user, the fingerprint module is provided with a temperature data collecting module, and the temperature data collecting module is used for obtaining temperature data of the user in a fingerprint data inputting time period;
the customs management server further comprises:
the temperature change judging module is used for acquiring the temperature data acquired by the temperature data acquiring module, calculating and acquiring temperature change information recorded in a fingerprint data time period, and obtaining a normal temperature result or an abnormal temperature result based on the temperature change information;
and the gate control module is also used for controlling the action of the gate module according to the normal temperature result or the abnormal temperature result.
Preferably, the temperature data acquisition module adopts an infrared temperature sensor.
Preferably, the gate machine control module controls the gate machine module to perform a gate opening operation when at least two of the abnormal micro-expression result, the abnormal heart rate value result and the abnormal temperature result are obtained.
Preferably, the floodgate machine module includes around interval setting first floodgate machine and the second floodgate machine on the customs passageway, module and the fingerprint module setting of making a video recording is on the second floodgate machine.
Preferably, a certificate identification module is arranged on the first gate, and the customs management server further comprises:
the information comparison module is used for carrying out verification and judgment according to the certificate information collected by the certificate identification module;
and the gate control module is also used for controlling the action of a first gate in the gate module after the certificate information passes verification.
In summary, compared with the prior art, the beneficial effects of the invention are as follows:
according to the method, through the arrangement of the first gate and the second gate, the certificate identification module is arranged on the first gate, and the camera module and the fingerprint module are arranged on the second gate, so that when a user enters and exits a customs clearance, the user needs to firstly swipe a card through the first gate, then the camera module on the second gate collects video data and fingerprint data of the user, and each customs officer is observed and analyzed by analyzing micro-expression data, heart rate value change information and temperature change information of the user, so that the problems that in the prior art, the flow of the customs officers is large, and the customs officers cannot observe the condition of each customs officer are solved;
and when the micro-expression data, the heart rate value change information and the temperature change information of the customs clearance personnel are abnormal, the user is represented that the user is in an abnormal state and has a suspicious place, so that the customs clearance personnel can ask the customs clearance personnel between the first gate and the second gate, and the customs clearance personnel can be prevented from entering the customs clearance when carrying prohibited articles and the like.
Drawings
Fig. 1 is a system block diagram of a customs gate detection system in the technical solution of the present invention;
fig. 2 is a block diagram of a customs management server according to the technical solution of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. It should be noted that: the relative arrangement of parts and steps set forth in these embodiments does not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In the prior art, customs personnel need to perform temporary spot inspection on customs personnel, objects of the temporary spot inspection are often concentrated on customs personnel with suspicious magical color, and then corresponding inquiries are performed to ensure that the requirements of entry and exit of the customs personnel are met, but the flow of people of the entry and exit of customs personnel is very large, and the situation that each customs personnel can observe cannot be ensured.
In order to solve the technical problems, the application provides a customs gate detection system based on face and fingerprint identification, which is shown by combining with a figure 1 and a figure 2 and comprises a customs channel and a customs management server, wherein the customs channel is provided with a gate module, the gate module is provided with a camera module, a fingerprint module, a certificate identification module and a temperature data acquisition module, the customs management server comprises a capture module, a micro-expression judgment module, a selection module and a heart rate value extraction module, the customs management server can acquire the data uploaded by the camera module, the fingerprint module, the certificate identification module and the temperature data acquisition module which are arranged on the floodgate module and the floodgate module, and the customs management server can correspondingly control the floodgate module to open and close the floodgate.
Regarding the way the gate module is communicatively connected to the customs management server, in one embodiment, the gate module is in wired communication with the customs management server. In another embodiment, the gate module is connected to the customs management server for wireless communication, including but not limited to, access to a communications network through a 433 gateway. In this embodiment, the wired mode or the wireless mode is not particularly limited, and may be set according to the user's needs.
Therefore, when each customs clearance person enters and exits the gate module of the customs, the customs management server can analyze micro-expression data, heart rate value change information and temperature change information of the customs clearance person, and when psychological factors such as improper complexion, accelerated heart rate or increased body temperature of the customs clearance person are caused by stress reaction of a human body, the customs clearance person can perform corresponding spot check and ask questions, so that the customs clearance person can be checked by applying the detection system.
Specifically, the customs passageway is provided with a plurality of side by side, and the floodgate module sets up on every customs passageway, and in this embodiment, the floodgate module includes around the interval sets up first floodgate machine and the second floodgate machine on the customs passageway, is formed with short duration dwell space between first floodgate machine and the second floodgate machine, and the personnel of passing through promptly is behind first floodgate machine, if can't pass through the second floodgate machine, the personnel of passing through will be detained between first floodgate machine and second floodgate machine.
The certificate identification module is arranged on a first gate of the gate module and used for identifying identity cards, port and Macau passes and other certificate information of induction customs clearance personnel and uploading the acquired certificate information to customs management service.
After the customs management server obtains the certificate information, the information comparison module is used for verifying and judging the certificate information, searching the certificate information in the personal information database, verifying whether the certificate information is pre-input in the personal information database, if so, indicating that the certificate information is verified to be passed, and if not, indicating that the certificate information is not verified to be passed. The gate control module is used for controlling the action of a first gate in the gate module after the certificate information is verified.
From this, the customs clearance personnel carry out ID card or the recognition of the card of hong Kong and Macao at the certificate identification module of first floodgate machine after, customs management server to the successful back of customs clearance personnel's certificate information verification, will control first floodgate machine and open the floodgate, the customs clearance personnel can enter into the short-term space that stops through first floodgate machine in to pass through subsequent second floodgate machine.
Wherein, module and fingerprint module set up on the second floodgate of floodgate machine module of making a video recording, and the user stands before the second floodgate machine, and the module of making a video recording is used for gathering user's video data, and fingerprint module is used for gathering user's fingerprint data. The video data are uploaded to the customs management server after the video data are collected by the camera module, and the fingerprint data are uploaded to the customs management server after the fingerprint data are collected by the fingerprint module.
The customs management server recognizes and judges the micro expression of the face image of the user in the video data through the capturing module and the micro expression judging module, which is described in detail below.
The capturing module is used for carrying out face detection on each frame of image information in the acquired video data, and identifying and acquiring a face image in the image information; the micro expression judging module is used for calculating and acquiring micro expression baseline data of the user according to the micro expression data of the face image capturing user, and further comparing the micro expression data of the current frame face image with the micro expression baseline data to obtain a normal micro expression result or an abnormal micro expression result; the gate control module is used for controlling the gate module to act according to the normal micro-expression result or the abnormal micro-expression result.
Specifically, the micro-expression baseline data comprises an eyebrow form, eyelid fissure and interlabial line, wherein the eyebrow form comprises an eyebrow position, an eyebrow-to-eyebrow connecting line angle and a distance matrix between an eyebrow lower edge and an upper eyelid edge when the user face is not expressed. When the eyebrow position is calculated, namely when the face of a user is not expressive, the relative positions of the perpendicular corresponding points of the eyebrow distance from the hairline on the two sides are calculated, and the three data are used as baseline data for comparing eyebrow movement.
Eyelid blepharoptosis refers to the distance (in millimeters) between the upper eyelid and the lower eyelid, and the baseline data of eyelid blepharoptosis is the size of the blepharoptosis value when the user is expressionless.
The interlabial line comprises the comparison of the interlabial line form, the mouth angle position and the bright and dark point area of the chin when the user faces are expressionless, wherein the interlabial line form refers to the radian of the upper and lower interlabial lines, the mouth angle position refers to the relative position of the mouth angles at two sides from the vertical corresponding point of the hairline, and the bright and dark point area comparison of the chin refers to the bright and dark area comparison value of the chin.
It is worth mentioning that in the eyebrow configuration, when the following occurs: 1. the eyebrows at both sides move downwards, the connecting line angle of the eyebrow heads and the eyebrow peaks is increased, and strong frown is represented; 2. the eyebrows at both sides move downwards, the connecting line angle of the eyebrows and the eyebrow crest is unchanged, and weak frown is represented; 3. the eyebrows at both sides move downwards, the connecting line angle of the eyebrow heads and the eyebrow peaks is unchanged, and the eyebrow raising is indicated; 4. the eyebrows on both sides move upwards, the connection line angle of the eyebrows and the eyebrows peak is reduced, and the jiong eyebrow is shown; 5. the eyelid spacing decreases, indicating anger; 6. the inter-eyelid distance increases, indicating no disclaimer.
In the interlabial line index, when the following occurs: 1. the radian of the interlabial line is increased upwards, the position of the mouth corner is moved upwards, and the contrast value of bright and dark points of the chin is not changed, which indicates smile; 2. the radian of the interlabial line is increased downwards, the position of the mouth angle is moved downwards, and the contrast value of bright and dark points of the chin is obviously changed, which shows that the result is negative; 3. the radian of the interlabial line is increased upwards, the position of the mouth angle is almost unchanged, or the mouth angle at one side is raised, the contrast value of bright and dark spots of the chin part is not changed, and the light and slight stripes are represented.
Therefore, according to the combined comparison of the baseline data of the eyebrow morphology, the eyelid fissure and the interlabial line, the following expression results appear:
1. if the separate phenomenon of increased palpebral fissure occurs, a depressive surprised expression result is formed; 2. if the combination of the raised eyebrows and the increase of the eyelid fissure occurs, a surprised expression result is formed; 3. if the combination of frown, eyelid fissure reduction and downward bending of the inter-lip line occurs, a strong aversion expression result is formed; 4. if the combination of frown wrinkling, eyelid fissure reduction and one-side mouth corner lifting appears, an aversive expression result is formed; 5. if a combination of eyelid fissure reduction and single-side mouth corner lifting occurs, a light-bamboo expression result is formed; 6. if the combination of frowning and eyelid fissure increasing occurs, an angry expression result is formed; 7. if the mouth corner on one side is lifted, a non-dandruff expression result is formed; 8. if a combination of jiong eyebrow and eyelid fissure increasing appears, a fear expression result is formed; 9. if a combination of jiong eyebrow and eyelid fissure reduction occurs, a sad expression result is formed; 10. if the combination of the upward bending of the interlabial line and the increase of the contrast value of the bright and dark spot area of the chin appears, a negative expression result is formed.
Therefore, a normal micro-expression result or an abnormal micro-expression result is obtained by comparing the micro-expression data of the current frame face image with the micro-expression baseline data, wherein the normal micro-expression result comprises a natural state, happiness, sadness and anger, and the abnormal micro-expression result comprises surprise, fear, disgust and slight stripes. And the gate control module is used for controlling the second gate to open according to the normal micro-expression result and controlling the second gate to close according to the abnormal micro-expression result.
In the application, the customs management server determines the heart rate value change information of the user in the video data through the selection module, the heart rate value extraction module and the determination module, which is described in detail below.
The selection module is used for selecting a heart rate detection area based on the face image; the heart rate value extraction module is used for extracting a heart rate value of the heart rate detection area according to the pixel data in the heart rate detection area; the judgment module calculates and acquires heart rate value change information in a video data time period according to the heart rate value extracted by the heart rate value extraction module, and obtains a normal heart rate value result or an abnormal heart rate value result based on the heart rate value change information; the gate control module is also used for controlling the action of the gate module according to the result of the normal heart rate value or the result of the abnormal heart rate value.
In the selection of the heart rate detection area, firstly, face key point positioning is carried out on an obtained face image to obtain 68 individual face key points, and then a plurality of polygonal areas such as the areas of the forehead, the cheek and the like are selected from the face image to be used as the heart rate detection area by utilizing the 68 individual face key points, so that the areas of the eyes, the mouth and the like are effectively avoided, and the influence of non-rigid movement of the face is reduced as much as possible.
In the heart rate value extraction, the absorption rate of the skin and the tissue to the light is basically kept unchanged, but the blood volume in the artery changes periodically along with the heartbeat, so that the absorption rate of the artery to the light also changes periodically, and therefore, the heart rate value can be obtained by detecting signals in the reflected light which change periodically along with the pulse. Specifically, pixel data of a heart rate detection area are extracted, a pixel data sequence is formed after multiple frames are continuously collected, an alternating current signal containing heart rate information is separated from the generated pixel data sequence by using a signal separation method, and a characteristic frequency with the maximum amplification in the alternating current signal is obtained through a frequency domain transformation method and is used as a heart rate value of the heart rate detection area.
In heart rate value change information, what the module of making a video recording gathered is video data, video data comprises a frame continuous image, in this application, every second video data comprises 25 frames of images, all contain the facial image in every frame of image, consequently through the heart rate value in the every frame facial image that the module extraction of heart rate value obtained, and then can judge the heart rate value change information in the video data time quantum, heart rate value change information is the customs person in this section of time of video data promptly, the heart rate value is in the acceleration state, steady state or slow down the state. Therefore, when the heart rate value change information shows that the heart rate value of the person in charge is in an accelerated state, the abnormal heart rate value result is output. And outputting a normal heart rate value result when the heart rate value of the customs clearance is displayed in the heart rate value change information to be in a stable state or a slow-down state. The gate machine control module is used for controlling the second gate machine to open according to the result of the normal heart rate value and controlling the second gate machine to close according to the result of the abnormal heart rate value.
In this embodiment, the fingerprint module may be a capacitive fingerprint module, or may be other types of fingerprint modules such as an optical fingerprint module, and is not limited to this embodiment. And after acquiring the fingerprint data of the user, the customs management server stores the fingerprint data of the user in a fingerprint database for file reservation. It is worth explaining that a temperature data acquisition module is arranged on the fingerprint module and used for acquiring temperature data in a time period when a user inputs fingerprint data.
The temperature data is finger temperature data of a user, and the temperature data acquisition module can be an infrared temperature sensor, but those skilled in the art can easily understand that the temperature data acquisition module can also adopt other temperature sensing modules composed of thermosensitive elements.
The customs management server determines the temperature change information of the human body of the customs officer through the temperature change determination module, which is described in detail below.
The temperature change judging module is used for acquiring temperature data acquired by the temperature data acquiring module, calculating and acquiring temperature change information recorded in a fingerprint data time period, and obtaining a normal temperature result or an abnormal temperature result based on the temperature change information; the gate control module is also used for controlling the action of the gate module according to the normal temperature result or the abnormal temperature result.
Specifically, when a user presses a finger on the fingerprint module to record fingerprint data, the temperature data acquisition module acquires the temperature of the finger of the user at intervals of 0.2s to form temperature data, after the temperature change judgment module acquires a sequence of the temperature data, the sequence of the temperature data is fitted into a curve, and then temperature change information is judged, namely the temperature data of the finger of the user is in an ascending state, a descending state or a balanced state within the time period of the fingerprint data recording of the user, and when the temperature data of the finger of the user is in the ascending state, an abnormal temperature result can be obtained. When the temperature data of the user's finger is in a steady state or a falling state, a normal temperature result can be obtained. The gate control module is used for controlling the second gate to open according to the normal temperature result and controlling the second gate to close according to the abnormal temperature result.
It is worth to be noted that the gate control module controls the second gate in the gate module to open the gate when obtaining the abnormal expression result, the abnormal heart rate value result and the abnormal temperature result. In this embodiment, the gate control module controls the second gate to open the gate only when at least two of the abnormal micro-expression result, the abnormal heart rate value result, and the abnormal temperature result are obtained.
Therefore, according to the method, through the arrangement of the first gate and the second gate, the certificate identification module is arranged on the first gate, and the camera module and the fingerprint module are arranged on the second gate, so that when a user enters and exits a customs, the user needs to firstly swipe the card through the first gate, then the camera module on the second gate collects video data and fingerprint data of the user, and each customs person is observed and analyzed by analyzing micro-expression data, heart rate value change information and temperature change information of the user, so that the problems that in the prior art, the flow of the customs person is large, and the customs person cannot observe the condition of each customs person are solved;
and when the micro-expression data, the heart rate value change information and the temperature change information of the customs clearance personnel are abnormal, the user is represented that the user is in an abnormal state and has a suspicious place, so that the customs clearance personnel can ask the customs clearance personnel between the first gate and the second gate, and the customs clearance personnel can be prevented from entering the customs clearance when carrying prohibited articles and the like.
The above description is intended to be illustrative of the present invention and not to limit the scope of the invention, which is defined by the claims appended hereto.
Claims (3)
1. A customs gate detection system based on face and fingerprint identification is characterized by comprising a customs channel and a customs management server;
the customs passageway is provided with a gate module, and the gate module is provided with a camera module, wherein the camera module is used for acquiring video data of a user;
the gate module comprises a first gate and a second gate which are arranged on the customs passageway at intervals, and the camera module and the fingerprint module are arranged on the second gate;
be provided with IC-card identification module on the first floodgate machine, customs management server includes:
the information comparison module is used for carrying out verification and judgment according to the IC card information collected by the IC card identification module;
the gate control module is also used for controlling the action of a first gate in the gate module after the IC card information verification is passed;
the gate module is also provided with a fingerprint module, the fingerprint module is used for collecting fingerprint data of a user, the fingerprint module is provided with a temperature data collecting module, the temperature data collecting module is used for obtaining temperature data in a time period when the user inputs the fingerprint data, and when the user presses a finger on the fingerprint module to record the fingerprint data, the temperature data collecting module collects the finger temperature of one user at intervals of 0.2s to form temperature data;
the customs management server further includes:
the capturing module is used for carrying out face detection on each frame of image information in the acquired video data, and identifying and acquiring a face image in the image information;
the micro expression judging module is used for calculating and acquiring micro expression baseline data of the user according to the micro expression data of the user captured by the face image, and further comparing the micro expression data of the current frame face image with the micro expression baseline data to obtain a normal micro expression result or an abnormal micro expression result;
the temperature change judging module is used for acquiring temperature data acquired by the temperature data acquiring module, calculating and acquiring temperature change information in a fingerprint data inputting time period, obtaining a normal temperature result or an abnormal temperature result based on the temperature change information, fitting a sequence of the temperature data into a curve after the temperature change judging module acquires the sequence of the temperature data, and further judging the temperature change information, namely, whether the temperature data of a finger of a user is in an ascending state, a descending state or a balanced state in the fingerprint data inputting time period of the user, obtaining the abnormal temperature result when the temperature data of the finger of the user is in the ascending state, and obtaining the normal temperature result when the temperature data of the finger of the user is in the stable state or the descending state;
the selecting module is used for selecting a heart rate detection area based on the face image;
the heart rate value extraction module is used for extracting the heart rate value of the heart rate detection area according to the pixel data in the heart rate detection area;
the judgment module is used for calculating and acquiring heart rate value change information in a video data time period according to the heart rate value extracted by the heart rate value extraction module, and obtaining a normal heart rate value result or an abnormal heart rate value result based on the heart rate value change information;
the gate control module is used for controlling the gate module to act according to the normal micro-expression result or the abnormal micro-expression result; the controller is used for controlling the action of the gate module according to the result of the normal heart rate value or the result of the abnormal heart rate value, controlling the action of the gate module according to the result of the normal temperature or the result of the abnormal temperature, controlling the opening action of the second gate according to the result of the normal temperature and controlling the closing action of the second gate according to the result of the abnormal temperature;
and the gate machine control module controls the gate machine module to open the gate when at least two of the abnormal micro-expression result, the abnormal heart rate value result and the abnormal temperature result are obtained.
2. The customs gate detection system based on human face and fingerprint recognition as claimed in claim 1, wherein the micro-expression baseline data comprises eyebrow shape, eyelid palpebral fissure and interlabial line, wherein the normal micro-expression results comprise natural state, happiness, sadness and anger, and the abnormal micro-expression results comprise surprise, fear, disgust and slight.
3. The customs gate detection system based on human face and fingerprint identification as claimed in claim 1, wherein the temperature data acquisition module employs an infrared temperature sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010148724.6A CN111292455B (en) | 2020-03-05 | 2020-03-05 | Customs gate detection system based on face and fingerprint identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010148724.6A CN111292455B (en) | 2020-03-05 | 2020-03-05 | Customs gate detection system based on face and fingerprint identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111292455A CN111292455A (en) | 2020-06-16 |
| CN111292455B true CN111292455B (en) | 2021-05-18 |
Family
ID=71030899
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010148724.6A Active CN111292455B (en) | 2020-03-05 | 2020-03-05 | Customs gate detection system based on face and fingerprint identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111292455B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113313014B (en) * | 2021-05-26 | 2023-08-25 | 深圳市君利信达科技有限公司 | Customs detection system based on facial feature analysis emotion intensity |
| CN115761945A (en) * | 2022-10-21 | 2023-03-07 | 重庆甲智甲创科技有限公司 | A control method and system for an intelligent door lock |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE10334012A1 (en) * | 2003-07-25 | 2005-02-10 | Id-Soft Gmbh | Data carrier for personal identity documents has all personal identification and biometric data compressed and encrypted into two dimensional bar code and microchip |
| KR20190058283A (en) * | 2018-09-20 | 2019-05-29 | (주)오픈웍스 | Site Safety Management Monitoring System and Method Thereof |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1861807B1 (en) * | 2005-03-24 | 2012-11-07 | Privaris, Inc. | Biometric identification device with smartcard capabilities |
| CN201522710U (en) * | 2009-10-19 | 2010-07-07 | 深圳市中控生物识别技术有限公司 | Face and fingerprint identification equipment |
| CN103714660B (en) * | 2013-12-26 | 2017-02-08 | 苏州清研微视电子科技有限公司 | System for achieving fatigue driving judgment on basis of image processing and fusion between heart rate characteristic and expression characteristic |
| CN104820495B (en) * | 2015-04-29 | 2019-06-21 | 姜振宇 | A kind of micro- Expression Recognition of exception and based reminding method and device |
| CN105550638A (en) * | 2015-12-07 | 2016-05-04 | 深圳市安网通信有限公司 | Intelligent self-service identity card customs control system and intelligent self-service identity card customs control method |
| CN105574498A (en) * | 2015-12-15 | 2016-05-11 | 重庆凯泽科技有限公司 | Face recognition system and recognition method based on customs security check |
| CN106557762A (en) * | 2016-12-13 | 2017-04-05 | 天津灵隆科技有限公司 | A kind of personal identification device with recognition of face and fingerprint identification function |
| CN207912696U (en) * | 2017-07-06 | 2018-09-28 | 北京同方神火联合科技发展有限公司 | Politics examination psychological test assessment system |
| CN207867523U (en) * | 2017-12-07 | 2018-09-14 | 秦家早 | Living body faces detection device |
| CN109784175A (en) * | 2018-12-14 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Abnormal behaviour people recognition methods, equipment and storage medium based on micro- Expression Recognition |
-
2020
- 2020-03-05 CN CN202010148724.6A patent/CN111292455B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE10334012A1 (en) * | 2003-07-25 | 2005-02-10 | Id-Soft Gmbh | Data carrier for personal identity documents has all personal identification and biometric data compressed and encrypted into two dimensional bar code and microchip |
| KR20190058283A (en) * | 2018-09-20 | 2019-05-29 | (주)오픈웍스 | Site Safety Management Monitoring System and Method Thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111292455A (en) | 2020-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106446831B (en) | Face recognition method and device | |
| Balcoh et al. | Algorithm for efficient attendance management: Face recognition based approach | |
| JP4401079B2 (en) | Subject behavior analysis | |
| CN104361276B (en) | A kind of multi-modal biological characteristic identity identifying method and system | |
| CN102332093B (en) | Identity authentication method and device adopting palmprint and human face fusion recognition | |
| CN113920568B (en) | Face and human body posture emotion recognition method based on video image | |
| CN105354527A (en) | Negative expression recognizing and encouraging system | |
| Chauhan et al. | A survey of emerging biometric modalities | |
| CN101493884A (en) | Multi-optical spectrum image collecting device and method | |
| CN111292455B (en) | Customs gate detection system based on face and fingerprint identification | |
| KR100554129B1 (en) | Personal authentication device using heat information of human body and its method | |
| JP2000105830A (en) | Individual identifying device | |
| CN102955933A (en) | Household access control method based on face recognition | |
| CN104331685A (en) | Non-contact active calling method | |
| CN105335691A (en) | Smiling face identification and encouragement system | |
| CN105119723A (en) | Identity authentication and authorization method based on human eye recognition | |
| KR101640014B1 (en) | Iris recognition apparatus for detecting false face image | |
| EP2953057A1 (en) | Iris recognition terminal and method | |
| CN109409343A (en) | A kind of face identification method based on In vivo detection | |
| Goudelis et al. | Emerging biometric modalities: a survey | |
| CN114140849A (en) | Electric power infrastructure field personnel state management method and system based on expression recognition | |
| KR100795360B1 (en) | How to judge yourself by face recognition | |
| CN111667599A (en) | Face recognition card punching system and method | |
| CN108648312A (en) | Recognition of face Intelligent greeting method and system | |
| CN119206829A (en) | A processing system based on face feature recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |