JP2018045340A - Immigration system and method - Google Patents

Abstract

[PROBLEMS] To perform examination using information associated with a past passport of a person even when the passport number is changed. The biometric information is obtained from a subject's living body, the passport information is obtained from the subject's passport, the obtained biometric information is compared with the biometric information as a template, and based on the obtained passport information. The passport information obtained at the immigration control, which performs immigration based on the verification result and the verification result, includes a passport number and other personal information. By selecting the biometric information as a template related to the number as a template used for collation, the passport owner can find a passport owned in the past and use the information for personal authentication and examination. [Selection diagram] Fig. 1

Description

  The present invention relates to a technology related to immigration.

  Currently, the introduction of a “face recognition automation gate” that does not require pre-registration is planned for the Japanese homecoming examination in Japan. This automated gate verifies the identity by collating the face image stored in the IC information in the passport (passport) with the face image photographed at the examination place. Pass through the gate. The introduction of this automated gate will improve the efficiency of Japanese homecoming examinations.

  In the departure / exit examination, it is assumed that the template and the passport number based on the above technique are used as key information, and the national management, gender, age, and passport IC information are linked to perform master management. As a technique for improving authentication accuracy in biometric information, as disclosed in Patent Document 1, biometric information acquired from a biometric reading device and used for authentication is accumulated, and a plurality of biometric information is used as a template to improve authentication accuracy. There is technology to do. When face images are used as biometric information, face images taken during immigration checks are accumulated and used as templates, and if the face image taken by the traveler does not match the face image displayed on the passport, the passport number If the template is searched for and matched with the searched template, the authentication accuracy can be improved.

JP 2011-123532 A

  However, Patent Document 1 does not consider template search when the key information associated with the collation reference template changes. For this reason, if the passport number is changed when the passport is updated or reissued, it will no longer be relevant to the template, so it will not be possible to match the template associated with the passport number before the change, and authentication accuracy will be reduced. There is a possibility that. As a result, the examination cannot be performed efficiently.

  In view of the above-described problems, an object of the present invention is to provide a technique for performing an examination using information relating to a past passport number even when the passport number is changed.

  In the present invention, in order to solve the above-mentioned problem, biometric information is obtained from the living body of the examinee, passport information is obtained from the passport of the examinee, and the obtained biometric information is compared with the biometric information as a template. In the immigration examination, which examines based on the acquired passport information and performs immigration based on the verification result and examination result, the acquired passport information includes the passport number and other personal information. The biometric information as a template related to a different passport number is selected as a template to be used for matching.

  According to the present invention, it is possible to carry out an examination using information relating to the passport number before the change.

1 is a configuration diagram of an automated gate immigration system according to an embodiment of the present invention. It is a block diagram for showing the structure of the gate terminal 20 concerning one Example of this invention. It is a block diagram for showing the structure of the template collation system 10 concerning one Example of this invention. It is a structure of the passport IC information 113 concerning one Example of this invention. It is a structure of the face image log | history database 111 concerning one Example of this invention. It is the structure of the template database 112 concerning one Example of this invention. It is the examination flow concerning one example of the present invention. It is the flow of the personal authentication in the examination flow concerning one Example of this invention. It is the integrated immigration history information concerning one Example of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

  A system configuration according to an embodiment of the present invention will be described with reference to FIG. In the present embodiment, the gate terminal 20, the template matching system 10, and the immigration control system 30 are connected by a wide area network 40. The gate terminal 20 is installed at an exit / exit examination place such as an airport and is used for automatic examination. When a traveler operates the terminal and passes the examination, the gate flap moves and the passage opens. It can pass. The template collation system 10 is installed in another place in the same facility as the gate terminal 20 and collates the face image of the traveler photographed by the gate terminal 20 with the template. In most cases, the immigration control system 30 is installed in a data center or the like different from the facility having the departure / exit checkpoint, and performs information processing and data storage necessary for the exit / exit checkpoint.

  The configuration of the gate terminal 20 will be described with reference to FIG. The gate terminal 20 includes a control unit 200, a face image photographing device 50, a display 60, an input device 70, a passport IC information reading device 80, and a gate device 90. The control unit 200 is constituted by, for example, a processor, and is a verification unit 201 for verifying the passport IC information and the photographed face image, which is a program, and a screening unit for screening for checking a revoked passport in cooperation with an external system. 202 is operated on it. The face image photographing device 30 is a camera and photographs a face image of a traveler. The display 60 displays information and instructions to the traveler, and the input device 70 receives an operation input from the traveler. The passport IC information reading device 80 is an IC reader, and reads information 113 stored in a passport IC included in a passport presented by a traveler by non-contact communication. The gate device 90 is provided with a flap that blocks a passage through which a traveler passes, opens the flap after examination, allows passage through the traveler passage, and returns home.

  The configuration of the template matching system 10 will be described with reference to FIG. The template matching system 10 includes a control unit 100 and a storage unit 110. The storage unit 110 stores a face image history database 111 and a template database 112. The control unit 100 is a template search unit 101 that searches the face image history database 111 or the template database 112 for a corresponding template (or a candidate for matching) with a photographed face image as a program, a photographed face image and a template, or a past A collation unit 102 that collates a captured face image, and a template management unit 103 that stores face images and updates information in the face image history database 111 and the template database 112.

  The configuration of passport IC information 113 stored in the passport IC will be described with reference to FIG. The passport IC information 113 stores the passport number, first and last name, gender, date of birth of the passport holder, and electronic data of the face image of the applicant himself / herself submitted at the time of issuing the passport. These pieces of information are the same as the information printed on the passport.

  The configuration of the face image history database 111 will be described with reference to FIG. The face image history database 111 stores the passport number, the shooting date and time when the face image was shot, and the shot face image data. The face image data is image data photographed by the gate terminal at the time of immigration examination, and is added and updated to this database every time it is photographed.

  The configuration of the template database 112 will be described with reference to FIG. The template database 112 stores a passport number, first and last name, sex, date of birth, template to be verified, and past passport number. In biometric authentication such as face authentication, registration is often made as a template in the state of a feature amount acquired from biometric information.

  The examination flow of this embodiment will be described with reference to FIG. The explanation will be given taking departure from Japan as an example, but the same applies to returning home.

  When traveling abroad, the airline company checks in at the airport, passes the security check, and then operates the gate terminal for departure examination. First, the identity authentication of the traveler at the gate terminal 20 is performed. When the traveler holds the passport over the passport IC information reading device 60 of the gate terminal 20, the gate terminal 20 reads the passport IC information (S300). An instruction to the traveler is displayed on the display 60 of the gate terminal 20 so as to face the camera (face image capturing device 50), and the face image capturing device 50 determines the direction and expression of the face of the traveler and takes a picture. When satisfactory predetermined conditions are satisfied, a face image of the traveler is photographed and recorded (S301).

  Next, personal authentication S302 is performed at the gate terminal 20. Details of the personal authentication will be described later. If the personal authentication is successful, automatic examination at the gate terminal 20 continues at the same place (S303). If the person cannot be authenticated, an instruction is displayed to the traveler to move to the manned booth, and the traveler is carefully authenticated and examined in the manned examination (S307).

  In the examination (S303), in order to determine whether or not to leave the country after successful authentication, it cooperates with the immigration control system. The passport number is transmitted from the gate terminal 20 to the external system, the external system collates with the black list and the revoked passport list and transmits the result, and the gate terminal 20 receives the result of the presence / absence of the problem. If there are no problems, it will be judged. In this case, the gate terminal 20 transmits the examination result and registers it in the external system (S304).

  And the gate terminal 20 opens the gate apparatus 70, and displays the guidance which prompts a traveler to pass. As a result, the traveler can pass through the departure gate and proceed to the departure area to board an international flight aircraft (S305).

  If there is a problem in the gate examination, the gate terminal 20 displays a guide for the traveler to proceed to the manned examination (S307).

  The detailed flow of the personal authentication S302 in the examination flow will be described with reference to FIG.

  The authentication that authenticates that the traveler and the passport holder (the person listed on the passport) are the same person is performed by comparing the face image taken of the traveler with the face image registered and stored for the passport. Do. In the collation, feature values are extracted from each face image (hereinafter, “face image” may mean a feature value), and when the similarity between feature values exceeds a predetermined value, a traveler and a passport Judge that the owner matches.

  With regard to face image authentication, a subject's face may change, and the person may be rejected even though the person is the person. For example, the appearance of the face may change due to the presence or absence of wrinkles, weight change, injury or illness, and authentication may not be possible. If the similarity threshold is lowered in order to increase the authentication rate, there is a possibility that others will be accepted.

  In this regard, by assuming a change in the face of the person using a plurality of registered face images to be compared, authentication can be performed in consideration of variations in the face image. For example, if it matches with any one of a plurality of face images that are recognized and registered as the person, the person is authenticated, or as described in Patent Document 1, the person is authenticated with an overall score compared with a plurality of templates. To do.

  The comparison with a plurality of templates is based on the premise that the traveler has already traveled many times and the face image history has been accumulated. However, at present, immigration control work under the jurisdiction of the Ministry of Justice does not link past passports when a passport is renewed or reissued. For this reason, the number of face image data stored in the face image history DB is small and the user authentication performance may be deteriorated when leaving home immediately after the update. Therefore, in this embodiment, the identity authentication is performed as follows, and the identity authentication and examination are performed by using the face image related to the past passport.

  In the gate terminal 20, the face image photographing device 50 photographs the face image of the traveler, and the passport IC information reading device 80 acquires a face image from the passport IC. Then, the face image collating unit 201 collates the acquired face image with the photographed face image (S310). If the result of the collation is “match”, the gate terminal 20 examines that the personal authentication is successful (S303). As a result of the collation, when it is “mismatch”, the passport IC information and the photographed face image are transmitted from the gate terminal 20 to the template collation system 10 and an authentication request is made.

  When the template verification system 10 receives the passport IC information and the photographed face image, the template search unit 101 searches the template database 112 using the passport number included in the passport IC information as a search key. If there is a matching passport number, the collation unit 102 collates the photographed face image with the template corresponding to the matched passport number in the template database (S311). The collation is performed in the same manner as the face image collating unit 201 of the gate terminal 20, but the similarity threshold may be changed. If the result of the collation is “match”, the fact that the personal authentication is successful is transmitted to the gate terminal 20 and the examination at the gate terminal 20 is performed (S303).

  If the collation results in “mismatch”, the template retrieval unit 101 searches the face image history database 111 using the passport number included in the passport IC information as a search key, and the collation unit 102 determines the latest photographed face image. Then, a past photographed face image corresponding to the matched passport number in the face image history database is collated (S312). If the result of the collation is “match”, the fact that the personal authentication has succeeded is transmitted to the gate terminal, and the examination at the gate terminal 20 is performed (S303).

  When it becomes “mismatch”, the template search means 103 checks whether other data of the passport holder is in the template database (S313). This is because there is a possibility that there is data with the same owner but different passport numbers because a new passport number is given in reissue or passport renewal due to a lost passport.

  Here, the template (passport) is narrowed down and face image authentication is performed as follows, thereby saving labor and speeding up the processing and improving the authentication accuracy as compared with the case of matching all the templates with the face image. As information used for narrowing down templates, for example, “birth date”, “first and last name”, and “gender” that are also present in the template database 112 in the passport IC information are used. First, since it cannot be assumed that the date of birth of the passport holder will be changed, only the same date of birth is targeted for narrowing down. Next, there is a case where the family name is changed due to marriage etc. for narrowing down by first and last name (using kanji or romaji), but at this time the passport is switched and issued (passport number changes) It is thought that there is not much. On the other hand, the name (First Name) is rarely changed. Therefore, the matching of the first name is essential by the search, and the one with the same last name is given priority. Furthermore, the gender may be indispensable because it is considered that there are only a few cases where the gender is changed, but may be arbitrary because it is considered that the gender can be roughly identified by name. Further, when the passport issuance order is known from the passport issuance date or passport number, the passport issued after the latest passport owned by the traveler may be excluded. In this way, the templates to be collated are narrowed down using at least one of the date of birth, first name, and sex.

  If “No candidate” after the above-mentioned narrowing down, the examination is conducted by manned examination (S307).

  When there is a target template candidate, collation is performed with the photographed face image and all candidate templates (S314). The matching and identity determination may take into account the degree of coincidence of the passport IC information in addition to the similarity in the face image. For example, according to the degree of coincidence of the passport IC information, such as when the first and last names match, the similarity threshold for judging the face image as a match is higher than when only the first name matches, You may change the threshold value of the similarity of a face image. Alternatively, the similarity score of face images and the score of coincidence of passport IC information may be added together for determination. If the result of the collation is “match”, it is assumed that the traveler has possessed the passport for the template in the past, and the identity authentication succeeds with the face image of the template. Then, the success of authentication is notified to the gate terminal 20, and the gate terminal 20 is examined (S307).

  If “mismatch” is determined in S314, the face image history database 111 is searched using the passport number of the template candidate as a key, and the latest photographed face image matches the face image history database by the matching means 106. A past photographed face image corresponding to the passport number is collated (S315). The collation is performed in the same manner as S314. If the result of the collation is “match”, it is determined that the identity authentication has been successful, and the gate terminal 20 performs an examination (S303). If there is no match, the examination is performed in the manned examination S307. .

  If the personal authentication is successful, the following processing is performed. These processes may be performed before or after the gate examination S307 as long as they are performed without delay after successful authentication, and the order of these processes may be changed.

  If the personal authentication is successful, in either case, the template collation system 10 registers the photographed face image in the face image history database 111 (S316). This is to keep the archive and use it for identity verification in later examinations.

  If the current passport number template cannot be used to authenticate the person and the other image has been successfully authenticated, a template is created based on the latest photographed face image and the template corresponding to the passport number is updated (S317). This is because it is considered that the template is not appropriate because the identity could not be authenticated even if the currently registered template was used. As an example of a template to be newly registered, a photographed image that is the latest face image is used, but instead of this, a template may be registered based on a template or a past face image used when the personal authentication is successful. If the personal authentication is successful with the face image history database, the template for the past passport number, or the data for the past face image database, this processing is performed.

  Further, when the user authentication is successful with the template related to the past passport number or the data related to the face image history database of the past passport, the past passport number corresponding to the matched template etc. In 108, association is performed by registering the relevant passport number corresponding to the latest passport number in the template database 112 (S318). The related passport number may be entered in the past passport number in a new passport template, or may be entered in both and referred to each other. Thereby, the latest passport number concerning the possession of the same traveler and the past passport number can be linked.

  When linked as a related passport number, the following processing can be performed.

  In the next and subsequent examinations, a passport template or the like related to the relevant passport number can be used for identity authentication. Even if the face image associated with the current passport number cannot be authenticated (after S312) and the relevant passport number is entered in the template database, the face image is verified using the template and face image history associated with the relevant passport number. In the case where it is determined that they match, the person's personal location can be obtained. By performing this before narrowing down target template candidates related to other passport numbers and proceeding to face image collation (S313 to 315), it is possible to improve the efficiency of personal authentication.

  In the gate examination and the manned examination, the examination can be performed using the information associated with the related passport number.

  In addition, it is possible to refer to the departure / return history of the same person related to a plurality of passport numbers by using the related passport numbers. Even if there is no problem in the identity authentication, the related passport number may be entered by performing a process of linking with a past passport in order to create an integrated departure and return record.

  FIG. 9 shows the integrated departure and return history. The departure / arrival history is created, for example, by the examiner's terminal when displaying the information of the person to be examined in the manned examination, or by the immigration control system in advance by batch processing. Specifically, the traveler's passport IC is read to obtain travel history information (not shown) of the latest passport number, and the presence or absence of the relevant passport number in the template database is checked. When there is a related passport number, the travel history information of the related passport number is acquired and integrated in time series based on the date of issue or the travel date.

  FIG. 9 shows the departure and return history integrated in this way. In this example, the passport number is changed twice by updating the passport and changing the surname, but it is possible to refer to the input / output history of past passports. By selecting each departure and return history, it is possible to display detailed examination information including face images taken at the time of examination. The immigration control system stores the examination result (exit and departure history) after examination (for example, S304 in FIG. 7), and the passport IC information and date / time are recorded in the examination result. If this is used, the date / time and departure / returning country classification can be displayed in a list.

  On the day of travel, a list of passengers is sent from the airline to the Immigration Bureau. By matching the passport number and recording the flight name and the destination of the flight in the departure / return history, it is possible to record the flight name and destination, and the departure / return history including the destination as shown in FIG. Can be created.

  In addition, if a normal departure is performed, the departure record and the return record are paired. Even when a passport is issued outside the country, there should be a departure history corresponding to this when returning home. If the departure and return history is integrated as in the present embodiment, the combination of departure and return can be checked, and the examination accuracy can be improved.

  The present invention has been described above. In the present invention, a face image is used as biometric information. However, the present invention is not limited to this, and other biometric information such as a fingerprint, a vein (finger, palm), and an iris may be used. In addition, although the subject is unmanned screening, it may be an auxiliary function for manned screening. Moreover, although the object was explained in the immigration examination of the Japanese who is the national, the immigration examination of the foreigner who is the visitor (the second visit to Japan with past immigration data) may be the object.

  DESCRIPTION OF SYMBOLS 10 ... Template collation system, 20 ... Gate terminal, 30 ... Immigration system, 40 ... Network, 50 ... Face image photographing device, 60 ... Display, 70 ... Input device 80 ... Passport IC information reading device, 90 ... gate device, 100 ... control unit, 101 ... template search means, 102 ... collation means, 103 ... template management means, DESCRIPTION OF SYMBOLS 110 ... Memory | storage part, 111 ... Face image history database, 112 ... Template database, 113 ... Passport IC information, 200 ... Control part, 201 ... Photographed face image sign means.

Claims (8)

Biometric information acquisition means for acquiring biometric information from the subject's biometric body,
A passport information acquisition means for acquiring passport information from the passport of the person to be examined;
Collation means for collating the acquired biometric information with biometric information as a template;
Based on the acquired passport information, screening means for screening,
With
In an immigration system that performs immigration based on the result of the matching and the examination,
The acquired passport information includes a passport number and other personal information,
The immigration system, wherein biometric information as a template related to a different passport number is selected as a template used for the collation using the other personal information. In claim 1,
An immigration system that links the different passport number and the passport number of the person to be examined when the acquired biometric information and the template of the different passport number are successfully verified. In claim 1,
Either the date of birth or the name is used as the other personal information. In claim 3,
As the other personal information, either a gender or a surname is further used. In claim 3,
An immigration check system, wherein a threshold value for successful collation for collating the biometric information is changed based on the degree of coincidence of the other personal information. In claim 1,
The biometric information as a template related to the passport number is matched with the biometric information acquired from the living body,
An immigration system characterized by selecting and collating templates for different passport numbers using the other personal information when collation fails. In claim 2,
Based on the linkage of the passport information, obtain a plurality of passport numbers for the same person,
An immigration system for obtaining an immigration record for each of the plurality of passport numbers and creating an integrated immigration record. A biological information acquisition step in which the biological information acquisition means acquires biological information from the subject's biological body;
A passport information acquisition means for acquiring passport information from the passport of the person to be examined;
A collating step for collating the acquired biometric information with the biometric information as a template;
A screening process in which screening means performs screening based on the acquired passport information; and
And
Based on the verification result and the examination result,
The acquired passport information includes a passport number and other personal information,
An immigration check method, wherein biometric information as a template related to a different passport number is selected as a template used for the collation using the other personal information.

Images