JP7615822B2 - Information processing device, information processing method, program, and information processing system - Google Patents

Description

The present invention relates to an information processing device, an information processing method, a program, and an information processing system.

In recent years, technology has been developed to detect the possibility of counterfeiting of an identification document from image data of the identification document in non-face-to-face identification related to the document. For example, Patent Document 1 discloses a technology that compares a specific part of a user's driver's license with a specific part of a reference driver's license to determine whether the user's driver's license is genuine.

JP 2006-11866 A

However, while the technology described in Patent Document 1 can identify counterfeit driver's licenses based on their layout and various printed contents, it is difficult to determine, for example, whether the facial photograph on the driver's license is that of the license holder.

The present invention has been made in consideration of the above problems, and an object of the present invention is to provide a new and improved information processing device, information processing method, program, and information processing system that can determine the validity of a facial photograph being the owner's facial photograph.

In order to solve the above problem, according to one aspect of the present invention, there is provided an information processing device comprising: an estimation unit that estimates standard feature information related to the outer frame of the photograph included in the photo identification document based on the printed information using an estimator obtained by learning the relationship between printed information included in the photo identification document and feature information related to the outer frame of the photograph included in the photo identification document; and a determination unit that determines the validity of the photograph included in the photo identification document being the photograph of the owner of the photo identification document based on the standard feature information and the feature information related to the outer frame of the photograph included in the photo identification document .

The determination unit may determine whether the facial photograph included in the photo identification document is the facial photograph of the owner based on the position of the outer frame of the facial photograph included in the photo identification document.

The determination unit may determine whether the facial photograph included in the photographic identification document is the facial photograph of the owner based on the distance from the position of predetermined information included in the photographic identification document to each vertex of the outer frame of the facial photograph.

The information processing device may further include a recognition unit that recognizes, as the outer frame of the facial photograph, straight lines included in a predetermined range of the photographic identification document, at least one of whose length or angle satisfies a predetermined condition.

The printed information may include at least one of the issuer information and the date of issue contained in the photo identification document.

In order to solve the above problem, according to another aspect of the present invention, there is provided an information processing method executed by a computer, which includes: estimating standard feature information related to the outer frame of the photograph included in the photo identification document based on the printed information using an estimator obtained by learning the relationship between printed information included in the photo identification document and feature information related to the outer frame of the photograph included in the photo identification document; and determining the validity that the photograph included in the photo identification document is a photograph of the owner of the photo identification document based on the standard feature information and the feature information related to the outer frame of the photograph included in the photo identification document .

In order to solve the above problem, according to another aspect of the present invention, there is provided a program that causes a computer to realize an estimation function of estimating standard feature information related to the outer frame of the photograph included in the photo identification document based on the printed information, using an estimator obtained by learning the relationship between printed information included in the photo identification document and feature information related to the outer frame of the photograph included in the photo identification document, and a determination function of determining, based on the standard feature information and the feature information related to the outer frame of the photograph included in the photo identification document , whether the photograph included in the photo identification document is a photograph of the owner of the photo identification document.

In order to solve the above problem, according to another aspect of the present invention, there is provided an information processing system including: a storage device including a database unit that stores a photo ID document; an information processing device including: a storage device including a database unit that stores a photo ID document; an estimation unit that estimates standard feature information related to the outer frame of the photograph included in the photo ID document based on the printed information using an estimator obtained by learning the relationship between printed information included in the photo ID document and feature information related to the outer frame of the photograph included in the photo ID document; and a determination unit that determines the validity of the photograph included in the photo ID document being the photograph of the owner of the photo ID document based on the standard feature information and the feature information related to the outer frame of the photograph included in the photo ID document obtained from the storage device.

As described above, the present invention provides a new and improved information processing device, information processing method, program, and information processing system that can determine the validity of a facial photograph being the owner's facial photograph.

FIG. 1 is an explanatory diagram illustrating an example of an information processing system according to an embodiment of the present invention. 2 is an explanatory diagram for explaining an example of the functional configuration of the examination terminal 10 and the examination system 20 according to the present embodiment. FIG. FIG. 2 is an explanatory diagram for explaining an example of a functional configuration of a server 30 according to the present embodiment. 11 is an explanatory diagram for explaining a specific example of a process for determining the validity of a face photo of the owner from a driver's license. FIG. FIG. 2 is an explanatory diagram for explaining an example of an operation process of the information processing system according to the embodiment. 10 is an explanatory diagram for explaining an example of an operation process of the server 30 according to the embodiment. FIG. FIG. 2 is a block diagram showing a hardware configuration of a server 30 according to the present embodiment.

The preferred embodiment of the present invention will be described in detail below with reference to the attached drawings. Note that in this specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals to avoid redundant description.

<<1. Overview of the information processing system>>
When using a service provided by a government or private company, a user may submit a photo ID to prove the user's identity in addition to application data. A verifier from the government or private company must then verify the various data submitted. For example, the verifier checks the details of the application data and checks the image data of the photo ID to see if there is anything unusual about the various printed information included in the photo ID and whether the photo has been tampered with.

When verifying such non-face-to-face photo IDs, for example when the ID is elaborately crafted by meticulously pasting another person's photo onto the document, it can be difficult for the verifying party to determine whether the photo is that of the owner of the ID.

Therefore, the information processing system according to this embodiment determines the validity of a facial photograph being that of the owner based on characteristic information about the outer frame of the facial photograph included in the photograph-attached identification document.

Below, we will explain in order the technology that the information processing system according to this embodiment uses to determine whether the face photo included in a photo-attached identification document is the face photo of the owner. First, we will explain the overview of the information processing system with reference to Figure 1.

FIG. 1 is an explanatory diagram for explaining an example of an information processing system according to this embodiment. The information processing system according to this embodiment has a network 1, an examination terminal 10, an examination system 20, and a server 30.

(Network 1)
The network 1 connects the examination terminal 10 and the examination system 20, and also connects the examination system 20 and the server 30. For example, the network 1 includes a wide area Internet line or a dedicated line using a communication cable such as an Ethernet cable for communication conforming to a standard such as IEEE.

(Examination terminal 10)
The examination terminal 10 is an information processing terminal for verifying an identity document. For example, the examination terminal 10 may be a PC (Personal Computer) or a smartphone. In the following description, an example in which the examination terminal 10 is a PC as shown in FIG. 1 will be mainly described.

(Examination System 20)
The screening system 20 holds the application data of the user and the image data of the identification document. The screening system 20 according to the present embodiment may be, for example, a PC or a server.

For example, a terminal of a user who uses a certain service transmits application data and image data of a photo ID to the review system 20. Then, when a reviewer selects the user's application during review, the review system 20 transmits the application data and image data of the photo ID to the server 30. Note that in the following explanation, the image data of the photo ID may be referred to simply as a photo ID.

(Server 30)
The server 30 is an example of an information processing device, and determines the validity of the facial photograph included in the photo identification document being the facial photograph of the owner, based on characteristic information related to the outer frame of the facial photograph included in the photo identification document.

An example of an information processing system according to this embodiment has been described above. Next, with reference to FIG. 2, an example of the functional configuration of the screening terminal 10 and screening system 20 according to this embodiment will be described.

<<2. Example of Functional Configuration of Examination Terminal 10 and Examination System 20>>
2 is an explanatory diagram for explaining an example of a functional configuration of the examination terminal 10 and the examination system 20 according to the present embodiment. First, an example of a functional configuration of the examination terminal 10 according to the present embodiment will be described.

As shown in FIG. 2, the examination terminal 10 according to this embodiment includes an operation unit 11, a display unit 13, a control unit 15, and a communication unit 17.

The operation unit 11 accepts operation input from the reviewer. For example, the operation unit 11 allows the reviewer to select the review target.

The operation unit 11 may be, for example, various input devices such as a mouse or a keyboard.

The display unit 13 displays the application data and identity verification documents. The display unit 13 also displays the validity, which is the face photo of the owner received from the screening system 20.

The display unit 13 may be, for example, a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, or an OLED (Organic Light Emitting Diode) device.

The control unit 15 controls the overall operation of the examination terminal 10. For example, the control unit 15 controls various communications by the communication unit 17.

The communication unit 17 performs various communications with the review system 20. For example, the communication unit 17 transmits information about the review subject selected by the user to the review system 20.

In addition, the communication unit 17 receives information from the screening system 20 regarding the validity of the facial photograph included in the photo-attached identification document determined by the server 30 being the facial photograph of the owner.

Above, an example of the functional configuration of the screening terminal 10 according to this embodiment has been described. Next, an example of the functional configuration of the screening system 20 according to this embodiment will be described.

As shown in FIG. 2, the examination system 20 according to this embodiment includes a database unit 21, a control unit 23, and a communication unit 25.

The database unit 21 stores various customer information such as application data and image data of photo identification documents corresponding to the application data.

The control unit 23 controls the overall operation of the screening system 20. For example, the control unit 23 controls various communications by the communication unit 25.

The communication unit 25 performs various communications with the examination terminal 10. The communication unit 25 also performs various communications with the server 30.

For example, the communication unit 25 receives information about the subject of the review from the review terminal 10, and transmits application data and a photo ID document corresponding to the subject of the review to the server 30.

The communication unit 25 also receives the judgment results of the subject of the examination from the server 30 and transmits the judgment results to the examination terminal 10.

The above describes an example of the functional configuration of the screening system 20 according to this embodiment. Next, with reference to FIG. 3, we will describe an example of the functional configuration of the server 30 according to this embodiment.

<<3. Example of functional configuration of server 30>>
3 is an explanatory diagram for explaining an example of a functional configuration of the server 30 according to the present embodiment. As shown in FIG. 3, the server 30 according to the present embodiment includes a database unit 31, a communication unit 33, and a control unit 35.

The database unit 31 holds master data of a standard photo identification document.

The communication unit 33 performs various communications with the screening system 20. For example, the communication unit 33 receives image data of the photo ID document that is the subject of screening from the screening system 20. The communication unit 33 also transmits to the screening system 20 a determination result indicating the validity of the face photo on the photo ID document being the face photo of the owner.

The control unit 35 controls the overall operation of the server 30. As shown in FIG. 3, the server 30 includes a recognition unit 351, a learning unit 353, an estimator 355, and a determination unit 357.

The recognition unit 351 recognizes various printed information and facial photographs contained in the photographic identification document received from the screening system 20.

In addition, the recognition unit 351 recognizes the outer frame of the facial photograph contained in the photographic identification document received from the screening system 20.

For example, the recognition unit 351 may recognize, as the outer frame of the facial photograph, straight lines included within a predetermined range of the photographic identification document, the straight lines whose length or angle at least satisfy a predetermined condition. This allows the recognition unit 351 to recognize the outer frame of the facial photograph with higher accuracy without recognizing lines of the face, clothing, or face included in the photograph as the outer frame of the facial photograph.

The recognition unit 351 may also perform a process to convert the pixels of the photo identification document into a predetermined number. This allows the recognition unit 351 to recognize various printed information and the photo with higher accuracy.

The recognition unit 351 may also recognize feature information related to the outer frame of the facial photograph contained in the photographic identification document received from the screening system 20. Specific examples of feature information related to the outer frame of the facial photograph will be described later.

The learning unit 353 generates learning data using machine learning technology that uses a combination of print information on a photo-attached identification document and feature information related to the outer frame of the photo as training data.

The estimator 355 is an example of an estimation unit, and inputs the user's identification document with a facial photograph and estimates feature information related to the outer frame of the facial photograph. The function of the estimator 355 is obtained by the learning data generated by the learning unit 353.

For example, the estimator 355 estimates standard feature information regarding the outer frame of the facial photograph on the user's photographic identification document based on the printed information contained in the photographic identification document.

The determination unit 357 determines whether the face photo included in the photo identification document is the face photo of the owner based on feature information related to the outer frame of the face photo included in the photo identification document. A specific example of validity determination will be described later.

The above describes an example of the functional configuration of the server 30 according to this embodiment. Next, a specific example of the determination according to this embodiment will be described with reference to FIG. 4.

<<4. Specific examples of validity determination>>
4 is an explanatory diagram for explaining a specific example of a process for determining the validity of the face photograph of the owner from the driver's license. Note that the driver's license C shown in FIG. 4 is an example of an identification document with a face photograph.

As shown in FIG. 4, driver's license C includes various printed information and a photograph. The various printed information includes, for example, the issue date W1 and issuer W2.

First, the recognition unit 351 recognizes the printed information of the driver's license C and the facial photograph from the image data of the driver's license.

The recognition unit 351 also recognizes the outer frame of the facial photograph. More specifically, the recognition unit 351 recognizes a straight line connecting points P1 and P2, a straight line connecting points P2 and P3, a straight line connecting points P3 and P4, and a straight line connecting points P4 and P1, which are on the outer frame of the facial photograph.

The recognition unit 351 then recognizes characteristic information about each recognized line. Note that the characteristic information about each line includes various information such as the position, length, angle, and width of each line.

For example, the recognition unit 351 may recognize the position of each straight line using the distance from specific printed information included in the driver's license C to each vertex on the outer frame of the facial photograph. More specifically, the recognition unit 351 may calculate the distance from the printed information W3, "Driver's License," to each of points P1, P2, P3, and P4 on the outer frame of the facial photograph, and recognize the position of each straight line using the calculated distances.

Next, the estimator 355 estimates standard feature information related to the outer frame of the facial photograph based on the print information recognized by the recognition unit 351. The standard feature information includes various information such as the position, length, angle, or thickness of the reference straight line.

For example, the estimator 355 estimates standard feature information regarding the outer frame of the facial photograph based on the issue date w1 and issuer w2 contained in the driver's license C.

Then, the judgment unit 357 compares the feature information regarding the outer frame of the facial photograph on the driver's license C with the standard feature information, and based on the result of the comparison, judges the validity that the facial photograph included in the driver's license C is the facial photograph of the owner of the driver's license C.

For example, the determination unit 357 may perform a similarity evaluation between the feature information of the outer frame of the facial photograph on the driver's license C and the standard feature information, and determine the result of the similarity evaluation as the validity of the photograph being the owner's facial photograph.

A specific example of the process for determining the validity of the owner's facial photograph from a driver's license according to this embodiment has been described above. Next, the operation of the information processing system according to this embodiment will be described in sequence with reference to Figures 5 and 6.

<<5. Operation Processing Example of Information Processing System According to This Embodiment>>
5 is an explanatory diagram for explaining an example of an operation process of the information processing system according to the present embodiment. First, in the examination terminal 10, the unexamined data is inquired by the verifying person, and an examination target is selected (S101).

Then, the screening system 20 transmits the identity verification documents selected by the reviewer as the subject of screening to the server 30 (S105).

Next, the server 30 receives the identity verification document (S109).

Then, the server 30 determines whether the facial photograph on the received identification document is the facial photograph of the owner (S113).

Then, the server 30 transmits the validity of the received identification document being the owner's facial photograph as the determination result (S117).

Then, the screening system 20 receives the judgment result of the screening target and transmits the judgment result to the screening terminal 10 (S121).

Then, the examination terminal 10 displays the received judgment result (S125).

Then, the review terminal 10 performs review and judgment by the reviewer (S129), and the information processing system according to this embodiment ends its operation processing.

The above describes an example of the operation process of the information processing system according to this embodiment. Next, with reference to FIG. 6, we will describe an example of the operation process in which the server 30 according to this embodiment determines whether the face photo on the personal identification document is the face photo of the owner.

Figure 6 is an explanatory diagram for explaining an example of the operation process of the server 30 according to this embodiment. First, the communication unit 33 receives the user's identification document with a facial photograph (S201).

Next, the recognition unit 351 recognizes the application data, various printed information, and the facial photograph, and the server 30 determines whether the various printed information is correct (S205). If the various printed information is correct (S205/Yes), the process proceeds to S209, and if the various printed information is incorrect (S205/No), the process of the server 30 according to this embodiment ends.

If the various printed information is correct (S205/Yes), the recognition unit 351 detects characteristic information related to the outer frame of the facial photograph included in the identification document (S209).

Then, the estimator 355 estimates standard feature information based on the printed information contained in the user's identification document (S213).

Next, the determination unit 357 determines the validity of the facial photograph included in the user's identification document being the owner's facial photograph based on the characteristic information regarding the outer frame of the facial photograph on the user's identification document and the standard characteristic information (S217).

Then, the communication unit 33 transmits the validity of the photograph being the owner's face as a judgment result to the review system 20 (S221), and ends the operation processing of the server 30 according to this embodiment.

The above describes an example of the operation process of the server 30 according to this embodiment. Next, we will explain the effects of this embodiment.

<<6. Effects of the Present Embodiment>>
According to the present embodiment described above, various operational effects can be obtained. For example, the server 30 according to the present embodiment can provide the verifying person with the validity that the face photograph included in the identification document is the face photograph of the owner, so that the verifying person can determine with higher accuracy whether the identification document has been tampered with.

In addition, using the data learned by the learning unit, the estimator 355 estimates standard feature information for the outer frame of the facial photograph based on the print information included in the identification document. This allows the determination unit 357 to determine with higher accuracy the validity of the photograph being the owner's facial photograph based on the standard feature information for the outer frame of the facial photograph, which may vary depending on the issuer and date of issue of the identification document.

<<7. Hardware configuration of the server 30 according to this embodiment>>
The information processing described above is realized by cooperation between the software and the hardware of the server 30 described below. The hardware configuration described below is also applicable to the examination terminal 10 and the examination system 20.

Figure 7 is a block diagram showing the hardware configuration of the server 30 according to this embodiment. The server 30 can include a CPU (Central Processing Unit) 302, a ROM (Read Only Memory) 304, a RAM (Random Access Memory) 306, an internal bus 308, an input/output interface 310, a display unit 312, an input unit 313, an audio output unit 314, a storage unit 315, a drive 316, a network interface 317, and an external interface 318.

The CPU 302 functions as an arithmetic processing device and control device, and controls the overall operation of the server 30 in accordance with various programs. By the CPU 302 working in conjunction with the ROM 304, RAM 306, and software described below, functions such as the recognition unit 351, the estimator 355, and the determination unit 357 can be realized.

The ROM 304 stores the programs and calculation parameters used by the CPU 302. The RAM 306 temporarily stores the programs used during execution by the CPU 302, as well as parameters that change as appropriate during the execution.

The CPU 302, ROM 304, and RAM 306 are interconnected by an internal bus 308, and are further connected via an input/output interface 310 to a display unit 312, an input unit 313, an audio output unit 314, a memory unit 315, a drive 316, a network interface 317, and an external interface 318, which will be described later.

The display unit 312 is a display device such as a CRT display device, a liquid crystal display (LCD), or an OLED device, and converts video data into video and outputs it. The input unit 313 may be composed of input means for members to input information, such as a mouse, keyboard, touch panel, button, microphone, sensor, switch, or lever, and an input control circuit that generates an input signal based on the member's input and outputs it to the CPU 302. The audio output unit 314 is an audio output device such as a speaker or headphones, and converts audio data into audio and outputs it.

The storage unit 315 is a data storage device configured as an example of the database unit 31 according to this embodiment. The storage unit 315 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, and a deleting device that deletes data recorded on the storage medium. The storage unit 315 is configured, for example, with a HDD (Hard Disk Drive) or SSD (Solid Storage Drive), or a memory with equivalent functions. This storage unit 315 drives the storage and stores programs executed by the CPU 302 and various data.

Drive 316 is a reader/writer for storage media, and is built into server 30 or attached externally. Drive 316 reads information stored in a removable storage medium, such as an attached magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to RAM 306. Drive 316 is also capable of writing information to the removable storage medium.

The network interface 317 is a communication interface that is configured with devices for connecting to a communication network such as the Internet. The network interface 317 may be a communication device that supports a wired LAN (Local Area Network) or a wireless LAN, or may be a wired communication device that performs wired communication.

The external interface 318 is a connection interface consisting of connection ports for connecting external devices, such as a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface) port, an RS-232C port, or an optical audio terminal.

<<8. Supplementary Information>>
Although the preferred embodiment of the present invention has been described in detail above with reference to the accompanying drawings, the present invention is not limited to such an example. It is clear that a person having ordinary knowledge in the technical field to which the present invention pertains can conceive of various modified or altered examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present invention.

For example, the steps in the processing of the operation of the examination terminal 10, examination system 20, and server 30 according to this embodiment do not necessarily have to be processed chronologically in the order described in the explanatory diagram. For example, each step in the processing of the operation of the examination terminal 10, examination system 20, and server 30 may be processed in an order different from the order described in the explanatory diagram, or may be processed in parallel.

It is also possible to create a computer program that causes hardware such as the CPU, ROM, and RAM built into the examination terminal 10, examination system 20, and server 30 to perform functions equivalent to those of the above-mentioned components of the examination terminal 10, examination system 20, and server 30.

REFERENCE SIGNS LIST 10 Examination terminal 11 Operation unit 13 Display unit 15 Control unit 17 Communication unit 20 Examination system 21 Database unit 23 Control unit 25 Communication unit 30 Server 31 Database unit 33 Communication unit 35 Control unit 351 Recognition unit 353 Learning unit 355 Estimator 357 Determination unit

Claims (8)

an estimation unit that estimates standard feature information related to the outer frame of the facial photograph included in the facial photograph identification document based on the printed information using an estimator obtained by learning the relationship between printed information included in the facial photograph identification document and feature information related to the outer frame of the facial photograph included in the facial photograph identification document;
a determination unit that determines whether the face photograph included in the photo identification document is a face photograph of the owner of the photo identification document based on the standard feature information and feature information related to the outer frame of the face photograph included in the photo identification document ;
An information processing device comprising: The determination unit is
determining whether the face photograph included in the photo identification document is a face photograph of the owner based on the position of an outer frame of the face photograph included in the photo identification document;
The information processing device according to claim 1 . The determination unit is
determining whether the face photograph included in the photo identification document is the face photograph of the owner based on the distance from a position of predetermined information included in the photo identification document to each vertex of the outer frame of the face photograph;
The information processing device according to claim 2 . The information processing device includes:
a recognition unit that recognizes, among straight lines included in a predetermined range of the identification document with a face photograph, straight lines whose length or angle at least satisfies a predetermined condition as an outer frame of the face photograph;
The information processing device according to claim 1 , further comprising: The printed information includes at least one of issuer information and issue date information included in the photo identification document,
The information processing device according to any one of claims 1 to 4 . Estimating standard feature information related to the outer frame of the facial photograph included in the photograph identification document based on the printed information using an estimator obtained by learning the relationship between the printed information included in the photograph identification document and feature information related to the outer frame of the facial photograph included in the photograph identification document;
determining whether the face photograph included in the photo identification document is a face photograph of the owner of the photo identification document based on the standard feature information and feature information related to the outer frame of the face photograph included in the photo identification document ;
2. An information processing method implemented by a computer, comprising: On the computer,
an estimation function for estimating standard feature information related to the outer frame of a facial photograph included in a facial photograph identification document based on the printed information, using an estimator obtained by learning the relationship between the printed information included in the facial photograph identification document and feature information related to the outer frame of the facial photograph included in the facial photograph identification document; and
a judgment function for judging whether the face photograph included in the photo identification document is a face photograph of the owner of the photo identification document based on the standard feature information and feature information related to the outer frame of the face photograph included in the photo identification document ;
A program to achieve this. A database section that holds identity documents with photographs of faces;
A storage device comprising:
an estimation unit that estimates standard feature information related to the outer frame of the facial photograph included in the facial photograph identification document based on the printed information using an estimator obtained by learning the relationship between the printed information included in the facial photograph identification document and feature information related to the outer frame of the facial photograph included in the facial photograph identification document;
a determination unit that determines whether the face photograph included in the photo identification document is a face photograph of the owner of the photo identification document based on the standard feature information and feature information related to the outer frame of the face photograph included in the photo identification document acquired from the storage device;
An information processing device comprising:
An information processing system comprising:

Images