JP2008085584A - Monitoring device and method, monitoring system, and program - Google Patents

Abstract

When a problem occurs in a vehicle using a parking lot, a driver of the vehicle is searched for in the store, and prompt return to the vehicle is urged.
A face image acquisition unit 228 acquires a face image of a player who is a person to be collated playing on a game table, and a similarity calculation unit 252 stores a face image registered as the vehicle face image information. The similarity determination unit 253 registers the visitor's face image in the corresponding vehicle face image information by comparing the similarity as a comparison result with a predetermined threshold value. The game store management device 24 determines that the face image of the person to be collated is a face image registered in the corresponding vehicle face image information. A screen that prompts the player to stop the game of the imaged game table and return to the vehicle is displayed. The present invention can be applied to a monitoring system.
[Selection] Figure 14

Description

  The present invention relates to a monitoring device, a monitoring method, a monitoring system, and a program, and more particularly, to a monitoring device and method, a monitoring system, and a program that can easily call a passenger of a vehicle parked in a parking lot.

  When an abnormality occurs in a vehicle parked in a parking lot, there is an increasing demand for notification technology to the owner of the vehicle.

  As a conventional vehicle abnormality information notification system, a technique has been proposed in which a dedicated device is installed in the vehicle body so that when the abnormality is detected by the dedicated device, the driver is notified of the vehicle abnormality (Patent Document). 1).

JP 2001-160192 A

  However, in the above method, it is necessary to install a dedicated device on the vehicle body, and parents who leave an infant in the vehicle and go to a commercial facility such as an amusement store or department store do not necessarily install the dedicated device on their own intention. Therefore, it is not always effective as a means for reporting vehicle abnormality.

  In addition, while the accident caused by leaving an infant in a car has become a social problem, the store manager has also tried to prevent the accident by patroling the staff in the parking lot. Even if a parking trouble such as parking or leaving an infant in the car is discovered, the information on the relevant vehicle that the clerk and the store can surely know is only the vehicle registration information (vehicle number), so the driver of the relevant vehicle is called The means was to broadcast the vehicle number in the store and wait for the driver of the vehicle to voluntarily return to the vehicle.

  In other words, if the driver fails to hear the in-store broadcast, or intentionally ignores the in-store broadcast or forgets the number of the vehicle, for example, the driver needs to play the in-store broadcast again. Even if this occurs, the driver does not always return to the corresponding vehicle promptly.

  The present invention has been made in view of such a situation, and when a trouble occurs in a vehicle using a parking lot, the driver of the corresponding vehicle is searched in the store and prompts to return to the corresponding vehicle promptly. It is intended to make it.

  The monitoring apparatus according to the first aspect of the present invention includes a registration unit that registers vehicle registration information of a vehicle entering a parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other. Of the vehicles parked in the parking lot, corresponding vehicle image capturing means for capturing an image of the corresponding vehicle, and corresponding vehicle registration information for extracting the vehicle registration information from the image of the corresponding vehicle imaged by the corresponding vehicle image capturing means. Based on the vehicle registration information of the relevant vehicle extracted by the extraction means and the relevant vehicle registration information extraction means, the vehicle registration database registered by the registration means is registered in association with the vehicle registration information of the relevant vehicle. Search means for searching for a face image, vehicle registration information searched by the search means, and face images registered in association with the searched vehicle registration information As the vehicle face image information, face image obtaining means for obtaining the face image of the person to be collated at a predetermined position, face image of the person to be collated obtained by the face image obtaining means, The similarity of the face image registered as the vehicle face image information is calculated and compared, and the face of the store visitor is compared by comparing the similarity as a result of the verification by the verification unit with a predetermined threshold. Similarity determination means for determining whether or not the image is a face image registered in the relevant vehicle face image information, and the face image of the person to be collated is converted into the relevant vehicle face image information by the similarity determination means. When it is determined that the face image is a registered face image, presentation means for presenting that the person to be collated acquired at the predetermined position is a passenger of the vehicle.

  An entrance vehicle imaging means for capturing an image of a vehicle entering the parking lot, an entrance vehicle registration information extraction means for extracting vehicle registration information of the vehicle from an image captured by the entrance vehicle imaging means, and the entrance vehicle An entrance vehicle face image extraction means for extracting a face image of a passenger of the vehicle from an image taken by the image pickup means, and the registration means includes the parking lot extracted by the entrance vehicle registration information extraction means. The vehicle registration information of the vehicle entering the vehicle and the face image of the person on the vehicle extracted by the entrance vehicle face image extracting means can be associated and registered as a vehicle information database.

  A collation target person imaging unit that captures an image of the collation target person, a face image extraction unit that extracts a face image of the collation target person from an image captured by the collation target person imaging unit, And a feature amount extraction unit that extracts a feature amount from the face image. The collation unit includes a face image of the person to be collated acquired by the acquisition unit, and a face image of the registrant stored in the storage unit. The feature level is used to calculate the similarity, and the face image of the person to be collated acquired by the obtaining unit and the face image of the registrant accumulated in the accumulating unit can be collated. .

  The face image acquisition means acquires a player who plays on the predetermined game table as a face image of the person to be collated, and the presentation means causes the face image of the person to be collated to be determined by the similarity determination means. When it is determined that the face image is registered in the vehicle face image information, the verification target person is presented by indicating that the verification target person acquired at the predetermined position is a passenger of the vehicle. Control means for controlling to stop the operation of the game table on which the player is playing can be further included.

  The face image acquisition means causes a player who plays on the predetermined game table to be acquired as a face image of a person to be collated, and the presenting means provides a portable terminal possessed by a clerk of a game store, When the similarity determination unit determines that the face image of the person to be collated is a face image registered in the vehicle face image information, the person to be collated acquired at the predetermined position By transmitting information indicating that the passenger is a passenger, this fact can be presented.

  The monitoring method according to one aspect of the present invention includes a registration step of registering vehicle registration information of a vehicle entering a parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other, and the parking Corresponding vehicle registration information for extracting the vehicle registration information from the corresponding vehicle imaging step of capturing an image of the corresponding vehicle among the vehicles parked in the parking lot, and the image of the corresponding vehicle imaged by the processing of the corresponding vehicle imaging step Based on the vehicle registration information of the corresponding vehicle extracted by the extraction step and the processing of the corresponding vehicle registration information extraction step, it corresponds to the vehicle registration information of the corresponding vehicle from the vehicle registration database registered by the processing of the registration step. A search step for searching for a registered face image, vehicle registration information searched by the processing of the search step, and the detection An accumulation step of accumulating face images registered in association with the registered vehicle registration information as corresponding vehicle face image information, a face image obtaining step of obtaining a face image of a person to be collated at a predetermined position, and the face In the collation step of calculating and collating the similarity between the face image of the person to be collated acquired by the process of the image acquisition step and the face image registered as the vehicle face image information, the process of the collation step A similarity determination step of determining whether or not the store visitor's face image is a face image registered in the corresponding vehicle face image information by comparing the similarity that is the result of the comparison with a predetermined threshold; When it is determined in the similarity determination step that the face image of the person to be collated is a face image registered in the vehicle face image information, the person to be collated acquired at the predetermined position And a presentation step of presenting to be a passenger of the relevant vehicle.

  The program of the first aspect of the present invention includes a registration step of registering vehicle registration information of a vehicle entering a parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other, Of the vehicles parked in the parking lot, the corresponding vehicle imaging step for capturing an image of the corresponding vehicle, and the corresponding vehicle registration for extracting the vehicle registration information from the image of the corresponding vehicle imaged by the processing of the corresponding vehicle imaging step Based on the vehicle registration information of the corresponding vehicle extracted by the information extraction step and the processing of the corresponding vehicle registration information extraction step, the vehicle registration information of the corresponding vehicle is obtained from the vehicle registration database registered by the processing of the registration step. A search step for searching for face images registered in association with each other, vehicle registration information searched by the processing of the search step, An accumulation step for accumulating the face image registered in association with the searched vehicle registration information as the corresponding vehicle face image information, a face image obtaining step for obtaining the face image of the person to be collated at a predetermined position, A collation step of calculating and collating the similarity between the face image of the person to be collated acquired by the processing of the face image acquisition step and the face image registered as the vehicle face image information; A similarity determination step of determining whether or not the store visitor's face image is a face image registered in the corresponding vehicle face image information by comparing the similarity as a comparison result in the processing with a predetermined threshold value If the face image of the person to be collated is determined to be a face image registered in the relevant vehicle face image information by the processing of the similarity determination step, the collation target acquired at the predetermined position There to execute processing including the presentation step of presenting to be a passenger of the appropriate vehicle computer.

  A monitoring system according to a second aspect of the present invention is a monitoring system comprising a monitoring device, a portable terminal held by a parking lot attendant, and a presentation device, wherein the monitoring device is a vehicle of a vehicle entering a parking lot. The vehicle registration information is extracted from a registration unit that registers registration information and a face image of a person on the vehicle in association with each other and registers it as a vehicle information database, and the image of the vehicle captured by the portable terminal. Corresponding to the vehicle registration information of the corresponding vehicle from the vehicle registration database registered by the registration means based on the vehicle registration information extracting means and the vehicle registration information of the applicable vehicle extracted by the corresponding vehicle registration information extracting means. Search means for searching for a registered face image, vehicle registration information searched by the search means, and the searched vehicle registration information. And accumulating means for accumulating the registered face image as relevant vehicle face image information, a face image obtaining means for obtaining the face image of the person to be collated at a predetermined position, and the face image obtaining means. The similarity between the face image of the person to be verified and the face image registered as the corresponding vehicle face image information is calculated and collated, the similarity that is the collation result of the collating means, and a predetermined threshold value The similarity determination means for determining whether or not the face image of the visitor is a face image registered in the corresponding vehicle face image information, and the portable terminal is parked in the parking lot. A vehicle in which a face image of the person to be collated is registered in the vehicle face image information by the similarity determination unit. Determined to be an image If, and a presentation means for presenting said predetermined collation object person acquired in position is passenger of the relevant vehicle.

  In the monitoring apparatus, method, and program according to the first aspect of the present invention, vehicle registration information of a vehicle entering a parking lot is associated with a face image of a person boarding the vehicle as a vehicle information database. Of the vehicles that are registered and parked in the parking lot, an image of the vehicle is captured, the vehicle registration information is extracted from the captured image of the vehicle, and based on the extracted vehicle registration information of the vehicle Then, the registered face registration image is searched from the registered vehicle registration database in association with the vehicle registration information of the corresponding vehicle, and the searched vehicle registration information is associated with the searched vehicle registration information. The registered face image is accumulated as relevant vehicle face image information, the face image of the person to be collated is acquired at a predetermined position, the face image of the person to be collated obtained, and the relevant vehicle The similarity with the face image registered as the image information is calculated and collated, and the face image of the visitor is compared with the vehicle face image information by comparing the similarity as the collation result with a predetermined threshold value. If the face image of the person to be collated is determined to be a face image registered in the relevant vehicle face image information, it is acquired at the predetermined position. It is presented that the person to be verified is a passenger of the vehicle.

  The monitoring system according to the second aspect of the present invention is a monitoring system comprising a monitoring device, a portable terminal held by a parking lot attendant, and a presentation device. Vehicle registration information and a face image of a person boarding the vehicle are registered as a vehicle information database in association with each other, and the vehicle registration information is extracted from the image of the vehicle picked up by the mobile terminal and extracted. Based on the registered vehicle registration information of the corresponding vehicle, the registered face registration image is searched from the registered vehicle registration database in association with the vehicle registration information of the corresponding vehicle, and the searched vehicle registration information, The face images registered in association with the searched vehicle registration information are accumulated as corresponding vehicle face image information, and the face image of the person to be collated is acquired at a predetermined position. The similarity between the acquired face image of the person to be collated and the face image registered as the vehicle face image information is calculated and collated, and the similarity as the collation result is compared with a predetermined threshold value. Thus, it is determined whether or not the face image of the visitor is a face image registered in the corresponding vehicle face image information, and among the vehicles parked in the parking lot by the portable terminal, When an image is captured and the presentation device determines that the face image of the person to be collated is a face image registered in the vehicle face image information, the person to be collated acquired at the predetermined position is It is presented that he is a passenger of the vehicle.

  In the monitoring device of the present invention, registration means for registering vehicle registration information of a vehicle entering a parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other is, for example, vehicle information registration Among the vehicles parked in the parking lot, the corresponding vehicle imaging unit that captures an image of the corresponding vehicle is, for example, an image acquisition unit, and the corresponding vehicle imaged by the corresponding vehicle imaging unit. The corresponding vehicle registration information extracting means for extracting the vehicle registration information from the image is, for example, a vehicle registration information image extracting unit, and based on the vehicle registration information of the corresponding vehicle extracted by the corresponding vehicle registration information extracting means, Search means for searching for a face image registered in association with the vehicle registration information of the vehicle from the vehicle registration database registered by the registration means is, for example, A storage means for storing both vehicle registration information searched by the search means and a face image registered in association with the searched vehicle registration information as corresponding vehicle face image information, being both registration information search sections; Is, for example, a corresponding vehicle face image information storage unit, and the face image acquisition unit that acquires the face image of the person to be collated at a predetermined position is, for example, a face image acquisition unit, which is acquired by the face image acquisition unit The collation means for calculating and collating the similarity between the face image of the person to be collated and the face image registered as the vehicle face image information is, for example, a similarity calculation section, and the collation means What is the similarity determination means for determining whether or not the face image of the visitor is a face image registered in the corresponding vehicle face image information by comparing the similarity that is the result of the comparison with a predetermined threshold value? For example, similarity determination unit Yes, if the similarity determination unit determines that the face image of the person to be verified is a face image registered in the vehicle face image information, the person to be verified acquired at the predetermined position is the corresponding The presenting means for presenting that the vehicle is a passenger is, for example, a game store management device.

  That is, the vehicle information registration unit registers vehicle registration information of a vehicle entering the parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other. The image acquisition unit captures an image of the corresponding vehicle among the vehicles parked in the parking lot, and the vehicle registration information image extraction unit extracts the vehicle registration information from the captured image of the corresponding vehicle. The vehicle registration information search unit searches the registered vehicle registration database for face images registered in association with the vehicle registration information of the corresponding vehicle based on the extracted vehicle registration information of the corresponding vehicle. The vehicle face image information storage unit stores the searched vehicle registration information and the face image registered in association with the searched vehicle registration information as the corresponding vehicle face image information.

  The face image acquisition unit acquires the face image of the person to be collated at a predetermined position, and the similarity calculation unit is registered as the obtained face image of the person to be collated and the corresponding vehicle face image information. The similarity with the face image is calculated and collated. The similarity determination unit determines whether the face image of the visitor is a face image registered in the corresponding vehicle face image information by comparing the similarity as a matching result with a predetermined threshold value, When it is determined that the face image of the person to be collated is a face image registered in the corresponding vehicle face image information, the amusement shop management apparatus determines that the person to be collated acquired at the predetermined position Present that you are a passenger.

  As a result, if an abnormality occurs in the vehicle parked in the parking lot, the clerk only searches for the vehicle and the player is searched based on the face image of the passenger of the vehicle and returned to the vehicle. Therefore, it is possible to promptly return the vehicle occupant to the vehicle in which an abnormality has occurred.

  According to the present invention, when a trouble occurs in a vehicle using a parking lot, it is possible to search for the driver of the corresponding vehicle in the store and promptly return to the corresponding vehicle.

  Embodiments of the present invention will be described below. Correspondences between the configuration requirements of the present invention and the embodiments described in the detailed description of the present invention are exemplified as follows. This description is to confirm that the embodiments supporting the present invention are described in the detailed description of the invention. Accordingly, although there are embodiments that are described in the detailed description of the invention but are not described here as embodiments corresponding to the constituent elements of the present invention, It does not mean that the embodiment does not correspond to the configuration requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

  That is, the monitoring apparatus according to the first aspect of the present invention is a registration unit that registers vehicle registration information of a vehicle entering a parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other. (For example, the vehicle information registration unit 225 in FIG. 14), a corresponding vehicle imaging unit (for example, the image acquisition unit 294 in FIG. 16) that captures an image of the corresponding vehicle among the vehicles parked in the parking lot, Corresponding vehicle registration information extracting means (for example, the vehicle registration information image extracting unit 272 in FIG. 15) for extracting the vehicle registration information from the image of the corresponding vehicle imaged by the corresponding vehicle imaging means, and the corresponding vehicle registration information extracting means. Is registered in association with the vehicle registration information of the corresponding vehicle from the vehicle registration database registered by the registration means based on the vehicle registration information of the corresponding vehicle extracted by Is registered in association with search means (for example, vehicle registration information search unit 277 in FIG. 15), vehicle registration information searched by the search means, and the searched vehicle registration information. Accumulating means for accumulating the face image as relevant vehicle face image information (for example, the relevant vehicle face image information accumulating unit 279 in FIG. 15), and face image acquiring means for obtaining the face image of the person to be collated at a predetermined position (for example, 14, and calculates the similarity between the face image of the person to be collated acquired by the face image acquisition unit 228) and the face image registered as the vehicle face image information, By comparing the matching means (for example, the similarity calculation unit 252 in FIG. 14) with the similarity that is the matching result of the matching means and a predetermined threshold value, the face image of the visitor is the corresponding vehicle face image. Register for information A similarity determination unit (for example, a similarity determination unit 253 in FIG. 14) that determines whether or not the face image of the person to be collated is the corresponding vehicle face image information by the similarity determination unit. When it is determined that the face image is registered, the presenting means for presenting that the person to be collated acquired at the predetermined position is a passenger of the vehicle (for example, the amusement shop management apparatus of FIG. 14) 24).

  The vehicle registration information of the vehicle is extracted from the entrance vehicle imaging means (for example, the parking lot entrance camera 61 in FIG. 1) that captures an image of the vehicle entering the parking lot and the image captured by the entrance vehicle imaging means. An entrance vehicle face image that extracts a face image of a passenger of the vehicle from an image captured by the entrance vehicle registration information extraction means (for example, the vehicle registration information image extraction unit 221 in FIG. 14) and the entrance vehicle imaging means. The parking lot extracted by the entrance vehicle registration information extraction means is included in the registration means (eg, the vehicle information registration unit 225 in FIG. 14). The vehicle registration information of the vehicle entering the vehicle and the face image of the person boarding the vehicle extracted by the entrance vehicle face image extracting means are associated and registered as a vehicle information database. It is possible to allow.

  A face image for extracting the face image of the person to be collated from the person imaged by the person to be collated (for example, the camera 38 in FIG. 1) for picking up the image of the person to be collated Extraction means (for example, face image extraction unit 202 in FIG. 12) and feature amount extraction means (for example, feature amount extraction unit 251 in FIG. 14) for extracting feature amounts from the face image of the person to be collated, In the collation means (for example, the similarity calculation unit 252 in FIG. 14), the feature amounts of the face image of the person to be collated acquired by the acquisition means and the face image of the registrant accumulated in the accumulation means are stored. It is possible to calculate the degree of similarity and to collate the face image of the person to be collated acquired by the obtaining unit with the face image of the registrant accumulated in the accumulating unit.

  The face image acquisition unit (for example, the face image acquisition unit 228 in FIG. 14) acquires a player who plays on the predetermined game table as a face image of the person to be collated, and the similarity determination unit performs the collation target. When it is determined that the person's face image is a face image registered in the corresponding vehicle face image information, it is acquired at the predetermined position by the presenting means (for example, the amusement shop management device 24 in FIG. 14). Control means (for example, FIG. 17) that controls to stop the operation of the gaming table on which the player who is the verification target person plays is shown when the verification target person is presented as a passenger of the vehicle. Can be further included.

  The face image acquisition means (for example, the face image acquisition unit 228 in FIG. 14) acquires a player playing a game on the predetermined game table as a face image of a person to be collated, and is held by a staff of a game store. When the face image of the person to be collated is determined to be a face image registered in the corresponding vehicle face image information by the similarity determination unit for a mobile terminal (for example, the mobile terminal 19 in FIG. 14), The presenting means (for example, the communication unit 231 in FIG. 14) is notified by transmitting information indicating that the person to be collated acquired at the predetermined position is a passenger of the vehicle. You can make it.

  A monitoring method and a program according to one aspect of the present invention include a registration step of registering vehicle registration information of a vehicle entering a parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other (for example, 18, the corresponding vehicle imaging step (for example, step S <b> 62 in FIG. 19) that captures an image of the corresponding vehicle among the vehicles parked in the parking lot, and the processing of the corresponding vehicle imaging step. The vehicle registration information extraction step (for example, step S93 in FIG. 19) for extracting the vehicle registration information from the captured image of the vehicle, and the vehicle of the vehicle extracted by the processing of the vehicle registration information extraction step. Based on the registration information, the vehicle registration information of the vehicle from the vehicle registration database registered by the process of the registration step. A search step (for example, step S100 in FIG. 19) for searching for face images registered in association with each other, vehicle registration information searched by the processing of the search step, and the searched vehicle registration information in association with each other. An accumulation step (for example, step S101 in FIG. 19) for accumulating the registered face image as corresponding vehicle face image information, and a face image acquisition step (for example, FIG. 19) for acquiring the face image of the person to be collated at a predetermined position. 20 step S132), and a collation for calculating and collating the similarity between the face image of the person to be collated acquired by the process of the face image acquisition step and the face image registered as the relevant vehicle face image information By comparing the step (for example, step S135 in FIG. 20) and the similarity, which is the collation result in the collation process, with a predetermined threshold, A similarity determination step (for example, step S136 in FIG. 20) for determining whether or not a person's face image is a face image registered in the vehicle face image information, and the similarity determination step When it is determined that the face image of the person to be collated is a face image registered in the corresponding vehicle face image information, it is indicated that the person to be collated acquired at the predetermined position is a passenger of the corresponding vehicle Presenting step (for example, step S154 in FIG. 20).

  FIG. 1 is a diagram showing a configuration of an embodiment of a game shop monitoring system according to the present invention.

  The game stores 1-1 to 1-n are so-called pachinko stores, pachislot stores, or casino stores. These amusement stores 1-1 to 1-n are affiliated stores or member stores of a biometric information management center or a third party amusement store management center, and stores that need to manage a plurality of stores in an integrated manner. It is. Each of the game stores 1-1 to 1-n is connected by a biological information management bus 6 and a third party game store management bus 7, and the public communication line networks 8 and 9 represented by the bus and the Internet are used. Via each other, biological information and third party game store management information are exchanged. In the following description, when there is no particular need to distinguish each of the game stores 1-1 to 1-n, the game store 1 is simply referred to, and the other configurations are also referred to in the same manner.

  The biological information management bus 6 mainly functions as a transmission path for distributing biological information managed by the image information recognition device 21 of each game store 1. The third-party game store management bus 7 functions as a transmission path for distributing medium lending management information managed mainly by the medium lending management device 27 of each amusement store 1.

  The biometric information management center 2 is a server used by a business operator who manages and operates the biometric information management center. The registered player DB managed by the biometric information management database (hereinafter also referred to as DB) 3 is stored in the biometric information management center 2. In addition to updating based on the unregistered player DB generated by each game store 1, the updated latest registered player DB is distributed to the image information recognition device 21 of each game store 1.

  The third-party amusement store management center 4 is a server used by a business operator that manages and operates the third-party amusement store management center, and the medium lending management managed by the third-party amusement store management database (DB) 5 In addition to updating the information DB based on the information supplied from each game store 1, the updated latest medium lending management information is distributed to the medium lending management device 27 of each game store 1.

  The image information recognition device 21 is parked from an image of a vehicle that enters the parking lot 51 by the parking lot entrance cameras 61-1 to 61-r provided in the parking lot 51-1 provided in the amusement store 1. The vehicle registration information (number plate information) of the vehicle extracted by the parking lot image processing units 63-1 to 63-r and supplied via the biological information bus 31, and the face of the passenger of the vehicle The images are registered in the vehicle information database 20 in association with each other.

  In addition, the image information recognition device 21 is picked up by the parking lot attendant portable terminal 64 when the attendant of the parking lot 51 attached to the amusement store 1 recognizes a vehicle abnormality or a state where it is desired to request movement. In addition to acquiring the transmitted vehicle image, the vehicle information database 20 is searched and the vehicle corresponding to the vehicle image captured and transmitted by the searched parking clerk portable terminal 64 (hereinafter referred to as applicable). The face image registered in association with the vehicle is also stored as corresponding vehicle face image information in the corresponding vehicle face image information storage unit 279 (FIG. 15) of the vehicle information management unit 227 (FIG. 14).

  Furthermore, the image information recognition apparatus 21 includes cameras 38-1 to 38-m and entrance cameras 40-1 to 40-p each configured by an image sensor such as a CCD (Charge Coupled Devices) or a CMOS (Complementary Metal Oxide Semiconductor). Based on the facial image information extracted by the image processing units 39-1 to 39- (m + p + q) from the images captured by the in-store cameras 41-1 to 41-q and supplied via the biological information bus 31. If the face image registered in the biometric information database 22 is matched and matched, the mobile player 19 is notified of the registered player's visit, CRT (Cathode Ray Tube), LCD (Liquid Crystal Display), etc. Is displayed on the display unit 23.

  Further, the image information recognition apparatus 21 includes image processing units 39-1 to 39-1 based on images captured by the cameras 38-1 to 38-m, the entrance cameras 40-1 to 40-p, and the in-store cameras 41-1 to 41-q. 39- (m + p + q) and collation with the face image registered in the corresponding vehicle face image information storage unit 279 (FIG. 15) based on the face image information supplied via the biological information bus 31 If they match, the game store management device 24 is instructed to stop the operation of the specified gaming table 36 based on the camera ID supplied with the face image, or the gaming table 38 A screen for prompting the player to return to the vehicle is displayed on the display unit 313 (FIG. 17).

  Furthermore, when the face image registered in the biometric information database 22 is collated and does not match, the image information recognition device 21 accesses the biometric information management database 3 and registers it in the unregistered player DB as an unregistered person. .

  The game store management device 24 is a so-called hall computer, and monitors or controls the operations of the game machines 36-1 to 36-m via the game store management information bus 30. The game store management device 24 determines a predetermined amount according to the monitoring status such as information on the payout of the game table 36 or the payout of medals, the call information of the players on the game tables 36-1 to 36-m, or the occurrence of an error. The execution result is executed, and the execution result is displayed on the display unit 25 such as a CRT or LCD. The game store management device 24 identifies information supplied from the counter 35, the game machines 36-1 to 36-m, and the game machine peripheral terminals 37-1 to 37-m, respectively. For example, it is managed by the gaming machine management database 26 in association with the gaming machine number.

  The medium lending management device 27 manages the medium lending management information of the rented game media using the medium lending management database 29 based on the information from the payment machine 33 and the lending machine 34, and also the medium lending management database. When the medium lending management information registered in 29 is updated, the updated information is sent to the third party amusement store management center 4 via the third party amusement store management bus 7 and the public communication line network 9. Further, the medium lending management device 27 acquires the medium lending management information supplied by the third party amusement store management center 4 via the third party amusement store management bus 7 and the public communication line network 9, and manages the medium lending management. Store in the database 29.

  The lending machine 34 lends a number of game media according to the amount when the player accepts a predetermined amount by cash or a prepaid card when playing on the gaming table 36. At this time, the lending machine 34 supplies information on the number of lent gaming media to the medium lending management device 27 together with information such as the accepted cash and the remaining number of prepaid cards. Accordingly, the medium lending management device 27 registers information on the number of lent gaming media in the medium lending management information database 29 together with information such as the accepted cash and the remaining number of prepaid cards.

  The checkout machine 33 sells prepaid cards with a frequency for borrowing a ball. At this time, the checkout machine 33 supplies the frequency of the prepaid card sold and the amount paid to the medium lending management device 27. Further, the settlement vending machine 33 settles and pays out cash based on the remaining number of game media lent as a frequency such as a prepaid card. At this time, the checkout machine 33 supplies the remaining number of prepaid cards and the amount of cash refunded to the medium lending management device 27.

  The counter 35 counts the number of game media acquired by the player playing on the game table 36, and outputs the counting result as a magnetic card or a receipt.

  The game machines 36-1 to 36-m execute a game when a predetermined operation is performed by the player, and pay out a game ball or a medal according to a so-called small hit or big hit.

  The game console peripheral terminals 37-1 to 37-m are so-called pedestrian machines provided corresponding to the respective game machines 36-1 to 36-m. The same as the lending machine 34) is provided. Further, the gaming machine peripheral terminal 37 acquires biological information such as a face image of the player who plays the gaming machine 36 and transmits it to the image information recognition device 21 together with the gaming machine identification information (game machine number). FIG. 1 shows an example in which cameras 38-1 to 38-m that acquire a player's face image are provided as a function of acquiring biometric information.

  For example, as shown in FIG. 2, the cameras 38-1 to 38-m are provided with stand display lamps 161-1 to 161-4 provided at the upper portions of the respective game stands 36-1 to 36-4. As shown in FIG. 3 at the bottom, it may be provided so that the player can take an image within the reading range δ, and a face image may be taken. It can be used as an ID.

  Further, as shown in FIG. 4, the cameras 38-1 to 38-m are provided with convex portions 171-1 to 171-4 on the game console peripheral terminals 37-1 to 37-4, as shown in FIG. As described above, it may be provided so that a player's face image can be captured within the reading range θ.

  Further, for example, as shown in FIG. 6, the cameras 38-1 to 38-m may be provided at the center of the game table 36 (on the board surface of the game table 36) to take an image. That is, by installing the camera 38 in the installation unit 181 of FIG. 6, the player is imaged within the reading range φ as shown in FIG.

  The entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q are installed at entrances and predetermined places in the store of the amusement store 1, and imaged units 39- (m + 1) to 39- (m + p + q).

  The entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q are set as shown in FIG. 8, for example. FIG. 8 shows an installation example of the entrance cameras 40-1 to 40-p and the in-store cameras 41-1 to 41-q in the game store 1.

  That is, in FIG. 8, entrances 192-1 to 192-3 are provided, and the entrance cameras 40-1 to 40-3 capture the players who enter the store through the respective entrances 192. Further, the in-store cameras 41-1 to 41-10 are set at positions at which both surfaces of the island facilities 191-1 to 191-5 can be imaged in a row. The island equipment 191 is provided with game machines 36 on both sides, that is, so as to sandwich the island equipment 191 in the figure in the vertical direction. Since the camera 38, the entrance camera 40, and the in-store camera 41 all have a pan / tilt / zoom function, the in-store cameras 41-1 to 41-10 are arranged as shown in FIG. All players who play at 36 can take an image with any of the in-store cameras 41-1 to 41-10.

  Furthermore, the in-store camera 41-a is provided in front of the lending machine 34, the in-store camera 41-b is provided in front of the checkout machine 33, and the in-store camera 41-c is the counter of the counter 35. It is provided in front, and a player who uses the rental machine 34, the checkout machine 33, and the counter 35 can be imaged.

  That is, as shown in FIG. 8, in the game store 1, a player who visits the store, a player who plays on the game stand 36, and a player who uses the lending machine 34, the checkout machine 33, and the counter 35. The camera 38, the entrance camera 40, and the in-store camera 41 are installed so that almost all of the actions that the player is supposed to take in the gaming store 1 can be monitored.

  Further, the parking lot entrance cameras 61-1 to 61-r and the parking lot exit cameras 62-1 to 62-s are constituted by image sensors such as CCD and CMOS, and are used as gates in the parking lot 51 of the amusement store 1. The installed and captured images are supplied to the parking lot image processing units 63-1 to 63- (r + s), respectively. The parking lot entrance cameras 61-1 to 61-r and the parking lot exit cameras 62-1 to 62-s are installed, for example, as shown in FIGS. FIG. 9 shows an installation example of the parking lot entrance cameras 61-1 to 61-r and the parking lot exit cameras 62-1 to 62-s in the parking lot 51 in the game store 1, and FIG. FIG. 6 is an enlarged layout view of parking lot entrance cameras 61-1 to 61-r and parking lot exit cameras 62-1 to 62-s in the vicinity of −1 to g-3.

  That is, in FIG. 9, gates g-1 to g-3 are provided in the parking lot 51, and the parking lot entrance cameras 61-1 to 61-3 enter from the respective gates g-1 to g-3. For example, the vehicle C2 is picked up as an image P from the front as shown in FIG. Moreover, the parking lot exit cameras 62-1 to 62-3 capture images of the vehicle C1 leaving the respective gates g-1 to g-3.

  In FIG. 11, the vehicle P is imaged from the front in the image P, and the face images F1 and F2 of the person boarding the vehicle C and the vehicle registration information image N are included. Thus, the face images F1, F2 and the vehicle registration information image N are extracted, and the face images F1, F2 are registered in the vehicle information database 20 in association with the vehicle registration information extracted from the vehicle registration information image N. .

  Thus, in the parking lot 51, since the parking lot entrance camera 61 and the parking lot exit camera 62 are provided in all the gates g, the vehicle C2 that enters the parking lot 51 is provided in the gate g that has entered. In the same way, when the vehicle exits from the parking lot 51, the vehicle C1 is taken by the parking lot exit camera 62 provided at the gate g to be exited. Images are always taken from the front.

  Next, a configuration example of the image processing unit 39 will be described with reference to FIG.

  The image acquisition unit 201 acquires an image captured by the camera 38 (or the entrance camera 40 or the in-store camera 41) and supplies it to the face image extraction unit 202. The face image extraction unit 202 extracts a rectangular image composed of a face image from the image supplied from the image acquisition unit 201 using a pattern such as the arrangement of the parts constituting the face, and supplies the rectangular image to the transmission unit 203. The transmission unit 203 transmits the face image to the image information recognition device 21.

  Next, a configuration example of the parking lot image processing unit 63 will be described with reference to FIG.

  The image acquisition unit 211 acquires an image captured by the parking lot entrance camera 61 (or the parking lot exit camera 62) and supplies it to the face image extraction unit 212 and the vehicle registration information image extraction unit 214. The face image extraction unit 212 extracts a rectangular image made up of a face image from the image supplied from the image acquisition unit 211 using a pattern such as the arrangement of the parts constituting the face, and supplies the extracted image to the transmission unit 213. The vehicle registration information image extraction unit 214 extracts a rectangular image made up of the vehicle registration information image from the image supplied from the image acquisition unit 211 by a pattern such as the arrangement of the parts constituting the number plate, and sends it to the transmission unit 213. Supply. The transmission unit 213 associates the vehicle registration information image with the face image and transmits the image to the image information recognition device 21.

  Next, a configuration example of the image information recognition device 21 will be described with reference to FIG.

  The vehicle registration information image extraction unit 221 extracts a vehicle registration information image from the vehicle registration information image and face image information supplied from the parking lot image processing unit 63 and supplies the vehicle registration information image to the character information matching unit 222.

  The character information collation unit 222 collates the vehicle registration information image supplied from the vehicle registration information image extraction unit 221 with the image for character recognition registered in the character information dictionary DB 223, and compares the collation result with the text data conversion unit. 224.

  The text data conversion unit 224 converts the vehicle registration information image as text data (character data) based on the collation result, and supplies the text data of the vehicle registration information as the conversion result to the vehicle information registration unit 225.

  The face image extraction unit 226 extracts a face image from the vehicle registration information image and the face image information supplied from the parking lot image processing unit 63 and supplies the face image to the vehicle information registration unit 225.

  The vehicle information registration unit 225 registers the text data of the vehicle registration information supplied from the text data conversion unit 224 and the face image of the person on the vehicle in association with each other in the vehicle information database (DB) 20. To do.

  The vehicle information management unit 227 searches the vehicle information DB 20 based on the vehicle registration information included in the vehicle image supplied from the parking lot attendant portable terminal 64, and is registered in association with the vehicle registration information. The face image is stored in the corresponding vehicle face image information storage unit 279 (FIG. 15) as the corresponding vehicle face image information.

  The face image acquisition unit 228 acquires the face image supplied from the image processing unit 39 and supplies it to the collation unit 229. The collation unit 229 includes the face image acquired by the face image acquisition unit 228, the registered player's face image registered in advance in the biometric information DB 22, or the corresponding vehicle face image information storage unit 279 of the vehicle information management unit 227. If there is a face image that is a candidate with a high degree of similarity, the top face image is displayed on the display unit 23 as a matching result, and the amusement store management device 24 Supply. The collation unit 229 supplies the supplied face image to the unregistered player database registration unit 230 when there is no face image that is a candidate with a high degree of similarity.

  More specifically, the feature amount extraction unit 251 of the matching unit 229 extracts a feature amount for identifying a face image and supplies the feature amount together with the face image to the similarity calculation unit 252. The similarity calculation unit 252 extracts a facial image of a registered player registered in the biometric information DB 22 or a feature amount of a face image registered in the corresponding vehicle face image information storage unit 279 of the vehicle information management unit 227. Then, using the feature amount supplied from the feature amount extraction unit 251, all the registered player face images registered in the biological information DB 22 or the corresponding vehicle face image of the vehicle information management unit 227. The similarity with the face image registered in the information storage unit 279 is obtained, and the face image supplied from the face image acquisition unit 228 and the face image with the highest similarity are supplied to the similarity determination unit 253. . More specifically, the similarity calculation unit 252 is based on various facial feature amounts such as the ratio between the distance between the eyes, the distance from the chin to the forehead, and the length from the chin to the nose. Each difference sum, average ratio, or ratio sum is obtained as the similarity.

  The similarity determination unit 253 compares the similarity with the face image having the highest similarity supplied from the similarity calculation unit 252 with a predetermined threshold, and becomes the highest based on the comparison result. When the registered face image is similar to the face image supplied from the face image acquisition unit 228 (in the case of similarity indicating that the similarity is higher as the degree of similarity is higher than a predetermined threshold) In the case of similarity indicating lower similarity, the similarity is lower than a predetermined threshold value), and the uppermost face image and similarity information are supplied to the display unit 23 for display. In addition, the data is supplied to the communication unit 231. Further, the similarity determination unit 253 compares the similarity between the highest-ranking face image and a predetermined threshold value, and based on the comparison result, the highest-level registered face image is received from the face-image acquiring unit 228. When the supplied face image is not similar, the face image supplied from the face image acquisition unit 228 is supplied to the unregistered player database registration unit 230.

  The unregistered player database registration unit 230 registers the face image that has been supplied as being unregistered by the collation unit 229 in the biometric information management database 3.

  The operation unit 232 includes buttons, a mouse, a keyboard, and the like. The operation unit 232 is operated when the face image displayed on the display unit 23 having the highest similarity is regarded as a captured face image. The operation result is supplied to the communication unit 231. The communication unit 231 includes a modem or the like, and distributes the selected face image to the mobile terminal 19 based on an operation signal from the operation unit 232.

  Here, for example, the similarity is assumed to indicate a higher value as it is closer to the registered face image as indicated by the ratio sum, and when the similarity is a value higher than a predetermined threshold, An example in which the face image of the registered player corresponding to the similarity is determined will be described. However, for example, each of a face image in which the degree of similarity is captured and a face image registered in the biological information DB 22 or a face image stored in the corresponding vehicle face image information storage unit 279 of the vehicle information management unit 227. If the similarity is smaller than the threshold, the similarity determination unit 253 regards the captured face image as a registered player's face image, or In the case of an average ratio or the like, if it is a predetermined value or more in the range of 0 to 1 and close to 1, it can be regarded as the same person.

  When new registered player information is distributed from the biometric information management center 2, the database management unit 233 updates the biometric information DB 22.

  The search unit 234 searches for a face image registered in the biological information DB 22 under the conditions input by operating the operation unit 232, and displays the search result on the display unit 23.

  Next, the configuration of the vehicle information management unit 227 will be described with reference to FIG.

  The vehicle image receiving unit 271 receives the image of the vehicle transmitted from the parking lot attendant portable terminal 64 and supplies it to the vehicle registration information image extracting unit 272.

  The vehicle registration information image extraction unit 272 obtains an image of the number plate of the corresponding vehicle from the image of the corresponding vehicle captured by the parking lot clerk supplied from the vehicle image receiving unit 271 using the parking lot clerk portable terminal 64. This is extracted as a vehicle registration information image and supplied to the character information matching unit 273.

  The character information collation unit 273 collates the vehicle registration information image supplied from the vehicle registration information image extraction unit 272 with the image for character recognition registered in the character information dictionary DB 274 and compares the collation result with the text data conversion unit. 275.

  The text data conversion unit 275 converts the vehicle registration information image as text data (character data) based on the collation result, and supplies the vehicle registration information text data as the conversion result to the vehicle registration information generation unit 276.

  The vehicle registration information generation unit 276 generates vehicle registration information of the corresponding vehicle using the supplied text data information and supplies the vehicle registration information search unit 277 with the vehicle registration information.

  The vehicle registration information search unit 277 searches the vehicle registration information registered in the vehicle information DB 20 based on the vehicle registration information supplied from the vehicle registration information generation unit 276, and if searched, the searched vehicle A face image registered in the vehicle information DB 20 in association with the registration information is extracted and supplied to the corresponding vehicle face image information generation unit 278.

  The corresponding vehicle face image information generation unit 278 maps the face image registered in the vehicle information DB 20 in association with the searched vehicle registration information supplied from the vehicle registration information search unit 277 to the corresponding vehicle face image information storage unit 279. In addition, the information is stored in association with the vehicle registration information. That is, in the corresponding vehicle face image information storage unit 279, the face image of the passenger imaged when the vehicle imaged by the parking lot attendant portable terminal 64 enters the parking lot 51 is accumulated.

  Next, with reference to FIG. 16, the structure of the parking lot attendant portable terminal 64 will be described.

  The receiving unit 291 is configured by a modem or the like, and exchanges data with the image information recognition device 21 via a wireless communication network in the game store 1. The receiving unit 291 receives information about whether or not there is a face image similar to the face image supplied from the parking lot image processing unit 63 distributed from the image information recognition device 21, and performs image processing. To the unit 292.

  The image processing unit 292 displays information about whether or not a face image similar to the face image supplied from the parking lot image processing unit 63 supplied from the receiving unit 291 exists, and is a display unit configured by an LCD or the like In addition to generating an image to be displayed on 293, the image is displayed on the display unit 293.

  The operation unit 297 is configured by buttons and a keyboard, and when a parking lot worker images a vehicle that needs to call a player who is the owner among vehicles parked in the parking lot 51, Or it is operated when trying to acquire the position information of the vehicle, and a signal corresponding to the operation content is supplied to the image acquisition unit 294 or the position information acquisition unit 295.

  The image acquisition unit 294 is configured by an image sensor such as a CCD or a CMOS, captures an image based on an operation signal supplied from the operation unit 297, and supplies image data that is an imaging result to the transmission unit 296. To do.

  The position information acquisition unit 295 is configured by a GPS (Global Positioning System) or the like, acquires a signal from a satellite (not shown) based on an operation signal supplied from the operation unit 297, and executes a predetermined calculation. As a result, position information on the earth is acquired, and the acquired position information is supplied to the transmission unit 296.

  The transmission unit 296 transmits the image supplied from the image acquisition unit 294 or the position information acquisition unit 295 or the position information supplied from the image and the position information acquisition unit 295 to the image information recognition device 21.

  Next, with reference to FIG. 17, the structure of the game shop management apparatus 24 and the game stand 36 is demonstrated.

  The corresponding vehicle face image acquisition unit 301 detects the face image of the person (player) of the person who is the passenger of the corresponding vehicle, which is captured by the parking lot attendant portable terminal 64 supplied from the image information recognition device 21. The face image supplied from time to time is acquired, and a camera ID that captures the face image added to the acquired face image is extracted and supplied to the game console control unit 302.

  When the gaming table control unit 302 acquires the camera ID supplied from the corresponding vehicle face image acquisition unit 301, the gaming table control unit 302 specifies the position of the corresponding gaming table 36 based on the camera ID, and performs the operation of the specified gaming table 36. A control signal for controlling the corresponding gaming table 36 is supplied so as to stop, and a parking staff member instructs the current player to display a screen prompting the player to return to the vehicle.

  The operation control unit 311 of the game table 36 stops the operation of the game table 36 related to the game when a control signal for instructing the operation stop is supplied based on the control signal from the game store management device 24.

  When the game store management device 24 instructs the display control unit 312 to display a screen prompting the current player to return to the vehicle by the parking clerk, the display clerk 312 instructs the current player to A screen prompting the user to return to the vehicle is displayed on the display unit 313.

  Next, a vehicle information acquisition process is demonstrated with reference to the flowchart of FIG.

  In step S <b> 1, the parking lot entrance camera 61 images the entrance direction of the gate g of the parking lot 51 and supplies the captured image to the parking lot image processing unit 63. The image acquisition unit 211 of the parking lot image processing unit 63 acquires the image supplied from the parking lot entrance camera 61 and supplies it to the face image extraction unit 212 and the vehicle registration information image extraction unit 214.

  In step S <b> 2, the vehicle registration information image extraction unit 214 detects vehicle registration information, that is, a characteristic amount specific to a so-called number plate image from the supplied image, and the rectangular shape in which the number plate is captured from the image. Is identified, extracted as a vehicle registration information image, and supplied to the transmission unit 213.

  In step S3, the vehicle registration information image extraction unit 214 extracts the feature amount of the vehicle registration information and determines whether or not the vehicle registration information image has been extracted. In step S3, for example, since the vehicle has not entered the gate g, and the image of the vehicle is not included in the captured image, the feature amount of the vehicle registration information is not extracted. Return to step S1. That is, vehicle registration information is not included, and it is considered that the vehicle has not entered the gate g, and the process returns to step S1 and the processes of steps S1 to S3 are repeated until the vehicle is imaged. become.

  If it is determined in step S3 that a vehicle registration information image has been extracted, that is, an image captured when the vehicle has entered the gate g and the vehicle registration information image has been extracted, The image extraction unit 212 extracts a face image of a vehicle occupant from the supplied image and supplies the extracted image to the transmission unit 213. More specifically, the face image extraction unit 212 extracts a face image from, for example, the arrangement of characteristic parts such as eyes and nose, where the skin is exposed from the color of the captured image. To the transmission unit 213.

  In step S5, the transmission unit 213 associates the face image supplied from the face image extraction unit 202 with the vehicle registration information image supplied from the vehicle registration information image extraction unit 214, and controls the parking lot entrance camera 61. Information such as a camera ID to be identified and an imaging time is added.

  In step S <b> 6, the transmission unit 213 captures an image including the face image supplied from the face image extraction unit 212, the vehicle registration information image supplied from the vehicle registration information image extraction unit 214, and the vehicle registration information image. The camera ID of the parking lot entrance camera 61 is transmitted to the image information recognition device 21.

  In step S21, the vehicle registration information image extraction unit 221 of the image information recognition device 21 determines whether the face image and the vehicle registration information image have been transmitted from the parking lot image processing unit 63, and determines that they have been transmitted. The same processing is repeated until

  In step S21, for example, when the face image and the vehicle registration information image are transmitted from the parking lot image processing unit 63 by the process of step S6, the vehicle registration information image extraction unit 221 has been transmitted in step S22. A face image and a vehicle registration information image are received. At this time, the face image extraction unit 226 also receives the transmitted face image and vehicle registration information image.

  In step S23, the vehicle registration information image extraction unit 221 extracts only the information of the vehicle registration information image, selects one vehicle registration information image from the extracted vehicle registration image information as a processing target, and performs character information verification. To the unit 222.

  In step S24, the character information collation unit 222 binarizes the supplied vehicle registration information image, collates with the character information dictionary DB 223 in step S25, and supplies the collation result to the text data conversion unit 224.

  In step S <b> 26, the text data conversion unit 224 converts the vehicle registration information image into text data based on the collation result, and supplies it to the vehicle information registration unit 225.

  In step S <b> 27, the face image extraction unit 226 extracts the face image transmitted in association with the vehicle registration information image that is being processed and supplies the face image to the vehicle information registration unit 225.

  In step S <b> 28, the vehicle information registration unit 225 associates the text data of the vehicle registration information supplied from the text data conversion unit 224 with the face image supplied from the face image extraction unit 226 in the vehicle information DB 20. sign up.

  In step S29, the vehicle registration information image extraction unit 221 determines whether or not processing has been performed for all vehicle registration information images and face images, and when processing has not been performed for all vehicle registration information images and face images, The process returns to step S23, and the processes of steps S23 to S29 are repeated until it is determined that all the vehicle registration information images and face images have been processed.

  If it is determined in step S29 that all the vehicle registration information images and face images have been processed, the process returns to step S21, and the subsequent processing is repeated.

  Through the above processing, the vehicle information DB 20 registers the vehicle registration information of the vehicle that has entered the parking lot 51 and the face image of the passenger boarding the vehicle in association with each other. That is, for example, when the image of FIG. 11 is captured by the parking lot entrance camera 61, “Nagoya 300 1234” included in the vehicle registration information image N is extracted as the vehicle registration information, and further, the face image of the passenger Face images F1 and F2 are extracted, and face images F1 and F2 are registered in the vehicle information DB 20 in association with “Nagoya 300 1234”.

  Next, the vehicle face image information generation process will be described with reference to the flowchart of FIG.

  In step S61, the image acquisition unit 294 determines whether or not imaging has been instructed based on the operation signal from the operation unit 297, and repeats the same processing until it is determined that imaging has been instructed.

  In step S61, for example, a parking clerk is a vehicle that is not parked at the parking position in the parking lot 51, a vehicle that is parked with an infant on board in the vehicle, or a crime such as a storm on the vehicle. When a vehicle or the like that is considered to be involved in the vehicle is found and it is desired to instruct the passenger of the vehicle to return to the vehicle, the operation unit 297 is operated and imaging of the vehicle is instructed. Is instructed, and the process proceeds to step S63.

  In step S <b> 63, the image acquisition unit 294 controls the image processing unit 292 to cause the display unit 293 to display a screen for selecting bibliographic information about the captured image. Bibliographic information is sentences that explain the current abnormal state, such as “car storm”, “requests to move”, or “the infant is in the car”, and “others”. These items may be provided so that text can be input.

  In step S <b> 64, the image acquisition unit 294 determines whether or not the bibliographic information is selected by operating the operation unit 297, and repeats the process until it is selected. In step S64, for example, when any bibliographic information is selected, in step S65, the image acquisition unit 294 attaches the captured image together with the captured image and supplies the image to the transmission unit 296.

  In step S66, the image acquisition unit 294 controls the image processing unit 292 to display on the display unit 293 a screen for inquiring whether to attach position information.

  In step S67, the position information acquisition unit 295 controls the operation unit 297 to determine whether or not attachment of position information has been selected. In step S67, for example, when it is selected to attach position information, in step S68, the position information acquisition unit 295 acquires its position information and supplies it to the transmission unit 296.

  On the other hand, when it is determined in step S67 that the position information is not attached, the process of step S68 is skipped.

  In step S69, the transmission unit 296 generates a transmission file. That is, when position information is attached, a transmission file is generated based on the captured image, bibliographic information, and position information. When position information is not attached, a transmission file is generated based on the captured image and bibliographic information. create.

  In step S <b> 70, the transmission unit 296 transmits the generated transmission file to the image information recognition device 21.

  In step S91, the vehicle image reception unit 271 of the vehicle information management unit 227 determines whether or not a transmission file has been transmitted from the parking lot attendant portable terminal 64, and repeats the process until it is transmitted.

  In step S91, for example, when a transmission file has been transmitted by the process of step S70, the vehicle image reception unit 271 receives the transmitted transmission file in step S92, and 1 of the received transmission files. One transmission file is selected as a processing target and supplied to the vehicle registration information image extraction unit 272 and the corresponding vehicle face image information storage unit 279.

  In step S <b> 93, the vehicle registration information image extraction unit 272 extracts only the vehicle registration information image from the supplied transmission file and supplies it to the character information collation unit 273.

  In step S94, the character information collation unit 273 binarizes the supplied vehicle registration information image, and collates with the character information dictionary DB 274 in step S95, and supplies the collation result to the text data conversion unit 275.

  In step S <b> 96, the text data conversion unit 275 converts the vehicle registration information image into text data based on the collation result, and supplies the text data to the vehicle registration information generation unit 276.

  In step S97, the vehicle registration information generation unit 276 registers the vehicle corresponding to the vehicle imaged by the parking lot attendant portable terminal 64 based on the vehicle registration image included in the transmission file being processed. Information is generated and supplied to the vehicle registration information search unit 277.

  In step S98, the vehicle registration information search unit 277 accesses the vehicle information DB 20, and searches for vehicle registration information of a vehicle corresponding to the vehicle imaged by the parking lot attendant portable terminal 64 generated by the vehicle registration information generation unit 276. To do.

  In step S99, the vehicle registration information search unit 277 determines whether or not the vehicle registration information of the vehicle corresponding to the vehicle imaged by the parking lot attendant portable terminal 64 is searched in the vehicle information DB 20. In step S99, for example, when vehicle registration information of a vehicle corresponding to the vehicle imaged by the parking lot attendant portable terminal 64 is searched, in step S100, the vehicle registration information search unit 277 stores the parking lot attendant in the vehicle information DB20. The face image registered in association with the vehicle registration information of the vehicle corresponding to the vehicle imaged by the portable terminal 64 is read and supplied to the corresponding vehicle face image information generation unit 278. The corresponding vehicle face image information generation unit 278 obtains the corresponding vehicle face image information from the face image registered in the vehicle information DB 20 in association with the vehicle registration information of the vehicle corresponding to the vehicle imaged by the parking lot attendant portable terminal 64. Generate.

  That is, the vehicle registration information search unit 277 searches the face image registered in association with the vehicle registration information of the vehicle corresponding to the vehicle imaged by the parking lot attendant portable terminal 64 by the process of step S98. Once, the vehicle registration information is retrieved based on the vehicle registration information of the vehicle imaged by the parking lot attendant portable terminal 64, and further associated with the vehicle registration information retrieved in the process of step S98 by the process of step S100. The registered face image is read out.

  In step S101, the corresponding vehicle face image information generation unit 278 causes the corresponding vehicle face image information storage unit 279 to store the generated corresponding vehicle face image information. At this time, the corresponding vehicle face image information storage unit 279 applies the bibliographic information included in the transmission file supplied from the vehicle image reception unit 271 and the captured image to the vehicle captured by the parking lot attendant portable terminal 64. The face image registered in association with the vehicle registration information of the corresponding vehicle is stored in association with it.

  In step S102, the vehicle registration information search unit 277 generates corresponding vehicle face image information of the face image registered in association with the vehicle registration information of the vehicle corresponding to the vehicle imaged by the parking lot attendant portable terminal 64. This is notified to the parking clerk portable terminal 64.

  On the other hand, in step S99, for example, when the vehicle registration information of the vehicle corresponding to the vehicle imaged by the parking lot attendant portable terminal 64 is not searched, in step S103, the vehicle registration information search unit 277 searches the parking lot attendant portable terminal 64. The parking lot attendant portable terminal 64 is notified that the vehicle registration information of the vehicle corresponding to the vehicle imaged by is not retrieved.

  In step S104, the vehicle image receiving unit 271 determines whether or not processing has been performed for all transmission files. If processing has not been performed for all transmission files, the process returns to step S92, and all transmission files are processed. Steps S92 to S102 are repeated until it is determined that the processing has been performed.

  If it is determined in step S104 that processing has been performed for all transmission files, the processing returns to step S91, and the subsequent processing is repeated.

  In step S <b> 71, the reception unit 291 receives the notification transmitted by the processing in step S <b> 102 or S <b> 103 and supplies the notification to the image processing unit 292. The image processing unit 292 causes the display unit 293 to display an image corresponding to the notification content. That is, if the notification is transmitted by the process of step S102, a screen indicating that the corresponding vehicle face image information is generated is displayed on the display unit 293, and if the notification is transmitted by the process of step S103. A screen indicating that the vehicle registration information of the corresponding vehicle could not be searched is displayed on the display unit 293.

  By the above processing, the parking clerk is registered in association with the vehicle registration information of the vehicle imaged using the parking clerk portable terminal 64, and is included in the image taken when entering the parking lot 51. The face image of the existing passenger is stored in the corresponding vehicle face image information storage unit 279.

  Next, the relevant vehicle face image detection process will be described with reference to the flowchart of FIG.

  In step S <b> 111, the camera 38 captures an image of a position where the player is seated on the game table 36 and supplies the captured image to the image processing unit 39. The image acquisition unit 201 of the image processing unit 39 acquires the supplied image and supplies it to the face image extraction unit 202.

  In step S112, the face image extraction unit 202 attempts to extract the player's face image from the supplied image, and determines whether or not the face image has been extracted. More specifically, the face image extraction unit 202 attempts to extract a face image based on the arrangement of characteristic parts such as eyes and nose, for example, where the skin is exposed from the color of the captured image. Whether or not a face image can be extracted is determined.

  If the face image cannot be extracted in step S112, the process returns to step S111. That is, the processes in steps S111 and S112 are repeated until a face image is extracted.

  When it is determined in step S112 that a face image is extracted, the face image extraction unit 202 supplies the extracted face image to the transmission unit 203 in step S113.

  In step S <b> 113, the transmission unit 203 transmits the face image supplied from the face image extraction unit 202 to the image information recognition device 21. At this time, the transmission unit 203 adds information such as a camera ID for identifying each of the cameras 38 (or the entrance camera 40 and the in-store camera 41) and information on the transmission time to the face image to the image information recognition device 21. Send.

  In step S131, the face image acquisition unit 228 of the image information recognition device 21 determines whether or not a face image has been transmitted, and repeats the processing until it is transmitted.

  In step S131, for example, when a face image is transmitted by the process of step S114, the face image acquisition unit 228 of the image information recognition device 21 acquires a face image in step S132. In step S <b> 133, the face image acquisition unit 228 extracts any unprocessed one of the supplied face images and supplies the extracted unprocessed one to the feature amount extraction unit 251.

  In step S134, the feature amount extraction unit 251 of the collation unit 229 extracts the feature amount from the supplied face image and supplies the feature amount together with the face image to the similarity calculation unit 252.

  In step S135, the similarity calculation unit 252 determines the ratio of the eye-to-eye spacing, the length from the chin to the forehead, and the length from the chin to the nose for the face image supplied from the feature amount extraction unit 251. And the same feature amount in the face image stored in the corresponding vehicle face image information storage unit 279 of the vehicle information management unit 227, and the difference sum, average ratio, or ratio The sum or the like is calculated as the similarity, the ranking of the similarity with the face image stored in the corresponding vehicle face image information storage unit 279 as the calculation result is obtained, and stored in the corresponding vehicle face image information storage unit 279. Information on the degree of similarity with the top-level face image among the face images is supplied to the similarity determination unit 253 together with the face image supplied from the feature amount extraction unit 251.

  In step S136, the similarity determination unit 253 determines whether or not the highest similarity is greater than a predetermined threshold based on the highest face image and similarity information supplied from the similarity calculation unit 252. Determine. That is, the similarity determination unit 253 is acquired by the face image acquisition unit 228 out of the face images registered in the most similar registered player (face images stored in the corresponding vehicle face image information storage unit 279). The registered player who is most similar to the registered face image: here, the similarity of the registered player having the highest similarity) is compared with a predetermined threshold.

  Note that, as described above, the similarity between the face image of the registered player who is most similar to the captured face image is not necessarily the highest because of the definition of the similarity. And the threshold value may differ from those in this example.

  If it is determined in step S136 that the highest similarity is greater than the predetermined threshold, the similarity determination unit 253 is stored as the corresponding vehicle face image information in the corresponding vehicle face image information storage unit 279 in step S137. The game store management device 24 is notified together with the face image that the detected face image is detected as the uppermost face image supplied from the similarity calculation unit 252. At this time, the game shop management device 24 is also notified of the camera ID for identifying the camera 38 that captured the face image.

  In step S138, the face image acquisition unit 228 determines whether there is an unprocessed face image. If there is an unprocessed face image, the process returns to step S133. On the other hand, if there is no unprocessed face image in step S138, the process returns to step S131, and the subsequent processes are repeated.

  In step S136, if the similarity is smaller than a predetermined threshold value, the process in step S137 is skipped.

  In step S151, the corresponding vehicle face image acquisition unit 301 of the amusement shop management device 24 determines whether or not a notification indicating that the face image registered as the corresponding vehicle face image information has been detected has been transmitted. The process is repeated until it is determined that it has been transmitted.

  In step S151, for example, when a notification indicating that a face image registered as corresponding vehicle face image information has been detected by the process in step S137 is transmitted, in step S152, the corresponding vehicle face image acquisition unit 301 is received. Receives the camera ID that captured the face image together with a notification indicating that the face image registered as the vehicle face image information has been detected.

  In step S <b> 153, the corresponding vehicle face image acquisition unit 301 extracts a camera ID that identifies the camera 38 that captured the face image included in the transmitted notification, and supplies the camera ID to the gaming table control unit 302.

  In step S154, the gaming table control unit 302 controls the gaming table 36 corresponding to the camera ID to stop the game and instructs to display a screen that prompts the player to return to the vehicle.

  In step S171, the operation control unit 311 of the gaming table 36 determines whether or not there is an instruction from the gaming store management device 24 to display a screen prompting to stop the operation and return to the corresponding vehicle. The processing is repeated until it is determined that there is an instruction to display a screen prompting to stop and return to the vehicle. In step S171, for example, when the game store management device 24 gives an instruction to display an operation prompting to stop operation and return to the vehicle by the process of step S154, the process proceeds to step S172.

  In step S172, the operation control unit 311 stops the operation of the game table 36.

  In step S173, the display control unit 312 causes the display unit 313 of the gaming table 36 to display a screen that prompts the user to return to his / her own vehicle.

  In the above processing, an example has been described in which the operation of the gaming table 36 is stopped and a screen that prompts the user to return to the vehicle is displayed to notify the passenger who is the owner of the vehicle of the vehicle abnormality. For example, in the process of step S154, a player who is playing on any of the game tables 36 by transmitting the same instruction information as the instructions supplied to the game table 36 to the portable terminal 19 possessed by the attendant. By providing information that indicates whether or not the person is prompted to return to the vehicle, a service is provided that encourages the player who is the passenger of the vehicle to return to the vehicle. You may do it.

  Based on the above processing, the player who takes the image of the vehicle indicating that an abnormality has occurred by the parking clerk to enter the parking lot 51, based on the face image of the person boarding the vehicle, And a screen that prompts the player to return to the vehicle by stopping the game on the gaming table 36 is displayed, so that the abnormality of the vehicle in the parking lot 51 is promptly and accurately notified to the owner of the vehicle. It becomes possible. As a result, if a problem occurs in the parking lot use vehicle, it is possible to search for the driver of the vehicle in the store and promptly return to the vehicle in question. It becomes possible to suppress.

  Incidentally, the series of monitoring processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.

  FIG. 21 shows a configuration example of a general-purpose personal computer. This personal computer incorporates a CPU (Central Processing Unit) 1001. An input / output interface 1005 is connected to the CPU 1001 via the bus 1004. A ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 are connected to the bus 1004.

  An input / output interface 1005 includes an input unit 1006 including an input device such as a keyboard and a mouse for a user to input an operation command, an output unit 1007 for outputting a processing operation screen and an image of a processing result to a display device, a program and various data. A storage unit 1008 including a hard disk drive to be stored, a LAN (Local Area Network) adapter, and the like, and a communication unit 1009 for performing communication processing via a network represented by the Internet are connected. Also, a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc)), a magneto-optical disk (including an MD (Mini Disc)), or a semiconductor A drive 1010 for reading / writing data from / to a removable medium 1011 such as a memory is connected.

  The CPU 1001 is read from a program stored in the ROM 1002 or a removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, installed in the storage unit 1008, and loaded from the storage unit 1008 to the RAM 1003. Various processes are executed according to the program. The RAM 1003 also appropriately stores data necessary for the CPU 1001 to execute various processes.

  In this specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series in the order described, but of course, it is not necessarily performed in time series. Or the process performed separately is included.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

It is a figure which shows the structure of one Embodiment of the monitoring system to which this invention is applied. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the camera of FIG. It is a figure which shows the example of installation of the entrance camera and shop camera of FIG. It is a figure explaining the structural example of the parking lot of FIG. It is a figure explaining the structural example of the parking lot entrance camera of FIG. 9, and a parking lot exit camera. It is a figure explaining the example of the image imaged with the parking lot entrance camera and parking lot exit camera of FIG. It is a figure explaining the structural example of the image processing unit of FIG. It is a figure explaining the structural example of the parking lot image processing unit of FIG. It is a figure explaining the structural example of the image information recognition apparatus of FIG. It is a figure explaining the structural example of the vehicle information management part of FIG. It is a figure explaining the structural example of the parking lot attendant portable terminal of FIG. It is a figure explaining the structural example of the game shop management apparatus of FIG. 1, and a game machine. It is a flowchart explaining a vehicle information acquisition process. It is a flowchart explaining the applicable vehicle face image information generation process. It is a flowchart explaining the applicable vehicle face image detection process. And FIG. 11 is a diagram illustrating a configuration example of a personal computer.

Explanation of symbols

1, 1-1 to 1-n amusement store 2 biometric information management center 3 biometric information management database 4 third party amusement store management center 5 third party amusement store management database 6 biometric information management bus 7 third party amusement store management bus 8, 9 Public communication network 20 Vehicle information database 21 Image information recognition device 22 Biometric information database 24 Game store management device 26 Game stand management database 27 Medium lending management device 29 Medium lending management database 30 Amusement store management information bus 31 Biometric information bus 33 Payment machine 34 Lending machine 35 Counter 36, 36-1 to 36-m Game machine 37, 37-1 to 37-m Game machine peripheral terminal 38, 38-1 to 38-m Camera 39, 39-1 to 39 -(M + p + q) Image processing unit 40, 40-1 to 40-p Entrance camera 41, 41-1 to 41- In-store camera 51, 51-1 to 51-n Parking lot 61, 61-1 to 61-r Parking lot entrance camera 62, 62-1 to 62-s Parking lot exit camera 63, 63-1 to 63- (r + s) Parking lot image processing unit 64 Parking lot staff mobile terminal

Claims (8)

Registration means for associating vehicle registration information of a vehicle entering a parking lot with a face image of a person boarding the vehicle as a vehicle information database;
Among vehicles parked in the parking lot, corresponding vehicle imaging means for capturing an image of the corresponding vehicle,
Applicable vehicle registration information extracting means for extracting the vehicle registration information from the image of the applicable vehicle imaged by the applicable vehicle imaging means;
Based on the vehicle registration information of the relevant vehicle extracted by the relevant vehicle registration information extracting means, the face image registered in association with the vehicle registration information of the relevant vehicle from the vehicle registration database registered by the registration means. A search means for searching for,
Storage means for storing vehicle registration information searched by the search means and face images registered in association with the searched vehicle registration information as corresponding vehicle face image information;
Face image acquisition means for acquiring a face image of the person to be collated at a predetermined position;
Collating means for calculating and collating the similarity between the face image of the person to be collated acquired by the face image obtaining means and the face image registered as the vehicle face image information.
Similarity determination for determining whether the face image of the visitor is a face image registered in the corresponding vehicle face image information by comparing the similarity that is the matching result of the matching unit with a predetermined threshold value Means,
When the similarity determination unit determines that the face image of the person to be collated is a face image registered in the vehicle face image information, the person to be collated acquired at the predetermined position And a presenting means for presenting that the passenger is a passenger. Entrance vehicle imaging means for capturing an image of a vehicle entering the parking lot;
From the image captured by the entrance vehicle imaging means, the entrance vehicle registration information extraction means for extracting the vehicle registration information of the vehicle,
Including an entrance vehicle face image extraction means for extracting a face image of a passenger of the vehicle from an image captured by the entrance vehicle imaging means,
The registration means includes vehicle registration information of a vehicle entering the parking lot extracted by the admission vehicle registration information extraction means, and a person's face on the vehicle extracted by the admission vehicle face image extraction means. The monitoring apparatus according to claim 1, wherein the image is registered in association with an image as a vehicle information database. A verification target person imaging means for capturing an image of the verification target person,
A face image extracting means for extracting a face image of the person to be collated from an image captured by the person to be collated imaging means;
Further comprising a feature amount extraction means for extracting a feature amount from the face image of the person to be collated,
The collating unit calculates a similarity using a feature amount between the face image of the person to be collated acquired by the acquiring unit and the face image of the registrant stored in the accumulating unit, and acquires the similarity by the acquiring unit. The monitoring device according to claim 1, wherein the face image of the person to be collated is collated with the face image of the registrant stored in the storage unit. The face image acquisition means acquires a player who plays on the predetermined game table as a face image of a person to be collated,
When it is determined by the similarity determination means that the face image of the person to be collated is a face image registered in the relevant vehicle face image information, the person to be collated acquired at the predetermined position by the presenting means The control means for controlling to stop the operation of the game table on which the player who is the person to be compared plays is shown by being presented as a passenger of the corresponding vehicle. Monitoring device. The face image acquisition means acquires a player who plays on the predetermined game table as a face image of a person to be collated,
The presenting means determines that the face image of the person to be collated is a face image registered in the corresponding vehicle face image information by the similarity determination means with respect to a portable terminal possessed by a clerk of a game shop. The monitoring apparatus according to claim 1, wherein, when it is done, information indicating that the person to be verified acquired at the predetermined position is a passenger of the vehicle is presented. A registration step of registering vehicle registration information of a vehicle entering the parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other;
Among vehicles parked in the parking lot, a corresponding vehicle imaging step of capturing an image of the corresponding vehicle,
A corresponding vehicle registration information extraction step for extracting the vehicle registration information from an image of the corresponding vehicle imaged by the processing of the corresponding vehicle imaging step;
Based on the vehicle registration information of the corresponding vehicle extracted by the process of the corresponding vehicle registration information extraction step, the vehicle registration database registered by the process of the registration step is registered in association with the vehicle registration information of the corresponding vehicle. A search step for searching for a facial image,
An accumulation step of accumulating vehicle registration information searched by the processing of the search step and a face image registered in association with the searched vehicle registration information as corresponding vehicle face image information;
A face image acquisition step of acquiring a face image of the person to be collated at a predetermined position;
A collation step of calculating and collating the similarity between the face image of the person to be collated acquired by the processing of the face image acquisition step and the face image registered as the relevant vehicle face image information;
It is determined whether or not the face image of the visitor is a face image registered in the corresponding vehicle face image information by comparing the similarity that is the result of the collation in the collation step and a predetermined threshold value. A similarity determination step;
When it is determined by the similarity determination step that the face image of the person to be collated is a face image registered in the corresponding vehicle face image information, the person to be collated acquired at the predetermined position is the corresponding And a presentation step for indicating that the vehicle is a passenger. A registration step of registering vehicle registration information of a vehicle entering the parking lot and a face image of a person boarding the vehicle as a vehicle information database in association with each other;
Among vehicles parked in the parking lot, a corresponding vehicle imaging step of capturing an image of the corresponding vehicle,
A corresponding vehicle registration information extraction step for extracting the vehicle registration information from an image of the corresponding vehicle imaged by the processing of the corresponding vehicle imaging step;
Based on the vehicle registration information of the corresponding vehicle extracted by the process of the corresponding vehicle registration information extraction step, the vehicle registration database registered by the process of the registration step is registered in association with the vehicle registration information of the corresponding vehicle. A search step for searching for a facial image,
An accumulation step of accumulating vehicle registration information searched by the processing of the search step and a face image registered in association with the searched vehicle registration information as corresponding vehicle face image information;
A face image acquisition step of acquiring a face image of the person to be collated at a predetermined position;
A collation step of calculating and collating the similarity between the face image of the person to be collated acquired by the processing of the face image acquisition step and the face image registered as the relevant vehicle face image information;
It is determined whether or not the face image of the visitor is a face image registered in the corresponding vehicle face image information by comparing the similarity that is the result of the collation in the collation step and a predetermined threshold value. A similarity determination step;
When it is determined by the similarity determination step that the face image of the person to be collated is a face image registered in the corresponding vehicle face image information, the person to be collated acquired at the predetermined position is the corresponding A program that causes a computer to execute a process including a presenting step of presenting a passenger of a vehicle. In a monitoring system consisting of a monitoring device, a portable terminal carried by a parking clerk, and a presentation device,
The monitoring device
Registration means for associating vehicle registration information of a vehicle entering the parking lot with a face image of a person boarding the vehicle as a vehicle information database;
Corresponding vehicle registration information extracting means for extracting the vehicle registration information from the image of the corresponding vehicle imaged by the portable terminal;
Based on the vehicle registration information of the relevant vehicle extracted by the relevant vehicle registration information extracting means, the face image registered in association with the vehicle registration information of the relevant vehicle from the vehicle registration database registered by the registration means. A search means for searching for,
Storage means for storing vehicle registration information searched by the search means and face images registered in association with the searched vehicle registration information as corresponding vehicle face image information;
Face image acquisition means for acquiring a face image of the person to be collated at a predetermined position;
Collating means for calculating and collating the similarity between the face image of the person to be collated acquired by the face image obtaining means and the face image registered as the vehicle face image information.
Similarity determination for determining whether the face image of the visitor is a face image registered in the corresponding vehicle face image information by comparing the similarity that is the matching result of the matching unit with a predetermined threshold value Means,
The portable terminal is
Among vehicles parked in the parking lot, including a corresponding vehicle imaging means for capturing an image of the corresponding vehicle,
The presenting device
When the similarity determination unit determines that the face image of the person to be collated is a face image registered in the vehicle face image information, the person to be collated acquired at the predetermined position A monitoring system including a presentation means for presenting that the passenger is a passenger.

Images