JP2019046053A - Monitoring system, monitoring method - Google Patents

Abstract

An object of the present invention is to collate card information with an image of a person by collating a captured card user with an image of a person stored in a storage unit.
A ticket image pickup unit provided in a station ticket gate, a first matching unit for collating a person based on an image of a person received from an external server and a ticket image picked up by the ticket gate image pickup unit, and a ticket gate image And a third matching unit that detects a person based on ticket information received from a station ticket gate provided with a ticket gate imaging unit that has captured a ticket image, and card information when the station ticket gate is entered and exited, and the ticket gate And a tying unit for tying the image, the ticket gate information, and the card information and accumulating the information in the storage unit.
[Selected figure] Figure 3

Description

  The present invention relates to a monitoring system and a monitoring method.

  Conventionally, various techniques for imaging and monitoring a person have been developed. For example, Patent Document 1 shows a gate system including a gate device and a photographing device for photographing a person passing the gate device, and ticket information when a ticket owned by the person passing the gate device is gated Ticket information acquiring means for acquiring the image, image photographing means for photographing a person passing through the gate device by the photographing device, attribute information detection means for detecting attribute information of a person from image information photographed by the image photographing means, There is disclosed a gate system having a tying means for tying the ticket information acquired by the information acquiring means and the attribute information detected by the attribute information detecting means.

JP, 2011-018300, A

  The technology described in Patent Document 1 does not disclose a configuration for collating a photographed IC card user with an image of a person stored in a storage unit such as a DB (Data Base). That is, it is not possible to collate the card information with the image of the person by collating the user of the captured card with the image of the person stored in the storage unit.

  The present invention provides a monitoring system and a monitoring method that can collate card information with an image of a person by collating a user of a captured card with an image of a person stored in a storage unit. With the goal.

A surveillance system according to the present invention is a first system for collating a person based on a ticket gate imaging unit provided in a station ticket gate, an image of a person received from an external server, and a ticket gate image captured by the ticket gate imaging unit. The matching unit, the ticket gate image, the ticket gate information received from the station ticket gate provided with the ticket gate imaging unit for capturing the ticket gate image, and the card information when the station ticket gate is entered and exited A monitoring system comprising: a third matching unit for detecting a person; and a tying unit for tying the ticket image, the ticket information, and the card information and storing the string information in a storage unit. Ru.
The present invention is also understood as a monitoring method used in the above monitoring system.

  According to the present invention, it is possible to collate the user of the captured card with the image of a person stored in the storage unit, and associate the card information with the image of the person.

It is a figure which shows the typical system configuration of a surveillance camera system. It is a figure showing functional composition of a central server and a station system. It is a figure which shows the processing sequence between a central server, a station system, and image DB. It is a figure which shows the processing flow of a central server. It is a figure which shows the example of camera reception image data. It is a figure which shows the example of ticket gate information. It is a figure which shows the example of IC card information.

  Hereinafter, examples will be described in detail using the drawings.

  FIG. 1 is a view showing a typical system configuration of a monitoring camera system 1000 in the present embodiment. In the surveillance camera system 1000, a central server 101, an image DB server 102, and a station server 103 are connected via a network N.

  The central server 101 is a server that manages a plurality of station servers 103, accesses the image DB server 102 as necessary, and performs various operations. Details of the central server 101 will be described later with reference to FIG.

  The image DB server 102 is a DB server outside the system that stores an image group to be searched. In the example of FIG. 1, as described above, the image DB server 102 is connected to the central server 101 via the network N. Although the image DB server 102 stores the face image of the wanted criminal and the image DB server 102 is described on the premise provided in the police system below, the image DB server 102 may be provided in the central server 101. The image of the wanted criminal is retrieved from the image group in the image DB server 102 in which the face image of the user entering or leaving the station is stored as the query image by the process described later with reference to FIGS. It becomes applicable to the scene.

  As described above, when the image DB server 102 is stored in the central server, it is effective, for example, when depositing a predetermined image group from the police system to a station management company.

  The station server 103 is a server installed for each station, manages a station where the station server 103 is installed, and collects information to be collected on the central server 101. Details of the station server 103 will be described later with reference to FIG.

  FIG. 2 is a diagram showing functional configurations of the central server 101 and the station server 103. As shown in FIG. As illustrated in FIG. 2, the central server 101 includes a storage unit 201, a first butting unit 202, a second butting unit 203, a third butting unit 204, a notifying unit 205, and a linking unit 206. Is configured. In addition, the station server 103 is configured to have a ticket management unit 1031 and a premises management unit 1032. First, the central server 101 will be described.

  The storage unit 201 includes, for example, a storage device such as a hard disk drive (HDD) as hardware, and the police reception image 2011, the camera reception image data 2012, the card information 2013, the detected image 2014, The notification information 2015 and the ticket gate information 2016 are stored.

  The police reception image 2011 is image data received from the police system. The camera reception image data 2012 is image data including a ticket gate image captured by the ticket gate camera unit 104 and a local image captured by the local camera unit 106. An example of the camera reception image data 2012 will be described later with reference to FIG. The card information 2013 is data including the history of the IC card when entering and leaving the station ticket gate. An example of the card information 2013 will be described later with reference to FIG. The detected image 2014 is image data in which a person presumed to be the offender is detected among the ticket gate image and the indoor image. The notification information 2015 is data including card information 2013 and personal information of a person presumed to be a criminal included in the detected image 2014 and the detected image 2014. The ticket examination information 2016 is data including the history of the station ticket gate where the user entered and exited by the IC card. An example of the ticket gate information 2016 will be described later with reference to FIG.

  The first matching unit 202 performs processing of matching the police reception image 2011 with the ticket gate image included in the camera reception image data 2012 and collating a person presumed to be a criminal. The details of the matching method will be described later with reference to FIGS.

  The second matching unit 203 performs processing of matching the police reception image 2011 with the local image included in the camera reception image data 2012 and collating a person presumed to be a criminal. The details of the matching method will be described later with reference to FIGS.

  The third matching unit 204 matches the ticket inspection image included in the camera reception image data 2012 with the card information 2013 when the first matching unit 202 and the second matching unit 203 estimate a criminal. A process is performed to match the person assumed to be The details of the matching method will be described later with reference to FIG.

  The notification unit 205 transmits notification information 2015 to the station server 103 and the image DB server 102 when a criminal is estimated in the first matching unit 202, the second matching unit 203, and the third matching unit 204. .

The associating unit 206 associates the police reception image stored in the storage unit 201 with the camera reception image data, the IC card information, and the ticket gate information.
As shown in FIG. 2, the station server 103 has a ticket management unit 1031 and a premises management unit 2032. A ticket management unit 1031 manages a station ticket gate and devices around the station ticket gate. A ticket control unit 1031 is provided in the vicinity of a station ticket gate, and has a ticket gate camera unit 104 for imaging the station ticket gate and its surroundings, a station ticket gate and information recorded in the IC card of the user by contact or non-contact And an IC card reading unit 105 for reading the

  The premises management unit 1032 manages devices in the vicinity of the station premises other than the ticket control unit 1031. The premises management unit 1032 is provided at a place other than the ticket gate camera unit 104, and includes a premises camera unit 106 for imaging the periphery of the station premises. As places other than the station ticket gate, for example, the vicinity of the home in the station ticket gate and the vicinity of the ticket vending machine outside the station ticket gate can be mentioned. A premises camera unit 106 may be provided in a place other than the station ticket gate, such as a concourse or a store adjacent to the concourse. In addition, the ticket gate camera unit 104 may be provided at a place other than the home in the ticket gate, for example, a staircase or a corridor connecting the home and the home.

FIG. 3 is a diagram showing a processing sequence among the central server 101, the station server 103, and the image DB server 102.
In the process of S301, the image DB server 102 performs an image of the wanted criminal on the central server 101 as a periodic process once a day, once a week, or the like. The central server 101 stores the image received from the image DB server 102 in the storage unit 201 as a police reception image.

  In the process of S302, the station server 103 transmits, to the central server 101, the ticket gate image captured by the ticket gate camera unit 104 and the indoor image captured by the indoor camera unit 106. The central server 101 stores the image received from the station server 103 in the storage unit 201 as a camera reception image.

  In the S303 process, the station server 103 receives the IC card information recorded in the IC card of the user read by the IC card reading unit 205 when entering and leaving the station ticket, and the station ticket when the user enters and leaves by IC card. Is sent to the central server 101. The central server 101 stores the information received from the station server 103 in the storage unit 201 as IC card information 2013 and ticket gate information 2016, respectively. From the IC card information 2013 and the ticket gate information 2016, it is possible to grasp the IC card ID of the customer, the ticket gate ID, and the time when the ticket gate passes.

  In S304 processing, the first matching unit 202 of the central server 101 analyzes the police reception image and the detected image stored in the storage unit 201, and the ticket gate image captured by the ticket gate camera unit 104 from among the camera reception images. The process of matching is performed as a periodic process once every several seconds. Details of the S304 process will be described later with reference to FIG.

  In S305 processing, the second matching unit 203 of the central server 101 analyzes the police reception image and the detected image stored in the storage unit 201 and the local image captured by the internal camera unit 106 from the camera reception image. The process of matching is performed as a periodic process once every several seconds. Details of the process of S305 will be described later with reference to FIG.

  The S306 process is performed when the S304 process is successful. The third matching unit 204 of the central server 101 links the detected image 2014 with the card information 2013. For example, the third matching unit 204 has an entry in which the shooting time 505 of the detected image 2014 matches the ticket ID for identifying the station ticket provided with the ticket camera unit 104 that has captured the detected image 2014. The ticket search information 2016 is searched, and the linking unit 210 links the information with the IC card ID of the corresponding entry, and stores the linked information in the notification information 2015.

  In addition, the third matching unit 204 searches the IC card information 2013 for an ID that matches the IC card ID, and when the linking unit 210 has registered personal information such as a name in the corresponding entry, the matching unit Information is linked and stored in the notification information 2015. The notification information 2015 is information in which an entry including a detected image in the camera reception image data is associated with the police reception image. Specific contents will be described later.

  By this processing, it is possible to carry out the linking of the wanted criminal and the IC card, even if the face picture has not been registered in the IC card in advance. For example, it is possible to detect a criminal even in a state where the name of the wanted criminal is unknown, the photograph is not present, the portrait is unknown, and the foreign nationality does not know the name. As a result, it is possible to identify a purchase item using an IC card and its position, as well as a station for getting off the wanted criminal, and it becomes possible to grasp the gait and life pattern of the wanted criminal. Further, if personal information of the wanted criminal is registered in the used IC card, that information can be obtained, and if it is subscribed to the auto charge etc., bank account information etc. can also be grasped. Even if personal information other than the wanted criminal is registered, there is a possibility that the person may lead to the wanted criminal.

  For example, in step S305, the second matching unit 203 of the central server 101 analyzes the police reception image including the wanted offender and the camera reception image including the person of the entry # 2 of the camera reception image data 2012 shown in FIG. As a result of collation, it is assumed that it is determined that the person of the wanted criminal and the person of the camera reception image match. In this case, the second matching unit 203 accesses the ticket inspection information 2016 shown in FIG. 6 using the ticket ID ID EB1 included in the entry and the imaging time 10:05:01 as keys, and the ticket ID and the ticket ID An entry including the same ticket ID as the imaging time and the entry time or exit time is retrieved, and the IC card ID A00002 included in the retrieved entry is read. Thus, it can be seen that the person who possessed the IC card whose IC card ID is A00002 has passed the station ticket gate identified by EB1. Here, the associating unit 206 associates the police reception image including the wanted criminal, the determined camera reception image, and the IC card IDA00002 and stores the association in the storage unit 201.

  Furthermore, the linking unit 206 accesses the IC card information 2013 shown in FIG. 7 using A00002 which is the IC card ID searched from the IC card information 2013 as a key, searches for an entry including the IC card ID, and searches The name XXXX, which is a name included in the extracted entry, is further linked to the linked information.

  Finally, the linking unit 206 stores the linked information in the notification information 2015. At this time, even if the name XXXX is not registered, the face of the person presumed to be the name XXXX and the IC card ID A00002 can be linked from the linked camera reception image and the IC card information. It is a feature.

  The S307 process is performed when the S304 process or the S305 process is successful. The notification unit 205 of the central server 101 transmits, to the station server 103, a notification of the wanted criminal detection stored in the notification information 2015.

  The process of S308 is performed when the process of S304 or S305 is successful. The notification unit 205 of the central server 101 transmits, to the image DB server 102, a notification of the wanted criminal detection stored in the notification information 2015.

  Referring to FIG. 3, for example, a case is considered where a wanted criminal is imaged by the on-site camera unit 1032 of the station A, and then a rider passes the ticket gate of the station A. In this case, it is first assumed that the wanted offender is imaged by the indoor camera unit 1032, and the person is collated and detected in the process of S305. The second matching unit 203 registers the image detected at this time in the storage unit 201 as a detected image 2014. As a result, the image sample of the wanted offender from the next time on increases, and the possibility of finding the desired offender increases. In addition, when clothes and the like that are worn on the day are included in the detected image, the information becomes powerful information for finding a wanted criminal, and the possibility of finding a wanted criminal increases. Thereafter, the station server 103 and the image DB server 102 of the station A are notified that the wanted criminal has been detected in the station yard through the S307 process and the S308 process.

  Thereafter, if the wanted criminal is imaged by the ticket camera unit 104 at the time of passage through the ticket gate in the processing of S304 periodically called, the second matching unit 203 determines the camera reception image at that time and the designation received in the processing of S301. The police reception image including the orderer and the past detected image stored in the S305 process are collated, and a person included in the camera reception image captured in S304 is a person included in the police reception image and the detection image Detect that there is.

  Next, the linking unit 206 performs the S306 process, the police reception image including the wanted criminal at the time of passing the ticket gate used in the collation in the S304 process, the camera reception image, and the detected image, the ticket information 2016 and the IC card. It is associated with personal information such as an ID stored in the information 2013. Thereby, the police reception image including the wanted criminal image, the camera reception image, the detected image, and the IC card stored in the IC card information 2013 can be linked to the ticket gate information 2016. If the name, date of birth, etc. are also registered in the IC card, such information can also be linked with the wanted criminal image. After that, the notification unit 205 notifies the station server 103 installed at the station A in the process of S307 of the wanted criminal information. In addition, the notification unit 205 notifies the image DB server 102 of the wanted criminal information in the process of S308.

  As another usage, it is applicable also when there is a crime in the station yard. Although the case of the station yard is explained below, when a crime arises near a ticket gate, it can think similarly.

  For example, it is assumed that a person ZZ who was innocent as of yesterday was drunk last night, assaulted station members and escaped. In this case, the in-station camera unit 106 of the station server 103 installed at the station where the assault occurred is imaging the inside of the station. Therefore, the ticket control unit 1031 displays the image captured by the internal camera unit 106 at the time when the assault was made on the display unit of the station server 103. According to the display, the station clerk who has been beaten confirms the image. When the station server 103 receives an input indicating that the person ZZ has been specified from the input device, the station server 103 transmits the time at which the person ZZ was imaged and the image thereof to the central server 101 as a detected image. The second matching unit 203 of the central server 101 stores the detected image received from the station server 103 in the storage unit 201 as the detected image 2014, and among the camera reception image data 2012 stored in the storage unit 201. From the image where the same person ZZ has been captured.

  As a method of specifying a person, various methods may be used such as determining that the person is the person if the degree of coincidence of features such as the face or clothes of the person is equal to or more than a predetermined threshold (for example, 90%). it can. In the case of this example, the camera image of the station at which the assault occurred last night and the camera images of the surrounding stations of the last night may be compared with the detected image received from the station server 103.

  If the second matching unit 203 can detect the person ZZ, it is possible to confirm the gait of the IC card used by the person ZZ. For example, the second matching unit 203 accesses the ticket gate information 2016 shown in FIG. 6 using the time included in the detected image as a key, and an entry including the same entry time or exit time as the time from the ticket gate information 2016 Is searched, and the IC card ID included in the searched entry is read.

  Alternatively, the second matching unit 203 accesses the IC card information 2013 shown in FIG. 7 using the time included in the detected image as a key, and from the IC card information 2013, the same entrance time or exit time as that time Search for the contained entry and read the ID contained in the searched entry. As described above, the second matching unit 203 tracks the entry / exit history of the person by using as a key the time at which the image was captured when the person ZZ was detected (in this example, when the assault was made). Can check their gait.

  In addition, if personal information is registered in the IC card, it is possible to grasp personal information of the person. In this way, even if a criminal can not be detected when the ticket passes, it is possible to detect the offender by confirming the subsequent gait. In addition, if a criminal can not be detected when the ticket passes, there is a possibility that a mask or the like has not been disguised, and it is possible to expect a possibility of easy detection.

  Alternatively, it can be applied to collective criminal organizations. For example, the second matching unit 203 detects the past gait of a plurality of wanted criminals by the above-described method, and it can be known that each of a plurality of wanted criminals were getting on / off at the same station at the same time. For example, they are likely to have acted together, and if they frequently get off at a particular station, they may be agic. Such usage can contribute to the arrest of criminal organizations acting collectively such as terrorists.

  FIG. 4 is a diagram showing the process flow of the central server 101, and is a diagram showing the details of S304 and S305. By this processing, the received camera image is collated with the police received image and the detected image.

  In S401, the first matching unit 202 and the second matching unit 203 respectively check the police reception image and the detected image including the offender image received from the image DB server 102 with the ticket gate image and the inside image. The detected image 2014 is an image detected on the day, and since the face and clothes of the offender are on the day, the matching accuracy is improved. Of course, the detected image may further include a past image. For this reason, even if the wanted criminal hides his face such as wearing a mask when passing a ticket gate, it becomes possible to link from characteristic information on appearance other than face such as clothes. In addition, since there is no need for the criminal image to be registered in the IC card in advance, what kind of station the wanted criminal has been getting in and out in the past, if data of past IC card use is left, how It is possible to grasp past steps, such as whether you have purchased something. In addition to the IC card, it is also possible to associate a terminal that can specify a personal ID.

  In S402, the first butting unit 202 and the second butting unit 203 determine whether the comparison result is acceptable or not, and the process transitions to 403 if successful, or 404 if unsuccessful.

  In S403, the first butting unit 202 and the second butting unit 203 store the detected content.

  In S404, the first matching unit 202 and the second matching unit 203 determine whether all images to be calculated have been checked, and if successful, the processing ends, and if unsuccessful, the processing transitions to 401.

  FIG. 5 is a view showing an example of camera reception image data 2012. As shown in FIG. The camera reception image data 2012 includes data on a ticket gate image and data on a local image.

  As shown in FIG. 5, the camera reception image data 2012 includes an item number 501 for identifying an entry, a camera ID 502 for identifying the ticket gate camera unit 104 or the indoor camera unit 106, and a ticket gate ID 503 for identifying a station ticket gate. An installation station 504 indicating a station where the station ticket gate is installed, a photographing time 505 indicating a time when the ticket camera unit 104 or the indoor camera unit 106 captures an image, an image captured by the ticket camera unit 104 or the indoor camera unit 106 And a photographed image 506 showing the image.

  The first matching unit 202 and the second matching unit 203 respectively store a ticket gate image and an indoor image received from the station server 103 as a photographed image 506 of the camera reception image data 2012. The first matching unit 202 and the second matching unit 203 respectively store the camera ID 502 received with the ticket gate image and the inside image, the ticket gate ID 503, the installation station 504, the shooting time 505, and the photographed image 506 Store in the same entry as 506.

  In FIG. 5, for example, it can be understood that the camera ID of the ticket gate camera unit 104 installed at station B is K152, and the ticket gate camera unit 104 is installed near the station ticket gate identified by the ticket ID EB1. . Further, it can be understood that the ticket gate camera unit 104 has captured the captured image ΩA at 10:05:01 on a certain day. As described above, the first matching unit 202 and the second matching unit 203 accumulate the information in the form of a history together with the camera reception image received from the station server 103 and store the information in the camera reception image data 2012. In the entries # 1 and # 4, no ticket gate ID is recorded. The reason is that these entries are camera reception images captured by the local camera unit 106.

  FIG. 6 is a diagram showing an example of the ticket gate information 2016. As shown in FIG. As shown in FIG. 6, the ticket information 2016 has a ticket ID 601 for identifying a station ticket, an entry time 602 indicating the time when the user entered from the station ticket, and the user exits the station ticket And an IC card ID 604 for identifying an IC card used when entering and leaving.

  In FIG. 6, for example, it is shown that the user who holds the IC card identified by the IC card ID A00002 has entered at 10:05:01 from the station ticket gate identified by EB1. Further, for example, it indicates that the user who holds the IC card identified by the IC card ID A83194 has entered from the station ticket gate identified by EB2 at 10:05:00.

FIG. 7 shows an example of the IC card information 2013. As shown in FIG.
As shown in FIG. 7, the IC card information 2013 includes an item number 701 for identifying an entry, an ID 702 for identifying the IC card, a name 703 indicating the owner of the IC card, and entrance using the IC card. An entry station 704 indicating the station where the station was located, an entry ticket 705 indicating the station ticket which entered the station ticket set in the station where the entry station was entered, an entry time 706 indicating the time of entry from the station ticket, the IC card And an exit ticket 708 indicating a station ticket gate that has been exited out of station ticket gates provided in the station that has been exited, and an exit time 709 indicating a time when the station ticket gate has exited.

  In FIG. 7, for example, the owner of the IC card identified by the ID A00001 has no registration, and enters the station ticket gate EA4 15:30:33 at the A station, and the ticket gate S C2 at the C station 16:30:12. It indicates that you have left. In addition, the owner of the IC card identified by the ID A00002 is XXXX, and it enters 10:05:01 from the station wicket EB1 at station B and is unresigned at this point in time and being in any station yard I understand.

  As described above, in this system, means for searching and collating the image DB server with the photographed image as a search query image, linking the image in the image DB server hit by the search and collation with the IC card information Therefore, the card user and the image of the person can be linked by collating the user of the captured card with the image of the person stored in the storage unit.

101: Central server 102: Image DB server 103: Station server 201: Storage unit 205: Notification unit 206: Linkage unit 104: Ticket camera unit 105: IC card reader unit 106: Private camera unit

Claims (8)

The ticket gate imaging unit provided at the station ticket gate,
A first matching unit that collates the person based on an image of a person received from an external server and a ticket gate image captured by the ticket gate imaging unit;
The person is detected based on the ticket gate image, ticket gate information received from the station ticket gate provided with the ticket gate imaging unit that has captured the ticket gate image, and card information when the station ticket gate is entered and exited A third butt joint,
A tying unit for tying the ticket image, the ticket information, and the card information and storing the string information in a storage unit;
A monitoring system comprising: A premises imaging unit provided in a premises other than the station ticket gate,
And a second matching unit that matches the person based on the image of the person received from the external server and the local image captured by the local imaging unit.
The tying unit further ties the local image and stores the tying image in the storage unit.
The monitoring system according to claim 1, characterized in that: The first matching unit collates the person based on features related to the appearance other than the face of the person.
The monitoring system according to claim 1, characterized in that: The second matching unit collates the person based on features related to the appearance other than the face of the person.
The monitoring system according to claim 2, characterized in that. Performing a first matching on the person based on the image of the person received from the external server and the ticket image captured by the ticket gate imaging unit provided in the station ticket gate;
The person is detected based on the ticket gate image, ticket gate information received from the station ticket gate provided with the ticket gate imaging unit for capturing the ticket gate image, and card information when the station ticket gate is entered and exited. ,
The ticket image, the ticket information, and the card information are associated with each other and stored in a storage unit.
A monitoring method characterized by A second matching is performed to match the person based on the image of the person received from the external server and the premises image captured by a premises imaging unit provided in the premises other than the station ticket gate,
In the tying, the premises image is further tied and stored in the storage unit.
The monitoring method according to claim 5, characterized in that: Matching the person in the first match based on features related to the appearance other than the face of the person;
The monitoring method according to claim 5, characterized in that: In the second matching, the person is matched based on features related to the appearance other than the face of the person;
The monitoring method according to claim 6, characterized in that:

Images