JP2017062124A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a monitoring camera system in which a positional measurement system using an infrared LED of a monitoring camera is constructed and improved.SOLUTION: An infrared LED is used as a lighting device for position detection, so that an indoor positional measurement system is constructed.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a position positioning system using infrared illumination of a monitoring camera and a monitoring method thereby.

  Conventionally, as a technique for a terminal such as a mobile phone to acquire its own position information, GPS that receives a signal transmitted from a GPS (Global Positioning System) satellite and calculates its current position has spread. ing. In such GPS, an error occurs in the estimated position to be calculated due to delay and attenuation due to the influence of the ionosphere and convection layer in the signal path from the GPS satellite to the GPS receiving terminal, and shielding by terrain and clouds. Also, it is difficult to receive signals accurately indoors.

  Considering the radio signal, for example, a large error occurs only with the base station information of the wireless LAN. Even in position measurement using the reception intensity of the wireless LAN, it is necessary to construct a database of the MAC address, reception signal intensity, and position coordinates of the wireless LAN device in advance. Furthermore, there is a problem that it takes time to acquire the reception intensity and to estimate the current position based on the information in the database. In addition, in the positioning method using radio wave transmission indoors, problems such as the location of the transmission source is not known and the accuracy is not stable, such as the radio wave intensity becomes unstable due to ambient reflections and the like.

  Next, information communication is performed by using LED illumination installed on the indoor ceiling, etc., and performing light intensity modulation (IM: Intensity Modulation) of the illumination in a short time that cannot be recognized by human eyes, There is visible light communication technology.

  FIG. 13 shows such an LED lighting device. Each of the LED lighting devices 1305a, 1305b, and 1305c is assigned an identifier (ID) in advance, and visible light 1306a, 1306b, and 1306c are used as transmission media. The position information is sent by the signal. Visible light 1306a, 1306b, and 1306c transmitted from the LED lighting devices 1305a, 1305b, and 1305c are received by the visible light receiving terminal 1308 of the person 1307. The visible light receiving terminal 1308 reads the identifier included in the received visible light (here, visible light 1306b), inquires the prepared server for the position of the LED lighting device determined in advance corresponding to the identifier, It can be estimated as a position. Reference numerals 1301 and 1302 denote GPS satellites, and GPS signals 1303 and 1304 transmitted from the GPS satellites are blocked by the building 1307, and it is difficult to receive signals indoors.

  Here, Patent Document 1 describes a position estimation terminal that receives visible light transmitted from a visible light transmitter and estimates its own position. The position estimation terminal specifies the position of the visible light transmitting device from the identifier of the visible light transmitting device included in the received visible light. Then, the relative position with respect to the visible light transmitting device is calculated using the elevation angle and the azimuth when the visible light is received, and the position of the own light is calculated from the position of the visible light transmitting device and the relative position with respect to the visible light transmitting device. Is estimated. Further, Patent Document 2 describes a position estimation device that can estimate the position of a position estimation device based on intensity distributions of signals transmitted from a plurality of illumination lights.

Japanese Patent No. 5036631 JP 2014-235102 A

  However, in the prior art disclosed in the patent document, the user needs to point the light receiving unit of the position estimation terminal in the direction of the visible light transmission device, and complicated calculation is required until the current position is estimated based on the information. There is a problem that it must be done and takes time.

  Accordingly, an object of the present invention is to provide a position positioning system that can appropriately perform position positioning while eliminating the need for special operations.

In order to achieve the above object, an imaging apparatus according to the present invention includes:
In a surveillance camera equipped with night illumination infrared illumination, a position positioning system is configured by using infrared illumination as a position signal transmission light source.

  In order to enable simultaneous reception of position signals from a plurality of monitoring cameras, light emission timing control is performed between the monitoring cameras so as not to cause signal interference (interference).

  The monitoring camera detects distance information and direction of the subject, calculates more accurate position information for the subject, and transmits the information.

  The infrared illumination to be emitted is changed according to the subject position in the monitoring camera image. For example, when the subject is far away, infrared illumination for long-distance illumination is used, and for short-distance subjects, infrared illumination for short-distance illumination is used. Furthermore, light intensity control is performed according to the subject distance.

  It has a photographing direction changing means for changing a photographing direction, and more detailed position information is transmitted according to the photographing direction by the photographing direction changing means.

  In order to reduce power consumption, an area where no subject is present in the image of the surveillance camera is characterized by not emitting infrared illumination.

  By detecting that the subject is operating a portable device such as a smartphone, data transmission is performed toward the detected subject.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the surveillance camera system which can perform position positioning appropriately, without requiring special operation. More specifically, accurate position data can be determined, and interference between multiple cameras can be prevented.

It is an image figure of the camera system explaining 1st embodiment. It is a block diagram of the camera system explaining 1st embodiment. It is a block diagram of a camera system explaining a first embodiment. It is an operation | movement flowchart explaining 1st embodiment. The figure which is an image of the camera system explaining 2nd embodiment. It is an operation | movement flowchart explaining 2nd embodiment. It is an image figure of the camera system explaining 3rd embodiment. It is a timing chart of the camera system explaining a third embodiment. It is an image figure of the camera system explaining 4th embodiment. It is an operation | movement flowchart explaining 4th embodiment. It is an operation | movement flowchart explaining 4th embodiment. It is a locus diagram of a zoom lens and a focus lens in a rear focus type zoom lens. It is an image figure of visible illumination explaining background art.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is an image diagram of a camera system according to an embodiment of the present invention.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to FIG. In each figure, the same components are denoted by the same reference numerals, and redundant description is omitted.

  In FIG. 1, reference numerals 101 and 105 denote network cameras, which are configured to be able to rotate a captured image in the pan and tilt directions and have a zoom function. The network camera 101 photographs a person 102 having a receiving terminal 104 such as a mobile phone or a smartphone.

  Here, the network camera 101 includes infrared illumination (202a, 202b, 202c, 203a, 203b, 203c) as shown in FIG. 204 is an illuminance sensor that monitors ambient brightness and switches to night shooting mode (infrared lighting: ON, high sensitivity shooting mode by removing the infrared cut filter of the network camera) after the visible light is turned off. Used for etc. Reference numeral 201 denotes a substrate on which infrared illumination (202a, 202b, 202c, 203a, 203b, 203c) and an illuminance sensor 204 are mounted.

  In addition, infrared illumination (202a, 202b, 202c, 203a, 203b, 203c) modulates the infrared illumination light 103 with position measurement information and transmits it to the person 102 via a modulation unit (not shown). doing. Here, the position positioning information includes items such as a building name, a floor number, a latitude, and a longitude. The modulation unit may be configured to generate infrared illumination light 103 by modulating with position positioning information, and the modulation method is not particularly limited.

  The network camera 105 is installed at a different level, takes a picture of a person 106 having a receiving terminal 108 such as a mobile phone, and modulates and transmits position information to infrared light 107. The captured images of the cameras 101 and 105 are distributed to the client terminal 110 via the network 109.

  The network cameras 101 and 105 are preliminarily input information such as position positioning information with respect to its own position, direction (azimuth) with respect to the captured image, installation height, inclination, and the like. Calculation of position positioning information is performed. However, there is no problem even if these are obtained from various sensor information built in the network camera.

  Next, the flow of video signals and the flow of control signals in the network cameras 101 and 105 will be described with reference to FIG.

  An image from the subject is projected onto the image sensor 301 through the lens unit. The projected image is converted into an electric signal and sent to the signal processing board 303 through a cable. In the signal processing board 303, processing such as color separation, white balance, and gamma correction is appropriately performed by the imaging engine 304 and sent to the network engine 305. In the network engine 305, conversion into a predetermined video signal and compression are performed, and video output, recording on the recording server 312 via the LAN network 109, distribution to the client PC 110, and the like are performed.

  Next, control commands from the recording server 312 and the client PC 110 are received via the network 109 and analyzed by the controller 306 built in the network engine 305. For example, when a panning command is transmitted from the client PC 110, the command is analyzed by the controller 306, the pan motor 308 is driven via the driver 307 based on the control signal, and the photographing direction is changed.

  Reference numeral 314 denotes infrared illumination, and a signal modulated by the controller 306 is driven via a driver 316 and irradiated as infrared illumination light 103 and 107 whose position information is modulated.

  Note that the video engine 304 and the network engine 305 may be integrated as electronic components, and the configuration is not limited.

Next, the internal operation of the network cameras 101 and 105 in this embodiment will be described using the flowchart of FIG.
(Step 401) Start
(Step 402) Acquisition of the direction (direction) of the captured image. The shooting direction is detected from the pan / tilt positions of the network cameras 101 and 105. Proceed to step 403.
(Step 403) The zoom magnification (view angle range) of the captured image is acquired. Proceed to step 404.
(Step 404) The subject distance is detected. As shown in FIG. 12, in the rear focus zoom system, the distance to the subject can be calculated from the focus lens position with respect to the zoom lens position as long as the focus is achieved. If it is in focus and the zoom lens and focus lens are at point A, the distance to the subject is 10 m because it is on the 10 m trajectory. Proceed to step 405.
(Step 405) The distance from the vertical position of the network camera to the foot of the subject is calculated based on the direction of the captured image, and accurate positioning of the subject is performed. Proceed to step 406.
(Step 406) The infrared illumination light is modulated according to the obtained position positioning information. Proceed to step 407.
(Step 407) The modulated infrared light is output. Proceed to step 408.
(Step 408) End.

  As described above, in the network camera provided with infrared illumination, the position monitoring system is configured by using the infrared illumination for night monitoring as the position signal transmission light source.

(Second Embodiment)
Hereinafter, with reference to FIG. 5, a monitoring mode of the camera system according to the second embodiment of the present invention will be described. In each figure, the same components are denoted by the same reference numerals, and redundant description is omitted.

  In FIG. 5, reference numeral 501 denotes a network camera which is configured to be able to rotate a captured image in the pan and tilt directions and has a zoom function.

  The network camera 501 captures a person 502 having a receiving terminal 503 such as a mobile phone or a smartphone and a person 504 having a receiving terminal 507. The network camera 501 includes infrared illumination (202a, 202b, 202c, 203a, 203b, 203c) as shown in FIG.

  Reference numerals 202a, 202b, and 202c are infrared illuminations for distant illumination, and 203a, 203b, and 203c are infrared illuminations for near illumination.

  By changing the infrared illumination to be emitted according to the shooting field angle direction (azimuth) of the network camera 501 and the subject position in the image, it is possible to provide detailed position positioning information for a limited subject. For example, infrared illumination (203a, 203b, 203c) for short-distance illumination is used for short-distance subjects, and infrared illumination (202a, 202b, 202c) for long-distance illumination is used for distant subjects. Is used. As described above, the camera can detect the distance information and direction of the subject, calculate more accurate correction information, and transmit the position measurement information.

  The network camera 501 transmits position measurement information 505 by infrared illumination (203a, 203b, 203) for short-distance illumination to the person 502, and infrared for long-distance illumination to the person 504. Position positioning information 506 by illumination (203a, 203b, 203) is transmitted to provide detailed position positioning information.

Next, the internal operation of the network camera 501 in this embodiment will be described using the flowchart of FIG.
(Step 601) Start
(Step 602) Acquisition of the direction of the captured image. The shooting direction (direction) is detected from the pan / tilt position of the network camera 501. Proceed to step 603.
(Step 603) The zoom magnification (angle of view range) of the captured image is acquired. Proceed to step 604.
(Step 604) The subject distance is calculated from the zoom magnification and the focus lens position. Proceed to step 605.
(Step 605) The tilt angle and the distance from the vertical position of the network camera to the foot of the subject are calculated, and the subject is positioned. Proceed to step 606.
(Step 606) The obtained subject distance is compared with the predetermined distance L. If it is farther than that, the process proceeds to Step 607, and if not, the process proceeds to Step 608.
(Step 607) Select infrared illumination for long distance. Proceed to step 609.
(Step 608) Select infrared illumination for short distance. Proceed to step 609.
(Step 609) The selected infrared illumination light is modulated based on the obtained position positioning information. Proceed to step 610.
(Step 610) Output modulated infrared light. Proceed to step 611.
(Step 611) End.

  In addition, with regard to such illumination assignment, a method of further subdividing and emitting one of 203a, 203b, and 203c according to the left and right positions of the subject can be considered, and the irradiation direction of each infrared illumination A method of transmitting position positioning information corresponding to the time division in a time division manner is also conceivable.

(Third embodiment)
Hereinafter, with reference to FIG. 7, a monitoring mode of the camera system according to the third embodiment of the present invention will be described.

  In FIG. 7, reference numerals 701 and 702 denote network cameras, which are configured to be able to rotate captured images in the pan and tilt directions and have a zoom function.

  The network cameras 701 and 702 photograph a person 703 who has a receiving terminal 704 such as a mobile phone or a smartphone. The network cameras 701 and 702 include infrared illumination (202a, 202b, 202c, 203a, 203b, and 203c) as shown in FIG.

  Here, in order to enable simultaneous reception of position positioning signals from a plurality of network cameras, emission timing control of infrared illumination between the network cameras is performed so as not to cause signal interference (interference).

  FIG. 8 shows a light emission timing example of the infrared illumination lights 705 and 706 from the network cameras 701 and 702.

  The network cameras 701 and 702 take the light emission timing according to the vertical synchronization signal, thereby preventing the interference of the positioning signal.

  In consideration of the situation of FIG. 7, it is also effective to give priority to the transmission of the positioning signal by the network camera 701 according to the traveling direction of the person 703.

(Fourth embodiment)
Hereinafter, with reference to FIG. 9, a monitoring mode of the camera system according to the fourth embodiment of the present invention will be described.

  In FIG. 9, reference numeral 901 denotes a network camera, which is configured to be able to rotate a captured image in the pan and tilt directions and has a zoom function.

  The network camera 901 takes a picture of a person 902 having a receiving terminal 903 such as a mobile phone or a smartphone, and a person 904 having no receiving terminal. The network camera 901 includes infrared illumination (202a, 202b, 202c, 203a, 203b, 203c) as shown in FIG.

  The network camera 901 detects that the receiving terminal 903 is held over the person 902 and transmits the position positioning information 905 using infrared illumination, but the person 904 holds the receiving terminal over the person 904. The transmission of the positioning information 906 is stopped.

Next, the internal operation of the network camera 901 in this embodiment will be described using the flowchart of FIG.
(Step 1001) Start
(Step 1002) A subject in a captured image of the network camera is detected. If the subject exists, the process proceeds to step 1003, and if not, the process proceeds to step 1010.
(Step 1003) It is detected whether or not the photographing subject is holding the receiving terminal. If the receiving terminal is held up, the process proceeds to step 1004. If not, the process proceeds to step 1010.
(Step 1004) The direction of the captured image is acquired. The shooting direction (direction) is detected from the pan / tilt position of the network camera 901. Proceed to step 1005.
(Step 1005) The zoom magnification (view angle range) of the captured image is acquired. Proceed to step 1006.
(Step 1006) The subject distance is calculated from the zoom magnification and the focus lens position. Proceed to step 1007.
(Step 1007) The tilt angle and the distance from the vertical position of the network camera to the foot of the subject are calculated, and the position of the subject is measured. Proceed to step 1008.
(Step 1008) Infrared illumination light is modulated according to the obtained position positioning information. Proceed to step 1009.
(Step 1009) Output modulated infrared light. Proceed to step 1010.
(Step 1010) End.

  Next, a case where a signal is transmitted from the network camera 901 in response to a request for position positioning information from the person 902 will be described. The network camera 901 receives a position positioning information request from the person 902 by the infrared light receiving element 315 (see FIG. 3) and transmits the position positioning information.

The internal operation of the network camera 901 will be described using the flowchart of FIG.
(Step 1101) Start.
(Step 1102) The position request information transmission request from the person 901 is confirmed. If there is a request for position positioning information, the process proceeds to step 1103, and if there is no request, the process proceeds to step 1109.
(Step 1103) The direction of the captured image is acquired. The shooting direction (direction) is detected from the pan / tilt position of the network camera 901. Proceed to step 1104.
(Step 1104) The zoom magnification (view angle range) of the captured image is acquired. Proceed to step 1105.
(Step 1105) The subject distance is calculated from the zoom magnification and the focus lens position. Proceed to step 1106.
(Step 1106) The tilt angle and the distance from the vertical position of the network camera to the foot of the subject are calculated, and the position of the subject is measured. Proceed to step 1107.
(Step 1107) Infrared illumination light is modulated according to the obtained position positioning information. Proceed to step 1108.
(Step 1108) Output modulated infrared light. Proceed to step 1109.
(Step 1109) End.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

101 camera, 102 person, 103 infrared illumination light, 104 receiving terminal

Claims (7)

An imaging means for imaging the monitoring target area;
Infrared illumination means for illuminating the monitored region;
Infrared illumination brightness changing means for changing the brightness of the infrared illumination means;
Position positioning means for positioning the imaged subject, and
The position positioning information acquired by the position positioning means is modulated by the infrared illumination brightness changing means,
An imaging apparatus that performs transmission from the infrared illumination means. The imaging device is arranged in the monitoring target area,
2. The imaging apparatus according to claim 1, wherein irradiation timing control of the infrared illumination unit is performed between the imaging apparatuses.   The imaging apparatus according to claim 1, wherein the distance information and direction (direction) of the subject are detected, and more accurate position information is calculated and transmitted. The infrared illumination means is composed of a plurality of light emitters,
The imaging apparatus according to claim 1, wherein a light emitter that emits light is changed according to a position of the imaging subject. Having a shooting direction changing means for changing the shooting direction;
The imaging apparatus according to claim 1, wherein more detailed position information is transmitted according to a shooting direction by the shooting direction changing unit.   The imaging apparatus according to claim 5, wherein the infrared illumination unit is not irradiated in an area where there is no subject in the monitoring target area. Receiving terminal detection means for detecting whether the subject has a receiving terminal;
2. The imaging apparatus according to claim 1, wherein position measurement information is transmitted toward the subject based on a detection result of the receiving terminal detection unit.