JP2019114967A - Automatic photographing system and automatic photographing method - Google Patents

Abstract

To provide an automatic photographing system capable of photographing even if a subject approaches from any direction.SOLUTION: The automatic photographing system includes: a plurality of receivers 2 capable of receiving a signal including identification information from a transmitter 3; an imaging apparatus 1 configured to perform imaging with an omnidirectional camera when at least one of the plurality of receivers 2 receives the signal; and a server device 5 for storing by associating reception intensity of the signal by each receiver 2, the identification information, and an image captured by the imaging apparatus 1 with each other.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an automatic photographing system and an automatic photographing method for automatically photographing an object.

  At leisure facilities, there is a service to shoot users and sell photos. For example, the staff photographs visitors at the entrance of the attraction, and prints out the printed photos at the exit of the attraction.

  In addition, a service has been implemented which automatically shoots visitors from a predetermined location and sells the photos taken to the visitors as a memorial. As a method of automatically photographing a visitor, according to Patent Document 1, the photographing apparatus acquires identification information transmitted from a transmitter of an entrance tag possessed by the visitor, and the acquired identification information corresponds to the photographed image. There is disclosed a technique for storing a stored image and retrieving and displaying a captured image stored using the identification information as a key.

  In such prior art, the imaging device performs imaging when receiving a signal from the transmitter. For example, in a leisure facility, visitors (subjects) are moving to various places and directions, and it is certain that the subject is in the vicinity of the photographing device when the signal from the transmitter is received, but the subject is photographed There is no guarantee that the area is located, and the subject may not be captured well.

Unexamined-Japanese-Patent No. 2002-112074

  An object of the present invention is to provide an automatic photographing system and an automatic photographing method capable of photographing from any direction from which a subject approaches.

  An automatic photographing system according to the present invention comprises a plurality of receivers capable of receiving a signal including identification information from a transmitter, and a photographing device for photographing with an omnidirectional camera when at least one of the plurality of receivers receives the signal. And a server device that stores the reception intensity of the signal by each receiver, the identification information, and the image captured by the imaging device in association with each other.

  In one aspect of the present invention, the server device cuts out a portion where a subject corresponding to the identification information is photographed from the photographed image, based on the reception intensity of the signal by each receiver.

  In one aspect of the present invention, a display device for receiving and displaying the photographed image from the server device, and a reader for receiving a signal from the transmitter and notifying the server device of identification information included in the received signal And the server device cuts out, from the photographed image corresponding to the identification information notified from the reader, a portion where the subject corresponding to the identification information is photographed, and the cut-out image is displayed on the display device. Send and display.

  In one aspect of the present invention, the server device determines an area where a subject corresponding to the identification information is photographed in the photographed image based on the reception intensity of the signal by each receiver, and the area other than the determined area A face image appearing in a region is extracted, and the extracted face image is converted into a predetermined image.

  The automatic photographing method according to the present invention includes the steps of: at least one of a plurality of receivers receiving a signal including identification information from a transmitter; and a step of photographing with an omnidirectional camera upon reception of a signal by the receivers. And a server device cutting out a portion where a subject corresponding to the identification information is photographed from the photographed image, based on the reception intensity of the signal by each receiver.

  According to the present invention, it is possible to capture an image from any direction from which a subject approaches.

(A) is the schematic of the automatic imaging | photography system which concerns on embodiment of this invention, (b) is a figure which shows the wristband distributed to a user. (A) is a figure which shows the display which displays a picked-up image, (b) is a figure which shows the example of a picked-up image, (c) is a figure which shows the example of trimming of an image. It is a block diagram of an automatic photography system. It is a figure showing an example of a photography picture. (A) is a table | surface which shows the example of the signal reception intensity | strength of each receiver, (b) is a figure which shows the example of trimming of an image. (A) is a table | surface which shows the example of the signal reception intensity | strength of each receiver, (b) is a figure which shows the example of trimming of an image. (A) is a table | surface which shows the example of the signal reception intensity | strength of each receiver, (b) is a figure which shows the example of trimming of an image. It is a figure showing an example of image processing. It is a figure which shows the application example of an automatic imaging | photography system.

  Hereinafter, embodiments will be described with reference to the drawings.

  As shown in FIGS. 1 (a), 1 (b) and 3, the automatic photographing system according to the embodiment of the present invention comprises the photographing device 1, the receiver 2, the transmitter 3, the control device 4 and the server device 5. , A reader 7, a printer 8, etc., and automatically shoots a user within the shooting range of the shooting apparatus 1. FIG. 1 (a) shows an example in which an automatic photographing system is installed in a leisure facility. FIG. 3 is a block diagram of the automatic photographing system.

  As shown in FIG. 1B, the wrist band W is distributed to the user (visitor of the leisure facility) at the time of entrance, and the transmitter 3 is attached to the wrist band W. The wristband W may be distributed free of charge or sold to all guests. The wrist band W is an example, and the transmitter 3 may be attached to a pass case which can be taken from the neck, or may be put in a pocket.

  Unique identification information is assigned to the transmitter 3. The transmitter 3 continues to transmit a signal including identification information at a predetermined radio wave intensity.

  The transmitter 3 can use, for example, a beacon terminal, and transmits, as identification information, a MAC address set in the beacon terminal and various beacon IDs (UUID, MAJOR value, MINOR value) and the like.

  A plurality of receivers 2 are installed around the imaging device 1. The receiver 2 detects and receives the signal from the transmitter 3 when the distance to the transmitter 3 approaches. The maximum distance in which the receiver 2 can detect the signal from the transmitter 3 varies depending on the output intensity of the transmitter 3 and is, for example, about several meters to 100 meters. In the example shown to Fig.1 (a), four receivers 2A-2D are arrange | positioned at equal intervals on the same periphery centering on the imaging device 1. As shown in FIG.

  When at least one of the plurality of receivers 2 receives a signal from the transmitter 3, the imaging device 1 performs imaging. For the photographing device 1, an omnidirectional camera (all-sky camera) capable of photographing 360-degree panoramic images of all directions in the vertical and horizontal directions in one photographing is used. Therefore, even when the user wearing the wristband W to which the transmitter 3 is attached is near any receiver 2, that is, the user can be photographed regardless of the direction in which the user is viewed from the photographing apparatus 1. .

  The photographed image by the photographing device 1 is transmitted to the server device 5 together with the identification information included in the signal received by the receiver 2 from the transmitter 3 and the information of the signal reception intensity at each receiver 2. The server device 5 stores the captured image in association with the identification information and the signal reception intensity information.

  At the exit of the attraction, a display 6 as shown in FIG. 2 (a) is provided. The server device 5 transmits the photographed image to the display device 6 to display it. For example, the photographed image is a panoramic image as shown in FIG.

  When the user holds the wristband W (the transmitter 3) over the reader 7, the reader 7 notifies the server device 5 of identification information included in the signal received from the transmitter 3.

  When the identification information is notified from the reader 7, the server device 5 cuts out a portion where the user corresponding to the notified identification information is photographed from the photographed image as shown in FIG. , To the display device 6. The display device 6 displays the cutout image received from the server device 5. The clipping process will be described later.

  The image displayed on the display device 6 may be printed out from the printer 8 in response to a request from the user.

  As described above, in the present embodiment, even when the user approaches the imaging device 1 from any direction, imaging can be performed. In addition, it is possible to automatically determine and cut out a portion where the user is photographed from the panoramic image.

  Next, the function of each part of the automatic photographing system will be described.

  The imaging device 1 is an omnidirectional camera, for example, has two imaging elements, performs imaging simultaneously with the two imaging elements, and performs a process of connecting two images. For example, in each of the two images, the amount of deviation between the reference image and the comparison image is calculated for each area by pattern matching processing, and the connection position is detected. Then, the two images are respectively converted into the omnidirectional image format in consideration of the detected connection position and the lens characteristics of each optical system. By blending these two omnidirectional image format images, one omnidirectional image is finally generated. For an omnidirectional image, an equidistant cylindrical projection is used, and the position of each pixel is associated with the coordinates of the surface of the sphere.

  When the receiver 2 receives a signal from the transmitter 3, the receiver 2 transmits the identification information included in the signal and the reception intensity of the signal to the control device 4. ,

  The control device 4 is, for example, a computer, and includes a receiver control unit 41, a camera control unit 42, and a communication processing unit 43.

  The receiver control unit 41 acquires, from the receiver 2, identification information included in the received signal and information on the reception strength of the signal.

  When the receiver control unit 41 acquires information from the receiver 2, the camera control unit 42 controls the imaging device 1 to execute imaging. The camera control unit 42 acquires photographed image data from the photographing device 1.

  The communication processing unit 43 transmits the information (identification information and reception intensity) received by the receiver control unit 41 from the receiver 2 and the photographed image data acquired by the camera control unit 42 from the photographing device 1 to the server device 5 Do.

  The server device 5 includes a communication processing unit 51, an image processing unit 52, and a storage unit 50, and a computer is used.

  The communication processing unit 51 communicates with the control device 4 and receives identification information, signal reception intensity, and photographed image data. The communication processing unit 51 stores the received data in the storage unit 50 in association with each other.

  The communication processing unit 51 transmits the photographed image data to the display unit 6. The display unit 6 is, for example, a liquid crystal display, and displays a photographed image.

  The reader 7 receives a signal from the transmitter 3 and notifies the server device 5 of identification information included in the signal.

  When the identification information is notified from the reader 7, the image processing unit 52 cuts out a portion in which the user corresponding to the identification information is photographed from the photographed image. The user corresponding to the identification information is a user wearing the wristband W to which the transmitter 3 to which the identification information is assigned is attached.

  The photographed image by the photographing device 1 includes a plurality of regions according to the position of each receiver 2 as shown in FIG. For example, when four receivers 2A to 2D are arranged, an area RA centered on the position of the receiver 2A, an area RB centered on the position of the receiver 2B, and a center on the position of the receiver 2C. The area RC includes an area RD centered on the position of the receiver 2D.

  The closer the users are to the receivers 2A to 2D, the higher the signal reception strength. The image processing unit 52 estimates the position of the user from the signal reception intensity of the receivers 2A to 2D, and determines the cutout range (trimming area). For example, as shown in FIG. 4, the width of each of the areas RA to RD is x. First, the position of the receiver 2 with the largest signal reception strength is temporarily set at the center of the trimming area. Subsequently, the signal reception strengths of the left and right receivers 2 of the receiver 2 having the largest signal reception strength are respectively designated SR and SL, and the shift width of the center of the trimming area is obtained from the following formula 1.

  The image processing unit 52 cuts out an image in a trimming area whose center is shifted.

  For example, in the example shown in FIG. 5A, since the signal reception strength of the receiver 2B is the largest, first, the center of the trimming area is set as the position of the receiver 2B (the center of the area RB). Since the signal reception strengths of the left and right receivers 2A and 2C of the receiver 2B are the same, the user is estimated to be at approximately the same position from the receivers 2A and 2C, that is, in the center (center) of the region RB, and trimming The center of the area is cut out without shifting. As a result, as shown in FIG. 5B, it is possible to cut out the portion where the user appears.

  In the example shown in FIG. 6A, since the signal reception strength of the receiver 2C is the largest, the center of the trimming area is first set as the position of the receiver 2C (the center of the area RC). Since the signal reception strength of the receiver 2B on the left side of the receiver 2C is larger than the signal reception strength of the receiver 2D on the right side, it can be understood that the user is closer to the region RB. The signal reception strengths of the receivers 2B and 2D are substituted into the above equation, and the center of the trimming area is cut out by shifting the center of the trimming area from the position of the receiver 2C by -x / 4 (x / 4 to the left). As a result, as shown in FIG. 6B, it is possible to cut out the portion in which the user appears.

  In the example shown in FIG. 7A, since the signal reception strength of the receiver 2C is the largest, first, the center of the trimming area is set as the position of the receiver 2C. Since the signal reception intensity of the receiver 2D on the right side of the receiver 2C is larger than the signal reception intensity of the receiver 2B on the left side, it can be understood that the user is closer to the region RD. The signal reception strengths of the receivers 2B and 2D are substituted into the above equation, and the center of the trimming area is cut out with a shift of x / 4 (x / 4 to the right) from the position of the receiver 2C. As a result, as shown in FIG. 7B, it is possible to cut out the portion in which the user appears.

  The communication processing unit 51 transmits the trimming image cut out by the image processing unit 52 by the trimming processing to the display device 6 and displays it. The user can hold the wristband W over the reader 7 to magnify and display a portion of the panoramic image in which the user is in the picture.

  When the user requests a printed matter of the trimming image (the purchase is desired), the printer 8 prints and outputs the trimming image on printing paper or the like. The image captured by the imaging device 1 which is an omnidirectional camera is distorted at the peripheral portion of the image, so the image processing unit 52 performs distortion correction processing and prints out the image after correction processing. Good.

  Data of the trimming image or panoramic image data before trimming may be provided (sold) to the user.

  As described above, according to the present embodiment, it is possible to capture an image regardless of which direction the user is approaching. In addition, the position of the user can be estimated from the signal reception strengths of the plurality of receivers 2, and a portion in which the user is photographed can be automatically determined and cut out of the image captured by the omnidirectional camera.

  Since the photographing apparatus 1 is an omnidirectional camera, when photographing a user, others may appear together in the photographed image. In general, consumers are resistant to the fact that an image or picture of their face is provided to others. Therefore, as shown in FIG. 8, the face may be extracted from the photographed image, and the face image in the area other than the portion where the user holding the wristband W is photographed may be converted into a character image or the like.

  The installation of the automatic imaging system is not limited to leisure facilities, but can be applied to various places. For example, as shown in FIG. 9, it can be installed in a dog run. In this case, the imaging device 1 is installed on the ground, the transmitter 3 is attached to the dog collar, and imaging is performed when the dog approaches. A plurality of receivers 2 may be installed to be able to specify the position of a dog, or only one receiver 2 may be installed and radiographing may be performed when it is extremely close to the imaging device 1.

  In the above embodiment, an example in which an omnidirectional camera having two imaging elements is used as the imaging device 1 has been described, but a plurality of digital cameras are combined, and the captured images are connected to create a 360 degree panoramic image. You may do so.

  The present invention is not limited to the above embodiment as it is, and at the implementation stage, the constituent elements can be modified and embodied without departing from the scope of the invention. In addition, various inventions can be formed by appropriate combinations of a plurality of constituent elements disclosed in the above embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components in different embodiments may be combined as appropriate.

Reference Signs List 1 imaging device 2 receiver 3 transmitter 4 control device 5 server device 6 display device 7 reader 8 printer

Claims (5)

A plurality of receivers capable of receiving a signal including identification information from a transmitter;
An imaging device that performs imaging with an omnidirectional camera when at least one of the plurality of receivers receives the signal;
A server device that stores the reception intensity of the signal by each receiver, the identification information, and a captured image by the imaging device in association with each other;
Automatic shooting system with   The automatic photographing system according to claim 1, wherein the server device cuts out a portion where a subject corresponding to the identification information is photographed from the photographed image, based on the reception intensity of the signal by each receiver. . A display device for receiving and displaying the photographed image from the server device;
A reader that receives a signal from the transmitter and notifies the server apparatus of identification information included in the received signal;
And further
The server device cuts out a portion where a subject corresponding to the identification information is taken from a captured image corresponding to the identification information notified from the reader, and transmits the cut out image to the display device for display. The automatic photographing system according to claim 2, characterized in that.   The server device determines an area in which the subject corresponding to the identification information is photographed in the photographed image based on the reception intensity of the signal by each receiver, and a face image photographed in an area other than the determined area The automatic photographing system according to claim 1, wherein the image capturing apparatus extracts an image of the face image and converts the extracted face image into a predetermined image. At least one of the plurality of receivers receiving a signal including identification information from the transmitter;
Shooting with an omnidirectional camera upon receipt of the signal by the receiver;
A step of the server device cutting out a portion where a subject corresponding to the identification information is photographed from the photographed image, based on the reception intensity of the signal by each receiver;
Automatic shooting method comprising.

Images