JP2019083389A - Information processing device, photographing system, and program - Google Patents

Abstract

An information processing apparatus and the like for removing an obstacle from a photographed image in a situation where two subjects arranged in front and back with an obstacle in between are put in the same frame and photographed.
SOLUTION: A photographing system performs photographing with a plurality of photographing devices 5 for photographing a user 20 and an animal 30 arranged on both sides of an iron rod 11 inside and outside an eyebrow 10 from a predetermined position, and the photographing device 5. And a photographing management device for creating an image without the iron rod 11 from the photographed image in which the iron rod 11 is superimposed on the user 20 obtained. The photographing management device complements the area of the iron rod 11 of the photographed image photographed by the main photographing device 5 using the photographed image photographed by the sub photographing device 5.
[Selected figure] Figure 2

Description

  The present invention relates to an information processing apparatus, an imaging system, and a program for removing an obstacle in a captured image.

  In daily life, various photographs are taken, and as one situation, two subjects arranged in front and back with an obstacle in between may be put in the same frame and photographed. For example, in the zoo, an animal in a cage and a user outside the cage are photographed together.

  In this case, the obstacle is an iron rod or the like that separates the inside and outside of the cage. When photographing from the outside of the cage, it is inevitable that the steel rod or the like is reflected in front of the animal and the animal can not be photographed beautifully.

  On the other hand, for example, in the cited reference 1, an image processing method is described in which an unnecessary area specified by the user is complemented using pixels in a surrounding area to remove an unnecessary subject appearing in an image.

International Publication No. 2013/179560

  However, the method of Patent Document 1 is not for the situation in which, as described above, two subjects placed in front of and behind the obstacle are put in the same frame and photographed.

  The present invention has been made in view of the above problems, and information for removing an obstacle from a photographed image in a situation in which two subjects arranged in front and back with an obstacle in between are put in the same frame and photographed. It aims at providing a processing device etc.

  According to a first aspect of the present invention for solving the above-mentioned problems, a photographed image obtained by photographing an object arranged in front and back with a fixed obstacle in between by a photographing device at a predetermined position is The obstacle is removed and the subject is displayed in the area by complementing the area of the obstacle in the captured image in which the obstacle is superimposed on any of the subjects, and an acquisition unit acquired from an imaging device. And an obstacle removing unit for creating an image.

  In the present invention, as described above, in a situation where two subjects arranged in front and back with an obstacle in between are put in the same frame and photographed, the obstacle is removed from the photographed image, so that there is no obstacle A two-shot image of is obtained. Here, "front" refers to the one closer to the imaging device, and "rear" is the opposite. In the present invention, since the imaging device and the position of the obstacle are known, the obstacle removal processing can be performed simply and automatically using this, and also the operation load such as the user specifying the obstacle to be removed It can be eliminated.

The photographed image is photographed from a plurality of the positions, and the obstacle removing means is configured to set the area of the obstacle of the photographed image photographed at the one position in the photographed image photographed at the other position. It is desirable to complement using the area without the obstacle.
As a method of removing an obstacle, for example, the photographed images are photographed from a plurality of positions as described above, and the area of the obstacle in the main photographed image is used as the image of the area without obstacles in the other photographed images. Thus, the obstacle removal process can be suitably performed by complementing the two.

It is also preferable that the obstacle removing means complements the area of the obstacle of the captured image using pixel values of pixels at other positions in the captured image.
As a method of removing the obstacle, a method called so-called in-painting may be applied, which complements the area of the obstacle in the captured image using pixel values at other positions in the captured image.

It is also desirable that the information processing apparatus according to the first aspect of the present invention include a receiving unit that receives, from a terminal, an imaging instruction for performing imaging with the imaging apparatus. It is also desirable to have a transmitting means for transmitting to the terminal a moving image obtained by photographing with the photographing device before receiving the photographing instruction.
In the present invention, a photographing instruction to the photographing device at a remote position can be performed by a terminal such as a smartphone. At this time, by transmitting a moving image from the information processing apparatus to the terminal, it is possible to issue a shooting instruction at a timing when the subject is at a suitable position while checking the moving image.

According to a second aspect of the present invention, there is provided an image pickup apparatus for photographing an object arranged in front and back with a fixed obstacle at a predetermined position, and any one of the objects obtained by photographing with the image pickup apparatus. An information processing apparatus that creates an image in which the obstacle is removed and the subject is displayed in the area by complementing the area of the obstacle in the photographed image on which the obstacle is superimposed; It is a photographing system.
A second invention is an invention about a photographing system including the information processing apparatus of the first invention.

The information processing apparatus complements the area of the obstacle of the photographed image photographed at the one position using the area without the obstacle in the photographed image photographed at the other position, Preferably, the imaging device is disposed at each of the plurality of positions.
By providing the imaging device at each of the plurality of positions, it is possible to preferably complement the area of the obstacle in the main photographed image using the image of the area without the obstacle in the other photographed images.

According to a third aspect of the present invention, a photographed image obtained by photographing a computer by a photographing device having a predetermined position at a predetermined position across a fixed obstacle and a fixed obstacle is obtained from the photographing device. An image is created in which the obstacle is removed and the subject is displayed in the area by complementing the area of the obstacle in the photographed image in which the obstacle is superimposed on any of the subjects, by acquisition means. It is a program for functioning as an information processor which has obstacle removal means.
A third invention is an invention of a program that causes a computer to function as the information processing apparatus of the first invention.

  According to the present invention, it is possible to provide an information processing apparatus and the like for removing an obstacle from a photographed image in a situation where two subjects arranged in front and back with an obstacle in between are put in the same frame and photographed.

FIG. 1 is a schematic view of a photographing system 1; FIG. 3 is a view showing the arrangement of the photographing device 5; FIG. 2 is a diagram showing a hardware configuration of a photographing management device 3. FIG. 2 is a diagram showing a hardware configuration of a user terminal 7; 6 is a flowchart showing processing of the imaging system 1; An example of a photographed image 100. The example of the image 101 after removal of an obstruction. The figure which shows arrangement | positioning of imaging device 5-3, 5-4. The figure explaining complementation of the field of an obstacle. The arrangement of the photographing device 5 and an example of the photographed image 100a. The example of arrangement | positioning of the imaging device 5. FIG. The example which used the terminal 7a instead of the user terminal 7. FIG. The example of arrangement | positioning of the imaging device 5. FIG. The figure explaining complementation of the field of an obstacle. The example of arrangement | positioning of the imaging device 5. FIG. The figure explaining complementation of the field of an obstacle.

  Hereinafter, preferred embodiments of the present invention will be described in detail based on the drawings.

(1. Shooting system 1)
FIG. 1 is a schematic view of a photographing system 1 according to an embodiment of the present invention. The imaging system 1 can communicate with the imaging management device 3 (information processing device), the user terminal 7, and the plurality of imaging devices 5 (5-1, 5-2, 5-3, 5-4, 5-5, ...) Have a configuration connected to Although these are connected by wireless, the photographing management device 3 and the photographing device 5 may be connected by wire.

  The photographing system 1 removes an obstacle from a photographed image in a situation in which two subjects arranged in front and back with an obstacle in between are put in the same frame and photographed. Note that "front" means one closer to the photographing device 5, and "rear" is the opposite.

  FIG. 2 is a view schematically showing the arrangement of the photographing device 5. The imaging system 1 of the present embodiment is used in a zoo, and images a user 20 outside the cage 10 and an animal 30 in the cage 10 in the same frame. The user 20 and the animal 30 are subjects placed back and forth with a plurality of iron rods 11 partitioning the inside and outside of the cage 10, these steel rods 11 are fixed, and the animal 30 moves in the cage 10. The imaging device 5 is disposed in the crucible 10, and images the user 20 and the animal 30 from the animal 30 side. At this time, the above-mentioned iron rod 11 becomes an obstacle (shield) in the photographed image.

  FIG. 3 is a diagram showing a hardware configuration of the photographing management device 3. As shown in FIG. 3, the photographing management device 3 can be realized by a computer configured by connecting a control unit 31, a storage unit 32, a display unit 33, an input unit 34, a communication control unit 35 and the like by a bus or the like. However, the present invention is not limited to this, and various configurations can be taken as appropriate.

  The control unit 31 includes a CPU, a ROM, a RAM, and the like. The CPU calls a program related to the processing of the photographing management device 3 stored in the storage unit 32 or a storage medium such as a ROM to a work area on the RAM and executes the program. The ROM is a non-volatile memory, which permanently holds a boot program, a program such as a BIOS, data and the like. The RAM is a volatile memory, and temporarily stores programs and data loaded from the storage unit 32 and the ROM, and includes a work area used by the control unit 31 to perform various processes.

  The storage unit 32 is a hard disk drive, a solid state drive, a flash memory or the like, and stores a program executed by the photographing management device 3 at the time of processing described later, data necessary for program execution, an OS and the like. These programs and data are read and executed by the control unit 31 as needed.

The display unit 33 includes a liquid crystal display or the like.
The input unit 34 inputs various settings to the photographing management device 3.
The communication control unit 35 is a communication interface that mediates wireless or wired communication, and communicates with the imaging device 5 and the user terminal 7

  The photographing device 5 photographs the user 20 and the animal 30. The photographing device 5 uses, for example, a known digital camera having a light receiving lens, an imaging device such as a CCD (Charged coupled devices) or a Complementary metal-oxide-semiconductor (CMOS), an A / D (Analog / digital) converter, etc. Can. Further, the photographing device 5 includes a control unit for controlling photographing and a communication unit for communicating with the photographing management device 3.

  As shown in FIG. 2, in the present embodiment, a plurality of imaging devices 5 (5-1, 5-2, 5-3, 5-4, 5-5,...) Are arranged side by side in the plane, The orientations (see arrows) of the respective photographing devices 5 are concentrated toward substantially one place. This part is shown in A of FIG. Thereby, it is possible to image the user 20 and the animal 30 at different angles from each imaging device 5.

  The position and the orientation of the photographing device 5 are determined in advance as appropriate for the purpose of removing the iron rod 11 in the photographed image by a method described later. In the present embodiment, the plurality of photographing devices 5 (5-1, 5-2, 5-3, 5-4, 5-5,...) Are approximately positioned on a circular arc centered at the point A. Although the distances from the respective photographing devices 5 to the place A are substantially the same, the present invention is not limited thereto.

  The user terminal 7 is a computer terminal owned by the user 20. For the user terminal 7, for example, a portable terminal such as a smartphone or a tablet terminal can be used.

  FIG. 4 is a diagram showing the hardware configuration of the user terminal 7. The user terminal 7 is configured by connecting a control unit 71, a storage unit 72, a display unit 73, an input unit 74, a communication control unit 75, a camera 76, an audio input / output unit 77, etc. by a bus or the like. However, the present invention is not limited to this, and various configurations can be taken as appropriate.

  The control unit 71 includes a CPU, a ROM, a RAM, and the like. The CPU calls a program related to processing of the user terminal 7 stored in a storage medium such as the storage unit 72 and the ROM to a work area on the RAM and executes the program. The ROM is a non-volatile memory, which permanently holds a boot program, a program such as a BIOS, data and the like. The RAM is a volatile memory, and temporarily stores programs and data loaded from the storage unit 72, the ROM and the like, and includes a work area used by the control unit 71 to perform various processes.

  The storage unit 72 is a flash memory or the like, and stores a program executed by the control unit 71, data necessary for program execution, an OS, and the like. These programs and data are read and executed by the control unit 71 as needed.

The display unit 73 is, for example, a liquid crystal display.
The input unit 74 is used to input various settings to the user terminal 7 and is, for example, a touch panel provided in the display unit 73.
The communication control unit 75 is a communication interface that mediates communication via a network or the like, and communicates with the photographing management device 3 and the like.

The camera 76 is configured of a light receiving lens, an imaging device such as a CCD or CMOS, an A / D converter, and the like.
The voice input / output unit 77 includes a microphone and a speaker, and converts input voice into digital voice data and outputs digital voice data as voice.

(2. Processing performed by the photographing system 1)
FIG. 5 is a flowchart showing processing of the photographing system 1. S101 to S103, S110 to S111, and S120 in FIG. 5 are processes executed by the control unit 71 of the user terminal 7, and S104 to S105, S108 to S109, S112 to S113, and S117 to S119 are control units of the photographing management device 3. 31 is a process to be executed. The control unit of the photographing device 5 executes S106 to S107 and S114 to S116.

  In the present embodiment, first, the user 20 operates the user terminal 7 to connect the user terminal 7 to the photographing management device 3 (S101). Here, the user terminal 7 communicably connects to the photographing management device 3 by wireless communication means such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

  At this time, a selection page (not shown) of the photographing device 5 provided by the photographing management device 3 is displayed on the display unit 73 of the user terminal 7, and the user operates the user terminal 7 to perform photographing on the page The photographing device 5 of is selected. The user terminal 7 receives this selection (S102), and transmits a video acquisition request including the information of the selected photographing device 5 to the photographing management device 3 (S103). Here, it is assumed that the imaging device 5-3 in FIG. 2 is selected.

  When the imaging management device 3 receives the video acquisition request (S104), the imaging management device 3 transmits a video provision request to the imaging device 5 selected in S102 (S105).

  When the imaging device 5 receives this request (S106), it transmits a real-time video (moving image) obtained by imaging with the imaging device 5 to the imaging management device 3 (S107).

  When the imaging management device 3 receives this video (S108), it transmits the video to the user terminal 7 (S109; transmission means).

  When the user terminal 7 receives the video (S110), the user terminal 7 causes the display unit 73 to display the video. The user looks at this video and operates the user terminal 7 at an appropriate timing, and transmits a photographing instruction to the photographing management device 3 (S111).

  When the photographing management device 3 receives a photographing instruction from the user terminal 7 (S112; receiving unit), the photographing management device 3 transmits a photographing request to the photographing device 5 (S113). In S113, a photographing request is transmitted to the main photographing device 5-3 and the other photographing devices 5 on both sides thereof. Here, it is assumed that a photographing request is transmitted to the photographing devices 5-2 and 5-4 (see FIG. 2) on the left and right sides of the main photographing device 5-3 as the other photographing device 5. Hereinafter, the photographing devices 5-2 and 5-4 are referred to as "sub photographing devices".

  When the photographing device 5 (5-2, 5-3, 5-4) receives the photographing request (S114), the photographing device 5 (S115) photographs the user 20 and the animal 30, respectively, and It transmits (S116). In S115, the respective photographing devices 5 simultaneously perform photographing.

  FIG. 6 shows an example of a photographed image 100 obtained by photographing in S115. FIG. 6 (a) is a photographed image 100 photographed by the main photographing device 5-3, and FIG. 6 (b) is a main photographing The captured image 100 captured by the sub imaging device 5-2 on the right side of the device 5-3, and FIG. 6C is captured by the sub imaging device 5-4 on the left side of the main imaging device 5-3. An example of the captured image 100 is shown. The left side and the right side indicate directions as viewed from the user 20. In these photographed images 100, the iron rod 11 is superimposed in front of the user 20.

  When the photographing management device 3 receives and acquires the photographed image 100 from each photographing device 5 (S117; acquisition means), the iron rod 11 (obstacle) is removed from the photographed image 100 in the main photographing device 5 and A process of creating a missing image is performed (S118; obstacle removing means).

  The obstacle removal process in S118 will be described later. In the present embodiment, by removing the iron rod 11, a two-shot image 101 of the user 20 without the iron rod 11 and the animal 30 as shown in FIG. 7 is obtained. In the image 101, the user 20 and the background blocked by the iron rod 11 are displayed in the area where the iron rod 11 was originally.

  The photographing management device 3 transmits the image 101 after removing the iron rod 11 to the user terminal 7 (S119), and the user terminal 7 receives the image 101 (S120). The image 101 received from the photographing management device 3 is displayed, for example, on the display unit 73 of the user terminal 7 and is also stored in the storage unit 72 of the user terminal 7.

(3. Removal of obstacles)
In this embodiment, in S118, the photographed image in the main photographing device 5-3 using the photographed image 100 (see FIGS. 6B and 6C) of the sub photographing devices 5-2 and 5-4. It is possible to complement the area of the iron rod 11 in 100 (see FIG. 6A) and create an image 101 from which the iron rod 11 is removed.

  Here, in the present embodiment, the positions and the orientations of the sub imaging devices 5-2 and 5-4 with respect to the main imaging device 5-3 are areas of the iron rod 11 in the captured image 100 in the main imaging device 5-3. The areas between the iron rods 11 in the photographed image 100 by the sub photographing devices 5-2 and 5-4 are determined to correspond to the front and back. That is, as schematically shown in FIG. 8, the area B behind the iron rod 11 as viewed from the main photographing device 5-3 is photographed from between the iron rods 11 by the sub photographing device 5-4 (5-2) It is determined to

  Therefore, in the present embodiment, as shown by the arrows in FIG. 9, the area a including the iron rod 11 in the photographed image 100 by the main photographing device 5-3 is divided by the sub photographing devices 5-2 and 5-4. By replacing the captured image 100 with the images of the areas b and c between the iron rods 11 corresponding to the area a, the iron rod 11 is erased, and the user 20 and the background blocked by the iron rod 11 in the area a of the iron rod 11 The displayed image 101 shown in FIG. 7 can be obtained.

  Here, in order to compensate for the difference in the orientation of the main imaging device 5-3 and the sub imaging devices 5-2 and 5-4, the photographed image 100 in the above-described sub imaging devices 5-2 and 5-4 It is preferable that image processing such as projective transformation be performed. If the direction of the photographing device 5 is different, the size of the user 20 or the animal 30 in the photographed image 100 changes, but by performing the projective transformation as described above, the user 20 caused by the difference in the direction of the photographing device 5 And the size of the animal 30, etc. can be eliminated.

  Further, in the present embodiment, the area a including the iron rod 11 in the right half of the photographed image 100 in the main photographing device 5-3 is a photographing device 5- on the right side of the main photographing device 5-3 (as viewed from the user). The area a including the iron rod 11 of the left half in the photographed image 100 in the photographed image 100 of the main photographing device 5-3 is replaced with the image of the region b between the iron rods 11 in the photographed image 100 in 2 and Although the image in the area c between the iron rods 11 in the photographed image 100 in the photographing device 5-4 on the left side is replaced, the replacement method is the arrangement of the photographing device 5 and the setting method of the sub photographing device 5 to the main photographing device 5 It differs depending on the case etc. and is not particularly limited.

  As described above, according to the present embodiment, in the situation where the user 20 and the animal 30 arranged in front and back with the iron rod 11 (obstacle) of the rod 10 in the same frame and photographed, the photographed image By removing the iron rod 11 from 100, a two-shot image of the user 20 without the iron rod 11 and the animal 30 is obtained. In the present embodiment, since the positions of the photographing device 5 and the iron rod 11 are known, the removal processing of the iron rod 11 can be performed easily and automatically using this, and an operation such as the user specifying an obstacle to be removed The burden can also be eliminated.

  Further, in the present embodiment, the photographed image 100 is photographed by the plurality of photographing devices 5 as described above, and the area of the iron rod 11 in the photographed image 100 by the main photographing device 5 is photographed by the sub photographing device 5 By complementing using the image of the area | region without the iron rod 11 in the image 100, the removal process of the iron rod 11 can be performed suitably.

  In the present embodiment, the user can issue a photographing instruction to the photographing device 5 located at a remote position from the user via the user terminal 7 such as a smart phone. At this time, by transmitting a moving image by the imaging device 5 from the imaging management device 3 to the user terminal 7, the user can issue an imaging instruction at a timing when the user 20 and the animal 30 are at suitable positions while checking the moving image.

  However, the present invention is not limited to this. For example, in the present embodiment, the moving image in the main photographing device 5 selected by the user can be viewed on the user terminal 7, but first, in S101, the moving image in all the photographing devices 5 from the photographing management device 3 to the user It may be transmitted to the terminal 7 and displayed on the selection page (not shown) of the photographing device 5 described above so that the main photographing device 5 to be photographed may be selected while watching those moving images. Further, it is also possible to extract the portion of the user 20 from the frame image in the moving image and use the image obtained thereby for complementing the area of the iron rod 11.

  Further, the arrangement of the photographing device 5 is not particularly limited, and may be outside the weir 10 as shown in FIG. 10A, for example. An example of the photographed image in this case is the photographed image 100a of FIG. 10 (b), and unlike the above, although the user 20 is in front of the iron rod 11 (obstacle) and the iron rod 11 is superimposed in front of the animal 30 It is possible to remove the iron rod 11 in the same manner as described above.

  Further, in the present embodiment, since the iron rods 11 (obstacles) in the vertical direction are arranged at an interval to the left and right, iron rods in the photographed image 100 in the main photographing device 5 by arranging a plurality of photographing devices 5 on a plane Although the 11 regions are complemented using the photographed images 100 by the left and right photographing devices 5, for example, as shown in FIG. 11, the iron rods 11 in the horizontal direction (the normal direction of the paper surface of FIG. 11) In the case where a plurality of imaging devices 5 are arranged in a vertical plane, the regions of the iron rod 11 in the captured image of the main imaging device 5 are similarly arranged using the captured images of the upper and lower imaging devices 5. It is possible to complement. As described above, the directions of these photographing devices 5 are concentrated at one place A 'as shown by the arrows.

  In addition, as shown in FIG. 12 instead of the user terminal 7, the terminal 7a may transmit a photographing instruction from the terminal 7a to the photographing management device 3 using the terminal 7a disposed outside the crucible 10 or the like. The terminal 7a includes a control unit, a display unit, a communication unit, and the like, and performs the processes of S101 to S103, S110 to S111, and S120 in the same manner as the user terminal 7. In this case, the terminal 7a receives the image 101 in S120, but the user can acquire the image 101 from the terminal 7a by communicating with the terminal 7a by the user terminal.

  Furthermore, although a plurality of imaging devices 5 are used in the present embodiment, instead, as shown in FIG. 13, one imaging device 5 can be moved to the positions 5 'and 5' 'of the plurality of imaging devices. Therefore, it is also possible to install only one photographing device 5.

  In this case, the selection of the photographing device 5 described in S102 is omitted, and a photographing request is transmitted to the one photographing device 5 (for example, disposed at the position of the main photographing device 5 described above) in S113. After that, photographing is performed respectively at the position of the main photographing device 5 and the position of the sub photographing device 5 as the photographing device 5 described above. However, since there is a possibility that the animal 30 may move while the photographing device 5 moves, in this respect, it is better to perform photographing at the same timing by a plurality of photographing devices 5 as described in the above embodiment. preferable.

  Furthermore, as shown in FIG. 14, the photographed image 100 when the user 20 is at the first position and the photographed image 100 when the user 20 is at the second position shifted from the first position in the left-right direction are photographed the same. It is also possible to take a picture with the device 5 and supplement the area a ′ of the iron rod 11 in the photographed image 100 of the former with the image of the area b ′ between the iron bars 11 in the photographed image 100 of the latter.

  The first and second positions are, for example, predetermined known positions (positions corresponding to the above areas a ′ and b ′), and the area of the iron rod 11 other than the above area a ′ in the photographed image 100 of the former is This can be complemented by using the in-painting technique described later.

  Also in this case, the number of imaging devices 5 can be reduced, and it is possible to install only one imaging device 5 as shown in FIG. Further, the selection of the photographing device 5 in S102 is also omitted, and after the photographing request is transmitted to the one photographing device 5 in S113, the photographing device 5 performs photographing twice. However, it is necessary for the user 20 to move between the first position and the second position described above during the first and second photographings, and in the same manner as described above, the animal 30 moves. There is a possibility of

  The method for removing obstacles is not particularly limited, and, for example, using only the captured image 100 of one imaging device 5, the area of the iron rod 11 in the captured image 100 is the pixel value of the pixel at another position in the captured image 100 It is also possible to perform the removal of the iron rod 11 by using

  In this case, for example, a mask image 200 shown in FIG. 16 (a) is used. The mask image 200 is one in which the position of the iron rod 11 (obstacle) in the photographed image 100 in the photographing device 5 described above is preset as the mask area 201. The mask image 200 is represented by a black and white image in which the pixel value (luminance value) of each pixel is, for example, the minimum value (black) or the maximum value (white), and a white area is set as the mask area 201.

  The mask image 200 is superimposed on the photographed image 100 (see FIG. 16B) by the photographing device 5 described above, and as shown in FIG. 16C, the mask area 201 (the area of the iron rod 11) is set on the photographed image 100. Do. Then, the image of the mask area 201 is complemented using pixel values of pixels at other positions. The area of the animal 30 is separately extracted from the photographed image 100 using its pixel value and the like, and excluded from the mask area 201.

  The complementary method is not particularly limited, and a known image processing technique called so-called in-painting can be applied, and an example thereof is described in Patent Document 1 mentioned above. Some in-painting techniques use known machine learning techniques such as support vector machines and deep learning, which is particularly effective when the pattern of the captured image 100 is limited to a certain extent as in the present embodiment.

  Even in this case, only one photographing device 5 can be installed as shown in FIG. Further, the selection of the photographing device 5 in S102 is omitted, and a photographing request is transmitted to the one photographing device 5 in S113. Also, in this example, the movement of the animal 30 is not a problem as described above.

  Furthermore, in the present embodiment, the application target of the imaging system 1 is a situation where the user 20 and animals 30 inside and outside the cage 10 are photographed at a zoo, but the application target of the imaging system 1 is not limited to this. The present invention is similarly applicable to any situation in which a subject placed in front of or behind the obstacle is photographed. Therefore, it is possible to install the imaging system 1 in various amusement facilities etc. other than a zoo and to improve the user experience.

  The preferred embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is apparent that those skilled in the art can conceive of various modifications or alterations within the scope of the technical idea disclosed in the present application, and of course these also fall within the technical scope of the present invention. It is understood.

1: Shooting system 3: Shooting management device 5: Shooting device 7: User terminal 10: 檻 11: Bar 20: User 30: Animal 100, 100a: Shooting image 101: (after removal of obstacle) Image 200: Mask image 201: Mask area

Claims (8)

An acquisition unit configured to acquire, from the imaging device, a captured image obtained by capturing an image of an object placed in front of and behind the fixed obstacle with the imaging device at a predetermined position;
Obstacle removing means for creating an image in which the obstacle is removed and the subject is displayed in the area by complementing the area of the obstacle in the photographed image in which the obstacle is superimposed on any of the subjects When,
An information processing apparatus comprising: The photographed image is photographed from a plurality of the positions,
The obstacle removing means is
The area of the obstacle of the photographed image photographed at one of the positions is complemented by using the area without the obstacle in the photographed image photographed at the other position. Information processor as described. The obstacle removing means is
The information processing apparatus according to claim 1, wherein the area of the obstacle of the captured image is complemented using pixel values of pixels at other positions in the captured image.   The information processing apparatus according to any one of claims 1 to 3, further comprising a receiving unit configured to receive, from a terminal, an imaging instruction for performing imaging with the imaging device.   5. The information processing apparatus according to claim 4, further comprising transmission means for transmitting a moving image obtained by photographing by the photographing device to the terminal before receiving the photographing instruction. A photographing device for photographing a subject placed in front of and behind the fixed obstacle from a predetermined position;
The obstacle is removed and the subject is displayed in the area by complementing the area of the obstacle in the photographed image in which the obstacle is superimposed on any of the subjects obtained by the photographing device. An information processing apparatus for creating a different image;
A photographing system characterized by having: The information processing apparatus is
Complementing the area of the obstacle of the photographed image photographed at one of the positions using the area without the obstacle in the photographed image photographed at the other position;
The imaging system according to claim 6, wherein the imaging device is disposed at each of the plurality of positions. Computer,
An acquisition unit configured to acquire, from the imaging device, a captured image obtained by capturing an image of an object placed in front of and behind the fixed obstacle with the imaging device at a predetermined position;
Obstacle removing means for creating an image in which the obstacle is removed and the subject is displayed in the area by complementing the area of the obstacle in the photographed image in which the obstacle is superimposed on any of the subjects When,
A program for functioning as an information processing apparatus having

Images