WO2019065551A1 - Image capture system, image capture device, image capture method, and image capture program - Google Patents

Abstract

Provided are an image capture system, an image capture device, an image capture method, and an image capture program which make it possible to select, from a storage unit in which a plurality of reference photographs are stored, a reference photograph serving as a composition model, and to perform imaging using the selected reference photograph. A plurality of images as composition references are acquired (S12); a sort condition is set with respect to a plurality of pieces of image data (S14, S16); the plurality of pieces of image data are sorted on the basis of the sort condition (S18); sorted images are displayed in order of sort ranks (S20); an image is selected from the plurality of images being displayed (S22); an image capture condition for image data corresponding to the selected image is set, and instructions are given concerning an image capture position and an image capture direction which enable the capturing of the same image as the selected image (S24); and imaging is performed (S28).

Description

Imaging system, imaging apparatus, imaging method, and imaging program

The present invention relates to an imaging system, an imaging apparatus, an imaging method, and an imaging program, and more particularly to imaging assistance.

2. Description of the Related Art There is known an imaging apparatus provided with an imaging support function of acquiring information of an imaging position and displaying guide information such as an imaging position and an imaging angle to an imaging person based on an image captured in the past at the imaging position.

Patent Document 1 describes an imaging device for guiding a position at which a reference photo is captured using augmented reality technology. The imaging device described in Patent Document 1 displays a virtual object on a liquid crystal screen on which a subject is displayed using an augmented reality technology. The virtual object changes in the same manner as a real subject according to the imaging position and the angle of view.

Patent Document 2 describes an imaging device that performs display for guiding a photographer to a place where a reference photo is captured in order to capture the same photo as the reference photo. The imaging device described in Patent Document 2 displays, on the display unit, a reference photograph transmitted from the photograph posting site, and guidance information such as the movement distance to the imaging location, the movement direction, and the height difference.

Patent Document 3 describes an imaging device that displays on a monitor in real time a shift in latitude between the location where the reference photo was captured and the current position and a shift in longitude in order to capture the same photo as the reference photo. There is.

Patent Document 4 describes an imaging support system that displays an image suitable for imaging support when there are many images stored in an image database. The imaging support system described in Patent Document 4 displays a plurality of reference composition images arranged in descending order of priority on the display unit of the imaging device.

JP, 2013-42250, A JP, 2009-239397, A JP 2004-80359 A JP, 2015-164343, A

The imaging devices described in Patent Literature 1 to Patent Literature 3 display guide information and the like based on one reference photograph determined by the user. However, Patent Document 1 to Patent Document 3 do not describe how to narrow down reference photographs to be candidates for imaging when a plurality of reference photographs are stored in a storage unit such as an image database. Further, Patent Document 1 to Patent Document 3 do not describe how to display the narrowed reference photo and how the user selects the narrowed reference photo.

Although the imaging support system described in Patent Document 4 displays a plurality of reference composition images arranged in descending order of priority, Patent Document 4 describes how the plurality of displayed reference composition images are used. Not listed.

The present invention has been made in view of such circumstances, and enables the selection of a reference picture to be a sample of composition from a storage unit in which a plurality of reference pictures are stored, and imaging using the selected reference picture It is an object of the present invention to provide an imaging system, an imaging apparatus, an imaging method, and an imaging program that realize the above.

The following invention aspects are provided in order to achieve the said objective.

The imaging system according to the first aspect is an image data acquisition system for acquiring a plurality of image data for reference of composition from a storage unit storing a plurality of image data and a plurality of image data stored in the storage unit And a plurality of image data based on the sort condition setting unit that sets sort conditions for a plurality of image data acquired using the image data acquisition unit, and the sort condition set using the sort condition setting unit A sorting unit for sorting the images, a display unit for displaying images corresponding to a plurality of image data sorted using the sorting unit in the order of the sorting order in the set sorting condition, and the display unit A selection unit that selects an image from a plurality of images, an imaging condition setting unit that sets imaging conditions of image data corresponding to the image selected using the selection unit, and a selection unit Apply an imaging condition set using an imaging position and an imaging condition setting unit that indicate an imaging position and an imaging direction at which the same image as the selected image can be imaged, and instruct using the composition assistance unit And an imaging unit configured to perform imaging by applying the determined imaging position and imaging direction.

According to the first aspect, when acquiring a plurality of image data to be a reference of composition, the plurality of image data are sorted based on the sorting criterion, and the plurality of image data are displayed in the order of the sorting order. This makes it possible to easily select image data to be a reference for the composition.

Image data is selected from among the image data displayed in the order of sorting order. The imaging condition of the selected image data, the imaging position, and the imaging direction are set in the imaging unit. This enables imaging using the imaging conditions and composition of the selected image.

When acquiring a plurality of image data, an acquisition range specification unit may be provided to specify an acquisition range of the image data. The imaging position of image data is mentioned as an acquisition range of image data.

In a second aspect, in the imaging system according to the first aspect, the storage unit stores a plurality of image data obtained by performing imaging at a designated point and a peripheral point of the designated point, and the imaging unit captures an image at the designated point May be configured to

According to the second aspect, it is possible to take an image utilizing a reference image of a composition at a designated point.

The designated point can automatically set the current position of the imaging device. The designated point may be manually set by the user.

In a third aspect, in the imaging system according to the first aspect or the second aspect, the sort condition setting unit includes at least one of the number of times of imaging, the number of times the social button has been operated, and the number of times read from the storage unit in the past. It is also possible to set one as the sort condition.

According to the third aspect, as the sorting condition, the number of times of imaging representing the order of popularity, the number of times the social button is operated, and the number of times read from the storage unit in the past can be set. In addition, it is possible to sort image data based on the number of times of imaging, the number of times the social button has been operated, and the number of times read from the storage unit in the past.

The sort condition may be one or more. In the case of setting a plurality of sort conditions, it is preferable to set the priority of the sort conditions.

According to a fourth aspect, in the imaging system according to any one of the first to third aspects, the sorting condition setting unit may set the condition of the imaging device used for imaging as the sorting condition.

According to the fourth aspect, the condition of the imaging device can be set as the sort condition.

As a condition of the imaging device, the matching degree of the imaging device can be mentioned. The matching degree of the imaging device includes the matching degree of an optical system such as a lens, the matching degree of an imaging device, and the matching degree of a manufacturer.

A 5th aspect is provided with the imaging log acquisition part which acquires the imaging log of the imaging device used for imaging in the imaging system of a 4th aspect, and the conditions of an imaging device are used for the imaging acquired using the imaging log acquisition part It may be configured to include an imaging history of the imaging device.

According to the fifth aspect, the imaging history of the imaging device used for imaging can be set as the sorting condition.

The imaging history of the imaging device used for imaging can be acquired using incidental information incidental to image data stored in the imaging device. An imaging history storage unit that stores imaging history may be provided.

In a sixth aspect according to the imaging system of the fourth or fifth aspect, the sorting condition setting unit may set two or more types of sorting conditions including the conditions of the imaging device.

According to the sixth aspect, two or more types of sorting conditions including the conditions of the imaging device can be set. This enables imaging that reflects the conditions of the imaging device and reflects the conditions such as the order of popularity.

Priority may be set to the sort condition.

According to a seventh aspect, in the imaging system according to any one of the first to sixth aspects, the display control unit is configured to cause the display unit to display an image from the first place in the sorting order in the sorting condition to a predetermined order. It is good also as composition.

According to the seventh aspect, it is possible to preferentially select an image higher in sort order.

In an eighth aspect according to the imaging system of the seventh aspect, the display control unit may adjust the number of images to be displayed on the display unit in accordance with the display capability of the display unit.

According to the eighth aspect, it is possible to display on the display unit a number of images according to the capability of the display unit.

The display capability includes the number of images that can be displayed, the resolution of the display unit, and the like.

In a ninth aspect based on the imaging system according to the seventh aspect or the eighth aspect, the display control unit reduces at least a part of the images when the number of images displayed on the display unit is a predetermined number or more. It may be configured to be displayed on the display unit.

According to the ninth aspect, it is possible to display a larger number of images on the display unit.

A tenth aspect is the imaging system according to any one of the seventh aspect to the ninth aspect, wherein the display control unit performs composition assistance information using the composition assistance unit at the time of imaging at the designated point, and an imaging condition setting unit Alternatively, at least one of the imaging conditions set by using may be superimposed on the subject.

According to the tenth aspect, in determining the composition of the subject, at least one of the composition assistance information and the imaging condition can be referred to.

In an eleventh aspect according to the imaging system of the tenth aspect, the display control unit may be configured to display at least one of the composition assistance information and the imaging condition in augmented reality.

According to the eleventh aspect, the extended realization display can be used to display at least one of the composition support information and the imaging condition.

The aspect provided with the image processing part which produces | generates an augmented-reality image is preferable.

According to a twelfth aspect, in the imaging system according to any one of the seventh to eleventh aspects, the imaging device may have a configuration including an imaging unit, a display unit, and a display control unit.

According to the twelfth aspect, in the imaging device, display of at least one of composition support information and imaging conditions and display control can be performed.

According to a thirteenth aspect, in the imaging system according to any one of the first aspect to the twelfth aspect, the server device and the imaging device connected to the server device via a network are provided, and the server includes a storage unit. The imaging apparatus may be configured to include a display unit, an imaging condition setting unit, a composition support unit, and an imaging unit.

According to the thirteenth aspect, the imaging device can acquire a plurality of images acquired from the server device. The imaging device can arrange a plurality of images in the order of sort order and display the images on the display unit of the imaging device. The imaging device can set imaging conditions corresponding to the selected image. The imaging device can indicate the composition corresponding to the selected image.

The server apparatus may include a sort condition setting unit and a sort unit.

According to a fourteenth aspect, in the imaging system of the thirteenth aspect, the imaging device may be configured to include a sort condition setting unit and a sort unit.

According to the fourteenth aspect, the imaging device sets sorting conditions, performs sorting of a plurality of images using the set sorting conditions, and arranges the plurality of images in the order of sorting order and displays the plurality of images on the display unit of the imaging device It becomes possible.

According to a fifteenth aspect, in the imaging system according to any one of the first to fourteenth aspects, the selection unit is an operation unit used to select an image from a plurality of images displayed using the display unit. May be provided.

According to the fifteenth aspect, the user can operate the operation unit to select an image to be a reference of composition from among a plurality of images displayed arranged in the order of sort order.

The imaging device according to the sixteenth aspect acquires an image data acquisition unit that acquires a plurality of image data to be a reference of a composition from a plurality of image data stored in the storage unit, and an image data acquisition unit. A sorting condition setting unit that sets sorting conditions for the plurality of pieces of image data; a sorting unit that sorts the plurality of image data based on the sorting conditions set using the sorting condition setting unit; Selecting an image from among the plurality of images displayed using the display unit that displays the images corresponding to the plurality of image data sorted in sequence in the order of the sorting order under the set sorting condition and the display unit It is possible to capture the same image as the image selected using the selection unit and the imaging condition setting unit that sets the imaging condition of the image data corresponding to the image selected using the unit and the selection unit Apply an imaging condition set using an imaging position and an imaging direction, a composition support unit specifying an imaging direction and an imaging condition setting unit, apply an imaging position instructed using a composition support unit, and an imaging direction And an imaging unit including the imaging unit.

According to the sixteenth aspect, the same effect as the first aspect can be obtained.

In the sixteenth aspect, the same matters as the matters specified in the second to fifteenth aspects can be appropriately combined. In that case, the component carrying the processing or function specified in the imaging system can be grasped as the component of the imaging apparatus carrying the processing or function corresponding to this.

An imaging method according to a seventeenth aspect includes an image data acquisition step of acquiring a plurality of image data to be a reference of composition from among a plurality of image data stored in the storage unit, and a plurality of image data acquired in the image data acquisition step. The sorting condition setting step of setting sorting conditions for the image data of the above, the sorting step of sorting the plurality of image data based on the sorting conditions set in the sorting condition setting step, and the plurality of sorting steps in the sorting step A display step of arranging and displaying images corresponding to the image data in the order of sorting in the set sorting condition, a selection step of selecting an image from a plurality of images displayed in the display step, and An imaging condition setting step of setting an imaging condition of image data corresponding to a selected image, and an image selected in the selection step The imaging position and imaging direction specified in the composition assistance step are applied by applying the imaging support condition for specifying the imaging position and imaging direction where the imaging of the same image is possible, and the imaging condition setting step. And an imaging step of applying and imaging.

According to the seventeenth aspect, the same effect as that of the first aspect can be obtained.

In the seventeenth aspect, the same matters as the matters specified in the second to fifteenth aspects can be appropriately combined. In that case, the component carrying the processing or function specified in the imaging system can be grasped as the component of the imaging method carrying the processing or function corresponding thereto.

The imaging program according to the eighteenth aspect uses an image data acquisition function and an image data acquisition function for acquiring a plurality of image data as reference for composition from among a plurality of image data stored in the storage unit in a computer. Sorting condition setting function for setting sorting conditions for a plurality of image data acquired by the user, sorting function for sorting a plurality of image data based on sorting conditions set using the sorting condition setting function, and sorting function A display function for displaying images corresponding to a plurality of image data sorted in the order of the sorting order in the set sorting condition, and a selecting function for selecting an image from a plurality of images displayed using the display function , Imaging condition setting function for setting imaging conditions of image data corresponding to an image selected using the selection function, selection using the selection function Image capturing conditions set using the imaging support position and imaging condition setting function that indicate the imaging position and imaging direction where imaging of the same image as the captured image is possible, and instructed using the composition assistance function It is an imaging program which realizes an imaging function of performing imaging by applying the imaging position and the imaging direction.

According to the eighteenth aspect, the same effect as the first aspect can be obtained.

In the eighteenth aspect, the same matters as the matters specified in the second to fifteenth aspects can be combined as appropriate. In that case, a component carrying a process or function specified in the imaging system can be grasped as a component of an imaging program carrying a process or function corresponding thereto.

An eighteenth aspect is an imaging device having at least one or more processors and at least one or more memories, wherein the processor acquires a plurality of image data from a storage unit in which the plurality of image data are stored. A plurality of image data based on the sorting conditions set using the data acquisition function, the sorting condition setting function for setting sorting conditions for a plurality of image data acquired using the image data acquiring function, and the sorting condition setting function A sorting function for sorting the images, a display function for displaying images corresponding to a plurality of image data sorted using the sorting function in the order of the sorting order in the set sorting condition, and a plurality of images displayed using the display function Select an image from among the images, set imaging conditions for the image data corresponding to the image selected using the selection function Apply imaging conditions set using imaging condition setting function and composition support function that indicates the imaging position and imaging direction where imaging of the same image as the image selected using imaging condition setting function selection function is possible The imaging system can be configured as an imaging system that implements an imaging function that performs imaging by applying an imaging position and an imaging direction instructed using the composition support function.

According to the present invention, when a plurality of image data to be a reference of composition is acquired, the plurality of image data is sorted based on the sort criterion, and the plurality of image data are arranged and displayed in the order of sort order. This makes it possible to easily select image data to be a reference for the composition.

Image data is selected from among the image data displayed in order of sort order. The imaging condition of the selected image data, the imaging position, and the imaging direction are set in the imaging unit. This enables imaging using the imaging conditions and composition of the selected image.

FIG. 1 is a front perspective view showing the appearance of an embodiment of a digital camera. FIG. 2 is a rear perspective view of the digital camera shown in FIG. FIG. 3 is a schematic block diagram of a finder device. FIG. 4 is a schematic block diagram of the inside of the digital camera. FIG. 5 is a block diagram of main functions realized by the camera microcomputer. FIG. 6 is an explanatory view showing an outline of the imaging support function. FIG. 7 is an explanatory view of a reference photograph showing an example of the reference photograph. FIG. 8 is a block diagram of a camera microcomputer for realizing the imaging support function. FIG. 9 is a flowchart showing the flow of the procedure of the imaging support function. FIG. 10 is a diagram showing an example of the designated point setting screen. FIG. 11 is a view showing an example of the result screen of the designated point automatic setting. FIG. 12 is a view showing another example of the designated point setting screen. FIG. 13 is a diagram showing an example of the sort reference setting screen. FIG. 14 is a diagram showing an example of the sort criterion selection screen. FIG. 15 is a view showing another example of the sort criterion selection screen. FIG. 16 is a view showing an example of the reference photograph display screen. FIG. 17 is a diagram showing an example of the reference photo selection screen. FIG. 18 is a view showing an example of the composition information display screen. FIG. 19 is a diagram showing an example of imaging condition display. FIG. 20 shows an example of the exposure adjustment selection screen. FIG. 21 is a block diagram of an imaging system showing an application example of a network system. FIG. 22 is a block diagram of a modification of the imaging system shown in FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. In the present specification, the same components are denoted by the same reference numerals and redundant description will be omitted.

[Constitution]
[External structure]
FIG. 1 is a front perspective view showing the appearance of an embodiment of a digital camera. FIG. 2 is a rear perspective view of the digital camera shown in FIG. The digital camera 1 is an example of an imaging device.

The digital camera 1 shown in FIGS. 1 and 2 is a lens-integrated digital camera in which an imaging lens 4 is integrated with a camera body 2.

The digital camera 1 includes an imaging lens 4, an operation unit 6, a rear monitor 8, a finder device 10 and the like in the camera body 2.

The imaging lens 4 is provided on the front of the camera body 2. The imaging lens 4 is configured by a single focus lens having a focusing function, and is configured by combining a plurality of lenses.

The operation unit includes the power lever 12, the shutter button 14, the first function button 16, the exposure correction dial 18, the shutter speed / sensitivity dial 20, the front command dial 22, the finder switching lever 24, the second function button 26, the focus mode switching lever 28, view mode button 30, metering mode button 32, AE lock button 34, rear command dial 36, focus lever 38, play button 40, erase button 42, back button 44, cross button 46, menu / OK button 48, AF lock It has a button 50, a quick menu button 52 and the like.

In FIGS. 1 and 2, the illustration of the reference numeral 6 representing the operation unit is omitted. The code | symbol 6 showing the operation part is illustrated in FIG.

AE is an abbreviation of automatic exposure, which is an English expression that represents automatic exposure. AF is an abbreviation of auto focus, which is an English expression that represents automatic focusing.

The power lever 12, the shutter button 14, the first function button 16, the exposure correction dial 18, and the shutter speed / sensitivity dial 20 are provided on the upper surface of the camera body 2. The front command dial 22, the finder switching lever 24, the second function button 26 and the focus mode switching lever 28 are provided on the front of the camera body 2.

The view mode button 30, metering mode button 32, AE lock button 34, rear command dial 36, focus lever 38, play button 40, erase button 42, back button 44, cross button 46, AF lock button 50 and quick menu button 52 , Provided on the back of the camera body 2.

The rear monitor 8 is provided on the rear of the camera body 2. The rear monitor 8 is an example of a display unit. The rear monitor 8 is configured of, for example, an LCD. The LCD is an abbreviation of liquid crystal display, which is an English expression representing a liquid crystal display device.

The finder device 10 is a hybrid type finder device capable of switching between the OVF mode and the EVF mode. The finder device 10 includes a finder window 10 a on the front side of the camera body 2 and a finder eyepiece 10 b on the rear side.

Note that OVF is an abbreviation of optical view finder, which is an English expression representing an optical viewfinder. EVF is an abbreviation of electronic view finder that represents an electronic view finder.

FIG. 3 is a schematic block diagram of a finder device.

The finder device 10 includes a finder first optical system 60, a finder LCD 62, a finder second optical system 64, and a liquid crystal shutter 66.

The finder first optical system 60 is an optical system for optically observing an object. The finder first optical system 60 includes an objective lens group 60a and an eyepiece lens group 60b. The finder first optical system 60 constitutes an optical finder.

The finder second optical system 64 is an optical system for guiding the image displayed on the finder LCD 62 to the light path of the finder first optical system 60. The finder second optical system 64 and the finder LCD 62 constitute a superimposed display unit. The finder second optical system 64 includes a half prism 64 a and a target lens group 64 b.

The half prism 64 a is disposed between the objective lens group 60 a and the eyepiece lens group 60 b of the finder first optical system 60. The half prism 64a has a semipermeable membrane 64a1 on the inner slope. The semipermeable membrane 64a1 splits the light incident on the half prism 64a into transmitted light and reflected light.

The target lens group 64b is disposed between the finder LCD 62 and the half prism 64a, and guides the light from the finder LCD 62 to the eyepiece group 60b via the half prism 64a.

The liquid crystal shutter 66 is disposed between the finder window 10a and the objective lens group 60a. The liquid crystal shutter 66 opens and closes the finder window 10a. That is, when the finder window 10a is opened, the light from the finder window 10a is transmitted. When the finder window 10a is closed, the light from the finder window 10a is blocked.

In the finder device 10 having the above configuration, when the liquid crystal shutter 66 is opened, light from the subject is transmitted through the objective lens group 60a, the half prism 64a, and the eyepiece lens group 60b and guided to the finder eyepiece 10b. Thus, when looking through the finder eyepiece 10b, it is possible to observe an optical image of the subject. An optical image of a subject is sometimes called an optical finder image.

When the liquid crystal shutter 66 is opened and an image is displayed on the finder LCD 62, light from the finder LCD 62 is incident on the half prism 64a via the target lens group 64b. The light incident on the half prism 64a is reflected by the semipermeable film 64a1 and is guided to the eyepiece lens group 60b. As a result, when looking through the finder eyepiece 10b, the image on the finder LCD 62 is observed superimposed on the optical finder image observed by the finder first optical system 60.

On the other hand, when the liquid crystal shutter 66 is closed, the incidence of light on the objective lens group 60a is blocked. As a result, even when looking through the finder eyepiece 10b, it is not possible to observe the optical finder image. On the other hand, the light from the finder LCD 62 is guided to the finder eyepiece 10b. Therefore, the image of the finder LCD 62 can be observed.

The mode in which the optical finder image can be observed is the OVF mode, and the mode in which only the image on the finder LCD 62 can be observed is the EVF mode. Switching between the OVF mode and the EVF mode is performed by operating the finder switching lever 24. The finder switching lever 24 is provided so as to be swingable, and each time it is swung, the OVF mode and the EVF mode are alternately switched. When the OVF mode is set, the liquid crystal shutter 66 is opened, and when the EVF mode is set, the liquid crystal shutter 66 is closed.

〔Internal structure〕
FIG. 4 is a schematic block diagram of the inside of the digital camera.

The digital camera 1 includes an imaging lens 4, a finder device 10, an image sensor 70, an analog signal processing unit 74, a digital signal processing unit 76, a back monitor 8, a storage unit 78, a communication unit 80, an operation unit 6, a camera microcomputer 100, and the like. Prepare.

<< Imaging lens >>
As described above, the imaging lens 4 is configured by combining a plurality of lenses. The imaging lens 4 includes a focus lens drive mechanism 82 and an aperture drive mechanism 84. The focus lens drive mechanism 82 includes an actuator and a drive circuit of the actuator. The focus lens drive mechanism 82 moves the focus lens group 4 f along the optical axis L in accordance with an instruction from the camera microcomputer 100. This adjusts the focus.

The diaphragm drive mechanism 84 includes an actuator and a drive circuit of the actuator. The diaphragm drive mechanism 84 operates the diaphragm 4i in accordance with an instruction from the camera microcomputer 100. That is, the diaphragm drive mechanism 84 switches the aperture of the diaphragm 4i. Thereby, the amount of light incident on the image sensor 70 is adjusted.

<< finder device >>
In the finder device 10, the display of the finder LCD 62 is controlled by the camera microcomputer 100 via the finder LCD driver 62dr. Further, in the finder device 10, the driving of the liquid crystal shutter 66 is controlled by the camera microcomputer 100 via the liquid crystal shutter driver 66dr.

Although the present embodiment exemplifies the digital camera 1 having the finder device 10, the digital camera 1 may not have the finder device 10.

Image sensor
The image sensor 70 receives light passing through the imaging lens 4 to capture an image. The image sensor 70 is an example of a component of an imaging unit. The image sensor 70 is configured by a known two-dimensional image sensor such as a CMOS type or a CCD type.

Note that CMOS is an abbreviation of complementary metal-oxide semiconductor, which is an English notation representing a complementary metal oxide semiconductor. CCD is an abbreviation for charge coupled device which stands for charge coupled device.

<< Analog signal processing unit >>
The analog signal processing unit 74 takes in an analog image signal for each pixel output from the image sensor 70 and performs signal processing on the analog image signal. Signal processing for an analog image signal includes correlated double sampling processing, amplification processing, and the like.

The analog signal processing unit 74 includes an ADC, converts an analog image signal after predetermined signal processing into a digital image signal, and outputs the digital image signal. ADC is an abbreviation of analog to digital converter, which is an English-language notation for an analog-to-digital converter. An analog-to-digital converter may be called an AD converter.

<< Digital Signal Processing Unit >>
The digital signal processing unit 76 takes in the digital image signal output from the analog signal processing unit 74, performs signal processing on the digital image signal, and generates image data. The generated image data is output to the camera microcomputer 100.

Signal processing on digital image signals includes tone conversion processing, white balance correction processing, gamma correction processing, synchronization processing, YC conversion processing, and the like. Y represents luminance. C represents a color difference.

Also, the digital signal processing unit 76 detects information of the brightness of the subject necessary for the exposure control based on the captured image signal. Information on the detected brightness of the subject is output to the camera microcomputer 100.

Further, the digital signal processing unit 76 detects information of the contrast of the subject necessary for the autofocus control based on the captured image signal. The detected contrast information is output to the camera microcomputer 100.

Rear monitor
The display of the rear monitor 8 is controlled by the camera microcomputer 100 via the LCD driver 8dr.

<< storage part >>
The storage unit 78 stores various data including image data. The storage unit 78 is configured to include a built-in memory and a control circuit that reads and writes data from and to the built-in memory.

The built-in memory is composed of, for example, a non-volatile memory such as an EEPROM. Reading and writing of data to the storage unit 78 is controlled by the camera microcomputer 100. The EEPROM is an abbreviation of electrically erasable programmable read only memory, which is an English notation representing an electrically erasable and writable storage element.

The storage unit 78 can also be configured using an external memory such as a memory card. When the storage unit 78 is configured using an external memory such as a memory card, the digital camera 1 is provided with a card slot or the like for loading a memory card.

<< communication department >>
The communication unit 80 wirelessly or wiredly communicates with an external device under the control of the camera microcomputer 100, and transmits / receives various signals to / from each other. The communication method is not particularly limited, and is a commonly used communication method, such as a communication method based on the wireless LAN standard, a communication method based on the specific power saving wireless standard, a communication method using a mobile telephone network, etc. And a communication method according to the USB standard, etc. are used. LAN is an abbreviation of local area network. USB is an abbreviation of universal serial bus.

<< Operation part >>
The operation unit 6 outputs a signal corresponding to the operation of each operation member to the camera microcomputer 100.

Camera microcomputer
The camera microcomputer 100 functions as a control unit that generally controls the entire operation of the digital camera 1. The camera microcomputer 100 also functions as an arithmetic processing unit that calculates physical quantities necessary for controlling the digital camera 1. The camera microcomputer 100 is configured using a computer including a CPU, a RAM, and a ROM, or a microcomputer.

The CPU is an abbreviation of central processing unit, which is an English notation representing a central processing unit. The RAM is an abbreviation of random access memory, which is an English notation representing a storage element that can be read out immediately. The ROM is an abbreviation of read only memory, which is an English notation representing a read only memory element.

The camera microcomputer 100 executes a focus control program, an exposure control program, a display control program, an image combining program, and the like to realize various functions. The program executed by the camera microcomputer 100 and various data required for control executed by the camera microcomputer 100 are stored in the ROM.

FIG. 5 is a block diagram of main functions implemented by the camera microcomputer.

As shown in the figure, the camera microcomputer 100 includes a focus control unit 112, an exposure setting unit 114, an aperture control unit 118, a rear monitor display control unit 120, a storage control unit 122, a communication control unit 124, and a finder LCD display control unit 126. , And functions as a liquid crystal shutter drive control unit 128 and the like.

<Focus control unit>
The focus control unit 112 performs so-called contrast autofocus control. That is, the focus control unit 112 moves the focus lens group 4f shown in FIG. 4 from the near end to the infinite end via the focus lens drive mechanism 82, and detects the position where the contrast is maximum.

The focus control unit 112 shown in FIG. 5 moves the focus lens group 4f shown in FIG. 4 to a position where the contrast is maximum via the focus lens drive mechanism 82.

<Exposure setting unit>
The exposure setting unit 114 illustrated in FIG. 5 sets the shutter speed and the aperture value that are appropriate for exposure based on the detection result of the brightness of the subject. The exposure setting unit 114 may set the exposure period of the image sensor 70 shown in FIG. 4 instead of the shutter speed.

Aperture control section
The aperture control unit 118 shown in FIG. 5 controls the aperture 4i shown in FIG. 4 via the aperture drive mechanism 84 so as to obtain the aperture value set by the exposure setting unit 114.

<Rear monitor display control unit>
The rear monitor display control unit 120 shown in FIG. 5 controls the display of the rear monitor 8 via the LCD driver 8dr. For example, when the image data obtained by imaging is displayed on the back monitor 8, the image data is converted into a data format that can be displayed on the back monitor 8, and is output to the back monitor 8.

<Storage control unit>
The storage control unit 122 controls reading and writing of data with respect to the storage unit 78. Image data obtained by imaging is stored in the storage unit 78 via the storage control unit 122. When the image data stored in the storage unit 78 is reproduced, the image data is read from the storage unit 78 via the storage control unit 122.

<Communication control unit>
The communication control unit 124 controls communication with an external device via the communication unit 80.

<Finder LCD Display Control Unit>
The finder LCD display control unit 126 controls the display of the finder LCD 62 via the finder LCD driver 62dr. As described above, the image displayed on the finder LCD 62 is superimposed on the optical finder image. Therefore, the finder LCD display control unit 126 also functions as a superimposed display control unit.

When the finder device 10 shown in FIG. 4 is not provided, the finder LCD display control unit 126 shown in FIG. 5 is omitted.

<Liquid crystal shutter drive control unit>
The liquid crystal shutter drive control unit 128 controls the driving of the liquid crystal shutter 66 via the liquid crystal shutter driver 66dr to open and close the liquid crystal shutter 66.

When the finder device 10 shown in FIG. 4 is not provided, the liquid crystal shutter drive control unit 128 shown in FIG. 5 is omitted.

[Imaging support function]
"Overview"
The digital camera 1 described with reference to FIGS. 1 to 5 has an imaging support function. When the digital camera 1 is switched to the imaging support mode, the digital camera 1 performs an imaging support function. The imaging support function of the digital camera 1 will be described in detail below.

FIG. 6 is an explanatory view showing an outline of the imaging support function. FIG. 6 illustrates a photographer 200 who is about to capture a landscape at a designated point using the digital camera 1. When the imaging person 200 causes the digital camera 1 to perform the imaging support function, it is possible to acquire the reference photo of the landscape at the designated point and the peripheral point of the designated point.

The surrounding point of the designated point may be arbitrarily set as long as it is a point at which a reference photo serving as a reference for composition in imaging of the designated point is taken. The point near the designated point may be set by the photographer, or may be automatically set based on the information of the designated point.

FIG. 7 is an explanatory view of a reference photograph showing an example of the reference photograph. The first reference picture 210, the second reference picture 212, the third reference picture 214, and the fourth reference picture 216 shown in FIG. 7 are a plurality of reference images displayed on the back monitor 8 of the digital camera 1 shown in FIG. It is a photograph.

The photographer 200 shown in FIG. 6 can select a reference picture to be taken from a plurality of reference pictures displayed on the back monitor 8 of the digital camera 1. When an arbitrary reference picture is selected from a plurality of reference pictures, the digital camera 1 uses the image data corresponding to the reference picture and incidental information of the image data corresponding to the reference picture to obtain the imaging condition of the digital camera 1. Set up and implement composition support.

<< Configuration example of digital camera that realizes imaging support function >>
FIG. 8 is a block diagram of a camera microcomputer for realizing the imaging support function. In the camera microcomputer 100 shown in FIG. 8, illustration of part of the components shown in FIG. 5 is omitted. The camera microcomputer 100 shown in FIG. 8 includes a position information acquisition unit 220, a reference photograph acquisition unit 222, a sort reference setting unit 224, a sort unit 226, a selection unit 228, a composition support unit 230, an imaging condition setting unit 232, and imaging history storage. A unit 234 is provided.

The position information acquisition unit 220 acquires information on the current position of the digital camera 1 from the position information transmission device 236 via the communication unit 80. An example of the position information transmitter 236 is GPS satellites. Note that GPS is an abbreviation of global positioning system, which is an English expression representing the global positioning system.

Communication between the communication unit 80 and the position information transmitter 236 may be via a public network (not shown). Communication between the communication unit 80 and the position information transmitting device 236 may be performed via a network (not shown).

The reference picture acquisition unit 222 acquires a plurality of image data corresponding to a plurality of reference pictures at the current position of the digital camera 1 from the image server 238 via the communication unit 80. The plurality of image data corresponding to the plurality of reference photographs acquired using the reference photograph acquisition unit 222 is transmitted to the image processing unit 227. The reference photograph acquisition unit 222 is an example of an image data acquisition unit. A storage unit (not shown) of the image server 238 is an example of a storage unit that stores a plurality of image data obtained by performing imaging at a designated point and a point around the designated point.

The sorting criteria setting unit 224 sets sorting criteria. Sort criteria are input using the operation unit 6. The sorting criterion is transmitted to the image processing unit 227. Sort criteria correspond to sort criteria. The sort criterion setting unit 224 is an example of a sort condition setting unit.

The sort criteria setting unit 224 may set two or more sort criteria. When setting two or more types of sort criteria, the sort criteria setting unit 224 may set the priority of the sort criteria.

The sorting unit 226 sorts the plurality of reference photographs acquired by using the reference photograph acquiring unit 222 by using the sorting criterion set by using the sorting criterion setting unit 224. A plurality of image data corresponding to the plurality of reference photographs sorted using the sorting unit 226 is transmitted to the image processing unit 227.

The selection unit 228 selects a photograph to be captured from the plurality of sorted reference photographs. The selection unit 228 can use the input information input using the operation unit 6 to select a photograph to be imaged from a plurality of reference photographs.

The composition support unit 230 causes the back monitor 8 to display composition support information that indicates the imaging position and imaging direction in which the same imaging as the reference photo selected using the selection unit 228 is possible. The composition support information includes imaging position instruction information for instructing an imaging position, and imaging direction instruction information for instructing an imaging direction.

The imaging condition setting unit 232 sets imaging conditions of the image data corresponding to the reference photo selected by using the selection unit 228. The imaging condition set using the imaging condition setting unit 232 may be displayed on the back monitor 8.

The image processing unit 227 acquires image data corresponding to a plurality of reference photographs acquired using the reference photograph acquisition unit 222. The image processing unit 227 acquires information indicating the sorting result transmitted from the sorting unit 226.

The image processing unit 227 acquires selection information transmitted from the selection unit 228. The image processing unit 227 acquires composition support information transmitted from the composition support unit 230.

The image processing unit 227 performs signal processing on image data and various information. The image data subjected to the signal processing and various information are transmitted to the LCD driver 8 dr via the rear monitor display control unit 120. The image processing unit is an example of a component of the display control unit.

The rear monitor 8 displays the image data and various information transmitted from the image processing unit 227 via the rear monitor display control unit 120 and the LCD driver 8dr. The rear monitor display control unit 120 is an example of a component of the display control unit. The LCD driver 8dr is an example of a component of the display control unit.

The camera microcomputer 100 may be configured by distributing the components shown in FIG. 5 and the components shown in FIG. 8 to a plurality of processors.

The imaging history storage unit 234 stores the imaging history of the digital camera 1. The imaging history of the digital camera 1 is stored in association with the image data. The imaging history is information reflecting the preference of the imaging person, preference, and the like, such as settings in past imaging. Examples of imaging history include various adjustments such as angle, color, and white balance.

The imaging history of the digital camera 1 stored in the imaging history storage unit 234 is applied to the sort criterion of the reference photo. That is, the sort reference setting unit 224 can set the imaging history of the digital camera 1 read out from the imaging history storage unit 234 as the sort reference.

The sort reference setting unit 224 that reads out the imaging history from the imaging history storage unit 234 is an example of the imaging history acquisition unit.

<< Flowchart of imaging support function >>
FIG. 9 is a flowchart showing the flow of the procedure of the imaging support function. The flowchart of the imaging support function shown in FIG. 9 is synonymous with the procedure of the imaging method using the imaging support function.

The imaging support function is started. In the designated place information acquiring step S10 shown in FIG. 9, the positional information acquiring unit 220 shown in FIG. 8 is used to acquire positional information of the designated point. You may acquire the positional information on the periphery of a designated point.

The designated point may be the current position. The designated point may be designated by the user using a map or the like. In the present embodiment, an aspect in which the designated point is the current position is exemplified.

The position information of the designated point acquired in the designated point information acquiring step S10 shown in FIG. 9 is transmitted to the image processing unit 227 shown in FIG. The position information of the designated point may be stored using a storage unit (not shown).

After the position information acquisition unit 220 shown in FIG. 8 acquires information on the position of the designated point in the designated point information acquisition step S10 shown in FIG.

In the image data acquisition step S12, the reference photograph acquired at the designated point and around the designated point is acquired using the reference photograph acquisition unit 222 shown in FIG. In the image data acquisition step S12 shown in FIG. 9, the reference picture acquisition unit 222 shown in FIG. 8 acquires a plurality of reference pictures. Image data acquisition process S12 is an example of a process which realizes an image data acquisition function.

In the image data acquisition step S12 shown in FIG. 9, after acquiring a plurality of reference photographs imaged at at least one of the designated point and the designated point, the process proceeds to the sort criterion setting determination step S14.

In the sort criterion setting determination step S14, the sort criterion setting unit 224 shown in FIG. 8 determines whether or not the sort criterion is to be set. The setting of the sort criteria includes an aspect of changing the preset sort criteria.

In the sort criterion setting determination step S14, when the sort criterion is not set in advance, or when the sort criterion set in advance is changed, the determination is YES. If the determination is YES, the process proceeds to sort criterion setting step S16. In sort criterion setting step S16, sort criterion setting unit 224 shown in FIG. 8 sets sort criterion.

The sorting criteria can apply the information input using the operation unit 6. Information representing the sort criteria set using the sort criteria setting unit 224 is transmitted to the sort unit 226. In sort criterion setting step S16 shown in FIG. 9, after sort criterion setting unit 224 shown in FIG. 8 sets sort criteria, the process proceeds to sort step S18.

The sort criterion setting step S16 is an example of a sort condition setting step. The step of setting the initial condition of the sort condition (not shown) is an example of the sort condition setting step.

On the other hand, in the sort criterion setting determination step S14 shown in FIG. 9, NO is determined when the preset sort criterion is not changed. If the determination is NO, the process proceeds to the sorting step S18.

In the sorting step S18, the sorting unit 226 shown in FIG. 8 performs sorting of a plurality of reference photographs acquired using the reference photograph acquiring unit 222, using the sorting criteria set in advance. Examples of sorting conditions in the sorting step S18 include the order of popularity, the order of the degree of image matching, and the order of the degree of matching of the imaging device. The sorting step S18 may be configured to be selectable in ascending order or descending order.

In the sorting step S18 shown in FIG. 9, after the sorting unit 226 shown in FIG. 8 sorts the plurality of reference photographs, the process proceeds to the display step S20 shown in FIG. In the display step S20, the image processing unit 227 illustrated in FIG. 8 displays the top N reference photographs on the back monitor 8. N is an integer of 1 or more.

After the top N reference photographs are displayed on the back surface monitor 8 shown in FIG. 8 in the display step S20 shown in FIG. 9, the process proceeds to the selection step S22 in FIG. In the selection step S22, using the selection unit 228 shown in FIG. 8, a reference photograph to be captured is selected from the N reference photographs on the rear monitor 8.

In the selection step S22 shown in FIG. 9, after the selection unit 228 shown in FIG. 8 selects the reference photo to be imaged, the process proceeds to the reference photo information setting step S24 shown in FIG.

In the reference photograph information setting step S24, the composition support unit 230 shown in FIG. 8 includes information on the imaging position when imaging the reference photograph selected in the selection step S22 shown in FIG. 9, and information on the imaging direction. Get composition information.

In the reference photograph information setting step S24, the composition support unit 230 shown in FIG. 8 displays the composition information of the reference photograph on the back monitor 8 via the image processing unit 227, the back monitor display control unit 120, and the LCD driver 8dr. .

Further, in the reference photograph information setting step S24 shown in FIG. 9, the imaging condition setting unit 232 shown in FIG. 8 acquires the imaging condition when the reference photograph selected in the selection step S22 of FIG. 9 is imaged. The imaging conditions include an exposure setting, a focus setting, and the like. The imaging conditions at the time of imaging the reference photo can be read out from the incidental information incidental to the image data of the reference photo.

Further, in the reference photograph information setting step S24 shown in FIG. 9, the imaging condition setting unit 232 shown in FIG. 8 sets the imaging conditions of the digital camera 1 shown in FIG. The reference photograph information setting step S24 is an example of the imaging condition setting step. The reference photo information setting step S24 is an example of the composition support step.

The reference photo information setting step S24 is an example of a step for realizing the imaging condition setting function and the composition assistance function.

In the reference photograph information setting step S24 shown in FIG. 9, after the information of the reference photograph is reflected on the digital camera 1 shown in FIG. 6, the process proceeds to the exposure determination step S26 shown in FIG. In the exposure determination step S26, the camera microcomputer 100 shown in FIG. 8 determines whether the exposure setting of the digital camera 1 shown in FIG. 6 is an appropriate exposure setting that matches the reference photo.

In the exposure determination step S26 shown in FIG. 9, when the camera microcomputer 100 shown in FIG. 8 determines that the exposure setting is appropriate for the reference photo, the determination is YES. In the case of a YES determination, the process proceeds to the imaging step S28 shown in FIG.

On the other hand, in the exposure determination step S26, if it is determined that the camera microcomputer 100 shown in FIG. 8 does not meet the reference photo and the exposure adjustment is necessary, the determination is NO. If the determination is NO, the process proceeds to the exposure adjustment step S30 shown in FIG.

In the exposure adjustment step S30, exposure adjustment is performed automatically or manually using the exposure setting unit 114 shown in FIG. After the exposure adjustment step S30 shown in FIG. 9 is adjusted to an appropriate exposure that matches the reference photo, the process proceeds to the imaging step S28. In the imaging step S28, imaging using the digital camera 1 shown in FIG. 6 is performed. After imaging is performed in the imaging step S28, the camera microcomputer 100 illustrated in FIG. 8 ends the imaging support method.

In the present embodiment, assuming that the depth of field is shallow, the aspect of applying the focus information of the reference photo as the focus information of imaging of the designated point is exemplified. The focus in the imaging of the designated point may be confirmed, and the focus may be readjusted if the focus is not appropriate.

"Screen display"
A screen displayed on the back monitor 8 of the digital camera 1 when the imaging support method is performed will be described using FIGS. 10 to 20. FIG. Each screen shown in FIGS. 10 to 20 is generated using the image processing unit 227 and the rear monitor display control unit 120 shown in FIG. 8. The data of each screen is converted into a signal that can be displayed on the rear monitor 8 using the LCD driver 8dr.

<Specified point selection screen>
FIG. 10 is a diagram showing an example of the designated point setting screen. The designated point automatic setting screen 300 shown in FIG. 10 is used when the current position of the digital camera 1 shown in FIG. 6 is set as the designated point. It is possible to select whether or not to automatically set the current position of the digital camera 1 as the designated point using the operation unit 6 shown in FIG. When the OK button 302 of the designated spot automatic setting screen 300 is operated, the selection is confirmed.

When automatically setting the current position of the digital camera 1 as a designated point, the position information acquisition unit 220 shown in FIG. 8 acquires information on the current position of the digital camera 1 from the position information transmitting device 236 via the communication unit 80 and acquires it. Information on the current location of the digital camera 1 is displayed on the rear monitor 8.

FIG. 11 is a view showing an example of the result screen of the designated point automatic setting. The result screen 310 of the designated point automatic setting shown in FIG. 11 displays the address of the designated point. When the OK button 302 on the result screen 310 is operated, the designated point is decided. On the other hand, when the return button 304 of the result screen 310 is operated, the display is switched to the designated place automatic setting screen 300 shown in FIG.

In the designated point automatic setting screen 300 shown in FIG. 10, it is possible to select whether to execute the designated point automatically or to set the designated point manually.

FIG. 12 is a view showing another example of the designated point setting screen. The designated place manual setting screen 320 shown in FIG. 12 may manually select the position on the map. The position on the selected map is set as a designated point.

The designated point manual setting screen 320 has a hierarchical structure in which the area including the selected position is switched to a screen illustrated in detail, and a more detailed position can be manually selected. As an example of the designated point manual setting screen 320 having a hierarchical structure, a screen for selecting a region is a top hierarchy, a screen for selecting a prefecture is a second hierarchy, a screen for selecting a city is a third hierarchy, There is an example in which the screen for selecting is the lowest hierarchy. FIG. 12 shows the screen of the top hierarchy of the above example.

<Sort criteria setting screen>
FIG. 13 is a diagram showing an example of the sort reference setting screen. The sort criterion setting selection screen 330 shown in FIG. 13 can select whether or not to set the sort criterion when the sort criterion is not set in advance. In addition, the sort criterion setting selection screen 330 can select whether or not to change the sort criterion when the sort criterion is set in advance. When the OK button 302 of the sort criteria setting selection screen 330 is operated, the selection is confirmed.

FIG. 14 is a diagram showing an example of the sort criterion selection screen. The sort criteria selection screen 332 shown in FIG. 14 is displayed when the sort criteria setting is selected on the sort criteria setting selection screen 330 shown in FIG. The same applies to the sort criteria selection screen 340 shown in FIG.

FIG. 14 shows the sort criteria selection screen 332 using the pull-down menu 334. The sort criteria displayed in pull-down menu 334 can be selected using operation unit 6 shown in FIG. When the OK button 302 of the sort criteria selection screen 332 shown in FIG. 14 is operated, sort criteria are determined.

FIG. 15 is a view showing another example of the sort criterion selection screen. The sort criterion selection screen 340 shown in FIG. 15 can select the similarity of images and the degree of coincidence of cameras as sort criteria. A camera is synonymous with an imaging device.

As shown in FIG. 14 and FIG. 15, the sort criteria may include the order of popularity, the degree of coincidence of imaging devices, and the degree of image similarity. The degree of coincidence of the camera is an example of the condition of the imaging device. As an example of the order of popularity, the order of the number of times of imaging, the order of the number of times the social button is pressed, and the order of the number of times read from the image server 238 shown in FIG. The number of likes shown in FIG. 14 corresponds to the number of times the social button is pressed.

As an example of the order of the degree of coincidence of the imaging device, the order of small angle of view and the order of close specifications of the lens may be mentioned. As an example of the order of the degree of similarity of the images, the order of the distance between the photographing position of the reference photograph and the designated point is short, and the order of the small difference of the similarity evaluation value of the image.

When the OK button 302 of the sort criteria selection screen 340 shown in FIG. 15 is operated, sort criteria are determined.

<Reference photo display screen>
FIG. 16 is a view showing an example of the reference photograph display screen. The reference photo display screen 350 shown in FIG. 16 is a reference photo from the top to the top at the top of the sort order: the first reference photo 362, the second reference photo 364, the third reference photo 366, and the fourth reference photo Images corresponding to 368 are displayed side by side in the order of the first reference picture 362, the second reference picture 364, the third reference picture 366, and the fourth reference picture 368.

The number of images displayed on the reference photo display screen 350 may be settable. FIG. 16 illustrates an example of displaying four reference images on the rear monitor 8 in accordance with the display capability of the rear monitor 8.

As an example of the first reference photo 362 shown in FIG. 16, the first reference photo 210 shown in FIG. 7 can be mentioned. As an example of the second reference picture 364 shown in FIG. 16, the second reference picture 212 shown in FIG. 7 can be mentioned.

As an example of the third reference picture 366 shown in FIG. 16, the third reference picture 214 shown in FIG. 7 can be mentioned. As an example of the fourth reference picture 368 shown in FIG. 16, a fourth reference picture 216 shown in FIG. 7 can be mentioned.

When displaying as many reference photos as can be displayed on the reference photo display screen 350 shown in FIG. 16, some of the images may be reduced images such as thumbnail images. For example, in the reference photo display screen 350, an image of two or less places may be used as a thumbnail image.

Also, the number of reference photographs may be set according to the size of the display device that displays the reference photograph display screen 350. For example, when displaying a reference photo on the display of the mobile terminal with an imaging function, it is possible to display nine images.

When the OK button 302 on the reference photo display screen 350 is operated, the selection is confirmed. When the next button 306 on the reference photo display screen 350 is operated, reference photos having a sorting order of 5 or less are displayed in order of the sorting order.

If there is no reference photo with a sorting order of 5 or less, the reference photo display screen 350 may be switched to a screen displaying that a reference photo with a sorting order of 5 or less does not exist.

Reference photo selection screen
FIG. 17 is a diagram showing an example of the reference photo selection screen. In the reference photo selection screen 360 shown in FIG. 17, the second reference photo 364 is selected, and the first reference photo 362, the third reference photo 366, and the fourth reference photo 368 are not selected. When the OK button 302 of the result screen 310 is operated, the selection of the second reference photo 364 is finalized.

In the through image display screen displaying the through image, the extended implementation display may be applied to superimpose and display the reference photo on the through image. The image processing unit 227 illustrated in FIG. 8 generates image data for extended implementation display from the image data corresponding to the reference photo selected as the reference photo to be captured.

Known image processing can be applied to image processing in generation of image data for extended realization display. Here, the detailed description of the image processing in the generation of the image data for extended realization display is omitted. In general, augmented reality may be expressed using AR, an abbreviation of Augmented Reality.

The image data for expanded realization display generated using the image processing unit 227 is expanded and displayed on the back monitor 8 via the back monitor display control unit 120 and the LCD driver 8dr. The rear surface monitor 8 superimposes a through image on the reference photo displayed in the expanded state. The superimposed display referred to here includes an aspect in which the reference photo is displayed in an extended manner, outside the frame of the screen displaying the through image. The same applies to superimposed display on the composition information display screen described later and superimposed display on the imaging condition display screen.

<Composition information display screen>
FIG. 18 is a view showing an example of the composition information display screen. In the composition information display screen 370 shown in FIG. 18, an imaging position 374 and an imaging direction 376 are displayed on the two-dimensional map 372. Instead of the two-dimensional map 372, a three-dimensional map may be applied. The two-dimensional map 372 can apply the two-dimensional map acquired by performing aerial photography using an aerial imaging device.

It is preferable that the image data corresponding to the reference photo be added with the information of the imaging position and the information of the imaging direction as incidental information.

Composition information can apply extended realization indication. That is, the image processing unit 227 shown in FIG. 8 is used to generate extended realization image data representing composition information. The extended implementation image data of composition information generated using the image processing unit 227 can be displayed on the rear monitor 8 via the rear monitor display control unit 120 and the LCD driver 8dr. The extended implementation display of composition information may be displayed superimposed on the through image.

A two-screen display in which the through image and the composition information are displayed on different screens may be applied. In the two-screen display, it is preferable to be able to adjust the screen size of the through image and the screen size of the composition information.

<Display of imaging condition>
FIG. 19 is a diagram showing an example of imaging condition display. FIG. 19 illustrates an example in which imaging conditions are superimposed and displayed outside the frame f on the through image display screen 382 for displaying the through image 380. A through image display screen 382 shown in FIG. 19 displays imaging conditions such as an imaging mode, an exposure mode, a shutter speed, an aperture value, an exposure correction value, and a setting sensitivity.

The through image display screen 382 shown in FIG. 19 displays information such as the number of shootable images and the remaining amount of battery. The imaging conditions shown in FIG. 19 may be displayed inside the frame f. In the case where the imaging condition is displayed inside the frame f, it is preferable that the background of the imaging condition be transparent or translucent to maintain the visibility of the through image.

As the imaging condition, an extended implementation display can be applied. That is, the image processing unit 227 shown in FIG. 8 is used to generate extended realization image data representing imaging conditions. The extended realization image data of the imaging condition generated using the image processing unit 227 can be displayed on the rear monitor 8 via the rear monitor display control unit 120 and the LCD driver 8dr. The extended implementation display of the imaging conditions may be displayed superimposed on the through image.

<Exposure adjustment selection screen>
FIG. 20 shows an example of the exposure adjustment selection screen. The exposure adjustment selection screen 390 shown in FIG. 20 can select whether to perform exposure adjustment. When the OK button 302 is operated, the selection is confirmed.

Although illustration is omitted, it is preferable to display a focus adjustment selection screen in the aspect configured to enable readjustment of the focus. When the OK button 302 of the designated spot automatic setting screen 300 is operated, the selection is confirmed.

[Function effect]
The digital camera configured as described above and the imaging support method can obtain the following effects.

[Operation effect 1]
A plurality of reference photographs to be used as reference for composition in imaging of a designated point are acquired. Multiple reference photos are sorted using sort criteria. Sort the top N reference photos into the sort order and display them on the back monitor of the digital camera. As a result, the user of the digital camera can easily select a reference picture taken from among a plurality of reference pictures displayed on the rear monitor.

Select the reference photo you want to take from the N reference photos. The imaging conditions of the selected reference photo are set in the digital camera. The composition of the selected reference photo is instructed. It becomes possible to take an image with the application of the shooting conditions and composition of the reference photo to be taken.

[Operation effect 2]
As the sort condition, the popularity order, the similarity of images, the coincidence of imaging devices, and the imaging history of digital cameras used for imaging can be set. As a result, imaging using the imaging conditions and the composition in which the sorting conditions are reflected becomes possible.

When the order of popularity is set as the sort condition, it is possible to capture an image using the imaging condition and composition of a popular reference photo.

When the image similarity is set as the sorting condition, it becomes possible to capture an image similar to the reference photo.

When the matching degree of the imaging device is set as the sorting condition, imaging according to the performance of the digital camera used for imaging becomes possible.

When the imaging history of the digital camera used for imaging is set as the sorting condition, imaging according to the imaging history becomes possible. When the preference of the user of the digital camera is reflected in the imaging history, it is possible to perform imaging according to the preference of the user of the digital camera.

When a plurality of sort conditions are set, it is possible to narrow down the reference photos as compared with the case where one sort condition is set. When priorities are set to a plurality of sorting conditions, it is possible to narrow down reference photos according to the priorities.

[Operation effect 3]
The number N of reference pictures displayed on one screen is adjusted according to the display capability of the rear monitor. This makes it possible to display a reference picture having an appropriate size, an appropriate resolution, and the like. The number N of reference photos displayed on one screen may be manually adjusted.

The rear monitor displays thumbnail images of at least some reference photos. This allows the rear monitor to display more reference pictures.

The rear monitor superimposes an imaging condition and composition support information on the through image. Thus, the user of the digital camera can visually recognize the through image, the imaging condition, and the composition support information on one screen.

The rear monitor superimposes the imaging condition and the composition support information on the through image using the augmented reality display. This makes it possible to display the through image, the imaging condition, and the composition support information in a well-balanced manner.

[Example of application to network system]
Next, an application example of the imaging support function described with reference to FIGS. 1 to 20 to a client server type network system will be described.

〔Constitution〕
FIG. 21 is a block diagram of an imaging system showing an application example of a network system. The imaging system 400 shown in FIG. 21 includes the digital camera 1 and a server apparatus 402. The digital camera 1 and the server device 402 are configured to be able to communicate via the network 404.

The server apparatus 402 illustrated in FIG. 21 has the same configuration and the same function as the image server 238 illustrated in FIG. 8. The network 404 shown in FIG. 21 is not limited in scale, communication system, etc., and any network can be applied.

The server device 402 includes an image database 410, a processing unit 412, and a server communication unit 414. The image database 410 stores image data corresponding to a plurality of reference photographs.

The processing unit 412 controls reading of image data from the image database 410 and writing of image data to the image database 410. Also, the processing unit 412 extracts image data that matches the extraction condition from the plurality of image data stored in the image database 410.

As the extraction condition, a designated point set in the digital camera 1 is applied. The processing unit 412 extracts image data corresponding to at least one of a reference photo matching the designated point set in the digital camera 1 and a reference photo matching the periphery of the designated point.

The server communication unit 414 executes communication with devices connected to the network 404. For example, when the extraction condition of the image data is transmitted from the digital camera 1 to the server device 402, the server device 402 acquires the extraction condition of the image data via the server communication unit 414.

Further, when transmitting image data from the server device 402 to the digital camera 1, the server device 402 transmits image data corresponding to the reference photo extracted from the image database 410 to the digital camera 1 via the server communication unit 414. Do.

The imaging system 3 of the digital camera 1 shown in FIG. 21 includes the imaging lens 4, the image sensor 70 and the analog signal processing unit 74 shown in FIG. 4.

Although not shown in FIG. 21, the network 404 is connected with a plurality of terminal devices. Examples of the terminal device include a computer, a portable terminal device, and the like.

[Modification]
FIG. 22 is a block diagram of a modification of the imaging system shown in FIG. The imaging system 400A illustrated in FIG. 22 includes the sort reference setting unit 420 and the sort unit 422 in the server device 402A.

The imaging system 400A further includes a sort reference transmission unit 250 in the camera microcomputer 100A of the digital camera 1A. The sort reference transmitting unit 250 transmits the sort condition to the sort reference setting unit 420 of the server apparatus 402A via the communication unit 80 and the server communication unit 414.

The sorting criterion setting unit 420 of the server device 402A sets sorting conditions transmitted from the sorting criterion transmission unit 250 of the digital camera 1A. The sorting unit 422 sorts the plurality of reference photographs based on the sorting condition set by using the sorting criterion setting unit 420.

The sorting unit 422 transmits image data corresponding to the plurality of sorted reference photos to the camera microcomputer 100A of the digital camera 1A via the processing unit 412, the server communication unit 414, the network 404, and the communication unit 80. The camera microcomputer 100A arranges the plurality of reference photographs transmitted from the server device 402 in the order of the sorting order and displays the reference photographs on the rear monitor 8.

[Effect of imaging system to which network system is applied]
An imaging system to which a network system is applied can obtain the following effects.

[Operation effect 1]
The digital camera acquires a plurality of reference photographs from the image database of the server device. Thus, the digital camera can use the reference photo stored in the image database of the server device, and does not need to have a large-capacity storage unit.

[Operation effect 2]
A digital camera includes a sort condition setting unit and a sort unit. This eliminates the need for communication between the server device and the digital camera when setting sorting conditions and obtaining sorting results. Further, communication between the server device and the digital camera is limited when the digital camera acquires a reference picture. Furthermore, setting of sorting conditions and processing of the server device in sorting are unnecessary.

[Others]
In the above embodiment, the imaging support function is realized by the computer, but the hardware configuration for realizing these functions is not limited to this. It can be realized by various processors. Various types of processors include CPUs that are general-purpose processors that function as processing units that execute software and perform various types of processing, and specific types such as PLDs and ASICs that are processors whose circuit configurations can be changed after manufacturing such as FPGAs. It includes a dedicated electric circuit, which is a processor having a circuit configuration specially designed to execute processing. Software is synonymous with program.

The term "FPGA" is an abbreviation of Field Programmable Gate Array, which is an English notation representing an integrated circuit whose configuration can be set by a purchaser or a designer after manufacture. PLD is an abbreviation of Programmable Logic Device, which is an English-language notation for a programmable logic device. ASIC is an abbreviation of Application Specific Integrated Circuit, which is an English-language notation for Application Specific Integrated Circuit.

One processing unit may be configured by one of these various processors, or may be configured by two or more processors of the same type or different types. For example, it may be configured by a plurality of FPGAs, or may be configured by a combination of a CPU and an FPGA.

Also, a plurality of processing units may be configured by one processor. As an example in which a plurality of processing units are configured by one processor, first, one processor is configured by a combination of one or more CPUs and software as represented by computers such as clients and servers; There is a form in which this processor functions as a plurality of processing units. Second, as typified by SoC or the like, there is a mode using a processor that realizes the functions of the entire system including a plurality of processing units by one IC chip. As described above, the various processing units are configured using one or more of the various processors as a hardware structure. Here, SoC is an abbreviation of System On Chip, which is an English notation representing a system on chip. IC is an abbreviation for Integrated Circuit which stands for integrated circuit.

Furthermore, the hardware-like structure of these various processors is, more specifically, an electric circuit combining circuit elements such as semiconductor elements.

[Example of application to program]
The functions of the digital camera and the imaging system described above can be realized by causing a computer to execute a program. That is, on the computer, a reference photo acquisition function for acquiring reference photos, a sorting condition setting function for setting sorting conditions, a sorting function for executing sorting of multiple reference photos, a display function for displaying sorted reference photos, It is possible to configure an imaging program for realizing a selection function of selecting a reference photograph to be a reference of composition from a reference photograph, an imaging condition function of setting imaging conditions, a composition instructing function of instructing composition, and an imaging function. .

In addition, the imaging program may cause a computer to realize functions other than the functions of the above-described imaging apparatus and imaging system. Furthermore, it is possible to configure a non-temporary computer-readable recording medium, such as a hard disk, a CD (Compact Disk), a DVD (Digital Versatile Disk), various semiconductor memories, etc., storing an imaging program.

[About the combination of the embodiment and the modification etc.]
The components described in the above embodiments and the components described in the modification may be used in appropriate combination, and some components may be replaced.

[Explanation of terms]
Imaging represents a concept that includes imaging. The imaging may include both still image acquisition and moving image acquisition.

An imaging device represents a concept that includes a camera. A digital camera is an example of an imaging device. A photograph may include a form in which an image is recorded on photo paper, and a form in which an image is displayed on a display device. The image data represents an electrical signal representative of the image.

In the embodiment of the present invention described above, it is possible to appropriately change, add, or delete the constituent requirements without departing from the spirit of the present invention. The present invention is not limited to the embodiments described above, and many modifications can be made by those skilled in the art within the technical concept of the present invention.

1, 1A Digital Camera 2 Camera Body 4 Camera Lens 4 f Focus Lens Group 4 i Aperture 6 Operation Unit 8 Rear Monitor 8 dr LCD Driver 10 Finder Device 10 a Finder Window 10 b Finder Eyepiece 12 Power Lever 14 Shutter Button 16 First Function Button 18 Exposure Correction dial 20 Shutter speed / sensitivity dial 22 Front command dial 24 Finder switching lever 26 Second function button 28 Focus mode switching lever 30 View mode button 32 Metering mode button 34 AE lock button 36 Rear command dial 38 Focus lever 40 Play button 42 Clear Button 44 Back button 46 Cross button 48 Menu / OK button 50 AF lock button 52 Quick menu button 6 Finder first optical system 60a objective lens group 60b eyepiece lens group 62 viewfinder LCD
62dr finder LCD driver 64 finder second optical system 64a half prism 64a1 semi-permeable film 64b target lens group 66 liquid crystal shutter 66dr liquid crystal shutter driver 70 image sensor 74 analog signal processing unit 76 digital signal processing unit 78 storage unit 80 communication unit 82 focus lens Drive mechanism 84 Aperture drive mechanism 100, 100A Camera microcomputer 112 Focus control unit 114 Exposure setting unit 118 Aperture control unit 120 Rear monitor display control unit 122 Storage control unit 124 Communication control unit 126 Finder LCD display control unit 128 Liquid crystal shutter drive control unit 200 Imager 210, 362 first reference photo 212, 364 second reference photo 214, 366 third reference photo 216, 368 fourth reference photo 220 location information acquisition unit 222 reference photo acquisition 224, 420 sort criterion setting unit 226, 422 sort unit 227 image processing unit 228 selection unit 230 composition support unit 232 imaging condition setting unit 234 imaging history storage unit 236 position information transmission device 238 image server 250 sort criterion transmission unit 300 designated point automatic Setting screen 302 OK button 304 Back button 306 Next button 310 Result screen 320 Specified point manual setting screen 330 Sort criteria setting selection screen 332, 340 Sort criteria selection screen 334 Pull down menu 350 Reference photo display screen 360 Reference photo selection screen 370 Composition information Display screen 372 Two-dimensional map 374 Imaging position 376 Imaging direction 380 Through image 382 Through image display screen 390 Exposure adjustment selection screen 400, 400A Imaging system 402, 402A Server device 404 Network 41 Each process of the optical axis S10 ~ S30 imaging support method of an image database 412 processor 414 server communication unit L imaging lens

Claims (19)

A storage unit that stores a plurality of image data;
An image data acquisition unit that acquires, from among the plurality of image data stored in the storage unit, the plurality of image data to be used as a reference for composition;
A sort condition setting unit that sets sort conditions for a plurality of image data acquired using the image data acquisition unit;
A sort unit that sorts the plurality of image data based on the sort condition set using the sort condition setting unit;
A display unit for displaying images corresponding to the plurality of image data sorted using the sorting unit in the order of the sorting order in the set sorting condition;
A selection unit that selects an image from among the plurality of images displayed using the display unit;
An imaging condition setting unit configured to set an imaging condition of image data corresponding to an image selected using the selection unit;
An imaging position at which imaging of the same image as the image selected using the selection unit is possible, and a composition support unit that instructs an imaging direction;
An imaging unit that applies an imaging condition set using the imaging condition setting unit and performs imaging by applying an imaging position and an imaging direction instructed using the composition support unit;
An imaging system equipped with The storage unit stores a plurality of image data obtained by performing imaging at a designated point and a peripheral point of the designated point,
The imaging system according to claim 1, wherein the imaging unit performs imaging at the designated point. 3. The sort condition setting unit according to claim 1 or 2, wherein at least one of the number of times of imaging, the number of times the social button is operated, and the number of times read from the storage unit in the past is set as a sort condition. Imaging system. The imaging system according to any one of claims 1 to 3, wherein the sorting condition setting unit sets a condition of an imaging device used for imaging as a sorting condition. An imaging history acquisition unit for acquiring an imaging history of an imaging device used for imaging;
The imaging system according to claim 4, wherein the condition of the imaging device includes an imaging history of the imaging device used for imaging acquired using the imaging history acquisition unit. The imaging system according to claim 4 or 5, wherein the sorting condition setting unit sets two or more types of sorting conditions including the conditions of the imaging device. The imaging system according to any one of claims 1 to 6, further comprising a display control unit that causes the display unit to display an image from the first place in the sorting order in the sorting condition to a predetermined order. The imaging system according to claim 7, wherein the display control unit adjusts the number of images to be displayed on the display unit according to the display capability of the display unit. The imaging according to claim 7 or 8, wherein the display control unit reduces at least a part of the image and causes the display unit to display the reduced image when the number of images displayed on the display unit is equal to or more than a predetermined number. system. The display control unit superimposes at least one of composition support information using the composition support unit and an imaging condition set using the imaging condition setting unit on an object at the time of imaging at a designated point. The imaging system according to any one of claims 7 to 9. The imaging system according to claim 10, wherein the display control unit displays at least one of the composition assistance information and the imaging condition in an augmented reality display. The imaging system according to any one of claims 7 to 11, comprising an imaging device having the imaging unit, the display unit, and the display control unit. A server device,
An imaging device connected to the server device via a network;
Equipped with
The server device includes the storage unit.
The imaging system according to any one of claims 1 to 12, wherein the imaging device includes the display unit, the imaging condition setting unit, the composition support unit, and the imaging unit. The imaging system according to claim 13, wherein the imaging device includes the sort condition setting unit and the sort unit. The imaging system according to any one of claims 1 to 14, wherein the selection unit includes an operation unit used to select an image from the plurality of images displayed using the display unit. An image data acquisition unit that acquires, from among a plurality of image data stored in the storage unit, a plurality of image data to be used as a reference for composition;
A sort condition setting unit that sets sort conditions for a plurality of image data acquired using the image data acquisition unit;
A sort unit that sorts the plurality of image data based on the sort condition set using the sort condition setting unit;
A display unit for displaying images corresponding to the plurality of image data sorted using the sorting unit in the order of the sorting order in the set sorting condition;
A selection unit that selects an image from among the plurality of images displayed using the display unit;
An imaging condition setting unit configured to set an imaging condition of image data corresponding to an image selected using the selection unit;
An imaging position at which imaging of the same image as the image selected using the selection unit is possible, and a composition support unit that instructs an imaging direction;
An imaging unit that applies an imaging condition set using the imaging condition setting unit and performs imaging by applying an imaging position and an imaging direction instructed using the composition support unit;
An imaging device provided with An image data acquisition step of acquiring a plurality of image data to be a reference of composition among a plurality of image data stored in the storage unit;
A sorting condition setting step of setting sorting conditions for a plurality of image data acquired in the image data acquiring step;
A sorting step of sorting the plurality of image data based on the sorting condition set in the sorting condition setting step;
A display step of arranging and displaying images corresponding to the plurality of image data sorted in the sorting step in the order of the sorting order under the set sorting condition;
A selection step of selecting an image from the plurality of images displayed in the display step;
An imaging condition setting step of setting an imaging condition of image data corresponding to the image selected in the selection step;
An imaging position at which imaging of the same image as the image selected in the selecting step is possible, and a composition support step of instructing an imaging direction;
An imaging step of applying an imaging condition set in the imaging condition setting step and applying an imaging position and an imaging direction instructed in the composition support step;
An imaging method including: On the computer
An image data acquisition function of acquiring a plurality of image data to be a reference of composition among a plurality of image data stored in the storage unit;
A sorting condition setting function for setting sorting conditions for a plurality of image data acquired using the image data acquisition function;
A sorting function for sorting the plurality of image data based on sorting conditions set using the sorting condition setting function;
A display function of displaying images corresponding to the plurality of image data sorted using the sorting function in the order of the sorting order in the set sorting condition;
A selection function of selecting an image from the plurality of images displayed using the display function;
An imaging condition setting function of setting an imaging condition of image data corresponding to an image selected using the selection function;
Applying an imaging condition set using the imaging condition setting function and a composition support function that instructs an imaging position and an imaging direction where imaging of the same image as the image selected using the selection function is possible; An imaging program for realizing an imaging function of performing imaging by applying an imaging position and an imaging direction instructed using the composition support function. A non-transitory computer-readable recording medium, in which a command stored in the recording medium is read by a computer.
An image data acquisition function of acquiring a plurality of image data to be a reference of composition among a plurality of image data stored in the storage unit;
A sorting condition setting function for setting sorting conditions for a plurality of image data acquired using the image data acquisition function;
A sorting function for sorting the plurality of image data based on sorting conditions set using the sorting condition setting function;
A display function of displaying images corresponding to the plurality of image data sorted using the sorting function in the order of the sorting order in the set sorting condition;
A selection function of selecting an image from the plurality of images displayed using the display function;
An imaging condition setting function of setting an imaging condition of image data corresponding to an image selected using the selection function;
Applying an imaging condition set using the imaging condition setting function and a composition support function that instructs an imaging position and an imaging direction where imaging of the same image as the image selected using the selection function is possible; A recording medium which causes a computer to realize an imaging function of performing imaging by applying an imaging position and an imaging direction instructed using the composition support function.

Images