JP2012060222A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of suppressing an unnecessary zoom operation not intended by a photographer.SOLUTION: An imaging apparatus 100 includes: an imaging part 10 that images a subject to acquire first image information; a first detector 41 that detects photographing magnification information based on at least one of second image information representing a photographer and sensor information from a motion sensor; and a deciding part 48 that decides an imaging magnification based on the photographing magnification information. When operation information from an operation part 25 represents that an operation is being performed, the deciding part 48 executes decision of the imaging magnification in the case that the variation in the photographing magnification information exceeds a second threshold. When the operation information from the operation part 25 does not represent that an operation is being performed, the deciding part 48 executes the decision of the imaging magnification in the case that the variation in the photographing magnification information exceeds a first threshold. The second threshold is larger than the first threshold.

Description

  The present invention relates to an imaging device and the like.

  The range of the imaging device that captures an image of a subject at a desired magnification includes an electronic still camera, an electronic video camera, and the like. When the imaging apparatus includes an operation unit such as a zoom lever and a zoom button, the photographer can determine the imaging magnification by operating the operation unit. In order to determine the imaging magnification, the photographer himself needs to operate the operation unit. Therefore, there is a problem that the operation of the operation unit is complicated, such as troublesome to check the operation unit or erroneous operation in the reverse direction.

  As such an imaging apparatus that does not use an operation unit, an imaging apparatus that follows the photographer's intuitive intention has been proposed in, for example, Patent Document 1 and Patent Document 2. In Patent Document 1, the imaging device includes a motion sensor, and the imaging magnification is determined by moving the imaging device in the optical axis direction. In Patent Document 2, a photographer's face image is analyzed, and it is determined whether the photographer is close to or away from the imaging device, and the imaging magnification is determined.

JP 2006-21458 A JP 2009-294728 A

  By simply determining the imaging magnification according to the distance between the photographer and the imaging device, for example, even when the photographer operates an operation unit such as a shutter button, the imaging device moves when the imaging device moves. The magnification is changed. That is, even when the photographer wants to fix the imaging magnification, for example, during a framing operation, the imaging magnification may be changed. As described above, the present inventor has recognized that it is difficult to accurately follow the photographer's intuitive intention only by determining the imaging magnification according to the distance between the photographer and the imaging device.

  According to some aspects of the present invention, it is possible to provide an imaging apparatus capable of suppressing unnecessary zoom operations that do not match the photographer's intention.

According to one aspect of the present invention, an imaging unit that captures an image of a subject and acquires first image information;
A first detector for detecting photographing magnification information based on at least one of second image information representing a photographer and sensor information from a motion sensor;
A determination unit that determines an imaging magnification based on the imaging magnification information;
Including
When the operation information from the operation unit indicates that the operation is being performed, the determination unit executes the determination of the imaging magnification when a change in the imaging magnification information exceeds a second threshold,
When the operation information from the operation unit does not indicate that the operation is being performed, the determination unit performs determination of the imaging magnification when the variation of the imaging magnification information exceeds a first threshold,
The second threshold value is related to an imaging device characterized by being larger than the first threshold value.

  According to one aspect of the present invention, the imaging magnification is less likely to be changed when the operation information from the operation unit indicates that the operation is in progress than when the operation information from the operation unit does not indicate that the operation is being performed. In this way, unnecessary zoom operations that do not match the photographer's intention can be suppressed in consideration of not only shooting magnification information but also operation information from the operation unit.

In one aspect of the present invention, the imaging device includes a second detection unit that detects motion information representing the motion of the imaging device;
A determination unit for determining which of the first zone and the second zone the movement information belongs to;
May further include
When the determination result of the determination unit represents the first zone, the determination unit may execute the determination of the imaging magnification when a variation in the imaging magnification information exceeds the second threshold,
When the determination result of the determination unit represents the second zone, the determination unit may determine the imaging magnification when the variation of the imaging magnification information exceeds the first threshold.

  According to one embodiment of the present invention, it is possible to consider the movement of the imaging device sorted into the corresponding zone. Therefore, not only when the operation information from the operation unit indicates that the operation is being performed, but also when the determination result (movement of the imaging apparatus) of the determination unit indicates the first zone, an unnecessary zoom operation that does not match the photographer's intention. Can be suppressed.

In the aspect of the invention, the second detection unit may include a first evaluation value based on the history of the motion information in the first period, and a second value based on the history of the motion information in the second period. You may ask for the evaluation value of
The first period may be a period when past operation information from the operation unit represents an operation in progress.
The second period may be a period when the current operation information from the operation unit does not indicate that an operation is in progress.
When the first evaluation value is less than or equal to the second evaluation value, the determination result may represent the first zone.

  According to one aspect of the present invention, when the first evaluation value is equal to or less than the second evaluation value, the determination result can indicate that the motion information belongs to the first zone.

  In one aspect of the present invention, at least one of the first evaluation value and the second evaluation value may be a variance value of the motion information or an average value of frequency spectrum values of the motion information. .

  According to one aspect of the present invention, it is possible to determine whether or not the motion information belongs to the first zone by evaluating the variance value of the motion information. In addition, you may evaluate the average value of the frequency spectrum value of motion information.

  In the aspect of the invention, the second detection unit may detect acceleration of the imaging device as the motion information.

  According to one embodiment of the present invention, it is possible to detect whether the motion information belongs to the first zone by detecting the acceleration of the imaging device.

  In the aspect of the invention, the photographing magnification information may be a distance between the photographer and the imaging device.

  According to one embodiment of the present invention, the distance between the photographer and the imaging apparatus can be used as the imaging magnification information.

  In the aspect of the invention, the operation unit may be a shutter button.

  For example, the photographer often intentionally stops the imaging device immediately before the photographer presses the shutter button. Therefore, it is preferable that the imaging magnification is difficult to change when the shutter button is pressed. Further, when the shutter button is pressed to perform the shutter, the first image information (subject) can be acquired with a frame (composition) intended by the photographer by suppressing or canceling the zoom operation. When the operation unit has not only the shutter button but also a zoom lever, the determination unit can adopt the second threshold only when the operation information from the shutter button indicates that the operation is being performed.

2 is a configuration example of an imaging apparatus according to the present embodiment. Another configuration example of the imaging apparatus of the present embodiment. Setting example of first to second zones. 3 is a specific configuration example of an imaging apparatus according to the present embodiment. 5 is a schematic configuration example of a processing unit in FIG. 5 is a flowchart for explaining a part of an operation example of the imaging apparatus in FIG. 4. 5 is a flowchart for explaining another part of the operation example of the imaging apparatus in FIG. 4. FIGS. 8A and 8B show an evaluation example of acceleration history.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Overview 1.1. Basic Configuration FIG. 1 shows a configuration example of an imaging apparatus according to the present embodiment. As illustrated in FIG. 1, the imaging apparatus 100 includes an imaging unit 10, a first detection unit 41, and a determination unit 48. In the example of FIG. 1, the imaging apparatus 100 can include an operation unit 25 for a user to perform various operations. The imaging apparatus 100 may include a shutter button, a zoom lever, and the like as the operation unit 25. Further, the operation unit 25 may be separated from the imaging device 100. In this case, the imaging apparatus 100 may receive operation information from the operation unit 25 wirelessly or by wire.

  In the example of FIG. 1, the imaging apparatus 100 can also include a motion sensor 47. The motion sensor 47 may be separated from the imaging device 100. In this case, the imaging apparatus 100 may receive sensor information from the motion sensor 47 wirelessly or by wire. In the example of FIG. 1, the first detection unit 41 can detect photographing magnification information from sensor information from the motion sensor 47.

  FIG. 2 shows another configuration example of the imaging apparatus of the present embodiment. As illustrated in FIG. 2, the imaging apparatus 100 can include, for example, a second imaging unit 49 instead of the motion sensor 47. In the example of FIG. 2, the first detection unit 41 can detect shooting magnification information using image information (photographer) from the second imaging unit 49. In addition, the example of FIG. 1 or the example of FIG. 2 is modified, and the first detection unit 41 detects the imaging magnification information by the image information (photographer) from the imaging unit (first imaging unit) 10. Also good.

  2, the first detection unit 41 detects photographing magnification information with a motion sensor such as the motion sensor 47 of FIG. 1, while the second detection unit 44 starts from the second imaging unit 49. You may continue to use the image information. In addition, the second detection unit 44 may also use sensor information from a motion sensor such as the motion sensor 47 of FIG. In addition, the example of FIG. 1 may be modified so that the first detection unit 41 may detect shooting magnification information using image information from an imaging unit such as the second imaging unit 49 of FIG. Thus, the first detection unit 41 can use at least one of image information and sensor information. The second detection unit 44 can also use at least one of image information and sensor information.

  In the example of FIG. 2, the second detection unit 44 detects motion information representing the motion of the imaging device 100 using image information (for example, the second imaging unit 49). Note that the second detection unit 44 may use both image information and sensor information.

  The imaging unit 10 can include an imaging element, for example. In the example of FIG. 1 and the example of FIG. 2, the first detection unit 41 and the determination unit 48 (and in some cases, the second detection unit 44 and the determination unit 46) are represented as a processing unit 40. 40 can have an IC such as an ASIC or DSP. Note that the configuration of the imaging apparatus 100 is not limited to FIGS. 1 and 2.

  In the example of FIG. 1 and the example of FIG. 2, the imaging device 100 can include a storage unit (not shown). The imaging apparatus 100 is typically an electronic still camera or an electronic video camera, and converts optical image information into an electrical signal by, for example, an imaging element (imaging unit 10 in a broad sense), and the converted image information. Can be electronically recorded in, for example, a storage unit (work area) in the processing unit 40 or a storage unit (not shown). Note that the imaging apparatus 100 may be portable like a digital camera. Further, in the imaging apparatus 100, the imaging part and the operation part may be separated as in an endoscope or a microscope. Furthermore, the imaging apparatus 100 (imaging unit 10) may be incorporated in an electronic device such as a portable information terminal, a mobile phone, or a portable game machine, and all or a part of the functions of the processing unit 40 may be incorporated into the MPU of the electronic device. It may be realized by a processing unit such as a CPU.

  In the example of FIG. 1 and the example of FIG. 2, the imaging unit 10 captures a subject and acquires image information (first image information). Note that the imaging magnification of the imaging unit 10 can be determined by the determination unit 48. The imaging magnification may be only an optical magnification, or may be both an optical magnification and an electronic magnification (combination). The optical magnification can be determined by adjusting the lens system of the imaging unit 10, and the electronic magnification can be electronically obtained by performing interpolation or thinning between pixels in the image data in the processing unit 40. Image data can be enlarged or reduced. Note that the imaging magnification may be only an electronic magnification.

  The first image information may represent a subject, and the first detection unit 41 may use image information (second image information) representing a photographer (user). In the example of FIG. 2, the second image information is captured by the second imaging unit 49, but the second image information may be captured by the imaging unit 10 (first imaging unit). When the imaging unit 10 employs, for example, an omnidirectional (360 °) lens system or a fish-eye lens system, the imaging unit 10 includes first image information representing a subject intended by the photographer and second image information representing the photographer. Can be obtained at the same time.

  The first detection unit 41 determines the distance (photographing magnification information in a broad sense) between the photographer and the imaging device 100 based on at least one of the second image information representing the photographer and the sensor information from the motion sensor 47. To detect. Since the imaging device 100 includes the first detection unit 41, the determination unit 48 can determine the imaging magnification (zoom magnification) according to the distance between the photographer and the imaging device 100. For example, as in Patent Document 2, the imaging magnification change (zoom operation) can be realized by an intuitive operation of pushing the imaging device 100 or pulling it toward the front. If the zoom operation can be realized by an intuitive operation, the first detection unit 41 may detect information (photographing magnification information) other than the distance between the photographer and the imaging device 100.

  In the example of FIG. 1, when the operation information from the operation unit 25 does not indicate that the operation is in progress, the determination unit 48 can execute the determination of the imaging magnification when the variation in the shooting magnification information exceeds the first threshold. . Further, when the operation information from the operation unit 25 indicates that the operation is being performed, the determination unit 48 can execute the determination of the imaging magnification when the variation in the imaging magnification information exceeds the second threshold. The second threshold value can be set larger than the first threshold value. With such a setting, when the operation information from the operation unit 25 indicates that the operation information from the operation unit 25 does not indicate that the operation is being performed (first threshold value), the operation information from the operation unit 25 indicates that the operation information is being operated (from the first threshold value) The second threshold value) is also difficult to change. In this way, unnecessary zoom operations that do not match the photographer's intention can be suppressed in consideration of not only shooting magnification information but also operation information from the operation unit.

  When the operation unit 25 is, for example, a shutter button, for example, the photographer often intentionally stops the imaging apparatus 100 immediately before the photographer presses the shutter button. Therefore, it is preferable that the imaging magnification is difficult to change when the shutter button is pressed. Further, when the shutter button is pressed to perform the shutter, the first image information (subject) can be acquired with a frame (composition) intended by the photographer by suppressing or canceling the zoom operation.

  In the example of FIG. 2, the second detection unit 44 detects motion information representing the motion of the imaging device 100. The second detection unit 44 can use at least one of second image information representing the photographer and sensor information from the motion sensor 47. When both the first detection unit 41 and the second detection unit 44 use the same information (for example, second image information), the configuration of the imaging device 100 can be simplified.

  In the example of FIG. 2, the determination unit 46 determines which zone of the first zone and the second zone the motion information belongs to. The determination unit 48 can take into account the movements of the imaging devices sorted into the corresponding zones. When the operation information from the operation unit 25 indicates that the operation is being performed, the determination unit 46 can send the operation information to the determination unit 48 as it is. The determination unit 46 may determine whether or not the operation information from the operation unit 25 indicates that the operation is being performed. The determination unit 48 determines the imaging magnification based on the shooting magnification information and the determination result of the determination unit 46. Therefore, not only when the operation information from the operation unit indicates that the operation is being performed, but also when the determination result (movement of the imaging apparatus) of the determination unit indicates the first zone, an unnecessary zoom operation that does not match the photographer's intention. Can be suppressed.

  An intuitive operation of pushing the imaging device 100 or pulling it toward the front can be detected by the first detection unit 41. In Patent Document 1 and Patent Document 2, it is assumed that such an imaging magnification change (zoom operation) is universal. However, the photographer sometimes does not want to change the imaging magnification. In addition, the image capturing apparatus 100 itself may predict or estimate an unnecessary zoom operation that does not match the photographer's intention. Thereby, compared with patent document 1 and patent document 2, zoom operation along a photographer's intention can be implemented.

  FIG. 3 shows an example of setting the first and second zones. In the example of FIG. 3, when the determination result of the determination unit 46 represents the first zone, the determination unit 48 can execute the determination of the imaging magnification when the variation in the shooting magnification information exceeds the second threshold. In addition, when the determination result of the determination unit 46 represents the second zone, the determination unit 48 can execute the determination of the imaging magnification when the variation of the imaging magnification information exceeds the first threshold. Since the second threshold value is larger than the first threshold value, the imaging magnification is hardly changed even when the determination result of the determination unit 46 (movement of the imaging device 100) represents the first zone.

  In the example of FIG. 2, the second detection unit 44 uses motion information (motion of the imaging device 100). Accordingly, the second detection unit 44 calculates an evaluation value for evaluating the motion information, and the determination unit 46 belongs to which zone of the first zone and the second zone the motion information belongs based on the evaluation value. Can be determined. The second detection unit 44 can calculate, for example, a past evaluation value (first evaluation value) and a current evaluation value (second evaluation value) as evaluation values. As the past evaluation value (first evaluation value), for example, a period when the past operation information from the operation unit 25 represents that the operation is being performed can be used. The current evaluation value (second evaluation value) can use, for example, a period when the current operation information from the operation unit 25 does not indicate that the operation is in progress.

  For example, when the current evaluation value (second evaluation value) is equal to or lower than the past evaluation value (first evaluation value), the determination result can represent the first zone (second threshold value). Otherwise, the determination result can represent the second zone (first threshold). The current evaluation value (second evaluation value) when the current operation unit 25 does not indicate that the operation is being performed is the past evaluation value (first evaluation value) when the past operation unit 25 indicates that the operation is being performed. In the case of the following, the imaging apparatus 100 can predict or estimate that the current motion information (movement of the imaging apparatus 100) is an unnecessary zoom operation that does not match the photographer's intention.

  In the example of FIG. 2, the second detection unit 44 uses, for example, the rate of change of the distance between the photographer and the imaging device 100 (imaging magnification information in a broad sense) as the motion information (movement of the imaging device 100). Can be detected. When the second detection unit 44 uses a motion sensor as shown in FIG. 1 by modifying the example of FIG. 2, for example, as the motion information (movement of the imaging device 100), for example, the acceleration (in a narrow sense) of the imaging device 100. Can detect the acceleration in the direction of the optical axis). The second detection unit can convert the current acceleration into a current evaluation value (second evaluation value).

2. Specific example 2.1. Configuration FIG. 4 shows a specific configuration example of the imaging apparatus of the present embodiment, and can also be called a specific example or a modification of the imaging apparatus 100 of FIG. Note that the configuration of the imaging apparatus 100 is not limited to that in FIG. 4, and various modifications may be made such as omitting some components of the imaging apparatus 100 in FIG. 4 or adding other components. Is possible. In the example of FIG. 4, the imaging apparatus 100 includes an optical element 11 and an imaging element 13 (for example, a CCD or a CMOS image sensor) as the imaging unit 10. The imaging apparatus 100 can include an image processing unit 30 that processes image information (first image information) from the imaging element 13. The optical element 11 forms a subject image on the imaging surface of the imaging element 13. In the example of FIG. 4, the image sensor 13 has processing blocks such as CDS (Correlated Double Sampling) and A / D conversion, and can output a digital image signal (image information in a broad sense).

  The optical element 11 includes, for example, three lenses 11a, 11b, 11d, and a diaphragm mechanism 11c. In the example of FIG. 4, the lens 11b is a zoom lens capable of changing the focal length, and the lens 11d is a focus lens. The optical element 11 can be housed in a lens barrel (not shown).

  In the example of FIG. 4, the imaging apparatus 100 can include an optical zoom control unit 17 that controls driving of the lens 11 b (zoom lens) as the control unit 20. Further, the imaging device 10 (the control unit 20 in a narrow sense) can include an AE (Automatic Exposure) control unit 19 that controls driving of the diaphragm mechanism 11c. Furthermore, the imaging apparatus 100 can include an AF (Automatic Focus) control unit 21 that controls driving of the lens 11d (focus lens). Note that the AE control unit 19 may be a control unit that manually controls the driving of the aperture mechanism 11c by a photographer's own operation. Further, the AF control unit 21 may be a control unit that manually controls the driving of the lens 11d by an operation of the photographer himself. In addition, the imaging apparatus 100 can include an imaging element driving unit 23 that drives the imaging element 13.

  The optical zoom control unit 17 can include an electromechanical mechanism for transporting the lens 11b in the optical axis direction. The AE control unit 19 can include an electromechanical mechanism for moving the aperture mechanism 11c in a direction perpendicular to the optical axis direction. The AF control unit 21 can include an electromechanical mechanism for moving the lens 11d in a direction perpendicular to the optical axis direction. The optical zoom control unit 17, the AE control unit 19, and the AF control unit 21 can control the positions of the lens 11 b, the lens 11 d, and the aperture mechanism 11 c in accordance with, for example, a command from the processing unit 40.

  In the example of FIG. 4, the imaging apparatus 100 can include a buffer memory 57 (work area) that temporarily stores image data (image information) for the image processing unit 30. Further, the imaging apparatus 100 can display through image information (moving image) that continuously represents image information acquired through the imaging element 13 or captured image information that represents one piece of image information acquired through the imaging element 13 ( A display control unit 39 for displaying a still image on the display unit 29 can be included.

  The display unit 29 can be realized by, for example, a liquid crystal display, a display using a light emitting element such as an organic EL, an electrophoretic display, or the like. The display unit 29 may be configured by a touch panel display (touch screen) and may have all or part of the functions of the operation unit 25.

  In the example of FIG. 4, the imaging apparatus 100 can include a shutter button 25a, a zoom lever 25b, and a mode selection unit 25c as the operation unit 25. For example, the mode selection unit 25c can set the first mode in which the imaging magnification is determined only by the operation amount of the zoom lever 25b. For example, the mode selection unit 25c can set the second mode in which the imaging magnification is determined only by the movement amount of the imaging device 100. Furthermore, the mode selection unit 25c can set, for example, a third mode in which the zoom lever 25b is given priority over the second imaging unit 49. The operation unit 25 may include a switch, a button, a lever, or the like that realizes a function (not shown) that enables various operations.

  In the example of FIG. 4, the imaging apparatus 100 can include a preprocessing unit 31, a resolution adjustment unit 33, a pixel number conversion unit 35, and an image compression unit 37 as the image processing unit 30. In addition, the imaging apparatus 100 can include a memory interface 43 and a processing unit 40. The image processing unit 30 and the processing unit 40 can be configured by an IC such as an ASIC or a DSP. The specific configuration of the processing unit 40 is shown in, for example, FIG. 1 and the like, and functions not shown in FIG. 1 and the like (for example, instructions to the control unit 20 and the like) can be realized.

  The preprocessing unit 31 receives digital image signals (image data and image information) from the image sensor 13 and can perform preprocessing such as white balance correction, gamma correction, and scratch correction. The resolution adjustment unit 33 can perform processing for converting the RGB signal in the pre-processed image information into a YC signal, and can perform processing for adjusting the resolution such as aperture correction. The pixel number conversion unit 35 can perform signal processing for converting the number of pixels of the image signal. The pixel number conversion unit 35 can electronically enlarge or reduce the image information by performing interpolation or thinning between pixels, thereby realizing an electronic change in imaging magnification (electronic zoom function). it can.

  The image compression unit 37 can compress image information in accordance with, for example, the JPEG method. The image information is not limited to the JPEG method, and may be compressed according to another method such as TIFF. The image information compressed by the image compression unit 37 can be stored in the recording medium 55. The display control unit 39 controls image display on the liquid crystal display element. The range of the recording medium 55 includes memory, HDD (hard disk drive), and the like. The memory is, for example, a nonvolatile memory such as a flash memory, and can be configured by a RAM, a rewritable ROM, or the like. The recording medium 55 may be a portable recording medium that is detachable from the imaging apparatus 100, such as an SD card (registered trademark), a compact flash (registered trademark), or the like.

  Note that the image processing unit 30 may use the recording medium 55 as a work area, and may use the storage unit 50 such as the buffer memory 57 and the recording medium 55 as a work area such as the processing unit 40. The recording medium 55 is a medium that can be read by a computer (the image processing unit 30 and the processing unit 40 in a narrow sense), and the storage unit 50 such as the recording medium 55 can store programs and data, and can be rewritten. An optical disc (CD, DVD) may be used. The image processing unit 30 and the processing unit 40 (the imaging device 100 in a broad sense) may perform various processes based on a program (data) stored in the storage unit 50 such as the recording medium 55. That is, the recording medium 55 stores a program for causing a computer (for example, an apparatus including the image processing unit 30, the processing unit 40, and the storage unit 50) to function (a program for causing the computer to execute processing of each unit). Also good.

  In the example of FIG. 4, the preprocessing unit 31, the resolution adjustment unit 33, the pixel number conversion unit 35, the image compression unit 37, and the display control unit 39 access the buffer memory 57 via the memory interface 43, and before each process. Data reading and data writing after each process can be performed as appropriate. The processing unit 40 can control the preprocessing unit 31, the resolution adjustment unit 33, the pixel number conversion unit 35, the image compression unit 37, and the display control unit 39, and can instruct image signal processing and the like. Further, the processing unit 40 can control the operation of the optical system by supervising the control of the optical zoom control unit 17, the AE control unit 19, and the AF control unit 21. The processing unit 40 can manage the control of the image sensor driving unit 23 and execute control such as all pixel readout or thinning readout of the output signal (image information) of the image sensor 13.

  In the example of FIG. 4, the imaging device 100 can include a motion sensor 47. The motion sensor 47 can be composed of an acceleration sensor, for example, and can output acceleration data. The processing unit 40 (for example, the first detection unit 41 in FIG. 1) receives this data, calculates the moving direction and moving amount of the imaging device 100, and detects the distance between the photographer and the imaging device 100 ( Conversion).

  The motion sensor 47 may be a combination of an acceleration sensor and a gyro sensor. The motion sensor 47 includes an acceleration sensor, a gyro sensor, a geomagnetic sensor, a pressure sensor (for example, an atmospheric pressure sensor, a water pressure sensor, etc.), an active sensor (for example, an infrared range sensor, an ultrasonic range sensor, etc.) and a position detection sensor (for example). For example, it may be at least one of GPS, a mobile phone network, a wireless network sensor such as RFID). The motion sensor 47 may be attached to the photographer's wrist or the like.

  In order to detect the distance between the photographer and the imaging device 100, the imaging device 100 may include a second imaging unit 49 as shown in FIG. The second imaging device 49 can acquire image information (second image information) representing a photographer (for example, a face). The processing unit 40 (for example, the first detection unit 41 in FIG. 1) performs, for example, face detection using the second image information representing the photographer, and determines between the photographer and the imaging apparatus 100 based on the size of the face. The distance between them can be detected (converted).

  In addition, although description of the detailed structure of the 2nd imaging part 49 is abbreviate | omitted, the structure which is the same as that of all or one part of the imaging part 10 and the image process part 30, or similar can be provided. In addition, the imaging device 100 or the second imaging unit 49 may have a configuration that is the same as or similar to the configuration of all or part of the control unit 20.

  In the example of FIG. 4, when the imaging apparatus 100 is moved in the front-rear direction (optical axis direction), the acceleration of the imaging apparatus 100 changes. Accordingly, the distance between the photographer and the imaging device 100 changes, and the processing unit 40 (for example, the determination unit 48 in FIG. 1) sets the imaging magnification based on the distance between the photographer and the imaging device 100. You may decide. The imaging magnification change (zoom operation) can be realized using at least one of the optical zoom control unit 17 and the pixel number conversion unit 35. However, if the processing unit 40 (for example, the determination unit 48 in FIG. 1) only determines the imaging magnification according to the distance between the photographer and the imaging device 100, it is possible to accurately follow the photographer's intuitive intention. difficult. Therefore, in the example of FIG. 4, the imaging apparatus 100 performs, for example, the function of the operation unit 25 of FIG. 1 or the functions of the second detection unit 44 and the determination unit 46 of FIG. To do. Thereby, it is possible to realize a zoom operation in accordance with the photographer's intention.

  In the example of FIG. 4, the processing unit 40 (for example, the second detection unit 44 of FIG. 2) can detect motion information. When the imaging apparatus 100 includes an acceleration sensor as the motion sensor 47, for example, acceleration can be adopted as the motion information.

  FIG. 5 shows a schematic configuration example of the processing unit 40 of FIG. The processing unit 40 illustrated in FIG. 5 can perform various processes, and FIG. 5 illustrates a schematic configuration example that realizes a representative process. Further, the same components as those in the above-described configuration example are denoted by the same reference numerals, description of coincident points is omitted, and differences will be described below. In the example of FIG. 5, the processing unit 40 (the imaging device 100 in a broad sense) detects the amount of operation (shooting magnification information in a broad sense) of the operation unit 25 (for example, the zoom lever 25 b in FIG. 4). Part 51 is included. The determination unit 48 can determine the imaging magnification based on the operation amount of the zoom lever 25b. The determination unit 48 can ignore the operation amount of the zoom lever 25b and determine the imaging magnification based on the sensor information from the motion sensor 47 (imaging magnification information in a broad sense). Furthermore, the determination unit 48 can prioritize the change of the imaging magnification (zoom operation) by the zoom lever 25b. Note that the second detection unit 44 and the determination unit 46 can use operation information (for example, presence or absence of operation) of the operation unit 25 (for example, the shutter button (release button) 25a in FIG. 4).

2.2. Operation FIG. 6 and FIG. 7 are flowcharts for explaining an operation example of the imaging apparatus 100 of FIG. Each figure represents a part of a flowchart. Hereinafter, the change of the imaging magnification (zoom operation) will be described.

  For example, when the imaging apparatus 100 is powered on, the imaging apparatus 100 (for example, the processing unit 40) sets an initial value of the imaging magnification (Step S101). The initial value can be set to the maximum wide angle value of the imaging unit 10, for example. The initial value may be set to a value set in advance by the photographer. The initial value can be stored in the storage unit 50, for example. In addition, after the imaging apparatus 100 is powered on, the imaging apparatus 100 can perform a learning operation as described later with reference to FIG. Alternatively, when the power supply of the imaging apparatus 100 is turned on, settings based on a learning operation performed in the past can be read, and step S103 and the like can be performed.

  In the example of FIG. 6, the processing unit 40 (for example, the third detection unit 51 of FIG. 5) detects whether or not the photographer is operating the zoom lever 25b. If the operation signal from the zoom lever 25b satisfies the first reference, the angle of view can be adjusted, for example, to the telephoto side so as to increase the imaging magnification. Also, if the operation signal from the zoom lever 25b satisfies the second reference, the angle of view can be adjusted to, for example, the wide angle (Wide) side so as to reduce the imaging magnification.

  When the photographer is operating the zoom lever 25b, the processing unit 40 (for example, the third detection unit 51 in FIG. 5) detects the operation amount from the zoom lever 25b, and the processing unit 40 (for example, FIG. 5). The determining unit 48) determines (calculates) an imaging magnification based on the detected operation amount (imaging magnification information) (step S301).

  In the example of step S <b> 301 in FIG. 6, the change amount of the imaging magnification is calculated as a method for determining the imaging magnification. The amount of change in the imaging magnification can be determined relatively, and the imaging magnification is determined (changed) based on the set magnification (for example, the maximum wide angle value set as the initial value). Can do. As a method for determining the imaging magnification, a target value for the imaging magnification may be calculated. As the target value of the imaging magnification, the imaging magnification may be determined absolutely, or the imaging magnification may be determined (changed) according to the operation position from the zoom lever 25b.

  In the example of step S303 in FIG. 6, the processing unit 40 (for example, the determination unit 48 in FIG. 5) executes zoom processing according to the calculated change amount of the imaging magnification (determined imaging magnification in a broad sense). Specifically, the determination unit 48 determines the imaging magnification at least one of an optical magnification and an electronic magnification. The determination unit 48 can instruct the control unit 20 in FIG. 5 (in a narrow sense, the optical zoom control unit 17 in FIG. 4) to change the optical magnification. Further, for example, it is possible to instruct the image processing unit 30 in FIG. 5 (in a narrow sense, the pixel number conversion unit 35 in FIG. 4) to change the electronic magnification.

  In the example of step S305 in FIG. 6, the processing unit 40 (for example, the third detection unit 51 in FIG. 3) detects whether or not the photographer is operating the zoom lever 25b. For example, while the zoom lever 25b is continuously set to the telephoto (Tele) side, the processing unit 40 controls at least one of the control unit 20 and the image processing unit 30 so as to continuously increase the imaging magnification (step S301). -Step S305).

  In the example of step S209 in FIG. 6, the processing unit 40 (for example, the first detection unit 41 and the second detection unit 44 in FIG. 5) receives acceleration data from the motion sensor 47 (in the narrow sense, the imaging device 100 or Acceleration data in the optical axis direction of the imaging unit 10) is detected. Furthermore, in the example of step S210 in FIG. 6, the processing unit 40 (for example, the first detection unit 41 in FIG. 5) moves the imaging device 100 based on the acceleration data from the motion sensor 47 (the photographer and the imaging device). 100). The first detection unit 41 may use the detection result (acceleration data) of the second detection unit 44 and the acceleration data from the second detection unit 44.

  In the example of step S401 in FIG. 7, the processing unit 40 (for example, the second detection unit 44 and the determination unit 46 in FIG. 5) detects whether or not the photographer is operating the shutter button 25a. For example, when the shutter button 25a is pressed, the operation information from the shutter button 25a can indicate that the operation is in progress. At other times, the operation information from the shutter button 25a can not indicate that the operation is in progress.

  Note that step S210 in FIG. 6 and step S401 in FIG. 7 can be performed in parallel. That is, in the example of step S209 in FIG. 6, the processing unit 40 (for example, the second detection unit 44 in FIG. 5) detects the acceleration data, and in the example of step S401, the processing unit 40 (for example, FIG. 5). The second detection unit 44 and the determination unit 46) can determine whether or not the operation information from the shutter button 25a indicates that the operation is in progress. In the example of step S209 in FIG. 6, the second detection unit 44 can store the history of acceleration data in, for example, the memory 59 (the work area of the processing unit 40 in a narrow sense and the storage unit 50 in a broad sense). When storing the acceleration data, for example, the acceleration data can be associated with the time when the acceleration data was acquired and the presence / absence of the operation of the shutter button 25a.

  In the example of step S402 in FIG. 7, when the operation information from the shutter button 25a indicates that the operation is in progress, the processing unit 40 (for example, the determination unit 48 in FIG. 5) sets the threshold value T to the maximum threshold value (in a broad sense, the first value). 2 threshold T2). In the example of step S403 in FIG. 7, when the operation information from the shutter button 25a does not indicate that the operation is in progress, the history of acceleration data is evaluated, and the determination unit 46 determines that the acceleration data (movement information in a broad sense) is the first. It is determined which zone of the second zone and the second zone belongs. The zone determination here will be described later.

  In the example of step S402 in FIG. 7, when the operation information from the shutter button 25a does not indicate that the operation is being performed, and the determination result of the determination unit 46 indicates the first zone, the processing unit 40 (for example, FIG. The determination unit 48) can set the threshold value T to the maximum value of the threshold value (second threshold value T2 in a broad sense). The threshold T is an index indicating permission or non-permission of change (determination) of the imaging magnification. As the threshold value T is larger, the imaging magnification is less likely to change.

  In the example of step S403 in FIG. 7, when the operation information from the shutter button 25a does not indicate that the operation is being performed, and the determination result of the determination unit 46 indicates the second zone, the processing unit 40 (for example, the determination in FIG. 5). The unit 48) can set the threshold value T to the minimum value of the threshold value (first threshold value T1 in a broad sense).

  The processing unit 40 (for example, the determination unit 48 in FIG. 5) considers the operation information from the shutter button 25a and the determination result of the determination unit 46 (movement of the imaging device 100 in a broad sense) in step S407, and in step S408, The moving distance of the imaging device 100 (the distance between the photographer and the imaging device 100) can be taken into consideration.

  In the example of step S407 in FIG. 7, the determination unit 48 determines that the change in the moving distance of the image capturing apparatus 100 (the distance between the photographer and the image capturing apparatus 100) is equal to or greater than the threshold T set in either step S402 or step S406. It is determined whether or not. The fluctuation of the moving distance of the imaging device 100 can be set, for example, as a difference between the moving distance of the imaging device 100 at the latest imaging time tn and the moving distance of the imaging device 100 at the previous imaging time tn. When the fluctuation of the moving distance of the imaging apparatus 100 is equal to or greater than the threshold value T, step S408 and step S409 are performed.

  In the example of step S <b> 408 of FIG. 7, the determination unit 48 calculates the change amount of the imaging magnification from the moving distance of the imaging device 100. Next, in step S409, the determination unit 48 performs zoom processing as in step S303. Note that the acceleration of the imaging device 100 can be converted into a moving distance of the imaging device 100 (or a distance between the photographer and the imaging device 100) by a known technique. When the power of the imaging apparatus 100 is turned off in step S130 or the zoom operation function is turned off by the operation unit 25, the zoom operation can be terminated.

  FIG. 8A and FIG. 8B show an evaluation example of acceleration history. FIG. 8A shows a period (first period) when past operation information from the shutter button 25a (operation section in a broad sense) indicates that the operation is in progress. FIG. 8B shows a period (second period) when the current operation information from the shutter button 25a does not indicate that the operation is in progress.

  The example in FIG. 8A shows a history of past acceleration during the learning operation, and a past evaluation value can be calculated based on this history. Step S401 in FIG. 7 determines the current operation of the shutter button 25a, but it is assumed that the shutter button 25a was previously pressed at the imaging time tn_on before performing step S401 in FIG. Immediately before the shutter button 25 is pressed at the imaging time tn_on (in the example of FIG. 8A, the photographer intentionally takes the first period τ_off including, for example, 10 samples from the past imaging times t1_off to tn-1_off). In many cases, the imaging apparatus 100 is stationary.

  The processing unit 40 (for example, the second detection unit 44) obtains a first evaluation value based on the past acceleration history in the first period τ_off, and in the example of step S403 in FIG. The first evaluation value can be used.

  The example of FIG. 8B shows a history of current acceleration, and a current evaluation value (second evaluation value) can be calculated based on this history. When the current shutter button 25a is not pressed at the latest imaging time tn when step S401 in FIG. 7 is performed, the processing unit 40 (for example, the second detection unit 44) performs the second period (FIG. 8). In the example of (B), the second evaluation value based on the current acceleration history in the current imaging time t2 to tn, for example, the period τ including 10 samples) is obtained, and in the example of step S403 in FIG. The determination unit 46 can use the second evaluation value. When the current evaluation value (second evaluation value) is equal to or lower than the past evaluation value (first evaluation value), the determination result of the determination unit 46 represents the first zone (step S402). When the current evaluation value (second evaluation value) is larger than the past evaluation value (first evaluation value), the determination result of the determination unit 46 represents the second zone (step S406).

  As the first evaluation value, a history of acceleration (movement information in a broad sense) in the first period τ_off is adopted, and for example, past imaging times t1_off to tn-1_off as shown in FIG. The variance value of the acceleration of 10 samples can be calculated. As the second evaluation value, the acceleration history in the second period τ is adopted, and the acceleration dispersion values of, for example, 10 samples at the current imaging times t2 to tn as shown in FIG. Can be calculated.

  As the first evaluation value, for example, the past acceleration of 100 samples may be subjected to frequency analysis (fast Fourier transform), and the average value of the frequency spectrum values may be calculated. Similarly, as the second evaluation value, for example, the current acceleration of 100 samples may be subjected to frequency analysis (fast Fourier transform), and the average value of the frequency spectrum values may be calculated. When calculating the first evaluation value and the second evaluation value, frequency analysis can be performed for a region of 10 [Hz] or less that is involved in intentional operation.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term described at least once together with a different term having a broader meaning or the same meaning in the specification or the drawings can be replaced with the different term in any part of the specification or the drawings. Further, the configuration and operation of imaging are not limited to those described in the present embodiment, and various modifications can be made.

10 imaging unit (first imaging unit), 11 optical element, 11a, 11b, 11d lens,
11c Aperture mechanism, 13 imaging device, 17 optical zoom control unit, 19 AE control unit,
20 control unit, 21 AF control unit, 23 image sensor driving unit, 25 operation unit,
25a shutter button (release button), 25b zoom lever, 25c mode selection unit,
29 display unit, 30 image processing unit, 31 pre-processing unit, 33 resolution adjustment unit,
35 pixel number conversion unit, 37 image compression unit, 39 display control unit, 40 processing unit,
41 first detection unit, 43 memory interface, 44 second detection unit,
46 determination unit, 48 determination unit, 49 second imaging unit, 50 storage unit,
51 third detection unit, 55 recording medium, 57 buffer memory, 59 memory,
100 Imaging device

Claims (7)

An imaging unit for imaging a subject and acquiring first image information;
A first detector for detecting photographing magnification information based on at least one of second image information representing a photographer and sensor information from a motion sensor;
A determination unit that determines an imaging magnification based on the imaging magnification information;
Including
When the operation information from the operation unit indicates that the operation is being performed, the determination unit executes the determination of the imaging magnification when a change in the imaging magnification information exceeds a second threshold,
When the operation information from the operation unit does not indicate that the operation is being performed, the determination unit performs determination of the imaging magnification when the variation of the imaging magnification information exceeds a first threshold,
The image pickup apparatus, wherein the second threshold value is larger than the first threshold value. In claim 1,
A second detector for detecting motion information representing the motion of the imaging device;
A determination unit for determining which of the first zone and the second zone the movement information belongs to;
Further including
When the determination result of the determination unit represents the first zone, the determination unit executes the determination of the imaging magnification when the variation of the imaging magnification information exceeds the second threshold,
When the determination result of the determination unit represents the second zone, the determination unit executes the determination of the imaging magnification when the variation of the imaging magnification information exceeds the first threshold. Imaging device. In claim 2,
The second detection unit obtains a first evaluation value based on the history of the motion information in the first period and a second evaluation value based on the history of the motion information in the second period,
The first period is a period when the past operation information from the operation unit represents an operation in progress,
The second period is a period when the current operation information from the operation unit does not indicate that an operation is in progress.
When the first evaluation value is equal to or less than the second evaluation value, the determination result represents the first zone. In claim 3,
At least one of the first evaluation value and the second evaluation value is a variance value of the motion information or an average value of frequency spectrum values of the motion information. In any of claims 2 to 4,
The second detection unit detects an acceleration of the imaging device as the motion information. In any one of Claims 1 thru | or 5,
The imaging apparatus is characterized in that the photographing magnification information is a distance between the photographer and the imaging apparatus. In any one of Claims 1 thru | or 6.
The image pickup apparatus, wherein the operation unit is a shutter button.

Images