JPH089237A - Image signal processor - Google Patents

Abstract

(57) [Abstract] [Purpose] To provide an image processing device capable of stable and optimum focus detection operation and photometric operation regardless of the shooting state. In a video camera which carries out a focus detection operation and a photometric operation by taking out an image signal corresponding to a predetermined area within a shooting screen, a set position of the predetermined area within the screen is detected by a line-of-sight detection means. If an error occurs in the line-of-sight detection, if the error is within a predetermined period, the predetermined area is held at the immediately preceding setting position, and if the error is a predetermined time or more, The focus detection operation and the photometric operation are performed by setting the predetermined area at the center of the screen.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image signal processing apparatus in which a predetermined area for extracting an image signal can be set within a screen.

[0002]

2. Description of the Related Art Conventionally, in the field of consumer image pickup equipment such as a video-integrated camera, various measures have been taken in order to obtain a higher quality image more easily. In recent years, standard auto focus (A
F) and automatic exposure adjustment (AE) are for the purpose of eliminating the trouble of adjusting the focus and the exposure each time the image is taken, and are just examples of functions that serve the purpose of easily obtaining a good image. It can be said that there is.

By the way, AF and AE are a mechanism for an imaging device such as a camera to "discriminately" determine a photographing situation and adjust a lens position and an aperture to a state suitable for the situation. It may occur that the shooting intention of is not reflected in the image.

For example, when a distant subject and a near subject coexist in the image pickup screen, the information of the entire image pickup screen is A.
When the F operation is executed, any one of the plurality of subjects will be in focus, but it is impossible for the imaging device to judge whether or not it is the main subject to be focused.

Similarly, when a main subject is photographed against a bright sky, if the AE operation is performed on the information of the entire screen, the aperture is adjusted according to the brightness of the sky, resulting in the main subject being blackened. become.

In order to avoid such a situation as much as possible,
It is common practice to focus and measure the distance to the object in the center of the image-pickup screen, and to perform AF and AE based on the results. This is when the photographer shoots
It is based on the fact that the main subject is often placed in the center of the screen. This method has a drawback in that when the main subject is placed in a place other than the center of the screen, the focus or exposure may not be adjusted appropriately with respect to the main subject.

On the other hand, the applicant of the present invention looks at the finder in Japanese Patent Application No. 4-154165 so that the optimum focus and exposure can be obtained regardless of where the main subject is in the image pickup screen. A photographer has proposed a photographing device that allows the photographer to select the main subject with his or her line of sight.

According to this photographing apparatus, it is possible to freely change the position of the main subject while moving and setting the distance measuring / photometric area by the line of sight.

[0009]

However, in the above-mentioned conventional visual axis position detecting distance measuring / photometric method, the visual axis cannot be detected due to, for example, the photographer looking away from the viewfinder or external noise. However, there is a drawback in that the line-of-sight position is unnecessarily detected, and the distance measurement / photometry is performed at an incorrect position that the photographer does not desire.

Further, when the line-of-sight detection fails due to external noise or the like, the photographer performs distance measurement and photometry at a position different from the viewpoint looking through the finder, which causes a problem that the photographer feels uncomfortable.

An object of the present invention is to solve the above problems,
An object of the present invention is to provide an image pickup device capable of stable and optimum distance measurement and photometry in all shooting conditions.

[0012]

In order to solve the above-mentioned problems, according to the invention described in claim 1 of the present application, gate means (embodiment) for taking out an image signal corresponding to a predetermined area in the screen. In the example, the gate circuit 261 in the AF evaluation value processing circuit 26, the gate circuit 25 in the aperture control circuit 25,
1)) and an instructing unit (corresponding to the line-of-sight detection block 1 in the embodiment) for inputting position setting information for instructing the setting position of the predetermined area in the screen.
Position setting means for controlling the gate means based on the output of the instructing means to control the position of the predetermined area within the screen (frame generating circuit 27, microcomputer 2 in the embodiment).
9)), and when an error occurs in the position setting operation of the predetermined area by the instruction means, the control means (in the embodiment, the frame generation circuit 27, which holds the predetermined area in a state immediately before the error occurs). (Corresponding to the microcomputer 29).

Therefore, even if the error is caused by the instructing means, the operation state is not immediately changed, and if it is an error for a short time, it is based on the fact that the last position setting information issued last is correct. Moreover, the state of the gate means is maintained and the system is stabilized.

According to the invention of claim 2 of the present application, the image pickup means (corresponding to the image pickup device 19 in the embodiment) is further provided, and the gate means outputs the image signal output from the image pickup means. Since the image signal corresponding to the predetermined area in the image pickup screen of the image pickup means is extracted, the image signal extraction area setting operation is erroneous because the image of the subject that changes momentarily is taken. In an environment in which the error is likely to occur, the state immediately before the short-time error is maintained and the state of the device does not change, so that the operability is improved.

According to the invention of claim 3 of the present application, a monitor for monitoring the image pickup screen (corresponding to the electronic viewfinder 24 in the embodiment) is further provided, and the instruction means is operated within the monitor screen. A line-of-sight detection unit (corresponding to the line-of-sight detection block 1 in the embodiment) for detecting the line-of-sight position of the person, and the position setting unit sets the predetermined area at the line-of-sight position detected by the line-of-sight detection unit. Since it is configured, it does not respond to short-time errors when using a line-of-sight detection means that inevitably causes many errors due to variations in the point of gaze itself, blinking, etc., so malfunctions can be prevented and device stabilization is promoted. To be done.

According to the invention of claim 4 of the present application, since the indicating means is constituted by a manual input device such as a joystick or a mouse, the degree of freedom in manual setting and the stability against manual error occurrence are improved. Can be compatible.

According to the invention of claim 5 of the present application, since the monitor is composed of the electronic viewfinder, the setting operation of the image capturing area can be performed while photographing.

According to the invention of claim 6 of the present application, the image pickup state is further detected from the image signal in the predetermined region extracted by the gate means, and the image pickup state is detected based on the detection result. Adjusting means (in the embodiment, the aperture control circuit 25, the IG driver 16, the IG meter 1)
5, AF evaluation value processing circuit 26, driver 18, motor 1
(Corresponding to 7), it is possible to select the adjustment area of the imaging state while shooting, and if the error occurs, if the error is acceptable for a short time, interrupt the imaging operation. The imaging operation can be continued without doing so.

According to the invention of claim 7 of the present application, the adjusting means detects the focus signal which changes according to the focus state from the image signals in the predetermined area extracted by the gate means. However, since the focus adjusting means (corresponding to the AF evaluation value processing circuit 26, the driver 18, and the motor 17 in the embodiment) for adjusting the focus state according to the focus signal is used, any object can be taken while performing the photographing operation. It is possible to focus on it, and it is possible to prevent a focus adjustment error due to an error.

According to the invention of claim 8 of the present application,
The adjusting means detects an exposure state from an image signal in the predetermined area extracted by the gate means, and adjusts the exposure state according to the exposure state (an aperture control circuit in the embodiment). 25, which corresponds to the IG driver 16), an optimum exposure state can be obtained for an arbitrary subject while performing a shooting operation, and an exposure control error due to an error can be prevented.

According to the invention of claim 9 of the present application, gate means for extracting an image signal corresponding to a predetermined area in the screen (in the embodiment, the gate circuit 261 in the AF evaluation value processing circuit 26, the aperture control circuit) 25), an instruction means for inputting position setting information for instructing the setting position of the predetermined area in the screen (corresponding to the eye-gaze detecting block 1 in the embodiment), The position setting means (corresponding to the frame generation circuit 27 and the microcomputer 29 in the embodiment) that controls the gate means based on the output of the instruction means to control the position of the predetermined area in the screen, and the instruction means. When an error occurs in the position setting operation of the predetermined area for a predetermined time or more, the predetermined area is set to a predetermined position in the screen regardless of the setting of the instruction unit. Control means (Examples The window generator 27 corresponds to the equivalent to the microcomputer 29) moving control to the use of configurations with.

Thus, when an error occurs in the image capturing area setting operation for a long time, the image capturing operation can be stabilized by forcibly fixing the predetermined area at the predetermined position.

According to the invention of claim 10 of the present application,
While making the predetermined position the central part in the screen,
Since the predetermined area is enlarged when moved to the center of the screen, it is generally the case that the main subject is usually placed in the center of the screen when an error occurs in the image capture area setting operation for a long time. As a result, the probability of capturing the main subject is increased by forcibly moving and enlarging the predetermined area in the center of the screen, and the optimum image capturing operation can be stabilized in any shooting condition.

According to the invention of claim 11 of the present application,
Further, the image pickup means (corresponding to the image pickup device 19 in the embodiment) is provided, and the gate means corresponds to the predetermined area in the image pickup screen of the image pickup means in the image signal output from the image pickup means. Since it is configured to extract the image signal, in order to capture an image of a subject that changes moment by moment, in an environment in which an error is likely to occur in the setting operation of the image signal extraction region, stabilization of the device when an error occurs,
The operability can be improved.

According to the invention of claim 12 of the present application,
Furthermore, a monitor (corresponding to the electronic viewfinder 24 in the embodiment) for monitoring the imaging screen is provided, and the instructing means is a sight line detecting means for detecting a sight line position of the operator in the monitor screen, and the position setting is performed. Since the means is configured to set the predetermined area at the line-of-sight position detected by the line-of-sight detection unit, the line-of-sight detection unit that inevitably causes many errors due to variations in the gazing point itself, blinking, etc. is used. In some cases, when an error occurs for a long time, or in an emergency such as when the photographer is looking away, unnecessary movement of the image capture area can be prohibited to stabilize the set position, and the device malfunctions. Can be prevented.

According to the invention of claim 13 of the present application,
Further, adjusting means for detecting the image pickup state from the image signal in the predetermined area extracted by the gate means and adjusting the image pickup state based on the detection result (in the embodiment, the aperture control circuit 25, the IG driver). 16, the IG meter 15, the AF evaluation value processing circuit 26, the driver 18, and the motor 17) are provided, so that it is possible to select the adjustment region of the imaging state while taking an image, and an error occurs. Even in this case, the image pickup operation can be stably continued without interrupting the image pickup operation.

According to the invention of claim 14 of the present application,
The focus adjusting means detects the focus signal that changes according to the focus state from the image signals in the predetermined area extracted by the gate means, and adjusts the focus state according to the focus signal. Since (corresponding to the AF evaluation value processing circuit 26, the driver 18, and the motor 17 in the embodiment), it is possible to focus on an arbitrary subject while performing a shooting operation, and prevent a focus adjustment error due to an error. it can.

According to the invention of claim 15 of the present application,
The adjusting means detects an exposure state from an image signal in the predetermined area extracted by the gate means, and adjusts the exposure state according to the exposure state (an aperture control circuit in the embodiment). 25, IG driver 16,
Since it corresponds to the IG meter 15), it is possible to obtain an optimum exposure state for an arbitrary subject while performing a shooting operation, and prevent an exposure control error due to an error.

According to the invention of claim 16 of the present application,
Gate means for extracting an image signal corresponding to a predetermined area in the screen (corresponding to the gate circuit 261 in the AF evaluation value processing circuit 26 and the gate circuit 251 in the aperture control circuit 25 in the embodiment), and in the screen. Instructing means (corresponding to the eye gaze detection block 1 in the embodiment) for inputting position setting information for instructing the setting position of the predetermined area, and controlling the gate means based on the output of the instructing means to display the screen. A position setting means (corresponding to the frame generation circuit 27 and the microcomputer 29 in the embodiment) for controlling the position of the predetermined area in the inside, and the position setting operation of the predetermined area by the instruction means causes an error of less than a predetermined time. When
The predetermined area is held in a state immediately before the error occurs, and when the error for the predetermined time or more occurs, the predetermined area is forced to a predetermined position in the screen regardless of the setting of the instruction unit. A configuration provided with moving control means (corresponding to the frame generation circuit 27 and the microcomputer 29 in the embodiment) is used.

Thus, even if the error is caused by the instructing means, the operation state is not immediately changed, and if the error is for a short time, it is based on the fact that the last position setting information issued last is correct. Moreover, the state of the gate means is maintained and the system is stabilized.

When an error occurs in the image capturing area setting operation for a long time, the image capturing operation can be stabilized by forcibly fixing the predetermined area at the predetermined position.

[0032]

Embodiments of the image processing apparatus according to the present invention will be described in detail below.

(First Embodiment) FIG. 1 is a block diagram showing the basic arrangement of the first embodiment of the present invention. In this embodiment, a case where the present invention is used for a video integrated camera will be described.

In the first embodiment, while the set position of the focus detection area is being moved, the AF operation is prohibited, and an erroneous AF operation is caused by focusing on an unintended subject image. To prevent.

In the figure, EYE is an eyeball of the operator excluding the finder of the video-integrated camera, and 1 is a line-of-sight detecting device block. Reference numeral 2 denotes an infrared light emitting diode (IRED) that irradiates infrared rays to the eyeball in order to detect the line-of-sight position of the operator's finder screen, 3 denotes a driver for driving the infrared light emitting diode, and 4 denotes infrared light reflected by the eyeball EYE. A light receiving sensor that receives infrared rays from the light emitting diode 2, for example, a CCD is used. Reference numeral 5 is an amplifier that amplifies the output signal of the light receiving sensor 4, and 6 is a visual axis detection circuit that analyzes the visual axis position of the eyeball EYE of the operator based on the output signal of the amplifier 5.

This line-of-sight detection apparatus irradiates the operator's eye with infrared rays from IRED2 and reflects the reflected light on the CCD.
3 is received, and the eye-gaze image is analyzed by the line-of-sight detection circuit 6 to detect the gazing point in the finder screen.

Further, in this embodiment, the visual axis detecting device is
It is unitized and placed in the finder of the video-integrated camera. Therefore, as a visual finder unit with a line-of-sight detection device, various controls can be performed by gazing at the image displayed on the finder screen.
It is highly versatile and can be widely applied in fields other than video cameras as a line-of-sight detection unit equipped with a display screen for displaying images used for control and selection and a line-of-sight detection device for detecting the point of gaze on the screen.

OB is a subject, 7 is a photographic lens optical system, and 8 is
Is a fixed first lens group, 9 is a variable power lens, 10 is a diaphragm,
Reference numeral 11 is a fixed third lens group, and 12 is a focus compensating lens which has a correction function for performing focus adjustment and also for correcting a focus plane movement at the time of zooming operation. With these, a photographing lens optical system is configured. There is.

Reference numeral 13 is a variable power lens motor for moving the variable power lens 9, 14 is a variable power lens driver for driving the variable power lens motor 9, 15 is an IG meter for driving the diaphragm 10 to control the aperture amount, 16 Is an IG driver for driving the IG meter, 17 is a focus compensating lens motor for moving the focus compensating lens, and 18 is a focus compensating lens driver for driving the focus compensating lens motor.

Reference numeral 19 is an image pickup device such as a CCD, 20 is an amplifier for amplifying the image pickup signal output from the image pickup device 19 to a predetermined level, 21 is a luminance signal and a color signal from the output signal of the amplifier 20, and A camera signal processing block for converting a television signal standardized by performing signal processing such as ranking processing, addition of a synchronization signal, and gamma correction, 22 is an amplifier, 23 is a television signal output from the amplifier 22 is a liquid crystal monitor LCD display circuit for driving and displaying an electronic viewfinder composed of
24 is an electronic viewfinder with a liquid crystal monitor. The electronic viewfinder 24 may be, for example, a CRT.

The television signal output from the camera signal processing block 21 is supplied to a video tape recorder (not shown) and recorded on a magnetic tape or the like. The LCD display circuit 2 displays the image information reproduced by the VTR.
3 to supply electronic viewfinder 24
Can be played at.

Reference numeral 25 denotes a frame generation circuit 27, which will be described later, for the image pickup signal output from the image pickup device 19 through the amplifier 20.
Has a gate circuit for sampling an image pickup signal corresponding to a predetermined photometric area set in the screen based on the command of 1. and the IG driver 16 so that the luminance level of the video signal in the photometric area becomes constant. It is an aperture control circuit for controlling and driving the IG meter 15 and adjusting the aperture amount of the aperture 10 to appropriately maintain the imaging light amount.

In the aperture control circuit 25, a gate circuit for sampling an image pickup signal corresponding to the photometric area, an integrating circuit for obtaining an average value of the brightness level of the image pickup signal in the photometric area, and the like. include. For aperture control, if only the image pickup signal in the photometry area is used, partial or spot photometry will be performed, and the method of increasing the weighting of the signal in the photometry area and reducing the weight of areas other than the photometry area and averaging Center-weighted metering. Furthermore, if a plurality of photometric areas are set on the screen and a plurality of weights are applied to each, so-called multi-division photometry is performed.

Reference numeral 26 is an AF evaluation value processing circuit for generating a focus evaluation signal such as a high frequency component whose level changes in accordance with the focus state from the image pickup signal output from the image pickup device 19 via the amplifier 20. Is. In the AF evaluation value processing circuit 26, a bandpass filter for extracting the high frequency component in the image pickup signal, a predetermined area used for focus detection set in the screen based on a command of a frame generation circuit described later, that is, a focus. A gate circuit is provided which passes only the image pickup signal corresponding to the detection area (distance measurement area) and performs sampling.

Reference numeral 27 denotes a frame for generating a gate signal for controlling the opening / closing timing of the gate circuits provided in the AF evaluation value processing circuit 26 and the aperture control circuit 25 for setting the focus detection area and the photometric area, respectively. By controlling the opening and closing timing of each of the gate circuits in the generation circuit,
It is possible to freely set the position and size of the capture area when capturing the image information of the imaging screen.

Further, the frame generation circuit 27 outputs an area display signal to the LCD display circuit 23 in order to display the focus detection area and the photometric area in the window, so that the video signal from the amplifier 22 is focused. Display signals of the detection area and the photometry area can be superimposed and displayed on the screen of the electronic viewfinder 24.

28 is arranged between the frame generation circuit 27 and the LCD display circuit 23, and is ON / OFF controlled by a command from a microcomputer 29 described later, and the focus detection area and photometry output from the frame generation circuit 27. This is a switch for turning on / off the display of a video signal capturing area such as an area. The switch 28 is turned on when the line-of-sight detection operation is being performed by the microcomputer 29, and functions to display the capture area or the gazing point.

Reference numeral 29 controls the focus compensating lens based on the output signal of the AF evaluation value processing circuit 26 and the driving of the zoom lens 9 to perform focusing and focus correction at the time of zooming. It is a control microcomputer (hereinafter referred to as a microcomputer) that controls the frame generation circuit 27 to change the positions of the focus detection area and the photometric area in the screen based on the above.

The microcomputer 29 controls the line-of-sight detection circuit 6 and receives information on the line-of-sight position of the operator from the line-of-sight detection circuit 6 to move the focus detection area and the photometric area,
Control using other line-of-sight detection is performed.

Further, the microcomputer 29 judges whether or not the visual axis detection is normally performed based on the visual axis detection error information output from the visual axis detection circuit 6, and when the gazing point of the photographer can be normally detected. The frame generation circuit 27 is controlled according to the position coordinate information of the gazing point in the screen detected by the line-of-sight detection circuit 6.

If it is confirmed from the line-of-sight detection error information output from the line-of-sight detection circuit 6, if the error is within a predetermined time, the current position of the gazing point on the screen. Information is held, and if there is an error for a predetermined time or more, a frame generation instruction is output to the frame generation circuit 27 to set a capture area having a size corresponding to each mode in the center.

The frame generation circuit 27 supplies the display frame pattern to the LCD display circuit 23 via the switch 28 according to the instruction of the microcomputer 29, and superimposes it on the video signal supplied from the amplifier 22 to make the electronic viewfinder 24. To display.

Reference numeral 30 is a sensor CC for detecting the line of sight.
It is a driver that drives D.

FIG. 2 is a detailed block diagram of the line-of-sight detection device block 1 of FIG. In the figure, blocks having the same functions as those in FIG. 1 will be described with the same numbers as in FIG.

The IRED driver 3 drives the IRED 2 in a predetermined cycle to emit light by a control signal from the visual axis detection circuit 6. Two IREDs are provided. IRED
The infrared light emitted from 2 is reflected by the eyeball EYE, and the reflected infrared light (eyeball image) reaches the dichroic mirror 102 which reflects only infrared light through the eyepiece lens 101 and transmits visible light. .

The reflected infrared light reflected by the dichroic mirror 202 and having its optical path changed is imaged on the image pickup surface of the CCD image sensor 4 as a line-of-sight detection sensor via the imaging lens 103. Reference numeral 30 denotes a drive circuit for driving the CCD, which is an image sensor, by the line-of-sight detection circuit 6 at a predetermined cycle to perform accumulation and reading.

The eyeball reflected light incident on the CCD 4 is converted into an electric signal and supplied to the visual axis detection circuit 6 via the amplifier 5. The eyeball EYE is looking at the display screen of the electronic viewfinder 24, and the image pickup screen of the CCD 4 and the screen of the electronic viewfinder 24 correspond to each other.
If the gazing point in the imaging screen of No. 4 is obtained, the gazing point in the display screen of the electronic viewfinder 24 can be sampled and detected at the predetermined cycle.

With the configuration of this line-of-sight detection block, the line-of-sight detection circuit 6 detects the line-of-sight position coordinates on the display screen of the electronic viewfinder from the output signal of the amplifier 5. The detected line-of-sight position coordinate information is stored in the microcomputer 2
9 is transmitted.

There are various methods for calculating the eye-gaze position coordinates based on the output of the eye-gaze CCD 4.
For example, Japanese Patent Application No. 3-218 filed by the present applicant
The method disclosed in Japanese Patent Application No. 574 and Japanese Patent Application No. 4-154165 can be used.

The video-integrated camera having the configuration shown in FIG.
As the AF method, a so-called television AF method (TV-
AF method), that is, a high-frequency component is taken out by a band pass filter in the AF evaluation value processing circuit 26 in the image pickup signal, and the microcomputer 29 drives the focus motor drive direction and drive to maximize the high-frequency component level. A focus adjustment method is used in which the speed is calculated, the focus competition lens motor 17 is driven via the focus competition lens driver 18, and the focus competition lens 12 is moved in the optical axis direction.

In this AF method, since the high frequency component included in the video signal is detected as described above, the video signal taken into the AF evaluation value processing circuit 26 must include an edge portion (level change portion). . That is, at least one horizontal scanning line video signal must be used,
Practically, a capture area having a predetermined area is required. This area is a focus detection area (distance measurement area).

FIG. 3 is a diagram showing the internal configuration of the AF evaluation value processing circuit 26, the aperture control circuit 25, the frame generation circuit 27 and their connection relationship. After the capture area, for example, the focus detection area is defined by the microcomputer 29, 3 shows a circuit configuration for performing a gate process for capturing a video signal. In the figure, the same components as those in FIG.

In FIG. 3, information about the size and position of the capture area is transmitted from the microcomputer 29 to the gate timing generation circuit 274 inside the frame generation circuit 27. Based on this information, the gate timing generation circuit 274 outputs a frame signal for displaying the capture area to a frame signal generation circuit 273, an AF gate pulse generation circuit 271 for generating a gate pulse corresponding to the focus detection area, and a photometric area. To the AE gate pulse generation circuit 272 which generates a gate pulse corresponding to the above.

On the other hand, the inside of the AF evaluation value processing circuit 26 is basically composed of a gate circuit 261, a bandpass filter 262 and a detection circuit 263, and the gate circuit 261 is an AF gate pulse generation circuit in the frame generation circuit 27. The image pickup signal is supplied from the amplifier 20 to the BPF 262 only while being closed by the output signal of 271, detected by the detection circuit 263 and converted into a DC level, and a focus voltage that is an evaluation value according to the focus state is output. It is supplied to the microcomputer 29.

The microcomputer 29 determines the driving direction and driving speed of the focus lens on the basis of the focus voltage which is the focus evaluation value, supplies the focus lens control signal to the focus competition driver 18, and The compensating lens motor 17 is driven to the focal point.

Regarding the zooming operation, a control signal is supplied to the zooming lens driver 14 according to the operation (telephoto, wide) of a zoom switch (not shown),
The zoom lens is driven in the optical axis direction to change the focal length.

The inside of the aperture control circuit 25 is basically composed of a gate circuit 251 for forming a photometric area and an iris controller 252. The gate circuit 251 outputs the output of the AE gate pulse generation circuit 272 in the frame generation circuit 27. The image pickup signal is amplified by the amplifier 20 only while the signal is closed.
Is supplied to the iris controller 252, detected, converted to a DC level, and an aperture control voltage is output.
It is supplied to the G driver 16 to drive the IG meter 15. Accordingly, the aperture amount of the diaphragm 10 is controlled so that the video signal level becomes constant.

Next, frame generation will be described with reference to FIGS.

FIG. 4 (a) shows the line-of-sight detection position by the output of the line-of-sight detection circuit 6 and the frame generation when the line-of-sight detection is normally performed or when the line-of-sight detection error occurs within a predetermined time. It is a figure explaining the relationship of the frame produced | generated by the circuit 27. FIG.

In the line-of-sight detection circuit 6, a line-of-sight detection error occurs when the gazing point of the photographer cannot be accurately detected. For example, when the photographer is looking away, blinking is frequently performed. There are various possible cases, such as the result that the gazing point cannot be detected, the eye-gaze detection screen and the photographer's eye move relative to each other, but if the error is short, temporary noise is generated. , Blinking, variations in the line of sight of the photographer, and others are considered to be transient, so it is highly probable that changing the shooting state significantly due to a short-time error will disturb the shooting state. .

On the other hand, if the error continues for a long time, it is assumed that the photographer is looking away from the screen or is not looking at the screen correctly. Therefore, the control based on the gaze detection result is reliable. There is no nature. Therefore, in the present invention, when the error continues for a long time, the control is switched to the control not using the line-of-sight detection.

In the figure, 401 is a finder screen corresponding to the photographing screen, OB is a subject image, and 405 is a gazing point. If the gazing point is normally detected without generating a line-of-sight detection error, a focus detection area / photometric area 402 having a predetermined size centered on the detected gazing point coordinates.
Is set.

When the gazing point 405 moves as shown by an arrow, the frame generation circuit 27 is instructed to generate and display the frame 403 such as the focus detection area / photometric area 402 at the moved position. .

If the line-of-sight detection error occurs within the predetermined period, the microcomputer 29 holds the position information of the gazing point 405 immediately before the error occurs, and according to the held position information. , Focus detection area /
The setting position and size of the photometric area 402 are set, and the frame display data is transmitted to the frame generation circuit 27.

FIG. 4B shows the microcomputer 2 when the line-of-sight detection circuit 6 has a line-of-sight detection error for a predetermined time or more.
9 shows a frame setting and a display state performed by 9.

When a line-of-sight detection circuit 6 generates a line-of-sight detection error and the line-of-sight detection error continues for a predetermined period or longer, the line-of-sight detection position information cannot be obtained. Therefore, as shown in FIG.
At the center of the screen, a focus detection area / photometric area 404 larger than that at the time of normal line-of-sight detection in FIG. The reason why the focus detection area / photometric area 404 is set larger than that in the normal state is that the line-of-sight information cannot be obtained accurately, so that the subject information is captured within the possible range within the screen and the normal AF, A
This is to enable the E operation.

FIG. 5A is a flow chart for explaining the frame generating operation in each of the above-mentioned situations performed by the microcomputer 29.

When the processing is started (step 501), the microcomputer 29 receives the visual axis detection error information from the visual axis detection circuit 6 (step 502) and determines whether or not the visual axis detection error has occurred (step 503).

If the result of the determination in step 503 is that the visual axis detection result is normal (not an error), the visual axis detection circuit 6
The position information of the gazing point detected by is read (step 506) and set as the gazing point 405, and the position and size are set according to the gazing point position information so as to generate the frame of the focus detection area / photometry area (step 506). 507), the frame generation circuit 2
The data of the set position and size of the focus detection area / photometry area in the screen is sent to 7 (step 505), and AF, A is generated based on the video signal in the focus detection area / photometry area.
The E operation is performed, and the focus detection area / photometry area is displayed.

When the position of the gazing point 405 moves on the screen, an instruction is given to newly generate a focus detection area / photometric area 403 centered on the moved position.

On the other hand, if it is determined in step 503 that a visual axis detection error has occurred (determination Ye
s) The process proceeds to step 512, and it is detected whether the line-of-sight detection error has continued for a predetermined time or longer.

When it is determined in step 512 that the line-of-sight detection error continues for a predetermined time (Yes), the process proceeds to step 504, and as shown in FIG. / Sets the photometric area at a predetermined fixed position 404 in the center of the screen, and sets it to be larger than that when the visual axis detection is normal.

Then, the information on the set position coordinates and size of the focus detection area / photometry area is supplied to the frame generation circuit 27, and the setting and display are performed (step 505). AF based on the video signal of
The AE operation is performed, and the focus detection area / photometry area is displayed.

In the determination of step 512, if the line-of-sight detection error does not continue for a predetermined time or more, the gazing point position coordinates immediately before the error occurs are held and the focus detection region / photometry region for the line-of-sight mode is set. The position coordinate is set to 405 and the size is set (step 51
3), the focus detection area in the screen /
Data of the set position and size of the photometric area is sent (step 505), AF and AE operations are performed based on the image signal in the focus detection area / photometry area, and the focus detection area / photometry area is displayed. Done.

FIG. 5B is a flowchart showing the autofocus operation.

First, when the processing is started in step 508, the focus evaluation value output from the AF evaluation value processing circuit 26 is read (step 509) and the size is compared with the focus evaluation value fetched last time (step 510).

As a result of the determination in step 510, if the current focus evaluation value is larger than the previous focus evaluation value, that is, the focus evaluation tends to increase, it is determined to be correct in the current movement direction of the focus compensating lens. , While returning to the moving direction at present, the process returns to step 508 to read the next focus evaluation value. That is, the mountain climbing AF operation is performed.

When the focus evaluation value this time is lower than the previous focus evaluation value in the determination of step 510 (No)
, The driving direction of the focus lens is reversed and changed to the opposite direction, and the hill climbing operation is similarly performed (step 1).
1).

With the above operation, the AF operation is performed so that the focus evaluation value becomes maximum based on the video signal in the set focus detection area / photometry area.

(Second Embodiment) Next, a second embodiment of the present invention will be described.

FIG. 6 is a diagram showing the configuration of the second embodiment of the present invention. This embodiment is an example in which the image information capturing area is determined by an external input means instead of the line-of-sight input.

The image information taking-in area detected by the image information taking-in area position setting device 32 is processed by the image information taking-in area detection setting circuit 31 and transmitted to the microcomputer 29.

Whether the microcomputer 29 uses, holds, or does not use the video information fetching area from the video information fetching area detection setting circuit 31 depending on the error information from the video information fetching area detection setting circuit 31 and its time. And sends the position / size information of the frame to the frame generation circuit 27,
The same control as in the first embodiment is performed below.

Further, the image information acquisition area position setting device 3
The numeral 2 may be, for example, a keyboard, a mouse, a trackball, or a joystick, which is generally used as an input device of a computer.

As described above, according to each of the above embodiments, the focus detection area and the photometric area can be set by the external position input such as the visual axis detection, and when an error occurs in the external position input, a predetermined time If the error is within the range, the last position where no error occurred is held, and if the error is longer than a predetermined time, the central fixed distance measurement / photometry system is switched to the wrong position that the photographer does not want. This has the effect of optimal distance measurement and photometry in all shooting conditions without performing distance measurement.

[0096]

As described above, according to the invention of claim 1 of the present application, even when an error is caused by the indicating means, if the error is in a short time without immediately changing the operation state, , The state of the gate means can be held and the system can be stabilized based on the fact that the position setting information immediately before last is correct.

Further, according to the invention of claim 2 of the present application, since an image of a subject which changes every moment is taken, in an environment in which an error is likely to occur even in the setting operation of the image signal extraction region,
As for the error for a short time, the state immediately before is held and the state of the apparatus does not change, so that the operability can be improved.

According to the invention of claim 3 of the present application, since the predetermined area is set at the line-of-sight position detected by the line-of-sight detecting means, it is inevitable due to variations in the gazing point itself, blinking, and the like. In the case of using the line-of-sight detecting means that causes many errors, since it does not respond to short-time errors, malfunction can be prevented and stabilization of the device can be promoted.

According to the invention of claim 4 of the present application, since the instructing means is constituted by a manual input device such as a joystick or a mouse, the degree of freedom of manual setting and the stability against manual error occurrence can both be achieved. .

According to the invention of claim 5 of the present application, the image pickup state is detected from the image signal in the predetermined region extracted by the gate means, and the image pickup state is adjusted based on the detection result. Since the adjustment means is provided, it is possible to select the adjustment area of the imaging state while shooting, and even if an error occurs, if the error is acceptable for a short time, the imaging operation is not interrupted. The imaging operation can be continued.

According to the invention of claim 7 of the present application, the focus state is adjusted by detecting the focus signal which changes according to the focus state from the image signals in the predetermined region, so that the photographing operation is performed. While performing, it is possible to focus on an arbitrary subject and prevent a focus adjustment error due to an error.

According to the invention of claim 8 of the present application, the exposure state is detected from the image signal in the predetermined area and the exposure state is adjusted. Thus, the optimum exposure state can be obtained, and an exposure control error due to an error can be prevented.

According to the invention of claim 9 of the present application, when an error occurs in the position setting operation of the predetermined area by the pointing means for a predetermined time or more, the predetermined area is set regardless of the setting of the pointing means. Since it has a control means for forcibly moving to a predetermined position in the screen, if an error occurs in the image capture area setting operation for a long time,
By forcibly fixing the predetermined area at the predetermined position, the image capturing operation can be stabilized.

According to the invention of claim 10 of the present application, the predetermined position is set to the central portion in the screen, and the predetermined area is enlarged when moved to the central portion of the screen. If an error occurs in the image capture area setting operation for a long period of time, the main subject is generally placed in the center of the screen in many cases. It is possible to increase the probability of capturing the subject and stabilize the optimum image capturing operation in all shooting conditions.

According to the eleventh aspect of the present invention, the image signal corresponding to the predetermined area in the image pickup screen of the image pickup means is extracted, so that the subject that changes momentarily is photographed. In an environment in which an error is likely to occur in the setting operation of the image signal extraction area, it is possible to stabilize the device and improve the operability when an error occurs.

According to the twelfth aspect of the present invention, the predetermined area is set at the line-of-sight position detected by the line-of-sight detecting means.
When using a line-of-sight detection means that inevitably causes many errors due to blinking etc., there is no need for an image capturing area when an error occurs for a long time or in an emergency such as when the photographer is looking away. It is possible to stabilize the set position by prohibiting various movements and prevent malfunction of the device.

According to the thirteenth aspect of the present invention, the image pickup state is detected from the image signal in the predetermined area and the adjusting means is provided for adjusting the image pickup state. Therefore, the image pickup state is adjusted while shooting. You can select the area,
Further, even if an error occurs, the image pickup operation can be stably continued without interrupting the image pickup operation.

According to the fourteenth aspect of the present invention, since the focus state is detected from the image signal in the predetermined area and adjusted, the focus state is adjusted for an arbitrary subject while performing the photographing operation. The focus adjustment error due to an error can be prevented.

According to the fifteenth aspect of the present invention, the exposure state is detected from the image signal in the predetermined area and adjusted, so that it is optimal for an arbitrary subject while performing the photographing operation. The exposure state can be obtained, and an exposure control error due to an error can be prevented.

According to the sixteenth aspect of the present invention, when an error of less than the predetermined time occurs in the position setting operation of the predetermined area, the predetermined area is held in a state immediately before the error occurs, and the predetermined time is maintained. When the above error occurs, the predetermined area is forcibly moved to a predetermined position on the screen, so even if an error occurs, the operation state is not immediately changed and a short time error occurs. If so, it is possible to stabilize the device by holding the state of the gate means based on the fact that the last position setting information that was issued is correct, and if an error occurs in the image capture area setting operation for a long time. By forcibly fixing the predetermined area at the predetermined position, the image capturing operation can be stabilized.

According to the present invention, in an external input position limited distance measuring / photometry method such as visual axis detection, when an error occurs in the external position input position limited method, no error occurs if it is within a predetermined time. Hold the last position, and if the error is longer than the specified time, switch to the general fixed center distance measurement / photometry method to measure all the shooting conditions without performing the wrong distance measurement / photometry that the photographer does not want. so,
It has the effect of optimal distance measurement and photometry.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of a first exemplary embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration of a line-of-sight detection block in FIG.

3 is a block diagram showing in detail the configurations and operations of a frame generation circuit 27, an AF evaluation value processing circuit 26, and an aperture control circuit 25. FIG.

FIG. 4 shows a relationship between the detection position of the visual axis detection circuit 6 and the focus detection area and the photometric area generated by the frame generation circuit 27 when the visual axis detection is normally performed and when a visual axis detection error occurs within a predetermined time. And a relationship between the focus detection area and the photometric area generated by the frame generation circuit 27 when a line-of-sight detection error occurs for a predetermined time or more.

FIG. 5 is a flowchart for explaining a frame generation operation and an autofocus operation.

FIG. 6 is a block diagram showing a configuration of a second exemplary embodiment of the present invention.

[Explanation of symbols]

 1 Line-of-sight detection block 6 Line-of-sight detection circuit 7 Lens unit 23 LCD display circuit 24 Electronic viewfinder 25 Aperture control circuit 26 AF evaluation value processing circuit 27 Frame generation circuit 29 Microcomputer 251 Gate circuit 261 Gate circuit

Claims (16)

[Claims] 1. A gate means for extracting an image signal corresponding to a predetermined area in a screen, an instruction means for inputting position setting information for instructing a setting position of the predetermined area in the screen, and the instructing means. Position setting means for controlling the position of the predetermined area in the screen by controlling the gate means on the basis of the output of, and the predetermined area when an error occurs in the position setting operation of the predetermined area by the instructing means. And a control unit that holds the state in a state immediately before the error occurs. 2. The image pickup device according to claim 1, further comprising the image pickup unit, wherein the gate unit corresponds to an image corresponding to the predetermined area in the image pickup screen of the image pickup unit from among the image signals output from the image pickup unit. An image signal processing device, which is configured to extract a signal. 3. The monitor according to claim 2, further comprising a monitor for monitoring the imaging screen, wherein the instructing unit is a line-of-sight detecting unit that detects a line-of-sight position of an operator in the monitor screen, and the position setting is performed. The image signal processing device is characterized in that the means is configured to set the predetermined area at the line-of-sight position detected by the line-of-sight detecting means. 4. The image signal processing device according to claim 2, wherein the instruction means is a manual input device such as a joystick or a mouse. 5. The image signal processing device according to claim 3, wherein the monitor is an electronic viewfinder. 6. The adjusting means according to claim 3, further comprising: an image pickup state detected from an image signal in the predetermined area extracted by the gate means, and adjusting the image pickup state based on the detection result. An image signal processing device comprising: 7. The adjusting means according to claim 6, wherein the adjusting means detects a focus signal that changes according to a focus state from the image signals in the predetermined area extracted by the gate means, and outputs the focus signal as the focus signal. An image signal processing device, characterized in that the image signal processing device is focus adjusting means for adjusting a focus state in accordance with the focus adjusting means. 8. The adjusting means according to claim 6, wherein the adjusting means detects an exposure state from an image signal in the predetermined area extracted by the gate means, and adjusts the exposure state according to the exposure state. Image signal processing characterized by being an exposure adjusting means. 9. A gate means for extracting an image signal corresponding to a predetermined area in the screen, an instruction means for inputting position setting information for instructing a setting position of the predetermined area in the screen, and the instructing means. Position setting means for controlling the gate means based on the output of the position control means for controlling the position of the predetermined area in the screen, and when the position setting operation of the predetermined area by the instruction means causes an error of a predetermined time or more. An image signal processing device, comprising: a control unit for forcibly moving the predetermined region to a predetermined position in the screen regardless of the setting of the instruction unit. 10. The method according to claim 9, wherein the predetermined position is set in a central portion of the screen, and the control means moves the predetermined region to the predetermined position and enlarges the predetermined region. An image signal processing device characterized by being configured. 11. The image pickup device according to claim 9, further comprising: the image pickup unit, wherein the gate unit has an image corresponding to the predetermined area in the image pickup screen of the image pickup unit in the image signal output from the image pickup unit. An image signal processing device, which is configured to extract a signal. 12. The monitor according to claim 11, further comprising a monitor for monitoring the imaging screen, wherein the instructing unit is a line-of-sight detecting unit that detects a line-of-sight position of the operator in the monitor screen, and the position setting is performed. The image signal processing device is characterized in that the means is configured to set the predetermined area at the line-of-sight position detected by the line-of-sight detecting means. 13. The adjusting means according to claim 11, further comprising: an image pickup state detected from an image signal in the predetermined area extracted by the gate means, and adjusting the image pickup state based on the detection result. An image signal processing device comprising: 14. The adjusting means according to claim 13, wherein the adjusting means detects a focus signal that changes according to a focus state from the image signals in the predetermined area extracted by the gate means, and outputs the focus signal as the focus signal. An image signal processing device, characterized in that the image signal processing device is focus adjusting means for adjusting a focus state in accordance with the focus adjusting means. 15. The adjusting means according to claim 13, wherein the adjusting means detects an exposure state from an image signal in the predetermined area extracted by the gate means, and adjusts the exposure state according to the exposure state. An image signal processing device, which is an exposure adjusting device. 16. Gate means for extracting an image signal corresponding to a predetermined area in a screen, instruction means for inputting position setting information for instructing a setting position of the predetermined area in the screen, and the instructing means. The position setting means for controlling the gate means based on the output of the position control means for controlling the position of the predetermined area in the screen, and the position setting operation of the predetermined area by the instruction means causes an error of less than a predetermined time. Sometimes, the predetermined area is held in a state immediately before the error occurs, and when the error for the predetermined time or more occurs, the predetermined area is forced to a predetermined position in the screen regardless of the setting of the instruction means. An image signal processing device comprising: a control unit that moves mechanically.