JPH07295036A - Imaging device and eyeball imaging device - Google Patents

Abstract

(57) [Abstract] [Purpose] It is possible to detect whether the subject's eyelids were closed at the time of shooting without using an expensive image sensor in a short time, and when the subject's eyelids were closed at the time of shooting. Informs the user accordingly. [Structure] A warning means 17 for giving a warning that the eyelid of a subject is closed and a counting means 35 are operated immediately before and during release, respectively, and the numbers of respective pixel blocks stored in the storage means 22 are compared. When the number of pixel blocks in the release is smaller, driving means 5 and 18 for driving the warning means are provided after the photographing is finished, and the image is taken from a part of the area in order to eliminate the need for the highly accurate image pickup means. If the number of pixel blocks having a predetermined wavelength region in this image data is smaller during the release than immediately before the release, it is considered that the subject's eyelids were closed during the release, I am trying to give a warning.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention illuminates a subject, picks up an image of a part of a screen of a reflected light image of the illuminating light on the subject by means of an image pickup means, and obtains image data from the obtained eyelid of the subject. The present invention relates to an improvement of a photographing apparatus such as a lens shutter camera or the like and an eyeball photographing apparatus having a function of detecting the open / closed state of the.

[0002]

2. Description of the Related Art When a portrait or a souvenir picture of a person is taken, it is often the case that a photograph of a subject in the middle of blinking eyes or blinking is obtained. In such a case, the expression of the subject becomes stupid, and I feel very disappointed with the subject.

Therefore, conventionally, in order to obtain a photograph in which the subject does not have his eyes closed, 1) Take a number of identical photographs and pick up a frame with open eyes from the finished photograph.

2) The subject is instructed not to close his eyes and then released.

3) In US Pat. No. 4,299,464, human blinking against a flash is used to start film exposure 240 to 300 ms after the strobe emission timing at the time of shooting to prevent the subject from blinking. The method of doing is disclosed.

However, the above conventional example has the following drawbacks.

In the above method 1), a large amount of film is wasted, and it takes a long time to shoot. In the above method 2), the subject is a child, a baby, or a non-speech animal. In some cases, it had no meaning. Further, in any of these methods 1) and 2), the result was not known until the photographed film was developed and printing was completed.

Further, in the configuration of the above 3), it is necessary to constantly make the strobe emit light in order to induce the blinking of a human, and the subject is made to feel dazzling each time, which is not good for the subject. It is a thing.

[0009]

In view of the above points,
By the applicant of the present application, Japanese Patent Application No. 5-340234,
It has been proposed to detect the eye-gaze state of a subject by detecting the presence or absence of red-eye generation by the eyeball of a living body with respect to the illumination light in the imaging region (Japanese Patent Application No. 5-3402).
34). This makes it possible to eliminate the above-mentioned drawbacks 1) to 3).

However, C according to the embodiment of this proposal
The image pickup area of the image pickup device such as a CD is the whole or a large area of the image pickup screen, and the image pickup is performed in this area. Therefore, in order to accurately detect the red-eye of the eye even when the subject is far from the camera and the photographing magnification is low, it is necessary to use a high resolution type having high density pixels as an image sensor. This is not only accompanied by an increase in cost, but when the number of pixels becomes high, it also requires a large amount of imaging time by the imaging circuit and calculation processing time for red eye block detection, which causes a release time lag and reduces the usability of the camera. There was a problem.

(Object of the Invention) A first object of the present invention is to detect whether or not the eyelid of a subject is closed at the time of photographing without using an expensive image pickup device in a short time.
Moreover, it is an object of the present invention to provide a photographing device and an eyeball photographing device which can inform the user of the fact that the eyelid of the subject is closed at the time of photographing.

A second object of the present invention is to detect whether or not the subject's eyelids were closed at the time of shooting without using an expensive image pickup device, and the subject's eyelids were not closed. An object of the present invention is to provide an imaging device and an eyeball imaging device that can automatically perform appropriate imaging.

A third object of the present invention is to detect whether or not the eyelid of the subject is closed at the time of photographing without using an expensive image pickup element, and moreover, when the eyelid of the subject is closed at the time of photographing. Is to inform the user to that effect, and further to provide an imaging apparatus and an eyeball imaging apparatus capable of automatically performing proper imaging when the eyelid of the subject is not closed during imaging.

A fourth object of the present invention is to provide a photographing apparatus and an eyeball photographing apparatus which can prevent unnecessary photographing even after proper photographing.

A fifth object of the present invention is to provide an image pickup apparatus and an eyeball image pickup apparatus which can perform image pickup without being concerned about framing at the time of image pickup.

A sixth object of the present invention is to provide a photographing apparatus and an eye photographing apparatus capable of always detecting the eyelid open / closed state of a subject with high accuracy without depending on the distance from the camera to the subject. Is to provide.

A seventh object of the present invention is to provide an image pickup apparatus and an eyeball image pickup apparatus capable of arranging the eyeball at a position corresponding to the detection area of the image pickup means regardless of the state of the camera. .

[0018]

In order to achieve the above-mentioned first object, the present invention according to claim 1 or 8 comprises a warning means for giving a warning that the eyelid of a subject is closed, and a counting means. Operate immediately before release and during release,
The number of pixel blocks stored in the storage means is compared, and when the number of pixel blocks being released is smaller, a driving means for driving the warning means after the end of shooting is provided, and high-precision image pickup means is provided. In order to eliminate the need for image data from a part of it, the number of pixel blocks with a predetermined wavelength range obtained when the eyelid of the subject is opened from this image data is greater during the release than immediately before the release. If the number is small, it is determined that the eyelid of the subject is closed during the release, and a warning to that effect is given.

In order to achieve the second object,
In the present invention according to claim 2 or 8, the counting means is operated immediately before and during the release, respectively, and the numbers of the respective pixel blocks stored in the storage means are compared. If the number is small, an operation control means for automatically performing a release operation of at least another frame is provided, and image data is obtained from a part of the area in order to eliminate the need for a highly accurate image pickup means. If the number of pixel blocks having a predetermined wavelength range obtained when the subject's eyelids are opened is smaller during the release than immediately before the release, it is determined that the subject's eyelids are closed during the release, and at least another frame is taken. In other words, until the number of pixel blocks during release exceeds the number of pixel blocks obtained immediately before release or when shooting multiple frames (the eyelids opened. So that automatically makes a determination can be up to) shoot.

Further, in order to achieve the third object,
According to the present invention of claim 3 or 8, the warning means for warning that the eyelid of the subject is closed during photographing and the counting means are operated immediately before and during the release, respectively, and stored in the storage means. When the number of pixel blocks in the release is smaller than that of the other pixel blocks, the warning means is driven after the photographing is completed and at least another frame is automatically operated as an operation control means. If the number of pixel blocks being released is less than the number of pixel blocks obtained immediately before the release, it is assumed that the subject's eyelids were closed during the release, and a warning is issued to that effect and at least one more frame is taken. Is done automatically.

Further, in order to achieve the fourth object,
The present invention according to claim 4 or 8 is provided with operation control means for ending the continuous release operation to the next frame by detecting that the number of pixel blocks in the release is equal to or more than the number of pixel blocks immediately before the release. The photographing is terminated by determining that the eyelid of the subject is open during the release.

In order to achieve the fifth object,
The present invention according to claim 5 or 8 comprises: posture detecting means for detecting the posture of the camera; and detection area changing means for changing the detection area of the image pickup means according to the posture information obtained by the posture detecting means. Is provided, and the detection area of the image pickup unit is changed according to the attitude information of the camera, that is, the information whether the camera is held in the vertical position or in the horizontal position.

In order to achieve the above sixth object,
According to a sixth aspect of the present invention, a distance measuring means for measuring a distance from a camera to a subject, and an image pickup screen to be detected by the image pickup means according to distance measuring data obtained by the distance measuring means. Even if the distance from the camera to the subject changes, the detection area changing means for changing a part of the upper area is provided.
The detection area of the image pickup unit is changed so that the size of the subject on the detection area of the image pickup unit is constant.

In order to achieve the seventh object,
The present invention according to claim 7 or 8 is provided with display means for displaying the detection area of the image pickup means in the finder so that the eyeball state detection area can be known when looking into the finder.

[0025]

EXAMPLES Before entering the description of each example below, here,
The principle of detecting the state of the eyelid of the subject in the present invention will be described with reference to FIGS.

FIG. 1 is a diagram showing the structure of a human eyeball.
1 is a cornea, 2 is an iris, 3 is a lens, and 4 is a retina. Further, FIG. 2 is a diagram showing a spectral reflection characteristic of a human eye.

It has long been known that when a human being, which is a subject, is photographed by using a strobe device, a red-eye phenomenon occurs in which a human eye appears red in a photograph. This is caused by the fact that the light emitted from the strobe device is imaged and scattered on the retina 4 of the human eye, and a part of the scattered light enters the photographing lens of the camera and is imaged on the film. Is.

As shown in FIG. 2, since the spectral reflectance of the retina 4 is high from the long wavelength region of visible light to the infrared region (about 650 nm or more), it is recorded in red on the film. From the optical principle of the occurrence of the red-eye phenomenon, it is a well-known fact that the smaller the angle formed by the strobe device that is the light emitting source and the direction of observation, the higher the frequency of occurrence. On the other hand, it is clear that this red-eye phenomenon does not occur when a person is blind.

Therefore, in the present invention, conversely, focusing on the fact that it is possible to detect the open / closed state of the eye by observing whether or not the red-eye phenomenon has occurred, the light projection and the optical axis of the observation optical system are coaxial. By setting, it is configured to efficiently generate the red-eye phenomenon in order to detect the open / closed state of the eye, and it is determined whether or not it is appropriate shooting based on the open / closed state of the eye during the release (eyelid state). However, when it is determined that it is inappropriate, that is, the eyelids are closed during the release, control is performed as in the following embodiment.

The present invention will be described below in detail with reference to the illustrated embodiments.

FIG. 3 is a block diagram showing the overall construction of a camera according to the first embodiment of the present invention.

In FIG. 3, 5 is a system controller for controlling the sequence, 6 is a photometering circuit for measuring the brightness of the object, 7 is a distance measuring circuit for measuring the distance to the object,
Reference numeral 8 is a shutter driver for driving a shutter 10 for controlling the amount of exposure to the film, 9 is an image pickup optical system, 11 is a film, 12 is a rack gear integrally formed with the image pickup optical system 9, and 13 is a mesh with the rack gear 12. A pinion gear, 14 a zoom motor 14 for driving the pinion gear 13, 15 a zoom motor driver for driving the zoom motor 14, 16 a focal length position detection for detecting a focal length set by the imaging optical system 9. A circuit, 17 is a warning buzzer, and 18 is a buzzer driver for driving the warning buzzer 17.

Reference numeral 19 is a release switch, and two switches 19a and 19b are turned on, depending on the pressing amount.
It is configured to turn off. More specifically,
Reference numeral 19a is a switch that is turned on when the release switch 19 is pressed by a small amount, and is a switch for instructing a shooting standby such as photometry or distance measurement of the camera. Also,
A switch 19b is a switch that is turned on with a deeper pressing amount than the switch 19a, and is a switch for exposing the film. The switches 19a and 19b are used as the input ports SW1 and SW2 of the system controller 5.
It is connected to the.

Reference numeral 20 is a switch for setting the photographing optical system 9 in the tele direction, 21 is a switch for setting the photographing optical system 9 in the wide direction, 22 is a RAM for storing various states and data of the camera, and 23 is A ROM 24 for storing programs and predetermined data is a liquid crystal display (hereinafter, referred to as LCD) for displaying the state of the camera and data, and a film counter display section 24a and a subject to be photographed. Mark display section 24 that lights up when the eyelids are open
b, on the contrary, a mark display portion 24c that lights up when the eyelid of the subject to be photographed is closed, a mark display portion 24d that displays the film feeding state, and a mark display portion 24e that displays the battery state. 25 is the LCD 24
Is an LCD driver for driving the.

Reference numeral 26 is an image pickup optical system block for generating the red-eye effect on the subject's eyeball, which includes the following optical elements 27 to 32.

Reference numeral 27 denotes an infrared light emitting diode (hereinafter referred to as LED) for illuminating a subject, which has an emission spectrum insensitive to human eyes. 28 is an LED driver for driving the LED 27, 29 is a light emitting / receiving lens, 30 is a half mirror, 31 is an effective transmissivity for the emission spectrum of the LED 27, and is a low transmissivity for other wavelength regions. It is a bandpass filter. Reference numeral 32a is an image pickup device such as a CCD that picks up a part of the subject when the camera is in the horizontal position, and 32b is an image pickup device such as a CCD that picks up a part of the subject when the camera is in the vertical position. (Not shown).

Reference numeral 33 is a signal selection circuit for selecting an image pickup signal of one of the above image pickup elements (hereinafter referred to as CCD) 32a, 32b, and 34 is an image pickup circuit for converting the output of the signal selection circuit 33 into a video signal. is there. Reference numeral 35 is a system controller 5 which outputs image data of each pixel of the CCD 32a or 32b.
This is an arithmetic circuit that performs various arithmetic operations on data by sampling at a timing given by the operator. Reference numeral 36 denotes a vertical / horizontal detection switch for detecting whether the camera is held vertically / horizontally. The switch (HOL.
SW) and a switch (VER.S) that turns on in the vertical position.
W).

FIG. 4 is an external perspective view of the camera having the above-mentioned structure, and the same components as those in FIG. 3 are designated by the same reference numerals.

In FIG. 4, 37 is a camera body, 38 is a stroboscopic light emitting portion, 39 is a finder, 40 is a distance measuring aperture, and 41 is a photometric aperture.

FIG. 5 is a perspective view showing the arrangement of the image pickup optical system for projecting and observing the subject's eye red eye phenomenon in the image pickup optical system block 26 shown in FIG.
The same numbers as in FIG. 3 are attached.

FIG. 6 is a timing chart when the film is exposed by the release switch 19 while detecting the state of the eyelid of the subject.

Next, the operation of the above-mentioned camera (with respect to the processing by the system controller 5) will be described with reference to the timing chart of FIG. 6 and the flowchart of FIG.

First, when the release switch 19 is pressed and the switch 19a which is turned on with a shallow stroke is turned on, the system controller 5 starts the operation from step 101. [Step 101] The photometric circuit 6 measures the subject brightness. [Step 102] The distance measuring circuit 7 measures the distance from the camera to the subject. [Step 103] The state of the switch 19b which is turned on with a deep stroke of the release switch 19 is determined, and if it is on, the process proceeds to step 105, and if it is off, the process proceeds to step 104. [Step 104] It is determined whether or not the switch 19a that is turned on with a shallow stroke is still on. If it is on, the process returns to step 103, and if it is off, the process ends. [Step 105] The LED 27 for illuminating the subject is turned on.

Here, the projection of light on the object and the image pickup optical system will be described with reference to FIG.

The light flux generated by the LED 27 is reflected by the half mirror 30 at a predetermined ratio, converted into parallel rays by the light projecting / receiving lens 29, and projected onto the subject. Then, the light flux reflected by the subject again enters the light projecting / receiving lens 29, transmits a predetermined proportion, and forms an image on the image pickup devices 32a and 32b. Here, since the bandpass filter 31 exists between the image pickup devices 32a and 32b and the half mirror 30, only the light flux having the predetermined wavelength width set by the bandpass filter 31 is imaged on the image pickup devices 32a and 32b. It will be.

As described above, since the projection optical axis and the reception optical axis of the object are matched by the half mirror 30, when the projected luminous flux enters the human eyeball, it is very efficiently reflected by the retina. The scattered light beam again forms an image on the CCD 32 via the lens 29.

Further, as described above, the reflectance of the human retina is high in the red to near-infrared region (see FIG. 2).
If the spectral characteristics of 7 and the bandpass filter 31 are set in the vicinity of the region, the subject is not sensed, and
It is possible to observe the red-eye effect that excludes the effects of light rays in the visible region. [Step 106] By determining the state of the vertical / horizontal detection switch 36, it is determined in which state the camera is held. As a result, if it is held in the vertical position, the process proceeds to step 107, and if it is held in the horizontal position, the process proceeds to step 108. [Step 107] Since the camera is held in the horizontal position, the vertical position image pickup CCD 32 is set by the signal selection circuit 33.
Select b. [Step 108] Since the camera is held at the horizontal position here, the signal selecting circuit 33 causes the C for horizontal position imaging.
Select the CD 32a.

FIG. 8 shows the image pickup range of the CCD 32a for image pickup in the horizontal position with respect to the image pickup area of the film when the camera is held in the horizontal position, and FIG. 9 shows the image pickup range in the vertical position. The image pickup range of the vertical position image pickup CCD 32b is shown with respect to the image pickup area of the film when held. [Step 109] Image data is accumulated while the LED 27 is on.

Needless to say, the accumulation time of the CCD 32 (32a, 32b) is determined by the subject brightness, the projection power of the LED 27, and the distance to the subject. The accumulated data is transferred to the image pickup circuit 34 and converted into an image signal. The imaged image is shown in a of FIG. In this case, since the eyelid of the subject is open, a red-eye phenomenon causes a retina reflection image of a size corresponding to the pupil diameter of the eyeball. [Step 110] The arithmetic circuit 35 binarizes the image data.

The image data after binarization is shown in d of FIG. When the binarization level is appropriately set, only the pupil portion where the red-eye phenomenon of the eyeball has occurred is detected. [Step 111] Next, from the binarized image data, the number of pixels of a predetermined level or more, in this case, the number of pixels of the CCD 32 corresponding to the red eye portion generated in the pupil portion of the eyeball of the subject is counted by the arithmetic circuit. When the pupil size in the CCD 32 is sufficiently larger than the pixel size, the predetermined number of pixels may be considered as one block, and the number of pixel blocks may be counted. In the present invention, for the sake of convenience, the number of pixel blocks, not the number of pixels, is expressed as including the number of pixels even when the pupil size is smaller than the one-pixel size. [Step 112] The number of counted pixel blocks (N ₁ ) is stored in the RAM 22.

When the pupil size is smaller than one pixel size, N ₁ is not the number of pixel blocks but the number of pixels, which is an accurate expression. Is also expressed as the number of pixel blocks. [Step 113] The shutter 10 is opened via the shutter driver 8 to start exposure of the film 11. [Step 114] A timer (T _S ) for counting the exposure time determined by the subject brightness measured by the photometric circuit 6 and the film sensitivity loaded in the camera is started. [Step 115] It is determined whether or not the shutter opening time (t) has passed 1/2 of the set exposure time (T _S ). When 1/2 or more has elapsed, the process proceeds to the next step 116. [Step 116] The accumulated data in the CCDs 32a and 32b selected by the signal selection circuit 33 is cleared. [Step 117] The CCDs 32a and 32b are stored again, and the image pickup circuit 34 generates image data. [Step 118] The arithmetic circuit 35 binarizes the image data. [Step 119] The arithmetic circuit 34 counts the number of pixels of a predetermined level or higher from the image data. [Step 120] The counted number of pixel blocks (N ₂ ) is stored in the RAM 22.

Here, a case where the subject closes his eyes during the shutter release will be described.

When the subject's eyes are closed, the eyelids block the light beam projected onto the eyeball, so that reflection on the retina does not occur. Therefore, the red eye phenomenon does not occur. Therefore, the image data captured by the CCD 32 is b in FIG.
When the image is binarized, pixels of a predetermined level or more are lost as shown in e of FIG. [Step 121] It is determined whether or not the shutter opening time (t) has exceeded the exposure setting time (T _S ), and if it has elapsed, the process proceeds to step 122. [Step 122] The shutter 10 is closed via the shutter driver 8, and the exposure of the film 11 is completed. [Step 123] Feed one frame of film (Fig. 1
The feeding means is not shown in the figure). [Step 124] The number of pixel pixel blocks immediately before the shutter release (N ₁ ) stored in the RAM 22 is compared with the number of pixel pixel blocks (N ₂ ) accumulated in the CCD 32 at an intermediate timing between the shutter release times. As a result,
If the number of pixels during shutter release (N ₂ ) has not decreased compared to the number of pixels (N ₁ ) immediately before release, step 1
Move to 25. [Step 125] The illumination LED 27 is turned off, and the process ends.

[0054] Further, in step 124, if it is determined that the shutter release just before (N ₁₎ from the in release (N2) is smaller pixel pixel blocks of (N _1> N _2), a subject is eyes closed Go to step 126. [Step 126] The warning buzzer 17 is driven through the buzzer driver 18, and a warning sound is emitted, and the next step 12
Proceed to 7. [Step 127] Here, the mark display unit 2 that lights up when the eyelids of the subject to be photographed on the LCD 24 are open.
Turn on 4b.

By turning on the warning buzzer 17 and the mark display portion 24c of the LCD 24, the photographer can know that the subject's eyes are closed during the film exposure. [Step 128] The delay time timer (T _D ) until re-release starts counting.

Needless to say, the delay time T _D is set to a time at which the eyelids will be opened during the re-release. More specifically, since the average eyelid opening / closing time can be predicted in advance, the delay time T _D is set based on the time from the eyelid opening to the eyelid closing. [Step 129] It is determined whether or not the shutter opening time (t) is longer than the delay time (T _D ), and if so, the routine proceeds to step 130. [Step 130] The shutter 10 is opened again via the shutter driver 8. [Step 131] Timer for counting exposure time (T
_S ) start. The set time is the same as the first time. [Step 132] It is determined whether or not the shutter opening time (t) has exceeded the exposure setting time (T _S ), and when it has elapsed, the process proceeds to step 133. [Step 133] The shutter 10 is closed via the shutter driver 8 to complete the exposure of the film 11. [Step 134] The light emitting LED 27 is turned off. [Step 135] The film 11 for one frame is fed again, and the process ends.

Here, in the above operation, the open / closed state of the eyelids of the object being released is detected at the timing of the middle (1/2) of the shutter opening time. This is because it is almost equal to the timing corresponding to the maximum opening amount of.
Alternatively, the gain of the image pickup system may be variably set, the accumulation time of the CCD 32 may be matched with the shutter opening time, and the image may be captured in the CCD 32 over the entire film exposure time.

(Second Embodiment) FIG. 10 is a block diagram showing the overall structure of a camera according to the second embodiment of the present invention, in which the image pickup range is variable depending on the photographing magnification. The same parts as those in FIG. 1 are designated by the same reference numerals, and the description thereof will be omitted.

In FIG. 10, reference numeral 42 designates an image pickup lens 42a.
Is a variable-magnification image-capturing pixel block having an optical axis direction, and is configured to change the imaging magnification by moving. 43 is a rack gear integrally formed with the imaging lens 42a, 44 is a pinion gear, 45 is a motor for rotating the pinion gear 44, and 46 is the motor 4
5 is a motor driver for driving the motor 5.

The operation of the above configuration will be described with reference to the flowchart of FIG. The same steps as those in the flowchart of FIG. 7 in the first embodiment are designated by the same step numbers.

When the release switch 19 is pressed and the switch 19a which is turned on with a shallow stroke is turned on, the system controller 5 measures the subject brightness by the photometric circuit 6 in step 101, and in the next step 102, the photometric circuit 7 After measuring the distance from the camera to the subject, the process proceeds to step 201. [Step 201] The imaging lens 42 is moved based on the distance measurement data obtained in the above step 102,
The imaging magnification is changed.

Here, it is preferable to set the image pickup magnification for the distance measurement data so that the size of the subject on the CCD 32 becomes constant. Therefore, when the image pickup magnification is M, the focal length of the image pickup lens 42 is f, and the distance from the camera to the subject (distance measurement data) d, the image pickup lens 42 is set at a position where f = M × d. Further, it goes without saying that the imaging magnification M is set by the relationship between the number of pixels of the CCDs 32a and 32b and the size of the red-eye reflection image of the eyeball occupying in the detection area.

With the above configuration, it is possible to properly observe the eyeball state of the subject even when the distance between the subject and the camera changes.

When the operation of the above step 201 is completed, the operation proceeds to the operation of step 103 and thereafter, but the operation after that is the same as that of the first embodiment, and therefore its explanation is omitted.

(Third Embodiment) FIG. 12 is a block diagram showing the overall construction of a camera according to the third embodiment of the present invention, which is constructed so as to display a visual axis detection area in the viewfinder of the camera. Is. The same parts as those in FIG. 1 are designated by the same reference numerals, and the description thereof will be omitted.

In FIG. 12, 47 is a transmissive LCD installed in the viewfinder, 48 is a segment indicating the detection area when the camera is in the horizontal position, and 49 is a detection area when the camera is in the vertical position. By installing the LCD 47 at a predetermined image forming position in the finder optical path (not shown), which is a segment, the photographer can visually recognize the photographed screen while overlapping the detection area range when looking through the finder.

The operation of the above configuration will be described with reference to the flowchart of FIG. The same steps as those in the flowchart of FIG. 7 in the first embodiment are designated by the same step numbers.

In step 107, the state (posture) of the camera is detected, and if it is in the vertical position, the process proceeds to step 108, where the CCD 32a is selected and then the process proceeds to step 301. [Step 301] Since the camera is held vertically, the segment 49 is turned on.

When it is determined in step 107 that the position is the lateral position, the process proceeds to step 109, where the CCD 32b is selected, and then the process proceeds to step 302. [Step 302] Since the camera is held vertically, the segment 48 is turned on.

Steps 301 to 30 described above
When the operation of No. 2 is completed, the operation proceeds to the operation of step 109 and subsequent steps, but the subsequent operation is the same as that of the first embodiment, and therefore the description thereof is omitted.

According to each of the above embodiments, the following effects can be obtained.

1) By limiting the detection area of the subject's eyeball red-eye phenomenon in the shooting screen to a part, it is not necessary to use a high-resolution image pickup element, so that the cost is kept low and the eyeball state is kept. The calculation time for the detection can be shortened.

2) By independently installing detection areas corresponding to how the camera is held, detecting the direction of the camera at the time of shooting and automatically switching between them, there is no waste of framing even during portrait shooting. Is possible. That is, the photographer can take a photograph without having to worry about the positions of the CCDs 32a and 32b. Furthermore, 3) By varying the area of the eyeball state detection area according to the shooting distance from the camera to the subject, highly accurate detection is possible regardless of the shooting distance.

4) The detection area is displayed in the viewfinder in the red-eye state, and the display is switched depending on the state of holding the camera. Therefore, the photographer can be surely positioned at the position corresponding to the detection area in any holding manner. It is possible to dispose the subject's eyeball, and it is possible to accurately open and close the eyelids at the time of release.

(Correspondence between Invention and Embodiment) In the present embodiment, the LED 27, the half mirror 30, the light emitting and receiving lens 29.
Corresponds to the illumination means of the present invention, the CCDs 32a and 32b correspond to the imaging means of the present invention, the arithmetic circuit 35 corresponds to the counting means of the present invention, the RAM 22 corresponds to the storage means of the present invention, and the buzzer 17 corresponds to the buzzer 17. The system controller 5 and the buzzer driver 18 correspond to the driving means of the present invention, the system controller 5 corresponds to the operation control means of the present invention, and the vertical / horizontal detection switch 36 corresponds to the posture detection of the present invention. The distance measuring circuit 7 corresponds to the distance measuring means of the present invention, the system controller 5 and the signal selecting circuit 33 correspond to the detection area changing means of the present invention, and the LCD 24 corresponds to the display means of the present invention. .

The above is the correspondence relationship between each configuration of the embodiments and each configuration of the present invention, but the present invention is not limited to the configurations of these embodiments, and a configuration capable of achieving the functions shown in the claims. It goes without saying that it may be of any type.

(Modification) In the present embodiment, when it is detected that the eyelids are closed during the release, another frame is automatically photographed. Since it is not always the case that photographing is performed (photographing with the eyelids open), two or more frames may be photographed. Alternatively, in the flowchart of FIG. 7, step 13
Alternatively, steps 115 to 120 may be added after ₁ , and the determination of step 124 is performed again after step 135, and the release operation may be repeated until the relationship of “N ₁ ≦ N ₂ ” is satisfied. In this case, step 12
The operations of 8,129, that is, the operations of measuring the predetermined delay time T _D are not always necessary.

Further, although the present embodiment describes the case where the invention is applied to a camera such as a single-lens reflex camera, a lens shutter camera and a video camera, it can also be applied to an eyeball photographing device in the field of other medical equipment. it can.

Further, according to the present invention, the number of pixel blocks having a predetermined wavelength region obtained when the subject's eyelids are opened is detected from the image data picked up by the CCD (other image pickup device may be used). By doing so, it is determined that the eyelid is currently open, and conversely, if it is not detected, it is determined that the eyelid is closed, and the open / closed state of the eyelid is displayed by a buzzer (display, other notification means, etc. May be used) to notify the user of the line-of-sight state detecting device.

Furthermore, the present invention may be constructed by appropriately combining the above-described embodiments or their techniques.

[0081]

As described above, according to the present invention as set forth in claim 1 or 8, the warning means for warning that the eyelid of the subject is closed and the counting means are provided just before and during the release, respectively. When the number of pixel blocks stored in the storage means is activated and the number of pixel blocks stored in the storage means is compared, if the number of pixel blocks in the release is smaller, a driving means for driving the warning means after completion of photographing is provided, and high precision is provided. In order to eliminate the need for the image pickup means, the image data is obtained from a part of the area, and the number of pixel blocks having a predetermined wavelength area obtained when the subject's eyelids are opened from this image data is
If there are fewer shutters during the release than immediately before the shutter release, it is assumed that the subject's eyelids are closed during the shutter release, and a warning to that effect is given.

Therefore, it is possible to detect whether or not the subject's eyelids are closed at the time of shooting without using an expensive image pickup element, and if the subject's eyelids are closed at the time of shooting, that effect is detected. Can be notified to the user.

According to the present invention as defined in claim 2 or 8, the counting means is operated immediately before and during the release, respectively, and the numbers of the respective pixel blocks stored in the storage means are compared with each other to perform the release. If the number of pixel blocks is smaller, the operation control means for automatically performing the release operation for at least another frame is provided, and the image data is obtained from a part of the area in order to eliminate the need for the highly accurate image pickup means. If the number of pixel blocks having a predetermined wavelength range obtained when the subject's eyelids are opened from this image data is less during the release than immediately before the release, it is determined that the subject's eyelids were closed during the release. , At least another frame is shot, that is, multiple frames are shot, or the number of pixel blocks being released is greater than the number of pixel blocks obtained immediately before release. And to automatically carry out the shooting until the.

Therefore, it is possible to detect whether or not the eyelid of the subject is closed at the time of photographing without using an expensive image pickup device in a short time, and moreover, the proper photographing in which the eyelid of the subject is not closed is automatically performed. It can be carried out.

According to the present invention as set forth in claim 3 or 8, the warning means for warning that the eyelid of the subject is closed during photographing, and the counting means are operated immediately before and during the release, respectively. , The number of pixel blocks stored in the storage means is compared, and when the number of pixel blocks being released is smaller, the warning means is driven after the photographing is completed and at least another one is automatically set.
If the number of pixel blocks being released is smaller than the number of pixel blocks obtained immediately before the release, it is considered that the eyelid of the subject was closed during the release. A warning is issued and at least another frame is automatically shot.

Therefore, it is possible to detect whether or not the subject's eyelids are closed at the time of shooting without using an expensive image pickup element, and if the subject's eyelids are closed at the time of shooting, the user is informed accordingly. In addition, it is possible to automatically perform proper shooting when the eyelid of the subject is not closed at the time of shooting.

Further, according to the present invention as defined in claim 4 or 8, by detecting that the number of pixel blocks in the release is equal to or more than the number of pixel blocks immediately before the release, the continuous release operation to the next frame is performed. The automatic release means for terminating is provided, and the photographing is terminated by determining that the eyelid of the subject is open during the release.

Therefore, it is possible to prevent useless shooting even after proper shooting.

According to the present invention as defined in claim 5 or 8, the posture detection means for detecting the posture of the camera, and the detection area of the image pickup means according to the posture information obtained by the posture detection means. And a detection area changing means for changing the posture information of the camera, that is, whether the camera is held in the vertical position,
The detection area of the image pickup means is changed according to the information indicating whether the camera is held in the horizontal position.

Therefore, it is possible to perform shooting without worrying about the framing during shooting.

According to the present invention as defined in claim 6 or 8, the distance measuring means for measuring the distance from the camera to the object and the image pickup means according to the distance measuring data obtained by the distance measuring means. The detection area changing means for changing a part of the area on the image pickup screen to be detected by the means is provided, and even if the distance from the camera to the subject is changed, the size of the subject in the detection area of the image pickup means is constant. Therefore, the detection area of the image pickup means is changed.

Therefore, the eyelid open / closed state of the subject can always be detected with high accuracy without depending on the distance from the camera to the subject.

Further, according to the present invention as set forth in claim 7 or 8, the display means for displaying the detection area of the image pickup means in the finder is provided so that the eyeball state detection area can be known when looking into the finder. I have to.

Therefore, no matter which state the camera is held in, the eyeball can be placed at the position corresponding to the detection area of the image pickup means.

[Brief description of drawings]

FIG. 1 is a diagram showing the structure of a human eyeball according to the present invention.

FIG. 2 is a diagram showing spectral reflectance characteristics of a human eye low according to the present invention.

FIG. 3 is a block diagram showing the overall configuration of a camera according to the first embodiment of the present invention.

FIG. 4 is an external perspective view of the camera of the first embodiment of the present invention.

5 is a perspective view showing the arrangement of a light projecting element for generating a red-eye effect on an object and an imaging optical system for observation in the imaging optical system block of FIG.

FIG. 6 is a timing chart to help explain the operation of FIG.

FIG. 7 is a flowchart showing the operation of the system controller of FIG.

FIG. 8 is a diagram showing a state of a selected CCD when the camera is held in a horizontal position in the first embodiment of the present invention.

FIG. 9 is a diagram showing a state of a selected CCD when the camera is held in a vertical position in the first embodiment of the present invention.

FIG. 10 is a pixel block diagram showing an overall configuration of a camera according to a second embodiment of the present invention.

11 is a flowchart showing the operation of the system controller of FIG.

FIG. 12 is a pixel block diagram showing an overall configuration of a camera of a third embodiment of the present invention.

13 is a flowchart showing the operation of the system controller of FIG.

[Explanation of symbols]

5 System Controller 7 Distance Measuring Circuit 9 Photographic Lens 10 Shutter 14 Zoom Motor 16 Focus Position Detection Circuit 17 Buzzer 18 Buzzer Driver 22 RAM 24 Liquid Crystal Display (LCD) 29 Light Emitting / Receiving Lens 30 Half Mirror 32a, 32b Imaging Device (CCD) 33 Signal selection circuit 35 Arithmetic circuit 36 Vertical / horizontal detection switch 42a Imaging lens 45 Variable magnification motor 47 Transmissive LCD 48,49 Segments for horizontal position / vertical position detection area

Claims (8)

[Claims] 1. An illuminating means for illuminating a subject, an image capturing means for capturing a partial area on an image capturing screen of a reflected light image of the subject by the illuminating means, and image data captured by the image capturing means. Counting means for counting the number of pixel blocks having a predetermined wavelength region obtained when the eyelids of the subject are opened,
A photographing device comprising a storage means for storing the counting result by the counting means, the warning means for giving a warning that the eyelid of the subject is closed, and the counting means for operating immediately before and during the release, respectively. Comparing the numbers of the respective pixel blocks stored in the storage unit, and when the number of pixel blocks being released is smaller, a driving unit for driving the warning unit after the end of photographing is provided. Shooting device. 2. Illuminating means for illuminating an object, imaging means for imaging a partial area on an imaging screen of a reflected light image of the object of the illuminating means, and image data captured by the imaging means. Counting means for counting the number of pixel blocks having a predetermined wavelength region obtained when the eyelids of the subject are opened,
An image pickup apparatus comprising: a storage unit for storing the counting result by the counting unit, wherein the counting unit is operated immediately before and during the release, and the numbers of the respective pixel blocks stored in the storage unit are compared. However, when the number of pixel blocks being released is smaller, an image pickup apparatus is provided with an operation control means for automatically performing at least another frame of the release operation. 3. Illuminating means for illuminating a subject, image capturing means for capturing a partial area on an image capturing screen of a reflected light image of the subject of the illuminating means, and image data captured by the image capturing means. Counting means for counting the number of pixel blocks having a predetermined wavelength region obtained when the eyelids of the subject are opened,
An imaging device comprising a storage means for storing the counting result by the counting means, the warning means giving a warning that the eyelid of the subject is closed during shooting, and the counting means immediately before and during the release. When the number of pixel blocks stored in the storage means is compared with each other, the number of pixel blocks stored in the storage means is smaller. An image pickup apparatus, comprising: an operation control means for performing a one-frame release operation. 4. The automatic release means is means for ending a continuous release operation to a next frame by detecting that the number of pixel blocks in the release is equal to or larger than the number of pixel blocks immediately before the release. The image pickup apparatus according to claim 2 or 3, characterized in that: 5. A posture detecting means for detecting a posture of a camera, and a part of an area on an image pickup screen to be detected by said image pickup means is changed according to the posture information obtained by said posture detecting means. 5. The image pickup apparatus according to claim 1, further comprising a detection area changing means. 6. A distance measuring means for measuring a distance from a camera to a subject, and a part of an image pickup screen to be detected by said image pickup means according to distance measuring data obtained by said distance measuring means. The image pickup apparatus according to claim 1, further comprising a detection area changing unit that changes an area. 7. The photographing apparatus according to claim 1, further comprising display means for displaying a detection area of the image pickup means in a finder. 8. An eyeball photographing apparatus provided with the photographing apparatus according to claim 7.