JP2009111489A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize display of an image that is easier to see according to a user when a user with color blindness checks a composition at the time of imaging based on an image.
An imaging unit that captures an image of a subject and generates an image, a display unit that displays an image for composition confirmation, an acquisition unit that acquires information about color vision impairment of a user, and a display unit based on the information A correction unit that corrects the composition confirmation image displayed on the screen. The correction unit corrects the composition confirmation image displayed on the display unit by performing at least one of image processing on the composition confirmation image and control of the light emission ratio of each color in the display unit. good.
[Selection] Figure 1

Description

  The present invention relates to an imaging device including a display unit that displays an image generated by capturing a subject image.

2. Description of the Related Art Conventionally, techniques for assisting the use of various devices for users with color blindness such as color weakness and color blindness have been considered. For example, in the invention of Patent Document 1, when outputting an image, by referring to color information that is registered in advance and has a tendency to be misidentified, it is possible to output an image that is easy to see and has no misunderstanding.
JP 2006-246072 A

  By the way, when a user with color blindness uses an imaging apparatus, it may be difficult to recognize an image when performing composition confirmation at the time of imaging based on the image. In such a case, it becomes difficult to determine the angle of view and adjust the focus when checking the composition. In addition, the user's color blindness has various individual differences in content and degree, and it is difficult to take uniform measures.

  An object of the imaging apparatus of the present invention is to realize display of a more easily viewable image in accordance with a user when a user with color blindness confirms the composition at the time of imaging based on the image.

  An imaging apparatus according to the present invention includes an imaging unit that captures a subject image to generate an image, a display unit that displays the image for composition confirmation, an acquisition unit that acquires information about color blindness of a user, and the information And a correction unit that corrects the composition confirmation image displayed on the display unit.

  Preferably, the correction unit performs composition processing for displaying the composition displayed on the display unit by performing at least one of image processing on the image for composition confirmation and control of a light emission ratio of each color in the display unit. The image may be corrected.

  Preferably, the information processing apparatus further includes an operation unit that receives an operation by the user, and a diagnosis unit that controls the display unit and the operation unit to diagnose color blindness of the user, and the acquisition unit includes the diagnosis unit The information may be acquired in accordance with the diagnosis result obtained by.

  Preferably, the acquisition unit may acquire at least one of the information and information used for calculating the information from outside the imaging apparatus.

  Preferably, the image processing unit may further include an image processing unit that performs image processing on the image generated by the imaging unit based on the correction content of the correction unit.

  Preferably, the information indicating the correction content by the correction unit, the information indicating the content of the image processing by the image processing unit, and the image by the image processing unit in association with the image after the image processing by the image processing unit. You may further provide the recording part which records at least one among the images before a process.

  Preferably, the information processing apparatus may further include a recording unit that records information indicating details of correction performed by the correction unit and the image generated by the imaging unit in association with each other.

  Preferably, the information processing apparatus may further include an output unit that outputs information indicating details of correction performed by the correction unit to the outside of the imaging device.

  Preferably, the information processing apparatus may further include an output unit that outputs information indicating a diagnosis result by the diagnosis unit to the outside of the imaging apparatus.

  According to the imaging apparatus of the present invention, when a user with color vision impairment confirms a composition at the time of imaging based on an image, it is possible to realize display of an image that is easier to see according to the user.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the present embodiment, an electronic camera provided with a so-called electronic viewfinder will be described as an example.

  FIG. 1 is a diagram illustrating a configuration of an electronic camera 1 according to the present embodiment. As shown in FIG. 1, the electronic camera 1 includes a photographing lens 2, a diaphragm 3, a sub monitor 4, an eyepiece lens 5, an image sensor 6, a main monitor 7, and a control unit 8.

  The sub monitor 4 and the main monitor 7 include a liquid crystal display element, an organic EL element, and the like. The imaging element 6 is a semiconductor device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The control unit 8 comprehensively controls each unit of the electronic camera 1. The control unit 8 includes a memory (not shown) therein, and stores a program for controlling each unit in advance.

  The sub monitor 4 is a so-called electronic viewfinder used for composition confirmation. The user can determine the angle of view and adjust the focus when checking the composition by viewing the sub monitor 4 through the eyepiece 5.

  FIG. 2 is a functional block diagram of the electronic camera 1 of the present embodiment. As shown in FIG. 2, the electronic camera 1 includes an imaging unit 20 including an A / D conversion unit (not shown), a release button (not shown), a selection button, and the like in addition to the photographing lens 2, the diaphragm 3, and the imaging element 6. Including an operation unit 21, an image processing unit 22 that performs image processing on an image generated by the imaging unit 20, a recording unit 23 that includes a memory card (not shown) and the like and that records an image generated by the imaging unit 20, and an external device Each part of the connectable external interface unit 24 is provided.

  The imaging unit 20, the image processing unit 22, the recording unit 23, and the external interface unit 24 are connected to the control unit 8. Further, the control unit 8 detects the state of the operation unit 21. Further, the output of the control unit 8 is connected to the sub monitor 4 and the main monitor 7, respectively.

  In the electronic camera 1 having the configuration described above, the control unit 8 controls the imaging unit 20 at the time of imaging, captures a subject image by the imaging element 6, controls the image processing unit 22, performs image processing, and displays a through image. Generated and displayed on the sub-monitor 4. When a release button (not shown) of the operation unit 21 is operated, the control unit 8 controls the image pickup unit 20 to pick up a subject image, and controls the image processing unit 22 to perform image processing to display the image. Generate and record in the recording unit 23. The image generated at this time is distinguished from the above-described through image, and is hereinafter referred to as “main image”. At the time of reproduction, the control unit 8 reads an image from the recording unit 23 according to a user instruction and displays the image on the main monitor 7.

  By the way, when a user with color blindness uses the electronic camera 1, it may be difficult to recognize an image when performing composition confirmation at the time of imaging based on a through image displayed on the sub-monitor 4. In such a case, as described above, it becomes difficult to determine the angle of view and adjust the focus when confirming the composition. Therefore, in the present embodiment, a process for realizing a display that is easier to see for a user with a color blindness is performed.

  FIG. 3 is a flowchart showing the operation of the control unit 8 at the time of initial setting.

  In step S1, the control unit 8 determines whether or not to perform a color blindness diagnosis. The control unit 8 displays a message asking the user whether or not to perform color blindness diagnosis on the sub monitor 4 or the main monitor 7, and obtains the user's answer via the operation unit 21. Then, the control unit 8 proceeds to step S2 when the user answers that the color blindness diagnosis is performed, and ends the initial setting when it answers that the color blindness diagnosis is not performed.

  In step S2, the control unit 8 sequentially displays questions and obtains answers. The control unit 8 sequentially displays the questions on the sub monitor 4 or the main monitor 7 and acquires the user's answer via the operation unit 21. When importance is attached to the way the through image displayed on the sub monitor 4 is viewed, it is preferable to make a diagnosis by displaying a question on the sub monitor 4. The question may be a known question used for diagnosing color blindness. For example, an Ishihara-style inspection table shown in FIG. 4A, a Tokyo Medical University table shown in FIG. 4B, a standard color vision inspection table (not shown), or the like may be used. Each question is preferably one that can be selectively answered such as “YES”, “NO”, “left”, “right”, etc. so that it can be answered easily via the operation unit 21.

  In step S <b> 3, the control unit 8 diagnoses the presence / absence, type, and degree of color blindness based on the answer acquired in step S <b> 2.

  In step S4, the control unit 8 determines whether or not there is a color blindness based on the diagnosis result of step S3. Then, when it is determined that there is a color blindness, the control unit 8 proceeds to step S5, and when it is determined that there is no color blindness, the initial setting is terminated.

  In step S5, the control unit 8 records the diagnosis result in step S3 in a memory (not shown) in the control unit 8.

  In step S6, the control unit 8 determines whether or not to output the diagnosis result to the outside. The control unit 8 displays a message asking the user whether or not to output the diagnosis result to the sub monitor 4 or the main monitor 7, and obtains the user's answer via the operation unit 21. The control unit 8 proceeds to step S7 when the user replies to output the diagnosis result to the outside, and proceeds to step S8 when replies not to output the diagnosis result to the outside.

  In step S7, the control unit 8 outputs the diagnosis result of step S3 via the external interface unit 24.

  The output diagnosis result can be used in various ways as a simple diagnosis result of color blindness. For example, it is useful for optimizing output in an output device such as an external display device or printer.

  In step S <b> 8, the control unit 8 accepts the setting of the diagnostic result application target according to a procedure described later.

  In step S9, the control unit 8 determines whether or not to output the setting content to the outside. The control unit 8 displays a message asking the user whether to output the setting contents to the outside on the sub monitor 4 or the main monitor 7, and obtains the user's answer via the operation unit 21. The control unit 8 proceeds to step S10 when the user replies that the setting content is output to the outside, and ends the initial setting when replies that the setting content is not output to the outside.

  In step S <b> 10, the control unit 8 outputs the setting content in step S <b> 8 via the external interface unit 24.

  The output setting contents can be used in various ways as the setting contents corresponding to the color blindness of the user. For example, in an output device such as an external display device or printer, it can be diverted to a setting for optimizing the output.

  A part or all of the initial setting process described above may be performed at a timing desired by the user. In other words, it is preferable that the color blindness diagnosis and the setting of the application target of the diagnosis result can be appropriately executed other than at the initial setting. In addition, when the electronic camera 1 is shared by a plurality of users, it is preferable to individually record the results of color blindness diagnosis and the setting of the application target of the diagnosis results for each user.

  Next, details of the setting of the application target of the diagnosis result described in step S8 of the flowchart of FIG. 3 will be described using the flowchart of FIG.

  In step S <b> 11, the control unit 8 displays a menu as shown in FIG. 6 on the sub-monitor 4 or the main monitor 7, and acquires the user's answer via the operation unit 21. If the user answers that both the through image and the main image are to be applied, the control unit 8 proceeds to step S12, and otherwise proceeds to step S17 described later.

  In step S <b> 12, the control unit 8 reads a through image correction value from a memory (not shown) in the control unit 8. A table shown in FIG. 7 is stored in advance in a memory (not shown) in the control unit 8. As shown in FIG. 7, the table stores through image correction values (F1 to F6) and main image correction values (f1 to f6) for each classification based on the diagnosis result of color blindness. .

  The through-image correction values (F1 to F6) are correction values related to image processing for displaying the through-image displayed on the sub-monitor 4 more easily according to the color blindness of the user. Specifically, it is a correction value for replacing a difficult-to-see color combination with another color combination or optimizing the brightness, saturation, etc. of each color according to the type and degree of color blindness of the user. Since the contents of the correction value are the same as those of the known technique, detailed description thereof is omitted.

  The main image correction values (f1 to f6) are correction values related to image processing for correcting the main image generated by the imaging unit 20 and recorded in the recording unit 23 according to the color blindness of the user. is there. Specifically, similar to the through image correction values (F1 to F6) described above, depending on the type and degree of color blindness of the user, a combination of colors that are difficult to see is replaced with a combination of other colors, or the brightness of each color. A correction value for optimizing saturation and the like. The content of the correction value is also the same as that of the publicly known technology, and thus detailed description thereof is omitted. The main image correction values (f1 to f6) are preferably associated with the through image correction values (F1 to F6). If the through image correction values (F1 to F6) and the main image correction values (f1 to f6) are associated with each other, the through image displayed on the sub monitor 4 and the main image recorded on the recording unit 23 are displayed. This is because the expression is close. The main image correction values (f1 to f6) may be appropriately calculated based on the through image correction values (F1 to F6).

  The control unit 8 reads one of the through-image correction values (F1 to F6) according to the diagnosis result in step S3 of the flowchart of FIG.

  In step S <b> 13, the control unit 8 accepts designation of whether or not to attach a correction value for a through image to the main image. The control unit 8 displays a message asking the user whether or not to attach a correction value for through image to the main image on the sub monitor 4 or the main monitor 7, and obtains the user's answer via the operation unit 21.

  When the correction value for the through image is attached to the main image, the control unit 8 records the correction value for the through image as auxiliary information such as tag information in association with the main image. The attached through-image correction value can be used in various ways as a correction value corresponding to the color blindness of the user. For example, in an output device such as an external display device or printer, it can be diverted to a setting for optimizing the output.

  In step S <b> 14, the control unit 8 reads the correction value for the main image from a memory (not shown) in the control unit 8. The control unit 8 reads out one of the main image correction values (f1 to f6) according to the diagnosis result in step S3 of the flowchart of FIG.

  In step S <b> 15, the control unit 8 accepts designation as to whether or not a correction value for the main image is attached to the main image. The control unit 8 displays a message asking the user whether or not the correction value for the main image is attached to the main image on the sub monitor 4 or the main monitor 7, and obtains the user's answer via the operation unit 21.

  When the correction value for the main image is attached to the main image, the control unit 8 records the correction value for the main image as auxiliary information such as tag information in association with the main image. The accompanying correction value for the main image can be used in various ways as a correction value corresponding to the color blindness of the user. For example, it can be diverted to image processing on an image generated by an external imaging device. In addition, in an output device such as an external display device or a printer, it can be diverted to a setting for optimizing the output.

  In step S <b> 16, the control unit 8 receives a designation as to whether or not an image before image processing is attached to the main image. The control unit 8 displays on the sub monitor 4 or the main monitor 7 a message asking the user whether or not to attach an image before image processing to the main image, and obtains the user's answer via the operation unit 21.

  When an image before image processing is attached to the main image, the control unit 8 records the image before image processing in association with the main image as auxiliary information such as tag information. The attached image before image processing can be used in various ways. For example, use images before and after image processing, such as using images before image processing to show to viewers without color blindness, and using images after image processing to show to viewers with color blindness. Can do.

  In step S <b> 17, the control unit 8 proceeds to step S <b> 18 when the user answers that only through images are to be applied in step S <b> 11, and proceeds to step S <b> 20 described later otherwise.

  In step S18, similarly to step S12, the control unit 8 reads one of the through-image correction values (F1 to F6) according to the diagnosis result in step S3 of the flowchart of FIG.

  In step S19, the control unit 8 accepts designation as to whether or not a through image correction value is attached to the main image, as in step S13.

  In step S20, the control unit 8 proceeds to step S21 when the user replies that only the main image is to be applied in step S11, and otherwise proceeds (when the user replies that there is no application target). Ends a series of processing.

  In step S21, similarly to step S14, the control unit 8 reads out one of the main image correction values (f1 to f6) according to the diagnosis result in step S3 of the flowchart of FIG.

  In step S22, the control unit 8 accepts designation as to whether or not the correction value for the main image is attached to the main image, as in step S15.

  In step S23, the control unit 8 accepts designation as to whether or not an image before image processing is attached to the main image, as in step S16.

  In step S24, the control unit 8 sets each unit. The setting includes the following two types of elements.

(1) About the application target of a diagnostic result The control part 8 sets the image made into the application object in step S11, S17, S20 to the image process part 22. FIG. As a result, the image processing unit 22 performs image processing based on the read correction values (steps S12, S14, S18, and S21) on only the images to be applied by the user among the through image and the main image.

(2) Recording of Main Image The control unit 8 sets information (each correction value or image before image processing) that is added to the main image in steps S13, S15, S16, S19, S22, and S23. As a result, the control unit 8 records only the information added by the user to the main image among the correction values and the image before image processing as the auxiliary information of the main image.

  After the initial setting described above is completed, the operation of the control unit 8 when capturing the main image will be described with reference to the flowchart shown in FIG.

  In step S31, the control unit 8 controls each unit to capture a subject image, and generates a through image. At this time, when the through image is an application target of the diagnosis result, the control unit 8 corrects the image using the through image correction values (F1 to F6).

  In step S <b> 32, the control unit 8 displays the through image generated in step S <b> 31 on the sub monitor 4.

  In step S <b> 33, the control unit 8 determines whether an imaging instruction has been given via the operation unit 21. The control unit 8 repeats the processes of step S31 and step S32 until an imaging instruction is given. When the imaging instruction is given, the process proceeds to step S34.

  In step S34, the control unit 8 controls each unit to capture a subject image, and generates a main image. At this time, when the main image is an application target of the diagnosis result, the control unit 8 corrects the image using the main image correction values (f1 to f6).

  In step S35, the control unit 8 records the main image generated in step S34 on the recording unit 23. At this time, the control unit 8 records the information specified in the setting of the application target (information described in the flowchart of FIG. 5) as supplementary information of the main image.

  As described above, according to the present embodiment, the composition displayed on the display unit is obtained by acquiring information related to the color blindness of the user and performing image processing on the composition confirmation image based on the acquired information. Correct the confirmation image. Therefore, when a user with color blindness confirms the composition at the time of imaging based on the image, it is possible to realize display of an image that is easier to see according to the user.

  Further, according to the present embodiment, the display unit and the operation unit are controlled to diagnose the user's color blindness, and information related to the user's color blindness is acquired according to the diagnosis result. Therefore, an accurate diagnosis result can be obtained by making a diagnosis based on how the user sees the electronic camera to be used. In addition, by correcting the composition confirmation image according to the diagnosis result, it is possible to realize a more easily viewable image display.

  In addition, according to the present embodiment, image processing is performed on an image generated by imaging based on the correction content of the composition confirmation image displayed on the display unit. Therefore, the composition confirmation image (through image) displayed on the display unit and the image (main image) generated by the imaging can be made close in expression.

  In the present embodiment, an example in which an image displayed on the sub-monitor 4 is corrected so as to be displayed more easily according to a user's color blindness using an image processing technique has been described. It is not limited to examples. For example, when the sub monitor 4 is configured to include a plurality of color backlights, the light emission ratio of each color of the backlight may be controlled based on the diagnosis result of color blindness instead of performing image processing. For example, when the backlight has three colors of R, G, and B, the same effect as in the case of using the image processing method can be obtained by appropriately controlling the light emission ratio of these three colors. The same applies to a self-luminous display element. When the light emission ratio of each color of the display unit is controlled instead of the image processing method, an effect of shortening the display response speed can be expected as compared with the case of performing image processing. A similar effect can be obtained by preparing a plurality of optical filters in advance and appropriately replacing the optical filters based on the diagnosis result of color blindness.

  Note that two or more methods among an image processing method, a method for controlling the light emission ratio of each color of the display unit, and a method using an optical filter may be appropriately combined and executed.

  Further, in the present embodiment, an example of performing color blindness diagnosis using the electronic camera 1 has been shown, but the present invention is not limited to this example. For example, the color blindness diagnosis may be performed in advance using a device such as a computer, and information corresponding to the diagnosis result may be acquired via the external interface unit 24. Moreover, it is good also as a structure which inputs the information equivalent to a diagnostic result via the operation part 21. FIG.

  In addition, part or all of the processing described using the sub monitor 4 in the present embodiment may be performed using the main monitor 7. For example, a through image may be displayed using the main monitor 7. When performing a color blindness diagnosis using the main monitor 7, if the main monitor 7 is provided with a touch panel, a complicated answer such as “tracing a predetermined character” can be accepted. Further, the present invention can be similarly applied to an electronic camera provided with only one monitor (only the sub monitor 4 or only the main monitor 7).

  In the present embodiment, the content automatically set by the electronic camera 1 may be configured to be appropriately adjusted based on a user operation. For example, it is good also as a structure which can adjust the correction value demonstrated using FIG. 7 based on user operation. By adopting such a configuration, it is possible to realize a more preferable correction according to the state and preference of the color blindness of the user.

  Further, the electronic camera 1 described in the present embodiment may be an electronic camera that captures a still image, an electronic camera that captures a moving image, or both a still image and a moving image. An electronic camera for imaging may be used. Further, the present invention can be similarly applied to a so-called silver salt camera with an electronic viewfinder provided with an image sensor.

It is a figure which shows the structure of the electronic camera 1 of this embodiment. It is a functional block diagram of electronic camera 1 of this embodiment. It is a flowchart which shows operation | movement of the control part 8 at the time of initialization. It is a figure explaining a color blindness diagnosis. It is a flowchart regarding the setting of the application target of a diagnostic result. It is a figure explaining a menu. It is a figure which shows the table of a correction value. It is a flowchart which shows operation | movement of the control part 8 at the time of this image imaging.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Electronic camera, 4 ... Sub monitor, 6 ... Imaging device, 7 ... Main monitor, 8 ... Control part, 20 ... Imaging part, 22 ... Image processing part, 23 ... Recording part, 24 ... External interface part

Claims (9)

An imaging unit that captures a subject image and generates an image;
A display unit for displaying the image for composition confirmation;
An acquisition unit for acquiring information on color blindness of the user;
An image pickup apparatus comprising: a correction unit that corrects the image for composition confirmation displayed on the display unit based on the information. The imaging device according to claim 1,
The correction unit corrects the image for composition confirmation displayed on the display unit by performing at least one of image processing on the image for composition confirmation and control of a light emission ratio of each color in the display unit. An imaging apparatus characterized by: The imaging device according to claim 1,
An operation unit for receiving an operation by the user;
A diagnostic unit that controls the display unit and the operation unit to diagnose color blindness of the user;
The said acquisition part acquires the said information according to the diagnostic result by the said diagnostic part. The imaging device characterized by the above-mentioned. The imaging device according to claim 1,
The said acquisition part acquires at least one of the said information and the information used for calculation of the said information from the exterior of the said imaging device. The imaging device characterized by the above-mentioned. The imaging device according to claim 1,
An imaging apparatus, further comprising: an image processing unit that performs image processing on the image generated by the imaging unit based on the correction content of the correction unit. The imaging apparatus according to claim 5,
In association with the image after the image processing by the image processing unit, information indicating the correction content by the correction unit, information indicating the content of the image processing by the image processing unit, an image before the image processing by the image processing unit, An image pickup apparatus, further comprising: a recording unit that records at least one of the two. The imaging device according to claim 1,
An imaging apparatus, further comprising: a recording unit that records information indicating details of correction by the correction unit and the image generated by the imaging unit in association with each other. The imaging device according to claim 1,
An imaging apparatus, further comprising: an output unit that outputs information indicating details of correction performed by the correction unit to the outside of the imaging apparatus. The imaging device according to claim 3.
An image pickup apparatus, further comprising: an output unit that outputs information indicating a diagnosis result by the diagnosis unit to the outside of the image pickup apparatus.

Images