JP2013058861A - Image processor, and method and program for controlling image processor - Google Patents

Abstract

A user-preferred image is easily generated.
An image processing apparatus includes a first processing unit, a second processing unit, and a control unit. The first processing unit gives a first effect to the image. The second processing unit is an effect different from the first effect and gives a plurality of types of second effects to the image. When the user operation received by the operation receiving unit satisfies a predetermined condition, the control unit performs control for giving the first effect by the first processing unit to the image according to the user operation. Further, when the user operation does not satisfy the predetermined condition, the control unit performs control for giving any one of the second effects by the second processing unit to the image according to the user operation.
[Selection] Figure 1

Description

  The present technology relates to an image processing apparatus. Specifically, the present invention relates to an image processing apparatus that handles images, a control method thereof, and a program that causes a computer to execute the method.

  In recent years, an image processing apparatus (for example, an imaging apparatus such as a digital still camera) that captures an image of a subject such as a person and generates an image and records the generated image as an image content (image file) has become widespread. A number of techniques for applying various effects to the image generated in this way have been proposed.

  For example, there has been proposed an image data processing apparatus that performs sharpening processing within an area set by a user operation among images captured from a digital still camera, and performs blurring processing outside the area. (For example, refer to Patent Document 1).

Japanese Patent Laid-Open No. 11-144026

  According to the above-described conventional technology, the telephoto effect can be realized with a simple configuration.

  Here, since there are a variety of user preferences, it is assumed that there are a variety of user preferences with respect to the degree of blurring of an image generated by the imaging apparatus. Therefore, for example, if an appropriate process according to the user's preference can be performed by a relatively easy operation during the imaging operation, it is considered that an image preferred by the user can be easily generated.

  The present technology has been created in view of such a situation, and an object thereof is to easily generate a user-preferred image.

  The present technology has been made to solve the above-described problems. The first aspect of the present technology is a first processing unit that gives a first effect to an image and an effect different from the first effect. A second processing unit that applies a plurality of types of second effects to the image, and when the user operation received by the operation receiving unit satisfies a predetermined condition, the first effect by the first processing unit is determined according to the user operation. If the user operation does not satisfy a predetermined condition, control for giving any one of the second effects by the second processing unit to the image according to the user operation is performed. An image processing apparatus including a control unit to perform, a control method thereof, and a program for causing a computer to execute the method. Thereby, when the user operation satisfies the predetermined condition, the first effect by the first processing unit is given to the image according to the user operation, and when the user operation does not satisfy the predetermined condition, the second processing unit This brings about the effect that any one of the second effects is applied to the image in accordance with the user operation.

  Further, in the first aspect, an optical system may be further provided, and the control unit may give the first effect to the image by controlling the optical system. This brings about the effect | action which gives a 1st effect to an image by controlling an optical system.

  In the first aspect, the predetermined condition may be that the processing set by the user operation is within a processing range obtained by controlling the optical system. Accordingly, there is an effect that it is determined that the predetermined condition is satisfied when the processing set by the user operation is within the processing range obtained by the control of the optical system.

  In the first aspect, the first effect may be an optical blur effect resulting from the control of the optical system, and the second effect may be a digital blur effect by digital image processing. This brings about the effect | action of giving the optical blurring effect resulting from control of an optical system, or the digital blurring effect by digital image processing.

  In the first aspect, the second processing unit may be an image processing unit that applies the plurality of types of second effects by performing digital image processing on the image. This brings about the effect of giving a plurality of types of second effects by applying digital image processing to the image.

  In the first aspect, the second effect is a blur effect, and the control unit controls the image processing unit according to the user operation when the user operation does not satisfy the predetermined condition. By doing so, you may make it perform control for giving any one of the said blurring effects of a plurality of said blurring effects to the said image according to the said user operation. Thereby, when the user operation does not satisfy the predetermined condition, by controlling the image processing unit according to the user operation, any one of the plurality of types of blur effects can be selected according to the user operation. The effect is to give to the image.

  In the first aspect, the control unit may perform control for displaying an operation region image for accepting the user operation on the display unit. This brings about the effect | action of displaying the operation area | region image for accepting user operation.

  In the first aspect, the control unit includes a first operation range for performing a contact operation by a user as the user operation for giving the first effect to the image by the first processing unit, A series of linear regions including a second operation range for performing a contact operation by a user as the user operation for giving any one of the second effects to the image by the second processing unit. You may make it perform control for displaying on the said display part as an area | region image. This brings about the effect that a series of linear regions including the first operation range and the second operation range are displayed as an operation region image.

  Further, in the first aspect, the control unit performs the first operation according to a distance between a position where the contact operation is performed in the first operation range and a boundary between the first operation range and the second operation range. The level of the first effect by the first processing unit is determined, and the level of the second effect by the second processing unit is determined according to the distance between the position where the contact operation is performed in the second operation range and the boundary. You may make it control so that it may determine. Accordingly, the level of the first effect by the first processing unit is determined according to the distance between the position where the contact operation is performed in the first operation range and the boundary between the first operation range and the second operation range, and the second operation This brings about the effect that the level of the second effect by the second processing unit is determined according to the distance between the position where the contact operation is performed in the range and the boundary thereof.

  In the first aspect, the control unit converts the plurality of linear regions branched from the boundary between the first operation range and the second operation range into the plurality of types of second effects in the second operation range. You may make it perform control for displaying on the said display part as a corresponding image. Accordingly, there is an effect that a plurality of linear regions branched from the boundary between the first operation range and the second operation range are displayed as images corresponding to a plurality of types of second effects in the second operation range.

  In the first aspect, the control unit associates an image representing the second effect with a linear region related to the second effect and causes the display unit to display the image for each of the plurality of types of second effects. You may make it perform control of. This brings about the effect | action of associating the image showing the 2nd effect with the linear area | region which concerns on the 2nd effect, and displaying for every 2nd kind of 2nd effect.

  In the first aspect, the control unit may perform control to display the image on which an effect according to the user operation is given on the display unit. This brings about the effect | action of displaying the image to which the effect according to user operation was given.

  In the first aspect, the control unit is an image that is recorded in response to the recording instruction operation when a recording instruction operation for recording the image is received, and that corresponds to the user operation. Control may be performed to display an image to which the effect is given on the display unit. As a result, when a recording instruction operation is accepted, an image that is recorded according to the recording instruction operation and that has an effect according to the user operation is displayed.

  In the first aspect, an imaging unit may be further provided. This brings about the effect | action of giving the 1st effect or the 2nd effect according to user operation about the image produced | generated by the imaging part.

  According to the present technology, it is possible to achieve an excellent effect that it is possible to easily generate a user-preferred image.

It is a block diagram showing an example of functional composition of imaging device 100 in a 1st embodiment of this art. It is a figure which shows simply the imaging operation performed using the imaging device 100 in 1st Embodiment of this technique, and the imaging range of the image produced | generated by the imaging operation. It is a figure which shows simply the image produced | generated by the imaging operation performed using the imaging device 100 in 1st Embodiment of this technique. It is a figure which shows the example of a display of the operation area image for performing a blurring process about the image produced | generated by the imaging operation performed using the imaging device 100 in 1st Embodiment of this technique. 3 is a flowchart illustrating an example of a processing procedure of image recording processing by the imaging device 100 according to the first embodiment of the present technology. It is a figure which shows the example of a display (display screen 400) of the operation area | region image for performing an image process about the image produced | generated by the imaging operation performed using the imaging device 100 in 2nd Embodiment of this technique. It is a figure which shows the example of a display screen (operation area image setting screen 500) displayed on the display part 160 (input / output panel 300) of the imaging device 100 in the 3rd Embodiment of this technique. It is a figure which shows simply the image produced | generated by the imaging operation performed using the imaging device 100 in 3rd Embodiment of this technique. It is a figure which shows the example of a display of the operation area | region image for performing an image process about the image produced | generated by the imaging operation performed using the imaging device 100 in 3rd Embodiment of this technique. It is a figure which shows the example of a display of the operation area image for performing a zoom process about the image produced | generated by the imaging operation performed using the imaging device 100 in 3rd Embodiment of this technique. It is a figure which shows operation area image 610,620 displayed on the display part 160 (input / output panel 300) of the imaging device 100 in 4th Embodiment of this technique.

Hereinafter, modes for carrying out the present technology (hereinafter referred to as embodiments) will be described. The description will be made in the following order.
1. First Embodiment (Example in which a user operation for performing optical blur processing and multiple types of electronic blur processing is performed using an operation region image)
2. Second embodiment (an example in which an image subjected to a plurality of types of electronic blur processing is displayed together with an operation area image)
3. Third Embodiment (Example in which user operations for various processes are performed using an operation area image)
4). Fourth embodiment (modified example of display mode of operation region image)

<1. First Embodiment>
[Configuration example of imaging device]
FIG. 1 is a block diagram illustrating a functional configuration example of the imaging apparatus 100 according to the first embodiment of the present technology.

  The imaging apparatus 100 includes a lens unit 110, an imaging unit 120, a conversion unit 130, an image processing unit 140, a display control unit 150, a display unit 160, a recording control unit 170, a recording medium 180, and an operation reception. Unit 190 and control unit 200. Further, the imaging apparatus 100 uses, for example, a digital still camera that captures an image of a subject to generate an image (image data) and records the generated image (image data) as image content (still image content or moving image content). Realized. The imaging device 100 is an example of an image processing device described in the claims.

  The lens unit 110 includes a lens unit 111, a diaphragm 112, a lens driving unit 113, and a diaphragm driving unit 114.

  The lens unit 111 is a lens group that collects incident light from the subject, and the light collected by these lens groups is incident on the imaging unit 120 via the diaphragm 112. The lens unit 111 includes a focus lens for focusing, a zoom lens for enlarging a subject, and the like, and illustration and description of the specific arrangement configuration and the like are omitted. Each lens constituting the lens unit 111 is driven by the lens driving unit 113 and moves back and forth with respect to the subject. Thereby, a focus function and a zoom function are realized.

  The diaphragm 112 adjusts the amount of incident light passing through the lens unit 111, and the adjusted light is incident on the imaging unit 120. That is, the diaphragm 112 adjusts the amount of incident light that passes through the lens unit 111 and determines the amount of light (that is, exposure) supplied to the imaging unit 120. The diaphragm 112 is driven by the diaphragm driving unit 114, and the opening of the diaphragm is adjusted.

  The lens driving unit 113 drives each lens constituting the lens unit 111 based on an instruction from the control unit 200. In addition, the lens driving unit 113 acquires the position of each lens constituting the lens unit 111 and outputs it to the control unit 200.

  The aperture driving unit 114 drives the aperture 112 based on an instruction from the control unit 200. Further, the aperture driving unit 114 acquires the state (open / closed state) of the aperture 112 and outputs the acquired state to the control unit 200.

  As described above, the diaphragm drive unit 114 controls the opening and closing of the diaphragm 112 that constitutes the optical system (the lens unit 110) that collects light and supplies it to the imaging unit 120, thereby generating an image generated by the imaging unit 120. Is given a blurring effect (first effect). The lens unit 110 (aperture driving unit 114) is an example of a first processing unit described in the claims.

  The lens unit 110 may be an interchangeable lens unit. In this case, the lens unit 110 is attached to the imaging device 100 via a lens mount (not shown). The control unit 200 that controls the lens unit 110 can also be grasped as a processing unit (first processing unit) that provides a blurring effect (first effect).

  Here, the depth of field will be described. The depth of field indicates the range of the subject distance that is considered to be substantially focused on the subject. Generally, when this range is wide, it is referred to as “deep depth of field”, and when this range is narrow, it is referred to as “shallow depth of field”. In addition, it is widely known that the depth of field changes according to the opening / closing of the diaphragm. For example, when the aperture is opened, the depth of field becomes shallow according to the degree of opening. That is, when the F value is decreased, the depth of field becomes shallow. On the other hand, when the aperture is closed, the depth of field increases according to the degree of the aperture. That is, increasing the F value increases the depth of field.

  For example, when the diameter of the aperture of the diaphragm is the diameter H1, the range of the focus lens that is substantially focused on the subject is the focusing range W1. In this case (when the aperture of the stop has a diameter H1), when the focus lens exists within the focusing range W1, the subject is substantially focused. For this reason, the subject in a relatively wide range (the range in the optical axis direction) is focused on the subject that is slightly around the optical axis direction of the imaging apparatus 100.

  Further, for example, when the diameter of the aperture of the diaphragm is set to the diameter H2 (H2 <H1), the range of the focus lens that is substantially focused on the subject is set to the focusing range W2 (W2 <W1). In this case (when the aperture opening has a diameter H2), the subject is not substantially focused unless the focus lens exists within the focusing range W2 that is narrower than the focusing range W1. For this reason, when subjects included in the imaging range slightly move forward and backward with respect to the optical axis direction of the imaging apparatus 100, these subjects may not be focused. That is, for a subject that is slightly back and forth with respect to the optical axis direction of the imaging device 100, only a relatively narrow range of subjects is focused.

  Therefore, in the first embodiment of the present technology, an example in which an image in which the background of the main subject is blurred is generated using the above-described property of depth of field. Specifically, the aperture 112 is opened based on a user operation, and an image with a blurred background is generated so as to suit the user's preference. However, depending on the performance of the lens, if the F value is too small, it may not be possible to “blur” further. For example, in the case of using an interchangeable lens, there is an interchangeable lens including a zoom lens that has a limit on opening the aperture. For this reason, it is assumed that the user-preferred blurring process cannot be performed only by opening the aperture 112. Therefore, in the first embodiment of the present technology, blurring processing is performed by digital image processing by the image processing unit 140 together with optical processing by the lens unit 110.

  The imaging unit 120 generates an image signal (analog signal) based on an instruction from the control unit 200, and outputs the generated image signal to the conversion unit 130. Specifically, the imaging unit 120 processes an imaging element (not shown) that converts light of a subject incident through the lens unit 110 into an electrical signal, and an output signal (analog signal) of the imaging element. An analog signal processing unit (not shown). That is, in the imaging unit 120, an optical image of a subject incident through the lens unit 110 is formed on the imaging surface of the imaging element, and an analog signal is generated by performing an imaging operation in this state. . The analog signal processing unit performs analog processing such as noise removal and amplification on the analog signal to generate an image signal. Then, the generated image signal (analog signal) is output to the conversion unit 130. For example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like can be used as the imaging element.

  In addition, as these image sensors, for example, an image sensor that performs phase difference detection type focus detection (phase difference AF (Auto Focus)) by receiving transmitted light that has passed through different portions of the exit pupil is used. it can. An image sensor that performs this phase difference AF outputs a phase difference detection signal together with an image signal (analog signal). Therefore, the image processing unit 140 can calculate the subject distance of each region in the image corresponding to the image signal output from the imaging unit 120 based on the phase difference detection signal output from the imaging unit 120. Note that the subject distance is a distance from the imaging apparatus 100 to the subject.

  The conversion unit 130 converts the image signal (analog signal) output from the imaging unit 120 into a digital signal, and outputs the digital signal generated by this conversion to the image processing unit 140.

  The image processing unit 140 performs various image processing on the image signal (digital signal) output from the conversion unit 130 based on an instruction from the control unit 200, and the image signal (image data subjected to various image processing) ) To the display control unit 150 and the recording control unit 170.

  In addition, the image processing unit 140 performs electronic blurring processing on an image (image generated by the imaging unit 120) corresponding to the image signal (digital signal) output from the conversion unit 130 by image processing using a blur filter. Do. For example, the image processing unit 140 can perform different levels of electronic blur for each of a plurality of regions in the image generated by the imaging unit 120. Further, the image processing unit 140 can apply different levels of electronic blur to each region in the image generated by the imaging unit 120 depending on the subject distance associated with the region. Note that, as described above, a value calculated based on the phase difference detection signal output from the imaging unit 120 can be used as the subject distance related to each region.

  Further, the subject distance regarding the image may be calculated based on the image generated by the imaging unit 120 and each information (for example, the lens position and the focus position) at the time of generating the image. For example, a depth map (a so-called depth map) can be generated, and subject distances related to the respective areas can be obtained based on the depth map. Here, the depth map is a map composed of data representing the subject distance. As a method of generating the depth map, for example, a method such as a TOF (Time of flight) method or a blur amount analysis (Depth from Defocus) can be used. For example, the TOF method is a method of calculating the distance to the subject based on the light delay time until the light emitted from the light source is reflected by the object and reaches the sensor, and the speed of the light.

As the blurring filter, for example, a smoothing filter or a Gaussian filter (the following formula 1) can be used. The size of the Gaussian filter can be set to 20 × 20 pixels, for example.
f (x, y) = (1 / 2πσ ² ) exp {− (x ² + y ² ) / 2σ ² } Equation 1

  Here, x and y indicate pixel coordinate positions in the image. Σ represents a filter coefficient. As the filter coefficient σ (> 0), for example, a value corresponding to the subject distance associated with each region in the image generated by the imaging unit 120 can be used. For example, the filter coefficient σ can be increased as the subject distance related to each region becomes longer. Note that a value (filter coefficient σ) corresponding to the subject distance is set in advance.

  Further, the image processing unit 140 detects a human face included in the image generated by the imaging unit 120, classifies the detected face into a region including the detected face, and a region other than this, and performs blurring processing. Can do. The face detection method is based on, for example, a face detection method by matching a template in which luminance distribution information of a face is recorded with an actual image, a skin color part included in image data, a human face feature amount, or the like. A face detection method or the like can be used.

  As described above, the image processing unit 140 applies a plurality of types of blurring effects (second effect (an effect different from the first effect)) by performing digital image processing on the image generated by the imaging unit 120. The image processing unit 140 is an example of a second processing unit described in the claims.

  The display control unit 150 causes the display unit 160 to display the image output from the image processing unit 140 based on an instruction from the control unit 200. For example, the display control unit 150 sets a setting screen (for example, an operation region image setting screen 500 shown in FIG. 7) for performing various settings when performing an imaging operation, or an image generated by the imaging unit 120 (a so-called through-type). (Image, live view image) are displayed on the display unit 160. For example, the display control unit 150 causes the display unit 160 to display an operation region image (for example, the operation region image 330 illustrated in FIG. 4) for the user to perform an operation input.

  The display unit 160 is a display panel (for example, a liquid crystal finder) that displays each image based on the control of the display control unit 150. As the display unit 160, for example, a display panel such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) panel can be used.

  The recording control unit 170 performs recording control on the recording medium 180 based on an instruction from the control unit 200. For example, the recording control unit 170 causes the recording medium 180 to record the image (image data) output from the image processing unit 140 as a still image content (still image file).

  The recording medium 180 is a recording medium that stores various information (still image content and moving image content) based on the control of the recording control unit 170. Note that the recording medium 180 may be built in the imaging apparatus 100 or detachable from the imaging apparatus 100. As the recording medium 180, various recording media such as a semiconductor memory, an optical recording medium, a magnetic disk, and an HDD (Hard Disk Drive) can be used.

  The operation reception unit 190 is an operation reception unit that receives an operation performed by a user, and outputs a control signal (operation signal) corresponding to the received operation content to the control unit 200. The operation receiving unit 190 corresponds to the shutter button 191 and the input / output panel 300 shown in FIG.

  The control unit 200 controls each unit in the imaging apparatus 100 based on a control program stored in a memory (not shown). The control unit 200 is configured by, for example, a microprocessor.

  For example, the control unit 200 performs control for causing the display unit 160 to display an operation region image 330 (shown in FIG. 4) for accepting a user operation.

  In addition, for example, the control unit 200 determines whether or not the user operation received by the operation receiving unit 190 (for example, the contact operation in the operation area image 330 illustrated in FIG. 4) satisfies a predetermined condition. Here, the case where the user operation satisfies the predetermined condition is, for example, a case where the contact operation of the optical processing range 332 in the operation area image 330 illustrated in FIG. 4B is performed. That is, the control unit 200 may set a predetermined condition that a process (for example, blurring process) set by a user operation is within a process range obtained by controlling the optical system (lens unit 110). it can. For example, the control unit 200 determines that the predetermined condition is satisfied when an operation content that can give a blurring effect to the image generated by the imaging unit 120 by opening and closing the diaphragm 112 is accepted as a user operation. .

  Then, when the user operation satisfies a predetermined condition, the control unit 200 applies a blurring effect (first effect) by opening / closing the diaphragm 112 according to the user operation to an image (an image generated by the imaging unit 120). Take control to give. That is, the blurring effect (first effect) is given to the image generated by the imaging unit 120 by the control of the optical system (lens unit 110) by the control unit 200 (for example, opening and closing of the diaphragm 112). In addition, when the user operation does not satisfy the predetermined condition, the control unit 200 displays one of the blurring effects (second effect) by the image processing unit 140 according to the user operation (image capturing unit). The control for giving to the image produced | generated by 120 is performed. Thus, depending on whether or not the user operation satisfies a predetermined condition, the optical blur effect (first effect) resulting from the control of the optical system (lens unit 110) or the digital blur effect (first effect) by digital image processing. 2 effects).

[Example of imaging operation and imaging range]
FIG. 2 is a diagram schematically illustrating an imaging operation performed using the imaging apparatus 100 according to the first embodiment of the present technology and an imaging range of an image generated by the imaging operation.

  FIG. 2A shows a case where an imaging operation state performed using the imaging apparatus 100 is viewed from the side. Specifically, a state in which an imaging operation is performed using the imaging apparatus 100 with a person 701, a tree 702, a house 703, and a building group 704 as subjects is shown. In this case, the person 701 has a distance (subject distance) from the imaging apparatus 100 within the range of L1 (m), and the tree 702 has a subject distance within the range of L1 (m) to L2 (m). It shall exist. Further, it is assumed that the house 703 has a subject distance within a range of L2 (m) to L3 (m), and the building group 704 has a subject distance exceeding L3 (m). In the first embodiment of the present technology, it is assumed that the person 701 is a main subject. Here, for example, when a face of a person is detected by the image processing unit 140, the face can be set as a main subject. Further, for example, a subject specified by a user operation (for example, a touch operation on the input / output panel 300 shown in FIG. 4 or the like) can be set as a main subject.

  FIG. 2B shows an imaging range 700 (horizontal and vertical imaging ranges) of an image generated by an imaging operation performed using the imaging apparatus 100. Specifically, an imaging range 700 of an image generated by the imaging unit 120 in the state illustrated in FIG.

  As shown in FIG. 2B, an image can be generated with the person 701 as a main subject and the person 701 and its background (tree 702, house 703, building group 704) as subjects. In this case, for example, it is assumed that the user prefers an image in which only the person 701 that is the main subject is clear and the background (tree 702, house 703, building group 704) is blurred.

  Therefore, as described above, the background of the main subject can be blurred by reducing the depth of field. Further, by adjusting the depth of field, an image blurred to the user's preference can be generated. A generation example of such a blurred image is shown in FIG.

[Image generation example]
FIG. 3 is a diagram schematically illustrating an image generated by an imaging operation performed using the imaging device 100 according to the first embodiment of the present technology. FIGS. 3A and 3B show an example of an image generated after the diaphragm 112 is adjusted when the imaging operation is performed in the state shown in FIG.

  FIG. 3A shows an image 711 generated when the diaphragm 112 is fully opened while the person 701 is in focus. Thus, when the aperture stop 112 is fully opened, the focusing range is narrowed. For this reason, the subject (tree 702) slightly away from the focused subject (person 701) cannot be focused. Similarly, a subject (house 703) relatively far from the focused subject (person 701) and a subject (building group 704) farthest from the focused subject (person 701) are also described. The focus is not correct. Therefore, an image 711 in which each of the tree 702, the house 703, and the building group 704 is blurred is generated.

  FIG. 3B shows an image 712 that is generated when the diaphragm 112 is opened by a certain amount (a more closed amount than FIG. 3A) in a state where the person 701 is focused. As described above, when the diaphragm 112 is closed as compared with FIG. 3A, the focusing range becomes wider than the focusing range shown in FIG. Therefore, the subject (tree 702) that is slightly away from the focused subject (person 701) is in focus, but the subject (house) that is relatively far from the focused subject (person 701). 703) is out of focus. Similarly, the subject (building group 704) farthest from the focused subject (person 701) is not focused. Therefore, an image 712 in which each of the house 703 and the building group 704 is blurred is generated.

  FIG. 3C shows an image 713 that is generated when the diaphragm 112 is opened by a certain amount (a more closed amount than FIG. 3B) in a state where the person 701 is focused. As described above, when the diaphragm 112 is closed as compared with FIG. 3B, the in-focus range becomes wider than the in-focus range shown in FIG. For this reason, the subject (tree 702) that is slightly away from the focused subject (person 701) and the subject (house 703) that is relatively far from the focused subject (person 701). Focus is on. However, the subject (building group 704) that is farthest from the focused subject (person 701) is out of focus. Therefore, an image 713 in which the building group 704 is blurred is generated.

  As described above, by adjusting the aperture 112 based on the user operation, it is possible to blur the user's preference. However, as described above, depending on the performance of the lens, when the F value is too small, it may not be possible to “blur” any more, and it is impossible to blur the user's preference only by adjusting the aperture 112. Is also envisaged. Therefore, in the first embodiment of the present technology, blurring processing is performed by image processing by the image processing unit 140 together with optical processing by the lens unit 110. FIG. 4 shows a display example of the operation area image for performing this blurring process.

[Example of operation area image display for blurring]
FIG. 4 is a diagram illustrating a display example of an operation region image for performing a blurring process on an image generated by an imaging operation performed using the imaging device 100 according to the first embodiment of the present technology. In FIG. 4, the input / output panel 300 that integrally configures the display unit 160 and the operation receiving unit 190 is the back surface of the imaging device 100 (that is, the surface opposite to the surface on which the lens directed to the subject is provided). An example provided on the side is shown. That is, the input / output panel 300 displays various images and accepts an operation input from a user based on a detection state of an object that is close to or in contact with the display surface. The input / output panel 300 is also referred to as a touch screen or a touch panel. In addition, as the input / output panel 300, for example, an electrostatic (capacitance type) touch panel that detects contact or proximity of a conductive object (for example, a person's finger) based on a change in capacitance. Can be used.

  FIG. 4A shows an example of a display screen (display screen 310) displayed on the input / output panel 300. FIG. The display screen 310 is provided with a captured image display area 311 and an operation area image display area 320.

  The captured image display area 311 is an area for displaying an image generated by the imaging unit 120 (a so-called through image). That is, an image generated after adjusting the diaphragm 112 is displayed in the captured image display area 311.

  The operation area image display area 320 is an area for displaying an operation area image 330 for operating the degree when an image effect (blurring effect) is applied to an image generated by the imaging unit 120. The user can make a setting for performing a desired blurring process by moving the operation marker 331 on the operation area image 330. The operation region image 330 is shown in an enlarged manner in FIG.

  In addition, although other images (for example, various icons (for example, icons representing imaging modes)) and the like are displayed on the input / output panel 300, illustration and description thereof are omitted.

  FIG. 4B shows an operation area image 330 displayed in the operation area image display area 320. The operation area image 330 is an operation area image for setting a blurring process for an image generated by the imaging unit 120 by moving the operation indicator 331. The operation area includes the optical processing area 332 and the image processing area. The range 333 is classified.

  Here, the operation indicator 331 can be moved by a user's touch operation or tracing operation on the input / output panel 300. For example, the user can move the operation indicator 331 by moving the finger to a desired position in the operation region image 330 while touching the display portion of the operation indicator 331 in the operation region image 330 with a finger. . In addition, when the user performs an operation (touch operation) of touching a finger on a desired position in the operation area image 330, the operation marker 331 can be moved to the position touched by the finger. In addition to the user's touch operation and tracing operation, for example, an operation member (for example, an operation button) provided in the imaging apparatus 100 may be used to move the operation marker 331.

  The optical processing range 332 is a range for adjusting the diaphragm 112 in the lens unit 110 (that is, adjusting the F value). That is, the optical processing range 332 is a first operation range for performing a contact operation by the user as a user operation for giving the blurring effect (first effect) by the lens unit 110 to the image. Note that the contact operation includes an operation in which the user touches a finger on the input / output panel 300 and an operation in which the user brings a finger close to the input / output panel 300. Further, the diaphragm 112 is adjusted according to the movement of the operation mark 331 in the optical processing range 332. Specifically, when the operation mark 331 is moved to the end 335 of the optical processing range 332 (that is, the upper end of the operation area image 330), the diaphragm 112 is most closed. In this case, for example, an image having a sharpness in the entire image (that is, an image with a clear background or the like) is generated by the imaging unit 120. On the other hand, when the operation marker 331 is moved to the other end 336 of the optical processing range 332 (that is, the boundary portion with the image processing range 333), the diaphragm 112 is opened most. In this case, for example, the imaging unit 120 generates an image in which subjects other than the main subject (for example, background subjects) are relatively blurred. That is, the boundary portion with the image processing range 333 means a boundary where the F value can be optically lowered. In addition, when the aperture 112 is set to be closed, the setting such as shortening the shutter speed is appropriately performed according to the degree of opening / closing of the aperture 112.

  The image processing range 333 is a range for adjusting the degree of image processing by the image processing unit 140. That is, the image processing range 333 is a second operation range for performing a contact operation by the user as a user operation for giving any one of the blurring effects (second effects) by the image processing unit 140 to the image. . Further, the degree of blurring processing by the image processing unit 140 is adjusted according to the movement of the operation marker 331 in the image processing range 333.

  Here, the image processing range 333 is configured by three ranges branched from the boundary portion with the optical processing range 332 (that is, by three branches branched from the boundary portion with the optical processing range 332). It is configured). When the operation marker 331 moves in the image processing range 333 (when the operation marker 331 exists in the image processing range 333), the aperture 112 is maintained in the most open state. Then, only the degree of blurring processing by the image processing unit 140 is changed according to the movement of the operation marker 331 in the image processing range 333.

  Specifically, when the operation marker 331 is moved to the end 336 of the image processing range 333, the operation is the same as when the operation marker 331 is moved to the end 336 of the optical processing range 332. That is, the imaging unit 120 generates an image with the aperture 112 being fully opened. In this case, the degree of blurring processing by the image processing unit 140 is set to be the smallest.

  Further, when the operation marker 331 is moved to the other end (blur 1, blur 2, blur 3) of the image processing range 333, the largest setting is made as the degree of blurring processing according to the destination. For example, when a Gaussian filter is used as the blur filter, the highest value is set as the filter coefficient σ.

  That is, the control unit 200 displays a plurality of linear regions branched from the boundary between the optical processing range 332 and the image processing range 333 as images corresponding to a plurality of types of blurring effects (second effects) in the image processing range 333. Control for displaying on 160 is performed.

  Here, FIG. 4 shows an example in which the degree of blurring is adjusted according to the subject distance for blurs 1 to 3. For example, it is assumed that blur 1 is a range for performing an adjustment to blur a subject other than the focused subject (target subject). Further, it is assumed that the blur 2 is a range for performing an adjustment to blur a subject that is relatively far from the subject of interest among subjects other than the focused subject (target subject). Further, the blur 3 is a range for performing an adjustment to blur only a subject farther from the subject of interest (subject farther than the blur 2) among subjects other than the focused subject (subject of interest). .

  For example, when the operation marker 331 is moved to the blur 1 during the imaging operation shown in FIG. 2A, adjustment is performed to blur a subject existing in a range where the subject distance exceeds L1 (m). In this case, for example, an image such as an image 711 shown in FIG.

  In addition, when the operation marker 331 is moved to the blur 2, adjustment is performed to blur a subject existing in a range where the subject distance exceeds L2 (m). In this case, for example, an image like an image 712 shown in FIG. 3B is generated.

  Further, when the operation marker 331 is moved to the blur 3, adjustment is performed to blur a subject existing in a range where the subject distance exceeds L3 (m). In this case, for example, an image like an image 713 shown in FIG. 3C is generated.

  As described above, when blurring processing is performed according to the subject distance of the subject included in the image, the subject distance calculated based on the phase difference detection signal output from the imaging unit 120 (subject distance of each region in the image). ) Is used. That is, the image processing unit 140 calculates the subject distance of each region in the image, and based on the calculated subject distance, the region (in the image) to be adjusted according to the blurs 1 to 3 where the operation marker 331 exists. Area). Then, the image processing unit 140 performs a blurring process with a degree corresponding to the position (position in the longitudinal direction) in blurring 1 to 3 for the specified area (area in the image). As described above, the image processing unit 140 applies, as a plurality of types of second effects (blurring effects), an effect of blurring the subject included in the image for each region in the image according to the subject distance.

  Thus, the control unit 200 performs control for causing the display unit 160 to display a series of linear regions including the optical processing range 332 and the image processing range 333 as the operation region image 330. Further, the control unit 200 causes the blurring effect (first effect) by the lens unit 110 according to the distance between the position where the contact operation is performed in the optical processing range 332 and the boundary between the optical processing range 332 and the image processing range 333. Determine high and low. The control unit 200 also blurs the image processing unit 140 according to the distance between the position where the contact operation is performed in the image processing range 333 and the boundary between the optical processing range 332 and the image processing range 333 (second effect). Determine the high and low.

  In this manner, the optical processing range 332 and one branch of the image processing range 333 are arranged on the same line, and a plurality of branches of the image processing range 333 are branched from these boundaries. By adopting such a display mode, since a branch (image processing range 333) for performing related image processing (electronic blur processing) is close, the user adjusts related image processing (electronic blur processing). Can be easily performed. Further, by making the operation area image 330 a display mode in which only one image processing effect can be selected from a plurality of image processing effects, user operations of one image processing effect and the degree of the processing can be performed. It can be done easily.

  Further, since the operation area image 330 is displayed together with the through image, the user can easily understand that the image to be recorded is a pseudo image obtained by digital image processing by the image processing unit 140.

  In the captured image display area 311, an image subjected to the blurring process by the aperture 112 is displayed (that is, an image subjected to the blurring process by the image processing unit 140 is not displayed). However, for example, when a specific operation (for example, a long press operation of the operation marker 331) is performed, an image subjected to the blurring process by the image processing unit 140 may be displayed in the captured image display area 311. Good. In other words, the control unit 200 performs control for causing the display unit 160 to display an image to which an effect (blurring effect) according to a user operation is given. Accordingly, for example, before the user fully presses the shutter button 191, an image subjected to the blurring process according to the specific operation can be shown to the user.

  Further, for example, an image to which an effect corresponding to a user operation in the operation area image 330 may be displayed on the display unit 160 as a preview image. The preview image is, for example, an image to be recorded when a still image recording instruction operation is accepted, and is an image that is displayed for a certain period during and immediately after the recording process related to the recording instruction operation. . That is, when a recording instruction operation for a still image is accepted, the control unit 200 has an effect corresponding to a user operation on the operation region image 330 as an image (preview image) recorded in accordance with the recording instruction operation. Control is performed to display a given image on the display unit 160.

[Operation example of imaging device]
Next, the operation of the imaging apparatus 100 according to the first embodiment of the present technology will be described with reference to the drawings.

[Operation example of imaging device]
FIG. 5 is a flowchart illustrating an example of a processing procedure of image recording processing by the imaging device 100 according to the first embodiment of the present technology.

  First, the control unit 200 determines whether or not an imaging mode has been set (step S901). If the imaging mode has not been set, monitoring is continued. If the imaging mode is set (step S901), the imaging unit 120 generates an image by imaging processing based on an instruction from the control unit 200 (step S902).

  Subsequently, the image processing unit 140 performs image processing (for example, blurring processing) on the image generated by the imaging unit 120 and converted by the conversion unit 130 based on an instruction from the control unit 200 (step S903). The contents of this image processing are determined according to the position of the operation marker 331 in the operation area image 330 shown in FIG.

  Subsequently, the display control unit 150 displays the image subjected to the image processing by the image processing unit 140 on the display unit 160 together with the operation region image 330 based on an instruction from the control unit 200 (step S904). For example, the display screen 310 shown in FIG.

  Subsequently, the control unit 200 determines whether or not an operation (for example, a movement operation) of the operation marker 331 in the operation region image 330 has been performed (step S905), and the operation of the operation marker 331 in the operation region image 330 is performed. If not, the process proceeds to step S909. On the other hand, when the operation marker 331 is operated in the operation region image 330 (step S905), the control unit 200 determines that the position of the operation marker 331 after the movement by the operation is the optical processing range 332 in the operation region image 330. It is determined whether it is within (step S906). Steps S905 and S906 are an example of a determination procedure described in the claims.

  When the position of the operation marker 331 after the movement by the operation is within the optical processing range 332 (step S906), the control unit 200 controls the lens unit 110 based on the position of the operation marker 331 in the optical processing range 332. (Step S907). That is, the diaphragm 112 is adjusted according to the position of the operation mark 331 in the optical processing range 332. Step S907 is an example of a first control procedure described in the claims.

  If the position of the operation marker 331 after the movement is not within the optical processing range 332 (step S906), the control unit 200 controls the image processing unit 140 based on the position of the operation marker 331 in the image processing range 333. (Step S908). That is, a region to be subjected to the blurring process is determined according to the branch where the operation marker 331 exists in the image processing range 333. Further, the degree of blur is determined according to the position of the operation marker 331 on the branch (position in the longitudinal direction). Then, the control unit 200 notifies the image processing unit 140 of these determination details. Thereby, the image processing unit 140 performs image processing on the image generated by the imaging unit 120 and converted by the conversion unit 130 (step S903). Note that step S908 is an example of a second control procedure described in the claims.

  Subsequently, the control unit 200 determines whether or not a still image recording instruction operation has been performed (step S909). If the still image recording instruction operation has not been performed, the control unit 200 proceeds to step S911. For example, the still image recording instruction operation is a full pressing operation of the shutter button 191 (shown in FIG. 4A and the like). When a still image recording instruction operation is performed (step S909), the recording control unit 170 records an image subjected to image processing by the image processing unit 140 based on an instruction from the control unit 200 as a recording medium. Recording processing for recording in 180 is performed (step S910). In this case, the image that has been subjected to the blurring process by the image processing unit 140 and the image that has not been subjected to the blurring process by the image processing unit 140 may be associated with each other and recorded on the recording medium 180. Accordingly, the user can compare and view the image that has been subjected to the blurring process by the digital image processing and the image that has not been subjected to the blurring process by the digital image process.

  In addition, the control unit 200 determines whether or not an operation for ending the imaging mode has been performed (step S911). If the operation for ending the imaging mode has not been performed, the control unit 200 returns to step S902. If an operation for ending the imaging mode is performed (step S911), the operation of the image recording process is ended.

  In this example, the operation region image 330 is displayed when the imaging mode is set. However, the operation is performed only when a specific mode (for example, the background blur mode) of the imaging mode is set. The area image 330 may be displayed.

  In this example, the operation area image 330 is always displayed during the imaging operation. However, whether or not to display the operation area image 330 (ON / OFF of the operation area image 330) is determined according to the user operation. It may be possible to switch easily.

  Thus, according to the first embodiment of the present technology, it is possible to provide a user interface capable of performing optical processing by the lens unit 110 and digital image processing by the image processing unit 140 on the same line. That is, it is possible to perform a background blur operation using lens performance such as opening the aperture 112 and shortening the corresponding shutter speed, and a blur operation using digital image processing technology with one interface. As a result, even when there is a restriction on the opening of the lens like a zoom lens, it is possible to generate a blurred image (for example, an image that is completely blurred) that exceeds the lens performance. Thus, since the background blur that cannot be reproduced by the lens unit 110 can be performed by digital image processing, the lens performance of the lens unit 110 can be virtually extended.

  Also, a plurality of background blur processing methods can be displayed as the operation area image 330 and can be selected by the user. In addition, the user can easily grasp the processing results on the input / output panel 300. For this reason, for example, even a beginner who is unfamiliar with the handling of the imaging apparatus 100 can easily generate an image with a desired degree of blurring. That is, a user-preferred image can be easily generated.

<2. Second Embodiment>
In the first embodiment of the present technology, the example in which the operation region image (for example, the operation region image 330 illustrated in FIG. 4) is displayed during the imaging operation has been described. Here, if the user can easily grasp, for each branch, an image that has been subjected to image processing corresponding to the tip of each branch in the image processing range of the operation area image, a user-preferred image is generated more easily. It is considered possible.

  Therefore, in the second embodiment of the present technology, an example in which an image subjected to image processing corresponding to the tip of each branch in the image processing range of the operation region image is displayed in association with each branch is shown. Note that the configuration of the imaging apparatus according to the second embodiment of the present technology is substantially the same as the example illustrated in FIG. For this reason, a part of description is abbreviate | omitted about the part which is common in 1st Embodiment of this technique.

[Example of operation area image display for image processing]
FIG. 6 is a diagram illustrating a display example (display screen 400) of an operation region image for performing image processing on an image generated by an imaging operation performed using the imaging device 100 according to the second embodiment of the present technology. It is.

  The display screen 400 displays the images 401 to 403 that have been subjected to each image processing in the display screen 310 shown in FIG. The display screen 400 is substantially the same as the display screen 310 except that the images 401 to 403 subjected to the respective image processes are added and displayed. Therefore, common portions are denoted by the same reference numerals, Some of these descriptions are omitted.

  FIG. 6A shows the display screen 400 when the operation indicator 331 in the operation region image 330 exists in the optical processing range (the optical processing range 332 shown in FIG. 4B). FIG. 6B shows a display screen 400 when the operation indicator 331 in the operation area image 330 is present in the image processing range (the image processing range 333 shown in FIG. 4B).

  As shown in FIG. 6A, on the display screen 400, on the lower side of the operation area image 330, an image corresponding to the tip of each branch in the image processing range (the image processing range 333 shown in FIG. 4B). A display area for displaying the processed images 401 to 403 is provided. That is, when the operation marker 331 in the operation region image 330 exists in the optical processing range (the optical processing range 332 shown in FIG. 4B), the images 401 to 401 subjected to image processing corresponding to the tips of the branches are performed. Each of 403 is displayed with the same size. In this manner, the control unit 200 performs control for causing the display unit 160 to display the images 401 to 403 that have been subjected to each image processing in association with the branches related to the respective image processing effects.

  Further, as shown in FIG. 6B, when the operation indicator 331 in the operation region image 330 exists in the image processing range (the image processing range 333 shown in FIG. 4B), the operation indicator 331 exists. An image subjected to image processing corresponding to the tip of the branch is enlarged and displayed (image 405). For example, as illustrated in FIG. 6B, when the operation indicator 331 exists on the “blur 1” branch in the image processing range, the image 401 subjected to image processing corresponding to “blur 1”. (Shown in FIG. 6A) is enlarged and displayed (image 405).

  Here, the images (images 401 to 403) displayed below the operation area image 330 are generated by the image processing unit 140 regularly or irregularly. For example, when the operation marker 331 is moved to the image processing range (the image processing range 333 shown in FIG. 4B), the image processing unit 140 generates an image that has been subjected to the blurring process corresponding to the tip of each branch. Can be displayed. Regardless of the position of the operation marker 331, the image processing unit 140 can sequentially generate and display images subjected to blurring processing corresponding to the tips of the branches.

  As described above, according to the second embodiment of the present technology, the image subjected to the image processing corresponding to the tip of each branch in the image processing range 333 of the operation region image 330 is displayed in association with each branch. Can do. Thereby, during the imaging operation, the user can more easily grasp the image after the operation of the operation marker 331, and the user-preferred image can be generated more easily. In addition, a user operation for adding a desired effect can be easily performed.

  Even when an image subjected to complicated blurring processing that cannot be optically reproduced is recorded, the user can easily and intuitively check the processing result of the image on the input / output panel 300. Therefore, a new user experience can be provided in the imaging apparatus 100.

<3. Third Embodiment>
In the first and second embodiments of the present technology, an example in which the degree of blurring is adjusted when performing a process of blurring a subject included in an image has been described. Here, it is considered that the first and second embodiments of the present technology can also be applied to the case of adjusting the degree of processing when performing other image processing.

  Therefore, in the third embodiment of the present technology, an example in which an operation region image for adjusting the degree of processing when various types of image processing are performed is displayed. Note that the configuration of the imaging apparatus according to the third embodiment of the present technology is substantially the same as the example illustrated in FIG. For this reason, a part of description is abbreviate | omitted about the part which is common in 1st Embodiment of this technique.

[Example of operation area image setting screen]
FIG. 7 is a diagram illustrating a display screen example (operation area image setting screen 500) displayed on the display unit 160 (input / output panel 300) of the imaging device 100 according to the third embodiment of the present technology.

  The operation area image setting screen 500 is a display screen for selecting an operation area image to be displayed on the input / output panel 300 during an imaging operation performed using the imaging apparatus 100. The operation area image setting screen 500 is displayed according to a selection operation on a display screen (for example, a menu screen) for selecting a function to be executed by the imaging apparatus 100, for example.

  Specifically, the operation area image setting screen 500 is provided with an operation area image selection area 501, a determination button 502, and a return button 503.

  In the operation area image selection area 501, a radio button for selecting an operation area image to be displayed on the input / output panel 300 during an imaging operation performed using the imaging apparatus 100 is displayed. For example, when displaying the operation area image 330 shown in the first embodiment of the present technology, the uppermost radio button (blur 1 to 3) is selected.

  The operation region image displayed when the middle radio button (tunnel wind + blur,...) Is selected will be described in detail with reference to FIG. The operation region image displayed when the lowermost radio button (zoom 1 to 3) is selected will be described in detail with reference to FIG.

  The decision button 502 is a button that is pressed when a selection operation for selecting an operation region image to be displayed is performed in the operation region image selection region 501 and the operation is determined.

  The return button 503 is a button that is pressed when returning to the display screen displayed immediately before, for example.

[Image generation example]
FIG. 8 is a diagram schematically illustrating an image generated by an imaging operation performed using the imaging apparatus 100 according to the third embodiment of the present technology. FIGS. 8A and 8B show an example of an image after image processing is performed in the case of performing an imaging operation with the person 515 as a main subject.

  FIG. 8A shows an image 511 that has been subjected to image processing related to the tunnel effect and blurring by the image processing unit 140. Here, the tunnel effect is to give an effect as if a person 515 shot a scene existing in the tunnel by reducing the amount of light at the periphery of the image.

  For example, the image processing unit 140 performs a tunnel effect on the image generated by the imaging unit 120 and converted by the conversion unit 130 by performing image processing that reduces the amount of light at the periphery of the image and adds a predetermined effect. An image 511 is generated.

  FIG. 8B shows an image 512 that has been subjected to image processing related to sketching and blurring by the image processing unit 140. Here, the sketch-like image is an image that has been subjected to image processing so as to adjust the luminance in the image, and is an image that is drawn by a sketch.

  For example, the image processing unit 140 performs lightness binarization processing and edge extraction processing on the image generated by the imaging unit 120 and converted by the conversion unit 130. Then, the image processing unit 140 performs a superimposition process that superimposes the binarized image generated by the binarization process and the contour line image generated by the edge extraction process, thereby generating a sketch-like image 512. Generate.

  FIG. 8C shows an image 513 that has been subjected to image processing related to toy camera style and blurring by the image processing unit 140. Here, the toy camera-like image is an image in which the four corners of the image are dimmed, and is an image having an atmosphere as if taken by a toy camera.

  For example, the image processing unit 140 performs toy camera-like image processing on the image generated by the imaging unit 120 and converted by the conversion unit 130 by dimming the four corners of the image and applying predetermined effects. 513 is generated.

[Example of operation area image display for image processing]
FIG. 9 is a diagram illustrating a display example of an operation region image for performing image processing on an image generated by an imaging operation performed using the imaging apparatus 100 according to the third embodiment of the present technology. Note that the display screen 520 shown in FIG. 9 is obtained by modifying a part of the display screen 310 shown in FIG. For this reason, in FIG. 9, parts common to the display screen 310 are denoted by the same reference numerals, and a part of these descriptions is omitted.

  The operation area image 530 is an image for adjusting the degree of the image generated by the imaging unit 120 when the image processing unit 140 performs an image effect (color, monochrome, etc.). Note that the upper range (a range corresponding to the optical processing range 332 shown in FIG. 4B) is a range for adjusting the degree of color. Also, the lower range (the range corresponding to the image processing range 333 shown in FIG. 4B) is a range for adjusting the degree of monochrome, and different images are used depending on the branches that are branched. Processing is performed.

[Display example of operation area image for zoom processing]
FIG. 10 is a diagram illustrating a display example of an operation region image for performing zoom processing on an image generated by an imaging operation performed using the imaging device 100 according to the third embodiment of the present technology. Note that the display screen 540 shown in FIG. 10 is obtained by modifying a part of the display screen 310 shown in FIG. For this reason, in FIG. 10, parts common to the display screen 310 are denoted by the same reference numerals, and a part of these descriptions is omitted.

  The operation region image 550 is an image for adjusting the degree of zoom processing performed on the image generated by the imaging unit 120. The upper range (the range corresponding to the optical processing range 332 shown in FIG. 4B) is a range for adjusting the optical zoom magnification. This optical zoom process is performed by the lens unit 110. The lower range (a range corresponding to the image processing range 333 shown in FIG. 4B) is a range for adjusting the degree of electronic zoom (digital zoom), and depends on each branch that is branched. Different zoom processes are performed. This electronic zoom process is performed by the image processing unit 140. For example, zoom 1 is a branch for zooming the left region in the image, zoom 2 is a branch for zooming the central region in the image, and zoom 3 is a branch for zooming the right region in the image. be able to.

  As described above, according to the third embodiment of the present technology, image processing that requires complicated processing such as a background blur effect and a sketch effect can be easily performed by a one-action operation by the user. Can do. In addition, similarly to the second embodiment of the present technology, by displaying an image subjected to the processing, the user can easily confirm the effect.

<4. Fourth Embodiment>
In the first to third embodiments of the present technology, an example in which an operation region image in which three branches having substantially the same length extend downward has been shown. Here, the display mode of the branches may be changed according to the user's preference and the content of the image processing.

  Therefore, in the fourth embodiment of the present technology, an example in which the display mode of a plurality of branches in the operation region image is changed is shown. Note that the configuration of the imaging apparatus according to the fourth embodiment of the present technology is substantially the same as the example illustrated in FIG. For this reason, a part of description is abbreviate | omitted about the part which is common in 1st Embodiment of this technique.

[Operation area image display example]
FIG. 11 is a diagram illustrating operation region images 610 and 620 displayed on the display unit 160 (input / output panel 300) of the imaging device 100 according to the fourth embodiment of the present technology.

  FIG. 11A shows an operation region image 610 in which a plurality of branches are arranged on one of the left and right when a line extending vertically is used as a reference. The operation area image 610 includes an operation indicator 611, a first operation range 612, and a second operation range 613.

  FIG. 11B shows an operation region image 620 in which the lengths of the left and right branches are changed with reference to a vertically extending line. The operation area image 620 includes an operation indicator 621, a first operation range 622, and a second operation range 623.

  About these changes, you may make it set by a user's manual operation, and you may make it set automatically according to each image process.

  In the embodiment of the present technology, an operation region image configured by three branches is illustrated, but an operation region image may be configured by two or four or more branches. Also in this case, similarly to the fourth embodiment of the present technology, the arrangement of the branches and the length of the branches may be changed as appropriate. Further, as in the second embodiment of the present technology, each image that has been subjected to each process is displayed in association with each branch, so that the user can easily confirm the effect.

  In the embodiment of the present technology, the imaging device 100 including the imaging unit 120 has been described as an example. However, the embodiment of the present technology can be applied to an image processing device to which the imaging unit can be attached and detached. Further, the embodiment of the present technology can be applied to an image processing device such as a mobile phone with an imaging function or a mobile terminal device with an imaging function.

  The above-described embodiment shows an example for embodying the present technology, and the matters in the embodiment and the invention-specific matters in the claims have a corresponding relationship. Similarly, the invention specific matter in the claims and the matter in the embodiment of the present technology having the same name as this have a corresponding relationship. However, the present technology is not limited to the embodiment, and can be embodied by making various modifications to the embodiment without departing from the gist thereof.

  Further, the processing procedure described in the above embodiment may be regarded as a method having a series of these procedures, and a program for causing a computer to execute these series of procedures or a recording medium storing the program. You may catch it. As this recording medium, for example, a CD (Compact Disc), an MD (MiniDisc), a DVD (Digital Versatile Disk), a memory card, a Blu-ray Disc (registered trademark), or the like can be used.

In addition, this technique can also take the following structures.
(1) a first processing unit that gives a first effect to an image;
A second processing unit that is an effect different from the first effect and gives a plurality of types of second effects to the image;
When the user operation received by the operation receiving unit satisfies a predetermined condition, the first effect by the first processing unit is given to the image according to the user operation, and when the user operation does not satisfy the predetermined condition Is an image processing apparatus comprising: a control unit that performs control for giving any one of the second effects by the second processing unit to the image according to the user operation.
(2) further comprising an optical system,
The image processing apparatus according to (1), wherein the control unit gives the first effect to the image by controlling the optical system.
(3) The image processing apparatus according to (2), wherein the predetermined condition is that the processing set by the user operation is within a processing range obtained by controlling the optical system.
(4) The first effect is an optical blur effect resulting from the control of the optical system,
The image processing apparatus according to (2) or (3), wherein the second effect is a digital blur effect by digital image processing.
(5) The image processing according to any one of (1) to (4), wherein the second processing unit is an image processing unit that applies the plurality of types of second effects by performing digital image processing on the image. apparatus.
(6) The second effect is a blur effect,
When the user operation does not satisfy the predetermined condition, the control unit controls the image processing unit in accordance with the user operation to obtain one of the plurality of types of blur effects. The image processing apparatus according to (5), wherein control for giving to the image is performed according to a user operation.
(7) The image processing device according to any one of (1) to (6), wherein the control unit performs control for displaying an operation region image for receiving the user operation on a display unit.
(8) The control unit includes a first operation range for performing a contact operation by a user as the user operation for giving the first effect to the image by the first processing unit, and the second processing unit. A series of linear regions including a second operation range for performing a contact operation by a user as the user operation for giving any one of the second effects to the image as the operation region image, the display unit The image processing apparatus according to (7), wherein the image processing apparatus performs control for display on the screen.
(9) The control unit may be configured such that the first processing unit performs the first operation according to a distance between a position where the contact operation is performed in the first operation range and a boundary between the first operation range and the second operation range. Control is performed so as to determine the level of the second effect by the second processing unit according to the distance between the position where the contact operation is performed in the second operation range and the boundary. The image processing apparatus according to (8), which is performed.
(10) The control unit displays the plurality of linear regions branched from the boundary between the first operation range and the second operation range as images corresponding to the plurality of types of second effects in the second operation range. The image processing apparatus according to (8) or (9), wherein the image processing apparatus performs control for display on a unit.
(11) The control unit performs control to display an image representing the second effect on the display unit for each of the plurality of types of second effects in association with a linear region related to the second effect. The image processing apparatus according to 10).
(12) The image processing device according to any one of (1) to (11), wherein the control unit performs control to display the image on which an effect according to the user operation is given on a display unit.
(13) When the recording instruction operation for recording the image is accepted, the control unit is an image recorded according to the recording instruction operation, and has an effect according to the user operation. The image processing apparatus according to any one of (1) to (12), wherein control is performed to display an image on a display unit.
(14) The image processing device according to any one of (1) to (13), further including an imaging unit.
(15) a determination procedure for determining whether or not the user operation received by the operation receiving unit satisfies a predetermined condition;
When the user operation satisfies a predetermined condition, a first control procedure for performing control for giving the first effect to the image according to the user operation by the first processing unit that gives the first effect to the image;
If the user operation does not satisfy a predetermined condition, any one of the second effects by the second processing unit that is different from the first effect and gives a plurality of types of second effects to the image A control method for an image processing apparatus, comprising: a second control procedure for performing control for giving an effect to the image according to the user operation.
(16) a determination procedure for determining whether or not a user operation received by the operation receiving unit satisfies a predetermined condition;
When the user operation satisfies a predetermined condition, a first control procedure for performing control for giving the first effect to the image according to the user operation by the first processing unit that gives the first effect to the image;
If the user operation does not satisfy a predetermined condition, any one of the second effects by the second processing unit that is different from the first effect and gives a plurality of types of second effects to the image The program which makes a computer perform the 2nd control procedure which performs control for giving an effect to the said image according to the said user operation.

DESCRIPTION OF SYMBOLS 100 Imaging device 110 Lens unit 111 Lens part 112 Aperture 113 Lens drive part 114 Aperture drive part 120 Imaging part 130 Conversion part 140 Image processing part 150 Display control part 160 Display part 170 Recording control part 180 Recording medium 190 Operation reception part 191 Shutter button 200 Control unit 300 Input / output panel

Claims (16)

A first processing unit that gives a first effect to an image;
A second processing unit that is an effect different from the first effect and gives a plurality of types of second effects to the image;
When the user operation received by the operation receiving unit satisfies a predetermined condition, the first effect by the first processing unit is given to the image according to the user operation, and when the user operation does not satisfy the predetermined condition Is an image processing apparatus comprising: a control unit that performs control for giving any one of the second effects by the second processing unit to the image according to the user operation. Further comprising an optical system,
The image processing apparatus according to claim 1, wherein the control unit gives the first effect to the image by controlling the optical system.   The image processing apparatus according to claim 2, wherein the predetermined condition is that the processing set by the user operation is within a processing range obtained by control of the optical system. The first effect is an optical blur effect resulting from the control of the optical system,
The image processing apparatus according to claim 2, wherein the second effect is a digital blur effect by digital image processing.   The image processing apparatus according to claim 1, wherein the second processing unit is an image processing unit that applies the plurality of types of second effects by performing digital image processing on the image. The second effect is a blur effect,
When the user operation does not satisfy the predetermined condition, the control unit controls the image processing unit in accordance with the user operation to obtain one of the plurality of types of blur effects. The image processing apparatus according to claim 5, wherein control for giving to the image is performed according to a user operation.   The image processing apparatus according to claim 1, wherein the control unit performs control for displaying an operation region image for receiving the user operation on a display unit.   The control unit includes a first operation range for performing a contact operation by a user as the user operation for giving the first effect to the image by the first processing unit, and the second effect by the second processing unit. A series of linear regions including a second operation range for performing a contact operation by the user as the user operation for giving any one of the effects to the image is displayed on the display unit as the operation region image. The image processing apparatus according to claim 7, which performs control for the purpose.   The control unit has the first effect of the first processing unit according to a distance between a position where the contact operation is performed in the first operation range and a boundary between the first operation range and the second operation range. The height is determined, and control is performed so as to determine the height of the second effect by the second processing unit according to the distance between the position where the contact operation is performed in the second operation range and the boundary. 8. The image processing apparatus according to 8.   The control unit displays, on the display unit, a plurality of linear regions branching from a boundary between the first operation range and the second operation range as images corresponding to the plurality of types of second effects in the second operation range. The image processing apparatus according to claim 8, wherein control for controlling the image processing is performed.   11. The control unit according to claim 10, wherein the control unit performs control for displaying an image representing the second effect on the display unit for each of the plurality of types of second effects in association with a linear region related to the second effect. Image processing device.   The image processing apparatus according to claim 1, wherein the control unit performs control to display the image to which an effect according to the user operation is given on a display unit.   When a recording instruction operation for recording the image is received, the control unit displays an image that is recorded according to the recording instruction operation and that has an effect according to the user operation. The image processing apparatus according to claim 1, wherein the image processing apparatus performs control to be displayed on the unit.   The image processing apparatus according to claim 1, further comprising an imaging unit. A determination procedure for determining whether the user operation received by the operation receiving unit satisfies a predetermined condition;
When the user operation satisfies a predetermined condition, a first control procedure for performing control for giving the first effect to the image according to the user operation by the first processing unit that gives the first effect to the image;
If the user operation does not satisfy a predetermined condition, any one of the second effects by the second processing unit that is different from the first effect and gives a plurality of types of second effects to the image A control method for an image processing apparatus, comprising: a second control procedure for performing control for giving an effect to the image according to the user operation. A determination procedure for determining whether the user operation received by the operation receiving unit satisfies a predetermined condition;
When the user operation satisfies a predetermined condition, a first control procedure for performing control for giving the first effect to the image according to the user operation by the first processing unit that gives the first effect to the image;
If the user operation does not satisfy a predetermined condition, any one of the second effects by the second processing unit that is different from the first effect and gives a plurality of types of second effects to the image The program which makes a computer perform the 2nd control procedure which performs control for giving an effect to the said image according to the said user operation.