JP2018174543A - Electronics - Google Patents

Abstract

An area corresponding to a photographing optical system is used in an imaging area of an imaging element. An imaging unit having an imaging element that forms an image of a light beam from a replaceable imaging optical system, and an area to be activated in an imaging area of the imaging element according to information of the imaging optical system. And a control unit 71 for setting. [Selection] Figure 6

Description

  The present invention relates to an electronic device.

  There has been proposed an electronic apparatus provided with an imaging element in which a back-illuminated imaging chip and a signal processing chip are laminated (hereinafter, this imaging element is referred to as a laminated imaging element) (for example, see Patent Document 1). The multilayer imaging element is laminated so that the back-illuminated imaging chip and the signal processing chip are connected via a micro bump for each block unit including a plurality of pixels.

JP 2006-49361 A

  However, there are not many proposals for acquiring an image by capturing an image for each of a plurality of block units in an electronic device including a conventional multilayer image sensor, and the usability of the electronic device including the multilayer image sensor is not sufficient.

  In an aspect of the present invention, an object is to use an area corresponding to a photographing optical system in an imaging area of an imaging element.

  According to the first aspect of the present invention, the lens information relating to the characteristics of the imaging optical system from the imaging unit having the imaging element on which the light beams from the plurality of types of interchangeable imaging optical systems form an image and the interchangeable lens unit is included. Accordingly, an electronic device is provided that includes a control unit that sets a region to be activated in the imaging region of the imaging device.

  According to the second aspect of the present invention, there is provided a method for controlling an electronic apparatus having an imaging device that can handle a plurality of types of imaging optical systems in which a light beam from an interchangeable imaging optical system forms an image. Control of an electronic device including: acquiring lens information relating to characteristics of a photographing optical system from a unit; and setting an active region in an imaging region of an image sensor in accordance with lens information of the photographing optical system A method is provided.

  According to the third aspect of the present invention, the imaging optical from the interchangeable lens unit is added to the control device having the imaging device that can handle a plurality of types of imaging optical systems in which the light flux from the interchangeable imaging optical system forms an image. There is provided a control program for executing an acquisition process for acquiring lens information related to the characteristics of the system, and a setting process for setting an area to be activated in the imaging area of the imaging device according to the lens information of the imaging optical system. .

  According to the aspect of the present invention, it is possible to use an area corresponding to the imaging optical system in the imaging area of the imaging element.

It is sectional drawing of a multilayer type image pick-up element. It is a figure explaining the pixel arrangement | sequence and unit group of an imaging chip. It is a circuit diagram corresponding to the unit group of an imaging chip. It is a block diagram which shows the functional structure of an image pick-up element. 1 is a cross-sectional view illustrating a schematic configuration of a digital camera (electronic device) according to a first embodiment. It is a block diagram which shows the structure of the digital camera (electronic device) which concerns on 1st Embodiment. It is a figure which shows the image circle from which a size standard differs, and the area | region set in an image circle. It is a sequence diagram which shows an example of imaging | photography pre-processing. It is a figure which shows the operation state for every area | region in 1st Embodiment. It is a figure which shows the area | region corresponding to a distortion aberration. It is a figure which shows the operation state for every area | region in 2nd Embodiment. It is a flowchart which shows an example of an imaging | photography process. It is a figure for demonstrating the detection of the focus position of a main to-be-photographed object. It is a flowchart which shows an example of an area | region selection process. It is a figure which shows the selection area | region and non-selection area | region in an imaging region. It is a figure which shows the selection area | region and non-selection area | region in an imaging region. It is a figure for demonstrating the other example of the detection of the focus position of a main to-be-photographed object. It is a figure which shows the area | region set according to a peripheral light reduction. It is a block diagram which shows the structure of the imaging device and electronic device which concern on 5th Embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. However, the present invention is not limited to this. Further, in the drawings, in order to describe the embodiment, the scale is appropriately changed and expressed, for example, partly enlarged or emphasized. In each of the following embodiments, a digital camera with interchangeable lenses will be described as an example of an electronic device.

<First Embodiment>
FIG. 1 is a cross-sectional view of a multilayer image sensor. The multilayer image sensor 100 is described in Japanese Patent Application No. 2012-139026 filed earlier by the applicant of the present application. The imaging device 100 includes an imaging chip 113 that outputs a pixel signal corresponding to incident light, a signal processing chip 111 that processes the pixel signal, and a memory chip 112 that stores the pixel signal. The imaging chip 113, the signal processing chip 111, and the memory chip 112 are stacked, and are electrically connected to each other by a conductive bump 109 such as Cu.

  As shown in the figure, incident light is incident mainly in the positive direction of the Z-axis indicated by a white arrow. In the present embodiment, in the imaging chip 113, the surface on the side where incident light is incident is referred to as a back surface. Further, as shown in the coordinate axes, the left direction of the paper orthogonal to the Z axis is the X axis plus direction, and the front side of the paper orthogonal to the Z axis and the X axis is the Y axis plus direction. In the following several figures, the coordinate axes are displayed so that the orientation of each figure can be understood with reference to the coordinate axes of FIG.

  An example of the imaging chip 113 is a back-illuminated MOS image sensor. The PD layer 106 is disposed on the back side of the wiring layer 108. The PD layer 106 includes a plurality of photodiodes (Photodiode; hereinafter referred to as PD) 104 that are two-dimensionally arranged and accumulate electric charges according to incident light, and a transistor 105 provided corresponding to the PD 104. .

  A color filter 102 is provided on the incident side of incident light in the PD layer 106 via a passivation film 103. The color filter 102 is a filter that passes a specific wavelength region of visible light. The color filter 102 has a plurality of types that transmit different wavelength regions, and has a specific arrangement corresponding to each of the PDs 104. The arrangement of the color filter 102 will be described later. A set of the color filter 102, the PD 104, and the transistor 105 forms one pixel.

  On the incident light incident side of the color filter 102, a microlens 101 is provided corresponding to each pixel. The microlens 101 condenses incident light toward the corresponding PD 104.

  The wiring layer 108 includes a wiring 107 that transmits the pixel signal from the PD layer 106 to the signal processing chip 111. The wiring 107 may be multilayer, and a passive element and an active element may be provided. A plurality of bumps 109 are disposed on the surface of the wiring layer 108. The plurality of bumps 109 are aligned with the plurality of bumps 109 provided on the opposing surface of the signal processing chip 111. Then, by pressing the imaging chip 113 and the signal processing chip 111, the aligned bumps 109 are joined and electrically connected.

  Similarly, a plurality of bumps 109 are disposed on the mutually facing surfaces of the signal processing chip 111 and the memory chip 112. These bumps 109 are aligned with each other. Then, when the signal processing chip 111 and the memory chip 112 are pressurized or the like, the aligned bumps 109 are joined and electrically connected.

  The bonding between the bumps 109 is not limited to Cu bump bonding by solid phase diffusion, and micro bump bonding by solder melting may be employed. Further, for example, about one bump 109 may be provided for one unit group described later. Therefore, the size of the bump 109 may be larger than the pitch of the PD 104. In addition, a bump larger than the bump 109 corresponding to the pixel region may be provided in a peripheral region other than the pixel region where the pixels are arranged (the pixel region 113A shown in FIG. 2).

  The signal processing chip 111 includes a TSV (Through-Silicon Via) 110 that connects circuits provided on the front surface and the back surface to each other. The TSV 110 is provided in the peripheral area. The TSV 110 may be provided in the peripheral area of the imaging chip 113 or the memory chip 112.

  FIG. 2 is a diagram for explaining a pixel array and a unit group of the imaging chip. FIG. 2 particularly shows a state where the imaging chip 113 is observed from the back side. An area where pixels are arranged in the imaging chip 113 is referred to as a pixel area (imaging area) 113A. In the pixel region 113A, 20 million or more pixels are arranged in a matrix. In the example shown in FIG. 2, 16 pixels of 4 pixels × 4 pixels adjacent to each other form one unit group 131. The grid lines in FIG. 2 indicate a concept in which adjacent pixels are grouped to form a unit group 131. The number of pixels forming the unit group 131 is not limited to this, and may be about 1000, for example, 32 pixels × 64 pixels, or more or less.

  As shown in the partially enlarged view of the pixel region 113A, the unit group 131 includes four so-called Bayer arrays including four pixels of green pixels Gb and Gr, a blue pixel B, and a red pixel R in the vertical and horizontal directions. The green pixel is a pixel having a green filter as the color filter 102, and receives light in the green wavelength band of incident light. Similarly, the blue pixel is a pixel having a blue filter as the color filter 102 and receives light in the blue wavelength band. The red pixel is a pixel having a red filter as the color filter 102 and receives light in the red wavelength band.

  FIG. 3 is a circuit diagram corresponding to the unit group of the imaging chip. In FIG. 3, a rectangle surrounded by a dotted line typically represents a circuit corresponding to one pixel. Note that at least some of the transistors described below correspond to the transistor 105 in FIG.

  As described above, the unit group 131 is formed of 16 pixels. The 16 PDs 104 corresponding to the respective pixels are each connected to the transfer transistor 302. The gate of each transfer transistor 302 is connected to a TX wiring 307 to which a transfer pulse is supplied. In the present embodiment, the TX wiring 307 is commonly connected to the 16 transfer transistors 302.

  The drain of each transfer transistor 302 is connected to the source of the corresponding reset transistor 303, and a so-called floating diffusion FD (charge detection unit) between the drain of the transfer transistor 302 and the source of each reset transistor 303 is connected to the amplifier transistor 304. Connected to the gate. The drain of each reset transistor 303 is connected to a Vdd wiring 310 to which a power supply voltage is supplied. The gate of each reset transistor 303 is connected to a reset wiring 306 to which a reset pulse is supplied. In the present embodiment, the reset wiring 306 is commonly connected to the 16 reset transistors 303.

  The drain of each amplification transistor 304 is connected to a Vdd wiring 310 to which a power supply voltage is supplied. The source of each amplification transistor 304 is connected to the drain of each corresponding selection transistor 305. The gate of each selection transistor 305 is connected to a decoder wiring 308 to which a selection pulse is supplied. In the present embodiment, the decoder wiring 308 is provided independently for each of the 16 selection transistors 305. The source of each selection transistor 305 is connected to a common output wiring 309. The load current source 311 supplies current to the output wiring 309. That is, the output wiring 309 for the selection transistor 305 is formed by a source follower. Note that the load current source 311 may be provided on the imaging chip 113 side or may be provided on the signal processing chip 111 side.

  Here, the flow from the start of charge accumulation to pixel output after the end of accumulation will be described. A reset pulse is applied to the reset transistor 303 through the reset wiring 306. At the same time, a transfer pulse is applied to the transfer transistor 302 through the TX wiring 307. As a result, the potentials of the PD 104 and the floating diffusion FD are reset.

  When the application of the transfer pulse is canceled, the PD 104 converts the incident light to be received into electric charge and accumulates it. Thereafter, when the transfer pulse is applied again without the reset pulse being applied, the charge accumulated in the PD 104 is transferred to the floating diffusion FD. As a result, the potential of the floating diffusion FD changes from the reset potential to the signal potential after charge accumulation. When a selection pulse is applied to the selection transistor 305 through the decoder wiring 308, the change in the signal potential of the floating diffusion FD is transmitted to the output wiring 309 through the amplification transistor 304 and the selection transistor 305. By such an operation of the circuit, a pixel signal corresponding to the reset potential and the signal potential is output from the unit pixel to the output wiring 309.

  As shown in FIG. 3, in the present embodiment, the reset wiring 306 and the TX wiring 307 are common to the 16 pixels forming the unit group 131. That is, the reset pulse and the transfer pulse are simultaneously applied to all 16 pixels. Therefore, all the pixels forming the unit group 131 start charge accumulation at the same timing and end charge accumulation at the same timing. However, the pixel signal corresponding to the accumulated charge is selectively output to the output wiring 309 by sequentially applying the selection pulse to each selection transistor 305. In addition, the reset wiring 306, the TX wiring 307, and the output wiring 309 are provided separately for each unit group 131.

  By configuring the circuit with the unit group 131 as a reference in this way, the charge accumulation time can be controlled for each unit group 131. In other words, pixel signals with different charge accumulation times can be output between the unit groups 131. More specifically, while one unit group 131 performs charge accumulation once, the other unit group 131 repeats charge accumulation several times and outputs a pixel signal each time, so that Each frame for moving images can be output at a different frame rate between the unit groups 131.

  FIG. 4 is a block diagram illustrating a functional configuration of the image sensor. The analog multiplexer 411 sequentially selects the 16 PDs 104 that form the unit group 131. Then, the multiplexer 411 outputs each pixel signal of the 16 PDs 104 to the output wiring 309 provided corresponding to the unit group 131. The multiplexer 411 is formed on the imaging chip 113 together with the PD 104.

  The analog pixel signal output through the multiplexer 411 is amplified by an amplifier 412 formed in the signal processing chip 111. Then, the pixel signal amplified by the amplifier 412 is formed in the signal processing chip 111 by a signal processing circuit 413 that performs correlated double sampling (CDS) / analog / digital (Analog / Digital) conversion. Correlated double sampling signal processing is performed, and A / D conversion (conversion from an analog signal to a digital signal) is performed. The pixel signal is subjected to correlated double sampling signal processing in the signal processing circuit 413, whereby noise of the pixel signal is reduced. The A / D converted pixel signal is transferred to the demultiplexer 414 and stored in the pixel memory 415 corresponding to each pixel. The demultiplexer 414 and the pixel memory 415 are formed in the memory chip 112.

  The arithmetic circuit 416 processes the pixel signal stored in the pixel memory 415 and passes it to the subsequent image processing unit. The arithmetic circuit 416 may be provided in the signal processing chip 111 or may be provided in the memory chip 112. Note that FIG. 4 shows connections for one unit group 131, but actually these exist for each unit group 131 and operate in parallel. However, the arithmetic circuit 416 may not exist for each unit group 131. For example, one arithmetic circuit 416 may perform sequential processing while sequentially referring to the values in the pixel memory 415 corresponding to each unit group 131.

  As described above, the output wiring 309 is provided corresponding to each of the unit groups 131. The image sensor 100 is formed by stacking an image pickup chip 113, a signal processing chip 111, and a memory chip 112. For this reason, by using the electrical connection between the chips using the bumps 109 for the output wirings 309, the wirings can be routed without enlarging each chip in the surface direction.

  Next, blocks set in the pixel region 113A (see FIG. 2) of the image sensor 100 will be described. In the present embodiment, the pixel region 113A of the image sensor 100 is divided into a plurality of blocks. The plurality of blocks are defined to include at least one unit group 131 per block. In each block, pixels included in each block are controlled by different control parameters. That is, pixel signals having different control parameters are acquired for a pixel group included in a block and a pixel group included in another block. Examples of the control parameter include a charge accumulation time or accumulation count, a frame rate, a gain, a thinning rate, the number of addition rows or addition columns to which pixel signals are added, the number of digitization bits, and the like. Furthermore, the control parameter may be a parameter in image processing after obtaining an image signal from a pixel.

  Here, the charge accumulation time refers to the time from when PD 104 starts to accumulate charge until it ends. This charge accumulation time is also referred to as exposure time or shutter speed (shutter speed). The number of times of charge accumulation refers to the number of times the PD 104 accumulates charges per unit time. The frame rate is a value representing the number of frames processed (displayed or recorded) per unit time in a moving image. The unit of the frame rate is represented by fps (Frames Per Second). The higher the frame rate, the smoother the movement of the subject (that is, the object to be imaged) in the moving image.

  The gain means a gain factor (amplification factor) of the amplifier 412. By changing this gain, the ISO sensitivity can be changed. This ISO sensitivity is a photographic film standard established by ISO and represents how much light the photographic film can record. However, generally, ISO sensitivity is also used when expressing the sensitivity of the image sensor 100. In this case, the ISO sensitivity is a value representing the ability of the image sensor 100 to capture light. Increasing the gain improves the ISO sensitivity. For example, when the gain is doubled, the electrical signal (pixel signal) is also doubled, and the brightness is appropriate even when the amount of incident light is half. However, when the gain is increased, noise included in the electric signal is also amplified, so that noise increases.

  The thinning-out rate is the ratio of the number of pixels that do not read out pixel signals with respect to the total number of pixels in a predetermined area. For example, when the thinning rate of a predetermined area is 0, it means that pixel signals are read from all pixels in the predetermined area. Further, when the thinning rate of the predetermined area is 0.5, it means that the pixel signal is read from half of the pixels in the predetermined area. Specifically, when the unit group 131 is a Bayer array, it is read as a pixel from which pixel signals are alternately read out every other unit of the Bayer array in the vertical direction, that is, every two pixels (two rows) of the pixel unit. Pixels that are not output are set. It should be noted that the resolution of the image is reduced when the pixel signal readout is thinned out. However, since 20 million or more pixels are arranged in the image sensor 100, for example, even if thinning is performed at a thinning rate of 0.5, an image can be displayed with 10 million or more pixels. For this reason, it is considered that the reduction in resolution is not a concern for the user (photographer).

  Further, the number of added rows refers to the number of vertical pixels (number of rows) to be added when pixel signals of pixels adjacent in the vertical direction are added. Further, the number of added columns refers to the number of horizontal pixels (number of columns) to be added when pixel signals of pixels adjacent in the horizontal direction are added. Such addition processing is performed in the arithmetic circuit 416, for example. The arithmetic circuit 416 performs the process of adding the pixel signals of a predetermined number of pixels adjacent in the vertical direction or the horizontal direction, thereby obtaining the same effect as the process of reading out the pixel signals by thinning out at a predetermined thinning rate. In the addition process described above, the average value may be calculated by dividing the added value by the number of rows or columns added by the arithmetic circuit 416.

  The number of bits for digitization refers to the number of bits when the signal processing circuit 413 converts an analog signal into a digital signal in A / D conversion. As the number of bits of the digital signal increases, brightness, color change, and the like are expressed in more detail.

  In the present embodiment, the accumulation condition refers to a condition related to charge accumulation in the image sensor 100. Specifically, the accumulation condition refers to the charge accumulation time or number of accumulations, the frame rate, and the gain among the control parameters described above. Since the frame rate can change according to the charge accumulation time and the number of times of accumulation, the frame rate is included in the accumulation condition. Further, the amount of light for proper exposure changes according to the gain, and the charge accumulation time or number of times of accumulation can also change according to the amount of light for proper exposure. For this reason, the gain is included in the accumulation condition.

  The imaging condition is a condition related to imaging of a subject. Specifically, the imaging condition refers to a control parameter including the above accumulation condition. The imaging conditions include control parameters (for example, charge accumulation time or accumulation count, frame rate, gain) for controlling the image sensor 100, as well as control parameters (for controlling reading of signals from the image sensor 100). For example, a thinning rate), a control parameter for processing a signal from the image sensor 100 (for example, the number of addition rows or addition columns for adding pixel signals, the number of digitization bits, the image processing unit 30 described later performs image processing) Is also included.

  FIG. 5 is a cross-sectional view illustrating a schematic configuration of the digital camera (electronic device) according to the first embodiment. A digital camera 1 as an electronic apparatus according to the first embodiment includes a lens unit 10 as an interchangeable lens and a camera body 2 as a camera body. The camera body 2 is provided with a body side mount portion 80A for mounting the lens portion 10. Further, the lens unit 10 is provided with a lens side mount unit 80B corresponding to the body side mount unit 80A. The lens unit 10 is attached to the camera body 2 when the user joins the body side mount 80A and the lens side mount 80B. When the lens unit 10 is mounted on the camera body 2, the electrical contact 81A provided on the body side mount 80A and the electrical contact 81B provided on the lens side mount 80B are electrically connected.

  The lens unit 10 includes a lens 11a, a zooming lens 11b, a focusing lens 11c, a diaphragm 14, a lens drive control device 15, and the like. As shown in FIG. 5, the lens 11 a, the zooming lens 11 b, and the focusing lens 11 c constitute a photographing optical system 11. The photographing optical system 11 may be provided with a larger number of lenses than the lens group shown in FIG. In the present embodiment, the camera body 2 can be mounted with different interchangeable lenses (lens portions 10) having different types of photographing optical systems 11.

  The aperture 14 forms an aperture with a variable aperture diameter at the center of the optical axis in order to adjust the amount of light and the amount of blur. The lens drive control device 15 includes a CPU (Central Processing Unit), a memory, a drive control circuit, and the like. As will be described later, the CPU corresponds to the lens control unit 13 shown in FIG. Further, as will be described later, the memory corresponds to the lens storage unit 12 shown in FIG.

  The lens drive control device 15 communicates with the system control unit 70 on the camera body 2 side via the electrical contacts 81A and 81B, thereby transmitting lens information related to the characteristics of the photographing optical system 11 and control information ( The amount of movement of the focusing lens 11c, the aperture value of the aperture 14 and the like). Further, the lens drive control device 15 performs drive control for adjusting the focus of the focusing lens 11 c and adjusting the aperture diameter of the stop 14 based on the control information from the system control unit 70. The lens drive control device 15 also performs position information of the focusing lens 11c, state detection of the diaphragm 14, and the like. When the zooming lens 11b is not operated manually but by a power zoom operation, control information and drive control of the zooming lens 11b may be added.

  Here, the lens information transmitted from the lens drive control device 15 includes type data and distortion aberration data. The type data is information related to the type (size standard) of the photographing optical system 11 mounted on the lens unit 10. For example, the types of the photographing optical system 11 include a photographing optical system (lens) corresponding to the APS-C size and a photographing optical system (lens) corresponding to the 35 mm full size.

  The APS-C size is one of the size standards of the image sensor. Since the size is close to the APS-C type format of the APS system (APS: Advanced Photo System), it is called the APS-C size. The 35 mm full size is also one of the size standards of the image sensor. Since its size is close to the size widely used in digital cameras using 135 film (35 mm film), it is called 35 mm full size. In the memory of the lens unit 10, information indicating what type of photographing optical system the photographing optical system 11 is (that is, whether it is a photographing optical system corresponding to the APS-C size or 35 mm full size). Information indicating whether the optical system is a photographing optical system) is stored as type data. In the present embodiment, the imaging unit 20 is mounted with a 35 mm full-size imaging device (the imaging device 100 shown in FIG. 1 and the like).

  The distortion aberration data is information regarding distortion aberration (distortion) of the photographing optical system 11 mounted on the lens unit 10. The distortion aberration is an aberration in which an image in the peripheral portion of the photographing optical system 11 is distorted. Depending on the photographing optical system 11, a “ball shape” image is formed at a position where a rectangular image is to be formed. This distortion is called “barrel aberration”. In the memory of the lens unit 10, information on distortion aberration acquired in advance at the design stage of the photographing optical system 11 (that is, information indicating how much distortion aberration occurs in the peripheral portion) is stored as distortion aberration data. Yes.

  The camera body 2 includes an imaging unit 20 including the imaging element 100, an image processing unit 30, a display unit 50, a storage unit 60, a system control unit 70, and the like. A subject image is formed on the light receiving surface of the imaging element of the imaging unit 20 by the light beam that has passed through the lens unit 10. This subject image is photoelectrically converted by the image sensor, and the pixel signal of each pixel of the image sensor is sent to the image processing unit 30. The image processing unit 30 performs various kinds of image processing on the RAW data including the pixel signal of each pixel to generate image data. The display unit 50 displays the image data generated by the image processing unit 30. The storage unit 60 stores the image data generated by the image processing unit 30.

  In this specification, “image data” is data constituting an image (still image, moving image, live view image) captured by the image capturing unit 20, and before image processing is performed in the image processing unit 30. Data (that is, RAW data) and data after image processing is performed. In the present specification, “RAW data” refers to image data before image processing is performed in the image processing unit 30. In the present specification, “image data” may be referred to as “image signal”.

  In this specification, a live view image is an image that is displayed on the display unit 50 by sequentially outputting the image data generated by the image processing unit 30 to the display unit 50. The live view image is used for the user to confirm the image of the subject imaged by the imaging unit 20. The live view image is also called a through image or a preview image.

  The system control unit 70 controls the overall processing and operation of the digital camera 1. Details of processing and operation of the system control unit 70 and details of the configuration in the camera body 2 will be described with reference to FIG.

  FIG. 6 is a block diagram illustrating a configuration of the digital camera (electronic device) according to the first embodiment. As shown in FIG. 6, a digital camera 1 as an electronic device includes a camera body 2 and a lens unit 10. As described above, the lens unit 10 is an interchangeable lens that can be attached to and detached from the camera body 2.

  The lens unit 10 guides the luminous flux from the subject to the imaging unit 20 in a state where the lens unit 10 is connected to the camera body 2. The lens unit 10 includes a photographing optical system 11, a lens storage unit 12, and a lens control unit 13. The lens storage unit 12 stores lens information (type data, distortion aberration data) regarding the characteristics of the photographing optical system 11 described above. The lens storage unit 12 corresponds to a memory of the lens drive control device 15.

  The lens control unit 13 controls processing and operation of the lens unit 10. The lens control unit 13 corresponds to processing executed by the CPU of the lens drive control device 15 based on a control program. In the present embodiment, the lens control unit 13 determines whether or not the lens unit 10 is connected to the camera body 2. When the lens control unit 13 determines that the lens unit 10 is connected to the camera body 2, the lens control (type data, distortion aberration data) stored in the lens storage unit 12 is controlled by the system control of the camera body 2. To the unit 70. The lens control unit 13 also performs control corresponding to AF (Automatic Focusing) processing, AE (Automatic Exposure) processing, and the like based on control information (movement amount, aperture value, etc.) from the system control unit 70. That is, the lens control unit 13 performs focus control of the focusing lens 11c, drive control for adjusting the aperture diameter of the diaphragm 14, and the like based on a control signal from the system control unit 70. As shown in FIG. 6, the lens unit 10 incorporating the CPU (lens control unit 13) is called a CPU lens.

  As shown in FIG. 6, the camera body 2 includes an imaging unit 20, an image processing unit 30, a work memory 40, a display unit 50, an operation unit 55, a recording unit 60, and a system control unit 70.

  The imaging unit 20 includes an imaging element 100 and a drive unit 21. The image sensor 100 includes at least a 35 mm full-size pixel region (see the pixel region 113A shown in FIG. 2). The drive unit 21 is a control circuit that controls driving of the image sensor 100 in accordance with an instruction from the system control unit 70. Here, the drive unit 21 controls the timing (or timing cycle) at which the reset pulse and the transfer pulse are applied to the reset transistor 303 and the transfer transistor 302, respectively, thereby reducing the charge accumulation time or accumulation count as a control parameter. Control. In addition, the drive unit 21 controls the frame rate by controlling the timing (or timing cycle) at which the reset pulse, the transfer pulse, and the selection pulse are applied to the reset transistor 303, the transfer transistor 302, and the selection transistor 305, respectively. To do. The drive unit 21 controls the thinning rate by setting pixels to which the reset pulse, the transfer pulse, and the selection pulse are applied.

  In addition, the drive unit 21 controls the ISO sensitivity of the image sensor 100 by controlling the gain (also referred to as gain factor or amplification factor) of the amplifier 412. In addition, the driving unit 21 sends an instruction to the arithmetic circuit 416 to set the number of added rows or the number of added columns to which the pixel signals are added. Further, the drive unit 21 sets the number of bits for digitization by sending an instruction to the signal processing circuit 413. Furthermore, in the pixel area (imaging area) 113 </ b> A of the image sensor 100, the driving unit 21 sets an area corresponding to the lens information type data in units of blocks. In this way, the drive unit 21 functions as an image sensor control unit that causes the image sensor 100 to capture an image under different image capturing conditions for each of a plurality of blocks and output a pixel signal. The system control unit 70 instructs the drive unit 21 on the block position, shape, range, and the like.

  The image sensor 100 delivers the pixel signal from the image sensor 100 to the image processing unit 30. The image processing unit 30 uses the work memory 40 as a work space, performs various image processing on the RAW data including the pixel signals of the respective pixels, and generates image data. The image processing unit 30 executes the following image processing. For example, the image processing unit 30 generates an RGB image signal by performing color signal processing (color tone correction) on a signal obtained by the Bayer array. The image processing unit 30 performs image processing such as white balance adjustment, sharpness adjustment, gamma correction, and gradation adjustment on the RGB image signal. Further, the image processing unit 30 performs a process of compressing in a predetermined compression format (JPEG format, MPEG format, etc.) as necessary. The image processing unit 30 outputs the generated image data to the recording unit 60. In addition, the image processing unit 30 outputs the generated image data to the display unit 50.

  Parameters that are referred to when the image processing unit 30 performs image processing are also included in the control parameters (imaging conditions). For example, parameters such as color signal processing (tone correction), white balance adjustment, gradation adjustment, and compression rate are included in the control parameters. The signal read from the image sensor 100 changes according to the charge accumulation time, and the parameters referred to when performing image processing also change according to the change in the signal. The image processing unit 30 sets different control parameters for each block, and executes image processing such as color signal processing based on these control parameters.

  In the present embodiment, the image processing unit 30 includes an image generation unit 31 and a subject detection unit 32 as shown in FIG. The image generation unit 31 generates image data by performing various kinds of image processing on the RAW data including pixel signals of each pixel output from the imaging unit 20. The subject detection unit 32 detects the main subject from the image data generated by the image generation unit 31. In the present embodiment, the subject detection unit 32 detects a main subject using a known face detection function. The subject detection unit 32 may detect a moving subject (moving subject) as a main subject by comparing a plurality of image data obtained in time series from the image generation unit 31. In addition to face detection, the subject detection unit 32 may detect a human body included in image data as a main subject as described in, for example, Japanese Patent Application Laid-Open No. 2010-16621 (US2010 / 0002940). Good.

  Here, the “main subject” refers to a subject that is an object to be imaged, a subject that is noticed by the user (photographer), or a subject that is estimated to be noticed by the user. The number of main subjects is not limited to one in the image data, and there may be a plurality of main subjects.

  The work memory 40 temporarily stores image data and the like when image processing by the image processing unit 30 is performed. The display unit 50 displays images (still images, moving images, live view images) and various types of information captured by the imaging unit 20. The display unit 50 is constituted by a liquid crystal display panel, for example. A touch panel 51 is formed on the display screen of the display unit 50. The touch panel 51 outputs a signal indicating a position touched by the user to the system control unit 70 when the user performs an operation such as menu selection.

  The operation unit 55 is a release switch (a switch that is pressed when shooting a still image), a moving image switch (a switch that is pressed when shooting an operation), various operation switches, and the like that are operated by the user. The operation unit 55 outputs a signal corresponding to the operation by the user to the system control unit 70. The recording unit 60 has a card slot into which a storage medium such as a memory card can be mounted. The recording unit 60 stores the image data and various data generated by the image processing unit 30 in a recording medium mounted in the card slot. The recording unit 60 has an internal memory. The recording unit 60 can also record the image data and various data generated by the image processing unit 30 in the internal memory.

  The system control unit 70 controls the overall processing and operation of the digital camera 1. The system control unit 70 has a CPU (Central Processing Unit). In the present embodiment, the system control unit 70 divides the imaging surface (pixel area 113A shown in FIG. 2) of the imaging device 100 (imaging chip 113) into a plurality of blocks, and different charge accumulation times (or charge accumulation times) among the blocks. ), And acquire the image at the frame rate and gain. Therefore, the system control unit 70 instructs the drive unit 21 about the block position, shape, range, and accumulation condition for each block.

  In addition, the system control unit 70 causes an image to be acquired with a different thinning rate between blocks, the number of addition rows or addition columns to which pixel signals are added, and the number of digitization bits. For this reason, the system control unit 70 instructs the drive unit 21 on the imaging conditions for each block (the thinning rate, the number of added rows or columns to which pixel signals are added, and the number of digitization bits). Further, the image processing unit 30 executes image processing under imaging conditions (control parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate) that are different between blocks. For this reason, the system control unit 70 instructs the image processing unit 30 on the imaging conditions for each block (control parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate).

  Further, the system control unit 70 causes the recording unit 60 to record the image data generated by the image processing unit 30. Further, the system control unit 70 causes the display unit 50 to display an image by causing the display unit 50 to output the image data generated in the image processing unit 30. Further, the system control unit 70 causes the display unit 50 to display an image by reading out the image data recorded in the recording unit 60 and causing the display unit 50 to output the image data. The images displayed on the display unit 50 include still images, moving images, and live view images.

  In the present embodiment, the system control unit 70 includes a control unit 71, an AF processing unit (focus adjustment unit) 72, and an AE processing unit 73, as shown in FIG. The control unit 71 receives lens information transmitted from the lens unit 10 through the electrical contacts 81A and 81B when the lens unit 10 is connected to the camera body 2. The control unit 71 confirms the type of the photographing optical system 11 mounted on the lens unit 10 based on the received lens data type data. Further, the control unit 71 sets an area corresponding to the type of the imaging optical system 11 in block units in the imaging area (the pixel area 113A shown in FIG. 2) of the imaging element 100 according to the type of the imaging optical system 11. (See FIG. 7 and FIG. 9). Further, the control unit 71 sets a region set in units of blocks to a region corresponding to the distortion aberration based on the distortion aberration data of the lens information (see FIG. 10A).

  Further, the control unit 71 executes different operations for each region set in the pixel region 113A. That is, the control unit 71 sets the operation state for each region set in the pixel region 113A to “active state” or “sleep state”. In the first embodiment, the control unit 71 controls the rectangular region in the image circle of the photographing optical system 11 (this region is on the image sensor 100 corresponding to the region where an image is actually displayed on the display unit 50). Is set to the active state, and regions other than that region (regions other than the rectangular region in the image circle and regions outside the image circle) are set to the sleep state. The image circle refers to a circular range in which light that has passed through the photographing optical system 11 forms an image on the imaging surface of the image sensor 100.

  Here, the “active state” means that each pixel in the region is operable (capable of imaging). In the active region, each pixel is driven and controlled by the drive unit 21 and a pixel signal is read from each pixel. Further, “sleep state” means that each pixel in the region is in an operation stop state (image pickup stop state). The operation stop state includes a state in which drive control by the drive unit 21 is not performed in each pixel in the region. That is, it includes a state in which the driving unit 21 does not apply a pulse to the reset transistor 303, the transfer transistor 302, and the selection transistor 305. Further, the operation stop state includes a state in which no pixel signal is read from each pixel in the region. That is, this includes a state in which the drive unit 21 does not apply a selection pulse to the selection transistor 305. The operation stop state includes a state in which a pixel signal is read from each pixel in the region, but the read pixel signal is not used. For example, the signal processing chip 111 or the like includes a state in which the pixel signal read from each pixel in the area is discarded.

  In addition, the control unit 71 sets an imaging condition for the region set in the active state. In the first embodiment, the control unit 71 sets, for example, predetermined imaging conditions (shutter speed, frame rate, gain, etc.) at the time of capturing a live view image. In addition, the control unit 71 performs drive control of the imaging element 100 so that imaging is performed in the region set to the active state. In addition, the control unit 71 controls the display unit 50 to output the image data generated by the image generation unit 31 and display an image (still image, moving image, live view image) on the display screen of the display unit 50. In addition, the control unit 71 performs control for causing the storage unit 60 to output the image data generated by the image generation unit 31 and storing the image data in the display unit 50.

  The AF processing unit 72 performs focus adjustment processing (AF processing) so that the contrast of the subject called contrast AF is maximized based on the half-press operation of the release switch (in the second embodiment). (See step S24 in FIG. 12). Specifically, the AF processing unit 72 moves the focusing lens 11c to the lens control unit 13 by transmitting control information to the lens control unit 13 via the electrical contacts 81A and 81B. In addition, the AF processing unit 72 outputs a contrast signal representing the contrast of the subject image captured by the imaging unit 20 (where the subject detection unit 32 detects the main subject, the contrast of the main subject image). Obtained from the processing unit 30. The AF processing unit 72 detects the position of the focusing lens 11c at which the contrast of the subject image is the highest as the focal position based on the contrast signal from the image processing unit 30 while moving the focusing lens 11c. The AF processing unit 72 transmits a control signal to the lens control unit 13 so as to move the focusing lens 11c to the detected focal position.

  The AE processing unit 73 performs AE processing based on the half-pressing operation of the release switch (see step S25 in FIG. 12 in the second embodiment). Specifically, the AE processing unit 73 acquires luminance distribution data indicating the luminance distribution of the image from the image processing unit 30. Then, the AE processing unit 73 determines an imaging condition (shutter speed (exposure time, charge accumulation time), aperture value, and gain (ISO sensitivity) based on the luminance distribution data. When capturing a moving image, the AE processing unit 73 determines a frame rate, a shutter speed, an aperture value, and a gain (ISO sensitivity) that achieves proper exposure based on the luminance distribution data. Based on the luminance distribution data, the unit 73 can determine an imaging condition that provides appropriate exposure for each block in the imaging region 113A of the imaging device 100.

  The AE processing unit 73 transmits control information indicating an aperture value corresponding to the determined appropriate exposure to the lens control unit 13 (that is, the lens drive control device 15), thereby driving control for adjusting the aperture diameter of the aperture 14. Is executed. Further, the AE processing unit 73 outputs an instruction signal for instructing a shutter speed (charge accumulation time), a gain (ISO sensitivity), and a frame rate according to appropriate exposure to the drive unit 21. The drive unit 21 drives and controls the image sensor 100 at the shutter speed, gain, and frame rate specified by the instruction signal.

  In the system control unit 70, the control unit 71, the AF processing unit 72, and the AE processing unit 73 are realized by the CPU executing processing based on the control program.

  In the example described above, the AF processing unit 72 is configured to execute the AF processing based on the half-press operation of the release switch. The AF process may be executed even during shooting and during moving image shooting. Further, the AE processing unit 73 is configured to execute the AE processing based on the half-press operation of the release switch. However, the AE processing unit 73 is configured to capture the live view image and the moving image. The AE process may be executed even during shooting.

  FIG. 7 is a diagram illustrating image circles having different size standards and regions set in the image circle. FIG. 7A shows an image circle 200 of the photographing optical system corresponding to the full size of 35 mm, and a rectangular region 210 set in the image circle 200. FIG. FIG. 7B shows an image circle 220 of the photographing optical system corresponding to the APS-C size, and a rectangular area 230 set in the image circle 220. FIG. 7C shows a state in which FIGS. 7A and 7B are overlapped while the centers of the two image circles 200 and 220 are matched.

  A region 210 in FIG. 7A corresponds to a region of an image that can be displayed on the display unit 50 when the lens unit 10 on which the photographing optical system 11 corresponding to the full size of 35 mm is mounted on the camera body 2. . An area 230 in FIG. 7B is an image area that can be displayed on the display unit 50 when the lens unit 10 equipped with the imaging optical system 11 corresponding to the APS-C size is attached to the camera body 2. Corresponding to

  In the present embodiment, a 35 mm full-size image sensor is mounted as the image sensor 100. The 35 mm full-size imaging device 100 has a wide imaging area, so that it can capture a subject image through a photographing optical system compatible with the 35 mm full size and also has a photographing optical system compatible with the APS-C size. It is possible to capture a subject image that passes through. However, the image circle of the photographing optical system corresponding to the APS-C size is too small for a 35 mm full size image sensor. In this case, conventionally, only an APS-C size region could not be used in a 35 mm full-size image sensor. Therefore, it is necessary to read out signals from all pixels of the 35 mm full-size image sensor, and to perform trimming of signals in regions other than the necessary region (APS-C size region) by post-processing in the image processing unit 30 or the like. was there. In such a configuration, power consumption increases in the image sensor, and excessive heat generation of the image sensor may occur. In addition, it is disadvantageous for speeding up signal processing from the image sensor and image processing of image data.

  On the other hand, in the present embodiment, the control unit 71 sets the area 210 or 230 corresponding to the photographing optical system 11 having a different size standard as the pixel area 113A. Then, the control unit 71 sets the area 210 or 230 corresponding to the photographing optical system 11 having a different size standard to the active state. With such a configuration, in the digital camera 1 in which the 35 mm full-size image sensor 100 is mounted, even when the imaging optical system 11 corresponding to the APS-C size with a small image circle is used, the entire image sensor 100 is used. There is no need to read out signals from the pixels. Therefore, power saving can be realized in the image sensor 100, and excessive heat generation of the image sensor 100 can be prevented. In addition, since extra signal processing and image processing can be omitted, it is possible to increase the speed of signal processing and image processing.

  Next, pre-shooting processing of the digital camera 1 will be described. FIG. 8 is a sequence diagram illustrating an example of pre-shooting processing. Note that the pre-shooting process shown in FIG. 8 is executed, for example, when the user attaches the lens unit 10 to the camera body 2 and powers on the camera body 2. However, this pre-shooting process may be executed by attaching the lens unit 10 to the camera body 2 after the camera body 2 is powered on.

  In the process shown in FIG. 8, in the camera body 2, the control unit 71 of the system control unit 70 confirms the connection with the lens unit 10 (step S1). Further, in the lens unit 10, the lens control unit 13 confirms connection with the camera body 2 (step S11). The control unit 71 and the lens control unit 13 confirm the connection in steps S1 and S11 by confirming that the electrical contacts 81A and 81B are connected, respectively.

  After confirming the connection with the camera body 2 (step S1), the lens control unit 13 uses the lens information (type data, distortion aberration data) unique to the lens unit 10 stored in the lens storage unit 12 as an electrical contact. The data is transmitted to the system control unit 70 via 81A and 81B (step S12). The control unit 71 receives the lens information transmitted from the lens control unit 13 (step S2). And the control part 71 confirms the classification of the imaging optical system 11 based on the classification data of lens information (step S3). That is, the control unit 71 confirms whether the type of the photographing optical system 11 is a photographing optical system corresponding to the APS-C size or a photographing optical system corresponding to the 35 mm full size. And the control part 71 sets the area | region (area | region 210 or area | region 230) according to the classification of the imaging optical system 11 in the imaging area 113A of the image pick-up element 100 according to the classification of the imaging optical system 11 (step S4).

  Specifically, as shown in FIG. 7, when the type of the photographing optical system 11 is a photographing optical system corresponding to the full size of 35 mm, the control unit 71 has a rectangular shape in the image circle 200 of the photographing optical system. Region 210 is set as a 35 mm full size region. As shown in FIG. 7, when the type of the photographing optical system 11 is a photographing optical system corresponding to the APS-C size, the control unit 71 has a rectangular area 230 in the image circle 220 of the photographing optical system. Is set as an APS-C size area. The area 210 may be an area that is at least smaller than the pixel area (imaging area) 113A of the image sensor 100, and may be an area that is the same as or close to the pixel area 113A.

  Further, the control unit 71 sets an operation state for each region in the pixel region 113A of the image sensor 100 in the process of step S4. FIG. 9 is a diagram illustrating an operation state for each region in the first embodiment. As illustrated in FIG. 9, when the region 230 is set in the pixel region 113A, the control unit 71 sets the region 230 to an active state and sets a region other than the region 230 in the pixel region 113A to a sleep state. On the other hand, although not shown in FIG. 9, when the region 210 is set in the pixel region 113A, the control unit 71 sets the region 210 to the active state, and sets the region other than the region 210 in the pixel region 113A to the sleep state. Set.

  Next, the control unit 71 sets a region corresponding to the distortion aberration for the region 210 or the region 230 set in step S4 based on the distortion data of the lens information (step S5). FIG. 10 is a diagram illustrating a region corresponding to distortion. In step S <b> 5, the control unit 71 confirms how much distortion (ball aberration) occurs in the peripheral part of the photographing optical system 11 based on the distortion aberration data. The control unit 71 sets a region corresponding to distortion aberration for the region 210 or the region 230. The area where the subject is imaged is transformed into a barrel shape by the rectangular area 210 or area 230 and the area corresponding to the distortion.

  In the example illustrated in FIG. 10A, the region 230 is set in the pixel region 113 </ b> A of the image sensor 100. The control unit 71 sets regions 220 </ b> A to 220 </ b> D corresponding to barrel aberration on the outer peripheral side of the region 230 based on the distortion aberration data. As described above, the rectangular region 230 and the regions 220 </ b> A to 220 </ b> D corresponding to the barrel aberration become a “ball shape” in which the region where the subject is imaged in the image sensor 100 swells around the region 230.

  Further, when the regions 220A to 220D corresponding to the barrel aberration are set in step S5, the control unit 71 sets the regions 220A to 220D corresponding to the barrel aberration to the active state. As a result, the area where the subject is imaged in the image sensor 100 has a barrel shape corresponding to the distortion. As described above, by performing imaging in the region where the image sensor 100 is a barrel (region 230 and regions 220A to 220D), the image processing unit 30 can easily execute correction of image distortion due to distortion. it can. That is, as shown in FIG. 10A, the image sensor 100 captures in advance an area (area 230 and areas 220A to 220D) that can be distorted (enlarged) into a barrel shape by distortion. Then, the image processing unit 30 determines the actual image distortion due to the distortion, and corrects the image distortion based on the determined actual image distortion. In this case, if the image pickup device 100 is picking up an image of the region 230, when the image processing unit 30 corrects the distortion of the image, as shown in FIG. The images in the surrounding areas 50A to 50D are lost. On the other hand, when the image sensor 100 captures the region 230 and the regions 220A to 220D, when the image processing unit 30 corrects the distortion of the image, as illustrated in FIG. Image data on the entire display screen of the display unit 50 is generated, and an image is displayed on the entire display unit 50. Note that the image processing unit 30 trims extra image data other than the image data necessary for image distortion correction.

  Next, the control unit 71 sets imaging conditions (charge accumulation time, gain, etc.) in the region (region 210 or region 230) set to the active state in steps S4 and S5 (step S6). At this time, the control unit 71 outputs, for example, an instruction signal for instructing a predetermined imaging condition to the drive unit 21. Based on the instruction signal from the control unit 71, the drive unit 21 sets the imaging condition in the region set to the active state. The control unit 71 may be configured to set the imaging condition in accordance with the operation of the operation unit 55 or the touch panel 51 by the user. In the present embodiment, the control unit 71 sets the same imaging condition for the region (region 210 or region 230) set to the active state in steps S4 and S5.

  Note that after the control unit executes the pre-shooting process of the digital camera 1 shown in FIG. 8, the shooting process of the digital camera 1 is executed. However, the photographing process of the digital camera 1 will be described in the second and subsequent embodiments (see FIGS. 11 to 13).

  As described above, according to the first embodiment, the imaging unit 20 having the imaging element 100 capable of handling a plurality of types of imaging optical systems 11 and the characteristics of the imaging optical system from the interchangeable lens unit 10 are described. A control unit 71 that sets an area 210 or 230 to be activated in the imaging area 113A of the imaging element 100 according to lens information. According to such a configuration, it is possible to use areas (area 210 and area 230) corresponding to the imaging optical system 11 in the imaging area 113 </ b> A of the imaging device 100. As a result, power saving can be realized in the image sensor 100, and excessive heat generation of the image sensor 100 can be prevented. Further, since extra signal processing and image processing can be omitted in the imaging unit 20 and the image processing unit 30, it is possible to realize speeding up of signal processing and image processing.

  Further, according to the first embodiment, the lens information includes information regarding the size of the photographing optical system 11, and the control unit 71, based on the information regarding the size, the image circle 220 of the photographing optical system 11 in the imaging region 113A. An inner area and an area outside the image circle 220 are set. According to such a configuration, it is possible to use areas (area 210 and area 230) corresponding to the image circle corresponding to the size of the photographing optical system 11.

  Further, according to the first embodiment, the lens information includes information related to the distortion aberration of the photographing optical system 11, and the control unit 71 has a rectangular area (for example, the area 230 in FIG. 10) based on the information related to the distortion aberration. Is set in a region (for example, regions 220A to 220D in FIG. 10) corresponding to the distortion aberration of the photographing optical system 11. According to such a configuration, the image processing unit 30 can easily execute correction of image distortion due to distortion.

Second Embodiment
In the first embodiment described above, as shown in FIGS. 7B and 9, the control unit 71 sets the rectangular area 230 in the image circle 220 to the active state, and sets the areas other than the area 230 to the active area. It was set to sleep. However, in the second embodiment, the control unit 71 sets the area inside the image circle 220 to the active state and sets the area outside the image circle 220 to the sleep state. In the second embodiment, the control unit 71 sets different imaging conditions for the rectangular region 230 in the image circle 220 and the region other than the rectangular region 230 in the image circle 220. In the second embodiment, the subject detection unit 32 detects a main subject in an area in the image circle 220, and the AF processing unit 72 performs focus adjustment on the main subject in the area in the image circle 220. In the second embodiment, description will be made assuming that the lens unit 10 having the photographing optical system 11 corresponding to the APS-C size is attached to the camera body 2.

  FIG. 11 is a diagram illustrating an operation state for each region in the second embodiment. As shown in FIG. 11, the area in the image circle 220 includes a rectangular area 230 and areas other than the rectangular area 230 (areas around the rectangular area 230), that is, areas 221A, 221B, 221C, and 221D. . In each of the following embodiments, the rectangular region 230 in the image circle 220 is referred to as a “first region”, and the regions 221A, 221B, 221C, and 221D in the image circle 220 are referred to as “second regions”. . As shown in FIG. 11, in the second embodiment, in the pixel region (imaging region) 113 </ b> A (region 210 in the example shown in FIG. 11) of the image sensor 100, the regions (first region 230, second region) in the image circle 220. Regions 221A, 221B, 221C, and 221D) are set to the active state, and regions outside the image circle 220 are set to the sleep state.

  A region corresponding to the region of the image displayed on the display unit 50 is a rectangular region (first region) 230 in the image circle 220. Therefore, it is only necessary to perform imaging in the first region 230, and it is not necessary to perform imaging in the second regions 221A to 221D. However, in the second embodiment, the subject detection unit 32 not only detects the main subject based on the image data in the first region 230 but also detects the main subject based on the image data in the second regions 221A to 221D. Perform detection. The AF processing unit 72 not only performs focus adjustment on the main subject in the first region 230 but also performs focus adjustment on the main subject in the second regions 221A to 221D. Therefore, the control unit 71 sets not only the first region 230 but also the second regions 221A to 221D to the active state, and causes the imaging unit 20 to perform imaging in the second regions 221A to 221D.

  Next, the photographing process of the digital camera 1 will be described. FIG. 12 is a flowchart illustrating an example of the shooting process. The photographing process shown in FIG. 12 is executed after the pre-shooting process (see FIG. 8) described in the first embodiment is performed.

  In the second embodiment, it is assumed that the control unit 71 performs the following settings in the pre-shooting process described in the first embodiment. First, in step S3 of FIG. 8, the control unit 71 confirms that the type of the photographing optical system 11 is a photographing optical system corresponding to the APS-C size. In step S4, the control unit 71 includes the pixel region 113A in the image circle 220. It is assumed that the first area 230 is set in Further, it is assumed that the control unit 71 sets the first region 230 in the image circle 220 to the active state and sets the region outside the image circle 220 to the sleep state in step S4 of FIG. Further, it is assumed that the control unit 71 sets different imaging conditions for the first region 230 in the image circle 220 and the second regions 221A to 221D in the image circle 220 in step S6 of FIG. At this time, for the first region 230, for example, it is assumed that the control unit 71 has set imaging conditions (shutter speed, frame rate, gain, etc.) at the time of capturing a live view image, for example. Further, the control unit 71 sets a higher frame rate and higher gain (ISO sensitivity) than the first region 230 for the second regions 221A to 221D.

  In the process shown in FIG. 12, the control unit 71 starts capturing a live view image (step S21). Moreover, the control part 71 displays the live view image imaged by the imaging part 20 on the display screen of the display part 50 (step S22). At this time, the display unit 50 displays an image captured in the first region 230 of the image sensor 100. Since the live view image does not need to be a smooth image of the movement of the subject, the control unit 71 drives and controls the first region 230 of the image sensor 100 so as to capture an image at a low frame rate. On the other hand, the control unit 71 drives and controls the second areas 221A to 221D of the image sensor 100 so that the second areas 221A to 221D capture an image with a higher gain at a frame rate higher than that of the first area 230.

  Next, the control unit 71 determines whether or not a release switch half-press operation (SW1 operation) has been performed (step S23). If the control unit 71 determines that the release switch has been half-pressed, the AF processing unit 72 executes AF processing that automatically performs focus adjustment as preparation for shooting (step S24).

  FIG. 13 is a diagram for explaining the detection of the focal position of the main subject. FIG. 13 shows a situation where the person O1 enters the image circle 220 from outside the image circle 220, and the person O1 enters the first area 230 from the second area 221A in the image circle 220. When the person O1 enters the image circle 220, the subject detection unit 32 detects the person O1 that is the main subject from the image data of the second area 221A generated by the image generation unit 31. The subject detection unit 32 continues to detect the person O1 as the main subject until the person O1 goes out of the image circle 220. That is, the main subject is tracked by the subject detection unit 32. In addition, the image processing unit 30 outputs a contrast signal representing the contrast of the image of the person O1 detected by the subject detection unit 32 to the system control unit 70.

  In the AF processing (step S24), the AF processing unit 72 acquires a contrast signal representing the contrast of the image of the person O1 that is the main subject from the image processing unit 30. Further, the AF processing unit 72 transmits control information for instructing the movement of the focusing lens 11 c to the lens control unit 13. Accordingly, the lens control unit 13 performs control to move the focusing lens 11c based on the control information from the AF processing unit 72. Then, the AF processing unit 72 detects the lens position of the focusing lens 11c where the contrast of the image of the person O1 is the highest as the focal position while moving the focusing lens 11c. The AF processing unit 72 moves the focusing lens 11c to the detected focal position.

  As described above, the subject detection unit 32 detects the main subject when the person O1 enters the second region 221A in the image circle 220. In addition, the AF processing unit 72 adjusts the focus by driving the focusing lens 11c so that the main subject detected by the subject detection unit 32 is focused. Thus, the subject detection unit 32 detects the main subject not only in the first region 230 but also in the second regions 221A to 221D. The AF processing unit 72 performs focus adjustment on the main subject not only in the first region 230 but also in the second regions 221A to 221D. Accordingly, the subject detection unit 32 can detect the main subject from the time when the main subject enters the first region 230, and the AF processing unit 72 can also detect the main subject from the time when the main subject enters the first region 230. The focus of the subject can be adjusted.

  As described above, the control unit 71 sets a higher frame rate and higher gain (ISO sensitivity) than the first region 230 as the imaging conditions of the second regions 221A to 221D. As described above, when the control unit 71 sets a high frame rate in the second regions 221A to 221D, the subject detection unit 32 can quickly detect the main subject in the second region 221A. In addition, when the control unit 71 sets a high gain in the second regions 221A to 221D, the subject detection unit 32 can detect the main subject with high accuracy in the second regions 221A to 221D. Accordingly, the subject detection unit 32 reliably detects the main subject in the second regions 221A to 221D even when the time from when the main subject enters the second region 221A to when it enters the first region 230 is short. Can be done. In addition, since the subject detection unit 32 can detect the main subject in the second regions 221A to 221D, the AF processing unit 72 can also perform focus adjustment on the main subject in the second regions 221A to 221D. Become.

  Next, the AE processing unit 73 performs an AE process for controlling exposure so as to achieve proper exposure (step S25). Specifically, the AE processing unit 73 acquires luminance distribution data indicating the luminance distribution of the image data generated by the image generation unit 31 from the image processing unit 30. Then, the AE processing unit 73 determines an imaging condition (such as a frame rate, a shutter speed, and a gain (ISO sensitivity)) and an aperture value so as to achieve proper exposure based on the luminance distribution data. The AE processing unit 73 transmits control information indicating an aperture value corresponding to the determined appropriate exposure to the lens control unit 13 to execute drive control for adjusting the aperture diameter of the aperture 14. Further, the AE processing unit 73 outputs an instruction signal for instructing an imaging condition (frame rate, shutter speed, gain, etc.) according to the appropriate exposure to the drive unit 21. The drive unit 21 sets the imaging condition instructed by the instruction signal.

  Thereafter, the control unit 71 determines whether or not the release switch is fully pressed (SW2 operation) (step S26). When the control unit 71 determines that the release switch has not been fully pressed, the processes in steps S23 to S25 described above are repeatedly executed. When the control unit 71 determines that the release switch has been fully pressed, the control unit 71 executes an imaging process (step S27). That is, the control unit 71 causes the drive unit 21 to drive and control the imaging element 100 by outputting an instruction signal instructing imaging to the imaging unit 20.

  As described above, according to the second embodiment, the control unit 71 sets the area inside the image circle 220 to the active state and sets the area outside the image circle 220 to the sleep state. According to such a configuration, the imaging device 100 can perform imaging in a region in the image circle 220, and the subject detection unit 32 can detect a main subject using image data in the image circle 220.

  Further, according to the second embodiment, the control unit 71 includes the first region 230 corresponding to the region of the image displayed on the display unit 50 among the regions in the image circle 220 and the first region 230. Different second regions 221A to 221D are set. According to such a configuration, it is possible to detect the main subject in the second areas 221A to 221D outside the first area 230. Further, according to the second embodiment, the control unit 71 changes the imaging condition of the imaging device 100 between the first region 230 and the second regions 221A to 221D. According to such a configuration, it is possible to detect the main subject in the second areas 221 to 221D faster and more accurately than the first area 230.

  In addition, according to the second embodiment, since the subject detection unit 32 that detects the subject in the area in the image circle 220 is provided, the subject is detected not only in the first area 230 but also in the second areas 221A to 221D. Can do. Accordingly, the subject can be detected from the time when the subject enters the first region 230. In addition, according to the second embodiment, since the focus adjustment unit 72 that performs focus adjustment on the subject in the area in the image circle 220 is provided, not only in the first area 230 but also in the second areas 221A to 221D. Focus adjustment can be performed. Accordingly, the focus adjustment of the subject can be performed from the time when the subject enters the first region 230. Further, according to the second embodiment, the control unit 71 sets a higher frame rate and higher gain than the first region 230 as the imaging conditions of the second regions 221A to 221D, so that the subject is in the second region 221A. Even when the time from the time of entering 221D to the time of entering the first area 230 is short, the subject can be reliably detected in the second area 221A.

<Third Embodiment>
In the first embodiment described above, the control unit 71 automatically sets a region according to the type of the photographing optical system 11 (see step S4 in FIG. 8). On the other hand, in 3rd Embodiment, the control part 71 sets the area | region of various shapes according to a user's operation. In the third embodiment, it is assumed that the lens unit 10 having the photographing optical system 11 corresponding to the APS-C size is attached to the camera body 2.

  FIG. 14 is a flowchart illustrating an example of the area selection process. Here, the “selected area” is selected by the user from the areas set by the control unit 71 (here, the rectangular area 230 in the image circle 220 set by the control unit 71 in step S4 in FIG. 8). It refers to the area that was created. Further, the “non-selected area” refers to an area that is not selected by the user among the areas (here, the area 230) set by the control unit 71. The area selection process shown in FIG. 14 is executed after the pre-shooting process shown in FIG.

  In the process illustrated in FIG. 14, the control unit 71 determines whether or not an area in the area 230 has been selected in accordance with, for example, an operation on the touch panel 51 by the user (step S <b> 31). Examples of regions that can be selected by the user are shown in FIGS.

  15 and 16 are diagrams showing a selected area and a non-selected area in the imaging area. In the example shown in FIG. 15A, a horizontally long rectangular area 231 </ b> A is set in the area 230. The area 231A is a selection area, and the areas 231B and 231C other than the area 231A are non-selection areas. The selection area 231A is an area suitable for panoramic shooting. In the example shown in FIG. 15B, a square area 232 </ b> A is set in the area 230. The region 232A is a selected region, and the regions 232B and 232C other than the region 232A are non-selected regions. In the example shown in FIG. 15C, a triangular area 233 </ b> A is set in the area 230. The region 233A is a selection region, and the regions 233B and 233C other than the region 233A are non-selection regions.

  In the example shown in FIG. 16D, a circular area 234 </ b> A is set in the area 230. The region 234A is a selected region, and the regions 234B and 234C other than the region 234A are non-selected regions. In the example shown in FIG. 16E, a heart-shaped area 235 </ b> A is set in the area 230. The region 235A is a selection region, and the region 235B other than the region 235A is a non-selection region. In the example shown in FIG. 16F, a region 236A that is diagonal to the region 230 (region divided by diagonal lines) is set in the region 230. The region 236A is a selected region, and the regions 236B and 236C other than the region 236A are non-selected regions. In the example shown in FIG. 16G, a plurality (four) of circular regions 237A to 237D are discretely set in the region 230. These regions 237A to 237D are selection regions, and regions 237E other than these regions 237A to 237D are non-selection regions.

  The control unit 71 displays a list of selection areas in the form as shown in FIGS. 15 and 16 on the display screen of the display unit 50. The user touches and selects the selection area displayed on the display screen of the display unit 50. The touch panel 51 outputs a signal indicating the position touched by the user to the control unit 71. The control unit 71 recognizes an area selected by the user based on a signal from the touch panel 51. The user may select an arbitrary area by tracing the touch panel 51 (that is, the display screen of the display unit 50) with a finger or the like.

  If the control unit 71 determines that the selection region has been selected by the user, the control unit 71 sets the selection region (step S32). Then, the control unit 71 sets the selected area to the active state, and sets the non-selected areas other than the selected area to the sleep state. Thereafter, the control unit 71 sets imaging conditions for the selected region set to the active state (step S33). In addition, in the area | region on the display screen of the display part 50 corresponding to the non-selection area | region set to the sleep state, an image is not displayed but a black display is performed, for example.

<Modification of Third Embodiment>
In the third embodiment described above, the control unit 71 sets the selected area selected by the user to the active state and sets the non-selected area to the sleep state (see step S32). On the other hand, in the modification of the third embodiment, the control unit 71 sets the non-selected region to the active state. In the third embodiment described above, the control unit 71 sets the same imaging condition for the region set in the active state (see step S33). On the other hand, in the modification of the third embodiment, different imaging conditions are set for the selected area and the non-selected area.

  FIG. 17 is a diagram for explaining another example of focus position detection. In the example shown in FIG. 17, it is assumed that the user has selected the area 231A shown in FIG. 15A as the selection area. In such a case, as in the case described in the second embodiment (FIGS. 12 and 13), the subject detection unit 32 is the main subject not only in the selection region 231A but also in the non-selection regions 231B and 231C. A certain person O2 can be detected. Further, the AF processing unit 72 can adjust the focus of the person O2, which is the main subject detected by the subject detection unit 32, not only in the selection region 231A but also in the non-selection regions 231B and 231C (see step S24 in FIG. 12). ). With such a configuration, the subject detection unit 32 can detect the main subject immediately when the person O2 enters the selection area 231A, and the AF processing unit 72 also includes the person O2 enters the selection area 231A. The focus adjustment of the main subject can be performed immediately at the time. In addition, the subject detection unit 32 detects the main subject in the non-selected areas 231B and 231C even when the time from when the person O2 enters the non-selected areas 231B and 231C to when the person O2 enters the selected area 231A is short. It can be done reliably. Also, the AF processing unit 72 can reliably perform focus adjustment on the main subject in the non-selected areas 231B and 231C.

  As described above, according to the third embodiment, since the control unit 71 sets the first region 230 to an arbitrary shape, the shape of the region 230 can be set according to the usage mode of the user. . Further, according to the third embodiment, the control unit 71 sets the active state not only in the selected region but also in the non-selected region, so that the subject detection unit 32 detects the main subject in the non-selected region. In addition, the AF processing unit 72 can adjust the focus on the main subject.

  In the third embodiment described above, the user selects an area by operating the touch panel 51. However, the user may select an area by operating the operation unit 55. In the third embodiment, the lens unit 10 having the photographing optical system 11 corresponding to the APS-C size is described as being attached to the camera body 2. However, the corresponding photographing optical system 11 having a full size of 35 mm is described. The lens unit 10 having the above may be mounted on the camera body 2. That is, various shapes of areas may be set in the area 210.

<Fourth embodiment>
In the fourth embodiment, the lens storage unit 12 of the lens unit 10 stores peripheral dimming data in addition to the type data and distortion data as lens information. The peripheral dimming data is information related to the peripheral dimming of the photographing optical system 11 mounted on the lens unit 10. The amount of light at the periphery of the photographic optical system 11 is less than the amount of light at the center. That is, as the distance from the optical axis of the photographic optical system 11 (the central axis of the photographic optical system 11) increases to the periphery, the light amount decreases and becomes darker. This property is called peripheral dimming. The light quantity at the peripheral part is evaluated by a value called a ratio (peripheral light quantity ratio) to the light quantity at the central part. The lens storage unit 12 of the lens unit 10 stores information on the change rate (peripheral light amount ratio) of peripheral dimming acquired in advance at the design stage of the photographing optical system 11 as peripheral dimming data. In the fourth embodiment, description will be made assuming that the lens unit 10 having the photographing optical system 11 corresponding to the full size of 35 mm is attached to the camera body 2.

  In the process shown in FIG. 8, the lens control unit 13 confirms the connection with the camera body 2 (step S11), and as the lens information, in addition to the type data and the distortion aberration data, the peripheral dimming data includes the camera body. 2 is transmitted to the system control unit 70 (step S12). The control unit 71 of the system control unit 70 sets an area according to the peripheral dimming data transmitted from the lens control unit 13.

  FIG. 18 is a diagram illustrating a region set according to the peripheral light reduction according to the fourth embodiment. In the example shown in FIG. 18, an area set in the area 210 according to the peripheral light reduction is shown. When setting the area 210 in step S4 of FIG. 8, the control unit 71 sets a circular area 211 at the center of the area 210 as shown in FIG. Further, the control unit 71 sets a ring-shaped region 212 having a diameter larger than the diameter of the circular region 211 around the circular region 211. Further, the control unit 71 sets a ring-shaped region 213 having a diameter larger than the diameter of the ring-shaped region 212 around the ring-shaped region 212. Further, the controller 71 sets a ring-shaped region 214 having a diameter larger than the diameter of the ring-shaped region 213 around the ring-shaped region 213. Further, the control unit 71 sets a ring-shaped region 215 having a diameter larger than the diameter of the ring-shaped region 214 around the ring-shaped region 214.

  In step S6 of FIG. 8, the control unit 71 sets the imaging conditions (gain, frame rate, charge) of each of the regions 211 to 215 in the region 210 so that uniform exposure is performed in the region 210 based on the peripheral dimming data. Set the accumulation time. For example, as the distance from the center in the area 210 becomes farther, the light amount of the light beam from the photographing optical system 11 decreases. Therefore, the control unit 71 increases the gain for an area far from the area near the center in the area 210. Set or increase the charge accumulation time (shutter speed).

  As described above, in the fourth embodiment, since the imaging conditions of the areas 211 to 215 in the area 210 are set based on the peripheral dimming data, uniform exposure can be realized in the area 210. As a result, a situation in which the peripheral portion of the region 219 becomes dark can be prevented.

<Fifth Embodiment>
In the fifth embodiment, the camera body 2 of the digital camera 1 in the first embodiment is separated into an imaging device 1A and an electronic device 1B.

  FIG. 19 is a block diagram illustrating configurations of an imaging apparatus and an electronic apparatus according to the fifth embodiment. In the configuration shown in FIG. 19, the imaging device 1A is a device that captures an image of a subject. The imaging apparatus 1A includes an imaging unit 20, an image processing unit 30, a work memory 40, an operation unit 55, a recording unit 60, and a first system control unit 75. The imaging device 1A is configured so that the lens unit 10 can be attached. Note that, in the imaging apparatus 1A, the configurations of the imaging unit 20, the image processing unit 30, the work memory 40, the operation unit 55, and the recording unit 60 are the same as those illustrated in FIG. Accordingly, the same components are denoted by the same reference numerals, and redundant description is omitted.

  The electronic device 1B is a device that displays images (still images, moving images, live view images). The electronic apparatus 1B includes a display unit 50 and a second system control unit (control unit) 76. The configuration of the display unit 50 in the electronic device 1B is the same as the configuration illustrated in FIG. Accordingly, the same components are denoted by the same reference numerals, and redundant description is omitted.

  The first system control unit 75 includes a first communication unit 75A. The second system control unit 76 has a second communication unit 76B. The first communication unit 75A and the second communication unit 76B transmit and receive signals to each other in a wired or wireless manner. The configuration illustrated in FIG. 6 (the control unit 71, the AF processing unit 72, and the AE processing unit 73) may be provided in either the first system control unit 75 or the second system control unit 76. 6 may be provided in the first system control unit 75 or the second system control unit 76, and a part of the configuration shown in FIG. 6 is provided in the first system control unit 75. 6 may be provided in the second system control unit 76 other than a part of the configuration shown in FIG.

  Note that the imaging device 1A includes, for example, a digital camera, a smartphone, a mobile phone, and a personal computer that have an imaging function and a communication function, and the electronic device 1B includes, for example, a smartphone, a mobile phone, and a portable personal computer that have a communication function. Consists of a portable terminal such as a computer.

  The first system control unit 75 shown in FIG. 19 is realized by a CPU (not shown) executing processing based on a control program. The second system control unit 76 shown in FIG. 19 is realized by a CPU (not shown) executing processing based on a control program.

  In the configuration illustrated in FIG. 19, the image processing unit 30 and the first system control unit 75 may be configured integrally. In this case, a system control unit having one or more CPUs performs the processing based on the control program, thereby taking on the function of the image processing unit 30 and the function of the first system control unit 75.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above-described embodiment without departing from the spirit of the present invention. In addition, one or more of the requirements described in the above embodiments may be omitted. Such modifications, improvements, and omitted forms are also included in the technical scope of the present invention. In addition, the configurations of the above-described embodiments and modifications can be applied in appropriate combinations.

  In each of the embodiments described above, the arrangement of the color filters 102 is a Bayer arrangement, but an arrangement other than this arrangement may be used. Further, the number of pixels forming the unit group 131 only needs to include at least one pixel. In addition, the block only needs to include at least one pixel. Therefore, it is possible to execute imaging under different imaging conditions for each pixel.

  In each embodiment described above, part or all of the configuration of the drive unit 21 may be mounted on the imaging chip 113, or part or all of the configuration may be mounted on the signal processing chip 111. Further, a part of the configuration of the image processing unit 30 may be mounted on the imaging chip 113 or the signal processing chip 111. Further, a part of the configuration of the system control unit 70 may be mounted on the imaging chip 113 or the signal processing chip 111.

  Further, in each of the above-described embodiments, the imaging conditions that can be set by the control unit 71 are not limited to gain, charge accumulation time (exposure time, shutter speed), and frame rate, but may be other control parameters. Although only the case where the imaging condition is automatically set has been described, it may be set according to the operation of the operation unit 55 by the user.

  In each of the above-described embodiments, the case where the size of the block area is set in advance has been described. However, the user may set the size of the block area.

  In the second embodiment described above, the AF process (step S24) and the AE process (step S25) are configured to be executed when a half-press operation of the release switch or the moving image switch is performed. However, the present invention is not limited to this configuration, and the AF processing unit 72 may execute the AF processing even during the capture of the live view image, and the AE processing unit 73 may perform the capture during the capture of the live view image. Also, the AE process may be executed. Further, even when the AF processing unit 72 does not execute the AF process while capturing the live view image, the subject detection unit 32 may detect the main subject while capturing the live view image.

  Further, in the second embodiment described above, when the AF process is not executed during the capturing of the live view image, the control unit 71 may not perform the imaging in the second regions 221A to 221D. In this case, when a half-press operation such as a release switch is performed, the control unit 71 performs imaging in the second regions 221A to 221D, and based on the image data in the second regions 221A to 221D, the subject detection unit It may be configured to execute detection of the main subject by 32 and AF processing by the AF processing unit 72. In addition, the AF processing unit 72 detects the focal position (defocus amount) of the main subject in the second regions 221A to 221D during capturing of the live view image, but does not perform focus adjustment on the main subject. It may be configured. Even with such a configuration, when the main subject enters the first region 230, the AF processing unit 72 can immediately perform focus adjustment based on the focus position (defocus amount) of the main subject.

  In the second embodiment described above, the AF process (focus detection process) is configured to perform focus detection using contrast AF. However, the configuration is not limited to such a configuration, and may be a configuration performed by a phase difference detection method. In this case, a focus detection pixel is provided in the imaging region (pixel region 113A) of the imaging device 100. Then, the AF processing unit 72 detects a focus adjustment state (specifically, a defocus amount) by the photographing optical system 11 by performing a phase difference detection calculation using an output signal from the focus detection pixel. For the focus detection pixel and the phase difference detection calculation, for example, a technique described in Japanese Patent Laid-Open No. 2009-94881 can be used.

  The digital camera 1 in each of the above-described embodiments may be configured by devices such as a digital camera having an imaging function, a smartphone, a mobile phone, and a personal computer, for example.

DESCRIPTION OF SYMBOLS 1 ... Digital camera (electronic device), 1A ... Imaging device (electronic device), 1B ... Electronic device, 11 ... Imaging optical system, 20 ... Imaging part, 30 ... Image processing part, 31 ... Image generation part, 32 ... Object detection 50, display unit, 51 ... touch panel, 55 ... operation unit, 70 ... system control unit, 70A ... first system control unit, 70B ... second system control unit, 71 ... control unit, 72 ... AF processing unit (focus) Adjusting unit), 73... AE processing unit, 100.

Claims (1)

An imaging unit having an imaging element on which light beams from a plurality of types of interchangeable imaging optical systems are imaged;
An electronic device comprising: a control unit that sets a region to be activated in an imaging region of the imaging element in accordance with lens information relating to characteristics of the imaging optical system from a replaceable lens unit.