[go: up one dir, main page]

US20100110226A1 - Method and apparatus for detecting type of back light of an image - Google Patents

Method and apparatus for detecting type of back light of an image Download PDF

Info

Publication number
US20100110226A1
US20100110226A1 US12/610,837 US61083709A US2010110226A1 US 20100110226 A1 US20100110226 A1 US 20100110226A1 US 61083709 A US61083709 A US 61083709A US 2010110226 A1 US2010110226 A1 US 2010110226A1
Authority
US
United States
Prior art keywords
image
scene
ratio
aveimage
luminance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/610,837
Inventor
Jianping Zhou
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Texas Instruments Inc
Original Assignee
Texas Instruments Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Texas Instruments Inc filed Critical Texas Instruments Inc
Priority to US12/610,837 priority Critical patent/US20100110226A1/en
Assigned to TEXAS INSTRUMENTS INCORPORATED reassignment TEXAS INSTRUMENTS INCORPORATED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ZHOU, JIANPING
Publication of US20100110226A1 publication Critical patent/US20100110226A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/387—Composing, repositioning or otherwise geometrically modifying originals
    • H04N1/3877—Image rotation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image
    • G06V10/242—Aligning, centring, orientation detection or correction of the image by image rotation, e.g. by 90 degrees
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/161—Indexing scheme relating to constructional details of the monitor
    • G06F2200/1614—Image rotation following screen orientation, e.g. switching from landscape to portrait mode
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2101/00—Still video cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/3254—Orientation, e.g. landscape or portrait; Location or order of the image data, e.g. in memory

Definitions

  • Embodiments of the present invention generally relate to a method and apparatus for auto-exposure of an image.
  • Digital cameras are widely used in many applications, such as digital still cameras, camera phones, camcorders, and video surveillance equipment.
  • a typical camera has an auto-exposure module to control exposure under different lighting conditions.
  • a basic auto exposure method matches the average luminance of an image to a predefined reference value by adjusting exposure values.
  • FIG. 1 is an embodiment of two scenes with different back light. The top one is captured using basic auto exposure method and the bottom one is captured using proposed auto exposure method.
  • a desirable auto exposure method for digital cameras should be universal, since digital cameras will be used to capture different kinds of images. It also should have low computation complexity and low memory, due to the cost and shot-to-shot constraints of digital cameras.
  • Embodiments of the current invention generally relate to a method and apparatus for determining the type of back light of an image.
  • FIG. 1 is an embodiment of two (2) scenes with different back light
  • FIG. 2 is an embodiment depicting various regions of an image
  • FIG. 3 is an embodiment depicting two (2) images with different orientation
  • FIG. 4 is another embodiment depicting various regions of an image
  • FIG. 5 is yet another embodiment depicting various regions of an image
  • FIG. 6 is a flow diagram depicting an embodiment of a method determining the type of back light of an image.
  • An image is captured with a default or previous exposure value, which is denoted by exp1.
  • the mean luminance of the captured image is computed and is denoted by lum_ave.
  • a right exposure value is set and denoted by exp2.
  • the right exposure may be set based on a reference luminance value, lum_ref.
  • Exp2 Exp1*lum_ref/lum_ave.
  • the backlit scene is detected first and then exposure compensation for backlit scene is performed.
  • the luminance of the top of a backlit scene may be larger than the average luminance of the image.
  • local luminance mean may be used to detect backlit scene.
  • the top of the image is assumed to be the top of the scene. This assumption may not true if the camera is rotated while capturing the image. There are three different orientations: specifically, rotation by 90, 180, and 270 degrees. We do not consider rotation by 180 degree, which rarely happens for cameras.
  • the left image is rotated by 90 degree, and the right image is rotated by 270 degree.
  • a scene orientation detection method may be used to detect correct scene orientation. Once the orientation is known, the image orientation may be easily corrected. However, orientation correction is not required in the proposed auto exposure method.
  • the average luminance of the center region (denoted by aveCenter) is computed, as shown in FIG. 4 .
  • the height of the region may be 90% of the image height and the width may be equal to 75% of the image width.
  • Step 2 - 5 listed above are followed to compute exposure control.
  • the average luminance of the center region is computed, as shown in FIG. 5 .
  • FIG. 6 is a flow diagram depicting an embodiment of a method 600 for determining the type of back light of an image.
  • FIG. 6 starts at step 602 and proceeds to step 604 .
  • the method 600 computes the average luminance of the center region, which is herein denoted by the average luminance by aveCenter, as shown in FIG. 4 .
  • the height of the region may be 75% of the image height and the width may be equal to 90% of the image width.
  • the method 600 computes the average luminance of the entire image, denoted by aveImage.
  • the method 600 decides If ratio>t 1 , backlit scene and, Otherwise, determines the scene to be a normal scene.
  • t 1 and t 2 are two parameters, which may be set to 1.3, and 0.5, respectively.
  • the method 600 ends at step 616 .
  • this method and/or apparatus uses luminance average and is simpler than the current solutions. Moreover, one embodiment, this method and/or apparatus considers different image orientation, while others do not.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

A method and apparatus for determining the type of back light of an image. The method includes computing an average luminance of the center region of at least a portion of the image, wherein the average luminance is aveCenter, computing the average luminance of the image, wherein the average luminance is aveImage, computing the ratio of the average image luminance to the average center luminance, wherein the ratio=aveImage/aveCenter, determining that the scene related to the image is a backlit scene if the ratio is greater than a predetermined value and performing exposure compensation for the backlit scene and determining that the scene related to the image is a backlit scene if the ratio is greater than a predetermined value and performing exposure compensation for the backlit scene by utilizing the equation Exp2=Exp1 * lum_ref/(t2*aveImage+(1−t2)*aveCenter); and determining that the scene related to the image is a normal scene if the ratio is less than a predetermined value and computing the new exposure value for normal scene by utilizing the equation Exp2=Exp1 * lum_ref/aveImage.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims benefit of U.S. provisional patent application Ser. No. 61/111,081, filed Nov. 4, 2008, which is herein incorporated by reference.
    • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • Embodiments of the present invention generally relate to a method and apparatus for auto-exposure of an image.
  • 2. Description of the Related Art
  • Digital cameras are widely used in many applications, such as digital still cameras, camera phones, camcorders, and video surveillance equipment. A typical camera has an auto-exposure module to control exposure under different lighting conditions. A basic auto exposure method matches the average luminance of an image to a predefined reference value by adjusting exposure values.
  • However, this method works poorly in back-lit scene, where the background of the scene is lit by some strong light source. FIG. 1 is an embodiment of two scenes with different back light. The top one is captured using basic auto exposure method and the bottom one is captured using proposed auto exposure method. A desirable auto exposure method for digital cameras should be universal, since digital cameras will be used to capture different kinds of images. It also should have low computation complexity and low memory, due to the cost and shot-to-shot constraints of digital cameras.
  • Currently, many auto exposure methods are proposed for digital cameras. Some of them do not consider backlit scenes. Others detect backlit scenes by histogram analysis and fuzzy logic resulting in high computational complexity and high memory requirement. Therefore, there is a need for a method and/or apparatus for improving back light detection.
    • SUMMARY
  • Embodiments of the current invention generally relate to a method and apparatus for determining the type of back light of an image. The method includes computing an average luminance of the center region of at least a portion of the image, computing the average luminance of the image, wherein the average luminance is aveImage, computing the ratio of the average image luminance to the average center luminance, wherein the ratio=aveImage/aveCenter, determining that the scene related to the image is a backlit scene if the ratio is greater than a predetermined value and performing exposure compensation for the backlit scene and determining that the scene related to the image is a normal scene if the ratio is less than a predetermined value and computing the new exposure value for normal scene by utilizing the equation Exp2=Exp1 * lum_ref/aveImage.
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • So that the manner in which the above recited features of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments of this invention and are therefore not to be considered limiting of its scope, for the invention may admit to other equally effective embodiments.
  • FIG. 1 is an embodiment of two (2) scenes with different back light;
  • FIG. 2 is an embodiment depicting various regions of an image;
  • FIG. 3 is an embodiment depicting two (2) images with different orientation;
  • FIG. 4 is another embodiment depicting various regions of an image;
  • FIG. 5 is yet another embodiment depicting various regions of an image; and
  • FIG. 6 is a flow diagram depicting an embodiment of a method determining the type of back light of an image.
    •  DETAILED DESCRIPTION
  • An image is captured with a default or previous exposure value, which is denoted by exp1. The mean luminance of the captured image is computed and is denoted by lum_ave. A right exposure value is set and denoted by exp2. The right exposure may be set based on a reference luminance value, lum_ref. Thus,

  • Exp2=Exp1*lum_ref/lum_ave.
  • The backlit scene is detected first and then exposure compensation for backlit scene is performed. One observation is that the luminance of the top of a backlit scene may be larger than the average luminance of the image. In such an embodiment, local luminance mean may be used to detect backlit scene.
  • In such an embodiment, the top of the image is assumed to be the top of the scene. This assumption may not true if the camera is rotated while capturing the image. There are three different orientations: specifically, rotation by 90, 180, and 270 degrees. We do not consider rotation by 180 degree, which rarely happens for cameras.
  • In FIG. 3, the left image is rotated by 90 degree, and the right image is rotated by 270 degree. A scene orientation detection method may be used to detect correct scene orientation. Once the orientation is known, the image orientation may be easily corrected. However, orientation correction is not required in the proposed auto exposure method.
  • When the image has been rotated by 90 degree, the average luminance of the center region (denoted by aveCenter) is computed, as shown in FIG. 4. The height of the region may be 90% of the image height and the width may be equal to 75% of the image width. Step 2-5 listed above are followed to compute exposure control. When the image has been rotated by 270 degree, the average luminance of the center region is computed, as shown in FIG. 5.
  • When a scene orientation detection method is unavailable or impractical, the three average luminance values of the center regions specified in FIG. 2, FIG. 4, and FIG. 5 are computed. The minimal aveCenter in Step 2-5 above is used.
  • FIG. 6 is a flow diagram depicting an embodiment of a method 600 for determining the type of back light of an image. FIG. 6 starts at step 602 and proceeds to step 604. At step 604, the method 600 computes the average luminance of the center region, which is herein denoted by the average luminance by aveCenter, as shown in FIG. 4. The height of the region may be 75% of the image height and the width may be equal to 90% of the image width. At step 606, the method 600 computes the average luminance of the entire image, denoted by aveImage. At step 608, the method 600 computes the ratio of the average image luminance to the average center luminance: ratio=aveImage/aveCenter.
  • At step 610, the method 600 decides If ratio>t1, backlit scene and, Otherwise, determines the scene to be a normal scene. At step 612, the method 600 computes the new exposure value for normal scene by: Exp2=Exp1 * lum_ref/aveImage. At step 614, the method 600 performs exposure compensation for backlit scene by: Exp2=Exp1 * lum_ref/(t2*aveImage+(1−t2)*aveCenter). In this embodiment, t1 and t2 are two parameters, which may be set to 1.3, and 0.5, respectively. The method 600 ends at step 616.
  • Hence, in one embodiment, this method and/or apparatus uses luminance average and is simpler than the current solutions. Moreover, one embodiment, this method and/or apparatus considers different image orientation, while others do not.
  • The main advantages of our approach are this approach a) works well for different image orientation, b) has very low computation complexity, c) has very low memory requirement, d) can be easily implemented on existing hardware image processors.
  • While the foregoing is directed to embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.

Claims (3)

1. A method of a digital signal processor for determining the type of back light of an image, the method comprising:
computing an average luminance of the center region of at least a portion of the image, wherein the average luminance is aveCenter;
computing the average luminance of the image, wherein the average luminance is aveImage;
computing the ratio of the average image luminance to the average center luminance, wherein the ratio=aveImage/aveCenter;
determining that the scene related to the image is a backlit scene if the ratio is greater than a predetermined value and performing exposure compensation for the backlit scene by utilizing the equation

Exp2=Exp1* lum_ref/(t2*aveImage+(1−t2)*aveCenter); and
determining that the scene related to the image is a normal scene if the ratio is less than a predetermined value and computing the new exposure value for normal scene by utilizing the equation

Exp2=Exp1* lum_ref/aveImage.
1. An apparatus for determining the type of back light of an image, comprising:
means for computing an average luminance of the center region of at least a portion of the image, wherein the average luminance is aveCenter;
means for computing the average luminance of the image, wherein the average luminance is aveImage;
means for computing the ratio of the average image luminance to the average center luminance, wherein the ratio=aveImage/aveCenter;
means for determining that the scene related to the image is a backlit scene if the ratio is greater than a predetermined value and performing exposure compensation for the backlit scene by utilizing the equation

Exp2=Exp1* lum_ref/(t2*aveImage+(1−t2)*aveCenter); and
means for determining that the scene related to the image is a normal scene if the ratio is less than a predetermined value and computing the new exposure value for normal scene by utilizing the equation

Exp2=Exp1* lum_ref/aveImage.
3. A computer readable medium comprising computer instructions, when executed perform a method, the method of a digital signal processor for determining the type of back light of an image, the method comprising:
computing an average luminance of the center region of at least a portion of the image, wherein the average luminance is aveCenter;
computing the average luminance of the image, wherein the average luminance is aveImage;
computing the ratio of the average image luminance to the average center luminance, wherein the ratio=aveImage/aveCenter;
determining that the scene related to the image is a backlit scene if the ratio is greater than a predetermined value and performing exposure compensation for the backlit scene by utilizing the equation

Exp2=Exp1* lum_ref/(t2*aveImage+(1−t2)*aveCenter); and
determining that the scene related to the image is a normal scene if the ratio is less than a predetermined value and computing the new exposure value for normal scene by utilizing the equation

Exp2=Exp1* lum_ref/aveImage.
US12/610,837 2008-11-04 2009-11-02 Method and apparatus for detecting type of back light of an image Abandoned US20100110226A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/610,837 US20100110226A1 (en) 2008-11-04 2009-11-02 Method and apparatus for detecting type of back light of an image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11108108P 2008-11-04 2008-11-04
US12/610,837 US20100110226A1 (en) 2008-11-04 2009-11-02 Method and apparatus for detecting type of back light of an image

Publications (1)

Publication Number Publication Date
US20100110226A1 true US20100110226A1 (en) 2010-05-06

Family

ID=42130829

Family Applications (2)

Application Number Title Priority Date Filing Date
US12/610,837 Abandoned US20100110226A1 (en) 2008-11-04 2009-11-02 Method and apparatus for detecting type of back light of an image
US12/610,801 Active 2032-05-30 US8497878B2 (en) 2008-11-04 2009-11-02 Method and apparatus for determining image orientation

Family Applications After (1)

Application Number Title Priority Date Filing Date
US12/610,801 Active 2032-05-30 US8497878B2 (en) 2008-11-04 2009-11-02 Method and apparatus for determining image orientation

Country Status (1)

Country Link
US (2) US20100110226A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105227843A (en) * 2015-10-20 2016-01-06 宇龙计算机通信科技(深圳)有限公司 The filming control method of terminal, the imaging control device of terminal and terminal

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4912495A (en) * 1985-06-06 1990-03-27 Canon Kabushiki Kaisha Light measuring device
US5339163A (en) * 1988-03-16 1994-08-16 Canon Kabushiki Kaisha Automatic exposure control device using plural image plane detection areas
US5353058A (en) * 1990-10-31 1994-10-04 Canon Kabushiki Kaisha Automatic exposure control apparatus
US6175384B1 (en) * 1988-03-01 2001-01-16 Canon Kabushiki Kaisha Video camera apparatus having an exposure control device
US20040239796A1 (en) * 2002-09-20 2004-12-02 Seiko Epson Corporation Backlight adjustment processing of image using image generation record information
US6943832B2 (en) * 2001-03-22 2005-09-13 Agilent Technologies, Inc. Hysteresis in image processing algorithms
US20060203120A1 (en) * 2005-03-14 2006-09-14 Core Logic Inc. Device and method for adjusting exposure of image sensor

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4912495A (en) * 1985-06-06 1990-03-27 Canon Kabushiki Kaisha Light measuring device
US6175384B1 (en) * 1988-03-01 2001-01-16 Canon Kabushiki Kaisha Video camera apparatus having an exposure control device
US5339163A (en) * 1988-03-16 1994-08-16 Canon Kabushiki Kaisha Automatic exposure control device using plural image plane detection areas
US5353058A (en) * 1990-10-31 1994-10-04 Canon Kabushiki Kaisha Automatic exposure control apparatus
US6943832B2 (en) * 2001-03-22 2005-09-13 Agilent Technologies, Inc. Hysteresis in image processing algorithms
US20040239796A1 (en) * 2002-09-20 2004-12-02 Seiko Epson Corporation Backlight adjustment processing of image using image generation record information
US20060203120A1 (en) * 2005-03-14 2006-09-14 Core Logic Inc. Device and method for adjusting exposure of image sensor

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105227843A (en) * 2015-10-20 2016-01-06 宇龙计算机通信科技(深圳)有限公司 The filming control method of terminal, the imaging control device of terminal and terminal

Also Published As

Publication number Publication date
US8497878B2 (en) 2013-07-30
US20100110107A1 (en) 2010-05-06

Similar Documents

Publication Publication Date Title
US8682068B2 (en) Image processing apparatus, image processing method, and program
CN101472188B (en) White balance control device and white balance control method
EP1814081A2 (en) Exposure control apparatus and image pickup apparatus
US20140133774A1 (en) Image processor and image dead pixel detection method thereof
US20090095880A1 (en) Autofocus control circuit, autofocus control method and image pickup apparatus
US20100157110A1 (en) Image Sensing Apparatus
KR100791391B1 (en) Noise reduction method and device
US20180061029A1 (en) Image processing apparatus, imaging apparatus, image processing method, and storage medium storing image processing program of image processing apparatus
US9589339B2 (en) Image processing apparatus and control method therefor
US20030169348A1 (en) White balance adjustment method, image sensing apparatus, program, and storage medium
US8279300B2 (en) Imaging device and imaging method
US10432854B2 (en) Image processing apparatus to determine whether there is fog or mist in a captured image
US11375110B2 (en) Image processing apparatus, image pickup apparatus, image processing method, and non-transitory computer-readable storage medium
KR20060118352A (en) Image processing apparatus, imaging device, and image processing program
US20100110226A1 (en) Method and apparatus for detecting type of back light of an image
JP4349207B2 (en) Solid-state imaging device and defect correction method
US20210274141A1 (en) Image processing apparatus, image processing method, and storage medium
US10609275B2 (en) Image processing device, image processing method, and recording medium
KR20110067700A (en) Image Acquisition Method and Digital Camera System
US8698948B2 (en) Image pickup apparatus and control method configured to provide exposure control
US7864860B2 (en) Image pickup apparatus and motion vector deciding method
US20190215453A1 (en) Image capturing device
JP2001119716A (en) White balance adjustment device
CN113658053B (en) Image correction method, image correction device, electronic device, and computer-readable storage medium
JP5943682B2 (en) Imaging apparatus, control method thereof, and program

Legal Events

Date Code Title Description
AS Assignment

Owner name: TEXAS INSTRUMENTS INCORPORATED,TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ZHOU, JIANPING;REEL/FRAME:023968/0789

Effective date: 20091103

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION