KR20190018280A - Mobile terminal and method for obtaining high dynamic range image using the same - Google Patents

Abstract

The present invention relates to a mobile terminal which is capable of acquiring optimized high dynamic range (HDR) images in various situations, and to a method for acquiring an HDR image using the same. The method may comprise: a step of confirming whether a photographing request for a predetermined image is inputted; a step of extracting at least one scene feature by analyzing a scene of the predetermined image to be photographed when the photographing request is inputted; a step of determining whether to photograph an HDR image of the predetermined image on the basis of the extracted scene feature; a step of confirming whether there is one camera when the HDR photographing of the predetermined image is determined; a step of checking whether the camera supports the HDR if there is one camera; and a step of performing HDR image processing and photographing the predetermined image corresponding to the extracted scene feature, if the HDR support of the camera is possible.

Description

TECHNICAL FIELD [0001] The present invention relates to a mobile terminal and a method for acquiring an HDR image,

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of obtaining an HDR (High Dynamic Range) image optimized even in various situations, and a HDR image acquiring method thereof.

In general, dynamic range means the brightness range of light that can be displayed by a camera.

Therefore, since the dynamic range of the camera is remarkably smaller than that of the human dynamic range, it can be seen that the image photographed by the camera significantly reduces the expressive power as compared with the image that can be seen by humans.

However, since a camera of a general mobile terminal uses a sensor having a small dynamic range for reasons of design and price, it can not provide a good image quality when photographing a scene having a large dynamic range such as a backlight scene.

Therefore, the mobile terminal provides various HDR functions to improve the image quality of the photographed image.

However, a mobile terminal providing an HDR function in which a plurality of images are captured and synthesized has a drawback that the shooting speed is increased and is vulnerable to motion images, and a mobile terminal providing an HDR function using a sensor includes hardware The resolution dependency is high and resolution is degraded, and it can be weak for the motion image.

In order to improve this, an HDR function for capturing only necessary scenes has been applied to a mobile terminal. However, HDR function is not applied only to necessary scenes due to limitation of synthesis speed and current consumption, and HDR is applied to unnecessary scenes, .

Accordingly, it is required to develop an HDR technology capable of obtaining an HDR (High Dynamic Range) image optimized in various situations regardless of the camera performance and the shot scene of the mobile terminal.

The present invention is directed to solving the above-mentioned problems and other problems. Another object of the present invention is to provide a mobile terminal and an HDR image acquisition method capable of realizing an optimal HDR image regardless of whether or not the HDR is supported on the basis of extracted scene characteristics extracted from a preview image.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

A mobile terminal according to an embodiment of the present invention includes an image acquisition unit for acquiring a predetermined image, a scene analyzing unit for analyzing a scene of the acquired predetermined image to extract at least one scene feature, An HDR image processing unit for processing HDR images, a scene analyzing unit, a camera specification analyzing unit, and an HDR image processing unit, And determining a HDR image processing method based on the determination result.

According to an embodiment of the present invention, there is provided a method for acquiring an HDR image of a mobile terminal, the method comprising: confirming whether a photographing request for a predetermined image is input; analyzing a scene of a predetermined image to be photographed when the photographing request is input; Determining whether an HDR image of a predetermined image is captured on the basis of the extracted scene feature, confirming whether the camera is one when an HDR image of a predetermined image is determined, Determining whether HDR support is available; and if the HDR support of the camera is possible, capturing a predetermined image corresponding to the extracted scene feature and performing HDR image processing.

The effects of the mobile terminal and the HDR image acquisition method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, an optimal HDR image can be implemented regardless of whether HDR is supported or not, based on extracted scene characteristics of a preview image.

According to at least one of the embodiments of the present invention, since the optimal HDR processing method is determined based on the scene characteristics of the preview image, it is possible to adaptively perform HDR image shooting even in various shooting scenes, Image quality can be provided.

Further scope of applicability of the present invention will become apparent from the following detailed description. It should be understood, however, that the detailed description and specific examples, such as the preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2 is a block diagram illustrating a configuration module of a mobile terminal according to an exemplary embodiment of the present invention.
FIG. 3 is a block diagram illustrating the HDR imaging service module of FIG. 2. Referring to FIG.
4 to 10 are views for explaining an HDR image implementation process of the mobile terminal.
11 to 16 are views for explaining an HDR image processing process according to specifications of a mobile terminal.
17 to 26 are flowcharts for explaining an HDR image acquisition method of a mobile terminal according to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix " module " and " part " for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The mobile terminal described in this specification can be used in various applications such as a camera, a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) slate PCs, tablet PCs, ultrabooks, wearable devices (e.g., smartwatches, smart glass, HMDs (head mounted displays)), etc. Can be applied.

However, it should be understood by those skilled in the art that the configuration of the mobile terminal according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, a digital signage, and the like, You will know.

1 is a block diagram illustrating a mobile terminal according to the present invention.

1, the mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, A power supply unit 190, and the like. The components shown in FIG. 1 are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1 in order to drive an application program stored in the memory 170. Further, the control unit 180 may be configured to, as security information for transaction using at least a specific account among the components included in the mobile terminal 100, Two or more can be combined and operated.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 1 before explaining various embodiments implemented through the mobile terminal 100 as described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcasting signal may be encoded according to at least one of technical standards for transmitting and receiving a digital broadcasting signal (or a broadcasting system, for example, ISO, IEC, DVB, ATSC, etc.) It is possible to receive the digital broadcasting signal using a method conforming to the technical standard defined by the technical standards.

The broadcast-related information may be information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms, for example, an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication. The short-range communication module 114 includes Bluetooth (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. Between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and the wireless communication system through wireless local area network External server) may be connected to the network. The short-range wireless communication network may be a wireless personal area network (WLAN).

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, The virtual key or the visual key can be displayed on the touch screen with various forms. For example, the virtual key or the visual key can be displayed on the touch screen, ), An icon, a video, or a combination thereof.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as " proximity touch & The act of actually touching an object on the screen is called a " contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor uses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, Detection.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object touching the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

Generally, 3D stereoscopic images consist of left image (left eye image) and right image (right eye image). A top-down method of arranging a left image and a right image in one frame according to a method in which a left image and a right image are combined into a three-dimensional stereoscopic image, A checker board system in which pieces of a left image and a right image are arranged in a tile form, a left-to-right (right-side) Or an interlaced method in which rows are alternately arranged, and a time sequential (frame-by-frame) method in which right and left images are alternately displayed in time.

In addition, the 3D thumbnail image may generate a left image thumbnail and a right image thumbnail from the left image and right image of the original image frame, respectively, and may be generated as one image as they are combined. In general, a thumbnail means a reduced image or a reduced still image. The left image thumbnail and the right image thumbnail generated in this way are displayed on the screen with a difference of the left and right distance by the depth corresponding to the parallax between the left image and the right image, thereby exhibiting a stereoscopic spatial feeling.

The left and right images necessary for realizing the three-dimensional stereoscopic image can be displayed on the stereoscopic display unit by the stereoscopic processing unit. The stereoscopic processing unit receives a 3D image (an image at a reference time point and an image at an expansion point), sets a left image and a right image therefrom, or receives a 2D image and converts it into a left image and a right image.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

2 is a block diagram illustrating a configuration module of a mobile terminal according to an exemplary embodiment of the present invention.

2, the mobile terminal 100 includes a control unit 180, a display unit 151, a memory 170, and a camera unit 121.

Here, the memory 170 can store the application 171 and specification information of the camera. Although only one application 171 is shown in FIG. 2 for the sake of convenience, a plurality of applications may be stored in the memory 170. FIG. The application 171 may be a native application installed at the time of shipment of the mobile terminal 100 or at the time of OS / firmware upgrade, or may be an application that a user of the mobile terminal 100 separately downloads and installs from an external server.

Next, one or a plurality of camera units 1221 can be disposed in the mobile terminal, and a predetermined image can be captured. Here, the camera unit 1221 may have an image acquisition unit including a camera module that captures a predetermined image and an image sensor that can acquire the captured image. In some cases, the image obtaining unit may be included in the HDR image taking service module 190 of the control unit 180.

The display unit 151 may display an image photographed by the camera unit 121 and may display an HDR processing mode setting window of the camera unit 121. [

The control unit 180 may include an HDR (High Dynamic Range) imaging service module 190. 2, the HDR imaging service module 190 is implemented in the controller 180. However, according to the embodiment, the HDR imaging service module 190 may include a separate memory, a memory 170, Lt; / RTI > The HDR image photographing service module 190 may be implemented at the time of shipment of the mobile terminal 100 or at the time of OS / firmware upgrade.

For example, the control unit 180 checks whether a photographing request for a predetermined image is input, extracts at least one scene feature by analyzing a scene of a predetermined image to be photographed when a photographing request is input, It is determined whether the camera is one or not. If the camera is one, it is checked whether the camera supports HDR. If the HDR support of the camera is available, The HDR image processing can be performed by photographing a predetermined image corresponding to the scene feature.

When extracting at least one scene feature by analyzing a scene of a predetermined image to be photographed, the control unit 180 divides a scene of a predetermined image into pixels or blocks, measures a histogram for each separated unit, , The backlight of the scene is analyzed based on the measured histogram, and the backlight characteristic of the scene can be extracted based on the analyzed backlight.

In some cases, when extracting at least one scene feature by analyzing a scene of a predetermined image to be shot, the control unit 180 measures the variance of the scene of the predetermined image, and calculates the complexity of the scene based on the measured variance And analyzing the complexity of the scene based on the analyzed complexity.

Alternatively, when extracting at least one scene feature by analyzing a scene of a predetermined image to be photographed, the control unit 180 may measure the luminance of the ROI from the scene of the predetermined image, It is possible to analyze the backlight of the scene based on the background, and to extract the backlight feature of the scene based on the analyzed backlight.

In another case, when the at least one scene feature is extracted by analyzing a scene of a predetermined image to be photographed, the control unit 180 performs a deep running (DL) on the scene of the predetermined image, , It is possible to analyze the place of the scene and to extract the scene complexity characteristic or the dual auto white balance characteristic based on the analyzed place.

As another example, when extracting at least one scene feature by analyzing a scene of a predetermined image to be photographed, the control unit 180 collects environmental information about a scene of a predetermined image, and based on the collected environment information, And the backlight characteristic of the scene can be extracted based on the analyzed backlight.

As another example, when extracting at least one scene feature by analyzing a scene of a predetermined image to be photographed, the control unit 180 may calculate a first autofocus value of a background of a scene of a predetermined image, It is possible to extract the autofocus value, compare the first autofocus value with the second autofocus value, and extract the dual autofocus feature of the scene based on the comparison result.

As another example, when extracting at least one scene feature by analyzing a scene of a predetermined image to be photographed, the controller 180 sets the first auto white balance value of the illumination for the scene of the predetermined image and the first auto white balance value 2 You can extract the auto white balance value, compare the first auto white balance value with the second auto white balance value, and extract the dual auto white balance feature of the scene based on the comparison result.

 As another example, when extracting at least one scene feature by analyzing a scene of a predetermined image to be captured, the control unit 180 may capture a first scene of a first time among the predetermined images, Acquires a second scene of a second time later than the time, compares the acquired first scene with the second scene, and extracts a motion feature of the scene based on the comparison result.

In addition, when determining whether or not HDR photographing of a predetermined image is to be performed based on the extracted scene feature, the control unit 180 determines HDR photographing for a predetermined image if at least one extracted scene feature exists, The general photographing can be determined for the predetermined image.

Next, the control unit 180 checks whether there are a plurality of extracted scene characteristics when the HDR image processing is performed by photographing a predetermined image corresponding to the extracted scene feature, and if a plurality of extracted scene features are included, And the HDR image processing can be performed by photographing a predetermined image based on the scene feature having the highest priority according to the determined priority.

In addition, when performing the HDR image processing by photographing a predetermined image corresponding to the extracted scene feature, the controller 180 may perform the HDR image processing with at least one of the sensor HDR image processing and the multi-frame HDR image processing have.

For example, when the HDR image processing is performed by photographing the predetermined image corresponding to the extracted scene feature, the controller 180 determines whether there is a strong backlight feature and weak motion feature among the scenes of the predetermined image, The sensor HDR image processing and the multi-frame HDR image processing are performed together. If the backlight characteristic and the complexity characteristic exist together in the scene characteristic of the predetermined image, only the multi-frame HDR image processing is performed on the predetermined image, And the motion feature coexist, only the sensor HDR image processing can be performed on the predetermined image.

Next, the controller 180 checks whether the camera is one or not. When the camera is two, it checks whether the first and second cameras support HDR. Controls the first camera so as to photograph the scene of the predetermined image with background autofocus if the second camera can not support the HDR, controls the second camera to photograph the scene of the predetermined image with the area of interest autofocus, The HDR image processing can be performed by synthesizing the autofocus shooting scene and the area of interest autofocus shooting.

If the HDR support of the first and second cameras is not available, the control unit 180 controls the first and second cameras to capture the image of the predetermined image with the auto white balance of illumination. 1 controls the camera so that the second camera is controlled so that the scene of the predetermined image is photographed with the auto white balance of the area of interest, and the auto white balance shot scene of the lighting and the auto white balance shot scene of the area of interest are synthesized, Can be performed.

In addition, when the HDR support of the first camera and the second camera is not possible, the control unit 180 controls the first and second cameras to capture images of a predetermined image with a long exposure or a short exposure, Controls the first camera to control the second camera so as to take a picture of a predetermined image with a normal exposure, synthesizes a long exposure shot scene and a short exposure shot scene of the first camera and a general exposure shot scene of the second camera HDR image processing can be performed.

In addition, when checking whether the first and second cameras support HDR, if the first camera out of the first and second cameras can support HDR, the controller 180 performs a long exposure and a short exposure The first camera is controlled to shoot the HDR image, the second camera is controlled so as to shoot the scene of the predetermined image with the normal exposure, and the HDR image shot of the first camera and the general exposure shot scene of the second camera are combined, Can be performed.

In addition, when checking whether the first and second cameras support HDR, if the first camera out of the first and second cameras can support HDR, the controller 180 performs a long exposure and a short exposure Bit HDR scene, and controls the second camera so as to perform M-bit general photographing with a normal exposure for a scene of a predetermined image, image processing of an N-bit HDR photographing scene of the first camera, - It is possible to save the bit-HDR image and to process the M-bit general shooting scene of the second camera to save the M-bit general image.

When the HDR support of the camera is not possible, the control unit 180 controls the camera 180 to capture N-bit images with a long exposure, a short exposure, and a normal exposure for a scene of a predetermined image, Bit HDR image by processing an N-bit shot scene of the camera and storing the preview scene of the predetermined image as an M-bit image.

FIG. 3 is a block diagram illustrating the HDR imaging service module of FIG. 2. Referring to FIG.

3, the HDR imaging service module 190 includes an image acquisition unit 191, a scene analysis unit 192, a camera specification analysis unit 194, a control unit 195, An HDR image processing unit 197, and the like.

Here, the image acquisition unit 191 may capture and acquire a predetermined image, and may further include a camera module that captures an image, an image sensor that acquires an image, and the like.

Then, the scene analyzing unit 192 may analyze the scene of the acquired image to extract at least one scene feature.

For example, the extracted scene feature may be at least one of a backlight feature, a complexity feature, a motion feature, a dual autofocus feature, and a dual auto white balance feature, but is not limited thereto.

In some cases, the extracted scene feature may be prioritized in the order of backlight feature, motion feature, complexity feature, dual autofocus feature, and dual auto white balance feature.

For example, the priority may be higher in ranking than other features of a scene feature that may affect the personality of the image.

The camera specification analyzing unit 194 can analyze the specification of the camera according to the control signal of the controller 195 when the HDR (High Dynamic Range) imaging is determined.

Here, the specification information of the camera can be extracted from the camera information stored in advance in the memory or received from the external server.

Next, the HDR image processing unit 197 can process the photographed image based on the extracted scene characteristics and the specification of the camera.

Here, the HDR image processing can be performed by at least one of the sensor HDR image processing and the multi-frame HDR image processing.

For example, the HDR image processor 197 may perform a sensor HDR image process and a multi-frame HDR image process together with a predetermined image if there is a strong backlight feature and a weak motion feature among scene characteristics of a predetermined image, If the backlight feature and the complexity feature are present together, only the multi-frame HDR image processing is performed on the predetermined image. If there is a backlight feature and a motion feature of the scene feature of the predetermined image, only the sensor HDR image processing can be performed on the predetermined image .

The control unit 195 controls the image obtaining unit 191, the scene analyzing unit 192, the camera specification analyzing unit 194, and the HDR image processing unit 197, The HDR image processing method can be determined and the HDR image processing method can be determined.

The HDR image taking service module 190 configured as described above can realize HDR images of moving images and still images as well as HDR in a mobile terminal equipped with a high-end camera and a dual camera capable of supporting HDR It is possible to realize HDR images of moving images and still images even in a mobile terminal equipped with a low-end camera and a single camera.

In addition, the HDR image photographing service module 190 can realize an optimal HDR image irrespective of the motion of the camera or the motion of the object to be photographed.

4 to 10 are views for explaining an HDR image implementation process of the mobile terminal.

4, when the user input for selecting the camera icon 510 displayed on the display screen 500 is received, the mobile terminal 100 executes the camera and displays the display screen 500 in the camera mode And a preview image to be photographed can be displayed through the camera.

Then, as shown in FIG. 5, the mobile terminal 100 can analyze a scene of a preview image to be photographed.

For example, when analyzing a preview scene, the mobile terminal 100 may display a first message 520 indicating that a scene is being analyzed, thereby providing the user with the convenience of recognizing the current camera situation.

Next, as shown in FIG. 6, the mobile terminal 100 may extract at least one scene feature by analyzing the preview scene.

For example, when the mobile terminal 100 analyzes the preview scene and extracts the scene feature, the mobile terminal 100 may display a second message 522 indicating completion of the scene analysis to provide convenience to the user to recognize the current camera situation.

Then, the mobile terminal 100 can determine whether or not to capture the HDR of the preview image based on the extracted scene feature.

When the HDR imaging of the preview image is determined, the mobile terminal 100 can confirm whether the camera is single or dual among the camera specifications and confirm whether the camera supports HDR.

Next, when the HDR support of the camera is possible, the mobile terminal 100 can perform HDR image processing by capturing a preview image corresponding to the extracted scene feature.

Here, the mobile terminal 100 includes a memory in which specification information of the image acquisition unit is stored. When the HDR support of the image acquisition unit is confirmed, based on the specification information of the image acquisition unit stored in the memory, Can be confirmed.

Therefore, if the image acquisition unit can support HDR, the mobile terminal 100 can control the image acquisition unit to perform HDR image capture and perform HDR image processing on the captured image.

If the image acquiring unit can not support HDR, the mobile terminal 100 can perform HDR image processing on the captured image based on the extracted scene feature.

Here, the mobile terminal 100 may perform HDR image processing in a manner corresponding to moving image capturing, or may perform HDR image processing in accordance with a user input for selecting a moving image execution button 530 or a still image execution button 540, The HDR image processing may be performed.

For example, as shown in FIG. 7, when the user input for selecting the video execution button 530 is received, the mobile terminal 100 may perform the HDR image processing in a manner corresponding to the moving image capture.

8, when the user input for selecting the still image execution button 540 is received, the mobile terminal 100 can perform the HDR image processing in a manner corresponding to the still image shooting .

Next, as shown in FIG. 9, when the HDR photographing is determined based on the extracted scene feature, the mobile terminal 100 performs HDR photographing or HDR image processing on the image to be photographed, The third message 524 may be displayed to provide the user with the convenience of recognizing the current camera status.

10, when the mobile terminal 100 is determined to be a general picture taking based on the extracted scene feature, the mobile terminal 100 performs a general picture taking on the picture to be imaged and a fourth message 526 of general picture taking May be displayed to provide the user with the convenience of recognizing the current camera situation.

11 to 16 are views for explaining an HDR image processing process according to specifications of a mobile terminal.

The mobile terminal of the present invention can determine an optimal HDR processing method based on the scene characteristics of the preview image and the camera specifications of the mobile terminal, and process the image using the determined optimal HDR processing method.

11 is a first embodiment of the HDR image processing and is an HDR processing method performed when the extracted preview scene feature is a scene requiring HDR image capture and the camera specification of the mobile terminal is a single camera capable of supporting HDR image processing .

As shown in FIG. 11, the mobile terminal controls a single camera capable of supporting HDR image processing so that a frame of one frame is divided into a subframe 610 having a first luminance, a subframe 620 having a second luminance, A moving picture 640 can be generated by shooting in a sub-frame 630 having a third luminance, synthesizing them, and performing HDR image processing.

Here, each subframe may include a long exposure image and a short exposure image.

The HDR image processing of FIG. 11 may be a method of performing a sensor HDR image processing and a multi-frame HDR image processing together in order to realize a clear image when the preview scene has a strong backlight characteristic.

12 shows a second embodiment of the HDR image processing, in which the extracted preview scene feature is a scene requiring HDR image capturing, and HDR processing performed when the camera specification of the mobile terminal is a single camera capable of supporting HDR image processing Method.

12, the mobile terminal controls a single camera capable of supporting HDR image processing to synthesize subframes 610 photographed with a long exposure image and a short exposure image for a scene of one frame, and performs HDR image processing The moving picture 640 can be generated.

The HDR image processing of FIG. 12 may be a sensor HDR image processing method, which is performed to realize a clear image when the preview scene has general backlight characteristics.

Next, FIG. 13 shows a third embodiment of the HDR image processing, which is performed when the extracted preview scene feature is a scene requiring HDR image capture and the camera specification of the mobile terminal is a dual camera that can not support HDR image processing HDR processing method.

As shown in FIG. 13, the mobile terminal controls the first camera to repeatedly photograph an image to be photographed with a long exposure and a short exposure, thereby obtaining a first frame 710 having a long exposure image and a short- Gt; 720 < / RTI >

Then, the mobile terminal can acquire the third frame 730 having the general exposure image by controlling the second camera and photographing the image to be photographed in the normal exposure.

Next, the mobile terminal synthesizes a first frame 710 having a long exposure image, a second frame 720 having a short exposure image, and a third frame 730 having a general exposure image to perform HDR image processing , And a moving picture 740 can be generated.

The HDR image processing of FIG. 13 may be a multi-frame HDR image processing method, which is performed to realize a clear image when the preview scene has a general backlight characteristic and a complexity characteristic.

That is, in the third embodiment of the present invention, if HDR support of the first and second cameras is not possible, the first camera is controlled so as to take a background autofocus for a scene of a predetermined image, It is possible to control the second camera to shoot with the autofocus and to perform the HDR image processing by synthesizing the background autofocus shooting scene and the interest area autofocus shooting scene.

In a case where the HDR support of the first and second cameras is not possible, the third embodiment of the present invention controls the first camera to photograph the scene of the predetermined image with the auto white balance of illumination, It is possible to control the second camera to photograph the scene with the auto white balance of the area of interest and to perform the HDR image processing by synthesizing the auto white balance shot scene of the illumination and the auto white balance shot scene of the area of interest.

In other cases, the third embodiment of the present invention controls the first camera to shoot with a long exposure or a short exposure for a scene of a predetermined image if HDR support of the first and second cameras is not possible, It is possible to perform the HDR image processing by controlling the second camera to take a normal exposure with respect to the first camera and synthesizing the long exposure shot scene and the short exposure shot scene of the first camera with the general exposure shot scene of the second camera.

14 shows a fourth embodiment of the HDR image processing. When the extracted preview scene feature is a scene requiring HDR image capture, the camera specification of the mobile terminal is a dual camera, and one camera can support HDR image processing In the HDR system.

As shown in FIG. 14, the mobile terminal controls a first camera capable of supporting HDR image processing to shoot a long-exposure image and a short-exposure image with respect to a scene of one frame, and includes a long-exposure image and a short- Gt; 610 < / RTI >

Then, the mobile terminal can acquire the frame 730 having the general exposure image by controlling the second camera and photographing the image to be photographed with the general exposure.

Next, the mobile terminal can generate the moving image 750 by performing HDR image processing by synthesizing a frame 610 having a long exposure image and a short exposure image and a frame 730 having a normal exposure image.

That is, according to the fourth embodiment of the present invention, when only the first camera among the first and second cameras can support HDR, the first camera is controlled so as to take an HDR image with a long exposure and a short exposure with respect to a scene of a predetermined image, The HDR image processing may be performed by controlling the second camera to take a normal exposure with respect to the scene of the first camera and synthesizing the HDR shot of the first camera with the general exposure shot of the second camera.

15 is a diagram illustrating a fifth embodiment of the HDR image processing. In the fifth embodiment, when the extracted preview scene feature is a scene requiring HDR image capture, the camera specification of the mobile terminal is a dual camera, and one camera supports HDR image processing In the HDR system.

As shown in FIG. 15, the mobile terminal controls a first camera capable of HDR image processing to shoot a scene of one frame with a long exposure image and a short exposure image, and includes a long exposure image and a short exposure image Gt; 610 < / RTI >

Then, the mobile terminal can acquire the frame 730 having the general exposure image by controlling the second camera and photographing the image to be photographed with the general exposure.

Next, the mobile terminal can generate an N-bit moving image 760 by performing HDR image processing by synthesizing a frame 610 having a long exposure image and a short exposure image.

The mobile terminal can generate an M-bit moving image 770 by performing HDR image processing by synthesizing a frame 730 having a general exposure image.

That is, according to the fifth embodiment of the present invention, when only the first camera among the first and second cameras can support HDR, the first camera is controlled so as to perform N-bit HDR imaging with a long exposure and a short exposure Bit HDR image of the first camera to store the N-bit HDR image, and the M-bit HDR image of the second camera is stored in the M- - Bit Normal image can be processed to save M-bit general image.

Here, the N-bit of the N-bit HDR imaging scene may be larger than the M-bit of the M-bit general imaging scene.

In the fifth embodiment, an image can be produced as two images having different bits and a user can display an image desired by the user, thereby providing user convenience.

FIG. 16 shows a sixth embodiment of the HDR image processing, which is performed when the extracted preview scene feature is a scene requiring HDR image capture and the camera specification of the mobile terminal is a single camera that can not support HDR image processing HDR processing method.

As shown in FIG. 16, the mobile terminal controls a single camera which can not support the HDR image processing so as to repeatedly photograph an image to be photographed with a long exposure and a short exposure, thereby obtaining a first frame having a long exposure image 710), a second frame 720 having a short exposure image, and a third frame 730 having a normal exposure image.

Then, the mobile terminal can acquire a frame 660 having a preview image input through a single camera which can not support HDR image processing.

Next, the mobile terminal synthesizes a first frame 710 having a long exposure image, a second frame 720 having a short exposure image, and a third frame 730 having a general exposure image to perform HDR image processing , And an N-bit moving image 780 can be generated.

The mobile terminal can generate an M-bit moving image 790 by performing HDR image processing by synthesizing a frame 660 having a preview image.

That is, the sixth embodiment of the present invention controls the camera so that N-bit photography is performed with a long exposure, a short exposure, and a normal exposure for a scene of a predetermined image if HDR support of the camera is not possible, The HDR image processing of the scene is performed to store the N-bit HDR image, and the preview scene of the predetermined image can be stored as the M-bit image.

17 to 26 are flowcharts for explaining an HDR image acquisition method of a mobile terminal according to the present invention.

As shown in FIG. 17, the mobile terminal confirms whether a photographing request for a predetermined image is inputted (S10)

Then, the mobile terminal extracts at least one scene feature by analyzing a scene of the predetermined image to be photographed when the photographing request is input (S30)

Next, the mobile terminal confirms whether at least one scene feature is extracted (S40)

When the at least one scene feature is extracted as a result of the determination, the mobile terminal can determine whether or not to take an HDR image of the predetermined image based on the extracted scene feature. (S50)

In addition, if the extracted scene feature does not exist as a result of the determination, the mobile terminal can perform a general photographing by determining a general photographing with respect to a predetermined image (S60)

Then, when the HDR photographing of the predetermined image is determined, the mobile terminal confirms whether the camera is one (S70)

Next, if there is only one camera, the mobile terminal confirms whether the camera supports HDR (S80)

If it is possible to support HDR of the camera, the mobile terminal can perform HDR image capturing in accordance with the extracted scene feature (S90) and perform HDR image processing (S110).

Here, when the HDR image processing is performed, the mobile terminal determines whether there are a plurality of extracted scene features, determines a priority for a plurality of scene features if a plurality of extracted scene features are included, The HDR image processing may be performed by photographing a predetermined image based on the scene feature having the highest priority.

For example, the extracted scene feature may be at least one of a backlight feature, a complexity feature, a motion feature, a dual autofocus feature, and a dual auto white balance feature, but is not limited thereto.

The extracted scene characteristics may be prioritized in the order of the backlight characteristic, the motion characteristic, the complexity characteristic, the dual autofocus characteristic, and the dual auto white balance characteristic.

In addition, the mobile terminal can perform at least one of the sensor HDR image processing and the multi-frame HDR image processing based on the extracted scene characteristics when performing the HDR image processing.

For example, if a strong backlight characteristic and a weak motion feature exist together in a scene feature of a predetermined image, the mobile terminal can perform a sensor image HDR image process and a multi-frame HDR image process together.

Alternatively, the mobile terminal may perform a multi-frame HDR image process only on a predetermined image if the backlight feature and the complexity feature coexist among scenes of a predetermined image.

As another example, the mobile terminal may perform a sensor HDR image process only on a predetermined image if the backlight feature and the motion feature of the predetermined scene coexist.

If the HDR support of the camera is not possible in step S80, the mobile terminal can perform HDR image processing by capturing a predetermined image corresponding to the extracted scene feature. (S110)

In one embodiment, the mobile terminal controls the camera to capture N-bit images with a long exposure, a short exposure, and a normal exposure for a scene of a predetermined image if HDR support of the camera is not possible, Bit HDR image and stores a preview scene of a predetermined image as an M-bit image.

In step S70, if the camera is not one, the mobile terminal confirms whether there are two cameras. If the camera is two, the mobile terminal confirms whether the first and second cameras support HDR (S100).

Next, if the HDR support of the first camera and the second camera is not possible, the mobile terminal controls the first camera to photograph the scene of the predetermined image with background autofocus, and photographs the scene of the predetermined image with the area of interest autofocus And the HDR image processing may be performed by synthesizing the background autofocus shooting scene and the attention area autofocus shooting scene (S110).

If it is determined in step S100 that the HDR support of the first and second cameras is not possible, the mobile terminal may perform the auto light illumination on the scene of the predetermined image, The first camera is controlled so as to shoot in white balance, the second camera is controlled so as to photograph the scene of the predetermined image with the auto white balance of the area of interest, and the auto white balance shot scene of the scene and the auto white balance shot scene To perform HDR image processing (S110).

Alternatively, if the HDR support of the first and second cameras is not possible in the step S100 of confirming whether or not the first and second cameras support HDR, The first camera is controlled so as to shoot with a short exposure, the second camera is controlled so as to take a normal exposure with respect to a scene of a predetermined image, and a long exposure shot scene and a short exposure shot scene of the first camera, To perform HDR image processing (S110).

As another example, if it is determined in step S100 that the first and second cameras support HDR, if the first camera of the first and second cameras can support HDR, Controls the first camera to shoot the HDR image with the long exposure and the short exposure and controls the second camera to shoot the normal image with respect to the scene of the predetermined image and displays the HDR shot scene of the first camera and the general exposure shot scene of the second camera The HDR image processing may be performed (S110).

As another example, if it is determined in step S100 that the first and second cameras support HDR, if the first camera of the first and second cameras can support HDR, Bit HDR photographing with a long exposure and a short exposure and controls the second camera to take M-bit general photographs with a normal exposure with respect to a scene of a predetermined image, The M-bit general image may be stored by storing the N-bit HDR image and processing the M-bit normal shooting scene of the second camera (S110).

Here, the N-bit of the N-bit HDR imaging scene may be larger than the M-bit of the M-bit general imaging scene.

On the other hand, as shown in FIG. 18, in the step S30 of analyzing a scene of a predetermined image to be photographed and extracting at least one scene feature, the mobile terminal separates a scene of a predetermined image into pixels or blocks (S311)

Then, the mobile terminal measures the histogram for each separated unit (S313), and analyzes the backlight of the scene based on the measured histogram (S315).

Then, the mobile terminal can extract the backlight characteristic of the scene based on the analyzed backlight (S317).

Here, if the histogram value measured for each unit is larger than the reference value, the mobile terminal can extract the backlight characteristic by analyzing the presence of backlight in a predetermined scene.

19, the mobile terminal measures a variance of a scene of a predetermined image in a step S30 of analyzing a scene of a predetermined image to be captured and extracting at least one scene feature (S30). S321)

Then, the mobile terminal analyzes the complexity of the scene based on the measured variance (S323), and extracts the complexity characteristic of the scene based on the analyzed complexity (S325).

Here, if the measured variance value is larger than the reference value, the mobile terminal can extract the complexity characteristic by analyzing that the complexity exists in the predetermined scene.

20, in the step S30 of extracting at least one scene feature by analyzing a scene of a predetermined image to be photographed, the mobile terminal extracts the luminance of the ROI from the scene of the predetermined image, (S331).

Here, the region of interest may be determined based on a pre-stored set value or may be determined based on an area having the highest importance by analyzing the importance of a scene of a predetermined image.

As an example, the region of interest may be the face region of a person.

Then, the mobile terminal analyzes the backlight of the scene based on the measured brightness (S333), and extracts the backlight characteristic of the scene based on the analyzed backlight (S335).

Here, if the measured luminance value is larger than the reference value, the mobile terminal can analyze the presence of backlight in a predetermined scene to extract the backlight characteristic.

21, in the step S30 of analyzing a scene of a predetermined image to be photographed and extracting at least one scene feature, the mobile terminal performs a deep running (DL) operation on a scene of a predetermined image (S341).

The mobile terminal analyzes the location of the scene based on the performed deep running (S343), and extracts the complexity characteristic of the scene or the dual auto white balance characteristic based on the analyzed location (S345).

Here, the dual auto white balance feature can be extracted when the analyzed place is a place where the specific color of all the colors occupies more than 50%.

In addition, as shown in FIG. 22, in the step S30 of analyzing a scene of a predetermined image to be shot and extracting at least one scene feature, the mobile terminal collects environment information on a scene of a predetermined image S351).

Then, the mobile terminal analyzes the backlight of the scene based on the collected environment information (S353), and extracts the backlight characteristic of the scene based on the analyzed backlight (S355).

Here, the environment information may include at least one of current weather information, current location information, and current time information, but is not limited thereto.

23, in step S30, the mobile terminal analyzes a scene of a predetermined image to be photographed and extracts at least one scene feature, and the first autofocus And a second autofocus value of the ROI are extracted (S361).

Then, the mobile terminal compares the first autofocus value with the second autofocus value (S363), and extracts the dual autofocus feature of the scene based on the comparison result (S365).

Here, the dual autofocus feature can be extracted when the first autofocus value and the second autofocus value are different from each other.

24, the mobile terminal analyzes the scene of the predetermined image to be photographed and extracts at least one scene feature (S30). The first auto white The second auto white balance value of the region of interest and the region of interest is extracted (S371).

Then, the mobile terminal compares the first auto white balance value and the second auto white balance value (S373), and extracts the dual auto white balance characteristic of the scene based on the comparison result (S375).

Here, the dual auto white balance characteristic can be extracted when the first auto white balance value and the second auto white balance value are different from each other.

25, in step S30 of analyzing a scene of a predetermined image to be shot and extracting at least one scene feature, the mobile terminal captures a first scene of the first time among the predetermined images And acquires a second scene of a second image that is later than the first image among the predetermined images (S381).

Then, the mobile terminal compares the obtained first scene with the second scene (S383), and extracts the motion feature of the scene based on the comparison result (S385).

Here, the mobile terminal extracts a motion value by comparing the acquired first scene and the second scene, and if the extracted motion value is larger than the reference value, it is analyzed that motion exists in a predetermined scene to extract a motion feature .

Meanwhile, as shown in FIG. 26, the mobile terminal confirms whether there are a plurality of extracted scene characteristics (S42) in step S40 of confirming whether at least one scene feature is extracted.

Next, the mobile terminal can determine a priority for a plurality of scene characteristics if a plurality of extracted scene characteristics are present (S44).

For example, if the extracted scene feature includes a backlight feature, a complexity feature, a motion feature, a dual autofocus feature, and a dual auto white balance feature, the mobile terminal may use the extracted scene feature as a backlight feature, The complexity feature, dual autofocus feature, and dual auto white balance feature can be prioritized in order.

Here, the priority may be higher in ranking than other features of scene characteristics that can affect the character of the image.

Accordingly, when performing the HDR image processing, the mobile terminal can perform at least one of the sensor HDR image processing and the multi-frame HDR image processing based on the extracted scene characteristics.

As described above, according to the present invention, it is possible to implement an optimal HDR image regardless of whether HDR is supported or not based on extracted scene characteristics by extracting scene features of the preview image.

In addition, since the present invention determines an optimal HDR processing method based on scene characteristics of a preview image, it is possible to adaptively perform HDR image shooting even in various shooting scenes, thereby providing an optimum shooting speed and an optimal image quality .

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Also, the computer may include a control unit of the terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

191:
192: scene analyzing unit
194: camera specification analysis unit
195:
197: HDR image processor

Claims (10)

A method for acquiring an HDR image of a mobile terminal including at least one camera,
Confirming whether a photographing request for a predetermined image is input;
Analyzing a scene of the predetermined image to be photographed and extracting at least one scene feature when the photographing request is input;
Determining whether an HDR image of the predetermined image is captured based on the extracted scene feature;
Confirming whether the camera is one when the HDR imaging of the predetermined image is determined;
Confirming whether the camera supports HDR if the camera is one; And,
And if the HDR support of the camera is possible, capturing the predetermined image corresponding to the extracted scene feature and performing HDR image processing. The method according to claim 1,
Wherein the at least one feature is at least one of a backlight feature, a complexity feature, a motion feature, a dual autofocus feature, and a dual auto white balance feature. The method as claimed in claim 1, wherein the step of determining whether to photograph the predetermined image based on the extracted scene feature comprises:
Determining an HDR photographing operation on the predetermined image if at least one extracted scene feature exists,
And if the extracted scene feature does not exist, a general photographing is determined for the predetermined image. 2. The method according to claim 1, wherein, in the step of photographing the predetermined image corresponding to the extracted scene feature and performing HDR image processing,
Wherein the HDR image processing is performed by at least one of sensor HDR image processing and multi-frame HDR image processing. The method of claim 1, further comprising:
Confirming whether the camera is two, if the camera is not one;
Confirming whether the first and second cameras support HDR if the number of the cameras is two;
Controlling the first camera to shoot with a background autofocus for a scene of the predetermined image if the HDR support of the first and second cameras is not possible, And performing an HDR image process by controlling the second camera and synthesizing the background autofocus scene and the area of interest autofocus scene to perform an HDR image process. 6. The method of claim 5, wherein in the step of checking whether the first and second cameras support HDR,
Controlling the first camera to photograph the scene of the predetermined image with the auto white balance of illumination if the HDR support of the first and second cameras is not possible, And performing the HDR image processing by controlling the second camera so as to take a picture in a balanced manner and synthesizing the auto white balance shot scene of the illumination with the auto white balance shot scene of the area of interest, HDR image acquisition method. 6. The method of claim 5, wherein in the step of checking whether the first and second cameras support HDR,
Controlling the first camera to shoot the scene of the predetermined image with a long exposure or short exposure if the HDR support of the first and second cameras is not possible, And performing HDR image processing by controlling the second camera and synthesizing the long exposure shot scene and the short exposure shot scene of the first camera with the general exposure shot scene of the second camera, HDR image acquisition method. 6. The method of claim 5, wherein in the step of checking whether the first and second cameras support HDR,
Wherein the control unit controls the first camera to shoot an HDR image with a long exposure and a short exposure with respect to a scene of the predetermined image if only the first camera among the first and second cameras can support HDR, And performing an HDR image process by combining the HDR shot scene of the first camera and the general exposure shot scene of the second camera to perform an HDR image process on the mobile terminal Acquisition method. 6. The method of claim 5, wherein in the step of checking whether the first and second cameras support HDR,
Wherein when the first camera of the first and second cameras is capable of HDR support, the first camera is controlled to photograph N-bit HDR with a long exposure and a short exposure with respect to a scene of the predetermined image, Bit HDR image by processing the N-bit HDR photographed scene of the first camera to store an N-bit HDR image and controlling the M-bit general image of the second camera And storing the M-bit general image by performing image processing on the photographed scene. The method of claim 1, wherein if the camera is one, checking whether the camera supports HDR,
If the HDR support of the camera is not possible, the control unit controls the camera to capture N-bit images with a long exposure, a short exposure, and a normal exposure for the scene of the predetermined image, and performs HDR image processing Storing the N-bit HDR image, and storing the preview scene of the predetermined image as an M-bit image.

Images