US20180352143A1 - Focusing method, apparatus, computer readable storage medium and terminal - Google Patents
Focusing method, apparatus, computer readable storage medium and terminal Download PDFInfo
- Publication number
- US20180352143A1 US20180352143A1 US15/871,416 US201815871416A US2018352143A1 US 20180352143 A1 US20180352143 A1 US 20180352143A1 US 201815871416 A US201815871416 A US 201815871416A US 2018352143 A1 US2018352143 A1 US 2018352143A1
- Authority
- US
- United States
- Prior art keywords
- focus
- value
- offset value
- lens
- imaging apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/36—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
-
- H04N5/23212—
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/36—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
- G02B7/38—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals measured at different points on the optical axis, e.g. focussing on two or more planes and comparing image data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
- H04N23/673—Focus control based on electronic image sensor signals based on contrast or high frequency components of image signals, e.g. hill climbing method
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/681—Motion detection
- H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
-
- H04N5/23258—
Definitions
- the present disclosure relates to a focusing technology field, and more particularly to a focusing method, a focusing apparatus, a computer readable storage medium and a terminal.
- a terminal having a built-in imaging apparatus may employ a contrast-detection autofocus mode during photographing.
- focusing is performed by calculating a focus value (FV).
- FV focus value
- a position of a lens in the imaging apparatus is a second position.
- the imaging apparatus may be out of focus when a jitter occurs on the terminal.
- Embodiments of the present disclosure provide a focusing method, a focusing apparatus, a computer readable storage medium and a terminal, which may prevent out-of-focus caused by a jitter and may realize precise focusing.
- a focusing method includes the following.
- An imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured.
- a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move.
- a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values.
- a maximum value is determined from the plurality of focus values of validity.
- a computer readable storage medium has stored therein a computer program, when executed by a processor, causes the processor to perform following acts.
- An imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured.
- a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move.
- a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values.
- a maximum value is determined from the plurality of focus values of validity.
- a terminal includes an imaging apparatus, a gyroscope, a memory, a processor, and a computer program stored in the memory and executable by the processor.
- the processor performs following acts when executing the computer program.
- An imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured.
- a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move.
- a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values.
- a maximum value is determined from the plurality of focus values of validity.
- FIG. 1 is a flow chart of a focusing method according to an embodiment of the present disclosure
- FIG. 2 is a flow chart of obtaining a current focus value and a current offset value of an imaging apparatus according to an embodiment of the present disclosure
- FIG. 3 is a flow chart of obtaining a plurality of focus values of validity from obtained focus values according to obtained offset values according to an embodiment of the present disclosure
- FIG. 4 is a block diagram illustrating a focusing apparatus according to an embodiment of the present disclosure
- FIG. 5 is a block diagram illustrating a focusing apparatus according to another embodiment of the present disclosure.
- FIG. 6 is a flow chart of acts performed when a computer program stored in a computer readable storage medium is executed by a processor according to an embodiment of the present disclosure
- FIG. 7 is a schematic diagram of an internal structure of a terminal according to an embodiment of the present disclosure.
- FIG. 8 is a flow chart of acts performed when a processor of a terminal executes a computer program according to an embodiment of the present disclosure.
- FIG. 1 is a flow chart of a focusing method according to an embodiment of the present disclosure. As illustrated in FIG. 1 , the focusing method includes the following.
- an imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured.
- the imaging apparatus includes a lens and a driving device.
- the driving device is configured to drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens.
- the first position is a beginning position and the second position is an ending position.
- the lens begins to move gradually when the imaging apparatus begins focusing.
- a focus value (FV) of a focusing area is calculated in real time according to a preset algorithm during a moving process of the lens. It is found that the focus value increases gradually, and the focus value of the focusing area in an image is maximum (i.e., sharpness of the focusing area is highest) when the image is successfully focused.
- focus values are the data obtained from processing an image inputted by the imaging apparatus for representing image sharpness.
- the focusing is realized by finding a focusing position corresponding to a time when the focus value of the image is the highest.
- a control module controls the imaging apparatus to employ the contrast-detection autofocus mode to begin to focus on the target object to be captured.
- a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move.
- the offset value may be understood as a jitter value, i.e., a moving offset value or a rotation value of the imaging apparatus caused by external interference when the imaging apparatus employs the contrast-detection autofocus mode to focus on the target object to be captured.
- a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values.
- the plurality of focus values of validity are obtained according to the obtained offset values and a preset offset value.
- the focus value of validity refers to a focus value corresponding to an offset value in a preset offset range.
- a maximum value of the obtained focus values may have a local maximum value if a jitter occurs on the imaging apparatus.
- the imaging apparatus does not know the local maximum value is caused by the jitter, and may finally determine a position when the image is successfully focused at a position corresponding to the local maximum value, which may cause an out-of-focus phenomenon.
- the local maximum value formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, with only the plurality of focus values of validity obtained, thus avoiding the out-of-focus phenomenon.
- a maximum value is determined from the plurality of focus values of validity.
- the maximum value may be determined from the plurality of focus values of validity according to a preset algorithm.
- the focusing may be realized according to the maximum value.
- the imaging apparatus is controlled to employ the contrast-detection autofocus mode to focus on the target object to be captured, the current focus value and the current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move, the local maximum value of the focus values formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, and only the plurality of focus values of validity are obtained, avoiding the out-of-focus phenomenon, which may realize precise focusing on the target object to be captured.
- obtaining the current focus value and the current offset value of the imaging apparatus correspondingly each time the imaging apparatus is driven to move includes the following.
- a focus value of an image currently outputted by the lens is obtained and a current rotation angular velocity of the lens is obtained from a gyroscope each time the lens is driven to move.
- the imaging apparatus includes the lens and the driving device.
- the driving device may drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens. Therefore, when the lens is driven by the driving device, a focus value of the image currently outputted by the lens is obtained each time the lens is driven to move, and at the same time, the gyroscope-built-in terminal is controlled to obtain the rotation angular velocity of the lens, and the rotation angular velocity is obtained from the gyroscope. That is, the offset value may be understood as the current rotation angular velocity of the lens obtained by the gyroscope.
- the gyroscope may be a tri-axial MEMS (micro-electro-mechanical system) gyroscope, or a six-axial sensor realized by combining a tri-axial MEMS gyroscope with a tri-axial MEMS accelerometer.
- the tri-axial MEMS gyroscope may detect positions, moving paths and accelerated speeds in six directions at a time.
- a one-to-one correspondence relationship is established according to the obtained focus values of the images outputted by the lens and the obtained rotation angular velocities of the lens. Further, a correspondence table may be established according to the established correspondence relationship.
- obtaining the plurality of focus values of validity from the obtained focus values according to the obtained offset values includes the following.
- the offset values are rotation angular velocities.
- the obtained offset value may be compared with the preset offset value. It can be determined whether a jitter currently occurs on the imaging apparatus according to a comparison.
- an act at block 304 is executed. That is, it is determined that the focus value corresponding to the current offset value larger than the preset offset value has no validity, and the focus value of invalidity is filtered out. That is, when the current offset value of the imaging apparatus is larger than the preset offset value, it may be determined that there is a jitter occurring on the imaging apparatus during a current focusing process.
- the focus value corresponding to the current offset value may be determined according to the established correspondence relationship.
- the determined focus value is determined to be a focus value of invalidity. A single and independent focus value of invalidity is filtered out. In other words, when there is a jitter occurring on the imaging apparatus during the focusing process, a corresponding focus value is an invalid value.
- an act at block 306 is executed. That is, it is determined that a focus value corresponding to the current offset value not larger than the preset offset value has validity, and the focus value of validity is reserved. That is, when the current offset value of the imaging apparatus is less than the preset offset value, it may be determined that there is no jitter occurring on the imaging apparatus during a current focusing process.
- the focus value corresponding to the current offset value may be determined according to the established correspondence relationship.
- the determined focus value is determined to be a focus value of validity, and the focus value of validity is reserved.
- focus values of validity at a plurality of positions are successively obtained.
- determining the maximum value from the plurality of focus values of validity includes the following.
- a focusing waveform is obtained according to the plurality of focus values of validity.
- the maximum value is determined according to the focusing waveform. That is, the focusing waveform is drawn according to the plurality of obtained focus values of validity, and the maximum value of the focus values is determined according to the focusing waveform, thus a precise focusing may be realized according to the maximum value.
- the focusing method may further include an act of receiving an input from a user to set the preset offset value.
- the user may set a preset value via a touch screen or speech input.
- the user may set the preset value according his using habit, thus improving user experience.
- FIG. 4 is a block diagram illustrating a focusing apparatus according to an embodiment of the present disclosure.
- the focusing apparatus includes a control module 410 , an obtaining module 420 , a processing module 430 , and a filtering module 440 .
- the control module 410 is configured to control an imaging apparatus to employ a contrast-detection autofocus mode to focus on a target object to be captured.
- the obtaining module 420 is configured to obtain a current focus value and a current offset value of the imaging apparatus correspondingly each time the imaging apparatus is driven to move.
- the processing module 430 is configured to obtain a plurality of focus values of validity from the obtained focus values according to the obtained offset values.
- the filtering module 440 is configured to determine a maximum value from the plurality of focus values of validity.
- the control module 410 may control the imaging apparatus to employ the contrast-detection autofocus mode to focus on the target object to be captured, the obtaining module 420 correspondingly obtains the current focus value and the current offset value of the imaging apparatus each time the imaging apparatus is driven to move, the processing module 430 may filter out the local maximum value of the focus values formed by a jitter according to the obtained offset values and a preset offset value, and only the plurality of focus values of validity are obtained, the filtering module 440 determines the maximum value from the plurality of focus values of validity, thus avoiding an out-of-focus phenomenon, which may realize precise focusing on the target object to be captured.
- the focusing apparatus includes a lens and a driving device.
- the driving device is configured to drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens.
- the first position is a beginning position and the second position is an ending position.
- the lens begins to move gradually when the imaging apparatus begins focusing.
- a focus value (FV) of a focusing area is calculated in real time according to a preset algorithm during a moving process of the lens. It is found that the focus value increases gradually, and the focus value of the focusing area in an image is maximum (i.e., sharpness of the focusing area is highest) when the image is successfully focused.
- focus values are the data obtained from processing an image inputted by the imaging apparatus for representing image sharpness.
- the focusing is realized by finding a focusing position corresponding to a time when the focus value of the image is the highest.
- the obtaining module 420 includes a first obtaining unit 421 , a second obtaining unit 423 , and an establishing unit 425 .
- the first obtaining unit 421 is configured to obtain a focus value of an image currently outputted by the lens.
- the imaging apparatus includes the lens and the driving device.
- the driving device may drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens. Therefore, when the lens is driven by the driving device, the first obtaining unit 421 obtains the focus value of the image currently outputted by the lens each time the lens is driven to move.
- the second obtaining unit 423 is configured to obtain a current rotation angular velocity of the lens from a gyroscope.
- the gyroscope obtains the rotation angular velocity of the lens.
- the second obtaining unit 423 obtains the rotation angular velocity from the gyroscope. That is, the offset value may be understood as the current rotation angular velocity of the lens obtained by the gyroscope.
- the gyroscope may be a tri-axial MEMS (micro-electro-mechanical system) gyroscope, or a six-axial sensor realized by combining a tri-axial MEMS gyroscope with a tri-axial MEMS accelerometer.
- the tri-axial MEMS gyroscope may detect positions, moving paths and accelerated speeds in six directions at a time.
- the establishing unit 425 is configured to establish a correspondence relationship between the focus value of the image currently outputted by the lens and the current rotation angular velocity of the lens.
- the establishing unit 425 establishes a one-to-one correspondence relationship according to the obtained focus values of the images outputted by the lens and the obtained rotation angular velocities of the lens.
- the establishing unit 425 may further establish a correspondence table according to the established correspondence relationship.
- the processing module 430 includes a storing unit 431 , a determining unit 433 , and a processing unit 435 .
- the storing unit 431 is configured to store a preset offset value.
- the determining unit 433 is configured to determine whether a current offset value of the imaging apparatus is larger than the preset offset value. Each time an offset value of the imaging apparatus is obtained in real time, the determining unit 433 compares the obtained offset value with the preset offset value.
- the processing unit 435 is configured to successively obtain all the focus values of validity during a process of driving the imaging apparatus according to a result of the determining unit 433 .
- the processing unit 435 may determine that there is a jitter occurring on the imaging apparatus during a current focusing process.
- the focus value corresponding to the current offset value may be determined according to the established correspondence relationship.
- the determined focus value is determined to be a focus value of invalidity.
- a single and independent focus value of invalidity is filtered out.
- the processing unit 435 may determine that there is no jitter occurring on the imaging apparatus during a current focusing process.
- the focus value corresponding to the current offset value may be determined according to the established correspondence relationship.
- the determined focus value is determined to be a focus value of validity, and the focus value of validity is reserved.
- FIG. 5 is a block diagram illustrating a focusing apparatus according to another embodiment of the present disclosure.
- the focusing apparatus includes a control module 510 , an obtaining module 520 , a processing module 530 , a filtering module 540 , and a setting module 550 .
- the control module 510 , the obtaining module 520 , the processing module 530 , and the filtering module 540 have similar functions with corresponding modules in FIG. 4 .
- the setting module 550 is configured to receive an input from a user to set the preset offset value.
- the setting module 550 is configured to receive the input from a user to set a preset value.
- the user may set the preset value via a touch screen or speech input.
- the user may set the preset value according his using habit, thus improving users' quality of experience.
- the division of respective modules in the above focusing apparatus is only for illustration. In other embodiments, the focusing apparatus can be divided into different modules as required to accomplish all or part of the functions of the focusing apparatus.
- FIG. 6 is a flow chart of acts performed when a computer program (instruction) stored in a computer readable storage medium is executed by a processor according to an embodiment of the present disclosure. As illustrated in FIG. 6 , the computer readable storage medium having stored therein a computer program (instruction), when executed by a processor, causes the processor to perform following acts.
- an imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured.
- the imaging apparatus includes a lens and a driving device.
- the driving device is configured to drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens.
- the first position is a beginning position and the second position is an ending position.
- the lens begins to move gradually when the imaging apparatus begins focusing.
- a focus value (FV) of a focusing area is calculated in real time according to a preset algorithm during a moving process of the lens. It is found that the focus value increases gradually, and the focus value of the focusing area in an image is maximum (i.e., sharpness of the focusing area is highest) when the image is successfully focused.
- focus values are the data obtained from processing an image inputted by the imaging apparatus for representing image sharpness.
- the focusing is realized by finding a focusing position corresponding to a time when the focus value of the image is the highest.
- a control module controls the imaging apparatus to employ the contrast-detection autofocus mode to begin to focus on the target object to be captured.
- a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move.
- the offset value may be understood as a jitter value, i.e., a moving offset value or a rotation value of the imaging apparatus caused by external interference when the imaging apparatus employs the contrast-detection autofocus mode to focus on the target object to be captured.
- a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values.
- the plurality of focus values of validity are obtained according to the obtained offset values and a preset offset value.
- the focus value of validity refers to a focus value corresponding to an offset value in a preset offset range.
- a maximum value of the obtained focus values may have a local maximum value if a jitter occurs on the imaging apparatus.
- the imaging apparatus does not know the local maximum value is caused by the jitter, and may finally determine a position when the image is successfully focused at a position corresponding to the local maximum value, which may cause an out-of-focus phenomenon.
- the local maximum value formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, with only the plurality of focus values of validity obtained, thus avoiding the out-of-focus phenomenon.
- a maximum value is determined from the plurality of focus values of validity.
- the maximum value may be determined from the plurality of focus values of validity according to a preset algorithm.
- the focusing may be realized according to the maximum value.
- the imaging apparatus is controlled to employ the contrast-detection autofocus mode to focus on the target object to be captured, the current focus value and the current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move, the local maximum value of the focus values formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, and only the plurality of focus values of validity are obtained, avoiding the out-of-focus phenomenon, which may realize precise focusing on the target object to be captured.
- Embodiments of the present disclosure further provide a terminal. As illustrated in FIG. 7 , for simplification of illustration, portions related to embodiments of the present disclosure are merely illustrated. For those technical details being not disclosed, embodiments of the present disclosure may be referred to.
- the terminal includes an imaging apparatus, a gyroscope, a memory, a processor, and a computer program stored in the memory and executable by the processor.
- the terminal may include a mobile phone, a tablet computer, a wearable device or any other terminal device including an imaging apparatus.
- the imaging apparatus includes a front camera and/or a rear camera.
- the mobile phone as the terminal is taken as an example for illustrating.
- FIG. 7 is a schematic diagram of an internal structure of a terminal according to an embodiment of the present disclosure.
- the mobile phone includes a radio frequency (RF) circuit 710 , a memory 720 , an input unit 730 , a display unit 740 , a sensor 750 , an audio circuit 760 , a wireless fidelity (Wi-Fi) module 770 , a processor 780 and an imaging apparatus 790 , and the like.
- RF radio frequency
- the mobile phone may include less or more components than those illustrated in FIG. 7 or combinations thereof, or have a different arrangement of components.
- the RF circuit 710 may be configured to receive or transmit a signal during a process of transmitting or receiving a message or making a call.
- the RF circuit 710 may be configured to receive downlink data from a base station and to transmit the downlink data to the processor 780 .
- the RF circuit 710 may be configured to transmit uplink data to the base station.
- the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a diplexer and the like.
- the RF circuit 710 may be further configured to communicate with other devices via wireless communication and network.
- the above wireless communication may adopt any communication standard or protocol, which includes but is not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), e-mail, short messaging service (SMS) and the like.
- GSM global system of mobile communication
- GPRS general packet radio service
- CDMA code division multiple access
- WCDMA wideband code division multiple access
- LTE long term evolution
- SMS short messaging service
- the memory 720 may be configured to store software programs or modules.
- the processor 780 is configured to execute various functional applications and data processes of the mobile phone by running the software programs and modules stored in the memory 720 .
- the memory 720 may mainly include a program storage region and a data storage region.
- the program storage region may store an operation system, at least one function required applications (such as an application having a sound playing function, an application having an image playing function) and the like.
- the data storage region may store data produced by using the mobile phone (such as audio data, an address book) and the like.
- the memory 720 may include a high speed random access memory and may include a non-volatility memory, such as at least one disk memory, a flash memory, or other volatility solid state memory.
- the input unit 730 may be configured to receive figure or character information inputted and generate a key signal input related to a user setup or function control of the mobile phone 700 .
- the input unit 730 may include a touch panel 731 and other input devices 732 .
- the touch panel 731 (also called as touch screen) may be configured to gather touch operations near or on the touch panel 731 (such as an operation on the touch panel 731 or near the touch panel 731 of the user with a finger, a stylus or other suitable objects or attachments), and drive corresponding connected device according to a preset program.
- the touch panel 731 may include a touch detection device and a touch controller.
- the touch detection device detects an orientation of the user's touch, detects a signal caused by the touch operation and sends the signal to the touch controller.
- the touch controller receives the touch information on the touch detection device, converts the touch information to touch point coordinates, and sends the touch point coordinates to the processor 780 . Furthermore, the touch controller may receive and execute a command sent from the processor 780 .
- the touch panel 731 may be implemented as resistance typed, capacitive typed, infrared typed and surface acoustic wave typed.
- the input unit 730 may further include other input devices 732 .
- the other input devices 732 may include but without limitation to one or more of a physical keyboard, a functional key (such as a volume control key, a switch key and the like).
- the display unit 740 may be configured to display information inputted by the user or information provided to the user or various menus of the mobile phone.
- the display unit 740 may include a display panel 741 .
- the display panel 741 may be configured as a liquid crystal display (LCD), an organic light-emitting diode (OLED) and the like.
- the touch panel 731 may cover the display panel 741 . When the touch panel 731 detects the touch operation on the touch panel 731 or near the touch panel 731 , the touch operation is transmitted to the processor 780 to determine a type of the touch event. Thereafter, the processor 780 provides a corresponding visual output on the display panel 741 according to the type of the touch event.
- touch panel 731 and the display panel 741 are two separate components to realize an input and output function of the mobile phone illustrated in FIG. 7
- the touch panel 731 and the display panel 741 may be integrated to realize the input and output function of the mobile phone
- the mobile phone 700 may further include at least one sensor 750 , such as a gyroscope, an optical sensor, a motion sensor and other sensors.
- the gyroscope is configured to collect a rotation angular velocity of the mobile phone.
- the optical sensor may include a surrounding light sensor and a proximity sensor.
- the surrounding light sensor may adjust a brightness of the display panel 741 according to surrounding lights.
- the proximity sensor may close the display panel 741 and/or backlight when the mobile phone moves near ears of the user.
- the motion sensor may include an acceleration sensor, for measuring the acceleration value in various directions via the acceleration sensor, measuring a value and a direction of gravity when the phone is static, and identifying a state of the mobile phone (such as landscape screen and portrait screen switching), jitter related functions (such as a pedometer, a knocking) and the like.
- the mobile phone may be configured with a barometer, a hygrometer, a thermometer, an infrared sensor and other sensors.
- the audio circuit 760 , a loudspeaker 761 and a microphone 762 may provide an audio interface between the user and the phone.
- the audio circuit 760 may transmit an electrical signal converted from the audio data received to the loudspeaker 761 .
- the loudspeaker 761 converts the electrical signal to a sound signal and output the sound signal.
- the microphone 762 may convert gathered sound singles to electrical signals.
- the audio circuit 760 receives and converts the electrical signals to audio data and outputs the audio data to the processor 780 to be processed.
- the audio data processed by the processor 780 may be transmitted to another mobile phone via the RF circuit 710 or may be stored in the memory 720 to be subsequently processed.
- Wi-Fi is a short distance wireless communication technology.
- the mobile phone may help the user to receive or send an e-mail, search webpages, access to stream medium via the Wi-Fi module 770 .
- the Wi-Fi module 770 provides a wireless broadband Internet access. Although the Wi-Fi module 770 is illustrated in FIG. 7 , it may be understood that, the Wi-Fi module 770 is not necessary for the mobile phone 700 , thus it may be omitted according to demands.
- the processor 780 is a control center of the phone, which utilizes various interfaces and wires to connect various parts of the phone. By running or executing the software program and/or modules stored in the memory 720 , and by invoking data stored in the memory 720 , the various functions and data processing functions may be executed, thus integrally monitoring the mobile phone.
- the processor 780 may include one or more processing units.
- the processor 780 may be integrated with an application processor or a modem processor.
- the application processor mainly processes the operation system, a user interface and an application.
- the modem processor mainly processes wireless communication. It may be understood that, the above modem controller may be not integrated in the processor 780 .
- the mobile phone 700 may further include an imaging apparatus 790 .
- the imaging apparatus includes a lens 791 and a driving device 792 .
- the driving device 792 is configured to drive the lens 791 to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens 791 .
- the mobile phone 700 may further include a power supply (such as a battery) for providing powers to various parts of the mobile phone.
- a power supply such as a battery
- the power supply may be logically connected to a power management system and the processor 780 , thereby managing a charging, discharging and power consumption via the power management system.
- the processor 780 included in the terminal performs following acts when executing the computer program stored in the memory.
- an imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured.
- the imaging apparatus includes a lens and a driving device.
- the driving device is configured to drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens.
- the first position is a beginning position and the second position is an ending position.
- the lens begins to move gradually when the imaging apparatus begins focusing.
- a focus value (FV) of a focusing area is calculated in real time according to a preset algorithm during a moving process of the lens. It is found that the focus value increases gradually, and the focus value of the focusing area in an image is maximum (i.e., sharpness of the focusing area is highest) when the image is successfully focused.
- focus values are the data obtained from processing an image inputted by the imaging apparatus for representing image sharpness.
- the focusing is realized by finding a focusing position corresponding to a time when the focus value of the image is the highest.
- a control module controls the imaging apparatus to employ the contrast-detection autofocus mode to begin to focus on the target object to be captured.
- a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move.
- the offset value may be understood as a jitter value, i.e., a moving offset value or a rotation value of the imaging apparatus caused by external interference when the imaging apparatus employs the contrast-detection autofocus mode to focus on the target object to be captured.
- a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values.
- the plurality of focus values of validity are obtained according to the obtained offset values and a preset offset value.
- the focus value of validity refers to a focus value corresponding to an offset value in a preset offset range.
- a maximum value of the obtained focus values may have a local maximum value if a jitter is occurs on the imaging apparatus.
- the imaging apparatus does not know the local maximum value is caused by the jitter, and may finally determine a position when the image is successfully focused at a position corresponding to the local maximum value, which may cause an out-of-focus phenomenon.
- the local maximum value formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, with only the plurality of focus values of validity obtained, thus avoiding the out-of-focus phenomenon.
- a maximum value is determined from the plurality of focus values of validity.
- the maximum value may be determined from the plurality of focus values of validity according to a preset algorithm.
- the focusing may be realized according to the maximum value.
- the imaging apparatus is controlled to employ the contrast-detection auto-focus mode to focus on the target object to be captured, the current focus value and the current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move, the local maximum value of the focus values formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, and only the plurality of focus values of validity are obtained, avoiding the out-of-focus phenomenon, which may realize precise focusing on the target object to be captured.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
- Automatic Focus Adjustment (AREA)
Abstract
Description
- The present disclosure relates to a focusing technology field, and more particularly to a focusing method, a focusing apparatus, a computer readable storage medium and a terminal.
- A terminal having a built-in imaging apparatus may employ a contrast-detection autofocus mode during photographing. In the contrast-detection autofocus mode, focusing is performed by calculating a focus value (FV). When the focus value reaches a peak value, a position of a lens in the imaging apparatus is a second position. However, the imaging apparatus may be out of focus when a jitter occurs on the terminal.
- Embodiments of the present disclosure provide a focusing method, a focusing apparatus, a computer readable storage medium and a terminal, which may prevent out-of-focus caused by a jitter and may realize precise focusing.
- A focusing method includes the following. An imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured. A current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move. A plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values. A maximum value is determined from the plurality of focus values of validity.
- A computer readable storage medium has stored therein a computer program, when executed by a processor, causes the processor to perform following acts. An imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured. A current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move. A plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values. A maximum value is determined from the plurality of focus values of validity.
- A terminal includes an imaging apparatus, a gyroscope, a memory, a processor, and a computer program stored in the memory and executable by the processor. The processor performs following acts when executing the computer program. An imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured. A current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move. A plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values. A maximum value is determined from the plurality of focus values of validity.
-
FIG. 1 is a flow chart of a focusing method according to an embodiment of the present disclosure; -
FIG. 2 is a flow chart of obtaining a current focus value and a current offset value of an imaging apparatus according to an embodiment of the present disclosure; -
FIG. 3 is a flow chart of obtaining a plurality of focus values of validity from obtained focus values according to obtained offset values according to an embodiment of the present disclosure; -
FIG. 4 is a block diagram illustrating a focusing apparatus according to an embodiment of the present disclosure; -
FIG. 5 is a block diagram illustrating a focusing apparatus according to another embodiment of the present disclosure; -
FIG. 6 is a flow chart of acts performed when a computer program stored in a computer readable storage medium is executed by a processor according to an embodiment of the present disclosure; -
FIG. 7 is a schematic diagram of an internal structure of a terminal according to an embodiment of the present disclosure; -
FIG. 8 is a flow chart of acts performed when a processor of a terminal executes a computer program according to an embodiment of the present disclosure. - In order to make the objectives, the technical solutions and the advantages of the present disclosure more clear, further explanations on this disclosure are given below in details with reference to figures and exemplary embodiments. It is to be understood that, the exemplary embodiments described herein are merely used to explain the disclosure, rather than to limit this disclosure.
-
FIG. 1 is a flow chart of a focusing method according to an embodiment of the present disclosure. As illustrated inFIG. 1 , the focusing method includes the following. - At
block 102, an imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured. - In an embodiment, the imaging apparatus includes a lens and a driving device. The driving device is configured to drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens. The first position is a beginning position and the second position is an ending position.
- In the contrast-detection autofocus technology, the lens begins to move gradually when the imaging apparatus begins focusing. A focus value (FV) of a focusing area is calculated in real time according to a preset algorithm during a moving process of the lens. It is found that the focus value increases gradually, and the focus value of the focusing area in an image is maximum (i.e., sharpness of the focusing area is highest) when the image is successfully focused. Generally, focus values are the data obtained from processing an image inputted by the imaging apparatus for representing image sharpness. Generally, the higher the contrast of the focusing area is, the higher the focus value of the image is. In the contrast-detection autofocus mode, the focusing is realized by finding a focusing position corresponding to a time when the focus value of the image is the highest.
- A control module controls the imaging apparatus to employ the contrast-detection autofocus mode to begin to focus on the target object to be captured.
- At
block 104, a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move. - When the control module drives the lens in the imaging apparatus to move, a focus value of an image currently outputted by the imaging apparatus and an offset value of the imaging apparatus corresponding to the focus value are correspondingly obtained if the lens moves each time. The offset value may be understood as a jitter value, i.e., a moving offset value or a rotation value of the imaging apparatus caused by external interference when the imaging apparatus employs the contrast-detection autofocus mode to focus on the target object to be captured.
- At
block 106, a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values. - The plurality of focus values of validity are obtained according to the obtained offset values and a preset offset value. The focus value of validity refers to a focus value corresponding to an offset value in a preset offset range. When the contrast-detection autofocus mode is employed, a maximum value of the obtained focus values may have a local maximum value if a jitter occurs on the imaging apparatus. However, the imaging apparatus does not know the local maximum value is caused by the jitter, and may finally determine a position when the image is successfully focused at a position corresponding to the local maximum value, which may cause an out-of-focus phenomenon. The local maximum value formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, with only the plurality of focus values of validity obtained, thus avoiding the out-of-focus phenomenon.
- At
block 108, a maximum value is determined from the plurality of focus values of validity. - The maximum value may be determined from the plurality of focus values of validity according to a preset algorithm. The focusing may be realized according to the maximum value.
- With the above focusing method, the imaging apparatus is controlled to employ the contrast-detection autofocus mode to focus on the target object to be captured, the current focus value and the current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move, the local maximum value of the focus values formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, and only the plurality of focus values of validity are obtained, avoiding the out-of-focus phenomenon, which may realize precise focusing on the target object to be captured.
- Referring to
FIG. 2 , in an embodiment, obtaining the current focus value and the current offset value of the imaging apparatus correspondingly each time the imaging apparatus is driven to move includes the following. - At
block 202, a focus value of an image currently outputted by the lens is obtained and a current rotation angular velocity of the lens is obtained from a gyroscope each time the lens is driven to move. - The imaging apparatus includes the lens and the driving device. The driving device may drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens. Therefore, when the lens is driven by the driving device, a focus value of the image currently outputted by the lens is obtained each time the lens is driven to move, and at the same time, the gyroscope-built-in terminal is controlled to obtain the rotation angular velocity of the lens, and the rotation angular velocity is obtained from the gyroscope. That is, the offset value may be understood as the current rotation angular velocity of the lens obtained by the gyroscope. The gyroscope may be a tri-axial MEMS (micro-electro-mechanical system) gyroscope, or a six-axial sensor realized by combining a tri-axial MEMS gyroscope with a tri-axial MEMS accelerometer. The tri-axial MEMS gyroscope may detect positions, moving paths and accelerated speeds in six directions at a time.
- At
block 204, a correspondence relationship between the focus value of the image currently outputted by the lens and the current rotation angular velocity of the lens is established. - A one-to-one correspondence relationship is established according to the obtained focus values of the images outputted by the lens and the obtained rotation angular velocities of the lens. Further, a correspondence table may be established according to the established correspondence relationship.
- Referring to
FIG. 3 , in an embodiment, obtaining the plurality of focus values of validity from the obtained focus values according to the obtained offset values includes the following. - At
block 302, it is determined whether a current offset value of the imaging apparatus is larger than a preset offset value. - In an embodiment, the offset values are rotation angular velocities. Each time an offset value of the imaging apparatus is obtained in real time, the obtained offset value may be compared with the preset offset value. It can be determined whether a jitter currently occurs on the imaging apparatus according to a comparison.
- When the current offset value of the imaging apparatus is larger than the preset offset value, an act at
block 304 is executed. That is, it is determined that the focus value corresponding to the current offset value larger than the preset offset value has no validity, and the focus value of invalidity is filtered out. That is, when the current offset value of the imaging apparatus is larger than the preset offset value, it may be determined that there is a jitter occurring on the imaging apparatus during a current focusing process. The focus value corresponding to the current offset value may be determined according to the established correspondence relationship. The determined focus value is determined to be a focus value of invalidity. A single and independent focus value of invalidity is filtered out. In other words, when there is a jitter occurring on the imaging apparatus during the focusing process, a corresponding focus value is an invalid value. - When the current offset value is less than the preset offset value, an act at
block 306 is executed. That is, it is determined that a focus value corresponding to the current offset value not larger than the preset offset value has validity, and the focus value of validity is reserved. That is, when the current offset value of the imaging apparatus is less than the preset offset value, it may be determined that there is no jitter occurring on the imaging apparatus during a current focusing process. The focus value corresponding to the current offset value may be determined according to the established correspondence relationship. The determined focus value is determined to be a focus value of validity, and the focus value of validity is reserved. - At
block 308, all the focus values of validity during a process of driving the imaging apparatus are successively obtained. - In a process of employing the contrast-detection autofocus mode to focus on the target object to be captured, i.e., in a process of the lens moving, along the optical axis direction, from the first position to the second position within the focal distance range of the lens, focus values of validity at a plurality of positions are successively obtained.
- In an embodiment, determining the maximum value from the plurality of focus values of validity includes the following. A focusing waveform is obtained according to the plurality of focus values of validity. The maximum value is determined according to the focusing waveform. That is, the focusing waveform is drawn according to the plurality of obtained focus values of validity, and the maximum value of the focus values is determined according to the focusing waveform, thus a precise focusing may be realized according to the maximum value.
- In an embodiment, the focusing method may further include an act of receiving an input from a user to set the preset offset value.
- In detail, the user may set a preset value via a touch screen or speech input. For example, the user may set the preset value according his using habit, thus improving user experience.
- Embodiments of the present disclosure further provide a focusing apparatus.
FIG. 4 is a block diagram illustrating a focusing apparatus according to an embodiment of the present disclosure. As illustrated inFIG. 4 , the focusing apparatus includes acontrol module 410, an obtainingmodule 420, aprocessing module 430, and afiltering module 440. - The
control module 410 is configured to control an imaging apparatus to employ a contrast-detection autofocus mode to focus on a target object to be captured. - The obtaining
module 420 is configured to obtain a current focus value and a current offset value of the imaging apparatus correspondingly each time the imaging apparatus is driven to move. - The
processing module 430 is configured to obtain a plurality of focus values of validity from the obtained focus values according to the obtained offset values. - The
filtering module 440 is configured to determine a maximum value from the plurality of focus values of validity. - With the above focusing device, the
control module 410 may control the imaging apparatus to employ the contrast-detection autofocus mode to focus on the target object to be captured, the obtainingmodule 420 correspondingly obtains the current focus value and the current offset value of the imaging apparatus each time the imaging apparatus is driven to move, theprocessing module 430 may filter out the local maximum value of the focus values formed by a jitter according to the obtained offset values and a preset offset value, and only the plurality of focus values of validity are obtained, thefiltering module 440 determines the maximum value from the plurality of focus values of validity, thus avoiding an out-of-focus phenomenon, which may realize precise focusing on the target object to be captured. - In an embodiment, the focusing apparatus includes a lens and a driving device. The driving device is configured to drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens. The first position is a beginning position and the second position is an ending position.
- In the contrast-detection autofocus technology, the lens begins to move gradually when the imaging apparatus begins focusing. A focus value (FV) of a focusing area is calculated in real time according to a preset algorithm during a moving process of the lens. It is found that the focus value increases gradually, and the focus value of the focusing area in an image is maximum (i.e., sharpness of the focusing area is highest) when the image is successfully focused. Generally, focus values are the data obtained from processing an image inputted by the imaging apparatus for representing image sharpness. Generally, the higher the contrast of the focusing area is, the higher the focus value of the image is. In the contrast-detection autofocus mode, the focusing is realized by finding a focusing position corresponding to a time when the focus value of the image is the highest.
- In an embodiment, the obtaining
module 420 includes a first obtainingunit 421, a second obtainingunit 423, and an establishingunit 425. - The first obtaining
unit 421 is configured to obtain a focus value of an image currently outputted by the lens. The imaging apparatus includes the lens and the driving device. The driving device may drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens. Therefore, when the lens is driven by the driving device, the first obtainingunit 421 obtains the focus value of the image currently outputted by the lens each time the lens is driven to move. - The second obtaining
unit 423 is configured to obtain a current rotation angular velocity of the lens from a gyroscope. The gyroscope obtains the rotation angular velocity of the lens. The second obtainingunit 423 obtains the rotation angular velocity from the gyroscope. That is, the offset value may be understood as the current rotation angular velocity of the lens obtained by the gyroscope. The gyroscope may be a tri-axial MEMS (micro-electro-mechanical system) gyroscope, or a six-axial sensor realized by combining a tri-axial MEMS gyroscope with a tri-axial MEMS accelerometer. The tri-axial MEMS gyroscope may detect positions, moving paths and accelerated speeds in six directions at a time. - The establishing
unit 425 is configured to establish a correspondence relationship between the focus value of the image currently outputted by the lens and the current rotation angular velocity of the lens. - The establishing
unit 425 establishes a one-to-one correspondence relationship according to the obtained focus values of the images outputted by the lens and the obtained rotation angular velocities of the lens. The establishingunit 425 may further establish a correspondence table according to the established correspondence relationship. - In an embodiment, the
processing module 430 includes astoring unit 431, a determiningunit 433, and aprocessing unit 435. - The storing
unit 431 is configured to store a preset offset value. - The determining
unit 433 is configured to determine whether a current offset value of the imaging apparatus is larger than the preset offset value. Each time an offset value of the imaging apparatus is obtained in real time, the determiningunit 433 compares the obtained offset value with the preset offset value. - The
processing unit 435 is configured to successively obtain all the focus values of validity during a process of driving the imaging apparatus according to a result of the determiningunit 433. When the current offset value of the imaging apparatus is larger than the preset offset value, theprocessing unit 435 may determine that there is a jitter occurring on the imaging apparatus during a current focusing process. The focus value corresponding to the current offset value may be determined according to the established correspondence relationship. The determined focus value is determined to be a focus value of invalidity. A single and independent focus value of invalidity is filtered out. When the current offset value is less than the preset offset value, theprocessing unit 435 may determine that there is no jitter occurring on the imaging apparatus during a current focusing process. The focus value corresponding to the current offset value may be determined according to the established correspondence relationship. The determined focus value is determined to be a focus value of validity, and the focus value of validity is reserved. -
FIG. 5 is a block diagram illustrating a focusing apparatus according to another embodiment of the present disclosure. As illustrated inFIG. 5 , the focusing apparatus includes acontrol module 510, an obtainingmodule 520, aprocessing module 530, afiltering module 540, and asetting module 550. Thecontrol module 510, the obtainingmodule 520, theprocessing module 530, and thefiltering module 540 have similar functions with corresponding modules inFIG. 4 . - The
setting module 550 is configured to receive an input from a user to set the preset offset value. - That is to say, the
setting module 550 is configured to receive the input from a user to set a preset value. In detail, the user may set the preset value via a touch screen or speech input. For example, the user may set the preset value according his using habit, thus improving users' quality of experience. - The division of respective modules in the above focusing apparatus is only for illustration. In other embodiments, the focusing apparatus can be divided into different modules as required to accomplish all or part of the functions of the focusing apparatus.
-
FIG. 6 is a flow chart of acts performed when a computer program (instruction) stored in a computer readable storage medium is executed by a processor according to an embodiment of the present disclosure. As illustrated inFIG. 6 , the computer readable storage medium having stored therein a computer program (instruction), when executed by a processor, causes the processor to perform following acts. - At
block 602, an imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured. - In an embodiment, the imaging apparatus includes a lens and a driving device. The driving device is configured to drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens. The first position is a beginning position and the second position is an ending position.
- In the contrast-detection autofocus technology, the lens begins to move gradually when the imaging apparatus begins focusing. A focus value (FV) of a focusing area is calculated in real time according to a preset algorithm during a moving process of the lens. It is found that the focus value increases gradually, and the focus value of the focusing area in an image is maximum (i.e., sharpness of the focusing area is highest) when the image is successfully focused. Generally, focus values are the data obtained from processing an image inputted by the imaging apparatus for representing image sharpness. Generally, the higher the contrast of the focusing area is, the higher the focus value of the image is. In the contrast-detection autofocus mode, the focusing is realized by finding a focusing position corresponding to a time when the focus value of the image is the highest.
- A control module controls the imaging apparatus to employ the contrast-detection autofocus mode to begin to focus on the target object to be captured.
- At
block 604, a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move. - When the control module drives the lens in the imaging apparatus to move, a focus value of an image currently outputted by the imaging apparatus and an offset value of the imaging apparatus corresponding to the focus value are correspondingly obtained if the lens moves each time. The offset value may be understood as a jitter value, i.e., a moving offset value or a rotation value of the imaging apparatus caused by external interference when the imaging apparatus employs the contrast-detection autofocus mode to focus on the target object to be captured.
- At
block 606, a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values. - The plurality of focus values of validity are obtained according to the obtained offset values and a preset offset value. The focus value of validity refers to a focus value corresponding to an offset value in a preset offset range. When the contrast-detection autofocus mode is employed, a maximum value of the obtained focus values may have a local maximum value if a jitter occurs on the imaging apparatus. However, the imaging apparatus does not know the local maximum value is caused by the jitter, and may finally determine a position when the image is successfully focused at a position corresponding to the local maximum value, which may cause an out-of-focus phenomenon. The local maximum value formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, with only the plurality of focus values of validity obtained, thus avoiding the out-of-focus phenomenon.
- At
block 608, a maximum value is determined from the plurality of focus values of validity. - The maximum value may be determined from the plurality of focus values of validity according to a preset algorithm. The focusing may be realized according to the maximum value.
- When the computer program (instruction) in the above computer readable storage medium is executed, the imaging apparatus is controlled to employ the contrast-detection autofocus mode to focus on the target object to be captured, the current focus value and the current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move, the local maximum value of the focus values formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, and only the plurality of focus values of validity are obtained, avoiding the out-of-focus phenomenon, which may realize precise focusing on the target object to be captured.
- Embodiments of the present disclosure further provide a terminal. As illustrated in
FIG. 7 , for simplification of illustration, portions related to embodiments of the present disclosure are merely illustrated. For those technical details being not disclosed, embodiments of the present disclosure may be referred to. The terminal includes an imaging apparatus, a gyroscope, a memory, a processor, and a computer program stored in the memory and executable by the processor. - The terminal may include a mobile phone, a tablet computer, a wearable device or any other terminal device including an imaging apparatus. The imaging apparatus includes a front camera and/or a rear camera. The mobile phone as the terminal is taken as an example for illustrating.
-
FIG. 7 is a schematic diagram of an internal structure of a terminal according to an embodiment of the present disclosure. With reference toFIG. 7 , the mobile phone includes a radio frequency (RF)circuit 710, amemory 720, aninput unit 730, adisplay unit 740, asensor 750, anaudio circuit 760, a wireless fidelity (Wi-Fi)module 770, aprocessor 780 and animaging apparatus 790, and the like. It may be understood by those skilled in the art that the structures of the mobile phone illustrated inFIG. 7 do not limit the structures of the mobile phone. The mobile phone may include less or more components than those illustrated inFIG. 7 or combinations thereof, or have a different arrangement of components. - The
RF circuit 710 may be configured to receive or transmit a signal during a process of transmitting or receiving a message or making a call. TheRF circuit 710 may be configured to receive downlink data from a base station and to transmit the downlink data to theprocessor 780. Alternatively, theRF circuit 710 may be configured to transmit uplink data to the base station. In general, the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a diplexer and the like. Furthermore, theRF circuit 710 may be further configured to communicate with other devices via wireless communication and network. The above wireless communication may adopt any communication standard or protocol, which includes but is not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), e-mail, short messaging service (SMS) and the like. - The
memory 720 may be configured to store software programs or modules. Theprocessor 780 is configured to execute various functional applications and data processes of the mobile phone by running the software programs and modules stored in thememory 720. Thememory 720 may mainly include a program storage region and a data storage region. The program storage region may store an operation system, at least one function required applications (such as an application having a sound playing function, an application having an image playing function) and the like. The data storage region may store data produced by using the mobile phone (such as audio data, an address book) and the like. In addition, thememory 720 may include a high speed random access memory and may include a non-volatility memory, such as at least one disk memory, a flash memory, or other volatility solid state memory. - The
input unit 730 may be configured to receive figure or character information inputted and generate a key signal input related to a user setup or function control of themobile phone 700. In detail, theinput unit 730 may include atouch panel 731 andother input devices 732. The touch panel 731 (also called as touch screen) may be configured to gather touch operations near or on the touch panel 731 (such as an operation on thetouch panel 731 or near thetouch panel 731 of the user with a finger, a stylus or other suitable objects or attachments), and drive corresponding connected device according to a preset program. In an embodiment, thetouch panel 731 may include a touch detection device and a touch controller. The touch detection device detects an orientation of the user's touch, detects a signal caused by the touch operation and sends the signal to the touch controller. The touch controller receives the touch information on the touch detection device, converts the touch information to touch point coordinates, and sends the touch point coordinates to theprocessor 780. Furthermore, the touch controller may receive and execute a command sent from theprocessor 780. Thetouch panel 731 may be implemented as resistance typed, capacitive typed, infrared typed and surface acoustic wave typed. In addition to thetouch panel 731, theinput unit 730 may further includeother input devices 732. In detail, theother input devices 732 may include but without limitation to one or more of a physical keyboard, a functional key (such as a volume control key, a switch key and the like). - The
display unit 740 may be configured to display information inputted by the user or information provided to the user or various menus of the mobile phone. Thedisplay unit 740 may include adisplay panel 741. In an embodiment, thedisplay panel 741 may be configured as a liquid crystal display (LCD), an organic light-emitting diode (OLED) and the like. In an embodiment, thetouch panel 731 may cover thedisplay panel 741. When thetouch panel 731 detects the touch operation on thetouch panel 731 or near thetouch panel 731, the touch operation is transmitted to theprocessor 780 to determine a type of the touch event. Thereafter, theprocessor 780 provides a corresponding visual output on thedisplay panel 741 according to the type of the touch event. Although thetouch panel 731 and thedisplay panel 741 are two separate components to realize an input and output function of the mobile phone illustrated inFIG. 7 , in certain embodiments, thetouch panel 731 and thedisplay panel 741 may be integrated to realize the input and output function of the mobile phone, - The
mobile phone 700 may further include at least onesensor 750, such as a gyroscope, an optical sensor, a motion sensor and other sensors. In detail, the gyroscope is configured to collect a rotation angular velocity of the mobile phone. The optical sensor may include a surrounding light sensor and a proximity sensor. The surrounding light sensor may adjust a brightness of thedisplay panel 741 according to surrounding lights. The proximity sensor may close thedisplay panel 741 and/or backlight when the mobile phone moves near ears of the user. The motion sensor may include an acceleration sensor, for measuring the acceleration value in various directions via the acceleration sensor, measuring a value and a direction of gravity when the phone is static, and identifying a state of the mobile phone (such as landscape screen and portrait screen switching), jitter related functions (such as a pedometer, a knocking) and the like. Furthermore, the mobile phone may be configured with a barometer, a hygrometer, a thermometer, an infrared sensor and other sensors. - The
audio circuit 760, aloudspeaker 761 and amicrophone 762 may provide an audio interface between the user and the phone. Theaudio circuit 760 may transmit an electrical signal converted from the audio data received to theloudspeaker 761. Theloudspeaker 761 converts the electrical signal to a sound signal and output the sound signal. In another aspect, themicrophone 762 may convert gathered sound singles to electrical signals. Theaudio circuit 760 receives and converts the electrical signals to audio data and outputs the audio data to theprocessor 780 to be processed. The audio data processed by theprocessor 780 may be transmitted to another mobile phone via theRF circuit 710 or may be stored in thememory 720 to be subsequently processed. - Wi-Fi is a short distance wireless communication technology. The mobile phone may help the user to receive or send an e-mail, search webpages, access to stream medium via the Wi-
Fi module 770. The Wi-Fi module 770 provides a wireless broadband Internet access. Although the Wi-Fi module 770 is illustrated inFIG. 7 , it may be understood that, the Wi-Fi module 770 is not necessary for themobile phone 700, thus it may be omitted according to demands. - The
processor 780 is a control center of the phone, which utilizes various interfaces and wires to connect various parts of the phone. By running or executing the software program and/or modules stored in thememory 720, and by invoking data stored in thememory 720, the various functions and data processing functions may be executed, thus integrally monitoring the mobile phone. In an embodiment, theprocessor 780 may include one or more processing units. In an embodiment, theprocessor 780 may be integrated with an application processor or a modem processor. The application processor mainly processes the operation system, a user interface and an application. The modem processor mainly processes wireless communication. It may be understood that, the above modem controller may be not integrated in theprocessor 780. - The
mobile phone 700 may further include animaging apparatus 790. The imaging apparatus includes alens 791 and adriving device 792. Thedriving device 792 is configured to drive thelens 791 to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of thelens 791. - The
mobile phone 700 may further include a power supply (such as a battery) for providing powers to various parts of the mobile phone. Alternatively, the power supply may be logically connected to a power management system and theprocessor 780, thereby managing a charging, discharging and power consumption via the power management system. - In embodiments of the present disclosure, the
processor 780 included in the terminal performs following acts when executing the computer program stored in the memory. - At
block 802, an imaging apparatus is controlled to employ a contrast-detection autofocus mode to focus on a target object to be captured. - In an embodiment, the imaging apparatus includes a lens and a driving device. The driving device is configured to drive the lens to move successively, along the optical axis direction, to a plurality of positions respectively from a first position to a second position within a focal distance range of the lens. The first position is a beginning position and the second position is an ending position.
- In the contrast-detection autofocus technology, the lens begins to move gradually when the imaging apparatus begins focusing. A focus value (FV) of a focusing area is calculated in real time according to a preset algorithm during a moving process of the lens. It is found that the focus value increases gradually, and the focus value of the focusing area in an image is maximum (i.e., sharpness of the focusing area is highest) when the image is successfully focused. Generally, focus values are the data obtained from processing an image inputted by the imaging apparatus for representing image sharpness. Generally, the higher the contrast of the focusing area is, the higher the focus value of the image is. In the contrast-detection autofocus mode, the focusing is realized by finding a focusing position corresponding to a time when the focus value of the image is the highest.
- A control module controls the imaging apparatus to employ the contrast-detection autofocus mode to begin to focus on the target object to be captured.
- At
block 804, a current focus value and a current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move. - When the control module drives the lens in the imaging apparatus to move, a focus value of an image currently outputted by the imaging apparatus and an offset value of the imaging apparatus corresponding to the focus value are correspondingly obtained if the lens moves each time. The offset value may be understood as a jitter value, i.e., a moving offset value or a rotation value of the imaging apparatus caused by external interference when the imaging apparatus employs the contrast-detection autofocus mode to focus on the target object to be captured.
- At
block 806, a plurality of focus values of validity are obtained from the obtained focus values according to the obtained offset values. - The plurality of focus values of validity are obtained according to the obtained offset values and a preset offset value. The focus value of validity refers to a focus value corresponding to an offset value in a preset offset range. When the contrast-detection autofocus mode is employed, a maximum value of the obtained focus values may have a local maximum value if a jitter is occurs on the imaging apparatus. However, the imaging apparatus does not know the local maximum value is caused by the jitter, and may finally determine a position when the image is successfully focused at a position corresponding to the local maximum value, which may cause an out-of-focus phenomenon. The local maximum value formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, with only the plurality of focus values of validity obtained, thus avoiding the out-of-focus phenomenon.
- At
block 808, a maximum value is determined from the plurality of focus values of validity. - The maximum value may be determined from the plurality of focus values of validity according to a preset algorithm. The focusing may be realized according to the maximum value.
- When the processor in the terminal executes the program, the imaging apparatus is controlled to employ the contrast-detection auto-focus mode to focus on the target object to be captured, the current focus value and the current offset value of the imaging apparatus are correspondingly obtained each time the imaging apparatus is driven to move, the local maximum value of the focus values formed by the jitter may be filtered out according to the obtained offset values and the preset offset value, and only the plurality of focus values of validity are obtained, avoiding the out-of-focus phenomenon, which may realize precise focusing on the target object to be captured.
- In order to make the description simple, all possible combinations of the technical features in the foregoing embodiments are not described. However, as long as there is no conflict between the technical features in the embodiments, any combination of technical features in the above-described embodiments may be adopted, which should be considered in the scope of this specification.
- The above embodiments illustrate merely some implementations of the present disclosure, which are described in details but are not construed to limit the scope of the present disclosure. It should be pointed that, for those skilled in the art, without departing from the principle of the present disclosure, various changes and improvements may be made, which are covered by the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure is according to the appended claims.
Claims (18)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710401503.3A CN107124557A (en) | 2017-05-31 | 2017-05-31 | Focusing method, device, computer readable storage medium and terminal |
| CN201710401503 | 2017-05-31 | ||
| CN201710401503.3 | 2017-05-31 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20180352143A1 true US20180352143A1 (en) | 2018-12-06 |
| US10701260B2 US10701260B2 (en) | 2020-06-30 |
Family
ID=59729557
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/871,416 Active 2038-05-17 US10701260B2 (en) | 2017-05-31 | 2018-01-15 | Focusing method, apparatus, computer readable storage medium and terminal |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US10701260B2 (en) |
| EP (1) | EP3410171B1 (en) |
| JP (1) | JP6796210B2 (en) |
| KR (1) | KR102132135B1 (en) |
| CN (1) | CN107124557A (en) |
| TW (1) | TWI656794B (en) |
| WO (1) | WO2018219003A1 (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107124557A (en) * | 2017-05-31 | 2017-09-01 | 广东欧珀移动通信有限公司 | Focusing method, device, computer readable storage medium and terminal |
| CN107566741B (en) * | 2017-10-26 | 2020-04-14 | Oppo广东移动通信有限公司 | Focusing method, apparatus, computer readable storage medium and computer device |
| CN110248097B (en) * | 2019-06-28 | 2021-02-23 | Oppo广东移动通信有限公司 | Focus tracking method and device, terminal equipment and computer readable storage medium |
| CN113079310B (en) * | 2020-01-03 | 2022-11-04 | 北京小米移动软件有限公司 | Automatic focusing method, automatic focusing device, electronic equipment and computer readable storage medium |
| CN111294511B (en) * | 2020-02-06 | 2021-12-14 | 北京小米移动软件有限公司 | Focusing method and device of camera module and storage medium |
| CN111163279B (en) * | 2020-02-12 | 2025-06-10 | Oppo广东移动通信有限公司 | Electronic device, control method and storage medium |
| WO2022000258A1 (en) * | 2020-06-30 | 2022-01-06 | 深圳市大疆创新科技有限公司 | Focusing method and apparatus, electronic device, and computer readable medium |
| CN114755789B (en) * | 2020-12-28 | 2023-07-04 | 北京小米移动软件有限公司 | Focusing method, focusing device, terminal and storage medium |
| CN112954223B (en) * | 2021-03-26 | 2022-10-21 | 维沃移动通信(深圳)有限公司 | Focusing method and device, electronic equipment, readable storage medium and chip |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070065127A1 (en) * | 2005-09-20 | 2007-03-22 | Hirofumi Suda | Image-taking apparatus and focusing method |
| US20110050945A1 (en) * | 2009-09-02 | 2011-03-03 | Hiroshi Konno | Imaging apparatus |
| US20110133066A1 (en) * | 2008-09-16 | 2011-06-09 | Mari Nozoe | Pattern inspection device and method |
| US20150029387A1 (en) * | 2013-07-23 | 2015-01-29 | Olympus Corporation | Imaging apparatus |
| US20150035855A1 (en) * | 2013-07-31 | 2015-02-05 | Samsung Electronics Co., Ltd. | Electronic apparatus, method of controlling the same, and image reproducing apparatus and method |
| US20170318196A1 (en) * | 2016-05-02 | 2017-11-02 | Fuji Xerox Co., Ltd. | Change degree deriving device, change degree deriving system, and non-transitory computer readable medium |
| US20190094487A1 (en) * | 2016-06-01 | 2019-03-28 | Fujifilm Corporation | Imaging device, focusing control method, and focusing control program |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0630322A (en) * | 1992-07-10 | 1994-02-04 | Canon Inc | Automatic focusing device |
| JP2001136419A (en) * | 1999-11-08 | 2001-05-18 | Matsushita Electric Ind Co Ltd | Imaging device |
| JP2002139761A (en) * | 2000-11-02 | 2002-05-17 | Olympus Optical Co Ltd | Camera having shake notifying function |
| JP4323870B2 (en) * | 2003-06-10 | 2009-09-02 | キヤノン株式会社 | Recording device |
| US8537224B2 (en) * | 2005-01-31 | 2013-09-17 | Hewlett-Packard Development Company, L.P. | Image capture device having a shake metter |
| JP2008009340A (en) * | 2006-06-30 | 2008-01-17 | Sony Corp | Autofocus device, imaging device, and autofocus method |
| JP4746110B2 (en) | 2007-02-15 | 2011-08-10 | パナソニック株式会社 | Imaging device and camera body |
| JP4820460B2 (en) | 2009-10-22 | 2011-11-24 | パナソニック株式会社 | Focus system, interchangeable lens and imaging device |
| CN102419505B (en) * | 2011-12-06 | 2014-08-06 | 深圳英飞拓科技股份有限公司 | Automatic focusing method and system and integrated camera |
| JP6124538B2 (en) * | 2012-09-06 | 2017-05-10 | キヤノン株式会社 | IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, AND PROGRAM |
| CN103945126B (en) * | 2014-04-21 | 2015-03-04 | 中国人民解放军国防科学技术大学 | Automatic focusing and locating method |
| CN104618654B (en) * | 2015-02-13 | 2017-10-13 | 成都品果科技有限公司 | It is a kind of based on the mobile electronic device sequential focusing method and system for rocking detection |
| CN105657278A (en) * | 2016-02-29 | 2016-06-08 | 广东欧珀移动通信有限公司 | Control method, control device and electronic device |
| CN105827980B (en) * | 2016-05-04 | 2018-01-19 | 广东欧珀移动通信有限公司 | Focusing control method and device, imaging control method and device and electronic device |
| CN106534702A (en) * | 2016-12-22 | 2017-03-22 | 珠海市魅族科技有限公司 | Focusing method and focusing device |
| CN107124557A (en) | 2017-05-31 | 2017-09-01 | 广东欧珀移动通信有限公司 | Focusing method, device, computer readable storage medium and terminal |
-
2017
- 2017-05-31 CN CN201710401503.3A patent/CN107124557A/en active Pending
- 2017-12-20 TW TW106144852A patent/TWI656794B/en not_active IP Right Cessation
-
2018
- 2018-01-15 US US15/871,416 patent/US10701260B2/en active Active
- 2018-02-12 EP EP18156274.5A patent/EP3410171B1/en active Active
- 2018-03-05 WO PCT/CN2018/078053 patent/WO2018219003A1/en not_active Ceased
- 2018-03-05 KR KR1020197019129A patent/KR102132135B1/en not_active Expired - Fee Related
- 2018-03-05 JP JP2019538219A patent/JP6796210B2/en not_active Expired - Fee Related
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070065127A1 (en) * | 2005-09-20 | 2007-03-22 | Hirofumi Suda | Image-taking apparatus and focusing method |
| US7512328B2 (en) * | 2005-09-20 | 2009-03-31 | Canon Kabushiki Kaisha | Image-taking apparatus and focusing method |
| US20110133066A1 (en) * | 2008-09-16 | 2011-06-09 | Mari Nozoe | Pattern inspection device and method |
| US20110050945A1 (en) * | 2009-09-02 | 2011-03-03 | Hiroshi Konno | Imaging apparatus |
| US20150029387A1 (en) * | 2013-07-23 | 2015-01-29 | Olympus Corporation | Imaging apparatus |
| US9392161B2 (en) * | 2013-07-23 | 2016-07-12 | Olympus Corporation | Imaging apparatus |
| US20150035855A1 (en) * | 2013-07-31 | 2015-02-05 | Samsung Electronics Co., Ltd. | Electronic apparatus, method of controlling the same, and image reproducing apparatus and method |
| US20170318196A1 (en) * | 2016-05-02 | 2017-11-02 | Fuji Xerox Co., Ltd. | Change degree deriving device, change degree deriving system, and non-transitory computer readable medium |
| US20190094487A1 (en) * | 2016-06-01 | 2019-03-28 | Fujifilm Corporation | Imaging device, focusing control method, and focusing control program |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201904264A (en) | 2019-01-16 |
| CN107124557A (en) | 2017-09-01 |
| WO2018219003A1 (en) | 2018-12-06 |
| TWI656794B (en) | 2019-04-11 |
| US10701260B2 (en) | 2020-06-30 |
| EP3410171B1 (en) | 2020-10-14 |
| JP2020507802A (en) | 2020-03-12 |
| EP3410171A1 (en) | 2018-12-05 |
| KR20190089974A (en) | 2019-07-31 |
| JP6796210B2 (en) | 2020-12-02 |
| KR102132135B1 (en) | 2020-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10701260B2 (en) | Focusing method, apparatus, computer readable storage medium and terminal | |
| CN107317896B (en) | Double-camera device and mobile terminal | |
| CN110300267B (en) | Photographing method and terminal equipment | |
| CN112102780B (en) | Display frame rate regulation and control method, device and computer readable storage medium | |
| CN107124556B (en) | Focusing method, focusing device, computer readable storage medium and mobile terminal | |
| CN110060617B (en) | Screen light spot compensation method and device, terminal and readable storage medium | |
| CN107613208B (en) | Focusing area adjusting method, terminal and computer storage medium | |
| CN107580176A (en) | A kind of terminal taking control method, camera shooting terminal and computer-readable recording medium | |
| CN113347371A (en) | Photographing method, flash lamp module, mobile terminal and readable storage medium | |
| US12022190B2 (en) | Photographing method and electronic device | |
| CN113975796B (en) | Game control method, mobile terminal and computer readable storage medium | |
| CN107943402B (en) | Regional brightness control method, intelligent terminal and computer readable storage medium | |
| CN112135060A (en) | Focusing processing method, mobile terminal and computer storage medium | |
| EP3627204B1 (en) | Focusing method and related product | |
| CN108198195B (en) | Focusing method, terminal and computer readable storage medium | |
| WO2021104265A1 (en) | Electronic device and focusing method | |
| CN107728789B (en) | Starting method of one-hand operation mode, terminal and storage medium | |
| CN117793537A (en) | Image processing method, intelligent terminal and storage medium | |
| CN112532838B (en) | Image processing method, mobile terminal and computer storage medium | |
| CN111953814B (en) | Lens module and terminal equipment | |
| CN107257430A (en) | A kind of camera control method, terminal and computer-readable recording medium | |
| US11108950B2 (en) | Method for generating blurred photograph, and storage device and mobile terminal | |
| CN112637489A (en) | Image shooting method, terminal and storage medium | |
| CN112468705B (en) | Periscopic camera module and terminal equipment | |
| HK1238054A1 (en) | Focusing method, device, computer-readable storage medium, and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD., CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHUO, SHIJIE;LI, XIAOPENG;REEL/FRAME:044621/0907 Effective date: 20171214 Owner name: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LT Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHUO, SHIJIE;LI, XIAOPENG;REEL/FRAME:044621/0907 Effective date: 20171214 |
|
| FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |