CN106603928A - Shooting method and mobile terminal - Google Patents

Abstract

The embodiment of the invention discloses a photographing method and a mobile terminal. The method is applied to a mobile terminal with a camera, and the method includes: during the image shooting process, acquiring a preview image of each frame captured by the camera, performing face recognition on the preview image, identifying the shooting subject, and acquiring the characteristics of the shooting scene and the clothing features of the shooting subject, based on the shooting scene features and the clothing features of the shooting subject, image processing is performed on the shooting subject, and after the image shooting is completed, an image-processed target image is generated. Since the target image after image processing matches the shooting scene features and clothing features, the target image meets the special requirements of religion or ethnic minorities for the clothing worn by the subject, and the method described in the embodiment of the present invention saves the subject from specifying The wearing of clothing simplifies the shooting operation of the subject.

Description

A shooting method and mobile terminal

technical field

Embodiments of the present invention relate to the field of communication technologies, and in particular, to a photographing method and a mobile terminal.

Background technique

With the continuous development of terminal functions, the current terminal not only has the function of taking pictures, but also has the function of image processing. For example, after the face recognition function is turned on, the face area can be whitened and smoothed.

In the prior art, after the terminal turns on functions such as Selfie or beautification, it takes original photos of the subject. Since the terminal only takes original pictures of the subject, when the subject's clothing does not meet the special requirements of the religion or ethnic minorities, it is impossible to obtain a captured image that meets the requirements of the religious or ethnic minorities' clothing.

Contents of the invention

The present invention provides a shooting method to solve the problem that in the prior art, the terminal only takes the original shooting of the shooting subject. When the clothing of the shooting subject does not meet the special requirements of religion or ethnic minorities, it is impossible to obtain clothing that meets the requirements of religion or ethnic minorities. Asked questions about capturing images.

In a first aspect, a shooting method is provided, which is applied to a mobile terminal with a camera, and the method includes:

During the image capture process, obtain the preview image of each frame captured by the camera;

Perform face recognition on the preview image to identify the subject;

Obtaining the characteristics of the shooting scene and the clothing characteristics of the subject;

performing image processing on the subject based on the features of the shooting scene and the clothing features of the subject;

After the image capture is completed, a target image after image processing is generated.

In a second aspect, a mobile terminal is provided, the mobile terminal has a camera, including:

The preview image acquisition module is used to acquire the preview image of each frame collected by the camera during the image capture process;

A shooting subject recognition module, configured to perform face recognition on the preview image to identify the shooting subject;

A feature information acquisition module, configured to acquire the features of the shooting scene and the clothing features of the shooting subject;

An image processing module, configured to perform image processing on the subject based on the features of the shooting scene and the clothing features of the subject;

The target image generation module is configured to generate the target image after image processing after the image capture is completed.

In this way, in the embodiment of the present invention, during the image capturing process, the mobile terminal recognizes the subject from the preview image collected by the camera, and performs image processing on the subject according to the characteristics of the shooting scene and the clothing characteristics of the subject. After that, the target image after image processing is generated. Since the target image after image processing matches the shooting scene features and clothing features, the target image meets the special requirements of religion or ethnic minorities for the clothing worn by the subject, and the method described in the embodiment of the present invention saves the subject from specifying The wearing of clothing simplifies the shooting operation of the subject.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments of the present invention. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention , for those skilled in the art, other drawings can also be obtained according to these drawings without paying creative labor.

Fig. 1 is the flow chart of the photographing method of an embodiment of the present invention;

Fig. 2 is a flowchart of a shooting method according to another embodiment of the present invention;

Fig. 3 is a block diagram of a mobile terminal according to an embodiment of the present invention;

Fig. 4 is a block diagram of a mobile terminal according to another embodiment of the present invention;

Fig. 5 is a block diagram of a mobile terminal according to another embodiment of the present invention;

FIG. 6 is a block diagram of a mobile terminal according to another embodiment of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

Embodiment one

Fig. 1 is a flowchart of a shooting method according to an embodiment of the present invention. The shooting method shown in Figure 1 is applied to a mobile terminal with a camera, and the method includes:

Step 101. During the image capturing process, acquire a preview image of each frame captured by the camera.

The method described in the embodiment of the present invention is applied to a mobile terminal with a camera, and the mobile terminal can be in various forms, such as a mobile phone, a tablet, a notebook, a camera, and the like.

The camera of the mobile terminal can be used to take pictures or videos of the subject, and each static picture is called a frame of image, correspondingly, one frame of images can be obtained by taking a picture once, and multiple frames of images can be obtained by one recording. During the image capture process, the mobile terminal uses a camera to collect a preview image of each frame. The preview image may include information such as the subject and the scene to be photographed. The subject of the photograph in the embodiment of the present invention is the photographer.

After the camera captures a preview image frame, the mobile terminal acquires the captured preview image frame.

Step 102 , face recognition is performed on the preview image, and the subject is identified.

Face recognition refers to the technology of identifying identity by analyzing and comparing visual feature information of faces. After the mobile terminal acquires a frame of preview image collected by the camera, it can perform face recognition on the preview image, and identify the subject from the preview image.

Step 103, acquiring the characteristics of the shooting scene and the clothing characteristics of the shooting subject.

Clothing features can indicate a variety of information, such as the subject's gender, religious attributes, and ethnic attributes. After the subject is identified from the preview image, clothing information of the subject can be extracted, and the extracted clothing information can be analyzed to obtain clothing features of the subject. For example, the extracted clothing information of the photographed subject is a Mongolian robe, and the Mongolian robe may indicate that the nationality attribute of the photographed subject is Mongolian, and the Mongolian robe is determined to be the clothing feature.

The characteristics of the shooting scene can indicate a variety of information, such as indicating the region, religious attributes, and ethnic attributes of the subject through the architectural style. The shooting scene information can be extracted from the acquired preview image and analyzed to obtain the shooting scene features.

Since different religions or nationalities have different requirements for the clothing of the subject and the shooting scenes where the subject is located, the embodiment of the present invention can obtain the characteristics of the shooting scene and the clothing characteristics of the shooting subject after the subject is identified, and then According to the characteristics of the shooting scene and the clothing characteristics of the shooting subject, the religion or nationality of the shooting subject is determined, and the corresponding image processing method is further determined, and the clothing of the shooting subject is processed using the determined processing method, so that The clothing of the main body meets the requirements of religion or nationality.

Step 104: Perform image processing on the subject based on the features of the shooting scene and the clothing features of the subject.

In the embodiment of the present invention, corresponding image processing methods can be set in advance for different shooting scene features and different clothing features. relationship, determine the currently required image processing method, and then adopt the required image processing method to perform image processing on the subject in the preview image.

For example, religion A requires that the photographer’s face needs to be covered with a veil, and the corresponding relationship between the clothing characteristics indicating religion A and the processing method for covering the photographer’s face with a veil is established in advance. If the religious attribute of the shooting subject is religion A, the mobile terminal will use a preset veil image to block the face of the photographer in the preview image, so that the obtained image meets the religious requirements.

Step 105, after the image capture is completed, generate a target image after image processing.

After the image capture and image processing are completed, a target image after image processing that matches the characteristics of the shooting scene and the clothing characteristics of the shooting subject is generated, which meets the special requirements for shooting images and enriches the shooting functions of the mobile terminal.

For photographers with religious beliefs or ethnic minorities, when using a mobile terminal with the above-mentioned functions to shoot images, the photographer does not have to wear religious or ethnic costumes. During the shooting process, the mobile terminal can Scene features and clothing features of the photographer, select the corresponding image processing method to process the clothing of the photographer in the preview image, such as adding occluders, so that the generated target image meets the requirements of religion or ethnicity for clothing, eliminating the need for shooting The procedure for wearing the specified clothing.

According to the embodiment of the present invention, during the image capturing process, the mobile terminal recognizes the subject from the preview image collected by the camera, performs image processing on the subject according to the characteristics of the shooting scene and the clothing characteristics of the subject, and after the image capturing is completed, Generate the target image after image processing. Since the target image after image processing matches the shooting scene features and clothing features, the target image meets the special requirements of religion or ethnic minorities for the clothing worn by the subject, and the method described in the embodiment of the present invention saves the subject from specifying The wearing of clothing simplifies the shooting operation of the subject.

Embodiment two

Fig. 2 is a flowchart of a shooting method according to an embodiment of the present invention. The shooting method shown in Figure 2 is applied to a mobile terminal with a camera, and the method includes:

Step 201. During the image capturing process, acquire a preview image of each frame captured by the camera.

In the embodiment of the present invention, the mobile terminal has a camera, which can be in various forms, such as a mobile phone, a tablet, a notebook, a camera, and the like. The camera of the mobile terminal can be used to capture images, and one or more frames of captured images can be obtained in units of frames.

Step 202, performing face recognition on the preview image to identify the subject.

Face recognition technology is used to perform face recognition on the preview image, and each recognized face is determined as the subject of the shot. Then, for each subject, it is analyzed whether image processing is required, and image processing is performed on one or more subjects requiring image processing.

Step 203, acquiring the characteristics of the shooting scene and the clothing characteristics of the shooting subject.

After the identification of the subject is completed, the features of the shooting scene and the clothing features of the subject are acquired.

For example, religion A requires women to cover their faces with veils and wear specified robes when taking pictures. When using the camera of a mobile terminal to take pictures of women of religion A, the mobile terminal obtains the preview image of each frame collected by the camera, and uses face recognition technology from The subject is identified in the preview image of each frame, and then the shooting scene feature and the clothing feature of the shooting subject are obtained. The shooting scene feature can be a building with a certain religious style, and the clothing feature of the shooting subject can be a robe worn by a woman who believes in religion A.

Step 204, based on the features of the shooting scene and the clothing features of the subject, determine the religious attributes of the subject.

Since different religions have different requirements for the clothing worn by the subject, such as requiring the use of veils to cover the face and the use of headscarves to wrap the head, etc., before image processing of the clothing of the subject in the captured image, it is necessary to determine the subject’s clothing Religious attributes, and then adopt an image processing method corresponding to the determined religious attributes to process the collected images, so as to obtain photographed images that meet religious requirements.

Since the characteristics of the shooting scene and the clothing characteristics of the subject can indicate the area where the subject is located, the religion the subject believes in, etc., after obtaining the characteristics of the shooting scene and the clothing characteristics of the shooting subject, according to the characteristics of the shooting scene and the clothing of the shooting subject Features to determine the religious attributes of the subject.

For example, when taking a picture of a woman who believes in religion A in step 203, the acquired shooting scene feature is a building with the style of religion A, and the acquired clothing feature of the subject is the robe specified by religion A. According to the architectural style and the clothing worn by the subject, Robe, determine the religious attribute of the subject as religion A.

Step 205, acquiring the subject image area.

In the embodiment of the present invention, the religious attribute of the subject is determined according to the characteristics of the shooting scene and the clothing characteristics of the shooting subject. The subject's attire meets religious requirements.

Before performing image processing on the subject, it is necessary to determine the image area where the subject is located, and then perform image processing on the subject in the subject area.

For example, after the shooting of the subject is completed, if it is determined that the religious attribute of the subject is religion A, and the face of the subject is not covered by a veil, the image area where the woman is located is acquired.

Step 206, based on the religious attribute of the subject, determine the image material corresponding to the image area of the subject.

In the embodiment of the present invention, the religious attribute is the type of religion. Different religions have different requirements on the clothing they wear, such as requiring the use of veils to cover the face, the use of headscarves to wrap the head, etc., the embodiment of the present invention can pre-set different image materials for different religions and store them in the preset storage space of the mobile terminal , the image material is used to block the specified part of the subject in the captured image, and the image material can be in various forms, such as headgear images, face decoration images, etc.

In the embodiment of the present invention, after determining the religious attributes of the shooting subject according to the characteristics of the shooting scene and the clothing characteristics of the shooting subject, the image material corresponding to the currently determined religious attribute can be determined according to the image materials set in advance for different types of religions, and then used The selected image material performs image processing on the subject image area.

For example, the image material set corresponding to religion A is a veil. After determining that the religious attribute of the subject is religion A according to the characteristics of the shooting scene and the clothing characteristics of the subject, and determining that the subject is not wearing a veil, according to the pre-set religion A The image material is the corresponding relationship of the veil, and it is determined that the image material corresponding to the subject image area is the veil.

Step 207 , based on the image material, perform image processing on the subject image area.

After the image material used for processing the preview image is determined, image processing is performed on the subject image area by using the determined image material.

For example, after determining that the image material set for religion A is a veil, use the veil to block the face of the subject in the captured image. Specifically, the veil set for religion A can be extracted, and the veil can be superimposed on the face area of the subject , so that the face of the subject in the generated image is covered by a veil, so that the captured image meets religious requirements.

Preferably, step 207 may specifically include:

Adjust the size, angle and/or shape of the image footage based on the subject image area. Wherein, the image material may at least include a headgear image and/or a face decoration image.

Specifically, since the subject has different sizes, angles, and/or shapes in different preview images captured, after determining the image material corresponding to the subject image area, it is first necessary to determine that the image material in the subject image area is to be superimposed and then adjust the size, angle and/or shape of the image material according to the preset area, so that the size, angle and/or shape of the adjusted image material is consistent with the preset area in the image area of the subject After matching, a qualified image is obtained after processing.

For example, when the image material is a veil, it is first determined that the preset area to be superimposed on the image material in the image area of the subject is the head of the subject. When the head of the subject has a certain inclination angle, the mobile terminal extracts After matching the set veil, adjust the size of the veil to match the face size of subject A, and adjust the angle of the veil so that it can cover the face of the subject.

After the size, angle and/or shape of the image material is adjusted based on the image area of the subject, the adjusted image material is superimposed and displayed in a preset area of the image area of the subject.

After the adjustment of the image material is completed, the adjusted image material is superimposed and displayed in the preset area of the image area of the shooting subject, so as to realize the occlusion of the preset area. The preset area of the subject image area can be determined according to the image material. If the image material is a veil, the preset area of the subject image area is the face; if the image material is a veil, the preset area of the subject image area is the head .

Step 208 , after the image capture is completed, generate a target image after image processing.

After the image material is superimposed and displayed in the preset area of the image area of the shooting subject, the image processing is completed, and after the image shooting is completed, a target image meeting the requirements of the superimposed display image material is generated.

Preferably, after step 208, the method may further include: acquiring facial feature information of the photographed subject, and storing the facial feature information.

If only one subject is included in the target image, the facial feature information of the subject is recorded; if multiple subjects are included in the target image, the facial feature information of the subjects at different image positions is recorded. The facial feature information may include multiple types, such as one or more of facial features structure, facial features size, and pupil color.

The processed target image may include one or more subjects. In the embodiment of the present invention, after the step of storing facial feature information is performed, the requester may receive an instruction to view a target subject in the target image, such as receiving a user's click operation on a target subject in the target image, and the mobile terminal receives After receiving the viewing command of the target subject, turn on the camera to collect the face image of the requester, obtain the face image of the requester, then extract the face feature information in the face image of the requester, and convert the face image The face feature information is compared with the pre-stored face feature information of the target subject, and when the face feature information in the face image matches the face feature information of the target subject, it is determined that the requester is the target image The target subject in , and the requester wants to view his own image, at this time, the image material superimposed on the target subject is removed, so that the target subject can view the initial image that is not blocked by the image material.

For example, the face of subject A in the target image is overlaid with a veil. When subject A views the processed target image and wants to view his own face image, the preset operation will be performed, such as clicking on the veil of subject A in the target image, and the corresponding Specifically, after the mobile terminal receives the operation, it will turn on the camera to collect the face image of the subject A, recognize the face feature information of the subject A, and then compare the currently recognized face feature information with the pre-stored face image for the subject A. Comparing the face feature information, after judging that the two are the same, it is determined that the requester is the subject A, and at this time, the veil of the subject A’s face in the target image is removed.

Preferably, in the embodiment of the present invention, after the step of storing the face feature information, the camera is turned on for face recognition, and the face feature information is recognized. When the face feature information matches, the image material superimposed on the matched subject is removed.

When the user views the target image, the camera is automatically turned on for face recognition without any user operation, and the user's face feature information collected by the camera is recognized, and the recognized face feature information is compared with one or more of the target image. Compare the face feature information of multiple subjects, and when the recognized face feature information matches the face feature information of a subject, it is determined that the user captured by the camera is the subject, and the matched The image material superimposed on the subject of the camera allows the user to view the original image that is not blocked by the image material.

The embodiment of the present invention can judge whether the user viewing the target image is a subject in the target image by comparing the facial feature information, and if so, remove the image material superimposed and displayed on the subject in the target image, so that Users view their initial images that are not blocked by image materials, thereby satisfying users' needs for viewing their own facial information, and at the same time realizing that their own facial information is not obtained by others, ensuring the privacy and security of the subject.

Preferably, step 208 may specifically include: after the image capture is completed, simultaneously generating an initial image without image processing and a target image after image processing; storing the initial image and the target image respectively in the first storage space or the second storage space, or share the initial image and the target image to the first instant messaging application program and the second instant messaging application program respectively.

After the image capture and image processing are completed, two versions of the target image after image processing and the initial image without image processing are automatically generated for users to choose freely for subsequent viewing and use.

After the mobile terminal simultaneously generates the initial image without image processing and the target image after image processing, it can store the initial image in the first storage space, and only the subject or a small number of users with access rights can access the first storage space Check the initial image, thereby ensuring the privacy of the initial image and ensuring the privacy and security of the subject. When the subject himself or a few authorized users need to view the initial image, they can access the first storage space to view the initial image. Correspondingly, after the network terminal detects the subject's private account or the correct password or the correct answer to the question to allow the subject to enter the first storage space to view the initial image. At the same time, the processed target image is stored in the second storage space, and the subject and other users can view the target image by accessing the second storage space.

After the mobile terminal simultaneously generates the initial image without image processing and the target image after image processing, it can also share the initial image to the first instant messaging application program. Only the subject or a small number of users with access rights can use the first An instant messaging application to view the initial image. At the same time, the image-processed target image is shared to the second instant messaging application, and the subject and other users can view the target image by using the second instant messaging application.

In the embodiment of the present invention, the generated initial image and the processed target image are stored or shared in different instant communication applications, so that the original image without image processing can only be viewed by the subject or a small number of users with access rights, ensuring While ensuring that the initial image can be viewed, the privacy of the initial image is guaranteed, and the privacy and security of the shooting subject are guaranteed.

According to the embodiment of the present invention, during the image capturing process, the mobile terminal recognizes the subject from the preview image collected by the camera, performs image processing on the subject according to the characteristics of the shooting scene and the clothing characteristics of the subject, and after the image capturing is completed, Generate the target image after image processing. Since the target image after image processing matches the shooting scene features and clothing features, the target image meets the special requirements of religion or ethnic minorities for the clothing worn by the subject, and the method described in the embodiment of the present invention saves the subject from specifying The wearing of clothing simplifies the shooting operation of the subject.

Embodiment three

FIG. 3 is a block diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal shown in Figure 3 includes a camera, and the mobile terminal includes:

The preview image acquisition module 301 is configured to acquire a preview image of each frame captured by the camera during the image capturing process.

The subject identification module 302 is configured to perform face recognition on the preview image to identify the subject.

The characteristic information obtaining module 303 is used to obtain the characteristics of the shooting scene and the clothing characteristics of the shooting subject.

The image processing module 304 is configured to perform image processing on the subject based on the features of the shooting scene and the clothing features of the subject.

The target image generating module 305 is configured to generate a target image after image processing after the image capture is completed.

Referring to FIG. 4 , on the basis of FIG. 3 , the modules further included in the mobile terminal and the submodules included in the modules are described.

In the embodiment of the present invention, the image processing module 404 includes:

The religious attribute determination sub-module 4041 is used to determine the shooting scene characteristics and the clothing characteristics of the shooting subject based on the shooting scene characteristics and the clothing characteristics of the shooting subject after the feature information obtaining module 403 obtains the Religious attributes;

An image area acquisition sub-module 4042, configured to acquire the image area of the subject;

The image material determination sub-module 4043 is configured to determine the image material corresponding to the image area of the subject based on the religious attribute of the subject;

The image modification sub-module 4044 is configured to perform image processing on the subject image area based on the image material.

In the embodiment of the present invention, the image modification sub-module 4044 includes:

An image material adjustment unit 40441, configured to adjust the size, angle and/or shape of the image material based on the subject image area;

An image material superimposition unit 40442, configured to superimpose and display the adjusted image material in a preset area of the subject image area;

Wherein, the image material includes at least a headgear image and/or a face decoration image.

In the embodiment of the present invention, the mobile terminal further includes:

The facial feature information acquiring module 406 is used to acquire the facial feature information of the shooting subject after the image capture is completed, after the step of generating the image-processed target image;

The face feature information storage module 407 is configured to store the face feature information.

In the embodiment of the present invention, the mobile terminal further includes:

A viewing instruction receiving module 408, configured to receive a viewing instruction from a requester for a target subject in the target image after storing the facial feature information;

Facial image obtaining module 409, used to turn on the camera to collect the facial image of the requester to obtain the facial image of the requester;

Facial feature information extraction module 410, used to extract the facial feature information in the human face image;

Facial feature information comparison module 411, configured to compare the facial feature information in the face image with the pre-stored facial feature information of the target subject;

The first image material removal module 412 is configured to remove the image material superimposed on the target subject when the face feature information in the face image matches the face feature information of the target subject .

In the embodiment of the present invention, the mobile terminal further includes:

Facial feature information identification module 413, for after storing described facial feature information, open camera and carry out face recognition, identify facial feature information;

The second image material removal module 414 is configured to remove the image material superimposed on the matched subject when the recognized facial feature information matches the facial feature information of a subject in the target image .

In the embodiment of the present invention, the target image generation module 405 includes:

The image generation sub-module 4051 is used to simultaneously generate an initial image without image processing and a target image after image processing after the image capture is completed;

The image storage sub-module 4052 is configured to store the initial image and the target image in the first storage space or the second storage space respectively, or share the initial image and the target image to the first instant messaging application respectively program and a second instant messaging application.

In the embodiment of the present invention, the subject identification module 402 is specifically used for the preview image acquisition module 401 to perform face recognition on the preview image after acquiring each frame of preview image captured by the camera during the image capture process, and recognize Each human face is determined as the subject respectively.

During the image capturing process, the mobile terminal in the embodiment of the present invention recognizes the subject from the preview image collected by the camera, performs image processing on the subject according to the characteristics of the shooting scene and the clothing characteristics of the subject, and generates The target image after image processing. Since the target image after image processing matches the shooting scene features and clothing features, the target image meets the special requirements of religion or ethnic minorities for the clothing worn by the subject, and the method described in the embodiment of the present invention saves the subject from specifying The wearing of clothing simplifies the shooting operation of the subject.

Embodiment five

FIG. 5 is a block diagram of a mobile terminal according to another embodiment of the present invention. The mobile terminal 500 shown in FIG. 5 includes: at least one processor 501 , a memory 502 , at least one network interface 504 , a user interface 503 and a camera 506 . Various components in the mobile terminal 500 are coupled together through the bus system 505 . It can be understood that the bus system 505 is used to realize connection and communication between these components. In addition to the data bus, the bus system 505 also includes a power bus, a control bus and a status signal bus. However, for clarity of illustration, the various buses are labeled as bus system 505 in FIG. 5 .

Wherein, the user interface 503 may include a display, a keyboard, or a pointing device (for example, a mouse, a trackball (trackball), a touch panel, or a touch screen, and the like.

It can be understood that the memory 502 in the embodiment of the present invention may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Wherein, the non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electronically programmable Erase Programmable Read-Only Memory (Electrically EPROM, EEPROM) or Flash. The volatile memory can be Random Access Memory (RAM), which acts as an external cache. By way of illustration and not limitation, many forms of RAM are available such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data RateSDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (Synchlink DRAM, SLDRAM) and Direct memory bus random access memory (DirectRambus RAM, DRRAM). The memory 502 of the systems and methods described in embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

In some implementations, the memory 502 stores the following elements, executable modules or data structures, or their subsets, or their extended sets: an operating system 5021 and an application program 5022 .

Among them, the operating system 5021 includes various system programs, such as framework layer, core library layer, driver layer, etc., for realizing various basic services and processing tasks based on hardware. The application program 5022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., and is used to implement various application services. The program for realizing the method of the embodiment of the present invention may be included in the application program 5022 .

In the embodiment of the present invention, by calling the program or instruction stored in the memory 502, specifically, the program or instruction stored in the application program 5022, the processor 501 is used to obtain a preview of each frame captured by the camera during the image shooting process. image, face recognition is performed on the preview image, the subject is identified, the shooting scene features and the clothing features of the shooting subject are acquired, and based on the shooting scene features and the clothing features of the shooting subject, the Image processing is performed, and after the image capture is completed, an image-processed target image is generated.

The methods disclosed in the foregoing embodiments of the present invention may be applied to the processor 501 or implemented by the processor 501 . The processor 501 may be an integrated circuit chip and has signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 501 or instructions in the form of software. The above-mentioned processor 501 may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other programmable Logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps and logic block diagrams disclosed in the embodiments of the present invention may be implemented or executed. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like. The steps of the methods disclosed in the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register. The storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502, and completes the steps of the above method in combination with its hardware.

It can be understood that the embodiments described in the embodiments of the present invention may be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing device (DSP Device, DSPD), programmable logic Device (Programmable Logic Device, PLD), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), general-purpose processor, controller, microcontroller, microprocessor, other electronic units for performing the functions described in this application or a combination thereof.

For software implementation, the techniques described in the embodiments of the present invention may be implemented through modules (such as procedures, functions, etc.) that execute the functions described in the embodiments of the present invention. Software codes can be stored in memory and executed by a processor. Memory can be implemented within the processor or external to the processor.

Optionally, the processor 501 is further configured to: determine the religious attribute of the photographed subject based on the characteristics of the photographed scene and the clothing characteristics of the photographed subject; acquire the image area of the photographed subject; attribute, determining the image material corresponding to the subject image area; and performing image processing on the subject image area based on the image material.

Optionally, the processor 501 is further configured to: adjust the size, angle and/or shape of the image material based on the image area of the subject; superimpose and display the adjusted image material on the image area of the subject The preset area; wherein, the image material includes at least a headgear image and/or a face decoration image.

Optionally, the processor 501 is further configured to: acquire the facial feature information of the photographed subject after the step of generating the image-processed target image after the image capturing is completed; and store the facial feature information.

Optionally, the processor 501 is further configured to: after the step of storing the facial feature information, receive an instruction from the requester to view a target subject in the target image; Face image collection, to obtain the face image of the requester; extract the face feature information in the face image; combine the face feature information in the face image with the pre-stored person of the target subject The face feature information is compared; when the face feature information in the face image matches the face feature information of the target subject, the image material superimposed on the target subject is removed.

Optionally, the processor 501 is further configured to: after the step of storing the facial feature information, turn on the camera for face recognition, and identify the facial feature information; when the recognized facial feature information is consistent with the target When the facial feature information of a subject in the image matches, the image material superimposed and displayed on the matched subject is removed.

Optionally, the processor 501 is further configured to: generate an initial image without image processing and a target image after image processing at the same time after the image capture is completed; store the initial image and the target image in the first storage space or a second storage space, or share the initial image and the target image to the first instant messaging application program and the second instant messaging application program respectively.

Optionally, the processor 501 is further configured to: perform face recognition on the preview image, and determine each recognized face as the subject.

The mobile terminal 500 can implement various processes implemented by the mobile terminal in the foregoing embodiments, and to avoid repetition, details are not repeated here.

According to the embodiment of the present invention, during the image capturing process, the mobile terminal recognizes the subject from the preview image collected by the camera, performs image processing on the subject according to the characteristics of the shooting scene and the clothing characteristics of the subject, and after the image capturing is completed, Generate the target image after image processing. Since the target image after image processing matches the shooting scene features and clothing features, the target image meets the special requirements of religion or ethnic minorities for the clothing worn by the subject, and the method described in the embodiment of the present invention saves the subject from specifying The wearing of clothing simplifies the shooting operation of the subject.

Embodiment six

FIG. 6 is a block diagram of a mobile terminal according to another embodiment of the present invention. Specifically, the mobile terminal 600 in FIG. 6 may be a mobile phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), or a vehicle-mounted computer.

Mobile terminal 600 in Fig. 6 comprises radio frequency (Radio Frequency, RF) circuit 610, memory 620, input unit 630, display unit 640, camera 650, processor 660, audio frequency circuit 670, WiFi (Wireless Fidelity) module 680 and power supply 690 .

Wherein, the input unit 630 can be used to receive number or character information input by the user, and generate signal input related to the user setting and function control of the mobile terminal 600 . Specifically, in the embodiment of the present invention, the input unit 630 may include a touch panel 631 . The touch panel 631, also referred to as a touch screen, can collect user's touch operations on or near it (such as the user's operation on the touch panel 631 using any suitable object or accessory such as a finger, a stylus), and The specified program drives the corresponding connected device. Optionally, the touch panel 631 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 660, and can receive and execute commands sent by the processor 660. In addition, the touch panel 631 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 631, the input unit 630 may also include other input devices 632, which may include but not limited to physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc. one or more of.

Wherein, the display unit 640 can be used to display information input by the user or information provided to the user and various menu interfaces of the mobile terminal 600 . The display unit 640 may include a display panel 641. Optionally, the display panel 641 may be configured in the form of an LCD or an organic light-emitting diode (Organic Light-Emitting Diode, OLED).

It should be noted that the touch panel 631 can cover the display panel 641 to form a touch display screen. When the touch display screen detects a touch operation on or near it, it is sent to the processor 660 to determine the type of the touch event, and then the processor 660 provides corresponding visual output on the touch display screen according to the type of the touch event.

The touch display screen includes an application program interface display area and a common control display area. The arrangement of the display area of the application program interface and the display area of the commonly used controls is not limited, and may be an arrangement in which the two display areas can be distinguished, such as vertical arrangement, left-right arrangement, and the like. The application program interface display area can be used to display the interface of the application program. Each interface may include at least one interface element such as an icon of an application program and/or a widget desktop control. The application program interface display area can also be an empty interface without any content. The commonly used control display area is used to display controls with a high usage rate, for example, application icons such as setting buttons, interface numbers, scroll bars, and phonebook icons.

Wherein the processor 660 is the control center of the mobile terminal 600, utilizes various interfaces and lines to connect the various parts of the whole mobile phone, by running or executing the software programs and/or modules stored in the first memory 621, and calling the software programs and/or modules stored in the second memory 621. The data in the memory 622 executes various functions of the mobile terminal 600 and processes data, so as to monitor the mobile terminal 600 as a whole. Optionally, the processor 660 may include one or more processing units.

In the embodiment of the present invention, by calling the software programs and/or modules stored in the first memory 621 and/or the data in the second memory 622, the processor 660 is used to obtain the data collected by the camera during the image shooting process. For each frame of the preview image, face recognition is performed on the preview image, the subject is identified, the shooting scene features and the clothing features of the shooting subject are acquired, and based on the shooting scene features and the clothing features of the shooting subject, the Image processing is performed on the subject to be photographed, and an image-processed target image is generated after the image is captured.

Optionally, the processor 660 is further configured to: determine the religious attribute of the photographed subject based on the characteristics of the photographed scene and the clothing characteristics of the photographed subject; acquire the image area of the photographed subject; attribute, determining the image material corresponding to the subject image area; and performing image processing on the subject image area based on the image material.

Optionally, the processor 660 is further configured to: adjust the size, angle and/or shape of the image material based on the image area of the subject; superimpose and display the adjusted image material on the image area of the subject The preset area; wherein, the image material includes at least a headgear image and/or a face decoration image.

Optionally, the processor 660 is further configured to: acquire the facial feature information of the photographed subject after the step of generating the image-processed target image after the image capturing is completed; and store the facial feature information.

Optionally, the processor 660 is further configured to: after the step of storing the facial feature information, receive an instruction from the requester to view a target subject in the target image; Face image collection, to obtain the face image of the requester; extract the face feature information in the face image; combine the face feature information in the face image with the pre-stored person of the target subject The face feature information is compared; when the face feature information in the face image matches the face feature information of the target subject, the image material superimposed on the target subject is removed.

Optionally, the processor 660 is further configured to: after the step of storing the facial feature information, turn on the camera for face recognition, and identify the facial feature information; when the recognized facial feature information is consistent with the target When the facial feature information of a subject in the image matches, the image material superimposed and displayed on the matched subject is removed.

Optionally, the processor 660 is further configured to: generate an initial image without image processing and a target image after image processing at the same time after the image capture is completed; store the initial image and the target image in the first storage space or a second storage space, or share the initial image and the target image to the first instant messaging application program and the second instant messaging application program respectively.

Optionally, the processor 660 is further configured to: perform face recognition on the preview image, and determine each recognized face as the subject.

It can be seen that according to the embodiment of the present invention, the mobile terminal recognizes the subject from the preview image collected by the camera during the image capture process, and performs image processing on the subject according to the characteristics of the shooting scene and the clothing characteristics of the subject, and the subject is processed after the image capture is completed. After that, the target image after image processing is generated. Since the target image after image processing matches the shooting scene features and clothing features, the target image meets the special requirements of religion or ethnic minorities for the clothing worn by the subject, and the method described in the embodiment of the present invention saves the subject from specifying The wearing of clothing simplifies the shooting operation of the subject.

Those of ordinary skill in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed in the embodiments of the present invention can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

If the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media capable of storing program codes such as U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (16)

1. a kind of image pickup method, is applied to the mobile terminal with photographic head, it is characterised in that methods described includes：

In image shoot process, every frame preview image of photographic head collection is obtained；

Recognition of face is carried out to the preview image, shooting main body is identified；

Obtain the garment ornament of photographed scene feature and the shooting main body；

Based on the photographed scene feature and the garment ornament of the shooting main body, image procossing is carried out to the shooting main body；

After the completion of image taking, the target image after image procossing is generated.

2. method according to claim 1, it is characterised in that described based on the photographed scene feature and the shooting master The garment ornament of body, to it is described shooting main body carry out image procossing the step of, including：

Based on the photographed scene feature and the garment ornament of the shooting main body, the religion attribute for shooting main body is determined；

Obtain the shooting main image area；

Based on the religion attribute for shooting main body, the corresponding picture material in the shooting main image area is determined；

Based on described image material, image procossing is carried out to the shooting main image area.

3. method according to claim 2, it is characterised in that described based on described image material, to the shooting main body The step of image-region carries out image procossing, including：

Based on the shooting main image area, size, angle and/or the shape of described image material are adjusted；

By the described image material Overlapping display after adjustment the shooting main image area predeterminable area；

Wherein, described image material at least includes headwear image and/or facial ornament image.

4. method according to claim 3, it is characterised in that described after the completion of image taking, generates at image After the step of target image after reason, methods described also includes：

Obtain the face characteristic information for shooting main body；

Store the face characteristic information.

5. method according to claim 4, it is characterised in that after the step of the storage face characteristic information, Methods described also includes：

Receive requestor main body is shot to a target in the target image and check instruction；

Opening photographic head carries out man face image acquiring to the requestor, obtains the facial image of the requestor；

Extract the face characteristic information in the facial image；

Face characteristic information in the facial image and the target for prestoring are shot into the face characteristic information of main body Compare；

When the face characteristic information that the face characteristic information in the facial image shoots main body with the target matches, go Except the target shoots the picture material of institute's Overlapping display in main body.

6. method according to claim 4, it is characterised in that after the step of the storage face characteristic information, Methods described also includes：

Opening photographic head carries out recognition of face, identifies face characteristic information；

When the face characteristic information of a shooting main body in the face characteristic information for identifying with the target image matches When, remove the picture material of institute's Overlapping display in matched shooting main body.

7. method according to claim 1, it is characterised in that described after the completion of image taking, generates at image The step of target image after reason, including：

After the completion of image taking, while generating the target figure without the initial pictures of image procossing and after image procossing Picture；

The initial pictures and the target image are stored respectively to the first memory space or the second memory space, or will be described Initial pictures are shared to the first instant messaging application program and the second instant messaging application program respectively with the target image.

8. method according to claim 1, it is characterised in that described that recognition of face, identification are carried out to the preview image Go out the step of shooting main body, including：

Recognition of face is carried out to the preview image, each face that will identify that is identified as the shooting main body.

9. a kind of mobile terminal, including photographic head, it is characterised in that the mobile terminal also includes：

Preview image acquisition module, for, in image shoot process, obtaining every frame preview image of photographic head collection；

Main body identification module is shot, and for recognition of face being carried out to the preview image, identifies shooting main body；

Characteristic information acquisition module, for obtaining the garment ornament of photographed scene feature and the shooting main body；

Image processing module, for the garment ornament based on the photographed scene feature and the shooting main body, to the shooting Main body carries out image procossing；

Target image generation module, for, after the completion of image taking, generating the target image after image procossing.

10. mobile terminal according to claim 9, it is characterised in that described image processing module includes：

Religion attribute determination sub-module, for the garment ornament based on the photographed scene feature and the shooting main body, it is determined that The religion attribute for shooting main body；

Image-region acquisition submodule, for obtaining the shooting main image area；

Picture material determination sub-module, for based on the religion attribute for shooting main body, determining the shooting subject image area The corresponding picture material in domain；

Amending image submodule, for based on described image material, carrying out image procossing to the shooting main image area.

11. mobile terminals according to claim 10, it is characterised in that described image modification submodule includes：

Picture material adjustment unit, for based on the shooting main image area, adjusting size, the angle of described image material And/or shape；

Picture material superpositing unit, for by the described image material Overlapping display after adjustment in the shooting main image area Predeterminable area；

Wherein, described image material at least includes headwear image and/or facial ornament image.

12. mobile terminals according to claim 11, it is characterised in that the mobile terminal also includes：

Face characteristic information acquisition module, for, after the completion of image taking, generating the target image after image procossing After step, the face characteristic information for shooting main body is obtained；

Face characteristic information memory module, for storing the face characteristic information.

13. mobile terminals according to claim 12, it is characterised in that the mobile terminal also includes：

Command reception module is checked, for requestor after the face characteristic information is stored, being received to the target image In a target shoot main body and check instruction；

Facial image obtains module, carries out man face image acquiring to the requestor for opening photographic head, obtains the request The facial image of person；

Face characteristic information extraction module, for extracting the face characteristic information in the facial image；

Face characteristic information comparing module, for by the face characteristic information in the facial image and the mesh for prestoring Mark shoots the face characteristic information of main body and compares；

First picture material removes module, for shooting main body with the target when the face characteristic information in the facial image Face characteristic information when matching, remove the picture material that the target shoots institute's Overlapping display in main body.

14. mobile terminals according to claim 12, it is characterised in that the mobile terminal also includes：

Face characteristic information identification module, carries out face knowledge for after the face characteristic information is stored, opening photographic head Not, identify face characteristic information；

Second picture material removes module, for when a shooting in the face characteristic information for identifying with the target image When the face characteristic information of main body matches, the picture material of institute's Overlapping display in matched shooting main body is removed.

15. mobile terminals according to claim 9, it is characterised in that the target image generation module includes：

Image generates submodule, for after the completion of image taking, while generating the initial pictures and Jing without image procossing The target image crossed after image procossing；

Image sub-module stored, for the initial pictures and the target image are stored respectively to the first memory space or Two memory spaces, or the initial pictures and the target image are shared respectively to the first instant messaging application program and second Instant messaging application program.

16. mobile terminals according to claim 9, it is characterised in that the shooting main body identification module, specifically for right The preview image carries out recognition of face, and each face that will identify that is identified as the shooting main body.