CN110166691A - A shooting method and terminal equipment - Google Patents

Abstract

The embodiment of the invention discloses a shooting method and terminal equipment, wherein the method comprises the following steps: the method comprises the steps of receiving a first input of a user on a first image collected by a camera, marking a target area of the first image in response to the first input, carrying out feature detection on a preview image collected by the camera under the condition that the image is collected by the camera, carrying out shooting operation under the condition that a target object matched with the image feature of the target area is detected, and outputting a second image. By the method, the shooting operation times of the user can be reduced, the time cost is saved, the shooting accuracy is improved, and meanwhile the actual shooting requirements of the user can be met.

Description

A shooting method and terminal equipment

technical field

Embodiments of the present invention relate to the field of communication technologies, and in particular, to a photographing method and a terminal device.

Background technique

With the rapid development of computer technology, mobile phone-based terminal equipment has become a necessity for people's life and work. With the increase in the frequency of use of terminal equipment, people's demand for terminal equipment is becoming more and more diverse.

In daily life, the user can use the shooting function of the terminal device to take pictures of blind spots (such as the back of the head, the top of the head, the back of the neck, etc.), and then adjust the posture according to the captured images. For example, the user can use the terminal device to take pictures of the back of the head, and then check whether the hairstyle is messy according to the pictures taken.

However, when a user uses a terminal device to shoot in a blind spot, since the user cannot observe the image in the shooting preview interface, the image captured at one time often cannot meet the user's actual shooting needs. If the captured picture does not meet the user's needs, the user needs to adjust the shooting angle and shoot again. If the captured picture still does not match the user's demand, the user needs to adjust the shooting angle again until the picture that meets the demand is captured. In this process, the user needs to perform multiple repeated shooting actions on the blind area, and it is also difficult to capture images that meet the user's actual shooting needs (such as images of the user's visual blind area, etc.).

Contents of the invention

Embodiments of the present invention provide a shooting method and a terminal device to solve the problem that in the prior art, when shooting a visual blind spot, the user needs to perform multiple repeated shooting operations because the user cannot observe the image of the shooting preview interface. It is difficult to capture images that meet the actual shooting needs of users.

In order to solve the above-mentioned technical problems, the embodiment of the present invention is implemented as follows:

In a first aspect, an embodiment of the present invention provides a shooting method, the method comprising:

receiving a first input from the user on the first image captured by the camera;

marking a target region of the first image in response to the first input;

In the case of the image captured by the camera, feature detection is performed on the preview image captured by the camera;

If a target object matching the image features of the target area is detected, a shooting operation is performed to output a second image.

In a second aspect, an embodiment of the present invention provides a terminal device, including:

The input receiving module is used to receive the user's first input on the first image collected by the camera;

an area determination module, configured to mark a target area of the first image in response to the first input;

The matching detection module is used to perform feature detection on the preview image collected by the camera when the camera collects the image;

An image output module, configured to perform a shooting operation and output a second image when a target object matching the image features of the target area is detected.

Optionally, the area determination module includes:

an area determining unit, configured to determine an area within a preset range including the input area of the first input in the first image as a target area;

an area marking unit, configured to mark the target area.

Optionally, also include:

The first output module is configured to output first prompt information when a target object matching the image features of the target area is detected, and the first prompt information is used to indicate that an object matching the target area has been detected The target object for image feature matching.

Optionally, also include:

The first comparison unit is configured to compare the image features of the first object with the target area when it is detected that there is a first object in the preview image that matches a part of the image features in the target area The image features are compared to obtain the first comparison result;

a direction determining unit, configured to determine the moving direction of the camera based on the first comparison result;

The first output unit is configured to output second prompt information based on the moving direction, and the second prompt information is used to indicate the moving direction of the camera.

Optionally, the camera can be rotated;

Also includes:

a direction determination unit, configured to determine the rotation direction of the camera based on the first comparison result;

The image output module includes:

A first image acquisition unit, configured to control the camera to rotate according to the rotation direction, and capture at least two target images during the rotation process, the target images including at least part of the image features in the target area;

An image synthesis unit, configured to perform image synthesis on the at least two target images, and output a second image.

Optionally, also include:

The second output module is configured to output third prompt information when no image feature matching the image feature of the target area is detected in the preview image, and the third preset prompt information is used to indicate The target area is not included in the preview image.

Optionally, the image output module includes:

an enlargement processing unit, configured to perform enlargement processing on the area where the target object is located so that the target object does not exceed the preview image;

An image output unit, configured to perform a shooting operation and output the second image.

In a third aspect, an embodiment of the present invention provides a terminal device, including a processor, a memory, and a computer program stored in the memory and operable on the processor. When the computer program is executed by the processor, The steps of the photographing method provided in the foregoing embodiments are realized.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the photographing method provided in the foregoing embodiments are implemented.

It can be seen from the above technical solutions provided by the embodiments of the present invention that the embodiments of the present invention receive the first input from the user on the first image captured by the camera, respond to the first input, mark the target area of the first image, and mark the target area of the first image in the image captured by the camera. In this case, feature detection is performed on the preview image captured by the camera, and when a target object matching the image features of the target area is detected, a shooting operation is performed to output a second image. In this way, the user only needs to input on the first image, and then the terminal device can determine the target area according to the user's first input, and perform matching detection on the preview image according to the target area. There are image features in the preview image that match the target area When shooting under the condition of matching target objects, the user does not need to repeat the shooting many times, which can save the user's shooting time cost and improve the shooting efficiency. At the same time, since the matching detection is performed according to the user's first input, the captured second image can also meet the actual shooting needs of the user.

Description of drawings

FIG. 1 is one of the flowcharts of the shooting method provided by the embodiment of the present invention;

Fig. 2 is one of the schematic diagrams of the method for determining the target area provided by the embodiment of the present invention;

Fig. 3 is the second schematic diagram of the method for determining the target area provided by the embodiment of the present invention;

Fig. 4 is the third schematic diagram of the method for determining the target area provided by the embodiment of the present invention;

FIG. 5 is the second flowchart of the shooting method provided by the embodiment of the present invention;

FIG. 6 is a fourth schematic diagram of a method for determining a target area provided by an embodiment of the present invention;

Fig. 7 is the fifth schematic diagram of the method for determining the target area provided by the embodiment of the present invention;

Fig. 8 is the third flowchart of the photographing method provided by the embodiment of the present invention;

FIG. 9 is a schematic diagram of a method for determining a moving direction provided by an embodiment of the present invention;

FIG. 10 is the fourth flowchart of the photographing method provided by the embodiment of the present invention;

FIG. 11 is a schematic diagram of a method for acquiring a second sub-image provided by an embodiment of the present invention;

FIG. 12 is one of the schematic structural diagrams of a terminal device provided by an embodiment of the present invention;

FIG. 13 is a second schematic structural diagram of a terminal device provided by an embodiment of the present invention.

Detailed ways

In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

As shown in Figure 1, the embodiment of the present invention provides a shooting method. The execution body of the method can be a terminal device, and the terminal device can be a mobile terminal such as a mobile phone or a tablet computer, or can be any camera device (such as a camera) ) electronic equipment (such as a computer equipped with a camera, etc.). The method specifically may include the following steps:

In step 101, a first input from a user on a first image captured by a camera is received.

Wherein, the first image may be any image collected by the camera, or any frame of image in the video collected by the camera, the first image may include an image of the user's blind spot, and the first input may be the user's first input. A region selection operation performed on an image.

In practice, with the rapid development of computer technology, terminal equipment mainly based on mobile phones has become a necessity for people's life and work. change.

In daily life, the user can use the shooting function of the terminal device to take pictures of blind spots (such as the back of the head, the top of the head, the back of the neck, etc.), and then adjust the posture according to the captured images. For example, the user can use the terminal device to take pictures of the back of the head, and then check whether the hairstyle is messy according to the pictures taken.

However, when a user uses a terminal device to shoot in a blind spot, since the user cannot observe the image in the shooting preview interface, the image captured at one time often cannot meet the user's actual shooting needs. If the captured picture does not meet the user's needs, the user needs to adjust the shooting angle and shoot again. If the captured picture still does not match the user's demand, the user needs to adjust the shooting angle again until the picture that meets the demand is captured. In this process, the user needs to take multiple shots of the blind area to obtain an image that meets the needs. The time cost of shooting is high, resulting in a waste of shooting resources. At the same time, even after multiple shots, the obtained image is difficult to satisfy the user. actual shooting needs. To this end, the embodiments of the present invention provide a technical solution capable of solving the above problems, which may specifically include the following:

The user can open the camera application installed in the terminal device and enter the shooting preview interface. At this time, the user can select the shooting mode. For example, the shooting mode can be image shooting mode or video shooting mode. After entering the shooting preview interface, the user can choose image shooting mode, at this time, the user can move the terminal device to a position in the blind spot (such as the back of the user's head) to take pictures, and the captured image can be used as the first image. Or, when the user selects the image shooting mode, he can also choose the continuous shooting mode. After shooting the blind area, the user can choose among the multiple images obtained, and select the image that is more consistent with the shooting requirements as the first image. an image.

In addition, the user can also select a video shooting mode, and after shooting a video of the blind spot, a frame of an image that is more in line with the shooting requirement can be selected as the first image in the captured video.

After the first image is determined, the user may perform a marking operation on the first image, and the terminal device may receive a first input corresponding to the user's marking operation. For example, the user can draw a closed area on the first image, and the user's input during the process of drawing the closed area is the user's first input on the first image. As shown in Figure 2, the user draws on the first image If a closed circle is drawn, the closed circle is the result of the first input by the user on the first image.

Alternatively, the user's first input may also be an input corresponding to a click operation performed on the first image. For example, the terminal device may acquire depth information of a pixel point corresponding to the user's point-and-click operation, and then determine the first input corresponding to the user's point-and-click operation according to the depth information. For example, the user can perform a click operation on object A on the first image, and after the terminal device obtains the depth information of the pixel corresponding to the user's click operation, it can use the same (or similar) depth information as the pixel The image information corresponding to the region where the pixels are located is determined as a result of the first input, that is, the image information of the object A may be determined as a result of the user's first input on the first image.

Alternatively, the user may perform multiple marking operations on the first image, and the terminal device may respectively determine corresponding first inputs according to the user's marking operations. For example, the user can perform multiple click operations on the first image, and the terminal device can detect the user's click operations, and if the depth information of the pixels corresponding to the user's click operations is the same, the user's click operations can be The depth information of the corresponding pixel is confirmed as a result of the first input. Alternatively, the terminal device may perform range detection on the user's point-and-click operation, that is, detect whether the user's point-and-click operation can form a closed area. In addition, the user may draw multiple closed areas on the first image, and the image information corresponding to the multiple closed areas is the result of the user's first input on the first image.

The above method of determining the user's first input on the first image is an optional and achievable method. In addition, there may be multiple determination methods, which may vary according to different actual application scenarios , which is not specifically limited in this embodiment of the present invention.

In step 102, a target region of the first image is marked in response to the first input.

In an implementation, after the user's first input on the first image is acquired, the target area that the user pays attention to can be determined based on a preset selection rule. For example, as shown in FIG. 3 , the user may perform a click operation on the object A, and the click operation is the user's first input on the first image, and the target area may be determined according to the first input. For example, the target area may be the area where the object A is located. Alternatively, the target area corresponding to the first input can be determined according to the depth information of the object A. For example, the depth information of the object A is 13, and the preset selection rule can be: in the peripheral area of the input area of the first input, Search for an area that is similar to the image depth information of the first input area, and use the found area and the first input area as the target area. For example, in FIG. 3 , the target area corresponding to the first input on the user's object A may include the area where the object A is located, and the image depth information of the area where the object A is located (such as the image depth of the area where the object A is located). The information may be 13) the area where the difference is within the range of ±3 (that is, the area where the depth information is 10-16), and the finally determined target area may be the target area 1 in FIG. 3 .

The method for determining the target area described above is an optional and achievable method. In addition, there may be multiple methods for determining the target area, which may vary according to different actual application scenarios. This is not specifically limited.

In addition, if the user performs multiple first inputs on the first image, corresponding target areas may be respectively determined according to the multiple first inputs. Alternatively, distance detection may also be performed on the input areas corresponding to the above-mentioned multiple first inputs, and if the measured distance between the input areas corresponding to the multiple first inputs is less than a preset distance threshold, the above-mentioned multiple first inputs may be Input the corresponding input areas to merge to obtain the target area. For example, as shown in FIG. 4 , there are two first inputs on the first image, and the areas corresponding to the two first inputs are area 1 and area 2 respectively, and the distance between area 1 and area 2 can be obtained ( That is, s1), if the distance between the above two areas (ie, s1) is less than the preset distance threshold, you can merge area 1 and area 2, and obtain the average depth information of the pixels in area 1 and area 2, and then Based on this average depth information, a target area is determined. For example, assuming that the average depth information of area 1 and area 2 is 13, it is possible to detect areas with depth information ranging from 10 to 16 in the peripheral areas of area 1 and area 2, and store the detected depth information in areas ranging from 10 to 16 Merge with area 1 and area 2, and the combined area is the target area, for example, the target area may be target area 2 in FIG. 4 .

Determining the target area based on the user's first input on the first image can more accurately acquire an image that meets the user's actual shooting requirements, improving the accuracy of image shooting.

In step 103, in the case of the image captured by the camera, feature detection is performed on the preview image captured by the camera.

In implementation, the image features corresponding to the target area can be obtained based on the image recognition algorithm, and when the user's shooting start instruction is received, each frame captured by the camera can be previewed based on the extracted image features and the preset scanning frequency images for matching detection.

During the matching detection process, corresponding prompt information may be sent according to the matching degree of the image features. For example, in the process of matching detection, the matching degree of the preview image in the shooting preview interface detected at the nth second and the image feature of the target area is 50%, while the preview image in the shooting preview interface detected at the n+1 second The matching degree between the image and the image features of the target area is 40%. If the matching degree becomes smaller, it indicates that the moving direction of the terminal device deviates from the target area. At this time, the corresponding prompt message 1 can be sent to remind the user of the moving direction of the terminal device Deviated from the target area. In addition, if it is detected that the matching degree between the preview image in the shooting preview interface and the image features of the target area is greater than the preset matching degree threshold, corresponding prompt information 2 may be sent to remind the user that the terminal device has detected the target area.

In step 104, if a target object matching the image features of the target area is detected, a shooting operation is performed to output a second image.

In implementation, when performing image feature matching detection, if it is detected that there is a target object that matches the image feature of the target area in the preview image collected by the camera, the shooting operation can be performed and the second image is output, wherein the first The second image includes the target object, and the image features of the target object and the image features of the target area may be completely the same, or the matching degree of the image features of the target object and the image features of the target area may also be greater than a preset matching threshold.

In addition, before the matching detection is performed, a user's selection operation on a preset matching threshold may be received. For example, the terminal device may provide the user with an input box for a preset matching threshold, and may receive a user-defined preset matching threshold (for example, the received user-defined preset matching threshold may be 80%). The terminal device can perform matching detection on whether there is a target object that matches the image features of the target area in the preview image collected by the camera based on the image features of the target area according to the user-defined preset matching threshold. During the detection process, if it is detected in the preview image that the matching degree between the image features of the first target object and the image features of the target area is greater than or equal to 80%, the shooting operation can be performed, and the corresponding first sub- target image. Then the detection can be continued, and if it is detected again that there is a matching degree of the image feature of the second target object in the preview image and the image feature of the target area is greater than or equal to 80%, the shooting operation can be performed again, and the corresponding second target object can be obtained. subtarget image. In this way, after the user starts shooting, the terminal device can capture multiple sub-target images (such as the first sub-target image and the second sub-target image) that meet the preset matching threshold during the detection process. After the shooting is finished, the terminal device can display the sub-target image to the user in the form of a thumbnail, and the user can select the sub-target image that best matches the shooting requirement as the second image. As mentioned above, the second image should include the target object.

Alternatively, the terminal device may also perform synthesis processing on the acquired multiple sub-target images, and display the image obtained after the synthesis processing as a second image (including the target object) to the user.

An embodiment of the present invention provides a shooting method, by receiving the user's first input on the first image captured by the camera, responding to the first input, marking the target area of the first image, and in the case of the image captured by the camera, the camera collects Feature detection is performed on the preview image, and when a target object matching the image feature of the target area is detected, a shooting operation is performed to output a second image. In this way, the user only needs to input on the first image, and then the terminal device can determine the target area according to the user's first input, and perform matching detection on the preview image according to the target area. There are image features in the preview image that match the target area When shooting under the condition of matching target objects, the user does not need to repeat the shooting many times, which can save the user's shooting time cost and improve the shooting efficiency. At the same time, since the matching detection is performed according to the user's first input, the captured second image can also meet the actual shooting needs of the user.

The specific processing procedures of the above steps 101 to 104 will be described in detail below, for details, please refer to the following related content:

The specific processing methods of the above step 102 can be varied. In actual application scenarios, there may be a small input area corresponding to the user's first input, and the corresponding image features are few, so that the preview image collected by the camera cannot be characterized. In case of detection, as shown in FIG. 5 , this embodiment provides an optional processing method below, which determines the target area based on the user’s first input on the first image and the preset range, which may specifically include the following steps 201- Step 202.

In step 201, an area in the first image including a preset range of the input area of the first input is determined as a target area.

In implementation, after the user's first input on the first image is obtained, the input area including the first input, and the area determined based on the user's first input area and the preset range may be Determine the target area. For example, as shown in Figure 6, the user can mark the area of concern on the first image. For example, the user can use a circle to mark the area of interest on the first image. The input area corresponding to the input may be a circular enclosed area with radius r as shown in FIG. 6 . The target area can be determined based on the preset range and the input area through a predetermined image recognition mechanism, for example, the input area of the circular mark and the area whose radius is extended by a preset multiple of the input area are extracted as the target area, and the target area can be extracted The image features of the area, and save the extracted image features for subsequent precise positioning, etc., wherein the target area can be specifically shown in Figure 6, wherein the target area is a circular closed area with a radius of R, where R It may be a preset multiple of the above r, for example, R may be 1.5 times r, or R may be 3 times r, and the relationship between R and r may be determined according to a preset range.

In addition, if the input area corresponding to the user's first input is an irregular area (such as an area contained by an irregular polygon), the input area corresponding to the first input can also be extended by a preset distance, and the expanded area and The input area corresponding to the first input is used as the target area. As shown in FIG. 7, the input area corresponding to the user's first input may be area 1, and based on the preset distance s2, it may be determined that the target area corresponding to area 1 is area 2 including area 1, wherein the preset It is assumed that the distance s2 can be any distance, for example, s2 can be 1 cm, or 1.5 cm, etc.

After determining the target area, the terminal device may receive a user's range adjustment operation on the target area, where the range adjustment operation may include a zoom-in operation, a zoom-out operation, and the like. For example, the user may narrow down the scope included in the target area as a whole, or partially enlarge the scope included in the target area.

In addition, the terminal device can also provide the user with cancellation or re-operation.

Determining the target area based on the preset range and the first input can improve the accuracy of matching detection. At the same time, because the scope of the target area is expanded, the efficiency of matching detection can be improved and the time and cost of image shooting can be saved.

In step 202, the target area is marked.

In an actual application scenario, it may happen that when the terminal device detects a target object that matches the image features of the target area, the user moves the terminal device, resulting in poor image quality of the target object included in the captured second image, or For the situation that the second image that meets the user's shooting requirements cannot be captured in time, after step 103 is performed, as shown in FIG. 5 , the following step 401 may also be performed.

In step 401, if a target object matching the image features of the target area is detected, first prompt information is output.

Wherein, the first prompt information may be preset, and is used to indicate that a target object matching the image feature of the target area has been detected.

In implementation, if it is detected that there is a target object matching the image features of the target area in the collected preview image, first prompt information may be output. Wherein, the first prompt information can be voice information (such as voice information can be "have reached the target area, please start shooting"), and can also be vibration information of a predetermined frequency (such as vibration information can be vibration special effect a, wherein the vibration special effect a may be a special effect that vibrates at the first preset vibration frequency, such as a special vibration effect that vibrates 3 times within 3 seconds).

Before performing the shooting operation, outputting the first prompt information can remind the user that the terminal device has collected a target object that matches the image features included in the target area. After receiving the first prompt information, the user can fix the terminal device for subsequent Shooting, in order to get a better shooting effect.

After performing the above step 103, if no preview image matching the target area is detected, as shown in FIG. 5, the following step 501 may be performed.

In step 501, if no image feature matching the image feature of the target area is detected in the preview image, third prompt information is output.

Wherein, the third prompt information may be used to indicate that the preview image does not contain the target area.

In practice, the third prompt information can be prompt information different from the first prompt information. For example, if the first prompt information is vibration special effect a (that is, a vibration special effect that vibrates continuously 3 times within 3 seconds), then the third prompt information It may be a special vibration effect b (that is, a special vibration effect that vibrates once every two seconds).

Through the third preset prompt information, the user can be prompted that the moving direction of the terminal device is wrong, which can save the user's shooting time and improve the image shooting efficiency.

In actual application scenarios, since the user cannot observe the preview image, the user may not be able to find the target object that matches the image features of the target area, or, in order to find the target object, the user needs to move the terminal device multiple times. To solve the above problems , after step 103 is executed, as shown in FIG. 8 , steps 601 to 603 may also be executed.

In step 601, when it is detected that there is a first object in the preview image that matches part of the image features in the target area, the image features of the first object are compared with the image features of the target area to obtain the first ratio to the result.

In implementation, based on the image features of the target area, the collected preview image is detected, and if there is a first object that matches some of the image features of the target area in the preview image, the image of the first object can be The feature is compared with the image feature of the target area to obtain a first comparison result.

For example, as shown in Figure 9, the target area can be a circular area with R as the radius, and the image features of the first object captured by the current camera partially match the image features of the target area. At this time, the image of the first object can be The features are compared with the image features of the target area.

In step 602, the moving direction of the camera is determined based on the first comparison result.

In implementation, the target area can be superimposed on the first object based on the image features, the part of the target area that overlaps with the first object can be removed, and the moving direction of the camera can be determined according to the remaining area. As shown in Figure 9, the first object can be superimposed on the target area. After the first object is removed from the target area, the remaining area is area 3. At this time, it can be determined that the moving direction of the camera is the direction of area 3. That is, the moving direction of the camera is the right direction of the terminal device.

The moving direction of the camera is determined based on the comparison result of the image features of the first object and the target area, which can improve the shooting efficiency and prevent the user from moving the terminal device multiple times in order to find the target shooting area.

In step 603, output second prompt information based on the moving direction, where the second prompt information is used to indicate the moving direction of the camera.

In implementation, the corresponding second prompt information to be output may be determined according to the moving direction, wherein the second prompt information may be voice information or vibration information, and is different from the first prompt information and the third prompt information. For example, the second prompt information may be voice information. Assuming that the moving direction of the terminal device is to the right, the voice message may be "please move the terminal device to the right". Alternatively, the second prompt information may also be vibration information, and different vibration information may be set for different moving directions. For example, if the moving direction is on the right side, the special vibration effect b can be output, and if the moving direction is on the left side, the special vibration effect c can be output, etc., wherein the special vibration effect b can vibrate at the second vibration frequency, such as 3 seconds The vibration special effect of vibrating once within the clock, the special vibration effect of vibrating at the third vibration frequency, such as the special vibration effect of continuous vibration twice within 3 seconds. Alternatively, in order to avoid ambiguity in understanding caused by differences in relative positions, vibration information corresponding to positions may be output based on different moving directions. For example, as shown in FIG. 9, the moving direction is the right side of the terminal device. At this time, the vibration device configured on the right side of the terminal device can be triggered to output vibration information to prompt the user to move the terminal device (ie, move the camera) in this direction.

The method for determining the content and method of the above-mentioned second prompt information is an optional and achievable method. In addition, there may be multiple determination methods. This embodiment of the present invention does not specifically limit this, and it can It varies from scene to scene.

Outputting the corresponding second prompt information based on the moving direction to remind the user of the specific moving direction of the camera can save time and cost for shooting.

In addition, the above step 104 can also be processed in a variety of ways, and in practical applications, it may often be encountered that the terminal device can only move within a limited range. In this case, the terminal device in this embodiment also A freely rotatable camera can be configured, as shown in Figure 8, through a freely rotatable camera, a spatial orientation or spatial region can be found so that the target area is displayed in the shooting preview interface, so that the terminal device can move within a limited range The shooting of various required images is completed. Based on this, after step 601 is performed, the following steps 701 to 703 can be continued.

In step 701, the rotation direction of the camera is determined based on the first comparison result.

In step 702, the camera is controlled to rotate according to the rotation direction, and at least two target images are captured during the rotation process, the target images include at least part of image features in the target area.

In implementation, before the camera rotates, the preview image at this time can be stored as the target image, and then the camera is controlled to rotate according to the rotation direction to capture the target image. For example, as shown in Figure 9, before turning the camera, the preview image at this time can be stored, and then the camera is controlled to turn to the right side of the terminal device, and during the turning process, the target image is captured until the preview image collected by the camera In , there is no image feature that matches the image feature of the target region.

In step 703, image synthesis is performed on at least two target images, and a second image is output.

By synthesizing at least two target images to obtain the second image, the problem of poor shooting effect due to the camera shooting during rotation can be avoided.

When the mobile range of the terminal device is limited, the target area can be searched and positioned by moving or rotating the camera to obtain a second image that meets the user's shooting needs, so that when the range of the user's mobile phone is limited, It can also locate the target area conveniently and quickly, and obtain the image content required by the user.

The specific processing methods of the above step 104 can be varied. In practical applications, it may be encountered that the target object selected by the user is too small to capture a relatively clear second image containing the target object. In this case, As shown in FIG. 10 , the terminal device in this embodiment may also zoom in on the area where the target object is located to obtain a clearer second image containing the target object, which may specifically include the following steps 801 to 802 .

In step 801, when a target object matching the image features of the target area is detected, the area where the target object is located is enlarged so that the target object does not exceed the preview screen.

In step 802, a shooting operation is performed to output a second image.

In the case that the target object is small or the user has high requirements for image clarity, the distance for the user to move the terminal device may not be the most suitable, or the user cannot or is not easy to move the terminal device to the best shooting position. At the same time, by zooming in on the area where the target object is located, a second image that meets the actual shooting needs of the user and has high definition can be obtained.

In addition, when the zoomed-in target object exceeds the preview screen, the image features of the zoomed-in first target image are compared with the image features of the target area to obtain a second comparison result.

In implementation, as shown in Figure 11, the image features of the first target image can be compared with the image features of the target area, and the obtained second comparison result can be: the area that does not contain the target area in the first target image Image features of a and region b.

Based on the above second comparison result, the terminal device may also perform the following processing, see the following steps 1 to 3.

Step 1, based on the second comparison result, determine the moving direction of the camera.

In an implementation, as shown in FIG. 11 , it can be determined that the moving direction of the camera is the right side of the terminal device where area a is located, and the lower side of the terminal device where area b is located.

Step 2, controlling the camera according to the moving direction, and taking a second sub-image during the moving process.

In implementation, as shown in FIG. 11 , the camera can be moved to the location of area a, and the second sub-image 1 corresponding to area a can be obtained, and then the camera can be moved to the location of area b, and the second sub-image 1 corresponding to area b can be obtained. Second sub-image 2.

Step 3, combining the second sub-image with the first target image to obtain and output the second image.

The second sub-image is obtained by moving the camera, and the second sub-image is synthesized with the first target image to obtain the second image, which can meet the user's shooting needs while ensuring the clarity of the target image.

An embodiment of the present invention provides a shooting method, by receiving the user's first input on the first image captured by the camera, responding to the first input, marking the target area of the first image, and in the case of the image captured by the camera, the camera collects Feature detection is performed on the preview image, and when a target object matching the image feature of the target area is detected, a shooting operation is performed to output a second image. In this way, the user only needs to input on the first image, and then the terminal device can determine the target area according to the user's first input, and perform matching detection on the preview image according to the target area. There are image features in the preview image that match the target area When shooting under the condition of matching target objects, the user does not need to repeat the shooting many times, which can save the user's shooting time cost and improve the shooting efficiency. At the same time, since the matching detection is performed according to the user's first input, the captured second image can also meet the actual shooting needs of the user.

The above is the photographing method provided by the embodiment of the present invention. Based on the same idea, the embodiment of the present invention also provides a terminal device, as shown in FIG. 12 .

The terminal device includes: an input receiving module 1201, an area determination module 1202, a matching detection module 1203 and an image output module 1204, wherein:

The input receiving module 1201 is configured to receive the user's first input on the first image collected by the camera;

an area determining module 1202, configured to mark a target area of the first image in response to the first input;

The matching detection module 1203 is used to perform feature detection on the preview image collected by the camera when the camera collects the image;

The image output module 1204 is configured to perform a shooting operation and output a second image when a target object matching the image features of the target area is detected.

In the embodiment of the present invention, the area determining module 1202 includes:

an area determining unit, configured to determine an area within a preset range including the input area of the first input in the first image as a target area;

an area marking unit, configured to mark the target area.

In an embodiment of the present invention, it also includes:

The first output module is configured to output first prompt information when a target object matching the image features of the target area is detected, and the first prompt information is used to indicate that an object matching the target area has been detected The target object for image feature matching.

In an embodiment of the present invention, it also includes:

The first comparison unit is configured to compare the image features of the first object with the target area when it is detected that there is a first object in the preview image that matches a part of the image features in the target area The image features are compared to obtain the first comparison result;

a direction determining unit, configured to determine the moving direction of the camera based on the first comparison result;

The first output unit is configured to output second prompt information based on the moving direction, and the second prompt information is used to indicate the moving direction of the camera.

In the embodiment of the present invention, the camera can be rotated;

Also includes:

a direction determination unit, configured to determine the rotation direction of the camera based on the first comparison result;

The image output module includes:

A first image acquisition unit, configured to control the camera to rotate according to the rotation direction, and capture at least two target images during the rotation process, the target images including at least part of the image features in the target area;

An image synthesis unit, configured to perform image synthesis on the at least two target images, and output a second image.

In an embodiment of the present invention, it also includes:

The second output module is configured to output third prompt information when no image feature matching the image feature of the target area is detected in the preview image, and the third preset prompt information is used to indicate The target area is not included in the preview image.

In an embodiment of the present invention, the image output module includes:

an enlargement processing unit, configured to perform enlargement processing on the area where the target object is located so that the target object does not exceed the preview image;

An image output unit, configured to perform a shooting operation and output the second image.

The terminal device in the embodiment of the present invention can also execute the method performed by the terminal device in FIG. 1-FIG. 11, and realize the functions of the terminal device in the embodiment shown in FIG. 1-FIG. 11, which will not be repeated here.

An embodiment of the present invention provides a terminal device, which receives the user's first input on the first image captured by the camera, responds to the first input, and marks the target area of the first image. Feature detection is performed on the preview image, and when a target object matching the image feature of the target area is detected, a shooting operation is performed to output a second image. In this way, the user only needs to input on the first image, and then the terminal device can determine the target area according to the user's first input, and perform matching detection on the preview image according to the target area. There are image features in the preview image that match the target area When shooting under the condition of matching target objects, the user does not need to repeat the shooting many times, which can save the user's shooting time cost and improve the shooting efficiency. At the same time, since the matching detection is performed according to the user's first input, the captured second image can also meet the actual shooting needs of the user.

FIG. 13 is a schematic diagram of a hardware structure of a terminal device implementing various embodiments of the present invention,

The terminal device 1300 includes, but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, a processor 1310, and Power supply 1311 and other components. Those skilled in the art can understand that the terminal device structure shown in Figure 13 does not constitute a limitation on the terminal device, and the terminal device may include more or less components than shown in the figure, or combine some components, or different components layout. In the embodiment of the present invention, the terminal devices include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, vehicle-mounted terminals, wearable devices, and pedometers.

Wherein, the processor 1310 is configured to receive a first input from the user on the first image collected by the camera;

The processor 1310 is further configured to mark a target area of the first image in response to the first input;

The processor 1310 is also configured to perform feature detection on the preview image collected by the camera when the camera collects the image;

The processor 1310 is further configured to perform a shooting operation and output a second image when a target object matching the image feature of the target area is detected.

In addition, the processor 1310 is further configured to determine, in the first image, an area within a preset range including the input area of the first input as the target area;

In addition, the processor 1310 is further configured to mark the target area.

In addition, the processor 1310 is further configured to output first prompt information when a target object matching the image feature of the target area is detected, and the first prompt information is used to indicate that a target object matching the target area has been detected. Regions whose image features match the target object.

In addition, the processor 1310 is further configured to combine the image features of the first object with the The image features of the regions are compared to obtain the first comparison result;

In addition, the processor 1310 is further configured to determine the moving direction of the camera based on the first comparison result;

In addition, the processor 1310 is further configured to output second prompt information based on the moving direction, where the second prompt information is used to indicate the moving direction of the camera.

In addition, the processor 1310 is further configured to control the camera to rotate according to the rotation direction, and capture at least two target images during the rotation, the target images including at least part of the image features in the target area;

In addition, the processor 1310 is further configured to perform image synthesis on the at least two target images, and output a second image.

In addition, the processor 1310 is further configured to output third prompt information when no image feature matching the image feature of the target area is detected in the preview image, and the third preset prompt information uses Indicating that the target area is not included in the preview image.

In addition, the processor 1310 is further configured to zoom in on the area where the target object is located so that the target object does not exceed the preview screen;

In addition, the processor 1310 is further configured to perform a shooting operation and output the second image.

An embodiment of the present invention provides a terminal device, which receives the user's first input on the first image captured by the camera, responds to the first input, and marks the target area of the first image. Feature detection is performed on the preview image, and when a target object matching the image feature of the target area is detected, a shooting operation is performed to output a second image. In this way, the user only needs to input on the first image, and then the terminal device can determine the target area according to the user's first input, and perform matching detection on the preview image according to the target area. There are image features in the preview image that match the target area When shooting under the condition of matching target objects, the user does not need to repeat the shooting many times, which can save the user's shooting time cost and improve the shooting efficiency. At the same time, since the matching detection is performed according to the user's first input, the captured second image can also meet the actual shooting needs of the user.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 1301 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 1310; Uplink data is sent to the base station. Generally, the radio frequency unit 1301 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 1301 can also communicate with the network and other devices through a wireless communication system.

The terminal device provides users with wireless broadband Internet access through the network module 1302, such as helping users send and receive emails, browse web pages, and access streaming media.

The audio output unit 1303 may convert audio data received by the radio frequency unit 1301 or the network module 1302 or stored in the memory 1309 into an audio signal and output as sound. Also, the audio output unit 1303 may also provide audio output related to a specific function performed by the terminal device 1300 (for example, call signal reception sound, message reception sound, etc.). The audio output unit 1303 includes a speaker, a buzzer, a receiver, and the like.

The input unit 1304 is used to receive audio or video signals. The input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and a microphone 13042, and the graphics processor 13041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The data is processed. The processed image frames may be displayed on the display unit 1306 . The image frames processed by the graphics processor 13041 may be stored in the memory 1309 (or other storage medium) or sent via the radio frequency unit 1301 or the network module 1302 . The microphone 13042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into an output format transmittable to a mobile communication base station via the radio frequency unit 1301 in case of a phone call mode.

The terminal device 1300 also includes at least one sensor 1305, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 13061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 13061 and the / or backlighting. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the posture of terminal equipment (such as horizontal and vertical screen switching, related games) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 1305 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.

The display unit 1306 is used to display information input by the user or information provided to the user. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.

The user input unit 1307 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the terminal device. Specifically, the user input unit 1307 includes a touch panel 13071 and other input devices 13072 . The touch panel 13071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 13071 or near the touch panel 13071 operate). The touch panel 13071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 1310, receive the command sent by the processor 1310 and execute it. In addition, the touch panel 13071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 13071 , the user input unit 1307 may also include other input devices 13072 . Specifically, other input devices 13072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

Further, the touch panel 13071 can be covered on the display panel 13061, and when the touch panel 13071 detects a touch operation on or near it, it will be sent to the processor 1310 to determine the type of the touch event, and then the processor 1310 will The type of event provides a corresponding visual output on the display panel 13061. Although in FIG. 7, the touch panel 13071 and the display panel 13061 are used as two independent components to realize the input and output functions of the terminal device, in some embodiments, the touch panel 13071 and the display panel 13061 can be integrated The implementation of the input and output functions of the terminal device is not specifically limited here.

The interface unit 1308 is an interface for connecting an external device to the terminal device 1300 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 1308 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 1309 can be used to store software programs as well as various data. Memory 1309 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 1309 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 1310 is the control center of the terminal equipment, which uses various interfaces and lines to connect various parts of the entire terminal equipment, runs or executes software programs and/or modules stored in the memory 1309, and calls data stored in the memory 1309 , execute various functions of the terminal equipment and process data, so as to monitor the terminal equipment as a whole. The processor 1310 may include one or more processing units; preferably, the processor 1310 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 1310 .

The terminal device 1300 can also include a power supply 1311 (such as a battery) for supplying power to various components. Preferably, the power supply 1311 can be logically connected to the processor 1310 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.

Preferably, the embodiment of the present invention also provides a terminal device, including a processor 1310, a memory 1309, and a computer program stored in the memory 1309 and operable on the processor 1310. When the computer program is executed by the processor 1310 Each process of the above embodiment of the photographing method can be realized and the same technical effect can be achieved. In order to avoid repetition, details are not repeated here.

The embodiment of the present invention also provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above-mentioned shooting method embodiment is realized, and the same technical effect can be achieved. , to avoid repetition, it will not be repeated here. Wherein, the computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk or an optical disk, and the like.

An embodiment of the present invention provides a computer-readable storage medium, by receiving a user's first input on the first image captured by the camera, responding to the first input, and marking the target area of the first image, when the camera captures the image, Feature detection is performed on the preview image collected by the camera, and when a target object matching the image features of the target area is detected, a shooting operation is performed to output a second image. In this way, the user only needs to input on the first image, and then the terminal device can determine the target area according to the user's first input, and perform matching detection on the preview image according to the target area. There are image features in the preview image that match the target area When shooting under the condition of matching target objects, the user does not need to repeat the shooting many times, which can save the user's shooting time cost and improve the shooting efficiency. At the same time, since the matching detection is performed according to the user's first input, the captured second image can also meet the actual shooting needs of the user.

Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems, or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and/or nonvolatile memory such as read only memory (ROM) or flash RAM. Memory is an example of computer readable media.

Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridge, tape magnetic disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media excludes transitory computer-readable media, such as modulated data signals and carrier waves.

It should also be noted that the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes Other elements not expressly listed, or elements inherent in the process, method, commodity, or apparatus are also included. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The above descriptions are only examples of the present invention, and are not intended to limit the present invention. Various modifications and variations of the present invention will occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the scope of the claims of the present invention.

Claims (10)

1. A shooting method, characterized in that the method comprises: receiving a first input from the user on the first image captured by the camera; marking a target region of the first image in response to the first input; In the case of the image captured by the camera, feature detection is performed on the preview image captured by the camera; If a target object matching the image features of the target area is detected, a shooting operation is performed to output a second image. 2. The method according to claim 1, wherein the marking the target area of the first image in response to the first input comprises: determining an area in the first image within a preset range including the input area of the first input as a target area; Mark the target area. 3. The method according to claim 1, wherein, after performing feature detection on the preview image collected by the camera, further comprising: When a target object matching the image feature of the target area is detected, first prompt information is output, where the first prompt information is used to indicate that a target object matching the image feature of the target area has been detected. 4. The method according to claim 1, wherein, after performing feature detection on the preview image collected by the camera, further comprising: When it is detected that there is a first object in the preview image that matches part of the image features in the target area, comparing the image features of the first object with the image features of the target area to obtain The first comparison result; determining the moving direction of the camera based on the first comparison result; Based on the moving direction, output second prompt information, where the second prompt information is used to indicate the moving direction of the camera. 5. The method according to claim 4, wherein the camera is rotatable; After comparing the image features of the first object with the image features of the target area and obtaining the first comparison result, the method further includes: determining the rotation direction of the camera based on the first comparison result; The performing the shooting operation and outputting the second image includes: controlling the camera to rotate according to the rotation direction, and taking at least two target images during the rotation, the target images including at least part of the image features in the target area; Image synthesis is performed on the at least two target images to output a second image. 6. The method according to claim 1, wherein, after performing feature detection on the preview image collected by the camera, further comprising: In the case that no image feature matching the image feature of the target area is detected in the preview image, third prompt information is output, and the third preset prompt information is used to indicate that the preview image does not contain the target area. 7. The method according to claim 1, wherein the performing the shooting operation and outputting the second image comprises: Enlarge the area where the target object is located so that the target object does not exceed the preview screen; Executing a shooting operation to output the second image. 8. A terminal device, characterized in that it comprises: The input receiving module is used to receive the user's first input on the first image collected by the camera; an area determination module, configured to mark a target area of the first image in response to the first input; The matching detection module is used to perform feature detection on the preview image collected by the camera when the camera collects the image; An image output module, configured to perform a shooting operation and output a second image when a target object matching the image features of the target area is detected. 9. A terminal device, characterized by comprising a processor, a memory, and a computer program stored on the memory and operable on the processor, when the computer program is executed by the processor, the The steps of the photographing method described in any one of claims 1 to 7. 10. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the shooting according to any one of claims 1 to 7 is realized method steps.