WO2026001819A1 - Photographing method and apparatus, and computer-readable medium and electronic device - Google Patents

Abstract

A photographing method and apparatus, and a computer-readable medium and an electronic device. The method comprises: determining the type of a target photographing control subject having an association relationship with a target object to be photographed, wherein the target photographing control subject is used for controlling a photographing operation of a camera; acquiring imaging information of the target photographing control subject, and generating a photographing control signal on the basis of the imaging information and the type of the target photographing control subject; and executing a corresponding photographing operation on the target object on the basis of the photographing control signal. In the technical solution provided in the embodiments of the present application, a camera can implement automatic photographing on the basis of a target object that needs to be photographed and a target photographing control body, without requiring a user to perform a manual operation for photographing, such that the user can use the camera for photographing in more scenarios, thereby expanding the usage scenarios of the camera and improving the user experience.

Description

Shooting methods, apparatus, computer-readable media and electronic devices

Cross-references

This disclosure claims priority to Chinese Patent Application No. 202410828745.0, filed on June 25, 2024, entitled "Method for photographing, apparatus, computer-readable medium and electronic device", the entire contents of which are incorporated herein by reference.

Technical Field

This disclosure belongs to the field of camera technology, and specifically relates to a shooting method, apparatus, computer-readable medium, and electronic device.

Background Technology

Photography allows for the creation of long-term records of fleeting events, making it an essential part of daily life and work. Generally speaking, dedicated cameras offer better image quality compared to camera modules integrated into terminal devices (such as mobile phones), making them more popular among professionals.

Take instant cameras as an example. They integrate photo taking and printing functions into a single camera device, allowing for instant photo printing. However, currently, the photo taking operation of these smart cameras limits their usage scenarios. For instance, users need to hold the camera, aim it at the subject, and then press the shutter button on the camera to take the picture.

Public content

The purpose of this disclosure is to provide a shooting method, apparatus, computer-readable medium, and electronic device.

Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

According to one aspect of the present disclosure, a shooting method is provided, comprising:

Determine the type of target shooting control subject that is associated with the target object to be photographed, wherein the target shooting control subject is used to control the shooting operation of the camera;

Acquire imaging information of the target shooting control subject, and generate a shooting control signal based on the imaging information and the type of the target shooting control subject;

The corresponding shooting operation is performed on the target object according to the shooting control signal.

According to one aspect of the present disclosure, a shooting device is provided, comprising:

The type determination module is used to determine the type of the target shooting control subject that is associated with the target object to be photographed, and the target shooting control subject is used to control the shooting operation of the camera;

A signal generation module is used to acquire imaging information of the target shooting control subject and generate a shooting control signal based on the imaging information and the type of the target shooting control subject;

The shooting module is used to control the camera to perform shooting operations based on the target shooting control object and the target object.

In one embodiment of this disclosure, the type determination module is specifically used for:

Acquire the video stream data captured by the camera for the target object;

The type of target object to be filmed is determined based on the video stream data;

The type of the target shooting control subject is determined based on the type of the target object and the preset object subject mapping relationship; the preset object subject mapping relationship indicates the mapping relationship between the shooting object type and the shooting control subject type.

In one embodiment of this disclosure, the type determination module is specifically used for:

The type of target shooting control subject that is associated with the target object to be shot is determined according to the shooting mode selected by the user; the shooting mode includes at least single gesture shooting mode, multi-gesture shooting mode, dynamic gesture shooting mode, predefined gesture shooting mode, marker tracking shooting mode and face recognition tracking shooting mode.

In one embodiment of this disclosure, the type determination module is specifically used for:

Acquire facial image data within the field of view of the camera;

Facial feature extraction is performed on the facial image data to obtain facial feature information to be identified;

If the facial feature information to be identified is consistent with the pre-stored facial feature information, then the object corresponding to the facial feature information to be identified is taken as the target object, and the type of the target shooting control subject that is associated with the target object is determined.

In one embodiment of this disclosure, the signal generation module is specifically used for:

The corresponding subject recognition algorithm is determined based on the type of the target shooting control subject; the subject recognition algorithm includes at least one of the gesture recognition algorithm, face recognition algorithm, and marker recognition algorithm, or any combination thereof;

When the subject recognition algorithm identifies the target shooting control subject in the imaging information as the designated shooting control subject, the shooting control signal is generated.

In one embodiment of this disclosure, the signal generation module is specifically used for:

The subject recognition algorithm identifies a designated area in the imaging information to determine the target shooting control subject contained in the imaging information; wherein the distance between the boundary of the designated area and the image outline of the target object is less than a first preset distance, or the distance between the boundary of the designated area and the outline of a designated part of the target object is less than a second preset distance.

In one embodiment of this disclosure, the type of the target shooting control subject is a gesture; the type determination module is specifically used for:

Perform facial recognition on the target object to record the area where the target object's face is located;

When the target shooting control subject is identified based on the imaging information, the distance between the location of the target control subject and the area where the face is located is detected;

When the distance is within a preset range, the shooting control signal is generated.

In one embodiment of this disclosure, the target acquisition control subject is a marker; the type determination module is specifically used for:

When the target shooting control subject is detected based on the imaging information, a wireless connection is established with the wireless signal transmission module of the target shooting control subject;

The shooting control signal sent by the target shooting control subject is obtained through the wireless connection.

In one embodiment of this disclosure, the target shooting control subject is of the type of gesture; the signal generation module is specifically used for:

The first hand gesture performed by the target object is detected based on the imaging information;

When the target object is detected to have performed a second gesture within a preset time period after the first gesture is detected, the shooting control signal is generated.

In one embodiment of this disclosure, the target objects are multiple; the signal generation module is specifically used for:

Multiple target shooting control entities were identified based on the imaging information and the type of the target shooting control entity.

Calculate the ratio between the number of controlled entities and the number of target objects;

When the ratio is greater than a preset threshold, the shooting control signal is generated.

In one embodiment of this disclosure, the shooting control signal includes a focus command and a shooting command; the shooting module is specifically used for:

After focusing on the target object according to the focusing command, a corresponding shooting operation is performed on the target object according to the shooting command.

In one embodiment of this disclosure, the target objects are multiple; the shooting module is specifically used for:

Based on the generation time of the shooting control signal corresponding to each target object, focus on each target object sequentially and then perform the shooting operation; or

After focusing on each target object individually, the shooting operation is performed on multiple target objects as a whole.

In one embodiment of this disclosure, the imaging module is further configured to:

When a stop shooting gesture is detected, the camera is controlled to stop shooting.

In one embodiment of this disclosure, the imaging module is further configured to:

When the target object is detected to be moving, a camera movement command is generated based on the target object's movement path;

The camera lens is moved according to the lens movement command so that the target object is within the camera's field of view during the shooting process.

According to one aspect of the present disclosure, a computer-readable medium is provided having a computer program stored thereon, which, when executed by a processor, implements the shooting method as described in the above technical solutions.

According to one aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor executes the executable instructions to cause the electronic device to perform the shooting method as described in the above technical solution.

According to one aspect of the present disclosure, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the imaging method as described above.

In the technical solution provided in this disclosure, the type of the target shooting control subject that is associated with the target object to be photographed is first determined, wherein the target shooting control subject is used to control the shooting operation of the camera; then, the imaging information of the target shooting control subject is acquired, and a shooting control signal is generated according to the imaging information and the type of the target shooting control subject; finally, the corresponding shooting operation is performed on the target object according to the shooting control signal. Thus, the camera can automatically shoot based on the target object to be photographed and the target shooting control subject, without the need for manual operation by the user, thereby enabling the user to use the camera to shoot in more scenarios, expanding the camera's usage scenarios, and improving the user experience.

It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure.

Attached Figure Description

The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

Figure 1 schematically illustrates a flowchart of a shooting method provided in one embodiment of the present disclosure.

Figure 2 schematically illustrates a flowchart of an imaging method provided in one embodiment of the present disclosure.

Figure 3 schematically shows a structural block diagram of the imaging device provided in an embodiment of the present disclosure.

Figure 4 schematically illustrates a computer system architecture block diagram suitable for implementing electronic devices according to embodiments of the present disclosure.

Detailed Implementation

Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be more thorough and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art.

Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced without one or more of the specific details, or other methods, components, apparatuses, steps, etc., can be employed. In other instances, well-known methods, apparatuses, implementations, or operations are not shown or described in detail to avoid obscuring various aspects of this disclosure.

The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and/or processor devices and/or microcontroller devices.

The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations/steps, nor do they necessarily have to be performed in the described order. For example, some operations/steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

In this disclosure, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

When taking photos with a camera, the user needs to hold the camera, aim it at the desired object, and then press the shutter button. This prevents the user from being photographed and also requires the camera to be carried by the user, limiting the camera's usability. To address these issues, this disclosure proposes a shooting method, which will be described in detail below with specific embodiments.

Figure 1 schematically illustrates a flowchart of a shooting method provided in an embodiment of this disclosure. This method can be implemented using a camera, such as an instant camera. As shown in Figure 1, the shooting method provided in this embodiment includes steps 110 to 130, as detailed below:

Step 110: Determine the type of target shooting control subject that is associated with the target object to be photographed, wherein the target shooting control subject is used to control the camera's shooting operation.

Specifically, the target object is the subject of the camera's shooting, which can be any object that can be recorded by the camera, such as a person, animal, or machine. The target shooting control object is the object used to control the camera's shooting operation. It can be of various types, such as a person's body posture, facial expression, gestures, or tags worn on their person, or tags on other animals or objects, such as animal name tags or license plates.

In one embodiment of this disclosure, a user can pre-store multiple facial feature information in the camera. For example, the user uses the camera to photograph a designated person, the camera performs facial recognition on the photographed image to obtain and store the facial feature information; or, the user imports a facial image of a designated person into the camera, the camera performs facial recognition on the image to obtain and store the facial feature information. Facial feature information can be used to distinguish different people. During shooting, the camera acquires facial image data within the field of view and performs facial recognition on the facial image data to extract the facial feature information to be identified; then, the facial feature information to be identified is compared with pre-stored facial feature information. If they match, the person corresponding to the facial feature information to be identified is taken as the target object; if they do not match, the corresponding person is not taken as the target object. This allows for accurate identification of the target object to be photographed, eliminating interference from other people in the environment who are not relevant to the photograph.

In one embodiment of this disclosure, the type of the target shooting control entity can be determined based on the shooting mode set by the user on the camera. That is, the type of target shooting control entity associated with the target object to be photographed is determined according to the shooting mode selected by the user. The shooting mode defines the type of entity that triggers the shooting operation, i.e., defines the type of target shooting control entity. For example, the shooting mode may include a single-gesture shooting mode, a multi-gesture shooting mode, a dynamic gesture shooting mode, a predefined gesture shooting mode, a marker tracking shooting mode, and a face recognition tracking shooting mode. Other types of shooting modes may also be included based on user or design requirements. A single-gesture shooting mode refers to a mode that triggers the shooting operation through a single gesture, such as making a "V" shape with one hand. A multi-gesture shooting mode refers to a mode that triggers the shooting operation through multiple gestures, such as making a "V" shape with both hands. A dynamic gesture shooting mode refers to a mode that triggers the shooting operation through changing gestures, such as changing the gesture from making the number 1 to making the number 2. A predefined gesture shooting mode refers to a mode where the user pre-sets or the camera pre-stores relevant gestures, and the user triggers the shooting operation after performing the gesture. Marker-based tracking shooting mode refers to triggering the shooting operation through a specific marker, also known as logo tracking shooting mode. Examples include animal name tags, license plates, and specific tags worn by people. For instance, a specific marker could be a company logo or related graphic on a T-shirt, or a nameplate or tag worn on clothing. Face recognition tracking shooting mode refers to triggering the shooting operation by recognizing a face. All the above modes that trigger shooting operations through various gestures can be collectively referred to as gesture shooting modes. Therefore, based on the above shooting modes, the type of target shooting control subject can be gestures, faces, markers, etc.

As a further concrete example, in logo tracking shooting mode, the nameplate or marker can also integrate a wireless signal transmission module, which has the function of transmitting shooting control signals and can be networked or paired with the camera. When the camera recognizes the corresponding logo within the field of view, it can initiate network connection or pairing, automatically connecting or pairing with the marker's wireless transmission module. The camera then enters wireless control shooting mode, and the user can output shooting control signals by operating the marker. These signals are transmitted wirelessly to the camera, which then performs video recording or photo taking.

In one embodiment of this disclosure, the type of the target shooting control subject can be actively identified by the camera. The specific process includes: acquiring video stream data collected by the camera for the target object; determining the type of the target object to be shot based on the video stream data; determining the type of the target shooting control subject based on the type of the target object and a preset object subject mapping relationship; the preset object subject mapping relationship indicates the mapping relationship between the shooting object type and the shooting control subject type. After the camera is turned on, it can collect imaging information by framing the view through the lens. Multiple frames of images collected continuously constitute the video stream data collected by the camera. When shooting a target object, the images in the video stream collected by the camera usually include the target object. Therefore, by identifying the images in the video stream, the type of the target object can be determined, for example, whether the target object is a person, animal, vehicle, or other object. Depending on the type of the target object, the corresponding target shooting control subject type will naturally be different. The camera can pre-store the object subject mapping relationship, that is, the mapping relationship between the shooting object type and the shooting control subject type. Then, based on the currently detected target object type, the mapping relationship is queried to determine the type of the target shooting control subject. For example, when the target object type is detected as a person, the type of the target shooting control subject can be determined as a gesture, posture, or facial expression; when the target object type is detected as an animal, the type of the target shooting control subject can be determined as an animal nameplate, an identification item worn by the animal, or a specific action performed by the animal; when the target object type is detected as a vehicle, the type of the target shooting control subject can be determined as a license plate, vehicle logo, etc.

Step 120: Obtain the imaging information of the target shooting control subject, and generate a shooting control signal based on the imaging information and the type of the target shooting control subject.

Specifically, the imaging information of the target shooting control subject is obtained by capturing image data of the target object through the camera lens, such as the aforementioned video stream data. This imaging information is mainly used to identify what the target shooting control subject is, such as what kind of gesture, facial expression, or specific characters of a license plate. Generating a shooting control signal based on the imaging information and the type of the target shooting control subject involves identifying the specific content of the target shooting control subject based on the imaging information, and determining whether it corresponds to the subject content that triggers the shooting operation for the target shooting control subject type. If so, a shooting control signal is generated, which controls the camera to perform the shooting operation. For example, if the type of the target shooting control subject is a gesture, then the gesture that triggers the shooting operation might be a "V" sign. The imaging information identifies whether the target shooting control subject has a "V" sign; if so, a shooting control signal is generated.

Step 130: Perform the corresponding shooting operation on the target object according to the shooting control signal.

Specifically, after generating the shooting control signal, the camera executes the signal to take a picture of the target object. This eliminates the need for users to hold the camera and press the shutter button; instead, users can place the camera in a position and use gestures, postures, facial expressions, etc., to automatically take pictures. It also allows for conditional automatic shooting of other animals, vehicles, or objects, greatly expanding the camera's application scenarios and enhancing the user experience.

In the technical solution provided in this disclosure, the type of the target shooting control subject that is associated with the target object to be photographed is first determined, wherein the target shooting control subject is used to control the shooting operation of the camera; then, the imaging information of the target shooting control subject is acquired, and a shooting control signal is generated according to the imaging information and the type of the target shooting control subject; finally, the corresponding shooting operation is performed on the target object according to the shooting control signal. Thus, the camera can automatically shoot based on the target object to be photographed and the target shooting control subject, without the need for manual operation by the user, thereby enabling the user to use the camera to shoot in more scenarios, expanding the camera's usage scenarios, and improving the user experience.

Figure 2 schematically illustrates a flowchart of a shooting method provided in one embodiment of this disclosure. This embodiment is a further refinement of the above embodiments. As shown in Figure 2, the shooting method provided in this embodiment includes the following steps:

Step 210: Determine the type of target shooting control subject that is associated with the target object to be photographed, wherein the target shooting control subject is used to control the camera's shooting operation.

Step 220: Obtain the imaging information of the target shooting control subject.

Steps 210-220 are the same as the corresponding contents of steps 110-120 in the aforementioned embodiments, and will not be repeated here.

Step 230: Determine the corresponding subject recognition algorithm based on the type of the target shooting control subject; the subject recognition algorithm includes at least a gesture recognition algorithm, a face recognition algorithm, and a marker recognition algorithm.

Specifically, the subject recognition algorithm is used to identify the specific content of the target shooting control subject. Different types of target shooting control subjects require different subject recognition algorithms; therefore, it is necessary to determine the corresponding subject recognition algorithm based on the type of the target shooting control subject. In this embodiment, the subject recognition algorithm includes at least one of a gesture recognition algorithm, a face recognition algorithm, and a marker recognition algorithm, or any combination thereof. The gesture recognition algorithm is used to identify what specific gesture the target object is performing as the target shooting control subject. For example, the gesture recognition algorithm is used to identify whether the target object is performing a "V" sign or a "√" sign (a gesture made by spreading the thumb and forefinger). Alternatively, the gesture recognition algorithm is used to identify whether the target shooting control subject is the shooting control subject that triggered the shooting operation. For example, if the shooting control subject that triggered the shooting operation is a "V" sign, then the gesture recognition algorithm is used to identify whether the target object performed a "V" sign. The face recognition algorithm is used to identify the facial expressions of the target object. For example, the face recognition algorithm is used to identify whether the target object is smiling. The marker recognition algorithm is used to identify the content of markers, such as animal nameplates, license plates, car logos, etc. By associating the subject recognition algorithm with the type of the target shooting control subject, a more accurate algorithm can be used to identify the target shooting control subject. For example, if the type of the target shooting control subject is determined to be a gesture, then a gesture recognition algorithm is used instead of a face recognition algorithm or a marker recognition algorithm, thereby obtaining more accurate identification information of the target shooting control subject.

Step 240: When the target shooting control subject in the imaging information is identified as the designated shooting control subject by the subject recognition algorithm, a shooting control signal is generated.

Specifically, the designated shooting control subject is the shooting control subject that triggers the shooting operation. When the target shooting control subject in the imaging information is identified as the designated shooting control subject, it means that the shooting operation can be performed, thereby generating a shooting control signal.

In one embodiment of this disclosure, the specific process of identifying the target shooting control subject using a subject recognition algorithm is as follows: The subject recognition algorithm identifies a designated area in the imaging information to determine the target shooting control subject contained within the imaging information; wherein the distance between the boundary of the designated area and the image contour of the target object is less than a first preset distance, or the distance between the boundary of the designated area and the contour of a designated part of the target object is less than a second preset distance. For example, the designated area is within or near the image contour of the target object, or the designated area is within or near the contour of a specific part of the target object, such as a gesture within or near the human body contour area, a license plate within or near the vehicle image contour area, or a figure-eight gesture near a person's face.

Furthermore, in another embodiment of this disclosure, facial recognition can be performed on the target object to be photographed first, and facial feature information can be recorded or temporarily stored. This facial feature information can be used to distinguish different people. Facial recognition is combined with the identification of the target shooting control subject to generate a shooting control signal. Specifically, facial feature information is extracted and recorded for each face within the camera's field of view. Then, when a shooting control gesture is detected, it is determined whether the detected gesture is close to the area containing any previously recorded facial feature information. If close, the gesture is considered valid; otherwise, it is considered invalid, and the camera is not controlled until a valid shooting control gesture is detected. In cases of multiple people taking photos in public places, since there are other "unauthorized persons" besides the target object, combining gesture and facial recognition can eliminate interference from these unauthorized persons.

In one embodiment of this disclosure, the target shooting control subject is a gesture. In this case, shooting control signals can be generated based on imaging information through single gesture identification, multiple gesture recognition, static gesture recognition, dynamic gesture recognition, and custom gesture recognition. Single gesture identification refers to recognizing only one gesture. Multiple gesture recognition refers to recognizing two or more gestures. Static gesture recognition refers to recognizing gestures that do not change in a short period, such as the "OK" gesture, the heart gesture, or the figure-eight gesture. In this case, recognition can be combined with the target object's facial position, such as a figure-eight gesture close to the face. Dynamic gesture recognition refers to recognizing multiple gestures in a short period. Custom gesture recognition involves the user pre-defining gestures and then recognizing them. For example, a person with a physical disability can pre-define unconventional gestures, and then generate shooting control signals through custom gesture recognition during shooting.

Taking dynamic gesture recognition, which requires identifying two gesture actions, as an example, the process of generating a shooting control signal includes: detecting the first gesture action performed by the target object based on the imaging information; and generating a shooting control signal when the target object performs a second gesture action within a preset time period after the first gesture action is detected. Specifically, firstly, it detects whether the target object has performed the first gesture action based on the imaging information. If the target object has performed the first gesture action, it continues to detect whether the target object has performed the second gesture action within the preset time period. If so, a shooting control signal can be generated; if any of the aforementioned conditions are not met, no shooting control signal is generated. For example, if the user performs a "V" sign gesture followed by a "√" sign gesture within 2 seconds, a shooting control signal is generated; otherwise, no shooting control signal is generated. Another example is if the user changes from giving a thumbs-up to pressing their thumb down within 1 second, a shooting control signal is generated.

In one embodiment of this disclosure, when there are multiple target objects, each target object can have a corresponding target shooting control subject. The process of generating the shooting control signal includes: identifying multiple target shooting control subjects based on imaging information and the type of the target shooting control subject; calculating the ratio between the number of control subjects and the number of target objects; and generating a shooting control signal when the ratio is greater than a preset threshold. For example, if the type of target shooting control subject is a gesture, the gesture-to-head ratio is calculated, and a shooting control signal is generated when the ratio exceeds a preset threshold (e.g., 50%).

Step 250: After focusing on the target object according to the focus command, perform the corresponding shooting operation on the target object according to the shooting command.

Specifically, the shooting control signals include focus commands and shooting commands. Focus commands control the camera to focus on the target object, while shooting commands control the camera to execute the shooting operation. When taking a picture, the camera first focuses on the target object according to the focus command, and then executes the shooting command, i.e., performs the shooting operation, to achieve a clear image of the target object. Focusing can be done on a specific area of the target object or on the entire target object. For example, it can focus on the face of the target object, or on the entire target object, or it can be combined with markers to focus on the entire person, face, or the marker itself.

In one embodiment of this disclosure, there are multiple target objects. The focusing and shooting process can be as follows: based on the generation time of the shooting control signal corresponding to each target object, focus is sequentially applied to each target object before shooting. Specifically, the generation time of the shooting control signal corresponding to the target object actually reflects the execution time of the target shooting control entity corresponding to the target object, such as the gesture execution time of the target object. Therefore, based on the backward order of the gesture execution times of each target object, focus is applied to each target object sequentially before shooting, that is, focusing and shooting are performed on each target object according to the order of the gestures.

In one embodiment of this disclosure, there are multiple target objects. In this case, the focusing and shooting actions can be performed as follows: focus is applied to each target object separately, and then the shooting operation is performed on the multiple target objects as a whole. That is, focusing is applied to multiple target objects, while shooting is applied to the multiple target objects as a whole.

In one embodiment of this disclosure, if a stop-shoot gesture is detected during filming, the camera is controlled to stop filming. Optionally, if other objects in the background environment are detected performing corresponding target shooting control actions during filming, the camera is controlled to stop filming to eliminate interference from people in the environment. For example, if the target object is being filmed in a park and other people in the background are performing related gestures that interfere with the filming, the camera is controlled to stop filming. Alternatively, if the target object makes a gesture that is different from the shooting gesture and is predefined as a stop-shoot gesture, the camera is controlled to stop filming. For example, when filming a group video, if some participants are late and need to join the ongoing filming, any person in the viewfinder can make a stop-shoot gesture to end the current video recording. Once the later participants arrive, a new video recording or photo taking can be started again via gesture control.

In one embodiment of this disclosure, the camera can achieve automatic tracking and shooting, that is: when the movement of a target object is detected, a lens movement command is generated based on the movement path of the target object; the camera lens is controlled to move according to the lens movement command so that the target object is kept within the camera's field of view during the shooting process. Specifically, during the movement of the target object, the camera lens can move synchronously with the target object, so that the target object is always within the camera's field of view, thereby allowing continuous shooting of the target object. For example, when the target object moves from left to right, the camera lens can follow the target object from left to right, achieving dynamic target locking. This process can realize face tracking shooting, tracking and marking shooting of animals/plants/objects, tracking and shooting of specific people, and tracking and shooting of vehicle license plate numbers, etc.

In this disclosure, unless otherwise specified, the shooting control signal specifically refers to the control signal that controls the camera to perform shooting actions, such as starting to take a picture or starting to record video.

The technical solutions provided in this disclosure can realize functions such as object recognition/tracking, autofocus, and automatic shooting, which greatly enriches the ways and scenarios in which the camera is used, enabling the camera to better meet the user's needs and thus improve the user experience.

It should be noted that although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and/or a step may be broken down into multiple steps.

The following describes an embodiment of the device disclosed herein, which can be used to perform the shooting method in the above embodiments of the present disclosure. Figure 3 schematically shows a structural block diagram of the shooting device provided in the embodiment of the present disclosure. As shown in Figure 3, the shooting device provided in the embodiment of the present disclosure includes:

Type determiner 310 is configured to determine the type of target shooting control subject that is associated with the target object to be photographed, the target shooting control subject being used to control the shooting operation of the camera;

The signal generator 320 is configured to acquire imaging information of the target shooting control subject and generate a shooting control signal based on the imaging information and the type of the target shooting control subject;

The camera 330 is configured to control the camera to perform a shooting operation based on the target shooting control object and the target object.

In one embodiment of this disclosure, the type determiner 310 is specifically configured as follows:

Acquire the video stream data captured by the camera for the target object;

The type of the target object to be filmed is determined based on the video stream data;

The type of the target shooting control subject is determined based on the type of the target object and the preset object subject mapping relationship; the preset object subject mapping relationship indicates the mapping relationship between the shooting object type and the shooting control subject type.

In one embodiment of this disclosure, the type determiner 310 is specifically configured as follows:

The type of target shooting control subject that is associated with the target object to be shot is determined according to the shooting mode selected by the user; the shooting mode includes at least single gesture shooting mode, multi-gesture shooting mode, dynamic gesture shooting mode, predefined gesture shooting mode, marker tracking shooting mode and face recognition tracking shooting mode.

In one embodiment of this disclosure, the type determiner 310 is specifically configured as follows:

Acquire facial image data within the field of view of the camera;

Facial feature extraction is performed on the facial image data to obtain facial feature information to be identified;

If the facial feature information to be identified is consistent with the pre-stored facial feature information, then the object corresponding to the facial feature information to be identified is taken as the target object, and the type of the target shooting control subject that is associated with the target object is determined.

In one embodiment of this disclosure, the signal generator 320 is specifically configured as follows:

The corresponding subject recognition algorithm is determined based on the type of the target shooting control subject; the subject recognition algorithm includes at least one of the gesture recognition algorithm, face recognition algorithm, and marker recognition algorithm, or any combination thereof;

When the subject recognition algorithm identifies the target shooting control subject in the imaging information as the designated shooting control subject, the shooting control signal is generated.

In one embodiment of this disclosure, the signal generator 320 is specifically configured as follows:

The subject recognition algorithm identifies a designated area in the imaging information to determine the target shooting control subject contained in the imaging information; wherein the distance between the boundary of the designated area and the image outline of the target object is less than a first preset distance, or the distance between the boundary of the designated area and the outline of a designated part of the target object is less than a second preset distance.

In one embodiment of this disclosure, the type of the target shooting control subject is a gesture; the type determiner 310 is specifically configured as follows:

Perform facial recognition on the target object to record the area where the target object's face is located;

When the target shooting control subject is identified based on the imaging information, the distance between the location of the target control subject and the area where the face is located is detected;

When the distance is within a preset range, the shooting control signal is generated.

In one embodiment of this disclosure, the type of the target acquisition control subject is a marker; the type determiner 310 is specifically configured as follows:

When the target shooting control subject is detected based on the imaging information, a wireless connection is established with the wireless signal transmitter of the target shooting control subject;

The shooting control signal sent by the target shooting control subject is obtained through the wireless connection.

In one embodiment of this disclosure, the target shooting control subject is of the type of gesture; the signal generator 320 is specifically configured as follows:

The first hand gesture performed by the target object is detected based on the imaging information;

When the target object is detected to have performed a second gesture within a preset time period after the first gesture is detected, the shooting control signal is generated.

In one embodiment of this disclosure, the target objects are multiple; the signal generator 320 is specifically configured as follows:

Multiple target shooting control entities were identified based on the imaging information and the type of the target shooting control entity.

Calculate the ratio between the number of controlled entities and the number of target objects;

When the ratio is greater than a preset threshold, the shooting control signal is generated.

In one embodiment of this disclosure, the shooting control signal includes a focus command and a shooting command; the camera 330 is specifically configured as follows:

After focusing on the target object according to the focusing command, a corresponding shooting operation is performed on the target object according to the shooting command.

In one embodiment of this disclosure, the target objects are multiple; the camera 330 is specifically configured as follows:

Based on the generation time of the shooting control signal corresponding to each target object, focus on each target object sequentially and then perform the shooting operation; or

After focusing on each target object individually, the shooting operation is performed on multiple target objects as a whole.

In one embodiment of this disclosure, the camera 330 is further configured to:

When a stop shooting gesture is detected, the camera is controlled to stop shooting.

In one embodiment of this disclosure, the camera 330 is further configured to:

When the target object is detected to be moving, a camera movement command is generated based on the target object's movement path;

The camera lens is moved according to the lens movement command so that the target object is within the camera's field of view during the shooting process.

The specific details of the imaging devices provided in the various embodiments of this disclosure have been described in detail in the corresponding method embodiments, and will not be repeated here.

Figure 4 schematically illustrates a computer system architecture block diagram for implementing an electronic device according to embodiments of the present disclosure.

It should be noted that the computer system 400 of the electronic device shown in Figure 4 is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments disclosed herein.

As shown in Figure 4, the computer system 400 includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 402 or programs loaded from storage section 408 into random access memory (RAM). The RAM 403 also stores various programs and data required for system operation. The CPU 401, ROM 402, and RAM 403 are interconnected via a bus 404. An input/output interface 405 (I/O interface) is also connected to the bus 404.

The following components are connected to the input/output interface 405: an input section 406 including a keyboard, mouse, etc.; an output section 407 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 408 including a hard disk, etc.; and a communication section 409 including a network interface card such as a local area network card, modem, etc. The communication section 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the input/output interface 405 as needed. A removable medium 411, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 410 as needed so that computer programs read from it can be installed into the storage section 408 as needed.

In particular, according to embodiments of this disclosure, the processes described in the various method flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 409, and/or installed from removable medium 411. When the computer program is executed by central processing unit 401, it performs various functions defined in the system of this disclosure.

It should be noted that the computer-readable medium shown in the embodiments of this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such transmitted data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, etc., or any suitable combination thereof.

The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, touch terminal, or network device, etc.) to execute the method according to the embodiments of this disclosure.

Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein.

It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims (18)

A shooting method, comprising: Determine the type of target shooting control subject that is associated with the target object to be photographed, wherein the target shooting control subject is used to control the shooting operation of the camera; Acquire imaging information of the target shooting control subject, and generate a shooting control signal based on the imaging information and the type of the target shooting control subject; The corresponding shooting operation is performed on the target object according to the shooting control signal. According to the shooting method of claim 1, determining the type of the target shooting control subject that is associated with the target object to be shot includes: Acquire the video stream data captured by the camera for the target object; The type of the target object to be filmed is determined based on the video stream data; The type of the target shooting control subject is determined based on the type of the target object and the preset object subject mapping relationship; the preset object subject mapping relationship indicates the mapping relationship between the shooting object type and the shooting control subject type. According to the shooting method of claim 1, determining the type of the target shooting control subject that is associated with the target object to be shot includes: The type of target shooting control subject that is associated with the target object to be shot is determined according to the shooting mode selected by the user; the shooting mode includes at least single gesture shooting mode, multi-gesture shooting mode, dynamic gesture shooting mode, predefined gesture shooting mode, marker tracking shooting mode and face recognition tracking shooting mode. According to the shooting method of claim 1, determining the type of the target shooting control subject that is associated with the target object to be shot includes: Acquire facial image data within the field of view of the camera; Facial feature extraction is performed on the facial image data to obtain facial feature information to be identified; If the facial feature information to be identified is consistent with the pre-stored facial feature information, then the object corresponding to the facial feature information to be identified is taken as the target object, and the type of the target shooting control subject that is associated with the target object is determined. According to the shooting method of claim 1, generating a shooting control signal based on the imaging information and the type of the target shooting control subject includes: The corresponding subject recognition algorithm is determined based on the type of the target shooting control subject; the subject recognition algorithm includes at least one of the gesture recognition algorithm, face recognition algorithm, and marker recognition algorithm, or any combination thereof; When the subject recognition algorithm identifies the target shooting control subject in the imaging information as the designated shooting control subject, the shooting control signal is generated. According to the shooting method of claim 5, after determining the corresponding subject recognition algorithm based on the type of the target shooting control subject, the method further includes: The subject recognition algorithm identifies a designated area in the imaging information to determine the target shooting control subject contained in the imaging information; wherein the distance between the boundary of the designated area and the image outline of the target object is less than a first preset distance, or the distance between the boundary of the designated area and the outline of a designated part of the target object is less than a second preset distance. According to the shooting method of claim 1, wherein the type of the target shooting control subject is a gesture; generating a shooting control signal based on the imaging information and the type of the target shooting control subject includes: Perform facial recognition on the target object to record the area where the target object's face is located; When the target shooting control subject is identified based on the imaging information, the distance between the location of the target control subject and the area where the face is located is detected; When the distance is within a preset range, the shooting control signal is generated. According to the shooting method of claim 1, the type of the target shooting control subject is a marker; generating a shooting control signal based on the imaging information and the type of the target shooting control subject includes: When the target shooting control subject is detected based on the imaging information, a wireless connection is established with the wireless signal transmission module of the target shooting control subject; The shooting control signal sent by the target shooting control subject is obtained through the wireless connection. According to the shooting method of claim 1, wherein the type of the target shooting control subject is a gesture; generating a shooting control signal based on the imaging information and the type of the target shooting control subject includes: The first hand gesture performed by the target object is detected based on the imaging information; When the target object is detected to have performed a second gesture within a preset time period after the first gesture is detected, the shooting control signal is generated. According to the shooting method of claim 1, the target object is multiple; generating a shooting control signal based on the imaging information and the type of the target shooting control subject includes: Multiple target shooting control entities were identified based on the imaging information and the type of the target shooting control entity. Calculate the ratio between the number of controlled entities and the number of target objects; When the ratio is greater than a preset threshold, the shooting control signal is generated. According to the shooting method of claim 1, the shooting control signal includes a focus command and a shooting command; performing a corresponding shooting operation on the target object according to the shooting control signal includes: After focusing on the target object according to the focusing command, a corresponding shooting operation is performed on the target object according to the shooting command. According to the shooting method of claim 1, the target object is multiple; performing a corresponding shooting operation on the target object according to the shooting control signal includes: Based on the generation time of the shooting control signal corresponding to each target object, focus on each target object sequentially and then perform the shooting operation; or After focusing on each target object individually, the shooting operation is performed on multiple target objects as a whole. According to the shooting method of claim 1, wherein, during the process of performing a corresponding shooting operation on the target object according to the shooting control signal, the method further includes: When a stop shooting gesture is detected, the camera is controlled to stop shooting. According to the shooting method of claim 1, wherein, during the process of performing a corresponding shooting operation on the target object according to the shooting control signal, the method further includes: When the target object is detected to be moving, a camera movement command is generated based on the target object's movement path; The camera lens is moved according to the lens movement command so that the target object is within the camera's field of view during the shooting process. A filming device, comprising: A type determiner is configured to determine the type of a target shooting control subject that is associated with the target object to be photographed, the target shooting control subject being used to control the camera's shooting operation; A signal generator is configured to acquire imaging information of the target shooting control subject and generate a shooting control signal based on the imaging information and the type of the target shooting control subject; The camera is configured to control the camera to perform a shooting operation based on the target shooting control object and the target object. A computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the photographing method according to any one of claims 1-14. An electronic device, comprising: Processor; and Memory for storing the executable instructions of the processor; The processor is configured to execute the executable instructions to enable the electronic device to implement the shooting method as described in any one of claims 1-14. [Corrected according to Rule 26, 01.07.2025]
A computer program product, or computer program, includes computer instructions stored in a computer-readable storage medium; The processor of the computer device reads the computer instructions from a computer-readable storage medium, and executes the computer instructions to cause the computer device to perform the imaging method according to any one of claims 1-14.