WO2020038110A1 - Panoramic photographing method and apparatus, terminal and computer-readable storage medium - Google Patents

Abstract

The present application falls within the technical field of photographing, and particularly relates to a panoramic photographing method and apparatus, a terminal and a computer-readable storage medium. The method comprises: receiving a panoramic photographing instruction carrying panoramic photographing mode information, wherein the panoramic photographing mode information comprises panoramic picture photographing mode information and panoramic video photographing mode information; controlling, according to the panoramic photographing instruction, a plurality of cameras to respectively photograph frame images corresponding to photographing angles of the cameras; and splicing, according to a splicing rule corresponding to the panoramic photographing mode information, the frame images photographed by each camera into a panoramic photo or a panoramic video image. The method solves the technical problem of a single panoramic photographing mode, and diversification of panoramic photographing modes is realized.

Description

Panorama shooting method, device, terminal and computer-readable storage medium Technical field

The present application belongs to the field of photographing technology, and in particular, relates to a method, a device, a terminal, and a computer-readable storage medium for panoramic photographing.

Background technique

Panorama shooting is a shooting method that combines multiple photos taken by a camera to obtain photos with a large angle of view.

Summary of the Invention

The embodiments of the present application provide a panorama shooting method, device, terminal, and computer-readable storage medium, which can solve the technical problem of a single panorama shooting mode.

A first aspect of the embodiments of the present application provides a panoramic shooting method, including:

Receiving a panorama shooting instruction carrying panorama shooting mode information; the panorama shooting mode information includes panorama photo shooting mode information and panorama video shooting mode information;

Controlling a plurality of cameras to respectively capture a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction;

The frame images captured by each camera are stitched into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information.

A second aspect of the embodiments of the present application provides a panoramic photographing apparatus, including:

A receiving unit, configured to receive a panorama shooting instruction that carries information about a panorama shooting mode;

A shooting unit, configured to control a plurality of cameras to shoot a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction;

The stitching unit is configured to stitch the frame images captured by each camera into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information.

A third aspect of the embodiments of the present application provides a terminal including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented:

Receiving a panorama shooting instruction carrying panorama shooting mode information; the panorama shooting mode information includes panorama photo shooting mode information and panorama video shooting mode information;

Controlling a plurality of cameras to respectively capture a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction;

The frame images captured by each camera are stitched into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information.

A fourth aspect of the embodiments of the present application provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the foregoing method.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to explain the technical solution of the embodiments of the present application more clearly, the drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present application, so It should be regarded as a limitation on the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without paying creative work.

FIG. 1 is a schematic flowchart of an implementation of a panoramic shooting method according to an embodiment of the present application; FIG.

FIG. 2 is a schematic flowchart of a specific implementation of step 102 of a panoramic shooting method according to an embodiment of the present application; FIG.

3 is a schematic diagram of selecting a preset target object in a panoramic shooting method according to an embodiment of the present application;

4 is a schematic diagram of a mosaic effect of panoramic photos provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a panoramic shooting device according to an embodiment of the present application; FIG.

FIG. 6 is a schematic structural diagram of a terminal according to an embodiment of the present application.

detailed description

In order to make the purpose, technical solution, and advantages of the present application clearer, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the application, and are not used to limit the application. Meanwhile, in the description of the present application, the terms “first”, “second”, and the like are only used to distinguish descriptions, and cannot be understood to indicate or imply relative importance.

It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude one or more other features , The whole, steps, operations, elements, components, and / or their presence or addition.

It should also be understood that the terminology used in the description of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. As used in this specification and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

It should be further understood that the term "and / or" used in the specification of the application and the appended claims refers to any combination of one or more of the items listed in association and all possible combinations, and includes these combinations .

As used in this specification and the appended claims, the term "if" can be construed as "when" or "once" or "in response to a determination" or "in response to a detection" depending on the context . Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be interpreted, depending on the context, to mean "once determined" or "in response to the determination" or "once [the condition or event described ] "Or" In response to [Description of condition or event] detected ".

At present, when a user uses a mobile phone to perform panoramic shooting, the user needs to rotate the mobile phone around the object to be photographed, and can only take panoramic photos, which has the problem of a single panoramic shooting mode.

In the embodiment of the present application, by receiving a panorama shooting instruction carrying panorama shooting mode information, after acquiring frame images captured by multiple cameras, a panorama photo or a panorama video can be stitched according to a stitching rule corresponding to the panorama shooting mode information. The image solves the single technical problem of the panoramic shooting mode and realizes the diversification of the panoramic shooting mode.

In order to explain the above-mentioned technical solution of the present application, specific embodiments are used for description below.

FIG. 1 shows a schematic flowchart of implementing a panoramic shooting method according to an embodiment of the present application. This method is applied to a terminal and can be executed by a panoramic shooting device configured on the terminal, and is applicable to a situation where a variety of panoramic shooting modes need to be implemented. Including steps 101 to 103.

The terminal includes a terminal device equipped with a photographing device, such as a smart phone, a tablet computer, and a learning machine.

In step 101, a panorama shooting instruction is received that carries information about a panorama shooting mode; the panorama shooting mode information includes panorama photo shooting mode information and panorama video shooting mode information.

In the embodiment of the present application, the above-mentioned panorama shooting instruction includes a panorama shooting instruction triggered by a user clicking a panorama shooting control in a photographing application interface, a panorama shooting instruction triggered by a user using a touch gesture in the photographing application interface, and a panorama shooting instruction triggered by a user through voice. Or trigger the panorama shooting command in other ways.

In step 102, a plurality of cameras are controlled to respectively capture a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction.

In the embodiment of the present application, each camera is responsible for shooting in different areas, and each camera has a corresponding shooting angle, and the shooting areas between adjacent cameras may overlap each other.

Optionally, the sum of the shooting angles of each camera is greater than or equal to 360 °.

In the embodiment of the present application, when each camera is turned on and shooting, a 360 ° panoramic image can be directly obtained, and a 360 ° panoramic image cannot be captured without rotating the camera around the object to be captured once.

In step 103, a frame image captured by each camera is stitched into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the foregoing panoramic shooting mode information.

In the embodiment of the present application, if the panorama shooting mode information carried by the panorama shooting instruction is panorama picture shooting mode information, the frame images captured by each camera are stitched into a panorama picture according to the stitching rule corresponding to the panorama picture shooting mode; The panorama shooting mode information carried in the shooting instruction is the panorama video shooting mode information, and the frame images captured by each camera are stitched into a panorama video image according to the stitching rule corresponding to the panorama video shooting mode.

The stitching of the frame images captured by each camera into a panoramic photo according to the stitching rules corresponding to the panoramic photo shooting mode information includes: directly stitching one of the frame images captured by each camera to obtain a panoramic photo, or separately for each The edge parts of one frame image captured by two cameras are recognized to obtain the same imaging part in the frame image captured by the adjacent camera, and the same imaging part in the frame image captured by the adjacent camera is superimposed and stitched into a panoramic photo. .

For example, when the shooting areas of adjacent cameras are separated from each other and there is no same imaging part, one of the frame images captured by each camera can be directly stitched to obtain a panoramic photo. When the same imaging part exists in the shooting area of the adjacent camera, the edge part of one frame image captured by each camera can be identified separately to obtain the same imaging part in the frame image taken by the adjacent camera, and The same imaging parts in the frame images captured by adjacent cameras are superimposed and stitched into a panoramic photo.

In the embodiment of the present application, a panoramic photo or a panoramic video image is stitched according to a stitching rule corresponding to the foregoing panoramic shooting mode information after receiving a panoramic shooting instruction that carries panoramic shooting mode information, and after obtaining frame images captured by multiple cameras. , So that users can take panoramic photos or panoramic video images according to actual needs, and achieve a variety of panoramic shooting modes.

Optionally, as an embodiment of the present invention, in step 102, controlling a plurality of cameras to respectively capture a frame image corresponding to a shooting angle of the camera according to the panorama shooting instruction may include: controlling the circumference according to the panorama shooting instruction Multiple distributed cameras are sequentially turned on one camera at a time for frame image shooting with a preset number of frames, until all cameras have completed shooting.

For example, the terminal is provided with a plurality of cameras distributed in a circle, and the sum of the shooting angles of each camera is 360 °. When the terminal receives a panoramic shooting instruction that carries the panoramic video shooting mode information, it controls the multiple cameras to press in sequence Control one camera at a time in the clockwise direction or counterclockwise one at a time, and turn the other cameras off until all the cameras are finished shooting, and stitch the frame images captured by each camera to get a panoramic photo or panoramic video image.

In the embodiment of the present application, in the process of realizing the panoramic video image, the user does not need to rotate the camera around the object to be photographed, nor does the camera itself need to rotate, but the cameras are turned on and off one by one to realize the panoramic video image. Shoot automatically.

It should be noted that, in some embodiments of the present application, shooting panoramic photos may also be performed by controlling a plurality of cameras distributed in a circle to sequentially turn on one camera at a time to perform frame images with a preset number of frames, and, Set the interval at which adjacent cameras are turned on. For example, for the panoramic photo shooting of a static scene, there is no need to limit the time interval of turning on the camera. However, for the shooting of panoramic photos of dynamic scenes, in order to avoid the distortion of the panoramic photos due to the movement of the subject, it is necessary to control the opening time interval of the camera.

For another example, the camera shooting time can be controlled by setting different preset frames.

As another embodiment of the present invention, in step 102, controlling a plurality of cameras to respectively capture a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction may further include: controlling a circumference according to the panoramic shooting instruction. Multiple distributed cameras are turned on at the same time and frame image shooting with a preset number of frames is performed.

For example, when the terminal receives a panorama shooting instruction carrying panorama photo shooting mode information, the terminal controls the multiple cameras to be turned on at the same time and performs shooting in a frame image with a preset number of frames.

The above frame image refers to a frame image generated by the camera when the photographing application is in a preview state or a photographing state by collecting an external light signal. The data output by the camera every time it collects external light signals is called frame data. After the user starts the camera application on the terminal, it enters the preview mode. The terminal obtains the preview frame image by acquiring the frame data collected by the camera and displaying it.

Generally, the frame data is collected at a frequency of 30 frames per second, and is generally divided into a preview frame and a photographing frame, which are used for previewing and photographing respectively.

That is, you can control the shooting time of the camera by setting different preset frames. For example, when controlling the camera for panoramic video shooting, you can control the camera to close 60 frames of data and then turn on the next camera for shooting.

The above-mentioned stitching of the frame images captured by each camera into a panoramic video image according to the stitching rules corresponding to the panoramic video shooting mode includes: sequentially turning on one camera at a time to perform preset frames on a plurality of cameras that control the circumferential distribution according to the panoramic shooting instruction After capturing several frame images, until all cameras have finished shooting, the frame images captured by each camera are stitched in sequence according to the shooting time sequence to obtain the panoramic video image.

In the embodiment of the present application, when shooting a panoramic video image, a 360 ° panoramic video image can be taken without rotating the camera around the object to be rotated once. Instead, a plurality of cameras distributed in a circle can be controlled by After turning on one camera at a time to capture a frame image with a preset number of frames, the frame images captured by each camera are stitched in sequence according to the shooting time sequence.

Optionally, in order to realize the preview of the panoramic video image, the frame images captured by each camera are stitched in sequence according to the shooting time sequence, and the panoramic video image may be played after the panoramic video image is obtained.

It should be noted that, in the embodiment of the present application, the panoramic photo refers to a large-angle photo obtained by splicing multiple photos taken by a camera. The panoramic video image refers to a large-view video image obtained by the camera continuously shooting the current scene. The objects photographed in the foregoing panoramic photos and panoramic video images may include all objects within a 360 ° viewing angle range of the terminal, or may include only some objects within a 360 ° viewing angle range of the terminal, for example, may be included only in the terminal 270 All objects within the viewing angle range of °. It is only necessary to ensure that the shooting angle of the photographed object in the panoramic photo and the panoramic video image relative to the terminal position range is greater than one camera.

That is to say, in some embodiments of the present application, the angle of view of the panoramic photo and the panoramic video image may or may not be 360 °. That is, the sum of the shooting angles of each camera may be less than 360 °, for example, the sum of the shooting angles of each camera may be 270 ° or 300 °.

Optionally, as shown in FIG. 2, in some embodiments of the present application, the controlling the camera to take a frame image of a preset number of frames includes steps 201 to 202.

Step 201: Detect whether the first frame image includes a preset target object.

The preset target object may be a target object selected by a user in a preview image in a panoramic shooting state.

For example, when the user faces the scene 31 shown in FIG. 3 and needs to take a panorama shot, the sail image can be selected as a preset target object in the preview image in the panorama shot state.

It should be noted that, in some embodiments of the present application, the preset target object may also be a photographic object directly detected by the terminal. For example, when shooting a person, the preset target object is a person, and when shooting a building, the preset target object is a building. It should be noted that there may be one or more preset target objects in the frame image, and the types of the preset target objects may be one or more.

The above detecting whether the first frame image includes a preset target object includes performing target detection on the first frame image to achieve pixel-level classification of the foreground and background, remove the background, and retain one or more target objects to obtain the above. Preset audience.

In some embodiments of the present application, a preset detection object in the above-mentioned first frame image may also be detected by a target detection algorithm. Common target detection algorithms include a local binary pattern algorithm and a convolutional neural network model.

Step 202: if it is detected that the first frame image contains a preset target object, obtain characteristic information of the preset target object, and adjust the shooting parameters of the opened camera according to the feature information, and obtain the correspondence with the adjusted shooting parameters. Image of the second frame.

In the embodiment of the present application, when controlling a plurality of cameras to respectively capture a frame image corresponding to a shooting angle of the camera, by controlling each camera to shoot a frame image of a preset number of frames, the terminal can achieve real-time acquisition Frame image, and detect the preset target object for the frame image. Then, when the preset target object is detected in the frame image, the camera can be adjusted in time to capture the next frame of frame image according to the characteristic information of the preset target object. Shooting parameters.

For general panoramic shooting, because it does not limit the number of shooting frames of the camera, the camera ends shooting after only shooting one shooting parameter.

Wherein, the feature information of the preset target object refers to feature information for determining what kind of shooting parameters need to be used for shooting.

Optionally, the acquiring the characteristic information of the preset target object and adjusting the shooting parameters of the opened camera according to the characteristic information includes: acquiring position information of the preset target object in the first frame image, and according to the position information Adjust the metering area and focus of the camera that is turned on.

The selection of the metering area is one of the important basis for accurately selecting the shutter and aperture values. The metering system of the camera generally selects the metering area by measuring the brightness of the light reflected from the subject, which is also called reflective metering.

Specifically, the camera generally automatically assumes a reflectance of 18% in the photometric area, and performs photometry through this ratio, and then determines the values of the aperture and shutter.

Under the same lighting conditions, if you want to get the same exposure, the larger the aperture value, the smaller the shutter value, and the smaller the aperture value, the larger the shutter value. The value of 18% is based on the reflection performance of the midtones (gray tones) in natural scenes. If the white tones in the viewfinder are mostly, the reflected light will exceed 18%. If it is a completely white scene, it can reflect about 90%. Incident light, if it is a black scene, the reflectivity may be only a few percent.

The standard gray card is an 8 × 10-inch card. When you place this gray card on the same light source as the subject, the overall reflectance of the light measurement area is 18% of the standard. Then you only need to press the The aperture shutter value is taken, and the photos will be accurately exposed.

If the overall reflectance of the entire metering area is greater than 18%, for example, the background of the metering area is dominated by white. At this time, if you take the aperture shutter value measured by the camera's automatic metering, the photo will be An underexposed photo, the white background will look gray, if it is a white paper, it will become a black paper. Therefore, when shooting a scene with a reflectance greater than 18%, it is necessary to increase the exposure compensation value EV of the camera. Conversely, if you shoot a scene with a reflectance lower than 18%, such as a black background, the photos you take will often be overexposed and the black background will turn gray. Therefore, when shooting scenes with a reflectance below 18%, the EV exposure needs to be reduced.

The current metering methods mainly include central average metering, central partial metering, spot metering, multi-spot metering, and evaluation metering. Among them, the central average photometry is the most commonly used photometry mode. In the embodiment of the present application, the selection of the photometric area is described by using the central average photometry.

Among them, the central average metering mainly considers that ordinary photographers are used to placing the subject, that is, the target object that needs accurate exposure, in the middle of the viewfinder, so this part of the shooting content is the most important. Therefore, the sensory elements responsible for metering will organically separate the overall metering value of the camera. The metering data in the central part occupies most of the proportion, and the metering data outside the center of the screen will assist in metering as a small proportion. . The ratio of the two grid values after weighted average is obtained by the camera processor to obtain the photometric data captured by the camera. For example, the metering of the central part of the camera occupies 75% of the entire metering ratio, and the metering data for other non-central parts that gradually extend to the edge occupy 25%.

It can be seen that, after the position of the target object is determined, the photometric area is selected. For example, the position of the target object is used as the central part of the photometric area.

In addition, the camera focal length is generally selected by the camera emitting a group of infrared rays or other rays, and the distance of the subject is determined after the subject reflects, and then the lens combination is adjusted according to the measured distance to achieve automatic focusing. Therefore, after determining the position of the target object, it is also necessary to obtain the focal length of the photographed frame image.

Optionally, the acquiring the characteristic information of the preset target object and adjusting the shooting parameters of the opened camera according to the characteristic information further includes: acquiring the motion state information of the preset target object, and according to the feature points in the motion state information. The speed of motion is adjusted by turning on the exposure parameters of the camera.

Specifically, the obtaining the movement state information of the preset target object and adjusting the exposure parameter of the opened camera according to the movement speed of the feature points in the movement state information includes: calculating the preset target object feature points in the adjacent first frame image Calculate the average motion speed of the preset target object according to the position change and the acquisition cycle of the first frame image, and obtain a shutter speed and an aperture parameter corresponding to the average motion speed of the preset target object.

For example, the preset target object is a human face. The facial feature points include eye feature points, nose feature points, mouth feature points, and eyebrow feature points. The collection period of the first frame of images is 30 frames / second. Calculate the position change of the eyebrow feature point in the adjacent first frame image to obtain the average movement speed of the human face. By looking up the corresponding list of shutter speed and aperture parameters and the object's movement speed, the shutter of the second frame image can be obtained. Speed and aperture parameters.

In the embodiment of the present application, after obtaining the second frame image corresponding to the adjusted shooting parameters, in order to optimize the display effect of the panoramic photo or the panoramic video image, in the above step 103, the frame image captured by each camera is based on the The stitching rule corresponding to the panorama shooting mode information into a panoramic photo or a panoramic video image may include: stitching the first frame image captured by each camera into a panorama photo or a panoramic video image according to the stitching rule corresponding to the panorama shooting mode information, The second frame image is merged with the panoramic photo or the panoramic video image stitched to obtain a fused panoramic photo or a panoramic video image.

For example, the above terminal includes three cameras, and the user uses the sail in the shooting object as a preset target object. After receiving the panorama shooting instruction carrying the panorama shooting mode information, as shown in FIG. 4, the first camera, the The two cameras and the third camera capture the first frame image 41, the first frame image 42, and the first frame image 43, respectively. At this time, the terminal detects whether the first frame image 43 captured by the third camera includes a preset target object. That is, the sail, at this time, the terminal acquires the feature information such as the position information and the movement status information of the sail, and adjusts the shooting parameters of the third camera according to the feature information, and obtains the second frame corresponding to the adjusted shooting parameters. Image 44.

After acquiring the first frame image and the second frame image, the first frame images 41, 42 and 43 taken by each camera are stitched into a panoramic photo 45, and the second frame image 44 and the stitched into the The panoramic photos 45 are fused to obtain the fused panoramic photos 46.

Comparing the panoramic photo 45 with the panoramic photo 46, it can be seen that the fused panoramic photo 46 makes the display effect of the preset target object sail more prominent, and optimizes the display effect of the panoramic photo.

Optionally, in some implementations of the present application, the above-mentioned detecting whether the first frame image includes a preset target object includes: detecting whether the first frame image includes a target face, and if the first frame image is detected in the first frame image, If a target face is included, it is confirmed that the first frame image includes a preset target object.

For example, for some party scenes, when the user needs to capture a 360 ° indoor panoramic image, in order to optimize the effect of the panoramic image, some party members can be taken as preset target objects to take panoramic photos or panoramic video images that meet user requirements.

Optionally, the above-mentioned stitching of the frame images captured by each camera into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information includes: if the panoramic shooting mode information is the panoramic photo shooting mode information, respectively Filter the frame images of a preset number of frames captured by each camera, and stitch the frame images corresponding to the filtered cameras to obtain a panoramic photo; if the panoramic shooting mode information is panoramic video shooting mode information, then Each frame image captured by each camera is stitched to obtain a panoramic video image.

For example, if the panorama shooting mode information is panorama picture shooting mode information, frame images with the highest brightness, the lowest brightness, or intermediate brightness are selected from the frame images of a preset number of frames captured by each camera to stitch into a panorama photo; Alternatively, when the frame image captured by the camera includes the second frame image described above, the second frame image captured by the camera is fused with the first frame image captured by the camera, and the frame image obtained after the fusion is captured as the camera The panoramic images are stitched together to optimize the display of the panoramic photos.

For example, the frame image obtained by fusing the second frame image 44 and the first frame image 43 in FIG. 4 is used for stitching panoramic photos.

It should be noted that, in the embodiment of the present application, when the first frame image and the second frame image are fused, a preset target object may be separated from the second frame image first to obtain a target object including only the preset target object. The second frame image is superimposed on the position of the preset target object in the first frame image to obtain the fused frame image. That is, the preset target object in the first frame image is replaced with the preset target object in the second frame image.

Specifically, the edges of the preset target objects included in the first frame image and the second frame image may be recognized respectively, and the preset target objects may be separated from the first frame image and the second frame image respectively according to the recognition results. Then, the preset target object in the first frame image is replaced with the preset target object in the second frame image to realize the fusion of the first frame image and the second frame image.

FIG. 5 is a schematic structural diagram of a panoramic photographing apparatus 500 according to an embodiment of the present application, including a receiving unit 501, a photographing unit 502, and a stitching unit 503.

The receiving unit 501 is configured to receive a panorama shooting instruction carrying panorama shooting mode information;

A shooting unit 502, configured to control a plurality of cameras to capture a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction;

The stitching unit 503 is configured to stitch the frame images captured by each camera into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information.

In some embodiments of the present application, the above-mentioned shooting unit 502 is specifically configured to control a plurality of cameras distributed in a circle according to the panoramic shooting instruction to sequentially turn on one camera at a time to perform frame image shooting of a preset number of frames until all cameras All have completed shooting; or, a plurality of circumferentially distributed cameras are controlled to be turned on at the same time according to the panoramic shooting instruction, and frame image shooting with a preset number of frames is performed.

In some embodiments of the present application, the above-mentioned shooting unit 502 is further specifically configured to detect whether the first frame image includes a preset target object when shooting a frame image of a preset number of frames; if the first target image is detected, The frame image includes a preset target object, then obtains the characteristic information of the preset target object, and adjusts the shooting parameters of the opened camera according to the feature information to obtain a second frame image corresponding to the adjusted shooting parameters.

Specifically, the above-mentioned shooting unit 502 is further specifically configured to detect whether a target face is included in the first frame image, and if it is detected that the target frame is included in the first frame image, confirm the first frame The image contains a preset target object.

Optionally, the above-mentioned shooting unit 502 is further specifically configured to obtain position information of the preset target object in the first frame image, and adjust the photometric area and focal length of the camera that is turned on according to the position information; and / Or, acquiring the movement state information of the preset target object, and adjusting the exposure parameter of the opened camera according to the movement speed of the feature point in the movement state information.

Optionally, the above-mentioned stitching unit 503 is further specifically configured to stitch a first frame image captured by each camera into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information, and combine the second The frame image is fused with the panoramic photo or the panoramic video image stitched to obtain a fused panoramic photo or a panoramic video image.

Optionally, the stitching unit 503 is further specifically configured to: when the frame image captured by the camera includes the second frame image, combine the second frame image captured by the camera with the first frame captured by the camera The images are fused, and the frame image obtained after the fusion is used as a frame image taken by the camera to perform panorama photo stitching.

Optionally, the above-mentioned splicing unit 503 is further specifically configured to: if the panoramic shooting mode information is panoramic photo shooting mode information, respectively filter the frame images of a preset number of frames captured by each camera, and filter the filtered The frame images corresponding to each camera are stitched to obtain a panoramic photo; if the panoramic shooting mode information is panoramic video shooting mode information, each frame image captured by each camera is stitched to obtain a panoramic video image.

Optionally, the above-mentioned splicing unit 503 is further specifically configured to filter the frame images with the highest brightness, the lowest brightness, or the intermediate brightness from the frame images of a preset number of frames captured by each camera, and filter each camera after screening Corresponding frame images are stitched to obtain a panoramic photo.

Optionally, the above-mentioned stitching unit 503 is further specifically configured to directly stitch one frame image captured by each camera to obtain a panoramic photo, or separately perform an edge portion of one frame image captured by each camera Recognize to obtain the same imaging part in the frame image captured by the adjacent camera, and superimpose the same imaging part in the frame image captured by the adjacent camera into the panoramic photo.

Optionally, the above-mentioned splicing unit 503 is further specifically configured to sequentially turn on one camera at a time to perform frame image shooting of a preset number of frames in the plurality of cameras that control the circumferential distribution according to the panoramic shooting instruction, until all the cameras complete shooting After that, the frame images captured by each camera are stitched in sequence according to the shooting time sequence to obtain the panoramic video image.

Optionally, the above-mentioned stitching unit 503 is further specifically configured to: after the frame images captured by each camera are stitched in sequence according to the shooting time sequence to obtain the panoramic video image, the panoramic video image is played.

It should be noted that, for the convenience and brevity of the description, for the specific working process of the panoramic photographing apparatus 500 described above, reference may be made to the corresponding process of the method described in FIG. 1 to FIG. 4 above, and details are not described herein again.

As shown in FIG. 6, this application provides a terminal for implementing the foregoing panoramic shooting method. The terminal may be a mobile terminal, and the mobile terminal may be a terminal such as a smart phone, a tablet computer, a personal computer (PC), or a learning machine. It includes: one or more input devices 63 (only one is shown in FIG. 6) and one or more output devices 64 (only one is shown in FIG. 6). The processor 61, the memory 62, the input device 63, the output device 64, and the camera 65 are connected through a bus 66. The camera is used for generating a preview frame image and a photographing frame image according to the collected external light signals.

It should be understood that, in the embodiment of the present application, the processor 61 may be a central processing unit (CPU), and the processor may also be another general-purpose processor or a digital signal processor (DSP). , Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The input device 63 may include a virtual keyboard, a touchpad, a fingerprint sensor (for collecting fingerprint information and orientation information of a user), a microphone, and the like, and the output device 64 may include a display, a speaker, and the like.

The memory 62 may include a read-only memory and a random access memory, and provide instructions and data to the processor 61. A part or all of the memory 62 may further include a non-volatile random access memory. For example, the memory 62 may also store information of a device type.

The memory 62 stores a computer program that can be run on the processor 61. For example, the computer program is a program of a photographing method. When the processor 61 executes the computer program, the steps in the embodiment of the photographing method are implemented, for example, steps 101 to 103 shown in FIG. 1. Alternatively, when the processor 61 executes the computer program, the functions of the modules / units in the foregoing device embodiments are implemented, for example, the functions of the units 501 to 503 shown in FIG. 5.

The computer program may be divided into one or more modules / units. The one or more modules / units are stored in the memory 62 and executed by the processor 61 to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program in the terminal for taking pictures. For example, the above computer program may be divided into a receiving unit, a photographing unit, and a splicing unit, and the specific functions of each unit are as follows: the receiving unit is configured to receive a panorama shooting instruction carrying the panorama shooting mode information; and the photographing unit is used to shoot according to the panorama An instruction controls multiple cameras to shoot frame images corresponding to the shooting angle of the camera; a splicing unit is configured to stitch the frame images captured by each camera into a panoramic photo or a panoramic video according to a stitching rule corresponding to the panoramic shooting mode information image.

Those skilled in the art can clearly understand that, for the convenience and brevity of the description, only the above-mentioned division of functional units and modules is used as an example. In practical applications, the above functions can be allocated by different functional units according to needs. Module completion, that is, dividing the internal structure of the above device into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit. The integrated unit may be hardware. It can be implemented in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application. For specific working processes of the units and modules in the foregoing system, reference may be made to corresponding processes in the foregoing method embodiments, and details are not described herein again.

In the above embodiments, the description of each embodiment has its own emphasis. For a part that is not detailed or recorded in an embodiment, reference may be made to related descriptions of other embodiments.

Those of ordinary skill in the art may realize that the units and algorithm steps of each example described in connection with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed devices / terminals and methods may be implemented in other ways. For example, the device / terminal embodiments described above are only schematic. For example, the division of the above modules or units is only a logical function division. In actual implementation, there may be another division manner, such as multiple units or components. It can be combined or integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, which may be electrical, mechanical or other forms.

The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, which may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each of the units may exist separately physically, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional unit.

When the above integrated modules / units are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, this application implements all or part of the processes in the methods of the above embodiments, and can also be completed by a computer program instructing related hardware. The above computer program can be stored in a computer-readable storage medium. The computer program When executed by a processor, the steps of the foregoing method embodiments may be implemented. The computer program includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file, or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory Random Access Memory (RAM), electric carrier signals, telecommunication signals, and software distribution media. It should be noted that the content contained in the above computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in jurisdictions. For example, in some jurisdictions, computer-readable media do not Including electric carrier signals and telecommunication signals.

The above embodiments are only used to describe the technical solution of the present application, but are not limited thereto. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still apply the foregoing embodiments. The recorded technical solutions are modified, or some of the technical features are equivalently replaced; and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the present invention Within the scope of the application.

Claims (20)

A panoramic shooting method, comprising: Receiving a panorama shooting instruction carrying panorama shooting mode information; the panorama shooting mode information includes panorama photo shooting mode information and panorama video shooting mode information; Controlling a plurality of cameras to respectively capture a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction; The frame images captured by each camera are stitched into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information. The panorama shooting method according to claim 1, wherein the controlling a plurality of cameras to respectively capture a frame image corresponding to a shooting angle of the camera according to the panorama shooting instruction comprises: Control a plurality of cameras distributed in a circle according to the panoramic shooting instruction to sequentially turn on one camera at a time to perform frame image shooting of a preset number of frames until all cameras have completed shooting; or, According to the panoramic shooting instruction, a plurality of circumferentially distributed cameras are controlled to be turned on at the same time and frame image shooting of a preset number of frames is performed. The panorama shooting method according to claim 2, wherein the shooting of a frame image with a preset number of frames comprises: Detecting whether the first frame image contains a preset target object; If it is detected that the first frame image contains a preset target object, obtain characteristic information of the preset target object, and adjust the shooting parameters of the opened camera according to the feature information, and obtain the correspondence with the adjusted shooting parameters. Image of the second frame. The method of claim 3, wherein the detecting whether the first frame image includes a preset target object comprises: Detecting whether the first frame image includes a target face, and if it is detected that the first frame image includes the target face, then confirming that the first frame image includes a preset target object. The panoramic shooting method according to claim 3 or 4, wherein the acquiring feature information of the preset target object and adjusting the shooting parameters of the opened camera according to the feature information comprises: Acquiring position information of the preset target object in the first frame image, and adjusting a photometric area and a focal length of an opened camera according to the position information; and / or, Acquire the motion state information of the preset target object, and adjust the exposure parameter of the opened camera according to the motion speed of the feature point in the motion state information. The panorama shooting method according to claim 3, wherein the stitching the frame images captured by each camera into a panorama photo or a panorama video image according to a stitching rule corresponding to the panorama shooting mode information comprises: Stitching a first frame image captured by each camera into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information, and stitching the second frame image with the panoramic photo or the mosaic image The panoramic video images are fused to obtain a fused panoramic photo or a panoramic video image. The panorama shooting method according to claim 3, wherein the stitching the frame images captured by each camera into a panorama photo or a panorama video image according to a stitching rule corresponding to the panorama shooting mode information comprises: When the frame image captured by the camera includes the second frame image, the second frame image captured by the camera and the first frame image captured by the camera are fused, and the fused frame image is used as The frame images captured by the camera are stitched for panoramic photos. The panorama shooting method according to claim 2, wherein the stitching the frame images captured by each camera into a panorama photo or a panorama video image according to a stitching rule corresponding to the panorama shooting mode information comprises: If the panoramic shooting mode information is panoramic photo shooting mode information, the frame images of a preset number of frames captured by each camera are filtered separately, and the frame images corresponding to the filtered cameras are stitched to obtain a panoramic photo ; If the panoramic shooting mode information is panoramic video shooting mode information, stitching is performed on each frame image captured by each camera to obtain a panoramic video image. The panoramic photographing method according to claim 8, wherein the filtering is performed on the frame images of a preset number of frames captured by each camera, and the frame images corresponding to the filtered cameras are stitched to obtain Panoramic photos including: The frame images with the highest brightness, the lowest brightness, or the intermediate brightness are selected from the frame images of a preset number of frames taken by each camera, and the frame images corresponding to each of the filtered cameras are stitched to obtain a panoramic photo. The panorama shooting method according to claim 1 or 2, wherein the stitching the frame images captured by each camera into a panorama photo according to a stitching rule corresponding to the panorama shooting mode information comprises: Directly stitching one of the frames captured by each camera to obtain a panoramic photo, or, Recognize the edge part of one frame image captured by each camera separately to obtain the same imaging part in the frame image captured by the adjacent camera, and overlap the same imaging part in the frame image captured by the adjacent camera After stitching into the panoramic photo. The panoramic shooting method according to claim 2, wherein, in the plurality of cameras that control the circumferential distribution according to the panoramic shooting instruction, one camera is sequentially turned on at a time to perform frame image shooting of a preset number of frames until all cameras are After shooting, including: The frame images captured by each camera are stitched in sequence according to the shooting time sequence to obtain the panoramic video image. The panorama shooting method according to claim 11, wherein after the frame images captured by each camera are stitched in sequence according to the shooting time sequence to obtain the panorama video image, comprising: Playing the panoramic video image. A panoramic photographing device, comprising: A receiving unit, configured to receive a panorama shooting instruction that carries information about a panorama shooting mode; A shooting unit, configured to control a plurality of cameras to shoot a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction; The stitching unit is configured to stitch the frame images captured by each camera into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information. A terminal includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when the computer program is executed: Receiving a panorama shooting instruction carrying panorama shooting mode information; the panorama shooting mode information includes panorama photo shooting mode information and panorama video shooting mode information; Controlling a plurality of cameras to respectively capture a frame image corresponding to a shooting angle of the camera according to the panoramic shooting instruction; The frame images captured by each camera are stitched into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information. The terminal according to claim 14, wherein when the processor executes the computer program, the following steps are further implemented: Control a plurality of cameras distributed in a circle according to the panoramic shooting instruction to sequentially turn on one camera at a time to perform frame image shooting of a preset number of frames until all cameras have completed shooting; or, According to the panoramic shooting instruction, a plurality of circumferentially distributed cameras are controlled to be turned on at the same time and frame image shooting of a preset number of frames is performed. The terminal according to claim 15, wherein when the processor executes the computer program, the following steps are further implemented: Detecting whether the first frame image contains a preset target object; If it is detected that the first frame image contains a preset target object, obtain characteristic information of the preset target object, and adjust the shooting parameters of the opened camera according to the feature information, and obtain the correspondence with the adjusted shooting parameters. Image of the second frame. The terminal according to claim 16, wherein when the processor executes the computer program, the following steps are further implemented: Detecting whether the first frame image includes a target face, and if it is detected that the first frame image includes the target face, then confirming that the first frame image includes a preset target object. The terminal according to claim 16 or 17, wherein when the processor executes the computer program, the following steps are further implemented: Acquiring position information of the preset target object in the first frame image, and adjusting a photometric area and a focal length of an opened camera according to the position information; and / or, Acquire the motion state information of the preset target object, and adjust the exposure parameter of the opened camera according to the motion speed of the feature point in the motion state information. The terminal according to claim 16, wherein when the processor executes the computer program, the following steps are further implemented: Stitching a first frame image captured by each camera into a panoramic photo or a panoramic video image according to a stitching rule corresponding to the panoramic shooting mode information, and stitching the second frame image with the panoramic photo or the mosaic image The panoramic video images are fused to obtain a fused panoramic photo or a panoramic video image. A computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 12 are implemented.

Images