HK1251748B - Imaging method and device based on dual camera - Google Patents

Description

Dual-camera imaging method and device

Technical Field

The present invention relates to the field of mobile terminal technology, and in particular to an imaging method and device based on dual cameras.

Background Art

Dual cameras have been increasingly used in mobile terminal devices. In the prior art, one of the dual cameras is used to take photos, and the other camera is used to assist in calculating the depth information of the photo for subsequent image blurring processing.

However, after capturing an image, the dual cameras in the related art often use a fixed resolution for subsequent image processing, resulting in relatively simple functions and users being unable to adjust the resolution according to their needs.

Summary of the Invention

The present application aims to solve one of the technical problems in the related art at least to a certain extent.

To this end, the present application proposes an imaging method based on a dual camera, which adjusts the image resolution after shooting by setting the shooting mode, determining the main image resolution and the secondary image resolution.

To achieve the above objectives, the first embodiment of the present application proposes an imaging method based on a dual camera, the method comprising:

Acquire a first image captured by the primary camera, and acquire a second image captured by the secondary camera;

Confirm the selected shooting mode;

Determining a primary image resolution based on the shooting mode and the resolution of the primary camera, and determining a secondary image resolution based on the shooting mode and the resolution of the secondary camera;

generating a main image that meets the main image resolution based on the first image;

generating a secondary image that meets the secondary image resolution based on the second image;

Acquiring depth information of the main image according to the main image and the sub-image;

The main image is blurred according to the depth information of the main image to obtain a desired target image.

In an imaging method based on a dual camera according to an embodiment of the present application, a first image captured by a main camera and a second image captured by a secondary camera are obtained. The main image resolution and the secondary image resolution are determined based on a determined shooting mode and the resolutions of the main camera and the secondary camera, respectively. A main image that meets the main image resolution is generated based on the first image, and a secondary image that meets the secondary image resolution is generated based on the second image. Depth information of the main image is obtained based on the main image and the secondary image, and the main image is blurred to obtain the desired target image. The main image resolution and the secondary image resolution are determined based on the shooting mode and the resolutions of the main and secondary cameras to adjust the image resolution after shooting. This solves the technical problem in the prior art that dual cameras use a fixed resolution for subsequent image processing after shooting, resulting in relatively simple functions and an inability to meet the user's needs to adjust the resolution.

To achieve the above objectives, a second embodiment of the present application provides an imaging device based on a dual camera, the device comprising:

An acquisition module, configured to acquire a first image captured by the primary camera and a second image captured by the secondary camera;

a determination module, configured to determine a selected shooting mode; determine a primary image resolution based on the shooting mode and a resolution of the primary camera, and determine a secondary image resolution based on the shooting mode and a resolution of the secondary camera; wherein the shooting modes include a full-body mode and a half-body mode;

a generating module configured to generate a primary image conforming to the primary image resolution based on the first image; and to generate a secondary image conforming to the secondary image resolution based on the second image;

A depth of field module, configured to obtain depth information of the main image based on the main image and the auxiliary image;

The processing module is used to perform blurring processing on the main image according to the depth information of the main image to obtain the required target image.

In an imaging device based on a dual camera according to an embodiment of the present application, an acquisition module is used to acquire a first image captured by a main camera and a second image captured by a secondary camera; a determination module is used to determine a selected shooting mode, determine the resolution of the main image based on the shooting mode and the resolution of the main camera, and determine the resolution of the secondary image based on the shooting mode and the resolution of the secondary camera; a generation module is used to generate a main image that meets the resolution of the main image based on the first image, and generate a secondary image that meets the resolution of the secondary image based on the second image; a depth of field module is used to acquire depth information of the main image based on the main image and the secondary image; and a processing module is used to blur the main image based on the depth information of the main image to obtain the desired target image. In this embodiment, the main image resolution and the secondary image resolution are determined based on the shooting mode and the resolutions of the main and secondary cameras to achieve adjustment of the image resolution after shooting.

To achieve the above-mentioned purpose, the third aspect embodiment of the present application proposes a mobile terminal, comprising: a dual camera, a memory, a processor, and a computer program stored in the memory and runnable on the processor; when the processor executes the program, it determines the main camera and the secondary camera from the dual cameras, and controls the main camera and the secondary camera to shoot, so as to realize the dual-camera-based imaging method as described in the first aspect.

In order to achieve the above-mentioned objectives, the fourth embodiment of the present application proposes a computer-readable storage medium, which, when executed by a processor, implements the dual-camera-based imaging method as described in the first aspect.

Additional aspects and advantages of the present invention will be set forth in part in the description which follows and, in part, will be obvious from the description which follows, or may be learned through practice of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

FIG1 is a schematic flow chart of an imaging method based on dual cameras provided by an embodiment of the present invention;

Figure 2 is a schematic diagram of the principle of triangulation;

FIG3 is a schematic flow chart of another dual-camera-based imaging method provided by an embodiment of the present invention;

FIG4 is a schematic structural diagram of an imaging device based on dual cameras provided in an embodiment of the present application;

FIG5 is a schematic structural diagram of another dual-camera-based imaging device provided in an embodiment of the present application;

FIG6 is a schematic structural diagram of a terminal device according to another embodiment of the present invention;

FIG. 7 is a schematic diagram of an image processing circuit according to an embodiment.

DETAILED DESCRIPTION

The following describes embodiments of the present invention in detail, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and are not to be construed as limiting the present invention.

The following describes an imaging method and apparatus based on dual cameras according to an embodiment of the present invention with reference to the accompanying drawings.

FIG1 is a schematic flow chart of an imaging method based on dual cameras provided in an embodiment of the present invention.

As shown in FIG1 , the dual-camera-based imaging method includes the following steps:

Step S101: Acquire a first image captured by a main camera, and acquire a second image captured by a secondary camera.

The method of this embodiment is applied to a mobile terminal with a dual camera. For ease of distinction, the dual cameras can be respectively referred to as a first camera and a second camera. Among the first camera and the second camera, one is used as a main camera to obtain a first image for imaging, and the other is used as a secondary camera to obtain a second image for reference calculation of depth of field.

To achieve a better imaging effect, as a possible implementation method, the resolution of the first camera is higher than that of the second camera, and the sensitivity of the second camera is higher than that of the first camera. The main camera and the secondary camera can be selected from the first camera and the second camera according to the shooting scene. Specifically, before obtaining the first image captured by the main camera and the second image captured by the secondary camera, it is necessary to first measure the ambient brightness. Based on the ambient brightness, the main camera and the secondary camera are determined from the dual cameras. Based on the determined main camera and secondary camera, the first image captured for imaging and the second image captured for depth of field calculation are respectively acquired. This process will be described in more detail in subsequent embodiments and will not be repeated in this embodiment.

Step S102: Determine the selected shooting mode.

Specifically, the shooting modes include full-body mode and half-body mode. Full-body mode is suitable for portraits where you need to capture a full-body portrait. When the user selects full-body mode, they will generally frame the shot so that the entire portrait falls within the frame.

Half-body mode is suitable for portraits where you need to capture a portion of a person's body, typically the upper body, including the head and torso. When Half-body mode is selected, users typically frame their shot with only the upper body of the person in the frame.

As a possible implementation method, a control may be provided on the shooting preview interface of the mobile terminal so that the user can select a shooting mode through the control.

Step S103 : determining the resolution of the primary image according to the shooting mode and the resolution of the primary camera, and determining the resolution of the secondary image according to the shooting mode and the resolution of the secondary camera.

Specifically, if the shooting mode is full-body mode, according to the determined resolution of the main camera, the resolution of the main camera is multiplied by the adjustment coefficient corresponding to the full-body mode to obtain the main image resolution; according to the determined resolution of the secondary camera, the resolution of the secondary camera is multiplied by the adjustment coefficient corresponding to the full-body mode to obtain the secondary image resolution.

The adjustment coefficient is used during image resolution adjustment to indicate the ratio of the adjusted resolution to the original resolution. The adjustment coefficient ranges from greater than 1 to between 0 and 1. Specifically, if the adjusted resolution is greater than the original resolution, the adjustment coefficient is greater than 1; if the adjusted resolution is less than the original resolution, the adjustment coefficient is between 0 and 1.

If the shooting mode is half-body mode, according to the determined resolution of the main camera, the resolution of the main camera is multiplied by the adjustment coefficient corresponding to the half-body mode to obtain the main image resolution; according to the determined resolution of the secondary camera, the resolution of the secondary camera is multiplied by the adjustment coefficient corresponding to the half-body mode.

It should be noted that the adjustment coefficient corresponding to the full-body mode is greater than the adjustment coefficient corresponding to the half-body mode.

Step S104: generating a main image that meets the main image resolution based on the first image.

The first image is captured by the main camera. The resolution of the first image is the same as that of the main camera. The resolution of the main image is obtained by multiplying the resolution of the main camera by the adjustment coefficient corresponding to the shooting mode. Therefore, when the adjustment coefficient corresponding to the shooting mode is a positive number less than or equal to 1, the resolution of the first image is greater than or equal to the resolution of the main image. Specifically, if the resolution of the first image is greater than the resolution of the main image, the first image is cropped to obtain a main image that meets the resolution of the main image. If the resolution of the first image is equal to the resolution of the main image, the first image becomes the main image.

Step S105 : generating a secondary image that meets the secondary image resolution based on the second image.

The second image is captured using the secondary camera. Its resolution is the same as the secondary camera's. The secondary image's resolution is obtained by multiplying the secondary camera's resolution by the adjustment coefficient corresponding to the shooting mode. Therefore, if the adjustment coefficient corresponding to the shooting mode is a positive number less than or equal to 1, the second image's resolution is greater than or equal to the secondary image's resolution. Specifically, if the second image's resolution is greater than the secondary image's resolution, the second image is cropped to obtain a secondary image that matches the secondary image's resolution. If the second image's resolution is equal to the secondary image's resolution, the second image serves as the secondary image.

Step S106 : Calculate depth information of the main image based on the main image and the sub-image.

Specifically, since the main image and the secondary image are taken by different cameras respectively, there is a certain distance between the two cameras, resulting in parallax. According to the principle of triangulation, the depth information of the same object in the main image and the secondary image can be calculated, that is, the distance of the object from the plane where the main and secondary cameras are located.

In order to explain this process clearly, the principle of triangulation is briefly introduced below.

In real-world scenarios, the human eye primarily relies on binocular vision to discern the depth of objects. This is similar to the principle behind dual-camera depth resolution. In this embodiment, depth information for the primary image is calculated based on the primary and secondary images, primarily using the principle of triangulation. Figure 2 illustrates this principle.

Based on Figure 2, in real space, the imaging object, the positions of the two cameras _OR and _OT , and the focal planes of the two cameras are drawn. The distance f between the focal plane and the plane where the two cameras are located is , and the two cameras perform imaging at the focal plane position, thereby obtaining two captured images.

P and P' are the positions of the same object in different images. The distance from point P to the left edge of the image is X _R , and the distance from point P' to the left edge of the image is _XT . _OR and _OT are two cameras located on the same plane, separated by a distance B.

Based on the principle of triangulation, the distance Z between the object in Figure 2 and the plane where the two cameras are located has the following relationship:

Based on this, we can deduce that d is the distance difference between the positions of the same object in different captured images. Since B and f are constants, the distance Z of the object can be determined based on d.

Step S107 : blurring the main image according to the depth information of the main image to obtain the desired target image.

Specifically, after calculating the depth information of the primary image, the depth information of each object in the primary image can be used to determine whether the object is foreground or background. Generally speaking, if the depth information indicates that the object is close to the plane of the primary and secondary cameras and the depth value is small, the object can be determined to be foreground; otherwise, the object is background.

The identified background can be blurred to obtain a target image. In the target image, the foreground is more prominent and the background is blurred, presenting an imaging effect of a focused foreground.

In an imaging method based on a dual camera according to an embodiment of the present application, a first image captured by a main camera and a second image captured by a secondary camera are obtained. The main image resolution and the secondary image resolution are determined based on the determined shooting mode and the resolutions of the main camera and the secondary camera, respectively. A main image that meets the main image resolution is generated based on the first image, and a secondary image that meets the secondary image resolution is generated based on the second image. The depth information of the main image is calculated based on the main image and the secondary image, and the main image is blurred to obtain the desired target image. The main image resolution and the secondary image resolution are determined based on the shooting mode and the resolutions of the main and secondary cameras to adjust the image resolution after shooting. This solves the technical problem in the prior art that after shooting, dual cameras use a fixed resolution for subsequent image processing, resulting in relatively simple functions and an inability to meet the user's needs to adjust the resolution.

On the basis of the previous embodiment, in order to more clearly illustrate how to determine the resolution of the main image and the secondary image in different shooting modes, so as to achieve a method that not only ensures the imaging effect but also allows the image resolution to be flexibly adjusted after shooting, the embodiment of the present application provides another possible implementation method of the imaging method based on dual cameras.

FIG3 is a flow chart of another dual-camera-based imaging method provided by an embodiment of the present invention. As shown in FIG3 , the method includes:

Step S301: Determine the main camera and the secondary camera from the dual cameras according to the ambient brightness.

Specifically, as a possible implementation form, an independent light measuring device may be used to measure the brightness of the environment.

As another possible implementation, the automatically adjusted ISO values of the first and second cameras can be read and the ambient brightness determined based on the read ISO values. Generally, the first and second cameras should use the same ISO value, so that the corresponding ambient brightness can be determined using that ISO value. However, if the read ISO values of the first and second cameras are different, the corresponding ambient brightness can be determined based on the average of the two values.

It should be noted that the ISO value is used to indicate the sensitivity of the camera. Commonly used ISO values include 50, 100, 200, 400, 1000, etc. The camera can automatically adjust the ISO value according to the ambient brightness. Therefore, in this embodiment, the ambient brightness can be inferred based on the ISO value. Generally, in sufficient light, the ISO value is 50 or 100, and in insufficient light, the ISO value can be 400 or higher.

The dual camera includes a first camera and a second camera, wherein the resolution of the first camera is higher than that of the second camera, and the sensitivity of the second camera is higher than that of the first camera. For example, the first camera can be a 16-megapixel (MP) camera, and the second camera can be an 8-megapixel (MP) camera.

Specifically, if the ambient brightness is higher than a threshold brightness, the first camera is used as the main camera and the second camera is used as the secondary camera. If the ambient brightness is not higher than the threshold brightness, the second camera is used as the main camera and the first camera is used as the secondary camera.

This is because when the ambient brightness is below the threshold, the light is insufficient. When using a high-resolution camera as the primary camera to take pictures, more noise will appear, resulting in poor imaging quality. Therefore, when the light is insufficient, you can use a high-sensitivity camera as the primary camera to reduce noise in the image and improve the imaging quality.

On the contrary, when the ambient brightness is higher than the threshold brightness and there is sufficient light, the high-resolution camera has a higher resolution, the image is clearer and has less noise. Therefore, the high-resolution camera can be used as the main camera to take pictures, and the high-sensitivity camera can be used as the secondary camera to calculate more accurate depth information, thereby improving the imaging effect.

Step S302: Acquire a first image captured by the main camera, and acquire a second image captured by the secondary camera.

For example, when the ambient brightness is higher than the threshold brightness, the first camera with a resolution of 16MP is used as the main camera to capture the first image with a resolution of 16MP, and the second camera with a resolution of 8MP is used as the secondary camera to capture the second image with a resolution of 8MP.

When the ambient brightness is lower than the threshold brightness, the second camera with a resolution of 8MP is used as the main camera to capture the first image with a resolution of 8MP, and the first camera with a resolution of 16MP is used as the secondary camera to capture the second image with a resolution of 16MP.

Step S303 : Obtain the main image resolution and the sub-image resolution according to the selected shooting mode, the resolution of the main camera, the resolution of the sub-camera, and the adjustment coefficient corresponding to the shooting mode.

Specifically, the shooting modes include full-body mode and half-body mode, wherein the adjustment coefficient corresponding to the full-body mode is greater than the adjustment coefficient corresponding to the half-body mode. As a possible implementation method, the adjustment coefficient corresponding to the full-body mode is 1, and the adjustment coefficient corresponding to the half-body mode is 0.5.

For example, when the user selects full-body shooting mode, if the ambient brightness is higher than the threshold brightness, the main camera resolution is 16MP and the secondary camera resolution is 8MP. After multiplying them by the adjustment factor 1 corresponding to the full-body mode, the main image resolution is 16MP and the secondary image resolution is 8MP. If the ambient brightness is lower than the threshold brightness, the main camera resolution is 8MP and the secondary camera resolution is 16MP. After multiplying them by the adjustment factor 1 corresponding to the full-body mode, the main image resolution is 8MP and the secondary image resolution is 16MP.

When the user selects half-body shooting mode, if the ambient brightness is higher than the threshold brightness, the main camera resolution is 16MP and the secondary camera resolution is 8MP. After multiplying them by the adjustment coefficient of 0.5 corresponding to half-body mode, the resulting main image resolution is 8MP and the secondary image resolution is 4MP. If the ambient brightness is lower than the threshold brightness, the main camera resolution is 8MP and the secondary camera resolution is 16MP. After multiplying them by the adjustment coefficient of 0.5 corresponding to half-body mode, the resulting main image resolution is 4MP and the secondary image resolution is 8MP.

It should be noted that the adjustment coefficients corresponding to the full-body mode and the half-body mode can be set by those skilled in the art according to specific circumstances. This is not specifically limited in this embodiment and will not be elaborated on because the principles are the same.

Step S304: If the resolution of the first image is greater than the resolution of the main image, the first image is cropped to obtain a main image that meets the resolution of the main image.

The target area is the central area of the first image. Since the captured image is distorted on all sides and the image quality of the central area is better, intercepting the central area of the first image as the main image can ensure the imaging quality of the main image.

Specifically, when the ambient brightness is greater than the threshold brightness, the resolution of the first image is 16MP. If the current user selects the full-body mode, the resolution of the main image is 16MP. The resolution of the first image is the same as the resolution of the main image, and there is no need to capture the first image. The first image is directly used as the main image, and the resolution of the main image is 16MP; if the current user selects the half-body mode, the resolution of the main image is 8MP. The resolution of the first image is greater than the resolution of the main image, and the area that meets the main image resolution of 8MP is captured from the central area of the first image as the main image, and the resolution of the main image is 8MP.

When the ambient brightness is less than the threshold brightness, the resolution of the first image is 8MP. If the current user selects the full-body mode, the resolution of the main image is 8MP. If the resolution of the first image is the same as the main image resolution, there is no need to capture from the first image, and the first image is directly used as the main image, and the resolution of the main image is 8MP. If the current user selects the half-body mode, the resolution of the main image is 4MP. If the resolution of the first image 8MP is greater than the resolution of the main image 4MP, an area that meets the main image resolution of 4MP is captured from the central area of the first image as the main image, and the resolution of the main image is 4MP.

Step S305 : If the resolution of the second image is greater than the resolution of the sub-image, the second image is cropped to obtain a sub-image that meets the resolution of the sub-image.

Specifically, when the ambient brightness is greater than the threshold brightness, the resolution of the second image is 8MP. If the current user selects the full-body mode, the resolution of the sub-image is 8MP. The resolution of the second image is the same as the sub-image resolution, and there is no need to capture the second image. The second image is directly used as the sub-image, and the sub-image resolution is 8MP; if the current user selects the half-body mode, the resolution of the sub-image is 4MP. The resolution of the second image is greater than the resolution of the sub-image, and the area that meets the sub-image resolution of 4MP is captured from the central area of the second image as the sub-image, and the resolution of the sub-image is 4MP.

When the ambient brightness is lower than the threshold brightness, the resolution of the second image is 16MP. If the current user selects the full-body mode, the resolution of the secondary image is 16MP. The resolution of the second image is the same as that of the primary image. There is no need to capture from the second image, and the second image is directly used as the secondary image with a resolution of 16MP. If the current user selects the half-body mode, the resolution of the secondary image is 8MP. If the resolution of the second image (16MP) is greater than the resolution of the secondary image (8MP), an area that meets the secondary image resolution of 8MP is captured from the central area of the second image as the secondary image, and the resolution of the secondary image is 8MP.

Step S306: Acquire depth information of the main image according to the main image and the sub-image.

Specifically, the depth information of the main image is determined based on the position deviation of the same object in the main image and the sub-image, and the parameters of the dual cameras.

For the specific calculation process, please refer to the relevant description of step 106 in the above embodiment, which will not be repeated in this embodiment.

Step S307 : blurring the main image according to the depth information of the main image to obtain the desired target image.

Specifically, after calculating the depth information of the primary image, the depth information of each object in the primary image can be used to determine whether the object is foreground or background. Generally speaking, if the depth information indicates that the object is close to the plane of the primary and secondary cameras and the depth value is small, the object can be determined to be foreground; otherwise, the object is background.

The identified background can be blurred to obtain a target image. In the target image, the foreground is more prominent and the background is blurred, presenting an imaging effect of a focused foreground.

Step S308 : If the resolution of the main image is smaller than the resolution of the secondary image, upsample the target image so that the resolution of the upsampled target image meets the resolution of the secondary image.

Specifically, as described in step S303, when the ambient brightness is lower than the threshold brightness, the obtained main image resolution is smaller than the secondary image resolution, and the target image resolution is upsampled, for example, by using interpolation method, and the resolution of the target image obtained after upsampling meets the secondary image resolution.

For example, in full-body mode, the main image resolution is 8MP and the sub-image resolution is 16MP. After blurring the main image, the target image resolution obtained is 8MP. The target image is upsampled to obtain a target image with a resolution of 16MP, that is, the resolution of the upsampled target image meets the sub-image resolution, both of which are 16MP.

This is because, in a dark environment, the second camera with lower resolution and higher sensitivity is selected to obtain the main image. The main image has a lower resolution but good image quality. By upsampling the main image, the image quality in a dark environment is guaranteed and the resolution of the target image is improved, so that the resolution of the target image matches the resolution of the secondary image with a higher resolution.

In an imaging method based on a dual camera according to an embodiment of the present application, a first image captured by a main camera and a second image captured by a secondary camera are obtained. The main image resolution and the secondary image resolution are determined based on the determined shooting mode and the resolutions of the main camera and the secondary camera, respectively. A main image that meets the main image resolution is generated based on the first image, and a secondary image that meets the secondary image resolution is generated based on the second image. The depth information of the main image is calculated based on the main image and the secondary image, and the main image is blurred to obtain the desired target image. The main image resolution and the secondary image resolution are determined based on the shooting mode and the resolutions of the main and secondary cameras to adjust the image resolution after shooting. The full-body mode is full-resolution imaging with a clearer image; the half-body mode is imaging by cropping the central area of the original image, which can reduce the effect of image distortion around the periphery, highlight the subject, and speed up processing. By switching between the two modes, a similar zoom effect can also be achieved.

In order to implement the above embodiment, the present invention also proposes an imaging device based on dual cameras.

Figure 4 is a structural schematic diagram of an imaging device based on dual cameras provided in an embodiment of the present application. As shown in Figure 4, the device includes: an acquisition module 41, a determination module 42, a generation module 43, a depth of field module 44 and a processing module 45.

Acquisition module 41, for acquiring a first image captured by the main camera, and acquiring a second image captured by the secondary camera.

The determination module 42 is used to determine the selected shooting mode, determine the main image resolution based on the shooting mode and the resolution of the main camera, and determine the secondary image resolution based on the shooting mode and the resolution of the secondary camera, wherein the shooting mode includes a full-body mode and a half-body mode.

The generating module 43 is configured to generate a main image that meets the main image resolution based on the first image, and to generate a sub-image that meets the sub-image resolution based on the second image.

The depth of field module 44 is configured to obtain depth information of the main image based on the main image and the sub-image.

The processing module 45 is used to perform blurring processing on the main image according to the depth information of the main image to obtain the desired target image.

It should be noted that the above explanations of the method embodiment are also applicable to the device of this embodiment and will not be repeated here.

In an imaging device based on a dual camera according to an embodiment of the present application, an acquisition module is used to acquire a first image captured by a main camera and a second image captured by a secondary camera. A determination module is used to determine a selected shooting mode, determine the resolution of the main image based on the shooting mode and the resolution of the main camera, and determine the resolution of the secondary image based on the shooting mode and the resolution of the secondary camera. A generation module is used to generate a main image that meets the resolution of the main image based on the first image, and generate a secondary image that meets the resolution of the secondary image based on the second image. A depth of field module is used to acquire depth information of the main image based on the main image and the secondary image. A processing module is used to blur the main image based on the depth information of the main image to obtain a desired target image. In this embodiment, the main image resolution and the secondary image resolution are determined based on the shooting mode and the resolutions of the main and secondary cameras to achieve adjustment of the image resolution after shooting. This solves the technical problem in the prior art that after shooting, dual cameras use a fixed resolution for subsequent image processing, resulting in relatively simple functions and an inability to meet the user's needs to adjust the resolution.

Based on the above embodiments, the present application also proposes a possible implementation method of an imaging device based on a dual camera. Figure 5 is a structural schematic diagram of another imaging device based on a dual camera provided in an embodiment of the present application. As shown in Figure 5, based on the previous embodiment, the device may further include: a switching module 46 and an upsampling module 47.

The switching module 46 is used to: if the ambient brightness is higher than the threshold brightness, use the first camera as the main camera and the second camera as the secondary camera; if the ambient brightness is not higher than the threshold brightness, use the second camera as the main camera and the first camera as the secondary camera.

The upsampling module 47 is configured to upsample the target image if the resolution of the primary image is smaller than the resolution of the secondary image, so that the resolution of the upsampled target image matches the resolution of the secondary image. In one possible implementation of the embodiment of the present application, the determination module 42 may further include a first operation unit 421 and a second operation unit 422.

The first computing unit 421 is configured to obtain the main image resolution according to the resolution of the main camera and the adjustment coefficient corresponding to the shooting mode.

The second computing unit 422 obtains the secondary image resolution according to the resolution of the secondary camera and the adjustment coefficient corresponding to the shooting mode.

Furthermore, in a possible implementation of an embodiment of the present application, the generation module 43 can be specifically used to: if the resolution of the first image is greater than the resolution of the main image, cut out the first image to obtain a main image that meets the resolution of the main image; if the resolution of the second image is greater than the resolution of the secondary image, cut out the second image to obtain a secondary image that meets the resolution of the secondary image.

It should be noted that the above explanations of the method embodiment are also applicable to the device of this embodiment and will not be repeated here.

In an embodiment of the present application, an imaging device based on a dual camera includes an acquisition module for acquiring a first image captured by a primary camera and a second image captured by a secondary camera. A determination module is configured to determine a selected shooting mode and, based on the shooting mode and the resolution of the primary camera, determine the resolution of the primary image, and based on the shooting mode and the resolution of the secondary camera, determine the resolution of the secondary image. A generation module is configured to generate a primary image that matches the primary image resolution based on the first image and a secondary image that matches the secondary image resolution based on the second image. A depth of field module is configured to acquire depth information of the primary image based on the primary and secondary images. A processing module is configured to blur the primary image based on the depth information of the primary image to obtain a desired target image. In this embodiment, the primary and secondary image resolutions are determined based on the shooting mode and the resolutions of the primary and secondary cameras to adjust the image resolution after capture. The full-body mode provides full-resolution imaging for a clearer image, while the half-body mode crops the central portion of the original image for imaging, which can reduce the effects of image distortion around the periphery, highlight the subject, and speed up processing. Switching between the two modes can also achieve a zoom-like effect.

In order to implement the above embodiments, the present invention also proposes a mobile terminal. Figure 6 is a structural schematic diagram of a terminal device according to another embodiment of the present invention. As shown in Figure 6, the terminal device 1000 includes: a shell 1100 and a first camera 1112, a second camera 1113, a memory 1114 and a processor 1115 located in the shell 1100.

Among them, the memory 1114 stores executable program code; the processor 1115 runs the program corresponding to the executable program code by reading the executable program code stored in the memory 1114 to determine the main camera and the secondary camera from the dual cameras, and control the main camera and the secondary camera to shoot, thereby realizing the dual-camera-based imaging method as described in the aforementioned method embodiment.

The resolution of the first camera is higher than that of the second camera, the sensitivity of the second camera is higher than that of the first camera, and the field of view of the first camera and the second camera are the same.

In order to make the first camera have high resolution, a 16MP camera may be used. Of course, other high-resolution cameras may also be used, which is not limited in this embodiment.

At the same time, in order to make the second camera have high sensitivity, an 8MP camera can be used, which has larger pixel particles and good sensitivity. Of course, other high-sensitivity cameras can also be used, which is not limited in this embodiment.

In order to implement the above embodiments, the present invention further proposes a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor of a mobile terminal, implements the imaging method based on dual cameras as in the above embodiments.

The mobile terminal also includes image processing circuitry, which can be implemented using hardware and/or software components and may include various processing units that define the ISP (Image Signal Processing) pipeline. Figure 7 is a schematic diagram of the image processing circuitry in one embodiment. For ease of illustration, Figure 7 only illustrates aspects of image processing technology relevant to embodiments of the present invention.

As shown in FIG7 , the image processing circuitry includes an ISP processor 940 and control logic 950. Image data captured by the imaging device 910 is first processed by the ISP processor 940, which analyzes the image data to capture image statistics that can be used to determine and/or adjust one or more control parameters of the imaging device 910. Specifically, the imaging device 910 may include two cameras, each of which may include one or more lenses 912 and an image sensor 914. The image sensor 914 may include a color filter array (e.g., a Bayer filter) that acquires light intensity and wavelength information captured by each imaging pixel of the image sensor 914 and provides a set of raw image data that can be processed by the ISP processor 940. The sensor 920 may provide the raw image data to the ISP processor 940 based on the interface type of the sensor 920. The sensor 920 interface may utilize a SMPIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of these interfaces.

The ISP processor 940 processes raw image data on a pixel-by-pixel basis in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits. The ISP processor 940 may perform one or more image processing operations on the raw image data and collect statistical information about the image data. The image processing operations may be performed at the same or different bit depths of precision.

The ISP processor 940 may also receive pixel data from the image memory 930. For example, raw pixel data may be sent from the sensor 920 interface to the image memory 930, and the raw pixel data in the image memory 930 may be provided to the ISP processor 940 for processing. The image memory 930 may be part of a memory device, a storage device, or an independent dedicated memory within the electronic device, and may include a DMPA (Direct Memory Access) feature.

Upon receiving raw image data from the sensor 920 interface or from the image memory 930, the ISP processor 940 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to the image memory 930 for further processing before being displayed. The ISP processor 940 receives processed data from the image memory 930 and processes the processed data in the raw domain as well as in the RGB and YCbCr color spaces. The processed image data may be output to the display 970 for user viewing and/or further processing by a graphics engine or GPU (Graphics Processing Unit). Furthermore, the output of the ISP processor 940 may be sent to the image memory 930, from which the display 970 may read image data. In one embodiment, the image memory 930 may be configured to implement one or more frame buffers. Furthermore, the output of the ISP processor 940 may be sent to the encoder/decoder 960 for encoding/decoding image data. The encoded image data may be stored and decompressed before being displayed on the display 970 device. The encoder/decoder 960 may be implemented by a CPU, a GPU, or a coprocessor.

The statistical data determined by the ISP processor 940 may be sent to the control logic 950 unit. For example, the statistical data may include image sensor 914 statistical information such as auto-exposure, auto-white balance, auto-focus, flicker detection, black level compensation, lens 912 shading correction, etc. The control logic 950 may include a processor and/or microcontroller that executes one or more routines (e.g., firmware) that may determine control parameters of the imaging device 910 and control parameters based on the received statistical data. For example, the control parameters may include sensor 920 control parameters (e.g., gain, integration time for exposure control), camera flash control parameters, lens 912 control parameters (e.g., focal length for focus or zoom), or a combination of these parameters. The ISP control parameters may include gain levels and color correction matrices used for auto-white balance and color adjustment (e.g., during RGB processing), as well as lens 912 shading correction parameters.

In the description of this specification, the reference terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" mean that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine different embodiments or examples described in this specification and features of different embodiments or examples without contradiction.

Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic device), a random access memory (RAMP), a read-only memory (ROMP), an erasable and programmable read-only memory (EPROMP or flash memory), a fiber optic device, and a portable compact disc read-only memory (CDROMP). Furthermore, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing it in another suitable manner if necessary, and then storing it in a computer memory.

It should be understood that various parts of the present invention can be implemented using hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

Those skilled in the art will understand that all or part of the steps in the method of the above embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing module, or each unit may exist physically separately, or two or more units may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk, or an optical disk, etc. Although the embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and are not to be construed as limiting the present invention. Persons skilled in the art may make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present invention.

Claims (12)

1. An imaging method based on dual cameras, characterized in that the method includes the following steps: Acquire the first image captured by the main camera, and acquire the second image captured by the secondary camera; Confirm the selected shooting mode; The main image resolution is determined based on the shooting mode and the resolution of the main camera, and the secondary image resolution is determined based on the shooting mode and the resolution of the secondary camera, wherein the shooting mode includes full-body mode and half-body mode. Based on the first image, generate a main image that matches the resolution of the main image; Based on the second image, generate a sub-image that matches the resolution of the sub-image; Based on the main image and the sub-image, obtain the depth information of the main image; Based on the depth information of the main image, the main image is blurred to obtain the desired target image. 2. The imaging method according to claim 1, characterized in that, determining the main image resolution based on the shooting mode and the resolution of the main camera includes: The main image resolution is obtained based on the resolution of the main camera and the adjustment coefficient corresponding to the shooting mode. 3. The imaging method according to claim 1, characterized in that, determining the secondary image resolution based on the shooting mode and the resolution of the secondary camera includes: The resolution of the secondary image is obtained based on the resolution of the secondary camera and the adjustment coefficient corresponding to the shooting mode. 4. The imaging method according to claim 2 or 3, wherein the adjustment coefficient corresponding to the whole-body mode is greater than the adjustment coefficient corresponding to the half-body mode. 5. The imaging method according to claim 1, characterized in that, generating a main image conforming to the resolution of the main image based on the first image includes: If the resolution of the first image is greater than the resolution of the main image, the first image is cropped to obtain a main image that conforms to the resolution of the main image. 6. The imaging method according to claim 1, characterized in that, generating a sub-image conforming to the sub-image resolution based on the second image comprises: If the resolution of the second image is greater than the resolution of the sub-image, the second image is cropped to obtain a sub-image that conforms to the resolution of the sub-image. 7. The imaging method according to claim 1, characterized in that the dual cameras include a first camera and a second camera, the resolution of the first camera is higher than that of the second camera, and the photosensitivity of the second camera is higher than that of the first camera; before acquiring the first image captured by the main camera and the second image captured by the secondary camera, the method further includes: If the ambient brightness is higher than the threshold brightness, the first camera will be used as the main camera and the second camera will be used as the secondary camera. If the ambient brightness is not higher than the threshold brightness, the second camera will be used as the main camera and the first camera will be used as the secondary camera. 8. The imaging method according to any one of claims 1-3, characterized in that, after blurring the main image based on the depth information of the main image to obtain the desired target image, it further includes: If the resolution of the main image is less than the resolution of the secondary image, the target image is upsampled, and the resolution of the upsampled target image matches the resolution of the secondary image. 9. An imaging device based on dual cameras, characterized in that the device comprises: The acquisition module is used to acquire the first image captured by the main camera and the second image captured by the secondary camera; A determining module is used to determine the selected shooting mode; determine the main image resolution based on the shooting mode and the resolution of the main camera, and determine the secondary image resolution based on the shooting mode and the resolution of the secondary camera; wherein, the shooting mode includes full-body mode and half-body mode; A generation module is configured to generate a main image conforming to the resolution of the main image based on the first image; and to generate a sub-image conforming to the resolution of the sub-image based on the second image. A depth-of-field module is used to obtain the depth information of the main image based on the main image and the sub-image; The processing module is used to perform blurring processing on the main image based on the depth information of the main image to obtain the desired target image. 10. A mobile terminal, characterized in that it comprises: dual cameras, a memory, a processor, and a computer program stored in the memory and executable on the processor; when the processor executes the program, it determines a main camera and a secondary camera from the dual cameras and controls the main camera and the secondary camera to take pictures, thereby realizing the dual-camera-based imaging method as described in any one of claims 1-8. 11. The mobile terminal according to claim 10, characterized in that, The dual cameras include a first camera and a second camera. The first camera has a higher resolution than the second camera, the second camera has a higher light sensitivity than the first camera, and the first camera and the second camera have the same field of view. 12. A computer-readable storage medium having a computer program stored thereon, characterized in that, when executed by a processor, the program implements the imaging method based on a dual camera as described in any one of claims 1-8.