CN116567401A - Camera module control method, camera module and electronic device - Google Patents

Abstract

The present disclosure provides a method for controlling a camera module, a camera module, and electronic equipment. The camera module includes at least a first camera and a second camera. and the pixel information in the field of view of the second camera, the field of view of the first camera and the second camera are not on the same plane; for the field of view of the first camera and the second camera Process the pixel information in the target field of view area to obtain the target pixel information of the target field of view area, the target field of view area includes the field of view area of the first camera and/or the second camera; output the target based on the target pixel information Images can obtain high-resolution, high-quality images through low-resolution cameras.

Description

Camera module control method, camera module and electronic device

technical field

The present disclosure relates to the field of computers, and in particular to a camera module control method, camera module and electronic equipment.

Background technique

With the acceleration of the upgrading of electronic products, its various configurations also have the need to upgrade.

The improvement of the pixels of the camera shooting picture can obtain a better quality picture. In the prior art, there is a technique of optimizing image resolution through a supercomputing algorithm, but this technique not only takes up a lot of computing power, but also has the disadvantage of image distortion. Alternatively, the use of high-performance cameras is also limited by process and cost factors, and iterations are slow. Therefore, the progress of the camera in terms of pixel enhancement is slow and the development cycle is long.

Contents of the invention

The disclosure provides a camera module control method, camera module and electronic equipment.

According to a first aspect of the present disclosure, a method for controlling a camera module is provided, the camera module includes at least a first camera and a second camera, and the method includes:

In response to the first image acquisition instruction, acquire pixel information in the field of view areas of the first camera and the second camera, where the field of view areas of the first camera and the second camera are not on the same plane;

Processing pixel information in the field of view areas of the first camera and the second camera to obtain target pixel information of a target field of view area, where the target field of view area includes the first camera and/or the The field of view of the second camera;

outputting a target image based on the target pixel information.

In an implementation of the present application, the acquiring pixel information in the field of view areas of the first camera and the second camera in response to the first image acquisition instruction includes:

determining a target framing object in response to a first image acquisition instruction;

controlling the first camera to acquire the first pixel information of the target framing object in its field of view area in the first plane;

Controlling the second camera to acquire second pixel information of the target viewing object in its field of view area in a second plane; wherein, there is a first angle between the first plane and the second plane.

In an implementation of the present application, the acquiring pixel information in the field of view areas of the first camera and the second camera in response to the first image acquisition instruction includes:

determining a target framing object in response to a first image acquisition instruction;

controlling the first camera to acquire a first image of the target framing object;

controlling the second camera to acquire a second image of the target framing object;

acquiring the pixel information based on the first image and the second image;

Wherein, the pixel information of the target viewing object in the first image is at least partially different from the pixel information in the second image.

In an implementation of the present application, the acquiring pixel information in the field of view areas of the first camera and the second camera in response to the first image acquisition instruction includes:

determining a target framing object based on the first image acquisition instruction, and controlling the first camera to acquire a third image of the target framing object;

controlling the field of view area of the second camera based on the first image acquisition instruction, to acquire a fourth image of the target framing object on the third plane;

acquiring the pixel information based on the third image and the fourth image;

Wherein, the pixel information of the target viewing object in the third image is at least partially different from the pixel information in the fourth image.

In an implementation of the present application, the pixel information in the field of view area of the first camera and the second camera is processed to obtain the target pixel information of the target field of view area, including:

Obtain the first sub-pixel information of the sub-field of view area per unit length of the first camera;

Obtaining second sub-pixel information of the sub-field of view area per unit length of the second camera, where the second sub-pixel information differs from the first sub-pixel information at least in pixel positions;

Perform differential calculation on the first sub-pixel information and the second sub-pixel information to obtain target pixel information in the target field of view area.

In an implementation of the present application, outputting a target image based on the target pixel information includes:

determining position information of each pixel in the target field of view area based on the target pixel information;

The target image is obtained by performing splicing processing on corresponding pixel points in the target field of view area based on the position information.

In an implementation of the present application, it also includes:

Using the pixel information of the second pixel in the field of view of the second camera to compare and verify the first pixel in the field of view of the first camera to determine the target pixel in the field of view of the target, Wherein, the second pixel is a pixel adjacent to the first pixel.

In an implementation of the present application, it also includes:

In response to obtaining the second image capture instruction, adjust the field of view of the first camera and/or the second camera, so as to update the target image based on the adjusted pixel information in the field of view.

According to a second aspect of the present disclosure, a camera module is provided, including:

An acquisition module, configured to acquire pixel information in the field of view areas of the first camera and the second camera in response to the first image acquisition instruction, and the field of view areas of the first camera and the second camera are not in the same plane;

A pixel determination module, configured to process pixel information in the field of view areas of the first camera and the second camera to obtain target pixel information of a target field of view area, where the target field of view area includes the first the field of view area of the camera and/or the second camera;

An image output module, configured to output a target image based on the target pixel information.

In an implementation of the present application, the acquisition module is specifically used for:

determining a target framing object in response to a first image acquisition instruction;

controlling the first camera to acquire the first pixel information of the target framing object in its field of view area in the first plane;

Controlling the second camera to acquire second pixel information of the target viewing object in its field of view area in a second plane; wherein, there is a first angle between the first plane and the second plane.

In an implementation of the present application, the acquisition module is specifically used for:

determining a target framing object in response to a first image acquisition instruction;

controlling the first camera to acquire a first image of the target framing object;

controlling the second camera to acquire a second image of the target framing object;

acquiring the pixel information based on the first image and the second image;

Wherein, the pixel information of the target viewing object in the first image is at least partially different from the pixel information in the second image.

In an implementation of the present application, the acquisition module is specifically used for:

determining a target framing object based on the first image acquisition instruction, and controlling the first camera to acquire a third image of the target framing object;

controlling the field of view area of the second camera based on the first image acquisition instruction, to acquire a fourth image of the target framing object on the third plane;

acquiring the pixel information based on the third image and the fourth image;

Wherein, the pixel information of the target viewing object in the third image is at least partially different from the pixel information in the fourth image.

In an implementation of the present application, the pixel determination module is specifically used for:

Obtain the first sub-pixel information of the sub-field of view area per unit length of the first camera;

Obtaining second sub-pixel information of the sub-field of view area per unit length of the second camera, where the second sub-pixel information differs from the first sub-pixel information at least in pixel positions;

Perform differential calculation on the first sub-pixel information and the second sub-pixel information to obtain target pixel information in the target field of view area.

In an implementation of the present application, the pixel determination module is specifically used for:

determining position information of each pixel in the target field of view area based on the target pixel information;

The target image is obtained by performing splicing processing on corresponding pixel points in the target field of view area based on the position information.

In an implementation of the present application, it also includes:

A verification module, configured to use the pixel information of the second pixel in the field of view of the second camera to compare and verify the first pixel in the field of view of the first camera, so as to determine the pixel information in the field of view of the target. target pixel, wherein the second pixel is a pixel adjacent to the first pixel.

In an implementation of the present application, it also includes:

An adjustment module, configured to adjust the field of view of the first camera and/or the second camera in response to obtaining a second image acquisition instruction, so as to update the target image based on pixel information in the adjusted field of view .

According to a third aspect of the present disclosure, an electronic device is provided, including the camera module and a processor described in the present disclosure, wherein the camera module includes a first camera and a first camera connected to the processor for signal connection. For a second camera, the processor is capable of:

In response to the first image acquisition instruction, acquire pixel information in the field of view areas of the first camera and the second camera, where the field of view areas of the first camera and the second camera are not on the same plane;

Processing pixel information in the field of view areas of the first camera and the second camera to obtain target pixel information of a target field of view area, where the target field of view area includes the first camera and/or the The field of view of the second camera;

outputting a target image based on the target pixel information.

According to a fourth aspect of the present disclosure, there is provided an apparatus comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor, to enable the at least one processor to perform the methods described in the present disclosure.

According to a fifth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the method described in the present disclosure.

In the control method of the camera module of the present disclosure, by responding to the first image acquisition instruction, the pixel information in the field of view of the first camera and the second camera is acquired, and the first camera and the second camera The field of view areas of the cameras are not on the same plane; the pixel information in the field of view areas of the first camera and the second camera is processed to obtain the target pixel information of the target field of view area, and the target field of view area includes all The field of view area of the first camera and/or the second camera; the target image is output based on the target pixel information, and a high-resolution and high-quality image can be obtained through a low-resolution camera.

It should be understood that what is described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description.

Description of drawings

The above and other objects, features and advantages of exemplary embodiments of the present disclosure will become readily understood by reading the following detailed description with reference to the accompanying drawings. In the drawings, several embodiments of the present disclosure are shown by way of illustration and not limitation, in which:

In the drawings, the same or corresponding reference numerals denote the same or corresponding parts.

FIG. 1 shows a schematic flow diagram of a method for controlling a camera module provided by an embodiment of the present disclosure;

FIG. 2 shows a schematic diagram of the implementation flow of step S130 in a method for controlling a camera module provided by an embodiment of the present disclosure;

FIG. 3 shows a schematic flowchart of a target sub-pixel information calculation process provided by an embodiment of the present disclosure;

FIG. 4 shows a schematic structural diagram of a camera module provided by an embodiment of the present disclosure;

FIG. 5 shows a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure;

Fig. 6 shows a schematic diagram of the composition and structure of a device according to an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, features, and advantages of the present disclosure more obvious and understandable, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described The embodiments are only some of the embodiments of the present disclosure, but not all of them. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present disclosure.

FIG. 1 is a flow chart of a method for controlling a camera module provided by an embodiment of the present disclosure. The method may be executed by the camera module provided by an embodiment of the present disclosure. The camera module includes at least a first camera and a second camera. The method specifically includes:

S110. In response to the first image acquisition instruction, acquire pixel information in the field of view areas of the first camera and the second camera, where the field of view areas of the first camera and the second camera are not on the same plane.

Wherein, the first image acquisition instruction may be an instruction for capturing an image generated based on any trigger operation, and the trigger operation may be, for example, opening the camera application, receiving a voice instruction, changing the pose of the camera module, or detecting a target framing object Enter the target monitoring area, etc. The first camera and the second camera may be cameras with the same manufacturer, specification, model and resolution, or different cameras, and are used for shooting. Pixel information may include pixel density, pixel color value, gray scale, and position information.

Specifically, the camera module of this embodiment includes at least two cameras, and such cameras may be embedded in the electronic device, or may be external independent cameras. Since this embodiment uses a low-resolution camera through the camera module, a higher-resolution picture quality can be captured. Therefore, this embodiment needs to obtain different field of view areas without changing any camera structure or replacing any camera optics. By processing different pixel information in the field of view, more different pixel information is derived, thereby generating higher resolution image quality.

For ease of understanding, this embodiment uses two cameras as an example for description. If the first camera and the second camera are two external independent cameras, this embodiment can adjust the position and angle of the two cameras by controlling the pole connected to the cameras, so that the field of view of the first camera and the second camera Regions are not on the same plane. If the first camera and the second camera are two built-in cameras embedded in the electronic device, this embodiment can change the angle of the lens of the camera by designing the mechanical structure inside the camera or using a special type of lens, so that the second The field of view areas of the first camera and the second camera are not on the same plane. For example, the two cameras in this embodiment can be a multi-camera module assembled on the same plane but with an adjustable field of view, and the lenses of the cameras in the camera module can use liquid lenses or optical anti-shake lenses. Therefore, in this embodiment, after receiving the first image acquisition instruction, it only needs to ensure that the field of view areas of the first camera and the second camera are not on the same plane when performing the image acquisition task, and the specific implementation method is not limited.

S120. Process pixel information in the field of view areas of the first camera and the second camera to obtain target pixel information of a target field of view area, where the target field of view area includes the field of view areas of the first camera and/or the second camera.

Wherein, the target field of view area is a field of view area displaying target pixel information, which is determined by the field of view area of the first camera and/or the second camera. The target pixel information includes at least position information and color information of pixels, and is pixel information after processing pixel information in the field of view areas of the first camera and the second camera.

Since the corresponding pixel information of different cameras may be unusable due to equipment, light, etc., the target field of view area in this embodiment may include not only the field of view areas of the first camera and the second camera, but also Only the field of view of the first camera or the second camera is included separately.

Furthermore, since the field of view areas of the first camera and the second camera are not on the same plane, the pixel information in the field of view areas of different cameras is different, for example, there may be positional deviations in the collected pixel information. In this embodiment, differential processing or supercomputing algorithm processing may be performed on pixel information in different viewing field areas to generate more different pixel information, so as to obtain target pixel information in the target viewing field area. Exemplarily, if 4 pixels within the unit length are correspondingly collected in the field of view areas of the first camera and the second camera, by processing the pixel information of the 4 pixel points in the two field of view areas, 8 pixels can be generated pixels.

S130. Output a target image based on the target pixel information.

Wherein, the target image is an image finally used for output display, which can provide a higher resolution and clearer image.

In an embodiment of the present disclosure, outputting the target image based on the target pixel information includes: determining the position information of each pixel in the target field of view area based on the target pixel information; The corresponding pixel points are spliced to obtain the target image.

Since the target pixel information is generated by overlapping pixel information in different field of view areas, with initial position information and processed color information, after obtaining the target pixel information in this embodiment, the target field of view can be The position information and color information of each pixel in the area are integrated.

Specifically, this embodiment can determine the position information of each pixel in the target field of view area after acquiring the target pixel information. Since each pixel has its own color information, this embodiment divides each pixel The points are sorted, and the target image is generated by splicing each pixel point and its corresponding color information.

In this embodiment, pixel information in the field of view areas of the first camera and the second camera is obtained in response to the first image acquisition instruction, and the field of view areas of the first camera and the second camera are not on the same plane; for the first camera and the second camera The pixel information in the field of view area of the second camera is processed to obtain the target pixel information of the target field of view area, and the target field of view area includes the field of view area of the first camera and/or the second camera; outputting a target image based on the target pixel information, This embodiment provides a new type of digital zoom method, which gets rid of the technical barriers of technology and cost limitations in the prior art, and can generate high-resolution images by using multiple low-resolution cameras, significantly improving image quality.

In an optional embodiment, step S120, in response to the first image acquisition instruction, acquiring pixel information in the field of view areas of the first camera and the second camera may include: in response to the first image acquisition instruction, determining the target framing Object; controlling the first camera to acquire the first pixel information of the target framing object in its field of view area in the first plane; controlling the second camera to acquire the second pixel information of the target framing object in its field of view area in the second plane Information, wherein there is a first included angle between the first plane and the second plane.

Wherein, the target framing object may be an object to be photographed, and this embodiment does not limit the specific object of the framing object.

Specifically, the first image acquisition instruction in this embodiment may be an instruction to open the camera application, or an instruction to change the pose of the camera module, or the like. In this embodiment, after receiving the first image acquisition instruction, the target framing object may be focused and determined in response to the first image acquisition instruction.

Specifically, in this embodiment, the first camera and the second camera can be set at different positions, or a lens with an adjustable angle can be included, so that the field of view of the first camera on the first plane and the field of view of the second camera on the second plane The field of view area of has a first included angle. In addition, the applicable scenario of this embodiment is to obtain pixel information directly in the field of view of the camera before taking pictures of the framing object, that is, before obtaining the image of the framing object. Exemplarily, in this embodiment, the first pixel information about the target framing object can be directly obtained within the field of view of the first camera, and the second pixel information about the target framing object can be directly obtained within the field of view of the second camera. pixel information.

In this embodiment, before the image of the framing object is acquired, the pixel information acquired in the field of view areas of different cameras can be directly processed to obtain a higher quality image.

In an optional embodiment, step S120, in response to the first image acquisition instruction, acquires pixel information in the field of view areas of the first camera and the second camera, and further includes: in response to the first image acquisition instruction, determining the target framing object; controlling the first camera to acquire the first image of the target framing object; controlling the second camera to acquire the second image of the target framing object; obtaining pixel information based on the first image and the second image; wherein the target framing object is in the first image The pixel information of is at least partially different from the pixel information in the second image.

Wherein, the first image and the second image are images generated after collecting pixel information about the target viewing object.

Specifically, in this embodiment, the first camera and the second camera may be set at different positions, or include lenses whose angles can be adjusted, so that at least part of the pixel information of the collected images is different. In this embodiment, in response to the first image acquisition instruction, the first camera can be controlled to acquire a first image about the target framing object, and the second camera can be controlled to acquire a second image about the target framing object, respectively through the first image and the second image. image to get pixel information.

In this embodiment, a higher quality image is obtained by collecting the complete first image and the second image, and then collecting pixel information from the first image and the second image for processing.

In an optional embodiment, step S120, in response to the first image acquisition instruction, acquiring pixel information in the field of view areas of the first camera and the second camera, further includes: determining the target framing object based on the first image acquisition instruction, controlling the first camera to acquire a third image of the target framing object; controlling the field of view area of the second camera based on the first image acquisition instruction to acquire a fourth image of the target framing object on the third plane; based on the third image and the fourth The image acquires pixel information; the pixel information of the target viewing object in the third image is at least partially different from the pixel information in the fourth image.

This embodiment can also adjust the lens angle of the second camera according to the category, shape and size of the framing object, the corresponding positional relationship between the camera module and the framing object, thereby controlling the field of view area of the second camera, so that the second camera The field of view area of the first camera matches the field of view area of the first camera best, so as to display an image more suitable for the target framing object.

Specifically, in this embodiment, after the target framing object is determined, the third image of the target framing object may be acquired through the first camera. Then, the distance information between the first camera and the second camera and the viewing object is obtained, and the field angle and/or direction of the field of view of the second camera is adjusted according to the distance information. Then, the fourth image of the target viewfinder on the third plane is acquired by controlling the second camera, and the pixel information is acquired through the third image and the fourth image. Also because the field of view areas of the first camera and the second camera are different, the pixel information in the third image and the fourth image are at least partially different.

Exemplarily, in this embodiment, acquiring the distance information between the first camera and the second camera and the object to be measured may include: determining the distance information between the first camera and the target framing object through an infrared sensor or a depth-of-field camera. In another embodiment, if the camera module is an independent external camera, a binocular camera may also be used to determine the distance information between the first camera and the target framing object.

In this embodiment, the field of view area of the second camera can be adjusted according to the characteristics of the framing object, so that the effect of capturing the target image of the framing object is better.

In an optional embodiment, step S130 is to process the pixel information in the field of view area of the first camera and the second camera to obtain the target pixel information of the target field of view area, as shown in FIG. 2 , including:

S130a. Obtain first sub-pixel information of a sub-field of view area of the first camera on a unit length.

For the convenience of calculation, in this embodiment, when processing the pixel information in the field of view area of each camera, the field of view area can be divided into multiple sub-field of view areas, wherein the size of each sub-field of view area can be the same, or can be different. Exemplarily, in this embodiment, the field of view areas of the first camera and the second camera may be directly divided into multiple corresponding sub-field of view areas according to unit lengths. Alternatively, in this embodiment, an image in the field of view area may be acquired, and the image may be divided into multiple sub-field of view areas. Also in order to simplify the calculation, in this embodiment, the target pixel information in the target field of view area can be transformed into the calculation of sub-pixel information in the sub-field of view area on each unit length.

S130b. Obtain second sub-pixel information of a sub-field of view area of the second camera on a unit length, where the second sub-pixel information differs from the first sub-pixel information at least in pixel positions.

Specifically, in this embodiment, the first sub-pixel information and the second sub-pixel information can be obtained by directly obtaining pixel information in the sub-field of view area, or by obtaining pixel information on the image through pixel points, and obtaining pixel information through pixel points. Subpixel information. Since the field of view areas of the first camera and the second camera are not on the same plane, the first sub-pixel information obtained through the sub-field of view area of the first camera and the second sub-pixel information obtained through the sub-field of view area of the second camera Pixel information will vary in pixel location.

It should be noted that in this embodiment, the sub-field of view areas in the first camera and the second camera may be used as target sub-field of view areas in order to process pixel information in the entire field of view area. In this embodiment, according to requirements, part of the sub-field of view areas in the first camera and the second camera may be used as target sub-field of view areas to process pixel information in part of the field of view areas. Wherein, the target sub-field of view area is a sub-field of view area where pixel information is processed at the current moment, and may be any sub-field of view area.

S130c. Perform differential calculation on the first sub-pixel information and the second sub-pixel information to obtain target pixel information in the target field of view area.

In this embodiment, after the first sub-pixel information and the second sub-pixel information are acquired, a difference operation may be performed, that is, a pixel difference value between the first sub-pixel information and the second sub-pixel information may be calculated. Since the first sub-pixel information and the second sub-pixel information come from the field of view area with different angles, there is a positional deviation between the first sub-pixel information and the second sub-pixel information. This embodiment uses this positional deviation to calculate Pixel information of different color information is obtained by taking the pixel difference value of two sub-pixel information at overlapping positions. The calculated difference is used as target sub-pixel information. Finally, in this embodiment, after calculating the target sub-pixel information of each target sub-field of view area, it may be combined into target pixel information of the target field of view area.

For ease of understanding, this embodiment uses the first camera and the second camera as examples for description. As shown in FIG. 3 , FIG. 3 is a schematic diagram of a target sub-pixel information calculation process provided by an embodiment of the present disclosure. Collecting four pixels within a unit length L at the same position is taken as an example for illustration, including: FIG. 3 ( a), schematic diagram of the first pixel points A, B, C, D collected by the first camera; Fig. 3(b), schematic diagram of the second pixel points E, F, G, H ₁ , H ₂ collected by the second camera; Fig. 3(c) is a schematic diagram of superimposing the pixels collected by two cameras; Fig. 3(d) is a schematic diagram of target sub-pixels 1-8 generated after differential operation.

It should be noted that, for the convenience of illustration and understanding in this embodiment, a blank area is set between the pixel point AD in FIG. 3(a) and the pixel point EG in FIG. Neighboring pixels do not have any meaning. Secondly, the pixel point H is represented by _H1 and _H2 in Fig. 3(b), where _H1 is within the unit length L and _H2 is outside the unit length L. Moreover, in this embodiment, the length after fusion of pixel point AD in FIG. 3(a) and pixel point EH ₂ in FIG. Only the pixels within the unit length L are described.

Specifically, the first pixel point AD in this embodiment includes first pixel information; the second pixel point EH ₁ includes second pixel information, and the target sub-pixel points 1-8 include target sub-pixel information. In addition, the second camera continues to collect 4 pixels on the original unit length L through the angle deviation setting, but due to the position deviation, the pixel points collected at this time deviate from the pixel points collected by the first camera, resulting in Only _H1 part of the pixel H in 3(b) participates in the fusion.

In this embodiment, new pixel information can be obtained in the overlapping area by performing a differential operation on the pixel information of different pixel points collected in the overlapping area, that is, the target sub-pixel in the target sub-field of view area mentioned in the above-mentioned embodiment information.

In the embodiment of the present disclosure, it also includes: using the pixel information of the second pixel in the field of view of the second camera to compare and verify the first pixel in the field of view of the first camera, so as to determine the target view Target pixels in the field area, wherein the second pixel is a pixel adjacent to the first pixel.

Since there may be noise in the first pixel collected in the field of view of the first camera and the second pixel collected in the field of view of the second camera, in this embodiment, the two cameras can The collected pixels are compared and verified.

Specifically, in this embodiment, the first pixel in the field of view of the first camera can be verified through the pixel information of the second pixel in the field of view of the second camera, where the second pixel is the same as the second pixel in the field of view of the second camera. Pixels adjacent to one pixel. Taking FIG. 3 as an example for illustration, the second pixel points E and F can be used to verify the first pixel point B in this embodiment. If the pixel difference between the first pixel point and the second pixel point E and F is greater than the preset value, the first pixel point B can be considered as a noise point, and the pixel point data of point B is deleted, and only the second pixel point collected by the second camera is used. The pixel information of pixel points E and F is used to determine the target sub-pixel information. Alternatively, in this embodiment, the average pixel value of the first pixel point A and the first pixel point C may be calculated as the pixel information of the first pixel point B to replace the original noise.

In addition, in this embodiment, after the first pixel collected by the first camera or the second pixel collected by the second camera is respectively obtained, the surrounding pixels of the own pixel are used for comparative verification to remove noise. For example, still taking the first pixel point B captured by the first camera as an example, this embodiment can calculate the pixel difference between the first pixel point B and the first pixel point A and the first pixel point C, if If the pixel difference values are greater than the preset value, then the first pixel point B can be considered as a noise point, and the pixel point data of point B can be deleted, or the pixel average value of the first pixel point A and the first pixel point C can be calculated as the first pixel point B pixel information.

In addition, in this embodiment, each pixel collected by the first camera and/or the second camera may be verified by using adjacent target sub-pixels of the target sub-field of view. For example, still taking the first pixel point B collected by the first camera as an example for illustration, the first pixel point B can be verified by using the target sub-pixel point 3 and the target sub-pixel point 4 in this embodiment. Specifically, the pixel difference between the first pixel point B and the target sub-pixel point 3 and the target sub-pixel point 4 can also be calculated. If the pixel difference values are greater than the preset value, the first pixel point B can be considered as Noise, and delete the pixel data of point B.

In this embodiment, abnormal noises can be eliminated by using various methods of pixel point comparison and verification, and the image noise problem can be solved efficiently, thereby improving the image quality of the target image.

In the embodiment of the present disclosure, it further includes: in response to obtaining the second image acquisition instruction, adjusting the field of view of the first camera and/or the second camera, so as to update the target image based on the pixel information in the adjusted field of view.

Specifically, in this embodiment, after the target image is determined, the field of view area of the first camera and/or the second camera can be adjusted again, and by adjusting the included angle of multiple lenses, it can reasonably collect more images at the target distance. The effective pixel matrix generates more pixels and improves the resolution. Or the camera module in this embodiment may also include more than two cameras to generate more pixels.

In the prior art, ordinary digital zoom directly enlarges the original pixels, so the problem of image blurring and distortion occurs after focusing. However, the control method of the camera module adopted in this embodiment can not only avoid image The problem of blur and distortion can be solved, and the image resolution can be significantly improved.

Fig. 4 is a schematic structural diagram of a camera module provided by an embodiment of the present disclosure, including:

An acquisition module 410, configured to acquire pixel information in the field of view areas of the first camera and the second camera in response to the first image acquisition instruction, where the field of view areas of the first camera and the second camera are not on the same plane;

A pixel determination module 420, configured to process pixel information in the field of view areas of the first camera and the second camera to obtain target pixel information of the target field of view area, where the target field of view area includes the first camera and/or the second camera field of view area;

An image output module 430, configured to output a target image based on the target pixel information.

In an optional embodiment, the acquisition module 410 is specifically configured to: determine the target framing object in response to the first image acquisition instruction; control the first camera to acquire the first image of the target framing object in its field of view area in the first plane One pixel information; controlling the second camera to obtain second pixel information of the target viewing object in its field of view area in the second plane; wherein, there is a first angle between the first plane and the second plane.

In an optional embodiment, the acquisition module 410 is specifically configured to: determine the target framing object in response to the first image acquisition instruction; control the first camera to acquire the first image of the target framing object; control the second camera to acquire the target framing object the second image; obtaining pixel information based on the first image and the second image; wherein, the pixel information of the target object in the first image is at least partially different from the pixel information in the second image.

In an optional embodiment, the acquisition module 410 is specifically configured to: determine the target framing object based on the first image acquisition instruction, control the first camera to acquire the third image of the target framing object; control the second camera based on the first image acquisition instruction area of the field of view to obtain the fourth image of the target framing object on the third plane; obtain pixel information based on the third image and the fourth image; wherein, the pixel information of the target framing object in the third image and the pixel information in the fourth image The pixel information in is at least partially different.

In an optional embodiment, the pixel determination module 420 is specifically configured to: obtain the first sub-pixel information of the sub-field of view area of the first camera on a unit length; obtain the first sub-pixel information of the second camera on a unit length The second sub-pixel information of the sub-field of view area, the second sub-pixel information is different from the first sub-pixel information at least in the pixel position; for the first sub-pixel information and the second sub-pixel information The differential calculation is performed to obtain the target pixel information of the target field of view area.

In an optional embodiment, the pixel determination module 420 is specifically configured to: determine the position information of each pixel in the target field of view area based on the target pixel information; The corresponding pixel points are spliced to obtain the target image.

In an optional embodiment, it also includes: a verification module, configured to use the pixel information of the second pixel in the field of view of the second camera to compare the first pixel in the field of view of the first camera verifying to determine a target pixel in the target field of view area, wherein the second pixel is a pixel adjacent to the first pixel.

In an optional embodiment, it also includes: an adjustment module, configured to adjust the field of view of the first camera and/or the second camera in response to obtaining the second image acquisition instruction, so as to adjust the field of view based on the adjusted field of view Pixel information updates the target image.

FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. As shown in FIG. 5 , the electronic device 50 includes the aforementioned camera module 51 and a processor 52, wherein the camera module 51 includes a The processor 52 is signal-connected to the first camera and the second camera, and the processor 52 can perform the following operations: in response to the first image acquisition instruction, obtain pixel information in the field of view area of the first camera and the second camera , the field of view areas of the first camera and the second camera are not on the same plane;

Processing the pixel information in the field of view area of the first camera and the second camera to obtain the target pixel information of the target field of view area, where the target field of view area includes the field of view area of the first camera and/or the second camera;

A target image is output based on the target pixel information.

Specifically, the electronic device provided in this embodiment is a device configured with a camera module, and relevant instructions for capturing images can be executed through the camera module.

According to an embodiment of the present disclosure, the present disclosure also provides a device and a readable storage medium, wherein the device is used to run a control method of a camera module.

Fig. 6 shows a schematic block diagram of an example device 600 that may be used to implement embodiments of the present disclosure. The device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. A device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in FIG. 6, the device 600 includes a computing unit 601 that can execute according to a computer program stored in a read-only memory (ROM) 602 or loaded from a storage unit 608 into a random-access memory (RAM) 603. Various appropriate actions and treatments. In the RAM 603, various programs and data necessary for the operation of the device 600 can also be stored. The calculation unit 601 , the ROM 602 and the RAM 603 are connected to each other through a bus 604 . An input/output (I/O) interface 605 is also connected to the bus 604 .

Multiple components in the device 600 are connected to the I/O interface 605, including: an input unit 606, such as a keyboard, a mouse, etc.; an output unit 607, such as various types of displays, speakers, etc.; a storage unit 608, such as a magnetic disk, an optical disk, etc. ; and a communication unit 609, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 609 allows the device 600 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.

The computing unit 601 may be various general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of computing units 601 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The calculation unit 601 executes various methods and processes described above, such as a control method of a camera module. For example, in some embodiments, the method for controlling the camera module can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as the storage unit 608 . In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM 602 and/or the communication unit 609 . When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the method for controlling the camera module described above can be executed. Alternatively, in other embodiments, the computing unit 601 may be configured in any other appropriate manner (for example, by means of firmware) to execute the method for controlling the camera module.

Various implementations of the systems and techniques described herein above can be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), integrated systems on chip (SOC), Complex Programmable Logic Device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.

Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special purpose computer, or other programmable data processing devices, so that the program codes, when executed by the processor or controller, make the functions/functions specified in the flow diagrams and/or block diagrams Action is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

To provide for interaction with the user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user. ); and a keyboard and pointing device (eg, a mouse or a trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and can be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.

The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN) and the Internet.

A computer system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, a server of a distributed system, or a server combined with a blockchain.

It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, each step described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in the present disclosure can be achieved, no limitation is imposed herein.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present disclosure, "plurality" means two or more, unless otherwise specifically defined.

The above is only a specific implementation of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope of the present disclosure. should fall within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be determined by the protection scope of the claims.

Claims (10)

1. A control method of a camera module, the camera module at least comprising a first camera and a second camera, the method comprising:

acquiring pixel information in the field of view areas of the first camera and the second camera in response to a first image acquisition instruction, wherein the field of view areas of the first camera and the second camera are not in the same plane;

processing pixel information in the view field areas of the first camera and the second camera to obtain target pixel information of a target view field area, wherein the target view field area comprises view field areas of the first camera and/or the second camera;

outputting a target image based on the target pixel information.

2. The method of claim 1, the acquiring pixel information within the view field region of the first camera and the second camera in response to a first image acquisition instruction, comprising:

determining a target framing object in response to the first image acquisition instruction;

controlling the first camera to acquire first pixel information of the target framing object of a field of view area in a first plane;

controlling the second camera to acquire second pixel information of the target framing object of the field-of-view area in a second plane;

The first plane and the second plane are provided with a first included angle.

3. The method of claim 1, the acquiring pixel information within the view field region of the first camera and the second camera in response to a first image acquisition instruction, comprising:

determining a target framing object in response to the first image acquisition instruction;

controlling the first camera to acquire a first image of the target view finding object;

controlling the second camera to acquire a second image of the target view finding object;

acquiring the pixel information based on the first image and the second image;

wherein the pixel information of the target viewing object in the first image and the pixel information in the second image are at least partially different.

4. The method of claim 1, the acquiring pixel information within the view field region of the first camera and the second camera in response to a first image acquisition instruction, comprising:

determining a target view finding object based on the first image acquisition instruction, and controlling the first camera to acquire a third image of the target view finding object;

controlling a field of view area of the second camera based on the first image acquisition instruction to acquire a fourth image of the target viewfinder object on a third plane;

Acquiring the pixel information based on the third image and the fourth image;

wherein the pixel information of the target viewing object in the third image and the pixel information in the fourth image are at least partially different.

5. The method of claim 1, wherein processing pixel information in the view field regions of the first camera and the second camera to obtain target pixel information for a target view field region comprises:

acquiring first sub-pixel information of a sub-field area of the first camera in unit length;

obtaining second sub-pixel information of a sub-field area of the second camera in unit length, wherein the second sub-pixel information and the first sub-pixel information are different at least in pixel position;

and carrying out differential calculation on the first sub-pixel information and the second sub-pixel information to obtain target pixel information of a target view field area.

6. The method of claim 1 or 5, wherein outputting a target image based on the target pixel information comprises:

determining the position information of each pixel point in the target view field area based on the target pixel information;

and performing stitching processing on the corresponding pixel points in the target view field area based on the position information to obtain the target image.

7. The method of claim 1 or 5, further comprising:

and comparing and verifying the first pixel point in the view field area of the first camera by using the pixel information of the second pixel point in the view field area of the second camera to determine a target pixel point in the target view field area, wherein the second pixel point is a pixel point adjacent to the first pixel point.

8. The method of claim 1, further comprising:

and in response to obtaining a second image acquisition instruction, adjusting a field of view area of the first camera and/or the second camera to update the target image based on pixel information in the adjusted field of view area.

9. A camera module, comprising:

the acquisition module is used for responding to a first image acquisition instruction and acquiring pixel information in the field-of-view areas of the first camera and the second camera, wherein the field-of-view areas of the first camera and the second camera are not in the same plane;

the pixel determining module is used for processing the pixel information in the view field areas of the first camera and the second camera to obtain target pixel information of a target view field area, wherein the target view field area comprises the view field areas of the first camera and/or the second camera;

And the image output module is used for outputting a target image based on the target pixel information.

10. The electronic equipment comprises a camera module and a processor, wherein the camera module comprises a first camera and a second camera which are in signal connection with the processor, and the processor can execute the following operations:

acquiring pixel information in the field of view areas of the first camera and the second camera in response to a first image acquisition instruction, wherein the field of view areas of the first camera and the second camera are not in the same plane;

processing pixel information in the view field areas of the first camera and the second camera to obtain target pixel information of a target view field area, wherein the target view field area comprises view field areas of the first camera and/or the second camera;

outputting a target image based on the target pixel information.