TWI893110B - Mobile terminal, image acquisition method, and computer-readable storage medium - Google Patents

Abstract

A mobile terminal, an image acquisition method, and a computer-readable storage medium. The mobile terminal includes a housing, a display device, and a movable member, wherein the display device is mounted on the housing. The movable member includes a bracket and an imaging device mounted on the bracket, and the movable member is capable of moving relative to the housing. The imaging device can be in a first imaging mode or a second imaging mode. In the first imaging mode, the bracket moves to cause the imaging device to emerge from the housing and perform imaging. In the second imaging mode, the imaging device is located within the housing and receives light that passes through the display device to perform imaging.

Description

Mobile terminal, image acquisition method, and computer-readable storage medium

This application relates to the field of consumer electronic technology, and more particularly to a mobile terminal, an image acquisition method, and a computer-readable storage medium.

Some mobile phones are equipped with a movable camera. When the camera is needed to take a picture, the camera is exposed from the main body of the mobile phone for taking a picture. When the camera is not needed to take a picture, the camera is hidden inside the main body of the mobile phone.

The embodiments of this application provide a mobile terminal, an image acquisition method, and a computer-readable storage medium.

The mobile terminal of the embodiment of the present application includes a housing, a display device and a movable part, wherein the display device is mounted on the housing; the movable part includes a bracket and an imaging device mounted on the bracket, and the movable part can move relative to the housing; the imaging device can be in a first imaging mode or a second imaging mode. In the first imaging mode, the bracket moves to drive the imaging device to emerge from the housing and perform imaging; in the second imaging mode, the imaging device is located in the housing and receives light passing through the display device to perform imaging.

The present application also provides an image acquisition method, which is used for a mobile terminal. The mobile terminal includes a housing and a movable part capable of moving relative to the housing, the movable part including a bracket and an imaging device mounted on the bracket. The image acquisition method includes: controlling the bracket to move to drive the imaging device out of the housing and controlling the imaging device to perform imaging based on a first instruction; and controlling the imaging device to receive light passing through a display device to perform imaging based on a second instruction.

The present application also provides a mobile terminal, which includes a housing, a display device and a movable part, wherein the display device is mounted on the housing; the movable part includes a bracket and an imaging device mounted on the bracket, and the movable part is capable of moving relative to the housing; when the imaging device is turned on, if the imaging device has been driven by the bracket to emerge from the housing, the imaging device outputs a first image; when the imaging device is turned on, if the imaging device is located in the housing, the imaging device receives light passing through the display device to output a second image.

The present application also provides a non-volatile computer-readable storage medium, which contains computer-executable instructions. When the computer-executable instructions are executed by one or more processors, the processors execute the image acquisition method of the embodiment of the present application. The image acquisition method is used in a mobile terminal, which includes a housing and a movable part that can move relative to the housing. The movable part includes a bracket and an imaging device mounted on the bracket. The image acquisition method includes: according to a first instruction, controlling the movement of the bracket to drive the imaging device to emerge from the housing, and controlling the imaging device to perform imaging; and according to a second instruction, controlling the imaging device to receive light passing through a display device to perform imaging.

In the mobile terminal, image acquisition method, and readable storage medium of the embodiments of this application, the imaging device can perform imaging when exposed from the housing, and the imaging device can also receive light passing through the display device to perform imaging when inside the housing, thereby enriching the applicable scenarios of the imaging device and improving the user experience of using the imaging device for imaging.

Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become obvious from the description below, or will be understood through practice of the embodiments of the present application.

The following further describes the embodiments of the present application with reference to the accompanying drawings. The same or similar symbols throughout the drawings represent the same or similar elements or elements having the same or similar functions.

In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary and are only used to explain the embodiments of the present application and should not be construed as limiting the present application.

The present application provides a mobile terminal, which includes a housing, a display device and a movable part, wherein the display device is mounted on the housing; the movable part includes a bracket and an imaging device mounted on the bracket, and the movable part can move relative to the housing; the imaging device can be in a first imaging mode or a second imaging mode. In the first imaging mode, the bracket moves to drive the imaging device to emerge from the housing and perform imaging; in the second imaging mode, the imaging device is located in the housing and receives light passing through the display device to perform imaging.

In some embodiments, in the first imaging mode, the imaging device is used to output a first image of a first number of pixels; in the second imaging mode, the imaging device is used to output a second image of a second number of pixels; the second number is less than the first number.

In some embodiments, the imaging device includes an image sensor, the image sensor includes a photosensitive unit array, the photosensitive unit array includes multiple minimum repeating units, and each of the minimum repeating units includes multiple photosensitive units; in the first imaging mode, the imaging device outputs the pixel value of a pixel of the first image based on the signal value of one of the photosensitive units; in the second imaging mode, the imaging device outputs the pixel value of a pixel of the second image based on the signal value of one of the minimum repeating units.

In some embodiments, the minimum repeating unit is 4 photosensitive units in 2 rows and 2 columns, and the arrangement of the photosensitive units in the same minimum repeating unit is:

R  G

G  B

Among them, R represents the red photosensitive unit; G represents the green photosensitive unit; and B represents the blue photosensitive unit.

In some embodiments, the minimum repeating unit includes at least one full-color photosensitive unit.

In some embodiments, the minimum repeating unit is 4 photosensitive units in 2 rows and 2 columns, and the arrangement of the photosensitive units in the same minimum repeating unit is:

R  W

G  B

Among them, W represents the full-color photosensitive unit; R represents the red photosensitive unit; G represents the green photosensitive unit; and B represents the blue photosensitive unit.

In some embodiments, the ratio of the second amount to the first amount is 1:4; or the ratio of the second amount to the first amount is 1:16.

In some embodiments, the first image is a color image; and/or the second image is a black and white image.

In some embodiments, upon receiving a selfie instruction, the imaging device can be in a first imaging mode for imaging; and/or upon receiving an identity verification instruction, the imaging device can be in a second imaging mode for imaging.

In some embodiments, the mobile terminal further includes a distance detection device, which is used to detect whether there is any obstruction in the process of the imaging device being exposed from the housing; when there is any obstruction in the process of the imaging device being exposed from the housing, the imaging device can be in a second imaging mode to perform imaging.

In some embodiments, the movable member is movable relative to the housing; and/or the movable member is rotatable relative to the housing.

The present application provides an image acquisition method for a mobile terminal. The mobile terminal includes a housing and a movable part capable of moving relative to the housing. The movable part includes a bracket and an imaging device mounted on the bracket. The image acquisition method includes: controlling the bracket to move to drive the imaging device out of the housing and controlling the imaging device to perform imaging based on a first instruction; and controlling the imaging device to receive light passing through a display device to perform imaging based on a second instruction.

In some embodiments, controlling the imaging device to perform imaging in accordance with the first instruction includes: controlling the imaging device to output a first image with a first number of pixels in accordance with the first instruction; and controlling the imaging device to receive light passing through the display device for imaging in accordance with the second instruction includes: controlling the imaging device to output a second image with a second number of pixels in accordance with the second instruction, wherein the second number is less than the first number.

In some embodiments, the imaging device includes an image sensor, the image sensor includes a photosensitive unit array, the photosensitive unit array includes multiple minimum repeating units, and each of the minimum repeating units includes multiple photosensitive units; controlling the imaging device to output a first image of a first number of pixels in accordance with a first instruction includes: controlling the imaging device to output the pixel value of a pixel of the first image in accordance with the first instruction in accordance with the signal value of one of the photosensitive units; controlling the imaging device to output a second image of a second number of pixels in accordance with a second instruction includes: controlling the imaging device to output the pixel value of a pixel of the second image in accordance with the second instruction in accordance with the signal value of one of the minimum repeating units.

In some embodiments, the minimum repeating unit includes at least one full-color photosensitive unit.

In some embodiments, the ratio of the second amount to the first amount is 1:4; or the ratio of the second amount to the first amount is 1:16.

In some embodiments, the first image is a color image; and/or the second image is a black and white image.

In some embodiments, the first instruction includes a selfie instruction; and/or the second instruction includes an identity verification instruction.

In some embodiments, the image acquisition method further includes: detecting whether there is any obstruction in the process of the imaging device being exposed from the housing; and when there is any obstruction in the process of the imaging device being exposed from the housing, controlling the imaging device to receive light passing through the display device for imaging.

The present application embodiment also provides another mobile terminal, which includes a housing, a display device and a movable part, wherein the display device is mounted on the housing; the movable part includes a bracket and an imaging device mounted on the bracket, and the movable part can move relative to the housing; when the imaging device is turned on, if the imaging device has been driven by the bracket to emerge from the housing, the imaging device outputs a first image; when the imaging device is turned on, if the imaging device is located in the housing, the imaging device receives light passing through the display device to output a second image.

The following is a further explanation of the implementation of this application with reference to the accompanying drawings.

Referring to Figures 1a and 1b , a mobile terminal 100 according to an embodiment of the present application includes a housing 10, a display device 20, and a movable member 30. The mobile terminal 100 may be a mobile phone, a tablet computer, a laptop computer, a game console, a smart watch, a smart display, a head-mounted display (HMD), smart glasses, etc. While this application uses a mobile phone as an example for illustrative purposes, it should be understood that the specific form of the mobile terminal 100 is not limited to a mobile phone.

The housing 10 may be the outer shell of the mobile terminal 100, comprising a middle frame, a front housing, and a rear cover. The housing 10 may serve as a mounting carrier for the functional components of the mobile terminal 100, such as the display device 20, the movable element 30, and a power supply device, thereby making the structure of the mobile terminal 100 more compact.

The display device 20 can be used to display images, text, videos, and other information for the user to view. The user can also perform touch operations on the display device 20 to input commands to the mobile terminal 100. The display device 20 can be specifically an organic self-luminous display screen, a liquid crystal display screen, a micro LED display screen, etc.

The display device 20 is mounted on the housing 10. Specifically, the display device 20 can be mounted on the front of the housing 10 as a front display device, or the display device 20 can be mounted on the back of the housing 10 as a rear display device, or the display device 20 can be mounted on the side of the housing 10 as a side display device, or the display device 20 includes both a front display device and a rear display device, or the display device 20 can switch between the front display device and the rear display device, etc., without limitation herein.

The movable member 30 is movably mounted on the housing 10, that is, the movable member 30 is capable of moving relative to the housing 10. Specifically, the movable member 30 can be mounted at any location on the top, bottom, or side of the housing 10. A drive member can also be mounted within the housing 10 to drive the movable member 30 relative to the housing 10.

In the examples shown in Figures 1a and 1b, the movable member 30 is capable of rotating relative to the housing 10. In the state shown in Figure 1a, the movable member 30 is exposed from the housing 10. At this point, the movable member 30 can rotate relative to the housing 10 to switch to the state shown in Figure 1b, where the movable member 30 is concealed within the housing 10. Of course, when the movable member 30 and the housing 10 are in the state shown in Figure 1b, the movable member 30 can rotate relative to the housing 10 to switch to the state shown in Figure 1a.

In the examples shown in Figures 2a and 2b, the movable member 30 is movable relative to the housing 10. In the state shown in Figure 2a, the movable member 30 is exposed from the housing 10. At this point, the movable member 30 can be moved relative to the housing 10 to switch to the state shown in Figure 2b, where the movable member 30 is concealed within the housing 10. Of course, when the movable member 30 and the housing 10 are in the state shown in Figure 2b, the movable member 30 can be moved relative to the housing 10 to switch to the state shown in Figure 2a.

Continuing to refer to FIG. 1 a and FIG. 1 b , the movable member 30 includes a bracket 31 and an imaging device 32 mounted on the bracket 31 .

The bracket 31 can be movably connected to the housing 10, for example, the bracket 31 can rotate relative to the housing 10, or the bracket 31 can move relative to the housing 10. The driving member can drive the entire movable member 30 to move by driving the bracket 31 to move.

The bracket 31 serves as a mounting support for the imaging device 32. Movement of the bracket 31 drives the imaging device 32 in motion. Other functional components, such as a depth camera, flash, proximity sensor, or receiver, can also be mounted on the bracket 31. When one of these functional components is needed, the bracket 31 can be controlled to move, causing the functional component to emerge from the housing 10.

The imaging device 32 is mounted on the bracket 31. The imaging device 32 and the bracket 31 can be fixed relative to each other to prevent the imaging device 32 from shaking during imaging. For example, the imaging device 32 can be secured to the bracket 31 using clips, glue, screws, etc. The number of imaging devices 32 mounted on the bracket 31 can be one or more, such as two or three, without limitation.

As the bracket 31 and housing 10 move relative to each other, the bracket 31 can move the imaging device 32, thereby changing the positional relationship between the imaging device 32, the housing 10, and the display device 20. In the positions shown in Figures 1a and 2a, the imaging device 32 is exposed from the housing 10. In the positions shown in Figures 1b and 2b, the imaging device 32 is located within the housing 10 and below the display device 20.

3a and 3b, the imaging device 32 includes a lens assembly 321 and an image sensor 322. When the imaging device 32 is imaging, light passes through the lens assembly 321 and reaches the image sensor 322.

The lens assembly 321 may be an optical element composed of at least one lens, which may be a concave lens or a convex lens. After passing through the lens assembly 321, light may be focused on the image sensor 322 so that the image sensor 322 can generate a clear image.

The image sensor 322 is used to convert the light signal irradiated to the image sensor 322 into an electrical signal so that an image can be obtained by using the signal value of the electrical signal through image processing.

4 , the image sensor 322 includes a photosensitive cell array 50. The photosensitive cell array 50 is composed of a plurality of photosensitive cells arranged in an array, wherein the photosensitive cells can be composed of components such as filters, micro lenses, and photodiodes.

A photosensitive cell can convert a light signal of a specific color that strikes the photosensitive cell into an electrical signal, and the strength of the electrical signal can reflect the strength of the light signal of that specific color. For example, in Figure 4, the R photosensitive cell represents a red photosensitive cell, which can convert red light into an electrical signal; the G photosensitive cell represents a green photosensitive cell, which can convert green light into an electrical signal; and the B photosensitive cell represents a blue photosensitive cell, which can convert blue light into an electrical signal. Of course, other types of photosensitive cells can also be used to convert other types of light into electrical signals, and this is not a limitation. For example, in Figure 5, the W photosensitive cell represents a full-color photosensitive cell, which can convert light in the visible light band into an electrical signal.

Photosensitive cell array 50 includes multiple minimum repeating cells 51. Photosensitive cell array 50 can be considered as multiple minimum repeating cells 51 arranged in an array. Minimum repeating cell 51 is composed of multiple photosensitive cells. For example, minimum repeating cell 51 can include four photosensitive cells, eight photosensitive cells, sixteen photosensitive cells, etc.

For example, in the example shown in FIG4 , the minimum repeating unit 51 is 2 rows and 2 columns of 4 photosensitive units. The arrangement of the photosensitive units in the same minimum repeating unit 51 is:

R  G

G  B

Here, R represents a red photosensitive cell, G represents a green photosensitive cell, and B represents a blue photosensitive cell. The arrangement of the photosensitive cells in the minimum repeating cell 51 shown in Figure 4 can also be referred to as a Bayer array. The minimum repeating cells 51 arranged in a Bayer array closely resemble the human eye's perception of ambient light, resulting in superior imaging quality.

For example, the minimum repeating unit 51 includes at least one panchromatic photosensitive unit. For example, one-quarter of the photosensitive units in the minimum repeating unit 51 may be panchromatic photosensitive units, one-half of the photosensitive units in the minimum repeating unit 51 may be panchromatic photosensitive units, or one-eighth of the photosensitive units in the minimum repeating unit 51 may be panchromatic photosensitive units. Because the spectral effect of panchromatic photosensitive units is wider than that of monochromatic photosensitive units (e.g., red photosensitive units, green photosensitive units, and blue photosensitive units), panchromatic photosensitive units can obtain stronger light signals under the same light intensity, allowing the photosensitive unit array 50 to obtain more scene details even in low-light environments.

For example, in the example shown in FIG5 , the minimum repeating unit 51 is 2 rows and 2 columns with 4 photosensitive units. The arrangement of the photosensitive units in the same minimum repeating unit 51 is:

R  W

G  B

Here, W represents a full-color photosensitive unit, R represents a red photosensitive unit, G represents a green photosensitive unit, and B represents a blue photosensitive unit. Of course, the specific arrangement of the minimum repeating unit 51 including the full-color photosensitive unit can be other and is not limited to the above example.

The following describes how to use the imaging device 32 to perform imaging:

The imaging device 32 can be in a first imaging mode or a second imaging mode.

In the first imaging mode, the bracket 31 moves to drive the imaging device 32 out of the housing 10 and perform imaging. Specifically, as shown in Figures 1a, 2a, and 3a, the imaging device 32 is exposed from the housing 10, allowing it to directly receive external light for imaging. Because the imaging device 32 is not obstructed by other components of the mobile terminal 100 in the first imaging mode, it receives more light. The resulting images in this mode are of higher quality, meeting the user's expectations for high-quality imaging.

In the second imaging mode, the imaging device 32 is located within the housing 10 and receives light that has passed through the display device 20 to generate an image. Specifically, as shown in Figures 1b, 2b, and 3b, the imaging device 32 is located within the housing 10 and receives light that has passed through the display device 20 to generate an image. This eliminates the need to first control the movement of the movable member 30 to expose the imaging device 32 from the housing 10. This allows the imaging device 32 to quickly capture an image of the scene, reducing user waiting time. For example, when a user needs to perform facial recognition to unlock the mobile terminal 100, the user does not need to wait for the imaging device 32 to emerge from the housing 10. Instead, the second imaging mode can be used to generate an image and perform facial recognition, reducing user waiting time and improving the user experience.

In the related existing technology, when the imaging device needs to take an image, the imaging device must be exposed from the housing. Driving the imaging device out of the housing inevitably takes a certain amount of time. The user needs to wait for the imaging device to emerge from the housing before taking a picture, which reduces the user experience.

In the mobile terminal 100 of the embodiment of the present application, the imaging device 32 can perform imaging when it is exposed from the housing 10 (i.e., imaging in a first imaging mode), and the imaging device 32 can also receive light passing through the display device 20 for imaging when it is inside the housing 10 (i.e., imaging in a second imaging mode), thereby enriching the applicable scenarios of the imaging device 32 and improving the user experience of using the imaging device 32 for imaging.

The image acquisition method of the embodiment of this application can be applied to the mobile terminal 100 of any embodiment of this application. Please refer to Figure 6. The image acquisition method includes the steps of:

01: According to the first instruction, the bracket 31 is controlled to move so as to drive the imaging device 32 to emerge from the housing 10, and the imaging device 32 is controlled to perform imaging; and

02: According to the second instruction, the imaging device 32 is controlled to receive the light passing through the display device 20 to perform imaging.

The first instruction may be an instruction input by the user to enter the first imaging mode. For example, the first instruction may be a selfie instruction, a video call instruction, or the like.

The second instruction may be an instruction input by the user to enter the second imaging mode. For example, the second instruction may be an identity verification instruction, a light intensity detection instruction, or the like.

The specific implementation details of step 01 and step 02 can be found in the above description of the imaging device 32 performing imaging in the first imaging mode and the second imaging mode, which will not be repeated here.

7 , the mobile terminal 100 further includes a distance detection device 40. The distance detection device 40 can be mounted on the housing 10 or the bracket 31. The distance detection device 40 is used to detect whether the imaging device 32 is obstructed during its exposure from the housing 10.

If the imaging device 32 is obstructed during its emergence from the housing 10, it will not be able to fully emerge from the housing 10. For example, the imaging device 32 may be entirely within the housing 10, or partially within and partially outside the housing 10. In this case, the imaging device 32 cannot normally perform imaging in the first imaging mode. If imaging is required, the imaging device 32 can perform imaging in the second imaging mode to avoid damage to the movable member 30 or the driving member during the process of the imaging device 32 emerging from the housing 10.

If there is no obstruction during the process of the imaging device 32 being exposed from the housing 10, the imaging device 32 can be normally exposed from the housing 10. At this time, the imaging device 32 can normally perform imaging in the first imaging mode or in the second imaging mode.

For example, the distance detection device 40 can be installed on the same side of the housing 10 as the movable member 30. The distance detection device 40 is used to detect the distance of the obstruction 200 to determine whether the obstruction 200 is within the stroke of the imaging device 32 being exposed from the housing 10, or to determine whether the obstruction 200 will interfere with the movable member 30.

The distance detection device 40 can be specifically a proximity sensor, a time-of-flight ranging device, etc., which is not limited here.

Referring to FIG8 , in one example, the image acquisition method may further include the steps of:

03: Detect whether there is any obstruction when the imaging device 32 is exposed from the housing 10; and

04: When the imaging device 32 is blocked during its exposure from the housing 10 , the imaging device 32 is controlled to receive light passing through the display device 20 to perform imaging.

The specific implementation details of steps 03 and 04 can be found in the above description of how distance detection device 40 detects whether an obstruction exists and selects the imaging mode of imaging device 32, and will not be repeated here. In one example, when an obstruction is detected in the path of imaging device 32 protruding from housing 10, it can be considered that the second instruction has been received.

In one example, in a first imaging mode, the imaging device 32 is configured to output a first image having a first number of pixels. In a second imaging mode, the imaging device 32 is configured to output a second image having a second number of pixels, where the second number is smaller than the first number.

Since the imaging device 32 is not obstructed in the first imaging mode, the imaging device 32 receives a greater amount of light. Outputting the first image 60 with the first number of pixels can better reflect the imaging device 32's shooting capabilities, meeting the user's demand for high-pixel, high-quality photography, such as selfies, landscape photography, and video calls.

Because imaging device 32 is obscured by display device 20 in the second imaging mode, and the transmittance of display device 20 is generally lower than that of pure glass—for example, if the transmittance of display device 20 is less than 60%—imaging device 32 receives less light. If the second image were still output with a higher number of pixels, the brightness of each pixel in the second image would be dim, failing to faithfully reflect the real scene. Imaging device 32 outputs second image 70 with a second number of pixels, which is smaller than the first number. By sacrificing the number of pixels in second image 70, each pixel in second image 70 achieves greater fidelity.

For example, the first number may be the same as the total number of photosensitive cells in the photosensitive cell array 50. The second number may be any number such as one-half, one-third, one-quarter, one-sixth, one-eighth, one-ninth, one-tenth, one-twelfth, or one-sixteenth of the total number of photosensitive cells in the photosensitive cell array 50, without limitation.

For example, the ratio of the second quantity to the first quantity is 1:4, or the ratio of the second quantity to the first quantity is 1:8, or the ratio of the second quantity to the first quantity is 1:9, or the ratio of the second quantity to the first quantity is 1:16, or the ratio of the second quantity to the first quantity is 1:25, or the ratio of the second quantity to the first quantity is 1:36, etc., without limitation here.

Referring to FIG. 9 , in one example, step 01 of the image acquisition method includes step 011 : controlling the imaging device 32 to output a first image having a first number of pixels according to a first instruction.

Step 02 of the image acquisition method includes step 021: controlling the imaging device 32 to output a second image with a second number of pixels according to a second instruction, where the second number is less than the first number.

The specific implementation details of step 011 and step 021 can be found in the above description. The description of outputting the first image 60 and the second image 70 will not be repeated here.

Referring to the example shown in FIG. 10 , in the first imaging mode, the imaging device 32 outputs a pixel value of a pixel of the first image 60 according to a signal value of a photosensitive unit.

Since more light can be received in the first imaging mode, the amount of light received by each pixel is relatively sufficient. At this time, the number of pixels in the first image 60 can be prioritized so that the first image 60 can show more details.

For example, as shown in FIG10 , when outputting a first image 60, the imaging device 32 may first output the signal values of the photosensors of the same color to generate an initial image of a single color channel. The missing pixel values in the initial image are then filled in through interpolation to obtain a target image of a single color channel. Similar methods can be used to obtain target images of all color channels, and then the first image 60 is synthesized based on these target images of all colors.

Since the first image 60 includes signal values of multiple color channels, the first image 60 may be a color image.

Referring to the example shown in FIG. 11 , in the second imaging mode, the imaging device 32 outputs the pixel value of one pixel of the second image 70 according to the signal value of one minimum repetitive unit 51 .

Since the imaging device 32 is blocked by the display device 20 in the second imaging mode, the amount of light received by each pixel may be insufficient. In this case, the electrical signals output by all the photosensitive units in a minimum repeating unit 51 can be added and output to obtain the pixel value of a pixel in the second image 70 based on the signal value of a minimum repeating unit 51, thereby avoiding the problem of the image being too dark and distorted due to too little light received by some photosensitive units.

For example, as shown in FIG11 , the pixel value of second image 70 is derived from the sum of the signal values from the R photosensitive cell, two G photosensitive cells, and a B photosensitive cell within a minimum repeating unit 51. This avoids the problem of excessive darkness and distortion caused by any of the R photosensitive cell, two G photosensitive cells, or B photosensitive cell receiving too little light. Thus, the pixel values of all pixels in second image 70 are obtained, and the ratio of the number of pixels in second image 70 to the number of photosensitive cells in the photosensitive array is 1:4.

Of course, based on actual user needs, a pixel value of the second image 70 can be obtained based on the signal values of more photosensitive cells within the minimum repeating unit 51, for example, based on the signal values of photosensitive cells within two, three, four, five, or six minimum repeating units. For example, a pixel value of the second image 70 is obtained by summing the signal values of four R photosensitive cells, eight G photosensitive cells, and four B photosensitive cells within the minimum repeating unit 51 arranged in two rows and two columns. The ratio of the number of pixels in the second image 70 to the number of photosensitive cells in the photosensitive array is 1:16.

Since the pixel values of the second image 70 are obtained according to the sum of the signal values of all the photosensitive units within at least one minimum repeating unit 51, the second image 70 can be a black and white image and no longer reflects color information.

Referring to FIG. 12 , in one example, step 011 of the image acquisition method includes step 0111: according to a first instruction, controlling the imaging device 32 to output a pixel value of a pixel of the first image 60 according to a signal value of a photosensitive unit.

Step 021 of the image acquisition method includes step 0211: according to the second instruction, controlling the imaging device 32 to output the pixel value of a pixel of the second image 70 according to the signal value of a minimum repetition unit 51.

The specific implementation details of step 0111 and step 0211 can be found in the above description of outputting the first image 60 and the second image 70 based on the signal value of the photosensitive unit, which will not be repeated here.

Referring to Figures 1a and 1b, this application discloses a mobile terminal 100, which includes a housing 10, a display device 20, and a movable member 30. The display device 20 is mounted on the housing 10. The movable member 30 includes a bracket 31 and an imaging device 32 mounted on the bracket 31, and the movable member 30 is capable of moving relative to the housing 10. When the imaging device 32 is turned on, if the imaging device 32 has been driven by the bracket 31 to be exposed from the housing 10, the imaging device 32 outputs a first image. When the imaging device 32 is turned on, if the imaging device 32 is located in the housing 10, the imaging device 32 receives light that has passed through the display device 20 to output a second image.

Please refer to Figure 13. This application discloses a non-volatile computer-readable storage medium 300 containing computer-executable instructions 301. When the computer-executable instructions 301 are executed by one or more processors 400, the processors 400 execute the image acquisition method described in any embodiment of this application.

For example, processor 400 executes the steps:

01: According to the first instruction, the bracket 31 is controlled to move so as to drive the imaging device 32 to emerge from the housing 10, and the imaging device 32 is controlled to perform imaging; and

02: According to the second instruction, the imaging device 32 is controlled to receive the light passing through the display device 20 to perform imaging.

For example, processor 400 executes the steps:

03: Detect whether there is any obstruction when the imaging device 32 is exposed from the housing 10; and

04: When the imaging device 32 is blocked during its exposure from the housing 10 , the imaging device 32 is controlled to receive light passing through the display device 20 to perform imaging.

For example, processor 400 executes the steps:

011: According to the first instruction, control the imaging device 32 to output a first image with a first number of pixels; and

021: According to the second instruction, control the imaging device 32 to output a second image with a second number of pixels, where the second number is smaller than the first number.

For example, processor 400 executes the steps:

0111: According to the first instruction, control the imaging device 32 to output the pixel value of a pixel of the first image according to the signal value of a photosensitive unit; and

0211: According to the second instruction, the imaging device 32 is controlled to output the pixel value of a pixel of the second image according to the signal value of a minimum repetitive unit 51.

In the description of this specification, reference to the terms "certain embodiments," "one embodiment," "some embodiments," "example," "specific example," or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in an appropriate manner. In addition, different embodiments or examples described in this specification and features of different embodiments or examples may be combined and combined by a person skilled in the art, unless they are mutually inconsistent.

Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the technical features being referenced. Thus, a feature identified with "first" or "second" may explicitly or implicitly include at least one of the identified features. In the description of this application, "plurality" means at least two, such as two or three, unless otherwise specifically defined.

Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technical personnel in this field can change, modify, replace and modify the above embodiments within the scope of the present application. The scope of the present application is defined by the claims and their equivalents.

10: Housing 20: Display device 30: Movable part 31: Bracket 32: Imaging device 321: Lens assembly 322: Image sensor 40: Distance detection device 50: Photosensitive cell array 51: Minimum repeating unit 60: First image 70: Second image 100: Mobile terminal 200: Obstruction 300: Computer-readable storage medium 301: Computer-executable instructions 400: Processor 01-04: Steps 011-021: Steps 0111-0211: Steps

The above and/or additional aspects and advantages of the present application will become apparent and readily understood from the description of the embodiments in conjunction with the following drawings, in which:

Figure 1a is a schematic diagram of the status of a mobile terminal in certain embodiments of the present application;

FIG1b is a schematic diagram of the status of a mobile terminal in certain embodiments of the present application;

FIG2a is a schematic diagram of the status of a mobile terminal in certain embodiments of the present application;

FIG2b is a schematic diagram of the status of a mobile terminal in certain embodiments of the present application;

FIG3a is a schematic diagram of the imaging module in a first imaging mode according to certain embodiments of the present application;

FIG3 b is a schematic diagram of the imaging module in a second imaging mode according to certain embodiments of the present application;

FIG4 is a schematic diagram of the structure of a photosensitive unit array according to certain embodiments of the present application;

FIG5 is a schematic diagram of the structure of a photosensitive unit array according to certain embodiments of the present application;

FIG6 is a schematic diagram of the process of an image acquisition method according to certain embodiments of the present application;

FIG7 is a schematic diagram of a usage scenario of a mobile terminal according to certain embodiments of the present application;

FIG8 is a schematic flow chart of an image acquisition method according to certain embodiments of the present application;

FIG9 is a schematic diagram of the process of an image acquisition method according to certain embodiments of the present application;

FIG10 is a schematic diagram showing the principle of an imaging module outputting an image in a first imaging mode according to certain embodiments of the present application;

FIG11 is a schematic diagram showing the principle of an imaging module outputting an image in a second imaging mode according to certain embodiments of the present application;

FIG12 is a flowchart illustrating an image acquisition method according to certain embodiments of the present application; and

FIG13 is a schematic diagram showing the connection between a computer-readable storage medium and a processor in certain embodiments of the present application.

01~02: Steps

Claims (16)

A mobile terminal comprises: a housing; a display device mounted on the housing; and a movable member comprising a bracket and an imaging device mounted on the bracket, the movable member being movable relative to the housing; the imaging device being capable of being in a first imaging mode or a second imaging mode. In the first imaging mode, the bracket moves to cause the imaging device to emerge from the housing and perform imaging; in the second imaging mode, the imaging device is located within the housing and receives light passing through the display device for imaging. In the first imaging mode, the imaging device is configured to output a first image having a first number of pixels; in the second imaging mode, the imaging device is configured to output a second image having a second number of pixels; the second number being less than the first number, and The imaging device includes an image sensor, the image sensor including a photosensitive cell array, the photosensitive cell array including multiple minimum repeating units, each of which includes multiple photosensitive cells. In the first imaging mode, the imaging device outputs the pixel value of a pixel in the first image based on the signal value of one photosensitive cell. In the second imaging mode, the imaging device outputs the pixel value of a pixel in the second image based on the signal value of one minimum repeating unit. The mobile terminal of claim 1, wherein the minimum repeating unit is 4 photosensitive cells in 2 rows and 2 columns, and the photosensitive cells in the same minimum repeating unit are arranged as follows: R G G B wherein, R represents a red photosensitive cell; G represents a green photosensitive cell; B represents a blue photosensitive cell. The mobile terminal according to claim 1, wherein the minimum repeating unit includes at least one full-color photosensitive unit. The mobile terminal according to claim 3, wherein the minimum repeating unit is 4 photosensitive cells in 2 rows and 2 columns, and the photosensitive cells in the same minimum repeating unit are arranged as follows: R W G B W represents a full-color photosensitive cell; R represents a red photosensitive cell; G represents a green photosensitive cell; B represents a blue photosensitive cell. The mobile terminal according to claim 1, wherein the ratio of the second quantity to the first quantity is 1:4; or the ratio of the second quantity to the first quantity is 1:16. The mobile terminal according to claim 1, wherein the first image is a color image; and/or the second image is a black and white image. The mobile terminal of claim 1, wherein upon receiving a selfie command, the imaging device is capable of operating in a first imaging mode to perform imaging; and/or upon receiving an identity verification command, the imaging device is capable of operating in a second imaging mode to perform imaging. The mobile terminal according to claim 1 further comprises a distance detection device configured to detect whether the imaging device is obstructed while emerging from the housing; When the imaging device is obstructed while emerging from the housing, the imaging device can be operated in a second imaging mode to perform imaging. The mobile terminal according to claim 1, wherein the movable member is movable relative to the housing; and/or the movable member is rotatable relative to the housing. An image acquisition method for a mobile terminal includes a housing and a movable member capable of moving relative to the housing, the movable member including a bracket and an imaging device mounted on the bracket. The image acquisition method comprises: Controlling the bracket to move to cause the imaging device to emerge from the housing, and controlling the imaging device to perform imaging, based on a first instruction; and Controlling the imaging device to receive light passing through a display device to perform imaging, based on a second instruction, includes: Controlling the imaging device to perform imaging, based on the first instruction, includes: Controlling the imaging device to receive light passing through the display device to perform imaging, based on the second instruction, includes: Controlling the imaging device to output a first image having a first number of pixels, based on the first instruction; Controlling the imaging device to output a second image having a second number of pixels, based on the second instruction, includes: Controlling the imaging device to output a second image having a second number of pixels, the second number being less than the first number, based on the second instruction. The imaging device includes an image sensor, the image sensor including a photosensitive cell array, the photosensitive cell array including multiple minimal repeating units, each of the minimal repeating units including multiple photosensitive cells. Controlling the imaging device to output a first image having a first number of pixels in accordance with a first instruction comprises: controlling the imaging device to output the pixel value of a pixel in the first image in accordance with a signal value of one of the photosensitive cells in accordance with the first instruction. Controlling the imaging device to output a second image having a second number of pixels in accordance with a second instruction comprises: controlling the imaging device to output the pixel value of a pixel in the second image in accordance with a signal value of one of the minimal repeating units in accordance with the second instruction. The image acquisition method according to claim 10, wherein the minimum repeating unit includes at least one full-color photosensitive unit. The image acquisition method of claim 10, wherein the ratio of the second number to the first number is 1:4; or the ratio of the second number to the first number is 1:16. The image acquisition method according to claim 10, wherein the first image is a color image; and/or the second image is a black and white image. The image acquisition method according to claim 10, wherein the first command includes a selfie command; and/or the second command includes an identity verification command. The image acquisition method of claim 10 further comprises: Detecting whether the imaging device is obstructed during its exposure from the housing; and When the imaging device is obstructed during its exposure from the housing, controlling the imaging device to receive light that has passed through the display device to generate an image. A mobile terminal comprises: a housing; a display device mounted on the housing; and a movable member comprising a bracket and an imaging device mounted on the bracket, the movable member being movable relative to the housing; when the imaging device is turned on and has been pulled out of the housing by the bracket, the imaging device outputs a first image having a first number of pixels; when the imaging device is turned on and is located within the housing, the imaging device receives light passing through the display device and outputs a second image having a second number of pixels, the second number being less than the first number, wherein: The imaging device includes an image sensor, the image sensor including a photosensitive cell array, the photosensitive cell array including multiple minimum repeating units, each of which includes multiple photosensitive cells. The imaging device outputs a pixel value of a pixel in the first image based on a signal value of one of the photosensitive cells. The imaging device outputs a pixel value of a pixel in the second image based on a signal value of one of the minimum repeating units.