WO2020052284A1 - Control method and device, depth camera, electronic device, and readable storage medium - Google Patents

Abstract

A control method, a control device (90), a time of flight depth camera (300), an electronic device (800), and a computer readable storage medium (900). The control method comprises: (01) obtaining a scene image of a scene; (03) recognizing whether a human face exists in the scene image; (05) when a human face exists in the scene image, controlling a light transmitter (100) to emit light at a first light emitting power and/or a first turn-on frequency; and (07) when no human face exists in the scene image, controlling the light transmitter (100) to emit light at a second light emitting power and/or a second turn-on frequency.

Description

Control method and device, depth camera, electronic device and readable storage medium

Priority information

This application claims the priority and rights of the patent application with the patent application number 201811060690.4, which was filed with the State Intellectual Property Office of China on September 12, 2018, and is incorporated herein by reference in its entirety.

Technical field

The present application relates to the field of three-dimensional imaging technology, and in particular, to a control method, a control device, a time-of-flight depth camera, an electronic device, and a computer-readable storage medium.

Background technique

Time of flight (TOF) imaging system can calculate the depth information of the measured object by calculating the time difference between the moment when the optical transmitter emits the optical signal and the moment when the optical receiver receives the optical signal. Light emitters typically include a light source and a diffuser. The light from the light source is diffused by the diffuser and then casts a uniform surface light into the scene. The light emitted by the light source is usually an infrared laser.

Summary of the Invention

Embodiments of the present application provide a control method, a control device, a time-of-flight depth camera, an electronic device, and a computer-readable storage medium.

The method for controlling an optical transmitter according to an embodiment of the present application includes: acquiring a scene image of a scene; identifying whether a human face exists in the scene image; and controlling the optical transmitter to The first light emitting power and / or the first on frequency emit light; when the human face does not exist in the scene image, controlling the light emitter to emit light with the second light emitting power and / or the second on frequency.

The control device of the light transmitter according to the embodiment of the present application includes a first acquisition module, an identification module, and a control module. The first acquisition module is configured to acquire a scene image of a scene; the recognition module is configured to recognize whether a human face exists in the scene image; and the control module is configured to, when the human face exists in the scene image, Controlling the light emitter to emit light at a first light emitting power and / or a first on frequency, and when the human face does not exist in the scene image, controlling the light emitter to emit light at a second light emitting power and / or Two on-frequency lights.

The time-of-flight camera according to the embodiment of the present application includes a light transmitter and a processor. The processor is configured to obtain a scene image of a scene, identify whether a human face exists in the scene image, and control the light transmitter to be turned on at a first light emitting power and / or a first when the human face exists in the scene image. When the light is emitted at a frequency and when the human face does not exist in the scene image, the light emitter is controlled to emit light at a second light emission power and / or a second on frequency.

The electronic device according to the embodiment of the present application includes the time-of-flight depth camera, one or more processors, a memory, and one or more programs. Wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the programs include instructions for performing the control method described above.

The computer-readable storage medium of the embodiment of the present application includes a computer program used in combination with an electronic device, and the computer program can be executed by a processor to complete the control method described above.

Additional aspects and advantages of the present application will be given in part in the following description, part of which will become apparent from the following description, or be learned through practice of the present application.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and / or additional aspects and advantages of this application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

FIG. 1 is a schematic three-dimensional structure diagram of an electronic device according to some embodiments of the present application.

FIG. 2 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 3 is a schematic block diagram of a control device for a light transmitter according to some embodiments of the present application.

FIG. 4 and FIG. 5 are schematic diagrams of the turn-on frequencies of the optical transmitter in some embodiments of the present application.

6 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 7 is a schematic block diagram of a control device for a light transmitter according to some embodiments of the present application.

8 and 9 are schematic flowcharts of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 10 is a schematic block diagram of a control device for a light transmitter according to some embodiments of the present application.

11 is a schematic block diagram of a second acquisition module in a control device for a light transmitter according to some embodiments of the present application.

FIG. 12 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 13 is a schematic block diagram of a second computing unit in a control device for a light transmitter according to some embodiments of the present application.

14 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 15 is a schematic block diagram of a second computing unit in a control device for a light transmitter according to some embodiments of the present application.

FIG. 16 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 17 is a schematic block diagram of a second computing unit in a control device for a light transmitter according to some embodiments of the present application.

18 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

19 is a schematic block diagram of a control module in a control device for a light transmitter according to some embodiments of the present application.

FIG. 20 is a schematic three-dimensional structure diagram of an electronic device according to some embodiments of the present application.

FIG. 21 is a schematic diagram of a three-dimensional structure of a depth camera according to some embodiments of the present application.

22 is a schematic plan view of a depth camera according to some embodiments of the present application.

FIG. 23 is a schematic cross-sectional view of the depth camera in FIG. 22 along the line XXIII-XXIII.

FIG. 24 is a schematic structural diagram of a light emitter according to some embodiments of the present application.

25 is a schematic diagram of a connection between an electronic device and a computer-readable storage medium according to some embodiments of the present application.

detailed description

Hereinafter, embodiments of the present application will be described in detail. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary, and are intended to explain the present application, and should not be construed as limiting the present application.

Referring to FIG. 1, the present application provides a method for controlling a light transmitter 100. The control method includes: acquiring a scene image of the scene; 03: identifying whether a human face exists in the scene image; and controlling the light transmitter 100 to emit light at a first light emitting power and / or a first on frequency when a human face exists in the scene image; When a human face does not exist in the scene image, the light transmitter 100 is controlled to emit light at a second light emitting power and / or a second on frequency.

In some embodiments, the first turn-on frequency includes a first sub-turn-on frequency and a second sub-turn-on frequency. The control method further includes: judging an application scenario of the light transmitter. When a human face exists in the scene image, the step of controlling the light transmitter 100 to emit light at the first luminous power and / or the first on frequency includes: when the application scene is the first scene and the human face exists in the scene image, Control the light emitter 100 to emit light at the first light emitting power and the first sub-on frequency; when the application scene is the second scene and a human face is present in the scene image, control the light emitter 100 to turn on at the first light power and the second sub-light Frequency glow.

In some embodiments, after the step of identifying whether a human face exists in the scene image, the control method further includes: obtaining a projection distance between the user and the light transmitter 100; and calculating the first light emitting power according to the projection distance.

In some embodiments, the step of obtaining a projection distance between the user and the light transmitter 100 includes: calculating a first proportion of a human face in the scene image; and calculating the projection distance according to the first proportion.

In some embodiments, the step of calculating the projection distance according to the first scale includes: calculating a second ratio of the preset feature area of the human face in the scene image to the human face; and calculating the projection distance according to the first ratio and the second ratio.

In some embodiments, the step of calculating the projection distance according to the first ratio includes: judging whether the user is wearing glasses according to the scene image; and calculating the projection distance according to the first ratio and the distance coefficient when the user wears glasses.

In some embodiments, the step of calculating the projection distance according to the first ratio includes: judging the age of the user according to the scene image; and calculating the projection distance according to the first ratio and age.

In some embodiments, when there is no human face in the scene image, the step of controlling the light emitter 100 to emit light at the second light emission power and / or the second on frequency includes: obtaining a target subject and the light emitter 100 in the scene. Obtains the ambient brightness of the scene; and calculates the second luminous power according to the ambient brightness and the projection distance.

Referring to FIG. 1 and FIG. 3, the present application provides a control device 90 of a light transmitter 100. The control device 90 includes a first acquisition module 91, an identification module 93, and a control module 95. The first acquisition module 91 is configured to acquire a scene image of a scene. The recognition module 93 is used to recognize whether a human face exists in the scene image. The control module 95 is configured to control the light transmitter 100 to emit light at a first light emitting power and / or a first on frequency when a human face is present in the scene image, and control the light transmitter 100 to The second light emitting power and / or the second on frequency emit light.

Referring to FIG. 1 and FIG. 7, in some embodiments, the first turn-on frequency includes a first sub-turn-on frequency and a second sub-turn-on frequency. The control device 90 further includes a determination module 941, which is configured to determine an application scenario of the optical transmitter 100. The control module 90 may also control the light transmitter 100 to emit light at the first light emission power and the first sub-on frequency when the application scene is the first scene and the human face is present in the scene image, and the second scene is the second scene in the application scene. When the scene has a human face in the scene image, the light transmitter 100 is controlled to emit light at the first light emission power and the second sub-on frequency.

Referring to FIG. 1 and FIG. 10, in some embodiments, the control device 90 further includes a second obtaining module 942 and a calculation module 942. The second acquisition module 942 is configured to acquire a projection distance between the user and the light transmitter 100. The calculation module 943 is configured to calculate the first light emitting power according to the projection distance.

Referring to FIG. 11, in some embodiments, the second obtaining module 942 includes a first calculation unit 9421 and a second calculation unit 9422. The first calculation unit 9421 is configured to calculate a first proportion of a face in a scene image. The second calculation unit 9422 is configured to calculate a projection distance according to the first ratio.

Referring to FIG. 13, in some embodiments, the second calculation unit 942 includes a first calculation sub-unit 9423 and a second calculation sub-unit 9424. The first calculation subunit 9423 is configured to calculate a second proportion of the preset feature area of the human face in the scene image. The second calculation subunit 9424 is configured to calculate a projection distance according to the first scale and the second scale.

Referring to FIG. 15, in some embodiments, the second calculation unit 942 includes a first determination sub-unit 9425 and a third calculation sub-unit 9426. The first judging subunit 9425 is configured to judge whether the user wears glasses according to the scene image. The third subunit 9426 is configured to calculate a projection distance according to the first scale and the distance coefficient when the user wears glasses.

Referring to FIG. 17, in some embodiments, the second calculation unit 942 includes a second determination sub-unit 9427 and a fourth calculation sub-unit 9428. The second judging subunit 9427 is configured to judge the age of the user according to the scene image. The fourth calculation subunit 9428 is configured to calculate a projection distance according to the first ratio and age.

Referring to FIG. 1 and FIG. 19, in some embodiments, the control module 95 includes a first obtaining unit 951, a second obtaining unit 952, and a third computing unit 953. The first obtaining unit 951 is configured to obtain a projection distance between a target subject in the scene and the light emitter 100. The second obtaining unit 952 is configured to obtain the ambient brightness of the scene. The third calculation unit 953 is configured to calculate a second light emitting power according to the ambient brightness and the projection distance.

Please refer to FIG. 1, the application also provides a time-of-flight depth camera 300. The time-of-flight depth camera 300 includes a light transmitter 100 and a processor. The processor is configured to: obtain a scene image of the scene; identify whether a human face is present in the scene image; and when a human face is present in the scene image, control the light transmitter 100 to emit light at a first light emission power and / or a first on frequency; and in the scene image When the human face does not exist, the light transmitter 100 is controlled to emit light at a second light emitting power and / or a second on frequency.

Referring to FIG. 1 again, the processor is further configured to: determine an application scenario of the light transmitter 100; and when the application scenario is the first scene and a human face is present in the scene image, control the light transmitter at the first light emitting power and the first When the application scene is the second scene and a human face is present in the scene image, the light transmitter 100 is controlled to emit light at the first light emission power and the second sub-on frequency.

Please refer to FIG. 1 again. In some embodiments, the processor is further configured to: obtain a projection distance between the user and the light transmitter 100; and calculate the first light emitting power according to the projection distance.

Please refer to FIG. 1 again. In some embodiments, the processor is further configured to: calculate a first proportion of a face in a scene image; and calculate a projection distance according to the first proportion.

Please refer to FIG. 1 again. In some embodiments, the processor is further configured to: calculate a second proportion of the preset feature area of the face in the scene image to the human face; and calculate a projection distance according to the first proportion and the second proportion.

Please refer to FIG. 1 again. In some embodiments, the processor is further configured to: determine whether the user wears glasses according to the scene image; and calculate the projection distance according to the first scale and the distance coefficient when the user wears glasses.

Please refer to FIG. 1 again. In some embodiments, the processor is further configured to: determine the age of the user according to the scene image; and calculate the projection distance according to the first scale and age.

Please refer to FIG. 1 again. In some embodiments, the processor is further configured to: obtain a projection distance between the target subject and the light emitter in the scene; obtain the ambient brightness of the scene; and calculate the second luminous power according to the ambient brightness and the projection distance .

Please refer to FIG. 1, the present application further provides an electronic device 800. The electronic device includes the depth camera 300 according to any one of the foregoing embodiments, one or more processors 805, a memory 806, and one or more programs. One or more programs are stored in the memory 806 and are configured to be executed by one or more processors 805. The program includes instructions for the control method according to any one of the above embodiments.

Referring to FIG. 25, the present application further provides a computer-readable storage medium 900. The computer-readable storage medium 900 includes a computer program used in conjunction with the electronic device 800. The computer program may be executed by the processor 805 to implement the control method according to any one of the foregoing embodiments.

Please refer to FIG. 1 and FIG. 2 together. The present application provides a method for controlling an optical transmitter 100. Control methods include:

01: Get the scene image of the scene;

03: identify whether a human face exists in the scene image;

05: when a human face is present in the scene image, controlling the light transmitter 100 to emit light at a first light emitting power and / or a first on frequency;

07: When a human face does not exist in the scene image, the light transmitter 100 is controlled to emit light at the second emission power and / or the second on frequency.

Please refer to FIG. 1 and FIG. 3 together. The present application further provides a control device 90 of the optical transmitter 100. The control method according to the embodiment of the present application may be implemented by the control device 90 according to the embodiment of the present application. The control device 90 includes a first acquisition module 91, an identification module 93, and a control module 95. Step 01 may be implemented by the first obtaining module 91. Step 03 may be implemented by the identification module 93. Both steps 05 and 07 can be implemented by the control module 95. That is, the first acquisition module 91 may be configured to acquire a scene image of a scene. The recognition module 93 may be used to recognize whether a human face exists in the scene image. The control module 95 may be configured to control the light emitter 100 to emit light at a first light emitting power and / or a first on frequency when a human face is present in the scene image, and to control the light emitter 100 to emit a second light when no human face is present in the scene image. The light emitting power and / or the second on frequency emit light.

Please refer to FIG. 1 again, this application further provides a time-of-flight depth camera 300. The control device 90 according to the embodiment of the present application can be applied to the time-of-flight depth camera 300 according to the embodiment of the present application. The time-of-flight depth camera 300 includes a light transmitter 100, a light receiver 200, and a processor. Step 01, step 03, step 05, and step 07 can all be implemented by a processor. That is to say, the processor may be configured to acquire a scene image of the scene, identify whether a human face exists in the scene image, and control the light transmitter 100 to emit light at a first light emitting power and / or a first on frequency when a human face exists in the scene image. And when the human face does not exist in the scene image, the light transmitter 100 is controlled to emit light at the second emission power and / or the second on frequency.

The time-of-flight camera 300 according to the embodiment of the present application can be applied to the electronic device 800. The processor in the time-of-flight camera 300 according to the embodiment of the present application and the processor 805 of the electronic device 800 may be the same processor, or may be two independent processors. In a specific embodiment of the present application, the processor in the time-of-flight depth camera 300 and the processor 805 of the electronic device 800 are the same processor. The electronic device 800 may be a mobile phone, a tablet computer, a smart wearable device (a smart watch, a smart bracelet, a smart glasses, a smart helmet), a drone, etc., and is not limited herein.

Specifically, the time-of-flight depth camera 300 generally includes a light transmitter 100 and a light receiver 200. The light transmitter 100 is used to project a laser light into the scene, and the light receiver 200 receives the laser light reflected by a person or an object in the scene. When the time-of-flight depth camera 300 works, the processor 805 controls both the optical transmitter 100 and the optical receiver 200 to be turned on, and inputs a modulation signal with a certain frequency and amplitude to the driver 61 (shown in FIG. 24), and the driver 61 converts the modulation signal After being a constant current source, it is transmitted to the light source (shown in FIG. 24) of the light emitter 100, so that the light source emits laser light. The laser emitted by the optical transmitter 100 is usually an infrared laser. If the energy of the infrared laser is too high or the infrared laser is continuously emitted to a position for a long time, it is easy to cause damage to the eyes of the user.

In the control method, the control device 90 and the time-of-flight camera 300 according to the embodiments of the present application, when the light transmitter 100 is turned on, a scene image of a scene is first collected. For example, an infrared camera (which may be the light receiver 200) or a visible light camera may be used. 400 acquisitions. Subsequently, the processor 805 recognizes whether a face exists in the scene image based on the face recognition algorithm. When a human face exists in the scene image, the processor 805 controls the light transmitter 100 to emit light at a first light emitting power and / or a first on frequency. When there is no human face in the scene image, the processor 805 controls the light transmitter 100 to emit light at a second light emitting power and / or a second on frequency.

The light emitting power is indirectly characterized by the current output by the driver 61. When the current output by the driver 61 is larger, the light emitting power is larger; when the current output by the driver is smaller, the light emitting power is smaller. The turn-on frequency refers to the turn-on frequency of the light transmitter 100, not the light-emitting frequency of the light transmitter 100. The turn-on frequency of the light transmitter 100 corresponds to the frame rate at which the light receiver 200 outputs a depth image. Specifically, with reference to FIG. 4, it is assumed that the optical receiver 200 is to output a frame of image, the optical transmitter 100 needs to emit laser light of N periods T2, and when the optical receiver 200 is to output the next frame of image, the optical transmitter 100 needs to Emit the laser of N cycles again, then the sum of the time of N cycles is a turn-on cycle T1 of the optical transmitter 100, that is, T1 = N × T2, and the turn-on frequency f is calculated as f = 1 / T1; please combine Fig. 5. If the optical receiver 200 is to output one frame of image, the optical transmitter 100 needs to emit laser light of N cycles T2. When the optical receiver 200 is to output the next frame of image, the optical transmitter 100 needs to transmit N cycles again. Laser, and the optical transmitter 100 emits laser light of N cycles T2 for the first time and the laser light of N cycles T2 of the second time is separated by an interval t, the turn-on cycle T1 of the optical transmitter 100 is T1 = N × T2 + t, the calculation method of the opening frequency is 1 / T1.

The processor 805 controlling the light emitter 100 to emit light at the first light emitting power and / or the first on frequency includes: (1) the processor 805 controls the light emitter 100 to emit light at the first light emitting power; (2) the processor 805 controls the light emitting The transmitter 100 emits light at a first on frequency; (3) The processor 805 controls the light transmitter 100 to emit light at a first light emission power and a first on frequency at the same time.

Similarly, the processor 805 controlling the light emitter 100 to emit light at the second light emitting power and / or the second on frequency includes: (1) the processor 805 controls the light emitter 100 to emit light at the second light emitting power; (2) the processor 805 Control the light transmitter 100 to emit light at a second on frequency; (3) The processor 805 controls the light transmitter 100 to emit light at a second light emission power and a second on frequency simultaneously.

Because the infrared laser energy is likely to cause damage to the user's eyes when the energy of the infrared laser is high, in the control method of the embodiment of the present application, when a human face is present in the scene image, the light is turned on with a lower first luminous power and a lower first. Frequency light emission. A lower first luminous power can reduce the energy of the infrared laser light irradiated to the user's eyes. A lower first turn-on frequency can reduce the time that the infrared laser light continues to irradiate the user's eyes. In this way, the emitted laser light can reduce the impact on the user. The risk of injury to the eyes increases the safety of use of the time-of-flight depth camera 300. When there is no human face in the scene image, the light is emitted at a second light emission power and a second on frequency suitable for the current scene. In this way, the accuracy of the depth image output by the light receiver 200 can be improved.

Please refer to FIG. 1 and FIG. 6 together. In some embodiments, the first turn-on frequency includes a first turn-on sub-frequency and a second turn-on sub-frequency. Control methods also include:

041: determine an application scenario of the light transmitter 100;

Step 05: When a human face exists in the scene image, controlling the light transmitter 100 to emit light at the first light emitting power and / or the first on frequency includes:

051: when the application scene is the first scene and the face exists in the scene image, controlling the light transmitter 100 to emit light at the first light emission power and the first sub-on frequency; and

052: When the application scene is the second scene and the human face is present in the scene image, the light transmitter 100 is controlled to emit light at the first light emission power and the second sub-on frequency.

Please refer to FIG. 1 and FIG. 7 together. In some embodiments, the control device 90 further includes a determination module 941. Step 041 may be implemented by the judgment module 941. Both steps 051 and 052 can be implemented by the control module 95. That is to say, the determination module 941 can be used to determine an application scenario of the light transmitter 100. The control module 95 may be configured to control the light emitter 100 to emit light at a first light emitting power and a first sub-on frequency when the application scene is the first scene and the face is present in the scene image, and when the application scene is the second scene and the scene When the human face is present in the image, the light transmitter 100 is controlled to emit light at a first light emitting power and a second sub-on frequency.

Please refer to FIG. 1 again. In some embodiments, step 041, step 051, and step 052 can all be implemented by the processor 805. That is to say, the processor 805 may be configured to determine an application scene of the light transmitter 100, and when the application scene is the first scene, and the face exists in the scene image, control the light transmitter 100 to use the first light emitting power and the first The first sub-frequency is turned on to emit light, and when the application scene is the second scene and the human face is present in the scene image, the light transmitter 100 is controlled to emit light at the first sub-frequency and the second sub-on frequency.

The first scene refers to an application scene in which the application time of the depth-of-flight camera 300 is shorter than a preset time, for example, shooting a static three-dimensional image of the scene, unlocking the electronic device 800 based on a three-dimensional face, and performing payment based on the three-dimensional face Application scenarios where the time module has less application time. The second scenario refers to an application scenario in which the application time of the time-of-flight depth camera 300 is greater than or equal to a preset time, for example, an application scenario in which a user performs a three-dimensional video chat with other users.

Take the first scenario as an application scenario of unlocking the electronic device 800 based on a three-dimensional face, and the second scenario as an application scenario in which a user performs a three-dimensional video chat with other users. When the time-of-flight depth camera 300 is used to capture a user's three-dimensional face to unlock the electronic device 800, the light receiver 200 usually only needs to output a few depth images per second, for example, 3 frames per second, 4 frames per second, 5 frames per second, etc., the corresponding optical transmitter 100 is turned on 3 times / second, 4 times / second, 5 times / second, etc. At this time, in order to reduce the Damage, the light receiver 200 can output only one frame of the image, and correspondingly, the processor 805 can set the first sub-on frequency to 1 time / second. When the time-of-flight depth camera 300 is used to capture a three-dimensional video of a user, so that the user can use the electronic device 800 to have a three-dimensional video chat with other users, the light receiver 200 usually needs to output more depth images per second, such as every 30 frames per second, 60 frames per second, etc., the corresponding light transmitter 100 is turned on 30 times / second, 60 times / second, etc. At this time, in order to reduce the damage of the laser to the user's eyes, the light receiver 200 can only output 24 frames of images. Correspondingly, the processor 805 can set the first sub-on frequency to 24 times / second. It can be understood that when the screen refresh rate of the electronic device 800 reaches 24 frames / second, what the human eye sees is a smooth picture. Therefore, the first sub-on frequency can be set to 24 times / second, and the light transmitter 100 starts at The lowest frame rate output depth image, on the one hand, can reduce the damage of the laser to the user's eyes, and on the other hand, can ensure that the user can see a smooth three-dimensional video picture.

In this way, by distinguishing the application scenarios and using different first turn-on frequencies when the application scenarios are different, the risk of harm to the user from the laser can be reduced, and the user's use needs can be met, and the user experience is better.

Please refer to FIG. 1, FIG. 8 and FIG. 9 together. In some embodiments, the control method after step 03 further includes:

042: Obtain the projection distance between the user and the light transmitter 100; and

043: Calculate the first luminous power according to the projection distance.

Step 042 includes:

0421: Calculate the first proportion of faces in the scene image; and

0422: Calculate the projection distance according to the first scale.

Please refer to FIG. 1, FIG. 10, and FIG. 11 together. In some embodiments, the control device 90 further includes a second acquisition module 942 and a calculation module 943. The second acquisition module 942 includes a first calculation unit 9421 and a second calculation unit 9422. Step 042 may be implemented by the second obtaining module 942. Step 043 may be implemented by the first calculation unit 9421. Step 0421 may be implemented by the first calculation unit 9421, and step 0422 may be implemented by the second calculation unit 9422. That is, the second obtaining module 942 may be used to obtain a projection distance between the user and the light transmitter 100. The calculation module 943 may be configured to calculate the first light emitting power according to the projection distance. The first calculation unit 9421 may be configured to calculate a first proportion of a human face in the scene image. The second calculation unit 9422 may be configured to calculate a projection distance according to the first ratio.

Please refer to FIG. 1 again. In some embodiments, step 041, step 042, step 0421, and step 0422 can all be implemented by the processor 805. That is to say, the processor 805 may be further configured to obtain a projection distance between the user and the light transmitter 100, and calculate a first light emitting power according to the projection distance. When the processor 805 obtains the projection distance between the user and the light transmitter 100, the processor 805 specifically performs operations of calculating a first proportion of a face in the scene image and calculating a projection distance according to the first proportion.

Specifically, after the processor 805 recognizes the human face in the scene image, the processor 805 extracts the human face and calculates the number of pixels occupied by the human face. Subsequently, the processor 805 divides the number of human face pixels by the scene image. To obtain the first proportion of faces in the scene image, and finally calculate the projection distance based on the first proportion. Generally, when the first ratio is larger, the user is closer to the time-of-flight camera 300, that is, the user is closer to the light transmitter 100, and the projection distance is smaller. When the first ratio is larger, the user and the time-of-flight depth are explained. The camera 300 is farther away, that is, the user is farther away from the light transmitter 100, and the projection distance is larger. Therefore, the relationship between the projection distance and the first ratio satisfies that the projection distance increases as the first ratio decreases. In an example, when the scene image includes multiple faces, the face with the largest area among the multiple faces may be selected to calculate the first proportion; or, the average of the areas of the multiple faces may be selected to calculate The first proportion; or, the face of the holder of the electronic device 800 may be identified from a plurality of faces, and the first proportion may be calculated using the faces of the holder.

The first ratio has a mapping relationship with the projection distance. For example, the first ratio is a specific value and the projection distance is also a specific value. The first ratio corresponds to the projection distance one by one. Or, the first ratio is a range and the projection distance is For a specific value, the first ratio is a one-to-one correspondence with the projection distance; or, the first ratio is a range and the projection distance is also a range, and the first ratio corresponds to the projection distance one-to-one. Specifically, the mapping relationship between the first scale and the projection distance may be calibrated in advance. During calibration, the user is instructed to stand at a plurality of predetermined projection distances from the infrared camera or visible light camera 400, respectively, and the infrared camera or visible light camera 400 sequentially captures scene images. The processor 805 calculates the calibration ratio of the face to the scene image in each scene image, and then stores the correspondence between the calibration ratio in each scene image and the predetermined projection distance. In subsequent use, based on the first ratio actually measured Find the projection distance corresponding to the first ratio in the above mapping relationship. For example, the user is instructed to stand at a projection distance of 10 cm, 20 cm, 30 cm, 40 cm, an infrared camera or a visible light camera 400 sequentially captures scene images, and the processor 805 calculates a projection distance of 10 cm from the multiple scene images , 20 cm, 30 cm, and 40 cm respectively corresponding to the calibration ratio of 80%, 60%, 45%, 30%, and the mapping relationship between the calibration ratio and the predetermined projection distance 10cm-80%, 20cm-60%, 30cm-45 The%, 40cm-30% are stored in the memory 806 of the electronic device 800 in the form of a mapping table. In subsequent use, directly find the projection distance corresponding to the first ratio in the mapping table.

其中，D依据实际测量的第一比例R计算的实际的投射距离。 Alternatively, the projection distance and the first ratio are calibrated in advance. At the time of calibration, the user is directed to stand at a predetermined projection distance from the infrared camera or visible light camera 400, and the infrared camera or visible light camera 400 collects scene images. The processor 805 calculates the calibration ratio of the face in the scene image to the scene image, and then stores the correspondence between the calibration ratio in the scene image and the predetermined projection distance. In subsequent use, based on the correspondence between the calibration ratio and the predetermined projection distance The relationship calculates the projection distance. For example, to guide the user to stand at a position with a projection distance of 30 cm, the infrared camera or visible light camera 400 captures the scene image, the processor 805 calculates that the proportion of the human face in the scene image is 45%, and in actual measurement, when When the first ratio is calculated as R, according to the properties of similar triangles,

Among them, D is an actual projection distance calculated according to the actually measured first ratio R.

In this way, according to the first proportion of the human face in the scene image, the projection distance between the user and the light transmitter 100 can be more objectively reflected. Calculate the first luminous power based on the projection distance. The light transmitter 100 can emit light at a relatively suitable luminous power. On the one hand, it can prevent the light emitting power of the light transmitter 100 from being too high and causing damage to the user's eyes. The luminous power is too low, resulting in inaccurate depth information of the scene.

Referring to FIG. 12, in some embodiments, calculating the projection distance according to the first scale in step 0422 includes:

0423: Calculate the second proportion of the preset feature area of the human face in the scene image; and

0424: Calculate the projection distance according to the first scale and the second scale.

Referring to FIG. 13, in some embodiments, the second calculation unit 9422 includes a first calculation sub-unit 9423 and a second calculation sub-unit 9424. Step 0423 may be implemented by the first calculation subunit 9423. Step 0424 may be implemented by the second calculation subunit 9424. That is to say, the first calculation subunit 9423 can be used to calculate a second proportion of the preset feature area of the human face in the scene image to the human face. The second calculation sub-unit 9424 may be configured to calculate the projection distance according to the first scale and the second scale.

Please refer to FIG. 1 again. In some embodiments, step 0423 and step 0424 may be implemented by the processor 805. That is to say, the processor 805 can also be used to calculate a second proportion of the preset feature area of the human face in the scene image to the human face, and calculate a projection distance according to the first and second proportions.

其中，D1为依据实际测量的第一比例R1计算得到的初始的投射距离，可以再依据关系式

求得进一步依据实际测量的第二比例R2计算得到的校准的投射距离D2，D2作为最终的投射距离。如此，依据第一比例和第二比例计算得到的投射距离考虑了不同用户之间的个体差异，能够获得更加客观的投射距离，进一步地可以基于较为准确的投射距离确定出较为准确的第一发光功率。 It can be understood that the face sizes of different users are different, so that when different users are at the same distance, the first proportion of the faces in the collected scene images is different. The second ratio is the ratio of the preset feature area of the human face to the human face. The preset feature area can select a feature area with a small difference between different user individuals. For example, the preset feature area can be the distance between the eyes of the user. When the second ratio is large, the user's face is small, and the projection distance calculated based on the first ratio is too large; when the second ratio is small, the user's face is large, only based on the first The calculated projection distance is too small. In actual use, the first ratio, the second ratio, and the projection distance can be calibrated in advance. Specifically, the user is directed to stand at a predetermined projection distance position and collect a scene image, and then calculate a first calibration ratio and a second calibration ratio corresponding to the scene image, and store the predetermined projection distance, the first calibration ratio, and the second The corresponding relationship of the scales is calibrated, so as to calculate the projection distance according to the actual first scale and the second scale in subsequent use. For example, instruct the user to stand at a projection distance of 25 cm and collect a scene image, and then calculate the first calibration ratio corresponding to the scene image is 50% and the second calibration ratio is 10%. In actual measurement, when calculated, When the first ratio is R1 and the second ratio is R2, according to the similar properties of the triangle,

Among them, D1 is the initial projection distance calculated according to the actually measured first ratio R1, which can be further based on the relationship

A calibrated projection distance D2, which is further calculated according to the actually measured second ratio R2, is obtained, and D2 is used as the final projection distance. In this way, the projection distance calculated according to the first ratio and the second ratio takes into account the individual differences between different users, and can obtain a more objective projection distance. Further, a more accurate first light emission can be determined based on a more accurate projection distance. power.

Referring to FIG. 14, in some embodiments, calculating the projection distance according to the first scale in step 0422 includes:

0425: Determine whether the user is wearing glasses based on the scene image; and

0426: Calculate the projection distance according to the first scale and the distance coefficient when the user wears glasses.

Referring to FIG. 15, in some embodiments, the second calculation unit 9422 further includes a first determination sub-unit 9425 and a third calculation sub-unit 9426. Step 0425 may be implemented by the first judging subunit 9425. Step 0426 may be implemented by the third calculation subunit 9426. That is to say, the first judging subunit 9425 can be used to judge whether the user wears glasses according to the scene image. The third calculation subunit 9426 may be configured to calculate a projection distance according to the first scale and the distance coefficient when the user wears glasses.

Please refer to FIG. 1 again. In some embodiments, step 0425 and step 0426 may be implemented by the processor 805. That is to say, the processor 805 may be further configured to determine whether the user wears glasses according to the scene image, and calculate the projection distance according to the first ratio and the distance coefficient when the user wears the glasses.

It can be understood that whether the user wears glasses can be used to characterize the health status of the user's eyes. Specifically, if the user wears glasses, it indicates that the user's eyes have suffered from related eye diseases or poor eyesight. The optical transmitter 100 emits laser light to the user wearing the glasses At this time, the light emitting power of the light transmitter 100 needs to be reduced so that the energy of the laser light emitted by the light transmitter 100 is small, so as not to cause damage to the eyes of the user. The preset distance coefficient can be a coefficient between 0 and 1, such as 0.6, 0.78, 0.82, 0.95, etc., for example, the initial projection distance is calculated according to the first ratio, or the first distance and the second ratio are calculated. After the calibrated projection distance, the initial projection distance or the calibrated projection distance is multiplied by the distance coefficient to obtain the final projection distance, and the first luminous power is calculated according to the projection distance. In this way, it is possible to avoid that the power of the emitted laser is too large to hurt the user suffering from eye disease or poor vision.

Referring to FIG. 16, in some embodiments, calculating the projection distance according to the first scale in step 0422 includes:

0427: judging the user's age based on the scene image; and

0428: Calculate the projection distance based on the first ratio and age.

Referring to FIG. 17, in some embodiments, the second calculation unit 9422 includes a second determination sub-unit 9427 and a fourth calculation sub-unit 9428. Step 0427 may be implemented by the second judgment subunit 9427, and step 0428 may be implemented by the fourth calculation subunit 9428. That is to say, the second judging subunit 9427 may be configured to judge the age of the user according to the scene image. The fourth calculation sub-unit 9428 may be configured to calculate the projection distance according to the first ratio and the age.

Please refer to FIG. 1 again. In some embodiments, step 0427 and step 0428 may be implemented by the processor 805. That is to say, the processor 805 may be configured to determine the age of the user according to the scene image, and calculate the projection distance according to the first scale and age.

People of different ages have different tolerances to infrared lasers. For example, children and the elderly are more susceptible to laser burns. For adults, lasers of appropriate intensity may cause harm to children. In this embodiment, the number, distribution, and area of feature points of facial wrinkles in the scene image can be extracted to determine the user's age, for example, the number of wrinkles at the corners of the eyes can be used to determine the user's age, or further combined with the user's forehead How many wrinkles are there to determine the user's age. After judging the user's age, the proportion coefficient can be obtained according to the age of the user. Specifically, the correspondence between age and the proportion coefficient can be found in a query table. For example, when the age is under 15 years, the proportion coefficient is 0.6 and the age is between When the age is 15 to 20, the scale factor is 0.8; when the age is 20 to 45, the scale factor is 1.0; when the age is 45 or more, the scale factor is 0.8. After knowing the scale factor, the initial projection distance calculated from the first scale or the calibrated projection distance calculated from the first and second scales can be multiplied by the scale factor to obtain the final projection distance. The first light emitting power is calculated according to the projection distance. In this way, excessive power of the emitted laser can be avoided to hurt young users or older users.

Referring to FIG. 18, in some embodiments, when step 07 does not have a human face in the scene image, controlling the light emitter 100 to emit light at the second light emission power and / or the second on frequency includes:

071: Obtain a projection distance between the target subject in the scene and the light emitter 100;

072: Get the ambient brightness of the scene; and

073: Calculate the second luminous power according to the ambient brightness and the projection distance.

Referring to FIG. 19, in some embodiments, the control module 95 includes a first obtaining unit 951, a second obtaining unit 952, and a third computing unit 953. Step 071 may be implemented by the first obtaining unit 951. Step 072 may be performed by the second obtaining unit 952. Step 073 may be performed by the third calculation unit 953. That is to say, the first acquiring unit 951 may be configured to acquire a projection distance between the target subject in the scene and the light emitter 100. The second obtaining unit 952 may be configured to obtain the ambient brightness of the scene. The third calculation unit 953 may be configured to calculate the second light emitting power according to the ambient brightness and the projection distance.

Please refer to FIG. 1 again. In some embodiments, steps 071, 072, and 073 can all be implemented by the processor 805. That is to say, the processor 805 may be configured to obtain a projection distance between the target subject in the scene and the light emitter 100, obtain the ambient brightness of the scene, and calculate the second light emitting power according to the ambient brightness and the projection distance.

The projection distance between the target subject in the scene and the light transmitter 100 may be obtained by the time-of-flight depth camera 300. Specifically, the light transmitter 100 emits laser light at a preset light emission power and a predetermined light emission frequency, the light receiver 200 receives the laser light reflected by an object in the scene, and the processor 805 calculates the scene based on the laser light received by the light receiver 200. Initial depth information. Subsequently, the processor 805 determines the target subject from the scene. Since the target subject is generally located in the central area of the field of view of the light receiver 200, the central area of the field of view of the light receiver 200 can be used as the area where the target subject is located, and the central The initial depth information of the pixels of this part of the region is used as the initial depth information of the target subject. Generally, there are multiple values of the initial depth information of the target subject. The processor 805 can calculate the average or median value of the multiple initial depth information, and use the average or median value as the projection between the light emitter 100 and the target subject. distance. In this way, the projection distance between the light emitter 100 and the target subject can be obtained by the time-of-flight depth camera 300.

The ambient brightness can be detected by the light sensor, and the processor 805 reads the detected ambient brightness from the light sensor. Alternatively, the ambient brightness may be detected by an infrared camera (which may be the light receiver 200) or a visible light camera 400. The infrared camera or the visible light camera 400 captures an image of a scene, and the processor 805 calculates the brightness value of the image as the ambient brightness.

After determining the ambient brightness and the projection distance, the processor 805 jointly calculates the second light emitting power based on the two parameters of the ambient brightness and the projection distance.

It can be understood that when the ambient brightness is high, there are more infrared light components in the ambient light, and there are also more portions where the infrared light in the ambient light coincides with the wavelength band of the infrared laser light emitted by the light transmitter 100. At this time, The optical receiver 200 receives both the infrared laser light emitted by the optical transmitter 100 and the infrared light in the ambient light. If the light emitting power of the infrared laser emitted by the optical transmitter 100 is low, the light from the light received by the optical receiver 200 comes from the light. The ratio between the infrared laser of the transmitter 100 and the infrared light from the ambient light is not much different, which will cause the time when the light receiver 200 receives the light to be inaccurate, or the total amount of light received by the light receiver 200 will be insufficient. Accuracy will further reduce the accuracy of acquiring depth information. Therefore, the transmission power of the infrared laser emitted by the optical transmitter 100 needs to be increased to reduce the influence of the infrared light in the environment on the optical receiver 200 receiving the infrared laser from the optical transmitter 100 ; And when the ambient brightness is low, the infrared light component contained in the ambient light is less, at this time, if the light emitter 100 uses a higher luminous power to emit light, the electricity will increase. Power consumption of the sub-device 800. In addition, when the projection distance is long, the laser flight time is long, the flight distance is long, and the laser loss is large, which will affect the accuracy of the depth information acquisition. Therefore, when the projection distance is large, the second light emitting power of the light transmitter 100 can be appropriately increased. When the projection distance is small, the second light emitting power of the light transmitter 100 can be appropriately reduced.

In this way, jointly determining the second light emitting power of the light transmitter 100 based on the ambient brightness and the projection distance can reduce the power consumption of the electronic device 800 on the one hand, and improve the accuracy of obtaining the depth information of the scene on the other hand.

When there is no human face in the scene, the second turning-on frequency of the light transmitter 100 may be determined according to the application scenario. For example, when the application scenario is to unlock the electronic device 800 based on a three-dimensional face, the light receiver 200 usually only needs to output a few depth images per second, for example, 3 frames per second, 4 frames per second, Output 5 frames per second, etc., at this time, the second turn-on frequency of the light transmitter 100 can be set to 3 times / second, 4 times / second, 5 times / second, etc .; the application scenario is for the user to record the During video, the optical receiver 200 usually needs to output more depth images per second, for example, 30 frames per second and 60 frames per second. At this time, the second turn-on frequency of the optical transmitter 100 can be set correspondingly. 30 times / second, 60 times / second, etc. In this way, based on different application scenarios, the opening frequency that is most suitable for each application scenario is set to meet the needs of users.

Please refer to FIG. 1 and FIG. 21 together. The electronic device 800 according to the embodiment of the present application includes a casing 801 and a time-of-flight depth camera 300.

The housing 801 may serve as a mounting carrier for the functional elements of the electronic device 800. The housing 801 can provide protection for the functional components from dust, drop, and water. The functional components can be a display screen 802, a visible light camera 400, a receiver, and the like. In the embodiment of the present application, the housing 801 includes a main body 803 and a movable bracket 804. The movable bracket 804 can move relative to the main body 803 under the driving of a driving device. For example, the movable bracket 804 can slide relative to the main body 803 to slide Slide in or out of the main body 803 (as shown in FIG. 20). Some functional elements (such as display 802) can be installed on the main body 803, and other functional elements (such as time-of-flight depth camera 300, visible light camera 400, and receiver) can be installed on the movable bracket 804, which can be driven by the movement of the movable bracket 804 The other functional element is retracted into or protruded from the main body 803. Of course, the embodiments shown in FIG. 1 and FIG. 21 are merely examples of a specific form of the casing 801, and cannot be understood as a limitation on the casing 801 of the present application.

A time-of-flight depth camera 300 is mounted on the housing 801. Specifically, the casing 801 may be provided with an acquisition window, and the time-of-flight camera 300 is aligned with the acquisition window so that the time-of-flight camera 300 acquires depth information. In a specific embodiment of the present application, the time-of-flight depth camera 300 is mounted on a movable bracket 804. When the user needs to use the time-of-flight depth camera 300, the user can trigger the movable bracket 804 to slide out from the main body 803 to drive the time-of-flight depth camera 300 to protrude from the main body 803; when the time-of-flight depth camera 300 is not required, it can be triggered The movable bracket 804 slides into the main body 803 to cause the time-of-flight camera 300 to retract into the main body.

Please refer to FIGS. 21 to 23 together. The time-of-flight depth camera 300 includes a first substrate assembly 71, a pad 72, a light emitter 100 and a light receiver 200. The first substrate assembly 71 includes a first substrate 711 and a flexible circuit board 712 connected to each other. The spacer 72 is disposed on the first substrate 711. The light emitter 100 is used for projecting laser light outward, and the light emitter 100 is disposed on the cushion block 72. The flexible circuit board 712 is bent and one end of the flexible circuit board 712 is connected to the first substrate 711 and the other end is connected to the light emitter 100. The light receiver 200 is disposed on the first substrate 711. The light receiver 200 is configured to receive laser light reflected by a person or an object in a scene. The light receiver 200 includes a housing 741 and an optical element 742 provided on the housing 741. The housing 741 is integrally connected with the pad 72.

Specifically, the first substrate assembly 71 includes a first substrate 711 and a flexible circuit board 712. The first substrate 711 may be a printed wiring board or a flexible wiring board. The control circuit and the like of the time-of-flight camera 300 may be laid on the first substrate 711. One end of the flexible circuit board 712 may be connected to the first substrate 711. The flexible circuit board 712 can be bent at a certain angle, so that the relative positions of the devices connected at both ends of the flexible circuit board 712 can be selected.

The spacer 72 is disposed on the first substrate 711. In one example, the spacer 72 is in contact with the first substrate 711 and is carried on the first substrate 711. Specifically, the spacer 72 may be combined with the first substrate 711 by means of adhesion or the like. The material of the spacer 72 may be metal, plastic, or the like. In the embodiment of the present application, a surface on which the pad 72 is combined with the first substrate 711 may be a flat surface, and a surface on which the pad 72 is opposite to the combined surface may also be a flat surface, so that the light emitter 100 is disposed on the pad 72. It has better smoothness.

The light receiver 200 is disposed on the first substrate 711, and the contact surface between the light receiver 200 and the first substrate 711 is substantially flush with the contact surface between the pad 72 and the first substrate 711 (that is, the installation starting point of the two is at On the same plane). Specifically, the light receiver 200 includes a housing 741 and an optical element 742. The casing 741 is disposed on the first substrate 711, and the optical element 742 is disposed on the casing 741. The casing 741 may be a lens holder and a lens barrel of the light receiver 200, and the optical element 742 may be an element such as a lens disposed in the casing 741. Further, the light receiver 200 further includes a photosensitive chip (not shown), and the laser light reflected by a person or an object in the scene passes through the optical element 742 and is irradiated into the photosensitive chip, and the photosensitive chip generates a response to the laser. In the embodiment of the present application, the housing 741 and the cushion block 72 are integrally connected. Specifically, the casing 741 and the cushion block 72 may be integrally formed; or the materials of the casing 741 and the cushion block 72 are different, and the two are integrally formed by two-color injection molding or the like. The housing 741 and the spacer 72 may also be separately formed, and the two form a matching structure. When assembling the time-of-flight depth camera 300, one of the housing 741 and the spacer 72 may be set on the first substrate 711, and then the other One is disposed on the first substrate 711 and connected integrally.

In this way, the light transmitter 100 is disposed on the pad 72, which can increase the height of the light transmitter 100, thereby increasing the height of the surface on which the laser is emitted by the light transmitter 100. The laser light emitted by the light transmitter 100 is not easily received by the light The device 200 is blocked, so that the laser light can be completely irradiated on the measured object in the target space.

With reference to FIG. 23, the light emitter 100 includes a second substrate assembly 51, a light emitting assembly 101 and a housing 52. The second substrate assembly 51 is disposed on the pad 72, and the second substrate assembly 51 is connected to the flexible circuit board 712. The light emitting component 101 is disposed on the second substrate component 51, and the light emitting component 101 is used for emitting laser light. The casing 52 is disposed on the second substrate assembly 51. The casing 52 is formed with a receiving space 521, and the receiving space 521 can be used for receiving the light emitting module 101. The flexible circuit board 712 may be detachably connected to the second substrate assembly 51. The light emitting component 101 is connected to the second substrate component 51. The housing 52 may be bowl-shaped as a whole, and the opening of the housing 52 is disposed on the second substrate assembly 51 downwardly to accommodate the light emitting assembly 101 in the receiving space 521. In the embodiment of the present application, the housing 52 is provided with a light emitting port 522 corresponding to the light emitting component 101. The laser light emitted from the light emitting component 101 passes through the light emitting port 522 and is emitted. The laser light can pass directly through the light emitting port 522. It can also pass through the light exit port 522 after changing the optical path through other optical devices.

The second substrate assembly 51 includes a second substrate 511 and a reinforcing member 512. The second substrate 511 is connected to the flexible circuit board 712. The light emitting component 101 and the reinforcing member 512 are disposed on opposite sides of the second substrate 511. A specific type of the second substrate 511 may be a printed circuit board or a flexible circuit board, and a control circuit may be laid on the second substrate 511. The reinforcing member 512 can be fixedly connected to the second substrate 511 by gluing, riveting, or the like. The reinforcing member 512 can increase the overall strength of the second substrate assembly 51. When the light emitter 100 is disposed on the pad 72, the reinforcing member 512 can directly contact the pad 72, the second substrate 511 is not exposed to the outside, and does not need to be in direct contact with the pad 72, and the second substrate 511 is not vulnerable Contamination by dust, etc.

The reinforcing member 512 and the cushion block 72 are separately formed. When assembling the time-of-flight camera 300, the spacer 72 may be mounted on the first substrate 71. At this time, the two ends of the flexible circuit board 712 are respectively connected to the first substrate 711 and the second substrate 511, and the flexible circuit board 712 may Don't bend it. The flexible circuit board 712 is then bent, so that the reinforcing member 512 is disposed on the cushion block 72. Of course, in other embodiments, the reinforcing member 512 and the spacer 72 may be integrally formed, for example, integrally formed by a process such as injection molding. When assembling the time-of-flight depth camera 300, the spacer 72 and the light emitter 100 may be installed together. On the first substrate 711.

Referring to FIG. 24, the light emitting component 101 includes a light source 10, a diffuser 20, a lens barrel 30, a protective cover 40, and a driver 61.

The lens barrel 30 includes a ring-shaped lens barrel sidewall 33, and the ring-shaped lens barrel sidewall 33 surrounds a receiving cavity 62. The side wall 33 of the lens barrel includes an inner surface 331 located in the receiving cavity 62 and an outer surface 332 opposite to the inner surface. The side wall 33 of the lens barrel includes a first surface 31 and a second surface 32 opposite to each other. The receiving cavity 62 penetrates the first surface 31 and the second surface 32. The first surface 31 is recessed toward the second surface 32 to form a mounting groove 34 communicating with the receiving cavity 62. The bottom surface 35 of the mounting groove 34 is located on a side of the mounting groove 34 remote from the first surface 31. The outer surface 332 of the side wall 33 of the lens barrel is circular at one end of the first surface 31, and the outer surface 332 of the side wall 33 of the lens barrel is formed with an external thread at one end of the first surface 31. The lens barrel 30 is carried on a second substrate 511. The second substrate 511 may be a circuit board 511. The circuit board 511 is in contact with the second surface 32 of the lens barrel 30 to close one end of the receiving cavity 62.

The light source 10 is carried on the circuit board 511 and is housed in the receiving cavity 62. The light source 10 is configured to emit laser light toward the first surface 31 (the mounting groove 34) side of the lens barrel 30. The light source 10 may be a single-point light source or a multi-point light source. When the light source 10 is a point light source, the light source 10 may specifically be an edge-emitting laser, for example, a distributed feedback laser (Distributed Feedback Laser, DFB), etc .; when the light source 10 is a multi-point light source, the light source 10 may be vertical A cavity-surface emitter (Vertical-Cavity Surface Laser, VCSEL), or the light source 10 may also be a multi-point light source composed of multiple edge-emitting lasers. The vertical cavity surface emitting laser has a small height, and the use of the vertical cavity surface emitter as the light source 10 is beneficial to reducing the height of the light emitter 100 and facilitating the integration of the light emitter 100 into a mobile phone and other requirements on the thickness of the fuselage. Electronic device 800. Compared with the vertical cavity surface emitter, the temperature drift of the side-emitting laser is smaller, and the influence of the temperature on the effect of the projected laser light from the light source 10 can be reduced.

The driver 61 is carried on the circuit board 511 and is electrically connected to the light source 10. Specifically, the driver 61 may receive the modulation signal modulated by the processor 805805, and convert the modulation signal into a constant current source and transmit the modulated signal to the light source 10, so that the light source 10 is directed toward the first position of the lens barrel 30 under the action of the constant current source. The one side 31 emits laser light. The driver 61 of this embodiment is provided outside the lens barrel 30. In other embodiments, the driver 61 may be disposed in the lens barrel 30 and carried on the circuit board 511.

The diffuser 20 is mounted (supported) in the mounting groove 34 and abuts the mounting groove 34. The diffuser 20 is used to diffuse the laser light passing through the diffuser 20. That is, when the light source 10 emits laser light toward the first surface 31 side of the lens barrel 30, the laser light passes through the diffuser 20 and is diffused or projected outside the lens barrel 30 by the diffuser 20.

The protective cover 40 includes a top wall 41 and a protective sidewall 42 extending from one side of the top wall 41. A light through hole 401 is defined in the center of the top wall 41. The protective side wall 42 is disposed around the top wall 41 and the light through hole 401. The top wall 41 and the protection side wall 42 together form a mounting cavity 43, and the light-passing hole 401 communicates with the mounting cavity 43. The cross-section of the inner surface of the protective sidewall 42 is circular, and an inner thread is formed on the inner surface of the protective sidewall 42. The internal thread of the protective sidewall 42 is screwed with the external thread of the lens barrel 30 to mount the protective cover 40 on the lens barrel 30. The interference between the top wall 41 and the diffuser 20 causes the diffuser 40 to be sandwiched between the top wall 41 and the bottom surface 35 of the mounting groove 34.

In this way, the opening 20 is installed in the lens barrel 30, and the diffuser 20 is installed in the installation groove 34, and the protective cover 40 is installed on the lens barrel 30 to clamp the diffuser 20 between the protective cover 40 and the installation groove. Between the bottom surfaces 35 of 34, the diffuser 20 is fixed on the lens barrel 30. In this way, it is not necessary to fix the diffuser 20 to the lens barrel 30 by using glue, which can prevent the gas glue from diffusing and solidifying on the surface of the diffuser 20 after the glue is volatilized to affect the microstructure of the diffuser 20, and can avoid diffusion The diffuser 20 falls off from the lens barrel 30 when the glue of the device 20 and the lens barrel 30 decreases due to aging.

Please refer to FIG. 1 again, the present application further provides an electronic device 800. The electronic device includes the time-of-flight depth camera 300 according to any one of the above embodiments, one or more processors 805, a memory 806, and one or more programs. One or more programs are stored in the memory 806, and are configured to be executed by one or more processors 806. The programs include instructions for performing the control method according to any one of the foregoing embodiments.

For example, in conjunction with Figure 2, the program includes instructions for performing the following steps:

01: Get the scene image of the scene;

03: identify whether a human face exists in the scene image;

05: when a human face is present in the scene image, controlling the light transmitter 100 to emit light at a first light emitting power and / or a first on frequency;

07: When a human face does not exist in the scene image, the light transmitter 100 is controlled to emit light at the second emission power and / or the second on frequency.

For another example, in conjunction with FIG. 6, the program further includes instructions for performing the following steps:

041: determine an application scenario of the light transmitter 100;

051: when the application scene is the first scene and the face exists in the scene image, controlling the light transmitter 100 to emit light at the first light emission power and the first sub-on frequency; and

052: When the application scene is the second scene and the human face is present in the scene image, the light transmitter 100 is controlled to emit light at the first light emission power and the second sub-on frequency.

As another example, in conjunction with FIG. 8, the program further includes instructions for performing the following steps:

042: Obtain the projection distance between the user and the light transmitter 100; and

043: Calculate the first luminous power according to the projection distance.

As another example, in conjunction with FIG. 9, the program further includes instructions for performing the following steps:

0421: Calculate the first proportion of faces in the scene image; and

0422: Calculate the projection distance according to the first scale.

For another example, in conjunction with FIG. 12, the program further includes instructions for performing the following steps:

0423: Calculate the second proportion of the preset feature area of the human face in the scene image; and

0424: Calculate the projection distance according to the first scale and the second scale.

For another example, in conjunction with FIG. 14, the program further includes instructions for performing the following steps:

0425: Determine whether the user is wearing glasses based on the scene image; and

0426: Calculate the projection distance according to the first scale and the distance coefficient when the user wears glasses.

For another example, in conjunction with FIG. 16, the program further includes instructions for performing the following steps:

0427: judging the user's age based on the scene image; and

0428: Calculate the projection distance based on the first ratio and age.

As another example, in conjunction with FIG. 18, the program further includes instructions for performing the following steps:

071: Obtain a projection distance between the target subject in the scene and the light emitter 100;

072: Get the ambient brightness of the scene; and

073: Calculate the second luminous power according to the ambient brightness and the projection distance.

Referring to FIG. 25, the present application further provides a computer-readable storage medium 900. The computer-readable storage medium 900 includes a computer program used in conjunction with the electronic device 800, and the computer program can be executed by the processor 805 to complete the control method according to any one of the foregoing embodiments.

For example, in conjunction with FIG. 2, the computer program may be executed by the processor 805 to complete the following steps:

01: Get the scene image of the scene;

03: identify whether a human face exists in the scene image;

05: when a human face is present in the scene image, controlling the light transmitter 100 to emit light at a first light emitting power and / or a first on frequency;

07: When a human face does not exist in the scene image, the light transmitter 100 is controlled to emit light at the second emission power and / or the second on frequency.

For another example, in conjunction with FIG. 6, the computer program can also be executed by the processor 805 to complete the following steps:

041: determine an application scenario of the light transmitter 100;

051: when the application scene is the first scene and the face exists in the scene image, controlling the light transmitter 100 to emit light at the first light emission power and the first sub-on frequency; and

052: When the application scene is the second scene and the human face is present in the scene image, the light transmitter 100 is controlled to emit light at the first light emission power and the second sub-on frequency.

For another example, in conjunction with FIG. 8, the computer program may also be executed by the processor 805 to complete the following steps:

042: Obtain the projection distance between the user and the light transmitter 100; and

043: Calculate the first luminous power according to the projection distance.

As another example, in conjunction with FIG. 9, the computer program may also be executed by the processor 805 to complete the following steps:

0421: Calculate the first proportion of faces in the scene image; and

0422: Calculate the projection distance according to the first scale.

As another example, in conjunction with FIG. 12, the computer program may also be executed by the processor 805 to complete the following steps:

0423: Calculate the second proportion of the preset feature area of the human face in the scene image; and

0424: Calculate the projection distance according to the first scale and the second scale.

For another example, in conjunction with FIG. 14, the computer program may also be executed by the processor 805 to complete the following steps:

0425: Determine whether the user is wearing glasses based on the scene image; and

0426: Calculate the projection distance according to the first scale and the distance coefficient when the user wears glasses.

For another example, in conjunction with FIG. 16, the computer program may also be executed by the processor 805 to complete the following steps:

0427: judging the user's age based on the scene image; and

0428: Calculate the projection distance based on the first ratio and age.

For another example, in conjunction with FIG. 18, the computer program may also be executed by the processor 805 to complete the following steps:

071: Obtain a projection distance between the target subject in the scene and the light emitter 100;

072: Get the ambient brightness of the scene; and

073: Calculate the second luminous power according to the ambient brightness and the projection distance.

In the description of this specification, the description with reference to the terms “one embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” and the like means specific features described in conjunction with the embodiments or examples , Structure, material, or characteristic is included in at least one embodiment or example of the present application. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Moreover, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. In addition, without any contradiction, those skilled in the art may combine and combine different embodiments or examples and features of the different embodiments or examples described in this specification.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "a plurality" is at least two, for example, two, three, etc., unless it is specifically and specifically defined otherwise.

Any process or method description in a flowchart or otherwise described herein can be understood as a module, fragment, or portion of code that includes one or more executable instructions for implementing a particular logical function or step of a process And, the scope of the preferred embodiments of this application includes additional implementations in which the functions may be performed out of the order shown or discussed, including performing the functions in a substantially simultaneous manner or in the reverse order according to the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present application pertain.

Logic and / or steps represented in a flowchart or otherwise described herein, for example, a sequenced list of executable instructions that may be considered to implement a logical function, may be embodied in any computer-readable medium, For use by, or in combination with, an instruction execution system, device, or device (such as a computer-based system, a system that includes a processor, or another system that can fetch and execute instructions from an instruction execution system, device, or device) Or equipment. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connections (electronic devices) with one or more wirings, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable Processing to obtain the program electronically and then store it in computer memory.

It should be understood that each part of the application may be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods may be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it may be implemented using any one or a combination of the following techniques known in the art: Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gate circuits, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

A person of ordinary skill in the art can understand that all or part of the steps carried by the methods in the foregoing embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium. The program is When executed, one or a combination of the steps of the method embodiment is included.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, or each unit may exist separately physically, or two or more units may be integrated into one module. The above integrated modules may be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

The aforementioned storage medium may be a read-only memory, a magnetic disk, or an optical disk. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application. Those skilled in the art may, within the scope of the present application, understand the above. Embodiments are subject to change, modification, substitution, and modification.

Claims (26)

A control method of an optical transmitter, characterized in that the control method includes: Get the scene image of the scene; Identifying whether a human face exists in the scene image; When the human face is present in the scene image, controlling the light emitter to emit light at a first light emitting power and / or a first on frequency; When the human face does not exist in the scene image, controlling the light emitter to emit light at a second light emitting power and / or a second on frequency. The control method according to claim 1, wherein the first turn-on frequency comprises a first sub-turn-on frequency and a second sub-turn-on frequency, and the control method further comprises: Judging an application scenario of the light transmitter; When the human face is present in the scene image, the step of controlling the light emitter to emit light at a first light emission power and / or a first on frequency includes: When the application scene is a first scene and the human face is present in the scene image, controlling the light emitter to emit light at the first light emission power and the first sub-on frequency; and When the application scene is a second scene and the human face is present in the scene image, controlling the light emitter to emit light at the first light emission power and the second sub-on frequency. The control method according to claim 1, wherein after the step of identifying whether a face exists in the scene image, the control method further comprises: Obtaining a projection distance between a user and the light emitter; and Calculate the first light emitting power according to the projection distance. The control method according to claim 3, wherein the step of obtaining a projection distance between the user and the light transmitter comprises: Calculating a first proportion of the face in the scene image; and Calculating the projection distance according to the first ratio. The control method according to claim 4, wherein the step of calculating the projection distance according to the first ratio comprises: Calculating a second ratio of the preset feature area of the human face in the scene image to the human face; and Calculate the projection distance according to the first ratio and the second ratio. The control method according to claim 4, wherein the step of calculating the projection distance according to the first ratio comprises: Determining whether the user is wearing glasses according to the scene image; and Calculating the projection distance according to the first scale and the distance coefficient when the user wears glasses. The control method according to claim 4, wherein the step of calculating the projection distance according to the first ratio comprises: Judging the age of the user based on the scene image; and Calculate the projection distance according to the first ratio and the age. The control method according to claim 1, wherein the step of controlling the light emitter to emit light at a second light emission power and / or a second on frequency when the human face does not exist in the scene image comprises: Obtaining a projection distance between a target subject in the scene and the light emitter; Obtaining the ambient brightness of the scene; and The second light emitting power is calculated according to the ambient brightness and the projection distance. A control device for a light transmitter, characterized in that the control device includes: A first acquisition module, where the first acquisition module is configured to acquire a scene image of a scene; A recognition module for identifying whether a human face exists in the scene image; and A control module for: When the human face is present in the scene image, controlling the light emitter to emit light at a first light emitting power and / or a first on frequency; and When the human face does not exist in the scene image, controlling the light emitter to emit light at a second light emitting power and / or a second on frequency. The control device according to claim 9, wherein the first turn-on frequency comprises a first sub-turn-on frequency and a second sub-turn-on frequency, and the control device further comprises a judgment module, wherein the judgment module is configured to Describe the application scenarios of light transmitters; The control module may further be: When the application scene is a first scene and the human face is present in the scene image, controlling the light emitter to emit light at the first light emission power and the first sub-on frequency; and When the application scene is a second scene and the human face is present in the scene image, controlling the light emitter to emit light at the first light emission power and the second sub-on frequency. The control device according to claim 9, wherein the control device further comprises: A second acquisition module for acquiring a projection distance between a user and the light transmitter; and A calculation module for calculating the first luminous power according to the projection distance. The control device according to claim 11, wherein the second acquisition module comprises: A first calculation unit configured to calculate a first proportion of the face in the scene image; and A second calculation unit, configured to calculate the projection distance according to the first ratio. The control device according to claim 12, wherein the second calculation unit comprises: A first calculation subunit, configured to calculate a second proportion of the preset feature area of the face in the scene image to the face; and A second calculation subunit, configured to calculate the projection distance according to the first ratio and the second ratio. The control device according to claim 12, wherein the second calculation unit comprises: A first determining subunit, configured to determine whether the user wears glasses according to the scene image; and A third calculation subunit, where the third subunit is configured to calculate the projection distance according to the first scale and a distance coefficient when the user wears glasses. The control device according to claim 12, wherein the second calculation unit comprises: A second determining subunit, configured to determine the age of the user according to the scene image; and A fourth calculation subunit, configured to calculate the projection distance according to the first ratio and the age. The control device according to claim 9, wherein the control module comprises: A first obtaining unit, configured to obtain a projection distance between a target subject in the scene and the light emitter; A second acquisition unit configured to acquire the ambient brightness of the scene; and A third calculation unit, configured to calculate the second luminous power according to the ambient brightness and the projection distance. A time-of-flight camera, characterized in that the time-of-flight camera includes a light transmitter and a processor, and the processor is used for: Get the scene image of the scene; Identifying whether a human face exists in the scene image; When the human face is present in the scene image, controlling the light emitter to emit light at a first light emitting power and / or a first on frequency; When the human face does not exist in the scene image, controlling the light emitter to emit light at a second light emitting power and / or a second on frequency. The time-of-flight depth camera according to claim 17, wherein the processor is further configured to: Judging an application scenario of the light transmitter; When the application scene is a first scene and the human face is present in the scene image, controlling the light emitter to emit light at the first light emission power and the first sub-on frequency; and When the application scene is a second scene and the human face is present in the scene image, controlling the light emitter to emit light at the first light emission power and the second sub-on frequency. The time-of-flight depth camera according to claim 17, wherein the processor is further configured to: Obtaining a projection distance between a user and the light emitter; and Calculate the first light emitting power according to the projection distance. The time-of-flight depth camera according to claim 19, wherein the processor is further configured to: Calculating a first proportion of the face in the scene image; and Calculating the projection distance according to the first ratio. The time-of-flight depth camera according to claim 20, wherein the processor is further configured to: Calculating a second ratio of the preset feature area of the human face in the scene image to the human face; and Calculate the projection distance according to the first ratio and the second ratio. The time-of-flight depth camera according to claim 20, wherein the processor is further configured to: Determining whether the user is wearing glasses according to the scene image; and Calculating the projection distance according to the first scale and the distance coefficient when the user wears glasses. The time-of-flight depth camera according to claim 20, wherein the processor is further configured to: Judging the age of the user based on the scene image; and Calculate the projection distance according to the first ratio and the age. The time-of-flight depth camera according to claim 17, wherein the processor is further configured to: Obtaining a projection distance between a target subject in the scene and the light emitter; Obtaining the ambient brightness of the scene; and The second light emitting power is calculated according to the ambient brightness and the projection distance. An electronic device is characterized in that the electronic device includes: The time-of-flight depth camera according to any one of claims 17-24; One or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the programs include instructions for performing any of claims 1 to 8 An instruction for a control method as described. A computer-readable storage medium, comprising a computer program used in combination with an electronic device, the computer program being executable by a processor to complete the control method according to any one of claims 1 to 8.

Images