Disclosure of Invention
The embodiment of the invention provides a laser projection module, a depth camera and an electronic device.
The laser projection module of the embodiment of the invention comprises:
a substrate assembly;
the lens cone comprises a lens cone side wall, the lens cone side wall is arranged on the substrate assembly and forms an accommodating cavity together with the substrate assembly, the lens cone comprises a limiting bulge protruding inwards from the lens cone side wall, the limiting bulge comprises a first limiting surface and a second limiting surface which are opposite, and a detection through hole penetrating through the first limiting surface and the second limiting surface is formed in the limiting bulge;
a light source disposed on the substrate assembly and configured to emit laser light to the accommodation cavity;
a collimating element received within the receiving cavity;
the diffractive optical element is arranged on one side of the limiting bulge, which is opposite to the collimating element; and
the detection device comprises a transmitter and a receiver, wherein the transmitter and the receiver are aligned to two ends of the detection through hole, one of the transmitter and the receiver is arranged on the collimation element, the other one of the transmitter and the receiver is arranged on the diffraction optical element, the transmitter is used for transmitting a detection signal into the detection through hole, and the receiver is used for receiving the detection signal passing through the detection through hole.
In some embodiments, the collimating element comprises a bonding surface bonded to the second limiting surface, the diffractive optical element comprises a mounting surface bonded to the first limiting surface;
the transmitter is arranged on the combining surface, and the receiver is arranged on the mounting surface; or
The transmitter is arranged on the mounting surface, and the receiver is arranged on the combining surface.
In some embodiments, the number of the detection through holes is multiple, and the number of the detection devices is the same as the number of the detection through holes and corresponds to the positions of the detection through holes.
In some embodiments, the transmitter is a light emitter and is configured to emit detection light, and the receiver is a light receiver and is configured to receive detection light passing through the detection via.
In some embodiments, the inner wall of the detection through hole is formed with a light absorption film for absorbing the detection light irradiated on the light absorption film.
In some embodiments, the light source comprises an edge-emitting laser comprising a light emitting face, the light emitting face facing the collimating element.
In some embodiments, the laser projection module further comprises a fixing member for fixing the edge-emitting laser to the substrate assembly.
In some embodiments, the fixing member includes an encapsulant disposed between the edge-emitting laser and the substrate assembly, and the encapsulant is a thermally conductive adhesive.
In some embodiments, the fixing member includes at least two elastic support frames disposed on the substrate assembly, at least two of the support frames together form a receiving space for receiving the edge-emitting laser, and at least two of the support frames are used for supporting the edge-emitting laser.
The depth camera of the embodiment of the invention comprises:
the laser projection module of any of the above embodiments;
the image collector is used for collecting the laser patterns projected into the target space after passing through the diffractive optical element; and
and the processor is respectively connected with the laser projection module and the image collector and is used for processing the laser pattern to obtain a depth image.
An electronic device according to an embodiment of the present invention includes:
a housing; and
the depth camera of the above embodiment disposed within and exposed from the housing to acquire a depth image
In the laser projection module, the depth camera and the electronic device of the embodiment of the invention, one of the emitter and the receiver is arranged on the collimating element, and the other is arranged on the diffractive optical element.
Additional aspects and advantages of embodiments of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of embodiments of the invention.
Detailed Description
The following further describes embodiments of the present invention with reference to the drawings. The same or similar reference numbers in the drawings identify the same or similar elements or elements having the same or similar functionality throughout.
In addition, the embodiments of the present invention described below with reference to the accompanying drawings are exemplary only for the purpose of explaining the embodiments of the present invention, and are not to be construed as limiting the present invention.
In the present invention, unless otherwise expressly stated or limited, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through an intermediate. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.
Referring to fig. 1, an electronic device 1000 according to an embodiment of the invention includes a housing 200 and a depth camera 100. The electronic device 1000 may be a mobile phone, a tablet computer, a laptop computer, a game machine, a head display device, an access control system, a teller machine, etc., and the embodiment of the present invention is described by taking the electronic device 1000 as a mobile phone, it is understood that the specific form of the electronic device 1000 may be other, and is not limited herein. The depth camera 100 is disposed in the housing 200 and exposed from the housing 200 to obtain a depth image, the housing 200 can provide protection for the depth camera 100, such as dust prevention, water prevention, and falling prevention, and a hole corresponding to the depth camera 100 is formed in the housing 200, so that light passes through the hole or penetrates into the housing 200.
Referring to fig. 2, the depth camera 100 includes a laser projection module 10, an image collector 20 and a processor 30. The depth camera 100 may be formed with a projection window 40 corresponding to the laser projection module 10, and a collection window 50 corresponding to the image collector 20. The laser projection module 10 is configured to project a laser pattern to a target space through the projection window 40, and the image collector 20 is configured to collect the laser pattern modulated by a target object through the collection window 50. In one example, the laser projected by the laser projection module 10 is infrared light, and the image collector 20 is an infrared camera. The processor 30 is connected to both the laser projection module 10 and the image collector 20, and the processor 30 is configured to process the laser pattern to obtain a depth image. Specifically, the processor 30 calculates the deviation value between each pixel point in the laser pattern and each corresponding pixel point in the reference pattern by using an image matching algorithm, and further obtains the depth image of the laser pattern according to the deviation value. The Image matching algorithm may be a Digital Image Correlation (DIC) algorithm. Of course, other image matching algorithms may be employed instead of the DIC algorithm. The structure of the laser projection module 10 will be further described below.
Referring to fig. 3 and 4, the laser projection module 10 includes a substrate assembly 11, a lens barrel 12, a light source 13, a collimating element 14, a diffractive optical element 15, and a detecting device 16. The light source 13, the collimating element 14 and the diffractive optical element 15 are arranged in this order on the optical path of the light source 13, in particular, the light emitted by the light source 13 passes through the collimating element 14 and the diffractive optical element 15 in this order.
The substrate assembly 11 includes a substrate 111 and a circuit board 112 carried on the substrate 111. The substrate 111 is used to carry the lens barrel 12, the light source 13, and the circuit board 112. The material of the substrate 111 may be plastic, such as at least one of Polyethylene Terephthalate (PET), Polymethyl Methacrylate (PMMA), Polycarbonate (PC), and Polyimide (PI). That is, the substrate 111 may be made of a single plastic material selected from PET, PMMA, PC, and PI. Thus, the substrate 111 is light in weight and has sufficient support strength.
The circuit board 112 may be any one of a printed circuit board, a flexible circuit board, and a rigid-flex board. The circuit board 112 may be provided with a via hole 113, the via hole 113 may be used to accommodate the light source 13, a portion of the circuit board 112 is covered by the lens barrel 12, and another portion of the circuit board extends out and may be connected to the connector 17, and the connector 17 may connect the laser projection module 10 to a main board of the electronic device 1000.
Referring to fig. 3, the lens barrel 12 is disposed on the substrate assembly 11 and forms a receiving cavity 121 together with the substrate assembly 11. Specifically, the lens barrel 12 may be connected to the circuit board 112 of the substrate assembly 11, and the lens barrel 12 and the circuit board 112 may be adhered by an adhesive to improve the air tightness of the accommodating chamber 121. Of course, the lens barrel 12 and the substrate assembly 11 may be connected in other specific ways, such as by a snap connection. The accommodating cavity 121 may be used to accommodate components such as the collimating element 14 and the diffractive optical element 15, and the accommodating cavity 121 simultaneously forms a part of the optical path of the laser projection module 10. In the embodiment of the present invention, the lens barrel 12 is in a hollow cylindrical shape, and the lens barrel 12 includes a barrel sidewall 122 and a limiting protrusion 123.
The barrel sidewall 122 surrounds the receiving cavity 121, and the outer wall of the barrel sidewall 122 may be formed with a positioning structure and a mounting structure to fix the position of the laser projection module 10 when the laser projection module 10 is mounted in the electronic device 1000. The lens barrel 12 includes a first surface 124 and a second surface 125 opposite to each other, wherein one opening of the receiving cavity 121 is opened on the second surface 125, and the other opening is opened on the first surface 124. The second side 125 is bonded, e.g., glued, to the circuit board 112.
Referring to fig. 3 and 4, the limiting protrusion 123 protrudes inward from the barrel sidewall 122, and specifically, the limiting protrusion 123 protrudes inward from the barrel sidewall 122 into the receiving cavity 121. The limiting protrusion 123 may be continuous and annular, or the limiting protrusion 123 includes a plurality of limiting protrusions 123, and the plurality of limiting protrusions 123 are distributed at intervals. The limiting protrusion 123 forms a light passing hole 1231, the light passing hole 1231 may be a part of the accommodating cavity 121, and the laser passes through the light passing hole 1231 and then penetrates into the diffractive optical element 15. The limiting protrusion 123 includes a first limiting surface 1232 and a second limiting surface 1233, and the first limiting surface 1232 is opposite to the second limiting surface 1233. Specifically, the limiting protrusion 123 is located between the first surface 124 and the second surface 125, the first limiting surface 1232 is closer to the first surface 124 than the second limiting surface 1233, and the first limiting surface 1232 and the second limiting surface 1233 may be parallel planes. The accommodating cavity 121 between the first limiting surface 1232 and the first surface 124 may be used for accommodating the diffractive optical element 15, and the accommodating cavity 121 between the second limiting surface 1233 and the second surface 125 may be used for accommodating the collimating element 14. The limiting protrusion 123 is provided with a detection through hole 1234 penetrating through the first limiting surface 1232 and the second limiting surface 1233, in the embodiment of the present invention, the detection through hole 1234 is spaced apart from the light passing hole 1231, and a central axis of the detection through hole 1234 may be a straight line.
Referring to fig. 3, the light source 13 is disposed on the substrate assembly 11, specifically, the light source 13 may be disposed on the circuit board 112 and electrically connected to the circuit board 112, and the light source 13 may also be disposed on the substrate 111 and corresponding to the via 113, at this time, the light source 13 may be electrically connected to the circuit board 112 by disposing a wire. The light source 13 is used for Emitting Laser light, which may be infrared light, and in one example, the light source 13 may include a semiconductor substrate disposed on the substrate 111 and an Emitting Laser disposed on the semiconductor substrate, which may be a Vertical Cavity Surface Emitting Laser (VCSEL). The semiconductor substrate may be provided with a single emitting laser or with an array laser composed of a plurality of emitting lasers, and specifically, the plurality of emitting lasers may be arranged on the semiconductor substrate in a regular or irregular two-dimensional pattern.
Referring to fig. 3 and 4, the collimating element 14 may be an optical lens, the collimating element 14 is used for collimating laser light emitted by the light source 13, the collimating element 14 is accommodated in the accommodating cavity 121, and the collimating element 14 may be assembled into the accommodating cavity 121 along a direction in which the second surface 125 points to the first surface 124, specifically, the collimating element 14 includes a combining surface 143, and when the combining surface 143 is combined with the second limiting surface 1233, the collimating element 14 may be considered to be installed in place. The collimating element 14 includes an optical portion 141 and a mounting portion 142, the mounting portion 142 is used for combining with the barrel sidewall 122 to fix the collimating element 14 in the accommodating cavity 121, in the embodiment of the present invention, the combining surface 143 is an end surface of the mounting portion 142, and the optical portion 141 includes two curved surfaces located on opposite sides of the collimating element 14. One of the curved surfaces of the collimating element 14 extends into the light passing aperture 1231.
Referring to fig. 3 and 4, the diffractive optical element 15 is mounted on the limiting protrusion 123, and specifically, the diffractive optical element 15 includes a mounting surface 151, and the mounting surface 151 is combined with the first limiting surface 1232 to mount the diffractive optical element 15 on the limiting protrusion 123. Some regions on the mounting surface 151 may be formed with diffraction structures, the diffraction structures may correspond to the positions of the light passing holes 1231 and diffract the laser light collimated by the collimating element 14 out of the laser light patterns corresponding to the diffraction structures, and other regions on the mounting surface 151 may be planar and combined with the first limiting surface 1232. The diffractive optical element 15 can be made of glass, or, as it were, of a composite plastic (e.g., PET).
Referring to fig. 3 and 4, the detecting device 16 includes a transmitter 161 and a receiver 162. The emitter 161 and the receiver 162 are mounted one on the collimating element 14 and the other on the diffractive optical element 15, in particular, the emitter 161 may be arranged on the bonding surface 143 and the receiver 162 on the mounting surface 151; alternatively, the transmitter 161 may be disposed on the mounting surface 151 and the receiver 162 disposed on the bonding surface 143. The embodiment of the present invention is described by taking an example in which the transmitter 161 is disposed on the bonding surface 143 and the receiver 162 is disposed on the mounting surface 151. The transmitter 161 and the receiver 162 are installed to be aligned with both ends of the detection through hole 1234, and the transmitter 161 is used to transmit a detection signal into the detection through hole 1234 from one end, and the detection signal passes through the detection through hole 1234 to the other end and is received by the receiver 162. The receiver 162 analyzes information such as the intensity and phase of the received detection signal to determine whether the mounting positions of the collimating element 14 and the diffractive optical element 15 are correct at this time.
Specifically, the transmitter 161 may be an acoustic transmitter and is configured to transmit a detection acoustic wave, and in this case, the receiver 162 may be an acoustic receiver and is configured to receive a detection acoustic wave, which may be an ultrasonic wave, passing through the detection through hole 1234; the emitter 161 may be a light emitter and configured to emit detection light, and the receiver 162 may be a light receiver and configured to receive detection light, which may be laser light, through the detection through hole 1234. The present invention is described by taking an example in which the transmitter 161 is an optical transmitter and the receiver 162 is an optical receiver, and the transmitter 161 transmits the detection signal only to the surface of the receiver 162, and the receiver 162 receives the detection signal only to the surface (receiving surface) of the transmitter 161. In the embodiment of the present invention, referring to fig. 4, when the collimating element 14 and the diffractive optical element 15 are correctly installed, the detection signal emitted by the emitter 161 passes through the detection through hole 1234 and is not reflected by the inner wall of the detection through hole 1234, the propagation path of the detection signal to the receiver 162 is short, and when the detection signal is vertically incident on the receiving surface of the receiver 161, the intensity of the detection signal received by the receiver 162 is high.
Referring to fig. 5, when the collimating element 14 is displaced, tilted or falls off, the detection signal emitted by the emitter 161 is reflected by the inner wall of the detection through hole 1234 for multiple times and then received by the receiver 162 during the process of passing through the detection through hole 1234, the propagation path of the detection signal to the receiver 162 is long, and the strength of the detection signal received by the receiver 162 is weak. Referring to fig. 6, when the diffractive optical element 15 is displaced, tilted, or dropped, the receiving surface of the receiver 162 no longer faces the transmitter 161, the detection signal received by the receiver 162 is not vertically incident on the receiving surface, or a part of the receiving surface is not aligned with the detection through hole 1234 and cannot receive the detection signal, and the intensity of the detection signal received by the receiver 162 is weak. Therefore, the receiver 162 can determine whether the collimating element 14 and the diffractive optical element 15 are in the correct mounting positions by determining the intensity of the received detection signal.
Further, referring to fig. 2 and fig. 3, the receiver 162 may convert the determination result into an electrical signal and transmit the electrical signal to the processor 30 of the electronic device 1000, and the processor 30 may control the on/off of the light source 13 according to the electrical signal. Specifically, when the receiver 162 determines that the collimating element 14 and the diffractive optical element 15 are both in the correct mounting position, the processor 30 may control the light source 13 to emit light normally according to the determination result; when the receiver 162 determines that at least one of the collimating element 14 and the diffractive optical element 15 is not in the correct mounting position, the processor 30 may control the light source 13 to turn off according to the determination result, so as to prevent the laser light emitted from the light source 13 from being emitted without being processed correctly. The detection device 16 can perform real-time detection when the laser projection module 10 works; or the laser projection module 10 may receive the on command and perform the detection before the light source 13 emits light.
In summary, in the electronic device 1000 according to the embodiment of the present invention, one of the emitter 161 and the receiver 162 is mounted on the collimating element 14, and the other is mounted on the diffractive optical element 15, when one or both of the collimating element 14 and the diffractive optical element 15 deviate from the correct mounting position, the receiver 162 can detect an abnormality of the detection signal, and the user can prevent the laser from being emitted and injuring the user by turning off the light source 13.
Referring to fig. 3, in some embodiments, the number of the detecting through holes 1234 is multiple, and the number of the detecting devices 16 is the same as the number of the detecting through holes 1234 and corresponds to the position of the detecting through holes. Specifically, the number of the detection through holes 1234 may be two, three, four, five, etc., and a plurality of the detection through holes 1234 may be evenly distributed around the light passing hole 1231 at equal angles. One detection device 16 corresponds to one detection through hole 1234, and a plurality of detection devices 16 detect whether the collimating element 14 and the diffractive optical element 15 are located at the correct mounting positions together, so that the accuracy is high, and after a certain detection device 16 fails, the remaining detection devices 16 can still meet the detection requirements.
Referring to fig. 7, in some embodiments, a light absorption film 19 is formed on the inner wall of the sensing through hole 1234, and the light absorption film 19 is used to absorb the sensing light irradiated on the light absorption film 19. It is understood that the light absorption film 19 has a high absorptivity for the detection light, and when the diffractive optical element 15 or the collimating element 14 is tilted, displaced, or detached to cause the emitter 161 to shift, the detection light is irradiated onto the light absorption film 16 to be absorbed, and the amount of the detection light received by the receiver 162 is greatly reduced, so that even if the amount of the shift of the diffractive optical element 15 or the collimating element 14 is small, the detection light is easily detected by the detection device 16, and the detection sensitivity of the detection device 16 is improved.
Of course, in other embodiments, when the transmitter 161 is an acoustic transmitter and the receiver 162 is an acoustic receiver, the inner wall of the detection through hole 1234 may form a sound absorption structure, for example, the inner wall of the detection through hole 1234 is formed with a sound absorption hole, or is provided with sound absorption foam, etc.
Referring to fig. 3 and 8, in some embodiments, the light source 13 includes an edge-emitting Laser (EEL) 131, and specifically, the EEL 131 may be a Distributed Feedback Laser (DFB). The edge-emitting laser 131 is columnar as a whole, and a light-emitting surface 1311 is formed on one end surface of the edge-emitting laser 131 away from the substrate assembly 11, and laser light is emitted from the light-emitting surface 1311, with the light-emitting surface 1311 facing the collimating element 14. The edge-emitting laser 131 is adopted as a light source, on one hand, the temperature drift of the edge-emitting laser 131 is smaller than that of a VCSEL array, and on the other hand, the edge-emitting laser 131 is of a single-point light-emitting structure, so that an array structure does not need to be designed, the manufacturing is simple, and the cost of the light source of the laser projection module 10 is low.
Referring to fig. 8 and 9, in some embodiments, the laser projection module 10 further includes a fixing member 18, and the fixing member 18 is used for fixing the edge-emitting laser 131 on the substrate assembly 11. When the laser of the distributed feedback laser propagates, the gain of power is obtained through the feedback of the grating structure. To improve the power of the distributed feedback laser, the injection current needs to be increased and/or the length of the distributed feedback laser needs to be increased, which may increase the power consumption of the distributed feedback laser and cause serious heat generation. When the light emitting surface 1311 of the edge-emitting laser 131 faces the collimating element 14, the edge-emitting laser 131 is vertically placed, and because the edge-emitting laser 131 is of a slender strip structure, the edge-emitting laser 131 is prone to falling, shifting or shaking accidents, and therefore the edge-emitting laser 131 can be fixed by arranging the fixing member 18, and the edge-emitting laser 131 is prevented from falling, shifting or shaking accidents.
Specifically, referring to fig. 8, in some embodiments, the fixing member 18 includes an encapsulant 181, and the encapsulant 181 is disposed between the edge-emitting laser 131 and the substrate assembly 11. More specifically, in the example shown in fig. 8, the side emitting laser 131 is bonded to the substrate assembly 11 on the side opposite to the light emitting surface 1311. In the example shown in fig. 9, the side surface 1312 of the edge-emitting laser 131 may be bonded to the substrate assembly 11, and the side surface 1312 around the side surface may be covered with the sealant 181, or only one of the side surfaces 1312 may be bonded to the substrate assembly 11, or some of the side surfaces may be bonded to the substrate assembly 11. Further, the encapsulant 181 may be a heat conductive adhesive to conduct heat generated by the operation of the light source 13 to the substrate assembly 11. In order to improve the heat dissipation efficiency, the substrate 111 may further be formed with a heat dissipation hole 1111, heat generated by the operation of the light source 13 or the circuit board 112 may be dissipated through the heat dissipation hole 1111, and the heat dissipation hole 1111 may be filled with a thermal conductive adhesive to further improve the heat dissipation performance of the substrate assembly 11.
Referring to fig. 10, in some embodiments, the fixing member 18 includes at least two elastic supporting frames 182 disposed on the substrate assembly 11, the at least two supporting frames 182 together form an accommodating space 183, the accommodating space 183 is used for accommodating the edge-emitting laser 131, and the at least two supporting frames 182 are used for supporting the edge-emitting laser 131 to further prevent the edge-emitting laser 131 from shaking.
In some embodiments, the substrate 111 may be omitted and the light source 13 may be directly fixed to the circuit board 112 to reduce the overall thickness of the laser projector 10.
In the description of the specification, reference to the terms "certain embodiments," "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, unless specifically limited otherwise.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and those skilled in the art can make changes, modifications, substitutions and alterations to the above embodiments within the scope of the present invention, which is defined by the claims and their equivalents.