3D sensing module, 3D sensing method and electronic device

Abstract

The present application provides a 3D sensing module, a 3D sensing method and an electronic device. The 3D sensing module includes a transmitting end and a receiving end; the transmitting end is used to transmit a first outgoing light beam in a depth imaging mode, or to transmit a second outgoing light beam in a proximity sensing mode; the receiving end is used to open all pixels in the depth imaging mode to form a first detection channel with the transmitting end to receive a first reflected light beam (obtained by reflection of the first outgoing light beam) and generate a depth image of the target object, or to open some pixels in the proximity sensing mode to form a second detection channel with the transmitting end to receive a second reflected light beam (obtained by reflection of the second outgoing light beam) and generate distance information between the 3D sensing module and the target object; wherein the field of view angle of the first outgoing light beam is greater than the field of view angle of the second outgoing light beam. The present application no longer needs to form a camera device with a proximity sensor and a 3D sensing module, thereby reducing the volume, quality and manufacturing cost of the camera device.

Description

[Technical field]

[0001] The present application relates to the field of optical imaging technology, and in particular to a 3D sensing module, a 3D sensing method and an electronic device. [Background technology]

[0002] As users' demand for thinner and lighter electronic devices such as mobile phones and tablets continues to increase, the various devices installed inside electronic devices are gradually developing in the direction of miniaturization. The proximity sensor is an indispensable part of the electronic device. It is mainly used to detect the distance between the electronic device and the target object, and based on the detection results, it can draw conclusions such as the target object is close, far away, appears or disappears. It can effectively improve the overall operation logic of the electronic device, so that the user experience can be greatly improved. In recent years, with the increasing popularity of new payment methods, namely face-swiping payment methods, the traditional 2D face ID (i.e., two-dimensional face-swiping authentication method) can no longer meet the needs of users. Therefore, 3D face ID (i.e., three-dimensional face-swiping authentication method) has been widely used in electronic devices, and the most common form of expression is the 3D sensor module in the electronic device. In fact, the electronic device is equipped with a camera device with functions such as taking pictures, recording and face recognition. The proximity sensor and 3D sensor module mentioned above are both part of the camera device.

[0003] In the related art, although the proximity sensor and the 3D sensing module are both indispensable components of the camera device (located inside the electronic device, with functions such as taking pictures, recording videos and face recognition), the proximity sensor and the 3D sensing module are relatively independent, that is, the proximity sensor and the 3D sensing module are arranged separately, which leads to a larger size and mass of the camera device and a higher manufacturing cost. At the same time, this is not conducive to the development direction of lightweight electronic devices.

[0004] Therefore, it is necessary to improve the structure of the above 3D sensing module. [Summary of the invention]

[0005] The present application provides a 3D sensing module, a 3D sensing method and an electronic device, aiming to solve the problems of large size, large mass and high manufacturing cost of the camera device in the related art.

[0006] In order to solve the above technical problems, the first aspect of an embodiment of the present application provides a 3D sensing module, including a transmitting end and a receiving end; the transmitting end is used to emit a first outgoing light beam in a depth imaging mode, or to emit a second outgoing light beam in a proximity sensing mode; wherein the first outgoing light beam generates a corresponding first reflected light beam after being reflected by the target object, and the second outgoing light beam generates a corresponding second reflected light beam after being reflected by the target object, and the field of view angle of the first outgoing light beam is greater than the field of view angle of the second outgoing light beam; the receiving end is used to open all pixels in the depth imaging mode to form a first detection channel with the transmitting end to receive the first reflected light beam and generate a depth image of the target object, or to open some pixels in the proximity sensing mode to form a second detection channel with the transmitting end to receive the second reflected light beam and generate distance information between the 3D sensing module and the target object.

[0007] According to a second aspect of an embodiment of the present application, a 3D sensing method is provided, which is applied to a 3D sensing module. The 3D sensing method includes: controlling a transmitting end to emit a first outgoing light beam in a depth imaging mode, or to emit a second outgoing light beam in a proximity sensing mode; wherein the first outgoing light beam generates a corresponding first reflected light beam after being reflected by a target object, and the second outgoing light beam generates a corresponding second reflected light beam after being reflected by the target object, and a field of view angle of the first outgoing light beam is greater than a field of view angle of the second outgoing light beam; controlling a receiving end to open all pixels in the depth imaging mode to form a first detection channel with the transmitting end to receive the first reflected light beam and generate a depth image of the target object, or to open some pixels in the proximity sensing mode to form a second detection channel with the transmitting end to receive the second reflected light beam and generate distance information between the 3D sensing module and the target object.

[0008] A third aspect of the embodiments of the present application provides an electronic device, comprising the 3D sensing module as described in the first aspect of the embodiments of the present application.

[0009] From the above description, it can be seen that compared with the related art, the beneficial effect of the present application is that: a 3D sensing module is formed by a transmitting end and a receiving end, and two working modes are set for the formed 3D sensing module, namely a depth imaging mode and a proximity sensing mode. Based on this, when it is necessary to obtain a depth image of a target object, the 3D sensing module can be adjusted to a depth imaging mode, and in this mode, the transmitting end will emit a first outgoing light beam to the target object, and then the receiving end will open all pixels and form a first detection channel with the transmitting end to receive the first reflected light beam generated by the reflection of the first outgoing light beam by the target object and generate a depth image of the target object; when it is necessary to obtain the distance information between the 3D sensing module and the target object, the 3D sensing module can be adjusted to a proximity sensing mode, and in this mode, the transmitting end will emit a second outgoing light beam to the target object, and then the receiving end will open some pixels and form a second detection channel with the transmitting end to receive the second reflected light beam generated by the reflection of the second outgoing light beam by the target object and generate the distance information between the 3D sensing module and the target object. It can be seen that the 3D sensing module provided by the present application can not only obtain the depth image of the target object, but also obtain the distance information between the 3D sensing module and the target object. This is equivalent to integrating the 3D sensing module and the proximity sensor in the traditional camera device, so that the 3D sensing module and the proximity sensor can share the same transmitting end and the same receiving end. At this time, it is no longer necessary to form a camera device with a proximity sensor and a 3D sensing module, but only a 3D sensing module provided by the present application needs to be set in the camera device, thereby effectively reducing the volume and weight of the camera device and greatly saving manufacturing costs.

Brief Description of the Drawings

[0010] In order to more clearly illustrate the technical solutions in the related technologies or the embodiments of the present application, the drawings required for use in the description of the related technologies or the embodiments of the present application will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application, not all embodiments. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0011] Figure 1 A schematic diagram of the structure of a 3D sensing module provided in an embodiment of the present application;

[0012] Figure 2 A schematic diagram of the first structure of the transmitting end provided in the embodiment of the present application;

[0013] Figure 3 A schematic diagram of a modulation region of an optical modulation device provided in an embodiment of the present application;

[0014] Figure 4A first schematic diagram of a first modulation area provided in an embodiment of the present application;

[0015] Figure 5 A second schematic diagram of the first modulation area provided in an embodiment of the present application;

[0016] Figure 6 A second structural diagram of the transmitting end provided in an embodiment of the present application;

[0017] Figure 7 A third structural diagram of the transmitting end provided in an embodiment of the present application;

[0018] Figure 8 A schematic diagram of the process of a 3D sensing method provided in an embodiment of the present application. [Specific implementation method]

[0019] In order to make the purpose, technical solutions and advantages of the present application more obvious and easy to understand, the present application will be clearly and completely described below in conjunction with the embodiments of the present application and the corresponding drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. It should be understood that the various embodiments of the present application described below are only used to explain the present application and are not used to limit the present application, that is, based on the various embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of the present application. In addition, the technical features involved in the various embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.

[0020] As users' demand for thinner and lighter electronic devices such as mobile phones and tablets continues to increase, the various devices installed inside electronic devices are gradually developing in the direction of miniaturization. The proximity sensor is an indispensable part of the electronic device. It is mainly used to detect the distance between the electronic device and the target object, and based on the detection results, it can draw conclusions such as the target object is close, far away, appears or disappears. It can effectively improve the overall operation logic of the electronic device, so that the user experience can be greatly improved. In recent years, with the increasing popularity of new payment methods, namely face-swiping payment methods, the traditional 2D face ID (i.e., two-dimensional face-swiping authentication method) can no longer meet the needs of users. Therefore, 3D face ID (i.e., three-dimensional face-swiping authentication method) has been widely used in electronic devices, and the most common form of expression is the 3D sensor module in the electronic device. In fact, the electronic device is equipped with a camera device with functions such as taking pictures, recording and face recognition. The proximity sensor and 3D sensor module mentioned above are both part of the camera device.

[0021] In the related art, although the proximity sensor and the 3D sensing module are both indispensable components of the camera device, the proximity sensor and the 3D sensing module are relatively independent, that is, the proximity sensor and the 3D sensing module are separately set, which leads to a larger volume and mass of the camera device, and a higher manufacturing cost, which is also not conducive to the development direction of thinner electronic devices. To this end, the embodiment of the present application provides a 3D sensing module for application in electronic devices; wherein the electronic devices may include but are not limited to mobile phones, notebooks, tablet computers, POS machines, vehicle-mounted computers, and smart wearable devices.

[0022] See also Figure 1 , Figure 1 The 3D sensing module provided in the embodiment of the present application includes a transmitting end 10 and a receiving end 20.

[0023] Specifically, the transmitting end 10 is used to transmit a first outgoing light beam (such as Figure 1 a); or, in proximity sensing mode, emitting a second outgoing light beam (such as Figure 1 c); wherein, after the first outgoing light beam is reflected by the target object, a corresponding first reflected light beam (such as Figure 1 b); after the second outgoing light beam is reflected by the target object, a corresponding second reflected light beam (such as Figure 1 d); the field of view of the first outgoing light beam is greater than the field of view of the second outgoing light beam (for example, the field of view of a in Figure 1 is significantly greater than the field of view of c). The receiving end 20 is used to turn on all pixels in the depth imaging mode to form a first detection channel with the transmitting end 10 to receive the first reflected light beam and generate a depth image of the target object; or, turn on some pixels in the proximity sensing mode to form a second detection channel with the transmitting end 10 to receive the second reflected light beam and generate distance information between the 3D sensing module and the target object. In some embodiments, the 3D sensing module also includes a control and processing circuit, which is used to control the transmitting end 10 to emit the first outgoing light beam or the second outgoing light beam in the depth imaging mode or the proximity sensing mode, and control the receiving end 20 to turn on all pixels or some pixels to collect the first reflected light beam or the second reflected light beam reflected by the target object to generate a depth image or distance information.

[0024] It is understandable that, since the first outgoing light beam is used to perform 3D perception of the target object (i.e., obtain the depth image of the target object), and the second outgoing light beam is used to perform close-range sensing of the target object (i.e., obtain the distance information between the target object and the 3D sensing module), the field of view of the first outgoing light beam in this embodiment should be greater than the field of view of the second outgoing light beam. In addition, there is an "or" relationship between "the transmitting end 10 emits the first outgoing light beam" and "the transmitting end 10 emits the second outgoing light beam", and there is also an "or" relationship between "the receiving end 20 generates the depth image of the target object" and "the receiving end 20 generates the distance information between the 3D sensing module and the target object", which means that the depth imaging mode and the proximity sensing mode of the 3D sensing module in this embodiment are non-overlapping in terms of timing, that is, either in the depth imaging mode to perform 3D perception of the target object, or in the proximity sensing mode to perform distance sensing of the target object, but cannot be in the depth imaging mode and the proximity sensing mode at the same time.

[0025] In actual applications, when it is necessary to obtain a depth image of the target object, the 3D sensing module can be adjusted to a depth imaging mode. In this mode, the transmitting end 10 will emit a first outgoing light beam to the target object, and then the receiving end 20 will turn on all pixels to form a first detection channel with the transmitting end 10 to receive a first reflected light beam generated by the first outgoing light beam being reflected by the target object and generate a depth image of the target object; when it is necessary to obtain the distance information between the 3D sensing module and the target object, the 3D sensing module can be adjusted to a proximity sensing mode. In this mode, the transmitting end 10 will emit a second outgoing light beam to the target object, and then the receiving end 20 will turn on some pixels to form a second detection channel with the transmitting end 10 to receive a second reflected light beam generated by the second outgoing light beam being reflected by the target object and generate the distance information between the 3D sensing module and the target object. As an example, when the 3D sensing module provided in this embodiment is applied to a mobile phone, the 3D sensing module can first be adjusted to a proximity sensing mode to perform distance sensing of the mobile phone user (i.e., the target object). After sensing that the mobile phone user is close enough (i.e., the distance between the 3D sensing module and the mobile phone user is less than or equal to a preset distance), the 3D sensing module can be adjusted to a depth imaging mode to perform 3D perception of the mobile phone user, thereby obtaining a depth image of the mobile phone user (for example, obtaining a depth image of the mobile phone user's face for face recognition).

[0026] As can be seen from the above, the present embodiment forms a 3D sensing module with a transmitting end 10 and a receiving end 20, and sets two working modes for the 3D sensing module, namely a depth imaging mode and a proximity sensing mode; wherein the depth imaging mode is used for 3D perception of the target object; and the proximity sensing mode is used for close-range sensing of the target object. Importantly, the present embodiment can obtain both the depth image of the target object and the distance information between the 3D sensing module and the target object, which is equivalent to integrating the 3D sensing module and the proximity sensor in the traditional camera device, so that the 3D sensing module and the proximity sensor can share the same transmitting end 10 and the same receiving end 20. At this time, it is no longer necessary to form a camera device with a proximity sensor and a 3D sensing module, but only to set a 3D sensing module provided by the present embodiment in the camera device, thereby effectively reducing the volume and weight of the camera device and greatly saving the manufacturing cost.

[0027] In some embodiments, please refer to Figure 2 , Figure 2 A schematic diagram of the first structure of the transmitter provided in the embodiment of the present application. The transmitter 10 may include a first light source 11, a second light source 12, an optical modulator 13 and a substrate 14; wherein the first light source 11 and the second light source 12 are both arranged on the substrate 14, the first light source 11 and the second light source 12 are spaced apart from each other, and the optical modulator 13 is mounted on the substrate 14 and is located on the optical path of the first light source 11 and the second light source 12. In this embodiment, the substrate 14 serves to carry and protect optical devices such as the first light source 11, the second light source 12 and the optical modulator 13 arranged thereon, and the substrate 14 may be a ceramic substrate.

[0028] Specifically, the first light source 11 is used to emit a first incident light beam to the light modulator 13 in the depth imaging mode. The second light source 12 is used to emit a second incident light beam to the light modulator 13 in the proximity sensing mode. The light modulator 13 is used to modulate the first incident light beam and project a corresponding first outgoing light beam; or, to modulate the second incident light beam and project a corresponding second outgoing light beam. It can be understood that in the depth imaging mode, the first light source 11 first emits the first incident light beam, and then the light modulator 13 modulates the first incident light beam and projects a corresponding first outgoing light beam, so as to use the projected first outgoing light beam to perform 3D perception of the target object; in the proximity sensing mode, the second light source 12 first emits the second incident light beam, and then the light modulator 13 modulates the second incident light beam and projects a corresponding second outgoing light beam, so as to use the projected second outgoing light beam to perform distance sensing of the target object.

[0029] In this embodiment, the first light source 11 is used to perform 3D perception of the target object, that is, the first incident light beam emitted by the first light source 11 is modulated by the light modulator 13 to generate a first outgoing light beam with a large field of view angle, so the first light source 11 may include one or more sub-light sources, and when the first light source 11 includes multiple sub-light sources, the multiple sub-light sources are distributed in an array; the second light source 12 is used to perform distance sensing of the target object, that is, the second incident light beam emitted by the second light source 12 is modulated by the light modulator 13 to generate a second outgoing light beam with a small field of view angle, so the second light source 12 may only include one sub-light source, and at this time the second incident light beam and the corresponding second outgoing light beam are point light beams. In addition, the types of the first light source 11 and the second light source 12 may include, but are not limited to, LED (Light-Emitting Diode) and VCSEL (Vertical-Cavity Surface-Emitting Laser), which generally refers to optical active devices commonly used in the art that can emit incident light beams in the infrared band (or other bands).

[0030] Furthermore, the transmitting end 10 of the present embodiment may also include a control circuit, which is disposed on the substrate 14 and is electrically connected to the first light source 11 and the second light source 12. Specifically, the control circuit is used to turn on the first light source 11 and turn off the second light source 12 in the depth imaging mode; or, in the proximity sensing mode, turn on the second light source 12 and turn off the first light source 11; wherein, when the first light source 11 is turned on by the control circuit, it can emit a first incident light beam to the optical modulator 13; when the first light source 11 is turned off by the control circuit, it cannot emit the first incident light beam to the optical modulator 13; when the second light source 12 is turned on by the control circuit, it can emit a second incident light beam to the optical modulator 13; when the second light source 12 is turned off by the control circuit, it cannot emit a second incident light beam to the optical modulator 13. It can be understood that this embodiment realizes the timing control of "the first light source 11 emitting a first incident light beam" and "the second light source 12 emitting a second incident light beam" by setting a control circuit for controlling the opening / closing of the first light source 11 and the second light source 12 on the substrate 14, that is, it realizes the timing control of the depth imaging mode and the proximity sensing mode.

[0031] As an implementation method, still refer to Figure 2, the two opposite sides of the substrate 14 may be formed with support parts 141 extending along the direction of the light paths of the first light source 11 and the second light source 12, and at this time, the two opposite sides of the optical modulator 13 are respectively arranged on the two support parts 141. It can be understood that in this embodiment, the optical modulator 13 is mounted on the substrate 14 by forming support parts 141 on the two opposite sides of the substrate 14. Further, we can open holes, grooves and other structures on the inner side of the support parts 141, and respectively arrange the two opposite sides of the optical modulator 13 in the holes, grooves and other structures on the inner sides of the two support parts 141 to achieve reinforcement of the optical modulator 13; or, we can also add some clamping and fixing structures commonly used in the field at the end of the support part 141, and achieve reinforcement of the optical modulator 13 through these clamping and fixing structures; this embodiment does not make a sole limitation.

[0032] As an implementation mode, the light modulator 13 in this embodiment can be a liquid crystal panel, and the liquid crystal panel has two working states, namely, a diffusion state and a transparent state. Based on this, the control circuit provided on the substrate 14 can also be used to adjust the liquid crystal panel to the diffusion state in the depth imaging mode; or, in the proximity sensing mode, adjust the liquid crystal panel to the transparent state. It can be understood that when the working state of the liquid crystal panel is different, its modulation effect on the incident light beam (i.e., the first incident light beam and the second incident light beam) is different. Therefore, in the depth imaging mode, this embodiment not only needs to turn on the first light source 11 and turn off the second light source 12 through the control circuit, but also needs to adjust the liquid crystal panel to a diffuse state through the control circuit, so that the liquid crystal panel in the diffuse state can correctly modulate the first incident light beam, thereby generating a first outgoing light beam suitable for 3D perception of the target object; and in the proximity sensing mode, not only needs to turn on the second light source 12 and turn off the first light source 11 through the control circuit, but also needs to adjust the liquid crystal panel to a transparent state through the control circuit, so that the liquid crystal panel in the transparent state can correctly modulate the second incident light beam, thereby generating a second outgoing light beam suitable for close-range sensing of the target object. It is necessary to explain here that when the liquid crystal panel is in a transparent state, the liquid crystal panel does not actually perform any modulation on the second incident light beam, that is, the second incident light beam directly passes through the liquid crystal panel and shines on the target object, or in other words, the second outgoing light beam projected by the liquid crystal panel according to the incident second incident light beam belongs to the same light beam as the second incident light beam.

[0033] As another implementation, please refer to Figure 3 , Figure 3Schematic diagram of modulation area of ​​the optical modulation device provided in the embodiment of the present application. The optical modulation device 13 may have a first modulation area A and a second modulation area B connected to each other; wherein the first modulation area A corresponds to the first light source 11, and the second modulation area B corresponds to the second light source 12.

[0034] Specifically, the first modulation area A is used to modulate the first incident light beam emitted by the first light source 11, and project a corresponding first outgoing light beam; wherein the irradiation range of the first incident light beam on the first modulation area A is limited to the first modulation area A, that is, the irradiation range of the first incident light beam on the first modulation area A is smaller than the area of ​​the first modulation area A. The second modulation area B is used to modulate the second incident light beam emitted by the second light source 12, and project a corresponding second outgoing light beam; wherein the irradiation range of the second incident light beam on the second modulation area B is limited to the second modulation area B, that is, the irradiation range of the second incident light beam on the second modulation area B is smaller than the area of ​​the second modulation area B.

[0035] It can be understood that the present embodiment divides the optical modulator 13 into two modulation areas, namely the first modulation area A and the second modulation area B. Then, in the depth imaging mode, the first light source 11 first emits the first incident light beam, and then the first modulation area A modulates the first incident light beam and projects the corresponding first outgoing light beam, so as to use the projected first outgoing light beam to perform 3D perception of the target object; in the proximity sensing mode, the second light source 12 first emits the second incident light beam, and then the second modulation area B modulates the second incident light beam and projects the corresponding second outgoing light beam, so as to use the projected second outgoing light beam to perform close-range sensing of the target object. In addition, the role of "the irradiation range of the first incident light beam on the first modulation area A is limited to the first modulation area A, and the irradiation range of the second incident light beam on the second modulation area B is limited to the second modulation area B" is to prevent the first incident light beam from interfering with the second incident light beam, that is, to prevent the first incident light beam from interfering with the second incident light beam.

[0036] As a specific implementation of this embodiment, the first modulation area A may include multiple interconnected sub-modulation areas, and the number of sub-modulation areas is consistent with the sub-light sources included in the first light source 11, that is, the multiple sub-modulation areas correspond one-to-one to the multiple sub-light sources included in the first light source 11.

[0037] Specifically, the sub-modulation area is used to modulate the first incident light beam emitted by the corresponding sub-light source in the first light source 11, and project the corresponding first outgoing light beam; wherein, the field of view angles of the first outgoing light beams projected by different sub-modulation areas are different, which means that the modulation effects of the sub-modulation areas on the incident light beam are different. It can be understood that this specific implementation adjusts the field of view angle of the first outgoing light beam by dividing the first modulation area A into a plurality of sub-modulation areas having different modulation effects on the incident light beam, that is, if we need to adjust the field of view angle of the current first outgoing light beam to the target field of view angle, then we only need to turn off the sub-light source that is currently on, and turn on other sub-light sources (the field of view angle of the first outgoing light beam generated by the first incident light beam emitted by the other sub-light source being modulated by the corresponding sub-modulation area is the target field of view angle), and the turning on / off of all sub-light sources in the first light source 11 can be achieved by the control circuit disposed on the substrate 14.

[0038] For an example, see further Figure 4 , Figure 4 A first schematic diagram of the first modulation area provided in an embodiment of the present application. Figure 4 The figure shows the case where the first modulation area A includes two sub-modulation areas (first sub-modulation area A1 and second sub-modulation area A2), wherein the first sub-modulation area A1 is suitable for the occasion where the field of view of the first outgoing light beam is larger, and the second sub-modulation area A2 is suitable for the occasion where the field of view of the first outgoing light beam is smaller. Based on this, when we need the first outgoing light beam to have a larger field of view, we only need to turn on the sub-light source corresponding to the first sub-modulation area A1 in the first light source 11, and turn off the sub-light source corresponding to the second sub-modulation area B1 in the first light source 11; similarly, when we need the first outgoing light beam to have a smaller field of view, we only need to turn on the sub-light source corresponding to the second sub-modulation area B1 in the first light source 11, and turn off the sub-light source corresponding to the first sub-modulation area A1 in the first light source 11.

[0039] As another specific implementation of this embodiment, the first modulation area A may include n sub-modulation areas, and the nth sub-modulation area is obtained by extending a preset distance outward from the periphery of the n-1th sub-modulation area; wherein n is a positive integer greater than 1.

[0040] Specifically, the sub-modulation area is used to modulate the first incident light beam emitted by the first light source 11 and project a corresponding first outgoing light beam; wherein, in the order of the first sub-modulation area to the nth sub-modulation area, the number of sub-modulation areas in the open state is positively correlated with the size of the field of view angle of the first outgoing light beam, that is, when the first sub-modulation area is in the open state and the other sub-modulation areas are in the closed state, the modulation area that modulates the first incident light beam emitted by the first light source 11 is only the first sub-modulation area, and at this time, the field of view angle of the first outgoing light beam generated by the first incident light beam emitted by the first light source 11 being modulated by the first sub-modulation area is the smallest; when all the sub-modulation areas in the first modulation area A are in the open state, the modulation area that modulates the first incident light beam emitted by the first light source 11 is the first modulation area A (equivalent to all the sub-modulation areas in the first modulation area A), and at this time, the field of view angle of the first outgoing light beam generated by the first incident light beam emitted by the first light source 11 being modulated by the first modulation area A is the largest. It can be understood that this specific implementation divides the first modulation area A into n sub-modulation areas, and sets the nth sub-modulation area to be obtained by extending a preset distance outward from the periphery of the n-1th sub-modulation area, thereby realizing the adjustment of the field of view angle of the first output light beam, that is, when we need to reduce the field of view angle of the first output light beam, we only need to close a specified number of sub-modulation areas in the order of the nth sub-modulation area to the first sub-modulation area; when we need to increase the field of view angle of the first output light beam, we only need to open a specified number of sub-modulation areas in the order of the first sub-modulation area to the nth sub-modulation area.

[0041] For an example, see further Figure 5 , Figure 5 A second schematic diagram of the first modulation area provided in an embodiment of the present application. Figure 5 The figure shows a case where the first modulation area A includes two sub-modulation areas (first sub-modulation area A1 and second sub-modulation area A2), wherein the second sub-modulation area A2 is obtained by extending a preset distance outward from the periphery of the first sub-modulation area A1. Based on this, when the first sub-modulation area A1 is in an open state and the second sub-modulation area A2 is in a closed state, the first incident light beam emitted by the first light source 11 is modulated by the first sub-modulation area A1 to generate a first outgoing light beam with a smaller field of view angle; when both the first sub-modulation area A1 and the second sub-modulation area A2 are in an open state, the first incident light beam emitted by the first light source 11 is modulated by the first modulation area A to generate a first outgoing light beam with a larger field of view angle.

[0042] As another implementation method, please refer to Figure 6 , Figure 6A second structural diagram of the transmitting end provided in an embodiment of the present application. The light modulator 13 may include a diffuser 131 and a transparent glass 132; wherein the diffuser 131 corresponds to the first light source 11, and the transparent glass 132 corresponds to the second light source 12; in fact, this embodiment is equivalent to setting the first modulation area A of the aforementioned embodiment as the diffuser 131, and setting the second modulation area B of the aforementioned embodiment as the transparent glass 132.

[0043] Specifically, the diffuser 131 is used to modulate the first incident light beam emitted by the first light source 11, and project a corresponding first outgoing light beam, and the first outgoing light beam at this time is a floodlight beam; the transparent glass 132 is used for the second incident light beam emitted by the second light source 12 to be incident, and projects a corresponding second outgoing light beam, and the second incident light beam is the same as the second outgoing light beam at this time, which means that the transparent glass 132 does not actually perform any modulation on the second incident light beam, that is, the second incident light beam directly passes through the transparent glass 132 and shines on the target object, or in other words, the second outgoing light beam projected by the transparent glass 132 according to the incident second incident light beam belongs to the same light beam as the second incident light beam. It can be understood that the size relationship of the space occupied by the diffuser 131 and the transparent glass 132 depends on the divergence angles of the first incident light beam and the second incident light beam, the irradiation area of ​​the first incident light beam on the diffuser 131, the irradiation area of ​​the second incident light beam on the transparent glass 132, etc.; however, no matter what the size relationship of the space occupied by the diffuser 131 and the transparent glass 132 is, it is necessary to ensure that the first incident light beam and the second incident light beam do not interfere with each other.

[0044] As another implementation method, please refer to Figure 7 , Figure 7 A third structural diagram of the transmitter provided in the embodiment of the present application. The optical modulator 13 may include a diffractive optical element (DOE) 133 and an optical lens 134; wherein the diffractive optical element 133 corresponds to the first light source 11, and the optical lens 134 corresponds to the second light source 12; in fact, this embodiment is equivalent to setting the first modulation area A of the aforementioned embodiment as the diffractive optical element 133, and setting the second modulation area B of the aforementioned embodiment as the optical lens 134.

[0045] Specifically, the diffractive optical element 133 is used to modulate the first incident light beam emitted by the first light source 11, and project a corresponding first outgoing light beam, and the first outgoing light beam at this time is a speckle light beam; the optical lens 134 is used to converge the second incident light beam emitted by the second light source 12, and project a corresponding second outgoing light beam; here, the purpose of the optical lens 134 converging the second incident light beam is to increase the energy density of the projected second outgoing light beam. It can be understood that the size relationship of the space occupied by the diffractive optical element 133 and the optical lens 134 depends on the divergence angle of the first incident light beam and the second incident light beam, the irradiation area of ​​the first incident light beam on the diffractive optical element 133, the irradiation area of ​​the second incident light beam on the optical lens 134, etc.; however, no matter how the size relationship of the space occupied by the diffractive optical element 133 and the optical lens 134 is, it is necessary to ensure that the first incident light beam and the second incident light beam do not interfere with each other.

[0046] Of course, this is not limited to this. In other embodiments, the optical lens 134 can be replaced by the transparent glass 132 in the previous embodiment. For related descriptions, please refer to the previous embodiment, and this embodiment will not be repeated here.

[0047] It should be understood that the aforementioned implementation is only a preferred implementation of the embodiment of the present application, and is not the only limitation of the embodiment of the present application on the structural form of "the optical modulator 13 modulating the first incident light beam and the second incident light beam"; in this regard, those skilled in the art can flexibly set it according to the actual application scenario based on the embodiment of the present application. In addition, although the aforementioned implementations are all achieved by dividing the first modulation area A into a plurality of sub-modulation areas to adjust the field of view of the first outgoing light beam, those skilled in the art should know that it is not limited to adjusting the field of view of the first outgoing light beam, and these sub-modulation areas can also be used to generate light fields with different distribution forms, such as pre-designed stripes, speckle arrangements and floodlights of different shapes, etc., which are not listed one by one in this article.

[0048] In some embodiments, the receiving end 20 may include an image sensor, and the image sensor may include a pixel array composed of a plurality of pixels.

[0049] Specifically, the image sensor is used to receive a first reflected light beam generated by reflection of the first outgoing light beam by the target object through a first detection channel formed by the pixel array and the transmitting end 10 in a depth imaging mode, and generate a depth image of the target object based on the received first reflected light beam; or, in a proximity sensing mode, receive a second reflected light beam generated by reflection of the second outgoing light beam by the target object through a second detection channel formed by the pixel array and the transmitting end 10, and generate distance information between the 3D sensing module and the target object based on the received second reflected light beam; wherein, in the depth imaging mode, all pixels in the pixel array are in an on state; and in the proximity sensing mode, some pixels in the pixel array corresponding to the second reflected light beam are in an on state.

[0050] It is understandable that when the 3D sensing module performs 3D perception of the target object, that is, when the 3D sensing module is in the depth imaging mode, in order to ensure the detail and accuracy of the depth image of the target object generated according to the first reflected light beam, all pixels in the pixel array of the image sensor need to be in the on state. When the 3D sensing module performs close-range sensing of the target object, that is, when the 3D sensing module is in the proximity sensing mode, since the accuracy requirement for generating the distance information between the 3D sensing module and the target object according to the second reflected light beam is not high, in order to reduce power consumption, only some pixels in the pixel array of the image sensor corresponding to the second reflected light beam need to be in the on state.

[0051] See also Figure 8 , Figure 8 The present invention also provides a 3D sensing method, which is applied to the 3D sensing module provided in the present invention, and the 3D sensing method includes the following steps 801 to 802.

[0052] Step 801: Control the transmitting end to emit a first outgoing light beam in a depth imaging mode; or to emit a second outgoing light beam in a proximity sensing mode.

[0053] In this embodiment, a 3D sensing module is formed by a transmitting end 10 and a receiving end 20, and the 3D sensing module also includes a control and processing circuit (not shown). At the same time, two working modes are set for the 3D sensing module, namely, a depth imaging mode and a proximity sensing mode; wherein the depth imaging mode is used for 3D perception of the target object; and the proximity sensing mode is used for close-range sensing of the target object. Based on this, when it is necessary to obtain a depth image of the target object, the 3D sensing module can be adjusted to the depth imaging mode; in this mode, the control and processing circuit controls the transmitting end 10 to emit a first outgoing light beam to the target object, and the target object will reflect the first outgoing light beam, thereby generating a corresponding first reflected light beam. When it is necessary to obtain the distance information between the 3D sensing module and the target object, the 3D sensing module can be adjusted to the proximity sensing mode; in this mode, the control and processing circuit controls the transmitting end 10 to emit a second outgoing light beam to the target object, and the target object will reflect the second outgoing light beam, thereby generating a corresponding second reflected light beam.

[0054] Step 802: Control the receiving end to open all pixels in the depth imaging mode and form a first detection channel with the transmitting end to receive the first reflected light beam and generate a depth image of the target object; or, open some pixels in the proximity sensing mode and form a second detection channel with the transmitting end to receive the second reflected light beam and generate distance information between the 3D sensing module and the target object.

[0055] In this embodiment, when the 3D sensing module is in the depth imaging mode, the control and processing circuit controls the receiving end 20 to turn on all pixels and form a first detection channel with the transmitting end 10 to receive the first reflected light beam generated by the first outgoing light beam being reflected by the target object and generate a depth image of the target object; when the 3D sensing module is in the proximity sensing mode, the control and processing circuit controls the receiving end 20 to turn on some pixels and form a second detection channel with the transmitting end 10 to receive the second reflected light beam generated by the second outgoing light beam being reflected by the target object and generate distance information between the 3D sensing module and the target object.

[0056] It is understandable that, since the first outgoing light beam is used to perform 3D perception of the target object (i.e., obtain the depth image of the target object), and the second outgoing light beam is used to perform distance sensing of the target object (i.e., obtain the distance information between the target object and the 3D sensing module), the field of view of the first outgoing light beam in this embodiment should be greater than the field of view of the second outgoing light beam. In addition, there is an "or" relationship between "the transmitting end 10 emits the first outgoing light beam" and "the transmitting end 10 emits the second outgoing light beam", and there is also an "or" relationship between "the receiving end 20 generates the depth image of the target object" and "the receiving end 20 generates the distance information between the 3D sensing module and the target object", which means that the depth imaging mode and the proximity sensing mode of the 3D sensing module in this embodiment are non-overlapping in terms of timing, that is, either in the depth imaging mode to perform 3D perception of the target object, or in the proximity sensing mode to perform close-range sensing of the target object, but cannot be in the depth imaging mode and the proximity sensing mode at the same time.

[0057] As can be seen from the above, in the 3D sensing method provided in this embodiment, it is possible to obtain both the depth image of the target object and the distance information between the 3D sensing module and the target object, which is equivalent to integrating the 3D sensing module and the proximity sensor in the traditional camera device, so that the 3D sensing module and the proximity sensor can share the same transmitting end 10 and the same receiving end 20. Therefore, when the 3D sensing method provided in this embodiment is applied to the camera device, it is no longer necessary to constitute the camera device with a proximity sensor and a 3D sensing module, but only a 3D sensing module involved in this embodiment needs to be set in the camera device, thereby effectively reducing the volume and weight of the camera device and greatly saving the manufacturing cost.

[0058] It should be noted that each embodiment in the present application is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For product-type embodiments, since they are similar to method-type embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method-type embodiments.

[0059] It should also be noted that, in the present application, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or equipment including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or equipment. In the absence of further restrictions, the elements defined by the statement "comprise one..." do not exclude the existence of other identical elements in the process, method, article or equipment including the elements.

[0060] The above description of the disclosed embodiments enables professionals and technicians in the field to implement or use the present application. Various modifications to these embodiments will be apparent to professionals and technicians in the field, and the general principles defined in the present application can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown in the present application, but will conform to the widest range consistent with the principles and novel features disclosed in the present application.

Claims

1. A 3D sensing module, characterized in that: Includes a transmitter and a receiver; The transmitting end is used to transmit a first outgoing light beam in a depth imaging mode, or to transmit a second outgoing light beam in a proximity sensing mode; wherein the first outgoing light beam generates a corresponding first reflected light beam after being reflected by a target object, and the second outgoing light beam generates a corresponding second reflected light beam after being reflected by the target object, and the field of view angle of the first outgoing light beam is greater than the field of view angle of the second outgoing light beam; The receiving end is used to open all pixels in the depth imaging mode and form a first detection channel with the transmitting end to receive the first reflected light beam and generate a depth image of the target object, or to open some pixels in the proximity sensing mode and form a second detection channel with the transmitting end to receive the second reflected light beam and generate distance information between the 3D sensing module and the target object; the 3D sensing module realizes the depth imaging mode and the proximity sensing mode by sharing one of the transmitting end and one of the receiving end; wherein: The transmitting end includes a first light source, a second light source, a light modulator and a substrate; wherein the first light source and the second light source are both arranged on the substrate, the first light source and the second light source are spaced apart from each other, and the light modulator is mounted on the substrate and is located on the optical path of the first light source and the second light source; The first light source is used to emit a first incident light beam in the depth imaging mode; The second light source is used to emit a second incident light beam in the proximity sensing mode; the light modulator is used to modulate the first incident light beam and project the corresponding first outgoing light beam, or modulate the second incident light beam and project the corresponding second outgoing light beam; the light modulator modulates the first incident light beam by adjusting the field of view angle of the first incident light beam, and the first outgoing light beam includes a floodlight beam; The light modulation device is a liquid crystal panel, and the liquid crystal panel has a diffusion state and a transparent state; wherein, in the depth imaging mode, the liquid crystal panel is in the diffusion state, and in the proximity sensing mode, the liquid crystal panel is in the transparent state; Or, the light modulation device includes a diffuser and transparent glass; Alternatively, the light modulation device includes a diffractive optical element and transparent glass.

2. The 3D sensing module according to claim 1, wherein: Supporting parts extending along the direction of the optical path are formed on two opposite sides of the substrate, and two opposite sides of the optical modulation device are respectively arranged on the two supporting parts.

3. The 3D sensing module according to claim 1, wherein: The transmitting end further includes a control circuit, which is disposed on the substrate and is electrically connected to the first light source and the second light source; The control circuit is used to turn on the first light source and turn off the second light source in the depth imaging mode, or turn on the second light source and turn off the first light source in the proximity sensing mode.

4. The 3D sensing module according to claim 3, characterized in that: The control circuit is further configured to adjust the liquid crystal panel to the diffusion state in the depth imaging mode, or to adjust the liquid crystal panel to the transparent state in the proximity sensing mode.

5. The 3D sensing module according to claim 1, wherein: The first light source includes at least one sub-light source; wherein, when the first light source includes a plurality of the sub-light sources, the plurality of the sub-light sources are distributed in an array.

6. The 3D sensing module according to claim 5, characterized in that: The light modulation device has a first modulation area and a second modulation area connected to each other; wherein the first modulation area corresponds to the first light source, and the second modulation area corresponds to the second light source; The first modulation area is used to modulate the first incident light beam and project the corresponding first outgoing light beam; wherein the irradiation range of the first incident light beam on the first modulation area is limited to within the first modulation area; The second modulation area is used to modulate the second incident light beam and project the corresponding second outgoing light beam; wherein the irradiation range of the second incident light beam on the second modulation area is limited within the second modulation area.

7. The 3D sensing module according to claim 6, wherein: The first modulation area includes a plurality of sub-modulation areas, the plurality of sub-modulation areas are connected to each other, the number of the sub-modulation areas is adapted to the sub-light source, and one sub-modulation area corresponds to one sub-light source; The sub-modulation area is used to modulate the first incident light beam emitted by the corresponding sub-light source and project the corresponding first outgoing light beam; wherein the first outgoing light beams projected by different sub-modulation areas have different viewing angles.

8. The 3D sensing module according to claim 6, wherein: The first modulation area includes n sub-modulation areas, and the nth sub-modulation area is obtained by extending a preset distance outward from the periphery of the n-1th sub-modulation area; wherein n is a positive integer greater than 1; The sub-modulation area is used to modulate the first incident light beam and project the corresponding first output light beam; wherein, in the order of the first sub-modulation area to the nth sub-modulation area, the number of the sub-modulation areas in the open state is positively correlated with the size of the field of view angle of the first output light beam.

9. The 3D sensing module according to claim 1, wherein: The diffuser corresponds to the first light source, and the transparent glass corresponds to the second light source; The diffuser is used to modulate the first incident light beam and project the corresponding first outgoing light beam; wherein the first outgoing light beam is a flood light beam; The transparent glass is used for receiving the second incident light beam and projecting the corresponding second outgoing light beam; wherein the second incident light beam is the same as the second outgoing light beam.

10. The 3D sensing module according to claim 1, wherein: The diffractive optical element corresponds to the first light source, and the transparent glass corresponds to the second light source; The diffractive optical element is used to modulate the first incident light beam and project the corresponding first outgoing light beam; wherein the first outgoing light beam is a speckle light beam; The transparent glass is used for receiving the second incident light beam and projecting the corresponding second outgoing light beam; wherein the second incident light beam is the same as the second outgoing light beam.

11. The 3D sensing module according to claim 1, wherein: The light modulation device includes a diffractive optical element and an optical lens; wherein the diffractive optical element corresponds to the first light source, and the optical lens corresponds to the second light source; The diffractive optical element is used to modulate the first incident light beam and project the corresponding first outgoing light beam; wherein the first outgoing light beam is a speckle light beam; The optical lens is used to converge the second incident light beam and project the corresponding second outgoing light beam.

12. The 3D sensing module according to claim 1, wherein: The substrate is a ceramic substrate.

13. The 3D sensing module according to claim 1, wherein: Types of the first light source and the second light source include any one of LED and VCSEL.

14. The 3D sensing module according to claim 1, wherein: The receiving end includes an image sensor, and the image sensor includes a pixel array; The image sensor is used to receive the first reflected light beam through a first detection channel formed by the pixel array and the transmitting end, and generate a depth image of the target object based on the first reflected light beam, or to receive the second reflected light beam through a second detection channel formed by the pixel array and the transmitting end, and generate distance information between the 3D sensing module and the target object based on the second reflected light beam; wherein, in the depth imaging mode, all pixels in the pixel array are in an on state; and in the proximity sensing mode, some pixels in the pixel array corresponding to the second reflected light beam are in the on state.

15. A 3D sensing method, applied to a 3D sensing module, characterized in that: Controlling the transmitting end to emit a first outgoing light beam in a depth imaging mode, or to emit a second outgoing light beam in a proximity sensing mode; wherein the first outgoing light beam generates a corresponding first reflected light beam after being reflected by a target object, and the second outgoing light beam generates a corresponding second reflected light beam after being reflected by the target object, and the field of view angle of the first outgoing light beam is greater than the field of view angle of the second outgoing light beam; Controlling the receiving end to open all pixels in the depth imaging mode to form a first detection channel with the transmitting end to receive the first reflected light beam and generate a depth image of the target object, or to open some pixels in the proximity sensing mode to form a second detection channel with the transmitting end to receive the second reflected light beam and generate distance information between the 3D sensing module and the target object; the 3D sensing module realizes the depth imaging mode and the proximity sensing mode by sharing one transmitting end and one receiving end; Controlling a first light source in the transmitting end to emit a first incident light beam in the depth imaging mode; Control the first light source in the transmitting end to emit a second incident light beam in the proximity sensing mode; Controlling the optical modulator in the transmitting end to modulate the viewing angle of the first incident light beam and project the corresponding first outgoing light beam, or to modulate the second incident light beam and project the corresponding second outgoing light beam; the optical modulator modulates the first incident light beam including adjusting the viewing angle of the first incident light beam, and the first outgoing light beam includes a floodlight beam; The light modulator is a liquid crystal panel, and the liquid crystal panel has a diffusion state and a transparent state; wherein, in the depth imaging mode, the liquid crystal panel is in the diffusion state, and in the proximity sensing mode, the liquid crystal panel is in the transparent state; or, the light modulator includes a diffuser and transparent glass; or, the light modulator includes a diffractive optical element and transparent glass.

16. An electronic device, characterized in that: Comprising a 3D sensing module as described in any one of claims 1 to 14.

Images