Depth-of-field detection system, depth-of-field detection method, image processing method, and electronic device

Abstract

This application provides a depth detection system, a depth detection method, an image processing method, and an electronic device. The depth detection system includes: a laser generator, a digital micromirror device, a photodetector, a phase detector, and a controller. The digital micromirror device is located in the light output path of the laser generator and is electrically connected to the controller. The photodetector receives reflected light. The phase detector is electrically connected to both the laser generator and the photodetector, receiving first phase information of the emitted light from the laser generator and second phase information of the reflected light from the photodetector, and determines the phase difference between the emitted and reflected light based on the first and second phase information. The controller receives the phase difference from the phase detector and determines the depth information based on the phase difference. This depth detection system can obtain panoramic depth information of a target area, which is beneficial for improving the depth effect of images.

Description

Technical Field

[0001] This application relates to the field of laser measurement technology, and in particular to a depth detection system, a depth detection method, an image processing method, and an electronic device. Background Technology

[0002] In imaging optical systems, an object or part of it is typically imaged with basic sharpness only within a specific range of distances. This range is called the depth of field. Outside this specific range, other parts of the object or other objects may be imaged in a blurred manner.

[0003] Cameras in related electronic devices (such as smartphones and mobile cameras) can only perform single-point ranging and cannot obtain panoramic depth information, resulting in images with poor depth-of-field effects. Summary of the Invention

[0004] This application provides a depth detection system, a depth detection method, an image processing method, and an electronic device, which can solve the problem of poor image depth effect in single-point ranging of cameras.

[0005] The technical solution is as follows:

[0006] On the one hand, a depth detection system is provided, which includes: a laser generator, a digital micromirror device, a photodetector, a phase detector, and a controller;

[0007] The laser generator is used to generate emitted light;

[0008] The digital micromirror device is located on the light output path of the laser generator. The digital micromirror device is electrically connected to the controller. The digital micromirror device is used to reflect the emitted light in different directions under the control of the controller.

[0009] The photodetector is used to receive the reflected light that is reflected back;

[0010] The phase detector is electrically connected to the laser generator and the photodetector, respectively. The phase detector receives the first phase information of the emitted light fed back by the laser generator and the second phase information of the reflected light fed back by the photodetector, and determines the phase difference between the emitted light and the reflected light based on the first phase information and the second phase information.

[0011] The phase detector is electrically connected to the controller. The controller receives the phase difference fed back by the phase detector and determines the depth information based on the phase difference.

[0012] In some embodiments, the digital micromirror device includes a plurality of reflective array elements arranged in an array, each of the reflective array elements including an initial state and at least one working state;

[0013] In the initial state, the reflective array element does not reflect the emitted light into the target area;

[0014] In at least one of the operating states, the reflective array element reflects the emitted light toward one of the target directions of the target region.

[0015] In some embodiments, the depth detection system further includes a light-absorbing device for absorbing the emitted light reflected by the reflective array element in the initial state.

[0016] In some embodiments, the light-absorbing device includes one or more of the following: light-absorbing foam, light-absorbing coating, and carbon nanotube blackbody.

[0017] In some embodiments, the depth detection system further includes a beam expander located between the laser generator and the digital micromirror device. The beam expander is used to non-parallel expand the emitted light so that the emitted light can cover the reflective surface of the digital micromirror device.

[0018] In some embodiments, an aperture element is further provided between the beam expander and the digital micromirror device, the aperture element being used to constrain the boundary range of the emitted light.

[0019] On the other hand, a depth detection method is provided, applied to the depth detection system described in this application, the depth detection method comprising:

[0020] The controller determines the target area and at least one target direction within the target area;

[0021] The controller determines the target operating state of at least one reflective array element in the digital micromirror device based on the mapping relationship between the at least one target direction and the digital micromirror device, and issues a first control command to the digital micromirror device.

[0022] The digital micromirror device responds to the first control command by controlling the at least one reflective array element to adjust to the target working state;

[0023] The controller sends a second control command to the laser generator to generate the emitted light, and the laser generator generates the emitted light in response to the second control command, and inputs the first phase information of the emitted light into the phase detector;

[0024] The controller sends a third control command to the photodetector to receive the reflected light. The photodetector responds to the third control command to receive the reflected light and inputs the second phase information of the reflected light into the phase detector.

[0025] The phase detector determines the phase difference between the emitted light and the reflected light based on the first phase information and the second phase information;

[0026] The controller receives the phase difference fed back by the phase detector and determines the depth information in the at least one target direction based on the phase difference.

[0027] In some embodiments, the second control command and the third control command are issued simultaneously by the controller.

[0028] On the other hand, an image processing method is provided, the image processing method comprising:

[0029] The image processing unit acquires a two-dimensional image of the target region;

[0030] The image processing unit acquires the depth information of the target area output by the depth detection system described in this application;

[0031] The image processing unit divides the target region into depth domains based on the depth information and determines the depth parameters of each depth domain.

[0032] The image processing unit overlaps the depth field with the two-dimensional image and performs depth processing on the overlapping region of the two-dimensional image according to the depth parameters of the depth field.

[0033] On the other hand, an electronic device is provided, which includes the depth detection system described in any one of the claims of this application, or employs the depth detection method described in this application, or the image processing method described in this application.

[0034] The beneficial effects of the technical solution provided in this application include at least the following:

[0035] The depth detection system of this application includes a digital micromirror device positioned along the light output path of a laser generator. This digital micromirror device can reflect the laser light in different directions using its movable reflective properties, enabling depth scanning of the entire target area. The reflected light from different directions is received by a photodetector, and a phase detector compares the phase information of the reflected light with that of the emitted light to determine the phase difference. The controller can then determine the depth information for the corresponding direction based on this phase difference. By integrating all the depth information of the target area, the panoramic depth information of the target area can be obtained, which helps to improve the depth effect of the image. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0037] Figure 1 This is a schematic diagram of the depth detection system provided in the embodiments of this application;

[0038] Figure 2 This is a schematic diagram of the structure of the digital micromirror device provided in the embodiments of this application;

[0039] Figure 3 This is a schematic flowchart of the depth detection method provided in the embodiments of this application;

[0040] Figure 4 This is a schematic flowchart of the image processing method provided in the embodiments of this application.

[0041] The reference numerals in the figure are respectively:

[0042] 1. Laser generator;

[0043] 2. Digital micromirror device; 21. Reflection array element;

[0044] 3. Photodetector;

[0045] 4. Phase detector;

[0046] 5. Controller;

[0047] 6. Light absorption device;

[0048] 7. Beam expander;

[0049] 8. Aperture element;

[0050] 100. Target area. Detailed Implementation

[0051] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0052] In the description of this application, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential" indicate the orientation or positional relationship based on the appendix. Figure 1 The orientations or positional relationships shown are for the purpose of facilitating and simplifying the description of this application, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application.

[0053] It should be understood that in this application, "electrical connection" can be understood as physical contact and electrical conduction between components; it can also be understood as a form of connection between different components in a circuit structure through physical lines such as copper foil or wires on a printed circuit board (PCB) capable of transmitting electrical signals. "Communication connection" can refer to the transmission of electrical signals, including wireless communication connections and wired communication connections. Wireless communication connections do not require a physical medium and are not a connection relationship that limits the product structure. "Connection" and "connected" can both refer to a mechanical or physical connection relationship, that is, A and B being connected or connected can mean that there are fastening components (such as screws, bolts, rivets, etc.) between A and B, or that A and B are in contact with each other and are difficult to separate.

[0054] Unless otherwise defined, all technical terms used in the embodiments of this application have the same meaning as commonly understood by one of ordinary skill in the art.

[0055] Depth of field (DOF) refers to the range of distances in front of and behind a subject that allow for a sharp image to be captured by the lens of a camera or other imaging device. Aperture, lens, and the distance from the focal plane to the subject are important factors affecting depth of field.

[0056] The ranging methods used by cameras in related electronic devices (such as smartphones and action cameras) to achieve depth-of-field photography are usually time-of-flight (TOF), structured light, and RGB binocular methods. However, these ranging methods can usually only achieve single-point ranging and cannot obtain panoramic depth information, resulting in poor depth-of-field effects in the images.

[0057] Therefore, this application provides a depth detection system, a depth detection method, an image processing method, and an electronic device, which can obtain panoramic depth information of the target area, which is beneficial to improving the depth effect of the image.

[0058] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0059] On the one hand, combined with Figure 1 As shown, this embodiment provides a depth detection system, which includes: a laser generator 1, a digital micromirror device 2, a photodetector 3, a phase detector 4, and a controller 5.

[0060] Laser generator 1 is used to generate emitted light.

[0061] The digital micromirror device 2 is located on the light output path of the laser generator 1. The digital micromirror device 2 is electrically connected to the controller 5. The digital micromirror device 2 is used to reflect and emit light in different directions under the control of the controller 5.

[0062] The photodetector 3 is used to receive the reflected light that is reflected back.

[0063] Phase detector 4 is electrically connected to laser generator 1 and photodetector 3 respectively. Phase detector 4 receives the first phase information of the emitted light fed back by laser generator 1 and the second phase information of the reflected light fed back by photodetector 3 respectively, and determines the phase difference between emitted light and reflected light based on the first phase information and the second phase information.

[0064] Phase detector 4 is electrically connected to controller 5. Controller 5 receives the phase difference fed back by phase detector 4 and determines the depth information based on the phase difference.

[0065] The depth detection system of this application includes a digital micromirror device 2 installed on the light output path of the laser generator 1. The digital micromirror device 2 can reflect the laser in different directions using its movable reflective properties, enabling depth scanning of the entire target area 100. The reflected light from different directions is received by the photodetector 3. The phase detector 4 compares the phase information of the reflected light with the phase information of the emitted light to determine the phase difference. The controller 5 can determine the depth information of the corresponding direction based on the phase difference. By integrating all the depth information of the target area 100, the panoramic depth information of the target area 100 can be obtained, which helps to improve the depth effect of the image.

[0066] In some possible implementations, the digital micromirror device (DMD) is an array composed of multiple high-speed digital optical reflective switches. It is a type of optical switch that uses rotating mirrors to open and close the optical switch; the opening and closing time is relatively long, on the order of microseconds. When the DMD is open, the mirrors are at a certain angle, allowing reflected light to enter the target optical path. When the DMD is closed, the mirrors rotate slightly, and the reflected light cannot enter the target optical path, thus achieving the effect of turning off the optical switch.

[0067] In some possible implementations, the optical detector is a single-electron avalanche diode (SPAD), also known as an APD operating in Geiger mode. This SPAD is used to detect reflected laser light and generate an electrical signal. The number of SPADs can be single or multiple. As a photoelectric detection sensor, the SPAD plays an analog-to-digital conversion role in the depth detection system of this embodiment, converting analog light signals into recognizable digital signals to mark the arrival time of the signal.

[0068] In some possible implementations, the phase detector refers to a device that can identify the phase difference of the input signals, and is a circuit that makes the output voltage have a definite relationship with the phase difference between the two input signals.

[0069] In this embodiment, the phase detector 4 can identify and compare the phases of the emitted light and the reflected light to determine the phase difference between the two types of light. Thus, the controller 5 can determine the distance to the obstacle, i.e., the depth information, based on algorithms such as TOF.

[0070] Combination Figure 2 As shown, in some embodiments, the digital micromirror device 2 includes a plurality of reflective array elements 21 arranged in an array. Each reflective array element 21 includes an initial state and at least one operating state. In the initial state, the reflective array element 21 does not reflect emitted light into the target area 100; in at least one operating state, the reflective array element 21 reflects emitted light toward one of the target directions of the target area 100.

[0071] In this embodiment, the multiple reflective array elements 21 of the digital micromirror device 2 are arranged in an array. The number and area of ​​the reflective array elements 21 determine the resolution of the digital micromirror device 2. The higher the resolution, the more target directions the digital micromirror device 2 can achieve, thus enabling more precise depth detection of the target area 100. The obtained panoramic depth information is closer to the actual situation, and the image depth effect based on the panoramic depth information is more realistic and the imaging quality is higher.

[0072] In some possible implementations, when the reflective element 21 is in this working state, the emitted light can be reflected on the surface of the reflective element and then emitted along the target direction, which is equivalent to the light path in the target direction being open. When the reflective element 21 is in the initial state, the emitted light cannot be reflected by the reflective element, or even if it is reflected, it cannot be emitted along the target direction, which is equivalent to the light path in the target direction being closed.

[0073] When multiple reflective array elements 21 are controlled by the controller 5, they switch between the initial state and the working state according to the control command, so that the emitted light can be directed toward the target area 100 in a certain way, thereby achieving scanning of the target area 100.

[0074] refer to Figure 2 As shown, the reflective array element 21 is divided into multiple columns along the horizontal direction: X1, X2, X3...Xn, and into multiple rows along the vertical direction: Y1, Y2, Y3...Yn.

[0075] The digital micromirror device 2 in this embodiment can perform depth detection by point illumination.

[0076] For example, the reflective array element 21 in column X1 and row Y1 (the reflective array element 21 in the upper left corner) is adjusted to the working state, while the remaining reflective array elements 21 are adjusted to the initial state. Only the emitted light that illuminates the reflective array element 21 in column X1 and row Y1 of the laser generator 1 is reflected towards the target area 100, thereby enabling depth detection of a single point within the target area 100.

[0077] It should be noted that the single-point depth-of-field detection mode can be applied to any one of the reflective array elements 21 in the digital micromirror device 2.

[0078] For example, the X1 column Y1 row reflective array element 21 and the Xn column Yn row reflective array element 21 are adjusted to the working state, while the remaining reflective array elements 21 are adjusted to the initial state. Only the emitted light from the laser generated by the laser generator 1 that illuminates the X1 column Y1 row reflective array element 21 and the Xn column Yn row reflective array element 21 is reflected towards the target area 100, thereby enabling depth detection of two points within the target area 100.

[0079] It should be noted that the dual-point depth-of-field detection mode can be applied to any two reflective array elements 21 in the digital micromirror device 2.

[0080] Furthermore, any three or four reflective array elements 21 in the digital micromirror device 2 can be adjusted to the working state, while the remaining reflective array elements 21 are adjusted to the initial state.

[0081] The digital micromirror device 2 in this embodiment can also perform depth detection by means of wire beam scanning.

[0082] For example, the reflective array element 21 in column X1 is adjusted to the working state, while the remaining columns X2, X3...Xn are adjusted to the initial state. Only the laser beam generated by the laser generator 1 that illuminates the reflective array element 21 in column X1 is reflected towards the target area 100, thereby forming a linear beam of light within the target area 100. The depth information of the area illuminated by this beam of light can be detected.

[0083] Furthermore, the reflective array elements 21 in column X1 can be adjusted to the initial state, and the reflective array elements 21 in column X2 can be adjusted to the working state. The remaining columns X3...Xn remain in the initial state. After the depth information detection of the target area 100 corresponding to the reflective array elements 21 in column X2 is completed, the reflective array elements 21 in column X3 are adjusted to the working state in turn, and so on. The linear beam of light in the target area 100 sweeps across the entire target area 100 in the horizontal direction, thereby realizing the horizontal scanning of the target area 100.

[0084] In another example, the reflective array elements 21 in the vertical Y1, Y2, Y3...Yn rows are sequentially adjusted to the working state, and the linear beam of light in the target area 100 sweeps across the entire target area 100 vertically, thereby realizing the horizontal scanning of the target area 100.

[0085] As another example, by simultaneously controlling the reflective array elements 21 in the vertical rows Y1, Y2, Y3...Yn and the reflective array elements 21 in the horizontal columns X1, X2, X3...Xn to be sequentially adjusted to the working state, two linear beams of light, one horizontal and one vertical, are simultaneously formed within the target area 100, and they scan the entire target area 100 along the horizontal and vertical directions respectively, realizing cross-scanning of the target area 100. This cross-scanning is beneficial to improving the detection accuracy of depth information.

[0086] Combination Figure 1 As shown, in some embodiments, the depth detection system further includes a light-absorbing device 6, which is used to absorb the emitted light reflected by the reflective array element 21 in its initial state.

[0087] To prevent light pollution within the system, an active absorption strategy is adopted for emitted light that does not participate in depth detection. Specifically, a light-absorbing device 6 is arranged on the reflected light path of the reflective array element 21 in its initial state. This portion of emitted light can be absorbed by the light-absorbing device 6, thus avoiding light pollution. In addition, actively absorbing emitted light that does not participate in the operation also helps protect the system structure and prevent structural damage caused by prolonged exposure.

[0088] In some embodiments, the light-absorbing device 6 includes one or more of the following: light-absorbing foam, a light-absorbing coating, and a carbon nanotube blackbody. Foam is a material made by foaming plastic particles, often simply called foam. Foam has a series of characteristics such as elasticity, light weight, rapid pressure-sensitive fixing, ease of use, flexibility, ultra-thin size, and reliable performance. For example, polyvinyl chloride (PVC) foam. The light-absorbing coating can absorb all visible and infrared light, such as a nanoparticle chemical composite coating film. The carbon nanotube blackbody, or vantablack, is composed of vertically arranged carbon nanotubes. At room temperature, it does not emit visible light and absorbs up to 99.965% of electromagnetic radiation in the visible light band. This is because when light enters a carbon nanotube blackbody, it is almost not reflected but is confined within the tube wall and continuously deflected until it is finally converted into heat energy.

[0089] Combination Figure 1 As shown, in some embodiments, the depth detection system further includes a beam expander 7, which is located between the laser generator 1 and the digital micromirror device 2. The beam expander 7 is used to non-parallel expand the emitted light so that the emitted light can cover the reflective surface of the digital micromirror device 2.

[0090] The emitted light is non-parallel expanded using the beam expander 7, and the illumination range of the emitted light gradually increases with the increase of the illumination distance. After being reflected by the digital micromirror device 2, it can fully cover a large target area 100. This is beneficial to reducing the size of the digital micromirror device 2, further reducing the size of the depth detection system, and improving the integration of the depth detection system into electronic devices.

[0091] On the other hand, the beam expander 7 is located on the incident side of the digital micromirror device 2, and the emitted light illuminating the digital micromirror device 2 is formed after beam expansion. The spot diameter of the emitted light reflected by the digital micromirror device 2 depends on the size of the reflection array element 21 in the digital micromirror device 2. Compared with the diffuser being located on the exit side of the digital micromirror device 2, the emitted light spot diameter formed by this scheme is smaller, the depth detection resolution is higher, and it is more conducive to accurate depth detection of the target area 100.

[0092] Combination Figure 1 As shown, in some embodiments, an aperture element 8 is also provided between the beam expander 7 and the digital micromirror device 2. The aperture element 8 is used to constrain the range of emitted light. By using the aperture element 8 to filter the emitted light illuminating the digital micromirror device 2 at the boundary, it is beneficial to improve the working efficiency of the digital micromirror device 2 and avoid interference from boundary light.

[0093] Combination Figure 1As shown, in some embodiments, the electrical components in the depth detection system, such as the laser generator 1, photodetector 3, phase detector 4, and digital micromirror device 2, are electrically connected to the controller 5, and the controller 5 supplies power to the aforementioned components.

[0094] Furthermore, the power supply connection between the laser generator 1 and the photodetector 3 and the controller 5 is configured for synchronous operation, meaning that the controller 5 supplies power to the laser generator 1 while simultaneously supplying power to the photodetector 3. This helps reduce the ineffective standby time of the two devices, saves energy, and also enables the two devices to operate synchronously, improving the synchronization of the first phase information and the second phase information input into the phase detector 4.

[0095] On the other hand, combining Figure 3 As shown, this embodiment provides a depth detection method, applied to the depth detection system of this application (reference). Figure 1 Depth detection methods include:

[0096] Step S1, the controller 5 determines the target area 100 and at least one target direction within the target area 100.

[0097] In step S2, the controller 5 determines the target working state of at least one reflective array element 21 in the digital micromirror device 2 based on the mapping relationship between at least one target direction and the digital micromirror device 2, and issues a first control command to the digital micromirror device 2.

[0098] In step S3, the digital micromirror device 2 responds to the first control command and controls at least one reflective array element 21 to adjust to the target working state.

[0099] In step S4, the controller 5 sends a second control command to the laser generator 1 to generate emitted light. The laser generator 1 responds to the second control command to generate emitted light and inputs the first phase information of the emitted light into the phase detector 4.

[0100] In step S5, the controller 5 sends a third control command to the photodetector 3 to receive the reflected light. The photodetector 3 responds to the third control command to receive the reflected light and inputs the second phase information of the reflected light into the phase detector 4.

[0101] In step S6, the phase detector 4 determines the phase difference between the emitted light and the reflected light based on the first phase information and the second phase information.

[0102] In step S7, the controller 5 receives the phase difference fed back by the phase detector 4 and determines the depth information in at least one direction based on the phase difference.

[0103] The depth detection method in this embodiment is based on the depth detection system of this application and has all the beneficial technical effects of all embodiments herein.

[0104] The depth detection method of this embodiment can utilize the working characteristics of the digital micromirror device 2 to achieve depth detection in different directions within the target area 100. It can realize depth detection methods such as single-point, multi-point, single-beam scanning, and cross-beam scanning, which can improve the efficiency of depth information detection in the target area 100, realize panoramic depth detection, and help improve the depth effect of the image.

[0105] In some embodiments, the second control command and the third control command are issued simultaneously by the controller 5. This helps ensure that the laser generator 1 and the photodetector 3 are powered on and enabled simultaneously, starting synchronously, saving energy while improving the synchronization of the first phase information and the second phase information.

[0106] On the other hand, combining Figure 4 As shown, this embodiment provides an image processing method, which includes:

[0107] Step 1: The image processing unit acquires a two-dimensional image of the target region 100.

[0108] Optionally, the image processing unit is connected to an RGB camera, which captures an image of the target area 100 to obtain a two-dimensional image of the target area 100. This two-dimensional image is obtained by the RGB camera capturing the entire target area 100 under the same focal length, exposure, and other parameters, excluding depth information, or the depth parameters of all points within the target area 100 are the same.

[0109] Step two, the image processing unit acquires the depth information of the target region 100 output by the depth detection system of this application. Optionally, the depth detection system uses the depth detection method of this application to acquire depth information in multiple target directions within the target region 100. The number of target directions can be less than or equal to the number of reflective array elements 21 in the digital micromirror device 2, that is, each reflective array element 21 completes depth detection in one target direction.

[0110] Step 3: The image processing unit divides the target region 100 into depth domains based on the depth information and determines the depth parameters of each depth domain.

[0111] Optionally, the depth field is divided according to the numerical value of the depth information, and areas with the same depth value are divided into the same depth field.

[0112] Step four: The image processing unit overlaps the depth field with the two-dimensional image and performs depth processing on the overlapping area of ​​the two-dimensional image according to the depth parameters of the depth field.

[0113] Optionally, depth processing includes adjusting image parameters such as sharpness, blur, contrast, brightness, and blurring based on different depth parameters.

[0114] In some possible implementations, two-dimensional images and depth parameters are fused based on Virtual Reality (VR) technology to reconstruct and generate 3D images with a fixed viewpoint.

[0115] The image processing method in this embodiment uses the depth information obtained by the depth detection system of this application, which can perform multi-point or panoramic depth detection on the target area 100. With the help of the depth information, the image can be processed more accurately, making the depth effect of the image more accurate and the image quality better.

[0116] On the other hand, an electronic device is provided, which includes the depth detection system of any one of the claims of this application, or employs the depth detection method of this application, or the image processing method of this application.

[0117] The electronic device in this embodiment employs the depth detection system, depth detection method, or image processing method of this application, and has all the beneficial technical effects of all embodiments herein.

[0118] Specifically, the electronic device can be any of various types of computer system devices that are mobile or portable and perform image acquisition. Specifically, the electronic device can be a mobile phone or smartphone equipped with a camera (e.g., an iPhone™ or Android™ based phone), a portable gaming device (e.g., Nintendo DS™, PlayStation Portable™, Game Boy Advance™, iPhone™), a laptop computer, a PDA, a portable internet device, and a data storage device. The electronic device can also be other wearable devices that require image acquisition (e.g., head-mounted devices such as electronic bracelets, electronic necklaces, electronic devices, or smartwatches (HMDs)).

[0119] Electronic devices can also be any one of a plurality of electronic devices, including but not limited to cellular phones, smartphones, other wireless communication devices, personal digital assistants, audio players, other media players, music recorders, video recorders, other media recorders, radios, medical devices, vehicle transport instruments, calculators, programmable remote controls, pagers, laptop computers, desktop computers, printers, netbooks, personal digital assistants (PDAs), portable multimedia players (PMPs), Moving Picture Experts Group (MPEG-1 or MPEGG-2) audio layer 3 (MP3) players, portable medical devices, and digital cameras and combinations thereof.

[0120] In some cases, electronic devices can perform multiple functions (e.g., playing music, displaying video, storing pictures, and receiving and sending telephone calls). If desired, electronic devices can be such as cellular phones, media players, other handheld devices, wristwatches, pendant devices, or other compact, portable devices.

[0121] It should be noted that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, features defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0122] In this application, unless otherwise expressly specified and limited, "above" or "below" the second feature can include direct contact between the first and second features, or contact between the first and second features through another feature between them. Furthermore, "above," "over," and "on top" of the second feature includes the first feature being directly above or diagonally above the second feature, or simply indicates that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature includes the first feature being directly below or diagonally below the second feature, or simply indicates that the first feature is at a lower horizontal level than the second feature.

[0123] In the description of this specification, the references to the terms "certain embodiments", "one embodiment", "some embodiments", "illustrative embodiment", "example", "specific example", or "some examples" refer to specific features, structures, materials, or characteristics described in connection with the embodiments or examples that are included in at least one embodiment or example of this application.

[0124] The above description is merely an embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the principles of this application should be included within the protection scope of this application.

Claims

1. A depth detection system, characterized in that, The depth detection system includes: a laser generator (1), a digital micromirror device (2), a photodetector (3), a phase detector (4), and a controller (5); The laser generator (1) is used to generate emitted light; The digital micromirror device (2) is located on the light output path of the laser generator (1). The digital micromirror device (2) is electrically connected to the controller (5). The digital micromirror device (2) includes multiple reflective array elements (21). The controller (5) can control the multiple reflective array elements (21) to reflect the emitted light in different directions. The photodetector (3) is used to receive the reflected light that is reflected back; The phase detector (4) is electrically connected to the laser generator (1) and the photodetector (3) respectively. The phase detector (4) receives the first phase information of the emitted light fed back by the laser generator (1) and the second phase information of the reflected light fed back by the photodetector (3). The phase difference between the emitted light and the reflected light is determined based on the first phase information and the second phase information. The phase detector (4) is electrically connected to the controller (5). The controller (5) receives the phase difference fed back by the phase detector (4) and determines the depth information based on the phase difference.

2. The depth detection system according to claim 1, characterized in that, The multiple reflection array elements (21) are arranged in an array, and each reflection array element (21) includes an initial state and at least one working state; In the initial state, the reflective array element (21) does not reflect the emitted light into the target area (100); In at least one of the operating states, the reflective array element (21) reflects the reflected light toward one of the target directions of the target region (100).

3. The depth detection system according to claim 2, characterized in that, The depth detection system also includes a light-absorbing device (6) for absorbing the emitted light reflected by the reflective array element (21) in the initial state.

4. The depth detection system according to claim 3, characterized in that, The light-absorbing device (6) includes one or more of the following: light-absorbing foam, light-absorbing coating, and carbon nanotube blackbody.

5. The depth detection system according to any one of claims 1 to 4, characterized in that, The depth detection system also includes a beam expander (7), which is located between the laser generator (1) and the digital micromirror device (2). The beam expander (7) is used to non-parallel expand the emitted light so that the emitted light can cover the reflective surface of the digital micromirror device (2).

6. The depth detection system according to claim 5, characterized in that, An aperture element (8) is also provided between the beam expander (7) and the digital micromirror device (2), and the aperture element (8) is used to constrain the boundary range of the emitted light.

7. A depth detection method, characterized in that, The depth detection system applied to any one of claims 1 to 6, the depth detection method comprising: The controller (5) determines the target area and at least one target direction within the target area; The controller (5) determines the target working state of at least one reflective array element in the digital micromirror device (2) according to the mapping relationship between the at least one target direction and the digital micromirror device (2), and issues a first control command to the digital micromirror device (2); The digital micromirror device (2) responds to the first control command, controls the at least one reflective array element to adjust from the initial state to the target working state, and enables the reflected light to be directed toward the target area to scan the target area; The controller (5) sends a second control command to the laser generator (1) to generate the emitted light. The laser generator (1) generates the emitted light in response to the second control command and inputs the first phase information of the emitted light into the phase detector (4). The controller (5) sends a third control command to the photodetector (3) to receive the reflected light. The photodetector (3) receives the reflected light in response to the third control command and inputs the second phase information of the reflected light into the phase detector (4). The phase detector (4) determines the phase difference between the emitted light and the reflected light based on the first phase information and the second phase information; The controller (5) receives the phase difference fed back by the phase detector (4) and determines the depth information in the at least one target direction based on the phase difference.

8. The depth detection method according to claim 7, characterized in that, The second control command and the third control command are issued simultaneously by the controller (5).

9. An image processing method, characterized in that, The image processing method includes: The image processing unit acquires a two-dimensional image of the target region; The image processing unit acquires the depth information of the target area output by the depth detection system according to any one of claims 1 to 6; The image processing unit divides the target region into depth domains based on the numerical value of the depth information and determines the depth parameters of each depth domain. The image processing unit overlaps the depth field with the two-dimensional image and performs depth processing on the overlapping area of ​​the two-dimensional image according to the depth parameters of the depth field. The depth processing includes adjusting at least one parameter among the image's sharpness value, blur value, contrast, brightness, and blur processing according to different depth parameters.

10. An electronic device, characterized in that, The electronic device includes the depth detection system according to any one of claims 1 to 6, or includes a camera capable of operating the depth detection method according to claim 7 or 8, or the image processing method according to claim 9.

Images