Depth-of-field detection system, depth-of-field detection method, image processing method and electronic equipment

Abstract

The invention provides a depth-of-field detection system, a depth-of-field detection method, an image processing method and electronic equipment. The depth-of-field detection system comprises a laser generator, a digital micromirror device, a photoelectric detector, a phase discriminator and a controller. The digital micromirror device is located on a light emitting path of the laser generator, and the digital micromirror device is electrically connected with the controller; the photoelectric detector is used for receiving the reflected light; the phase discriminator is electrically connected with the laser generator and the photoelectric detector, the phase discriminator receives first phase information, fed back by the laser generator, of the emitted light and second phase information, fed back by the photoelectric detector, of the reflected light, and the phase difference between the emitted light and the reflected light is determined according to the first phase information and the second phase information; the controller receives the phase difference fed back by the phase discriminator and determines depth-of-field information according to the phase difference. According to the depth-of-field detection system, the panoramic depth information of the target area can be obtained, and the depth-of-field effect of the image can be improved.

Description

Technical Field

[0001] The present application relates to the field of laser measurement technology, and in particular to a depth of field detection system, a depth of field detection method, an image processing method and an electronic device. Background Art

[0002] In an imaging optical system, an object to be imaged or a part thereof is usually imaged substantially clearly by the optical system only within a specific distance range. The range of this distance range is called the depth of field. Outside this specific distance range, other parts of the object or other objects may be imaged in a blurred manner.

[0003] The cameras of electronic devices of related technologies (such as smart phones, mobile cameras, etc.) can only achieve single-point ranging and cannot obtain panoramic depth information. The images obtained generally have the problem of poor depth of field effect. Summary of the invention

[0004] The present application provides a depth of field detection system, a depth of field detection method, an image processing method and an electronic device, which can solve the problem of poor image depth of field effect in single-point ranging of a camera.

[0005] The technical solution is as follows:

[0006] In one aspect, a depth of field detection system is provided, the depth of field detection system comprising: a laser generator, a digital micromirror device, a photodetector, a phase detector and a controller;

[0007] The laser generator is used to generate emission light;

[0008] The digital micromirror device is located on the light output path of the laser generator, the digital micromirror device is electrically connected to the controller, and the digital micromirror device is used to reflect the emitted light in different directions under the control of the controller;

[0009] The photoelectric detector is used to receive the reflected light;

[0010] The phase detector is electrically connected to the laser generator and the photodetector respectively, and the phase detector receives the first phase information of the emitted light fed back by the laser generator and the second phase information of the reflected light fed back by the photodetector respectively, and determines the phase difference between the emitted light and the reflected light according to the first phase information and the second phase information;

[0011] The phase detector is electrically connected to the controller. The controller receives the phase difference fed back by the phase detector and determines the depth of field information according to the phase difference.

[0012] In some embodiments, the digital micromirror device includes a plurality of reflective array elements, the plurality of reflective array elements are arranged in an array, and each of the reflective array elements includes an initial state and at least one working state;

[0013] In the initial state, the reflective array element does not reflect the emitted light into the target area;

[0014] In the at least one working state, the reflective array element reflects the emitted light toward one target direction of the target area.

[0015] In some embodiments, the depth of field detection system further includes a light absorbing device, and the light absorbing device is used to absorb the emission light reflected by the reflective array element in the initial state.

[0016] In some embodiments, the light absorbing device includes one or more of the following: light absorbing foam, light absorbing coating, and carbon nanotube black body.

[0017] In some embodiments, the depth of field detection system also includes a beam expander, which is located between the laser generator and the digital micromirror device, and is used to perform non-parallel beam expansion on the emitted light so that the emitted light can cover the reflective surface of the digital micromirror device.

[0018] In some embodiments, an aperture element is further provided between the beam expander and the digital micromirror device, and the aperture element is used to constrain the boundary range of the emitted light.

[0019] On the other hand, a depth of field detection method is provided, which is applied to the depth of field detection system described in the present application, and the depth of field detection method includes:

[0020] The controller determines a target area and at least one target direction within the target area;

[0021] The controller determines a target working state of at least one reflective array element in the digital micromirror device according to a mapping relationship between the at least one target direction and the digital micromirror device, and issues a first control instruction to the digital micromirror device;

[0022] The digital micromirror device controls the at least one reflective array element to adjust to the target working state in response to the first control instruction;

[0023] The controller sends a second control instruction to the laser generator to generate the emission light, and the laser generator generates the emission light in response to the second control instruction, and inputs the first phase information of the emission light into the phase detector;

[0024] The controller sends a third control instruction to the photodetector to receive the reflected light, and the photodetector receives the reflected light in response to the third control instruction and inputs the second phase information of the reflected light into the phase detector;

[0025] The phase detector determines the phase difference between the emitted light and the reflected light according to the first phase information and the second phase information;

[0026] The controller receives the phase difference fed back by the phase detector, and determines the depth of field information in the at least one target direction according to the phase difference.

[0027] In some embodiments, the second control instruction and the third control instruction are issued by the controller simultaneously.

[0028] On the other hand, an image processing method is provided, the image processing method comprising:

[0029] The image processing unit acquires a two-dimensional image of the target area;

[0030] The image processing unit obtains the depth information of the target area output by the depth detection system described in the present application;

[0031] The image processing unit divides the target area into depth domains according to the depth information, and determines a depth parameter of each depth domain;

[0032] The image processing unit overlaps the depth of field domain with the two-dimensional image, and performs depth processing on the overlapped area of ​​the two-dimensional image according to the depth parameter of the depth of field domain.

[0033] On the other hand, an electronic device is provided, which includes the depth of field detection system described in any one of the present applications, or adopts the depth of field detection method described in the present application, or the image processing method described in the present application.

[0034] The beneficial effects of the technical solution provided by this application include at least:

[0035] The depth of field detection system of the present application is provided with a digital micromirror device on the light output path of the laser generator. The digital micromirror device can use its own movable reflection characteristics to reflect the laser in different directions, so as to realize the depth of field scanning of the entire target area. The reflected light reflected from different directions is received by the photoelectric detector, and the phase detector compares the phase information of the reflected light with the phase information of the emitted light to determine the phase difference. The controller can determine the depth of field information of the corresponding direction according to the phase difference, and integrate all the depth of field information of the target area to obtain the panoramic depth information of the target area, which is conducive to improving the depth of field effect of the image. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0037] Figure 1 is a schematic diagram of the structure of a depth of field detection system provided in an embodiment of the present application;

[0038] Figure 2 is a structural schematic diagram of a digital micromirror device provided in an embodiment of the present application;

[0039] Figure 3 is a flow chart of a depth of field detection method provided in an embodiment of the present application;

[0040] Figure 4 It is a flowchart of the image processing method provided in the embodiment of the present application.

[0041] The reference numerals in the figures represent respectively:

[0042] 1. Laser generator;

[0043] 2. Digital micromirror device; 21. Reflection array element;

[0044] 3. Photoelectric detector;

[0045] 4. Phase detector;

[0046] 5. Controller;

[0047] 6. Light absorption device;

[0048] 7. Beam expander;

[0049] 8. Aperture element;

[0050] 100. Target area. DETAILED DESCRIPTION

[0051] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0052] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate directions or positional relationships based on the attached Figure 1 The orientation or positional relationship shown is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0053] It should be understood that in this application, "electrical connection" can be understood as physical contact and electrical conduction between components; it can also be understood as a form of connection between different components in the circuit structure through physical lines such as printed circuit board (PCB) copper foil or wires that can transmit electrical signals. "Communication connection" can refer to electrical signal transmission, including wireless communication connection and wired communication connection. Wireless communication connection does not require a physical medium and does not belong to a connection relationship that limits the product structure. "Connection" and "connected" can both refer to a mechanical connection relationship or a physical connection relationship, that is, A is connected to B or A is connected to B, which can mean that there is a fastening component (such as screws, bolts, rivets, etc.) between A and B, or A and B are in contact with each other and A and B are difficult to separate.

[0054] Unless otherwise defined, all technical terms used in the embodiments of the present application have the same meanings as commonly understood by those of ordinary skill in the art.

[0055] Depth of field (DOF) refers to the range of distances in front of and behind the subject that can be imaged clearly at the front of the camera lens or other imaging equipment. The aperture, lens, and distance from the focal plane to the subject are important factors affecting the depth of field.

[0056] The distance measurement methods used by the cameras of electronic devices in the related technology (such as smart phones, sports cameras, etc.) to achieve depth of field photography are usually time-of-flight (TOF), structured light, and RGB binocular method. However, these distance measurement methods can usually only achieve single-point distance measurement and cannot obtain panoramic depth information, resulting in poor depth of field effect of the image.

[0057] Therefore, the present application provides a depth of field detection system, a depth of field detection method, an image processing method and an electronic device, which can obtain panoramic depth information of a target area, which is conducive to improving the depth of field effect of an image.

[0058] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0059] On the one hand, combined with Figure 1 As shown, this embodiment provides a depth of field detection system, which includes: a laser generator 1, a digital micromirror device 2, a photodetector 3, a phase detector 4 and a controller 5.

[0060] The laser generator 1 is used to generate emission light.

[0061] The digital micromirror device 2 is located on the light output path of the laser generator 1 . The digital micromirror device 2 is electrically connected to the controller 5 . The digital micromirror device 2 is used to reflect the emitted light in different directions under the control of the controller 5 .

[0062] The photodetector 3 is used to receive the reflected light.

[0063] The phase detector 4 is electrically connected to the laser generator 1 and the photodetector 3 respectively, and the phase detector 4 receives the first phase information of the emitted light fed back by the laser generator 1 and the second phase information of the reflected light fed back by the photodetector 3 respectively, and determines the phase difference between the emitted light and the reflected light according to the first phase information and the second phase information.

[0064] The phase detector 4 is electrically connected to the controller 5 . The controller 5 receives the phase difference fed back by the phase detector 4 and determines the depth of field information according to the phase difference.

[0065] The depth of field detection system of the present application is provided with a digital micromirror device 2 on the light output path of the laser generator 1. The digital micromirror device 2 can use its own movable reflection characteristics to reflect the laser in different directions, and can realize the depth of field scanning of the entire target area 100. The reflected light reflected from different directions is received by the photodetector 3, and the phase detector 4 compares the phase information of the reflected light with the phase information of the emitted light to determine the phase difference. The controller 5 can determine the depth of field information of the corresponding direction according to the phase difference, and integrate all the depth of field information of the target area 100 to obtain the panoramic depth information of the target area 100, which is conducive to improving the depth of field effect of the image.

[0066] In some possible implementations, the digital micromirror device 2, or digital micromirror device (DMD), is an array composed of multiple high-speed digital light reflectors. It is a type of optical switch that uses a rotating reflector to realize the opening and closing of the optical switch. The opening and closing time is slightly longer, in the order of microseconds. When the DMD is turned on, the reflector is at a certain angle, and the reflected light can enter the target optical path. When the DMD is turned off, that is, the reflector of the DMD produces a small rotation, the light cannot enter the target optical path after reflection, and the effect of closing the optical switch is achieved.

[0067] In some possible implementations, the optical detector is a single electron avalanche diode (SPAD), also known as an APD (Avalanche Photon Diode) working in Geiger mode, which can be used to detect reflected lasers and generate electrical signals. The number of the SAPDs can be single or multiple. As a sensor device for photoelectric detection, SPAD plays the role of analog-to-digital conversion in the depth of field detection system of this embodiment, that is, converting analog optical signals into recognizable digital signals to mark the time when the signal arrives.

[0068] In some possible implementations, the phase detector 4 (phase detector) refers to a device that can identify the phase difference of input signals, and is a circuit that makes the output voltage have a definite relationship with the phase difference between two input signals.

[0069] The phase detector 4 in this embodiment can identify and compare the phases of the emitted light and the reflected light, so as to determine the phase difference between the two lights, so that the controller 5 can determine the distance of the obstacle, that is, the depth of field information, according to algorithms such as TOF.

[0070] Combination Figure 2 As shown, in some embodiments, the digital micromirror device 2 includes a plurality of reflective array elements 21, and the plurality of reflective array elements 21 are arranged in an array, and each reflective array element 21 includes an initial state and at least one working state. In the initial state, the reflective array element 21 does not reflect the emitted light into the target area 100; in at least one working state, the reflective array element 21 reflects the emitted light toward one of the target directions of the target area 100.

[0071] The multiple reflective elements 21 of the digital micromirror device 2 in this embodiment are arranged in an array. The number and area of ​​the reflective elements 21 determine the resolution of the digital micromirror device 2. The higher the resolution, the more target directions the digital micromirror device 2 can achieve, so that more precise depth of field detection can be performed on the target area 100, and the obtained panoramic depth information is closer to the actual situation. The depth of field effect of the image processed based on the panoramic depth information is more realistic and the imaging quality is higher.

[0072] In some possible implementations, the reflective array element 21 has one working state, when the reflective array element 21 is in this working state, the emitted light can be reflected on the surface of the emitting array element, and then emitted in the target direction, which is equivalent to the light path in the target direction being open. When the reflective array element 21 is in the initial state, the emitted light cannot be reflected by the emitting array element, or even if it is reflected, it cannot be emitted in the target direction, which is equivalent to the light path in the target direction being closed.

[0073] When the multiple reflective array elements 21 are switched between the initial state and the working state according to the control instruction rule under the control of the controller 5 , the emitted light can be directed to the target area 100 according to a certain rule, thereby realizing scanning within the target area 100 .

[0074] refer to Figure 2 As shown, the reflective array elements 21 are divided into a plurality of columns X1, X2, X3, ..., Xn in the horizontal direction, and are divided into a plurality of rows Y1, Y2, Y3, ..., Yn in the vertical direction.

[0075] The digital micromirror device 2 of this embodiment can perform depth of field detection in a point illumination manner.

[0076] Exemplarily, the reflective array element 21 in the X1 column and the Y1 row (the reflective array element 21 in the upper left corner) is controlled to be adjusted to the working state, and the other reflective array elements 21 are adjusted to the initial state. Among the laser light generated by the laser generator 1, only the emission light irradiated on the reflective array element 21 in the X1 column and the Y1 row is reflected toward the target area 100, so that the depth of field detection of a single point in the target area 100 can be realized.

[0077] It should be noted that the single-point depth of field detection mode can be applied to any reflective array element 21 in the digital micromirror device 2 .

[0078] Exemplarily, the reflective array elements 21 in the X1 column and the Y1 row and the reflective array elements 21 in the Xn column and the Yn row are controlled to be adjusted to the working state, and the other reflective array elements 21 are adjusted to the initial state. Among the lasers generated by the laser generator 1, only the emitted light irradiated on the reflective array elements 21 in the X1 column and the Y1 row and the reflective array elements 21 in the Xn column and the Yn row is reflected toward the target area 100, so that the depth of field detection of two points in the target area 100 can be realized.

[0079] It should be noted that the dual-point depth of field detection mode can be applied to any two reflective array elements 21 in the digital micromirror device 2 .

[0080] Furthermore, any three, four, etc. reflective array elements 21 in the digital micromirror device 2 can be controlled to be adjusted to a working state, and the remaining reflective array elements 21 can be adjusted to an initial state.

[0081] The digital micromirror device 2 of this embodiment can also perform depth detection in a line beam scanning manner.

[0082] Exemplarily, the reflective array elements 21 in column X1 are controlled to be adjusted to the working state, and the other columns X2, X3, ... Xn are adjusted to the initial state. Among the laser light generated by the laser generator 1, only the reflective array elements 21 in column X1 are reflected toward the target area 100, so that a straight line beam spot can be formed in the target area 100, and the depth of field information of the area illuminated by the line beam spot can be detected.

[0083] Further, the reflective array elements 21 of the X1 column can be controlled to be adjusted to the initial state, the reflective array elements 21 of the X2 column can be controlled to be adjusted to the working state, and the remaining X3 ... Xn columns are maintained in the initial state. After the depth of field information detection of the target area 100 corresponding to the reflective array elements 21 of the X2 column is completed, the reflective array elements 21 of the X3 column are adjusted to the working state in sequence, and so on. The straight line beam spot in the target area 100 is swept across the entire target area 100 in the horizontal direction, thereby realizing the horizontal scanning of the target area 100.

[0084] In another exemplary manner, the vertical reflective array elements 21 of Y1, Y2, Y3, ... Yn rows are controlled to be adjusted to the working state in sequence, and the straight line beam spot in the target area 100 vertically scans the entire target area 100, thereby realizing the horizontal scanning of the target area 100.

[0085] In another exemplary embodiment, the reflective array elements 21 in the vertical Y1, Y2, Y3 ... Yn rows and the reflective array elements 21 in the horizontal X1, X2, X3 ... Xn columns are controlled to be adjusted to the working state in sequence, and two straight-line beam spots, one horizontal and one vertical, are simultaneously formed in the target area 100, and the entire target area 100 is scanned horizontally and vertically respectively, thereby realizing cross scanning of the target area 100. Such cross scanning is conducive to improving the detection accuracy of depth of field information.

[0086] Combination Figure 1 As shown, in some embodiments, the depth of field detection system further includes a light absorbing device 6, and the light absorbing device 6 is used to absorb the emitted light reflected by the reflective array element 21 in the initial state.

[0087] In order to prevent light pollution inside the system, an active absorption strategy is adopted for the emitted light that does not participate in the depth of field detection, that is, a light absorbing device 6 is arranged on the reflected light path when the reflective array element 21 is in the initial state, and this part of the emitted light can be absorbed by the light absorbing device 6 to avoid light pollution. In addition, actively absorbing the emitted light that does not participate in the work is also conducive to protecting the system structure and preventing structural damage caused by long-term exposure.

[0088] In some embodiments, the light absorbing device 6 includes one or more of the following: light absorbing foam, light absorbing coating, carbon nanotube black body. Among them, foam is a material made of foamed plastic particles, referred to as foam. Foam has a series of characteristics such as elasticity, light weight, rapid pressure-sensitive fixation, easy to use, flexible bending, ultra-thin volume, and reliable performance. For example, polyvinyl chloride PVC foam. The light absorbing coating can absorb all visible light and infrared light, such as a nano-particle chemical composite coating film. Carbon nanotube black body, that is, carbon nanotube black body (Vantablack), is composed of vertically arranged carbon nanotubes. At room temperature, the body does not emit visible light, and absorbs up to 99.965% of electromagnetic radiation in the visible light band. Because when light enters the carbon nanotube black body, it will hardly be reflected, but will be confined to the tube wall and continuously deflected until it is finally converted into heat energy.

[0089] Combination Figure 1 As shown, in some embodiments, the depth of field detection system also includes a beam expander 7, which is located between the laser generator 1 and the digital micromirror device 2. The beam expander 7 is used to perform non-parallel beam expansion on the emitted light so that the emitted light can cover the reflective surface of the digital micromirror device 2.

[0090] The emitted light is expanded in a non-parallel manner using a beam expander 7, and the irradiation range of the emitted light gradually increases with the increase of the irradiation distance. After being reflected by the digital micromirror device 2, a larger target area 100 can be fully covered, which is conducive to reducing the size of the digital micromirror device 2, further reducing the size of the depth of field detection system, and is conducive to improving the integration of the depth of field detection system in electronic equipment.

[0091] On the other hand, the beam expander 7 is located on the incident side of the digital micromirror device 2, and the emitted light irradiated on the digital micromirror device 2 is formed after beam expansion, and the spot diameter of the emitted light reflected by the digital micromirror device 2 depends on the size of the reflective array element 21 in the digital micromirror device 2. Compared with the diffuser being located on the exit side of the digital micromirror device 2, the emitted light spot diameter formed by this solution is smaller, the resolution of the depth of field detection is higher, and it is more conducive to accurate depth of field detection of the target area 100.

[0092] Combination Figure 1 As shown, in some embodiments, an aperture element 8 is further provided between the beam expander 7 and the digital micromirror device 2, and the aperture element 8 is used to restrict the range of the emitted light. The aperture element 8 is used to perform boundary screening on the emitted light irradiated on the digital micromirror device 2, which is beneficial to improving the working efficiency of the digital micromirror device 2 and avoiding interference from boundary light.

[0093] Combination Figure 1As shown, in some embodiments, electrical components in the depth of field detection system, such as the laser generator 1, the photodetector 3, the phase detector 4 and the digital micromirror device 2, are electrically connected to the controller 5 respectively, and the controller 5 supplies power to the above components.

[0094] Furthermore, the power supply connection between the laser generator 1 and the photodetector 3 and the controller 5 is set for synchronous use, that is, the controller 5 supplies power to the photodetector 3 while supplying power to the laser generator 1. This is conducive to reducing the ineffective standby time of the two devices, saving power, and can also control the two devices to work synchronously, thereby improving the synchronization of the first phase information and the second phase information input into the phase detector 4.

[0095] On the other hand, combined Figure 3 As shown, this embodiment provides a depth of field detection method, which is applied to the depth of field detection system of this application (refer to Figure 1 ), the depth detection methods include:

[0096] In step S1 , the controller 5 determines a target area 100 and at least one target direction in the target area 100 .

[0097] In step S2 , the controller 5 determines a target working state of at least one reflective array element 21 in the digital micromirror device 2 according to a mapping relationship between at least one target direction and the digital micromirror device 2 , and sends a first control instruction to the digital micromirror device 2 .

[0098] In step S3 , the digital micromirror device 2 controls at least one reflective array element 21 to adjust to a target working state in response to the first control instruction.

[0099] In step S4 , the controller 5 sends a second control instruction to the laser generator 1 to generate emission light. The laser generator 1 generates emission light in response to the second control instruction and inputs the first phase information of the emission light into the phase detector 4 .

[0100] In step S5 , the controller 5 sends a third control instruction to the photodetector 3 to receive the reflected light. The photodetector 3 receives the reflected light in response to the third control instruction and inputs the second phase information of the reflected light into the phase detector 4 .

[0101] Step S6: the phase detector 4 determines the phase difference between the emitted light and the reflected light according to the first phase information and the second phase information.

[0102] In step S7, the controller 5 receives the phase difference fed back by the phase detector 4, and determines the depth of field information in at least one direction according to the phase difference.

[0103] The depth of field detection method of this embodiment is based on the depth of field detection system of the present application, and has all the beneficial technical effects of all the embodiments in this document.

[0104] The depth of field detection method of this embodiment can utilize the working characteristics of the digital micromirror device 2 to realize depth of field detection in different directions within the target area 100, and can realize single-point, multi-point, single-beam scanning, cross-beam scanning and other depth of field detection methods, which can improve the efficiency of depth of field information detection of the target area 100, realize panoramic depth detection, and is beneficial to improving the depth of field effect of the image.

[0105] In some embodiments, the second control instruction and the third control instruction are issued simultaneously by the controller 5. This helps to ensure that the laser generator 1 and the photodetector 3 are powered and enabled at the same time, start synchronously, save energy and improve the synchronization of the first phase information and the second phase information.

[0106] On the other hand, combined Figure 4 As shown, this embodiment provides an image processing method, and the image processing method includes:

[0107] Step 1: The image processing unit obtains a two-dimensional image of the target area 100.

[0108] Optionally, the image processing unit is connected to an RGB camera, and the target area 100 is photographed by the RGB camera to obtain a two-dimensional image of the target area 100. The two-dimensional image is an image acquisition activity of the entire target area 100 by the RGB camera under the same parameters such as focal length and exposure, and does not include depth of field information, or the depth of field parameters of all points in the target area 100 are the same.

[0109] Step 2: The image processing unit obtains the depth information of the target area 100 output by the depth detection system of the present application. Optionally, the depth detection system applies the depth detection method of the present application to obtain the depth information of multiple target directions in the target area 100, and the number of target directions may be less than or equal to the number of reflective array elements 21 in the digital micromirror device 2, that is, each reflective array element 21 completes the depth detection of one target direction.

[0110] In step three, the image processing unit divides the target area 100 into depth of field domains according to the depth of field information, and determines a depth parameter of each depth of field domain.

[0111] Optionally, the depth of field domain is divided according to the value of the depth of field information, wherein areas with the same depth of field value are divided into the same depth of field domain.

[0112] In step 4, the image processing unit overlaps the depth of field domain with the two-dimensional image, and performs depth processing on the overlapped area of ​​the two-dimensional image according to the depth parameter of the depth of field domain.

[0113] Optionally, the depth processing includes adjusting image parameters such as sharpness value, blur value, contrast, brightness, blur processing, etc. of the image according to different depth parameters.

[0114] In some possible implementations, the two-dimensional image and the depth parameter are fused based on virtual reality technology (VR) to restore and generate a 3D image with a fixed viewing angle.

[0115] The image processing method of this embodiment adopts the depth of field information obtained by the depth of field detection system of the present application, and can perform multi-point or panoramic depth detection on the target area 100. With the help of the depth of field information, the image can be more accurately processed in depth, making the depth effect of the image more accurate and the image quality better.

[0116] On the other hand, an electronic device is provided, which includes the depth of field detection system of any one of the present applications, or adopts the depth of field detection method of the present application, or the image processing method of the present application.

[0117] The electronic device of this embodiment adopts the depth of field detection system, depth of field detection method or image processing method of the present application, and has all the beneficial technical effects of all the embodiments of this document.

[0118] Specifically, the electronic device can be any of various types of computer system devices that are mobile or portable and perform image acquisition. Specifically, the electronic device can be a mobile phone or smart phone equipped with a camera (e.g., a phone based on iPhone TM, a phone based on Android TM), a portable game device (e.g., Nintendo DS TM, PlayStation Portable TM, Gameboy Advance TM, iPhone TM), a laptop computer, a PDA, a portable Internet device, and a data storage device. The electronic device can also be other wearable devices that require image acquisition (e.g., a head mounted device (HMD) such as an electronic bracelet, an electronic necklace, an electronic device, or a smart watch).

[0119] The electronic device can also be any one of a plurality of electronic devices, including but not limited to cellular phones, smart phones, other wireless communication devices, personal digital assistants, audio players, other media players, music recorders, video recorders, other media recorders, radios, medical devices, vehicle transportation instruments, calculators, programmable remote controls, pagers, laptop computers, desktop computers, printers, netbook computers, personal digital assistants (PDAs), portable multimedia players (PMPs), Moving Picture Experts Group (MPEG-1 or MPEGG-2) Audio Layer 3 (MP3) players, portable medical devices, and digital cameras and combinations thereof.

[0120] In some cases, the electronic device can perform multiple functions (e.g., play music, display video, store pictures, and receive and send phone calls). If desired, the electronic device can be a device such as a cellular phone, a media player, other handheld device, a wristwatch device, a pendant device, or other compact portable device.

[0121] It should be noted that the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0122] In the present application, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may include that the first and second features are in direct contact, or may include that the first and second features are not in direct contact but are in contact through another feature between them. Moreover, a first feature being "above", "above" and "above" a second feature includes that the first feature is directly above and obliquely above the second feature, or simply indicates that the first feature is higher in level than the second feature. A first feature being "below", "below" and "below" a second feature includes that the first feature is directly below and obliquely below the second feature, or simply indicates that the first feature is lower in level than the second feature.

[0123] In the description of this specification, the reference terms "certain embodiments", "one embodiment", "some embodiments", "illustrative embodiments", "example", "specific example", or "some examples" mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application.

[0124] The above description is only an embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present application shall be included in the protection scope of the present application.

Claims

1. A depth of field detection system, characterized in that: The depth of field detection system comprises: a laser generator (1), a digital micromirror device (2), a photoelectric detector (3), a phase detector (4) and a controller (5); The laser generator (1) is used to generate emission light; The digital micromirror device (2) is located on the light output path of the laser generator (1), the digital micromirror device (2) is electrically connected to the controller (5), and the digital micromirror device (2) is used to reflect the emitted light in different directions under the control of the controller (5); The photoelectric detector (3) is used to receive the reflected light; The phase detector (4) is electrically connected to the laser generator (1) and the photodetector (3) respectively, and the phase detector (4) receives the first phase information of the emitted light fed back by the laser generator (1) and the second phase information of the reflected light fed back by the photodetector (3), and determines the phase difference between the emitted light and the reflected light according to the first phase information and the second phase information; The phase detector (4) is electrically connected to the controller (5); the controller (5) receives the phase difference fed back by the phase detector (4) and determines the depth of field information according to the phase difference.

2. The depth detection system according to claim 1, characterized in that: The digital micromirror device (2) comprises a plurality of reflective array elements (21), the plurality of reflective array elements (21) are arranged in an array, and each of the reflective array elements (21) comprises an initial state and at least one working state; In the initial state, the reflective array element (21) does not reflect the emitted light into the target area (100); In the at least one working state, the reflection array element (21) reflects the reflected light towards one of the target directions of the target area (100).

3. The depth detection system according to claim 2, characterized in that: The depth of field detection system further comprises a light absorbing device (6), wherein the light absorbing device (6) is used to absorb the emitted light reflected by the reflective array element (21) in the initial state.

4. The depth detection system according to claim 3, characterized in that: The light absorbing device (6) comprises one or more of the following: light absorbing foam, light absorbing coating, and carbon nanotube black body.

5. The depth detection system according to any one of claims 1 to 4, characterized in that: The depth of field detection system further comprises a beam expander (7), wherein the beam expander (7) is located between the laser generator (1) and the digital micromirror device (2), and the beam expander (7) is used to perform non-parallel beam expansion on the emitted light so that the emitted light can cover the reflective surface of the digital micromirror device (2).

6. The depth detection system according to claim 5, characterized in that: An aperture element (8) is also provided between the beam expander (7) and the digital micromirror device (2), and the aperture element (8) is used to constrain the boundary range of the emitted light.

7. A depth of field detection method, characterized in that: The depth of field detection system applied to any one of claims 1 to 6, wherein the depth of field detection method comprises: The controller (5) determines a target area and at least one target direction within the target area; The controller (5) determines the target working state of at least one reflective array element in the digital micromirror device (2) according to the mapping relationship between the at least one target direction and the digital micromirror device (2), and issues a first control instruction to the digital micromirror device (2); The digital micromirror device (2) controls the at least one reflective array element to adjust to the target working state in response to the first control instruction; The controller (5) sends a second control instruction to the laser generator (1) to generate the emission light, and the laser generator (1) generates the emission light in response to the second control instruction, and inputs the first phase information of the emission light into the phase detector (4); The controller (5) sends a third control instruction to the photodetector (3) to receive the reflected light, and the photodetector (3) receives the reflected light in response to the third control instruction, and inputs the second phase information of the reflected light into the phase detector (4); The phase detector (4) determines the phase difference between the emitted light and the reflected light according to the first phase information and the second phase information; The controller (5) receives the phase difference fed back by the phase detector (4), and determines the depth of field information in at least one target direction according to the phase difference.

8. The depth of field detection method according to claim 7, characterized in that: The second control instruction and the third control instruction are issued simultaneously by the controller (5).

9. An image processing method, characterized in that: The image processing method comprises: The image processing unit acquires a two-dimensional image of the target area; The image processing unit obtains the depth information of the target area output by the depth detection system according to any one of claims 1 to 6; The image processing unit divides the target area into depth domains according to the depth information, and determines a depth parameter of each depth domain; The image processing unit overlaps the depth of field domain with the two-dimensional image, and performs depth processing on the overlapped area of ​​the two-dimensional image according to the depth parameter of the depth of field domain.

10. An electronic device, characterized in that: The electronic device comprises the depth of field detection system according to any one of claims 1 to 6, or adopts the depth of field detection method according to claim 7 or 8, or the image processing method according to claim 9.

Images