Display device, depth image assembly and depth image adjustment method

Abstract

A display device, a depth imaging component, and a depth image adjustment method are disclosed. The display device includes a depth imaging component and a display panel. The depth imaging component includes a range sensor group and a processor. The range sensor group is used to transmit range-measuring light within a scanning distance and receive the range-measuring light according to the scanning distance and exposure time. The processor obtains a depth image based on the received range-measuring light and performs an exposure adjustment procedure using the depth image. Based on the execution result of the exposure adjustment procedure, the processor selectively generates a first adjustment signal or a second adjustment signal. The range sensor group reduces the exposure time according to the first adjustment signal or increases the exposure time according to the second adjustment signal.

Description

[Technical Field]

[0001] A display device, a depth image component, and a depth image adjustment method, particularly a display device, a depth image component, and a depth image adjustment method capable of capturing a depth image with stable brightness and further filtering the depth image to obtain a filtered image with clear features. [Previous Technology]

[0002] Currently, some electronic devices possess functions such as biometric detection, eye tracking, or gesture control. These devices can scan objects using infrared light and calculate distances to each pixel on the target using time-of-flight (ToF) ranging. The electronic device can then perform corresponding application calculations based on this distance data. For example, it can create a 3D image of the target from the distance data or use it as a security password. However, the infrared light received by the electronic device from the target may be affected by ambient light sources, thus impacting the accuracy of the distance data. [Summary of the Invention]

[0003] In view of this, in some embodiments, the display device includes a depth imaging component and a display panel. The depth imaging component includes a range sensor group and a processor. The range sensor group is used to transmit range-measuring light within a scanning distance and to receive the range-measuring light according to the scanning distance and exposure time. The processor obtains a depth image based on the received range-measuring light and uses it to perform an exposure adjustment procedure. The exposure adjustment procedure includes: obtaining a depth data group based on the depth image, the depth data group having a plurality of pixel regions; obtaining an average brightness and an average brightness change based on the brightness of one of the pixel regions. In response to the average brightness change being greater than a change threshold, selectively generating a first adjustment signal or a second adjustment signal. The display panel is used to allow the range-measuring light to pass through. The range sensor group reduces the exposure time according to the first adjustment signal or increases the exposure time according to the second adjustment signal.

[0004] In some embodiments, a depth imaging component is provided, comprising a range sensor group and a processor. The range sensor group is used to transmit range-measuring light within a scanning distance and to receive the range-measuring light according to the scanning distance and exposure time. The processor obtains a depth image based on the received range-measuring light and uses it to perform an exposure adjustment procedure. The exposure adjustment procedure includes: obtaining a depth data group based on the depth image, the depth data group having multiple pixel regions; obtaining an average brightness and an average brightness change based on the brightness of one of the pixel regions. In response to the average brightness change being greater than a change threshold, selectively generating a first adjustment signal or a second adjustment signal. A display panel is used for the range-measuring light to pass through. The range sensor group reduces the exposure time according to the first adjustment signal or increases the exposure time according to the second adjustment signal.

[0005] In some embodiments, a depth image adjustment method is provided, suitable for adjusting a depth image by a processor. The depth image adjustment method includes: the processor receiving ranging light to obtain a depth image; the processor performing an exposure adjustment procedure based on the depth image; and a ranging sensor group reducing the exposure time according to a first adjustment signal, or increasing the exposure time according to a second adjustment signal. The exposure adjustment procedure includes: obtaining a depth data group based on the depth image, the depth data group having multiple pixel regions; obtaining an average brightness and an average brightness change amount based on the brightness of one of the pixel regions; and selectively generating a first adjustment signal or a second adjustment signal in response to the average brightness change amount being greater than a change threshold.

[0006] In summary, some embodiments of the display device use a depth imaging component and a display panel to measure the distance to a target to obtain a depth image. The depth imaging component includes a range sensor group and a processor. The range sensor group can emit range-measuring light towards the target, and the processor can obtain an unprocessed depth image based on the range-measuring light. The processor can perform a depth image adjustment method to adjust the depth image to a clear state. In response to the execution of the depth image adjustment method, the processor can execute an exposure adjustment procedure to determine whether the brightness of the range-measuring light received by the depth imaging component is stable. If the brightness is determined to be unstable, the processor can adjust the exposure time of the depth imaging component based on the result. After one or more adjustments to the exposure time, the average brightness change of the depth images of previous and subsequent frames can be controlled within a change threshold, so that the brightness of the depth images of consecutive frames becomes stable. The processor can also execute a filtering procedure and then filter the depth image to remove interference noise carried by the depth image. Accordingly, the display device can be applied to devices that require depth data detection, such as biometrics, object detection, or gesture control, to reduce the influence of ambient light or scanning distance on the detection results.

[0007] Various embodiments are described in detail below; however, these embodiments are merely illustrative and do not limit the scope of protection intended for this invention. Furthermore, some elements are omitted in the drawings of the embodiments to clearly show the technical features of the invention. The same reference numerals will be used to denote the same or similar elements in all drawings.

Implementation Method

[0009] As shown in Figures 1, 2, and 3. In some embodiments, the display device 100 includes a depth imaging component 102 and a display panel 104. The depth imaging component 102 includes a range sensor group 106 and a processor 108. The range sensor group 106 is used to transmit a range-measuring ray L1 within a scanning distance D1. The display panel 104 is used to allow the range-measuring ray L1 to pass through. The range sensor group 106 receives the range-measuring ray L1 according to the scanning distance D1 and an exposure time. The processor 108 obtains a depth image I1 based on the received range-measuring ray L1 and uses it to perform an exposure adjustment procedure ST1 (described later in Figure 7) based on the depth image I1. The range sensor group 106 reduces the exposure time according to a first adjustment signal or increases the exposure time according to a second adjustment signal (described later). The display panel 104 can generate an interference effect on visible light by controlling the alignment state of the liquid crystal, so that the display panel 104 displays an image. The visible light can be light from outside the display panel 104. Display panel 104 may be, for example, but not limited to, a cholesteric liquid crystal display (ChLCD) panel.

[0010] In some embodiments, the display panel 104 includes a first surface 110 and a second surface 112. The second surface 112 is located between the range sensor group 106 and the first surface 110. The aforementioned "display panel 104 is used for the transmission of the range measuring light L1" can mean that the range measuring light L1 emitted by the range sensor group 106 passes through the display panel 104 and is emitted toward a target T1 (shown in FIG. 3). The range measuring light L1 is reflected by the target T1 and passes through the display panel 104, so that the light receiver 116 receives the range measuring light L1.

[0011] In some embodiments, the ranging sensor group 106 includes a light emitter 114 and a light receiver 116. The light emitter 114 is used to emit a ranging ray L1. The light receiver 116 is used to receive the ranging ray L1 reflected from the target T1. The ranging ray L1 may be, for example, near-infrared (NIR) light with a wavelength range of 800 micrometers (nm) to 1100 nm or short-wave infrared (SWIR) light with a wavelength range of 1100 nm to 1600 nm. In some embodiments, the ranging ray L1 may be, for example, in the wavelength range of 800 nm to 1100 nm, such as 940 nm.

[0012] The aforementioned "range sensor group 106 receives the range measuring light L1 according to the scanning distance D1 and the exposure time" can refer to the light emitter 114 continuously or indirectly emitting the range measuring light L1 within the scanning distance D1. The light receiver 116 receives the range measuring light L1 at a preset frame rate and a set exposure time. The preset frame rate can be, for example, 10 to 20 frames per second (FPS). It should be noted that the preset frame rate can be set according to the required resolution of the depth image I1. For example, if the required specifications of the depth image I1 are higher, the preset frame rate can be increased accordingly (e.g., the preset frame rate is less than 10 FPS). Conversely, if the required specifications of the depth image I1 are lower, the preset frame rate can be decreased accordingly (e.g., the preset frame rate is greater than 20 FPS). The exposure time can be the factory preset exposure time of the range sensor group 106, or it can be the exposure time adjusted by the range sensor group 106 according to the first adjustment signal or the second adjustment signal. The ranging sensor group 106 may be, for example, but not limited to, an indirect time-of-flight (ITOF) sensing chip or a structured light sensing chip. The ITOF sensing chip can emit modulated continuous waves at a preset frame rate. Then, the ITOF sensing chip can capture the reflected waves at the preset frame rate, and the processor 108 can obtain depth data based on the reflected waves (described later). The structured light sensing chip can generate structured light and further set the emission period of the structured light to capture the reflected waves of the structured light at a preset frame rate.

[0013] The processor 108 may be, for example, but not limited to, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, or a digital signal processor (DSP). Referring to Figures 4 and 7, the exposure adjustment procedure ST1 executed by the processor 108 includes: obtaining a depth data set based on a depth image I1, the depth data set having multiple pixel regions I11 (step ST11); obtaining an average brightness and an average brightness change based on a brightness of one of the multiple pixel regions I11 (step ST12); and selectively generating a first adjustment signal or a second adjustment signal in response to the average brightness change being greater than a change threshold (step ST13). The following is a description of the exposure adjustment procedure ST1.

[0014] In some embodiments, the light receiver 116 receives the ranging light L1 that sequentially passes through the first surface 110 and the second surface 112 according to the exposure time. The processor 108 obtains a depth image I1 based on the ranging light L1 reflected from the target T1. The processor 108 can measure the depth data of multiple pixels (the depth data may include parameters such as the distance and brightness of each pixel on the target T1 to the light receiver 116) and define the depth data of adjacent pixels as one of the pixel regions I11. Here, the processor 108 can record the depth data of all pixel regions I11 to establish a depth data group (step ST11). The processor 108 can perform time-of-flight ranging calculation to obtain the depth data of each pixel based on the time difference of flight of the ranging light L1. Alternatively, the depth data can be estimated by the light distortion of the reflected light.

[0015] The processor 108 may capture the brightness of all pixel regions I11 to calculate the average brightness. Alternatively, it may capture a pixel region I12 corresponding to the center position of the depth image I1 (as shown in Figure 4) and calculate the average brightness of this pixel region I12. The following will use the average brightness of pixel region I12 as an example. The processor 108 compares the average brightness of this pixel region I12 in the previous and next frames according to a preset frame rate to calculate the change in average brightness (step ST12). In some embodiments, pixel region I12 may refer to the region corresponding to the center position of the depth image I1, that is, the region of the optical axis of the light receiver 116 corresponding to the target T1. In some embodiments, pixel region I12 may also be any region within the contour of the target T1.

[0016] In some embodiments, the processor 108 compares the average brightness change with a change threshold and selectively generates a first adjustment signal or a second adjustment signal based on the comparison result. In this way, the processor 108 can control the light receiver 116 to adjust the exposure time based on the comparison result, so as to stabilize the average brightness of the preceding and following frames by adjusting the exposure time.

[0017] Accordingly, the processor 108 compares the average brightness change with a change threshold to determine whether the current exposure time causes instability in the received ranging light L1. If it is determined that the receiving of the ranging light L1 is unstable, the processor 108 generates a corresponding first adjustment signal or a second adjustment signal to control the light receiver 116 to increase or decrease the exposure time. In this way, after one or more adjustments, the exposure time of the light receiver 116 can stably receive the ranging light L1 with an appropriate exposure time.

[0018] In some embodiments, the processor 108 may iteratively perform steps ST12 and ST13. Multiple adjustments to the exposure time (described later in step ST14 or ST15) are made so that the exposure time of the light receiver 116 can be adjusted accordingly to changes in distance from the target T1.

[0019] In some embodiments, the variation threshold can be 3% to 10%. Taking a variation threshold of 5% as an example, if the average brightness change is greater than 5%, it indicates that the light receiver 116 is interfered with by the ambient light source, which may cause the brightness of the pixel area I12 to be unstable in the previous and next frames. Conversely, if the average brightness change is less than or equal to 5%, it indicates that the brightness of the pixel area I12 in the previous and next frames has reached stability. It should be noted that the variation threshold can be adjusted according to the usage environment of the display device 100. For example, if the display device 100 is used in a high-brightness environment, the variation threshold can be increased to 8%; or, if the display device 100 is used in a low-brightness environment, the variation threshold can be reduced to 3%; thereby improving the stability and accuracy of exposure judgment (e.g., step ST13).

[0020] As shown in Figure 7, in some embodiments, step ST13 further includes: in response to the brightness of one of the pixel regions I11 (e.g., pixel region I12) being greater than the average brightness, the processor 108 generates a first adjustment signal (step ST14); or in response to the brightness of one of the pixel regions I11 being less than the average brightness, the processor 108 generates a second adjustment signal (step ST15). Specifically, when the change in average brightness is greater than a change threshold, it indicates that the average brightness of the previous and next frames is unstable, causing the brightness of each pixel region I11 to be less than or greater than the average brightness. Here, the processor 108 can generate the first adjustment signal or the second adjustment signal based on the difference between the brightness of pixel region I12 and the average brightness. For example, if the brightness of pixel region I12 is greater than the average brightness, it indicates that the depth image I1 is overexposed at this moment. The processor 108 generates the first adjustment signal to drive the light receiver 116 to reduce the exposure time. As another example, if the brightness of pixel region I12 is less than the average brightness, it indicates that the depth image I1 is underexposed at this moment. The processor 108 generates a second adjustment signal to drive the light receiver 116 to increase the exposure time.

[0021] Please refer to Figures 2, 5A, 6, and 8 together. In some embodiments, in response to the average brightness change being less than a change threshold, the processor 108 further performs a filtering procedure ST2 on the depth image I1 to generate a filtered image I2. The processor 108 determines that the exposure time of the depth image I1 is stable and can further perform the filtering procedure ST2 on the depth image I1 to obtain a clearer filtered image I2. The filtering procedure ST2 includes: identifying and filtering out invalid depth data I13 based on the average brightness (step ST21); and filtering out random noise I14 based on the center target of the depth image I1 (step ST22).

[0022] In step ST21, the processor 108 can identify whether other pixel regions I11 are invalid depth data I13 based on the average brightness of pixel region I12. For example, if the brightness of any pixel is less than the average brightness of pixel region I12, it indicates that the reflected brightness of this pixel is insufficient. The reasons for insufficient reflected brightness may include, for example, that the pixel is a black surface affecting the reflection of the ranging light L1; that the target T1 exceeds a preset scanning distance D1, resulting in insufficient reflected brightness of the ranging light L1; or that the area of ​​the pixel corresponding to the target T1 is a transparent part, affecting the reflection effect of the ranging light L1. Therefore, the processor 108 can mark the depth data corresponding to pixels with brightness less than the average brightness as invalid depth data I13. In some embodiments, if the brightness of any pixel is greater than the average brightness of pixel region I12, it indicates that the reflected brightness of this pixel is affected by ambient light, thermal noise, or electronic signals, causing the reflected brightness of this pixel to be greater than the average brightness. Therefore, the processor 108 can mark the depth data corresponding to pixels with brightness greater than the average brightness as invalid depth data I13. In some embodiments, the processor 108 may perform low-pass filtering (either through a physical low-pass filter circuit or a low-pass filter procedure) to filter out pixels marked as invalid depth data I13.

[0023] In step ST22, random noise I14 is filtered out based on the central target T11 of the depth image I1. For example, it can be filtered out first using the average brightness from the previous step. The processor 108 can obtain a central target T11 at the center of the depth image I1 (as shown in Figure 5A). The processor 108 can execute an edge detection algorithm (e.g., Prewitt Operator, Canny-edge detection, active contour model, or holistically nested edge detection) to identify the central target T11 of the target T1. Based on the central target T11, the processor 108 can determine pixels located outside the central target T11 as random noise I14 and filter out the random noise I14. Thus, after performing steps ST11 and ST12 on the depth image I1, the processor 108 can obtain a filtered image I2 (see Figure 6). This filtered image I2 has removed invalid depth data I13 and random noise I14, making the results of further depth processing on the filtered image I2 more accurate. In some embodiments, the center of target T1 can also refer to the face area. Here, the processor 108 can identify the face in the depth image I1 using the aforementioned edge detection algorithm or face recognition algorithm (the face recognition algorithm can be, for example, but not limited to, the Facenet model, the DeepFace model, or the ArcFace model), using the face area as the central target T11.

[0024] For example, as shown in Figures 5B and 5C, when the depth image component 102 scans multiple targets (hereinafter distinguished as near target T2, far target T3, and target T1 located between them), target T1 located at the center of the depth image I1 will be designated as the central target T11, and the average brightness will be calculated based on the depth data of the central target T11. Since the brightness of near target T2 is greater than the average brightness and the brightness of far target T3 is less than the average brightness, the brightness (i.e., depth data) of near target T2 and far target T3 will be filtered out. For example, near target T2 may be overexposed, resulting in a brightness greater than the average brightness within its range; this will cause the outline details of near target T2 to be invisible and thus need to be filtered out. Alternatively, far target T3 may be insufficient due to insufficient ambient light, resulting in insufficient brightness within its range or a brightness variation exceeding a change threshold across consecutive frames, thus requiring it to be filtered out.

[0025] In some embodiments, the filtering procedure ST2 further includes: performing a smooth filtering based on the central target T11 and the average brightness (step ST23). Specifically, the processor 108 may perform smooth filtering on each pixel within the central target T11 to suppress brightness changes of any pixel between previous and subsequent frames, thereby reducing noise of this pixel in consecutive frames. The smooth filtering performed by the processor 108 may be, for example, but not limited to, a Kalman filter, a mean filter, or an infinite impulse response filter. Here, the processor 108 may use a low-pass filter to filter the average brightness of the central target T11. The low-pass filter is used to smooth the depth data, reduce the depth data from sensor noise and changes (which may refer to noise or abnormal changes caused by structural or electronic interference of the aforementioned range sensor group 106), and filter out unstable depth data. For example, when the depth imaging component 102 detects a static object, the depth data captured by the range sensor group 106 ideally does not change. However, due to the aforementioned sensor noise, the depth data in consecutive frames may experience slight increases or decreases. Therefore, the processor 108 performs a smoothing filter on the depth data to make the depth data captured by the depth imaging component 102 more stable when detecting static objects.

[0026] In some embodiments, in response to the average brightness change of the filtered image I2 being greater than a change threshold, the processor 108 re-executes the exposure adjustment procedure ST1. Specifically, when the processor 108 completes the filtering procedure ST2 and generates the filtered image I2, the processor 108 can further compare whether the average brightness change of each pixel region I11 in the filtered image I2 is greater than the change threshold to determine whether the brightness of the filtered image I2 is sufficient to make each pixel sufficiently clear at the currently set exposure time. For example, if the average brightness change is greater than the change threshold, it means that the current exposure time can stably obtain the depth data of each pixel, but the filtered image I2 as a whole has high brightness. Therefore, the processor 108 can re-execute the exposure adjustment procedure ST1 when the average brightness change is greater than the change threshold.

[0027] In some embodiments, the exposure time is adjusted proportionally to the scanning distance D1. The light receiver 116 receives the ranging light L1 within the set scanning distance D1. If the light receiver 116 increases the scanning distance D1, the processor 108 can correspondingly increase the exposure time. In some embodiments, the processor 108 can adjust the exposure time step by step according to a preset increment, or it can establish a lookup table based on multiple test results, showing the appropriate exposure time for different scanning distances D1. The processor 108 can then look up the corresponding exposure time in the lookup table based on the current scanning distance D1 for adjustment. For example, if the scanning distance D1 is 20cm to 40cm, the exposure time can be adjusted between 50µs and 250µs.

[0028] As shown in Figures 2 and 3, in some embodiments, the processor 108 can control the modulation frequency of the ranging beam L1 emitted by the light emitter 114 according to the scanning distance D1. The modulation frequency can be set to 60MHz or 100MHz. For example, if the scanning distance D1 is less than 40cm, the processor 108 can control the light emitter 114 to set the modulation frequency to 100MHz. As another example, if the scanning distance D1 is between 40cm and 100cm, the processor 108 can control the light emitter 114 to set the modulation frequency to 60MHz.

[0029] As shown in FIG1, in some embodiments, the display device 100 further includes a light filter film 118. The light filter film 118 is located between the display panel 104 and the ranging sensor group 106. The ranging light L1 is filtered by the light filter film 118 so that it can pass through the display panel 104 (or be scattered or diffracted) to the ranging sensor group 106. The light filter film 118 can allow near-infrared light to pass through (i.e., the wavelength range of the light that passes through can be, for example, 800nm~1000nm), the light filter film 118 can absorb short-wave infrared light (for example, light with a wavelength greater than 1000nm can be absorbed by the light filter film 118), and the light filter film 118 can reflect light with a wavelength less than 800nm ​​(such as red light, green light, and blue light). Thus, when the light emitter 114 emits the ranging light L1, the ranging light L1 can sequentially pass through the light filter film 118 and the display panel 104. When the ranging ray L1 is reflected by the target T1, it can sequentially pass through the display panel 104 and the filter film 118 to be received by the light receiver 116. Since the first surface 110 is not covered by the filter film 118, the display panel 104 can display an image. In some embodiments, the filter film 118 can reflect or absorb non-near-infrared or short-wave infrared light, allowing only the ranging ray L1 to enter the light receiver 116. Here, the display device 100 can pre-filter most of the light outside the allowed wavelengths through the filter film 118, performing preliminary noise suppression. This reduces the computational burden and processing time of the processor 108 in subsequent exposure adjustment procedure ST1 and filtering procedure ST2, and can improve the clarity of the filtered image I2. In some embodiments, the filter film 118 can be a black film, plastic, or coating to absorb other light outside the allowed wavelength range (such as light with a wavelength greater than 1000 nm and reflect light with a wavelength less than 800 nm).

[0030] As shown in FIG2, in some embodiments, reducing the spacing between the filter film 118 and the display panel 104 can reduce the diffusion of the ranging light L1. Here, the filter film 118 can be directly attached to all or part of the display panel 104. For example, the filter film 118 can be attached to the entire area of ​​the second surface 112. The filter film 118 is attached to a partial area of ​​the second surface 112, corresponding to the area where the display panel 104 overlaps with the light receiver 116. In some embodiments, with the ranging sensor assembly 106 abutting against the second surface 112, the filter film 118 can also be directly attached to a lens 117 of the light receiver 116.

[0031] As shown in FIG9. In some embodiments, the depth image adjustment method ST3 is adapted to control the range sensor group 106 to adjust the exposure time via the processor 108. The depth image adjustment method ST3 includes: the processor 108 receiving the range ray L1 to obtain a depth image I1 (step ST31); the processor 108 performing an exposure adjustment procedure ST1 based on the depth image I1 (step ST32); and the range sensor group 106 reducing the exposure time according to a first adjustment signal, or increasing the exposure time according to a second adjustment signal (step ST33). It should be noted that steps ST31 to ST33 can be referred to the description in FIG7 above. In some embodiments, the depth image adjustment method ST3 further includes: in response to the average brightness change being less than a change threshold, the processor 108 performing a filtering procedure ST2 on the depth image I1 to generate a filtered image I2 (step ST34). It should be noted that the filtering procedure ST2 in step ST34 can be referred to the description in FIG8 above.

[0032] In summary, the display device 100 of some embodiments measures the distance to a target T1 using a depth imaging component 102 and a display panel 104 to obtain a depth image I1. The depth imaging component 102 includes a range sensor group 106 and a processor 108. The range sensor group 106 can emit a range-measuring ray L1 toward the target T1. The processor 108 can obtain an unprocessed depth image I1 based on the range-measuring ray L1. The processor 108 can perform a depth image adjustment method ST3 to adjust the depth image I1 to a clear state. In response to the execution of the depth image adjustment method ST3, the processor 108 can execute an exposure adjustment procedure ST1 to determine whether the brightness of the range-measuring ray L1 received by the depth imaging component 102 is stable. If the brightness is determined to be unstable, the processor 108 can determine the result and adjust the exposure time of the depth imaging component 102. After one or more adjustments to the exposure time, the average brightness change of the depth images I1 of previous and subsequent frames can be controlled within a change threshold, so that the brightness of the depth images I1 of consecutive frames becomes stable. The processor 108 can also execute the filtering program ST2, and then filter the depth image I1 to remove interference noise carried by the depth image I1.

[0033] The above-described embodiments are only for illustrating the technical ideas and features of this case. Their purpose is to enable those skilled in the art to understand the content of this case and implement it accordingly. They should not be used to limit the scope of the patent in this case. That is, all equivalent changes or modifications made in accordance with the spirit disclosed in this case should still be covered within the scope of the patent application in this case. [Simplified Explanation of the Diagram]

[0008] Figure 1 is a partial schematic diagram of the display device in some embodiments of the present invention, showing the corresponding positions of the depth image component and the display panel. Figure 2 is a block diagram of the depth image component in some embodiments of the present invention. Figure 3 is a usage state diagram of the display device in some embodiments of the present invention, showing the depth image component scanning targets. Figure 4 is an application schematic diagram of the display device in some embodiments of the present invention, showing the depth image captured by the depth image component. Figure 5A is an application schematic diagram of the display device in some embodiments of the present invention, showing the depth image before filtering processing. Figure 5B is a usage state diagram of the display device in some embodiments of the present invention, showing the depth image component scanning multiple targets. Figure 5C is an application schematic diagram of the display device in some embodiments of the present invention, showing the depth image containing near targets, far targets, and medium targets. Figure 6 is an application schematic diagram of the display device in some embodiments of the present invention, showing the filtered image generated after the depth image has been processed by the filtering process. Figure 7 is a flowchart of the exposure adjustment procedure in some embodiments of the present invention. Figure 8 is a flowchart of the filtering procedure in some embodiments of the present invention. Figure 9 is a flowchart of the depth image adjustment method in some embodiments of the present invention.

Claims

1. A display device comprising: a depth imaging component, comprising: a range sensor array for transmitting a range-measuring light ray within a scanning distance and receiving the range-measuring light ray according to the scanning distance and an exposure time; and a processor for obtaining a depth image based on the received range-measuring light ray and for performing an exposure adjustment procedure based on the depth image, the exposure adjustment procedure comprising: obtaining a depth data set based on the depth image, the depth data set having a plurality of pixel regions; obtaining an average brightness and an average brightness variation based on a brightness of one of the pixel regions; selectively generating a first adjustment signal or a second adjustment signal in response to the average brightness variation being greater than a variation threshold; and further configuring the processor to perform a filtering procedure on the depth image to generate a filtered image in response to the average brightness variation being less than the variation threshold; and a display panel for allowing the range-measuring light ray to pass through; wherein... The range sensor group reduces the exposure time based on the first adjustment signal or increases the exposure time based on the second adjustment signal; wherein the filtering procedure further includes: identifying and filtering out invalid depth data based on the average brightness; and filtering out random noise based on a central target of the depth image.

2. The display device as claimed in claim 1, wherein, The step of selectively generating the first adjustment signal or the second adjustment signal in response to the average brightness change being greater than the change threshold further includes: generating the first adjustment signal in response to the brightness of one of the pixel regions being greater than the average brightness, or generating the second adjustment signal in response to the brightness of one of the pixel regions being less than the average brightness.

3. The display device as claimed in claim 1, wherein, The threshold for this change is 3% to 10%.

4. The display device as claimed in claim 1, wherein, The filtering procedure also includes: performing a smoothing filter based on the central target and the average brightness.

5. The display device as claimed in claim 1, wherein, If the average brightness change of the filtered image exceeds the change threshold, the processor re-executes the exposure adjustment procedure.

6. The display device as claimed in claim 1, wherein, The exposure time is adjusted proportionally to the scanning distance.

7. The display device as claimed in claim 1, further comprising a light-filtering film located between the display panel and the ranging sensor assembly, wherein, The ranging light is filtered by the filter film so that it can pass through the display panel to the ranging sensor group.

8. A depth imaging component comprising: a range sensor array for transmitting a range-measuring ray within a scanning distance and receiving the range-measuring ray at the scanning distance according to an exposure time; and a processor for obtaining a depth image based on the received range-measuring ray and performing an exposure adjustment procedure, the exposure adjustment procedure comprising: obtaining a depth data set based on the depth image, the depth data set having a plurality of pixel regions; obtaining an average brightness and an average brightness variation based on a brightness of one of the pixel regions; selectively generating a first adjustment signal or a second adjustment signal in response to the average brightness variation being greater than a variation threshold; and further configuring the processor to perform a filtering procedure on the depth image to generate a filtered image in response to the average brightness variation being less than the variation threshold; wherein... The range sensor group reduces the exposure time based on the first adjustment signal, or increases the exposure time based on the second adjustment signal; wherein the filtering procedure further includes: identifying and filtering out invalid depth data based on the average brightness; and filtering out random noise based on a central target of the depth image.

9. A depth image adjustment method, suitable for adjusting a depth image by a processor, the depth image adjustment method comprising: the processor receiving a ranging ray to obtain a depth image; the processor performing an exposure adjustment procedure based on the depth image, the exposure adjustment procedure comprising: obtaining a depth data set based on the depth image, the depth data set having a plurality of pixel regions; obtaining an average brightness and an average brightness variation based on a brightness of one of the pixel regions; selectively generating a first adjustment signal or a second adjustment signal in response to the average brightness variation being greater than a variation threshold; and performing a filtering procedure on the depth image to generate a filtered image in response to the average brightness variation being less than the variation threshold; and a ranging sensor set decreasing an exposure time based on the first adjustment signal, or increasing the exposure time based on the second adjustment signal; wherein... The filtering procedure includes: identifying and filtering out invalid depth data based on the average brightness; and filtering out random noise based on a central target in the depth image.

10. The depth image adjustment method as described in claim 9, wherein, The step of selectively generating the first adjustment signal or the second adjustment signal in response to the average brightness change being greater than the change threshold further includes: generating the first adjustment signal in response to the brightness of one of the pixel regions being greater than the average brightness, or generating the second adjustment signal in response to the brightness of each of the pixel regions being less than the average brightness.

11. The depth image adjustment method as described in claim 9, wherein, The filtering procedure also includes: performing a smoothing filter based on the central target and the average brightness.

Images