A control method of a self-illuminating imaging device, an electronic device, and a system

Abstract

The application relates to a control method of a self-illumination imaging device, an electronic device and a system, and belongs to the technical field of illumination detection, wherein the method comprises the following steps: controlling a micro light-emitting diode to emit light, and acquiring a photoelectric signal of a current time window detected by a charge coupled device; integrating the photoelectric signal to obtain an actual integral quantity, and judging whether the current satisfies a set brightness adjustment condition based on the actual integral quantity; if the current satisfies the set brightness adjustment condition, the light-emitting brightness of the micro light-emitting diode is controlled to be reduced to a set light-emitting brightness value, and the parameters of the charge coupled device are adjusted, so that the gray value of image data generated by the charge coupled device falls within a set gray range. The application reduces the light-emitting brightness of the micro light-emitting diode when the micro light-emitting diode works for a long time at high brightness, reduces the heat effect, prolongs the service life, adjusts the exposure parameters of the charge coupled device at the same time, and guarantees stable imaging quality.

Description

Technical Field

[0001] This application relates to the field of lighting detection technology, and in particular to a control method, electronic device and system for a self-illuminating imaging device. Background Technology

[0002] Micro-LEDs, as a next-generation display technology, are suitable for all display applications, from the smallest to the largest, due to their miniaturized structure and high flexibility. Charge-coupled devices (CCDs), as imaging sensors, have high sensitivity and are suitable for scenarios requiring high-precision imaging.

[0003] By combining miniature light-emitting diodes (LEDs) with charge-coupled devices (CCDs), a self-illuminating imaging device can be formed. This approach offers two advantages: firstly, it provides complementary technologies, with the LEDs offering high brightness, low power consumption, and long lifespan, while the CCDs utilize their high sensitivity to capture clear images under LED illumination, enabling the detection and adjustment of the LEDs' luminous performance; secondly, it achieves integration and improved energy efficiency. Through packaging technology, the LED illumination array and CCD sensor are integrated onto a single chip, forming a compact design that significantly reduces energy loss and overall system power consumption, addressing the issues of large size and weak anti-interference capabilities inherent in traditional separate imaging systems.

[0004] However, the miniaturization brought about by integrated packaging has also exacerbated the heat dissipation problem: micro LEDs themselves generate heat when operating at high brightness, and the compact packaging structure makes it difficult for the heat to dissipate quickly. The accumulation of heat will not only shorten the lifespan of the micro LED and the packaging structure, but may also cause the brightness to drift, affecting the imaging stability. Summary of the Invention

[0005] In view of this, it is necessary to provide a control method, electronic device and system for a self-illuminating imaging device to solve the technical problem that the miniaturization characteristics brought about by integrated packaging in the prior art lead to an aggravation of heat dissipation problems and affect the service life of the device.

[0006] To address the aforementioned problems, in a first aspect, this application provides a control method for a self-illuminating imaging device, the self-illuminating imaging device comprising stacked micro light-emitting diodes and charge-coupled devices, the method comprising: The system controls the micro LED to emit light and acquires the photoelectric signal of the current time window detected by the charge coupler. The photoelectric signal is integrated to obtain the actual integrated value, and the set brightness adjustment conditions are determined based on the actual integrated value. If the set brightness adjustment conditions are met, the brightness of the micro LED is reduced to the set brightness value, and the parameters of the charge coupler are adjusted so that the grayscale value of the image data generated by the charge coupler falls within the set grayscale range.

[0007] In one possible implementation, controlling the luminous intensity of the micro LED to decrease to a set luminous intensity value includes: Calculate the deviation between the actual integral and the set brightness integral threshold; Based on the aforementioned deviation and the set brightness adjustment coefficient, the brightness adjustment ratio is calculated; The brightness of the micro LED is controlled to decrease to a set brightness value by adjusting the brightness ratio.

[0008] In one possible implementation, calculating the brightness adjustment ratio based on the deviation and a set brightness adjustment coefficient includes: Calculate the ratio of the deviation to the set brightness integral threshold to obtain a first intermediate value; Calculate the product of the first intermediate value and the set brightness adjustment coefficient to obtain the second intermediate value; The brightness adjustment ratio is calculated based on the second intermediate value; wherein the brightness adjustment ratio decreases as the second intermediate value increases.

[0009] In one possible implementation, the parameters of the charge-coupled device (CCD) include exposure time. Adjusting the parameters of the CCCD so that the grayscale values ​​of the image data generated by the CCCD fall within a set grayscale range includes: Based on the actual integral quantity and the target integral quantity corresponding to the set image brightness value, the light compensation ratio is calculated. The exposure time of the charge coupler is controlled to increase by the light compensation ratio so that the grayscale value of the image data generated by the charge coupler falls within a set grayscale range.

[0010] In one possible implementation, the parameters of the charge-coupled device (CCD) include gain. Adjusting the parameters of the CCCD so that the grayscale values ​​of the image data generated by the CCCD fall within a set grayscale range includes: Based on the luminance of the micro LED at the current moment and the calculated luminance of the LED at the next moment, calculate the luminance compensation ratio; The gain of the charge coupler is increased proportionally to the brightness compensation ratio so that the grayscale value of the image data generated by the charge coupler falls within a set grayscale range.

[0011] In one possible implementation, the photoelectric signal is integrated to obtain an actual integrated value, and based on the actual integrated value, it is determined whether the set brightness adjustment condition is met, including: Smooth the actual integral of the previous time window to obtain the smoothed integral of the previous time window; The actual integral of the current time window and the smoothed integral of the previous time window are weighted and summed to obtain the smoothed integral of the current time window. It is then determined whether the smoothed integral of the current time window is higher than the set brightness integral threshold. If the smoothing integral of the current time window is higher than the set brightness integral threshold, then it is determined that the set brightness adjustment condition is currently met.

[0012] In one possible implementation, the method further includes: The micro LED is controlled to be fully excited, and the fully excited emission matrix detected in real time by the charge coupler is obtained. The fully excited emission matrix is ​​divided by the average value of the fully excited emission matrix to obtain the preprocessed matrix. Obtain the target emission matrix, divide the target emission matrix by the preprocessed matrix to obtain the driving emission matrix, and control the emission brightness of the micro LED based on the driving emission matrix.

[0013] In one possible implementation, before dividing the target emission matrix by the preprocessing matrix, the method further includes: Obtain the actual emission matrix detected in real time by the charge coupler, calculate the absolute value of the difference between each brightness value in the target emission matrix and the corresponding brightness value in the actual emission matrix, and obtain the absolute difference matrix; Determine whether there are a predetermined number of absolute differences in the absolute difference matrix that exceed a set threshold; If a preset number of absolute differences in the absolute difference matrix exceed a set threshold, the normalized actual emission matrix is ​​divided by the normalized target emission matrix to obtain an update matrix. The update matrix is ​​then multiplied by the preprocessing matrix to update the preprocessing matrix.

[0014] Secondly, this application also provides an electronic device, including a memory and a processor; The memory is used to store programs; The processor, coupled to the memory, is used to execute the program stored in the memory to implement the steps of the control method for the self-illuminating imaging device described above.

[0015] Thirdly, this application also provides a self-illuminating imaging system, including the aforementioned electronic device and a self-illuminating imaging apparatus coupled to the electronic device.

[0016] The beneficial effects of this application are as follows: The control method for the self-illuminating imaging device provided in this application first controls the micro-LED to emit light; then, it acquires the photoelectric signal of the current time window detected by the charge-coupled device (CCD); then, it integrates the photoelectric signal to obtain the actual integrated value, and determines whether the set brightness adjustment conditions are met based on the actual integrated value; if the set brightness adjustment conditions are met, it controls the brightness of the micro-LED to decrease to the set brightness value, and adjusts the parameters of the CCD so that the grayscale value of the image data generated by the CCD falls within the set grayscale range. In this application, the CCD is used as both an image signal acquisition unit and a light intensity detection unit. By introducing a light integration feedback mechanism, the brightness of the micro-LED is reduced when it operates at high brightness for a long time, thereby reducing thermal effects, extending lifespan, and significantly reducing power consumption. At the same time, the exposure parameters of the CCD are adjusted to ensure stable imaging quality. Attached Figure Description

[0017] Figure 1 A schematic diagram of an embodiment of the self-illuminating imaging device provided in this application; Figure 2 A schematic flowchart of an embodiment of the control method for the self-illuminating imaging device provided in this application; Figure 3 For this application Figure 1 A schematic flowchart of an embodiment of step S202; Figure 4 A schematic flowchart of an embodiment of the method for adjusting the luminous intensity of a micro light-emitting diode provided in this application; Figure 5 For this application Figure 4 A schematic diagram of an embodiment of step S402; Figure 6 A schematic flowchart of an embodiment of the exposure time adjustment method for the charge coupler provided in this application; Figure 7 A schematic flowchart of an embodiment of the gain adjustment method for the charge coupler provided in this application; Figure 8 A schematic flowchart of an embodiment of the preprocessing method provided in this application; Figure 9 A schematic flowchart of an embodiment of the preprocessing matrix update method provided in this application; Figure 10 A display effect diagram of the self-illuminating imaging device provided in this application before preprocessing; Figure 11 A pre-processed display effect diagram of the self-illuminating imaging device provided in this application; Figure 12 A schematic diagram of an embodiment of the electronic device provided in this application; Reference numerals: 11-charge coupler; 12-microlens array; 13-micro light-emitting diode; 14-thermal conductive dielectric layer; 15-thermal conductive metal layer; 16-curing adhesive. Detailed Implementation

[0018] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0019] This application provides a control method, electronic device, and system for a self-illuminating imaging device, which are described below.

[0020] To facilitate understanding of the technical solution of this application, the self-illuminating imaging device of this application will be described first.

[0021] Figure 1 This is a schematic diagram of an embodiment of the self-illuminating imaging device provided in this application, as shown below. Figure 1 As shown, the self-illuminating imaging device includes a charge coupler 11, a microlens array 12, and a micro light-emitting diode 13. It adopts a stacked packaging structure, which tightly integrates the charge coupler 11, the microlens array 12, and the micro light-emitting diode 13 into a single package structure. The structure is divided into the following parts from top to bottom.

[0022] like Figure 1As shown, a miniature light-emitting diode (LED) 13 is located below. The LED 13 uses GaN-based material, and its switching and brightness are controlled by external drive wiring. A charge-coupled device (CCD) 11 is positioned above the LED 13. The CCD 11 receives the light signal from the LED 13 and converts it into image data for output. The acquired image data is used to detect the luminous performance of the LED 13 and adjust it via drive. The CCD 11 uses a CCD array receiver, which features high sensitivity, low noise, and fast response speed. Since the typical emission angle of a single light-emitting unit of the LED 13 is ±60°, crosstalk is relatively severe. To reduce crosstalk, a microlens array 12 is positioned in the optical path between the charge-coupled device (CCD) 11 and the micro-LED 13. This array collimates the diverging light from the micro-LED 13 and directs it vertically into the CCD 11, improving incident efficiency and reducing optical crosstalk. This process requires ensuring that the lens units of the microlens array 12 and the light-emitting units of the micro-LED 13 are optically aligned one-to-one. Each light-emitting unit in the micro-LED 13 corresponds to at least one pixel in the CCD 11, with a 1:n correspondence, meaning each light-emitting unit has an independent pixel corresponding to it. Furthermore, during the bonding process between the CCD 11 and the microlens array 12, a dust-free bonding process must be ensured to avoid light loss and unexpected aberrations.

[0023] Furthermore, considering that the high brightness of miniature light-emitting diodes may lead to heat generation, especially exacerbated in compact package structures, this application addresses the heat generation issue through optimized packaging materials and heat dissipation design in some embodiments. Specifically, such as... Figure 1 As shown, the encapsulation structure also integrates a thermally conductive dielectric layer 14 and a thermally conductive metal layer 15. The thermally conductive dielectric layer 14 is disposed on the side of the micro-LED 13 away from the microlens array 12, and is specifically thermally conductive silicone. The thermally conductive silicone fills the gap between the micro-LED 13 and the thermally conductive metal layer 15, conducts heat, and also serves as electrical insulation, protecting the micro-LED 13 and extending its lifespan. Furthermore, to achieve better thermal conductivity, the thermally conductive silicone has a thermal conductivity of 8 W / m·K and a thickness between 0.5 mm and 1.5 mm.

[0024] like Figure 1As shown, the thermally conductive dielectric layer 14 is in contact with the thermally conductive metal layer 15 below it. The thermally conductive metal layer 15 is disposed on the side of the thermally conductive dielectric layer 14 away from the micro LED 13. This layer structure provides a heat dissipation channel for the entire package structure, preventing the micro LED 13 from overheating. High-purity copper is used, which can be further connected to a heat sink or thermoelectric cooler. The heat generated by the micro LED 13 during operation is conducted through the thermally conductive dielectric layer 14 to the thermally conductive metal layer 15, and is finally discharged by the heat sink, maintaining a stable overall operating temperature.

[0025] Except for the micro light-emitting diode 13 and the thermally conductive metal layer 15, which are fixed by the thermally conductive medium layer 14, the rest need to be encapsulated by UV-curable adhesive 16. At the same time, the control method of the entire self-illuminating imaging device needs to be encapsulated for protection. The sealing protective layer formed by the encapsulation adhesive layer and the components can play the role of moisture protection, dust protection, and mechanical damage protection.

[0026] To address the overheating issue, in addition to structural improvements, this application also incorporates improvements to the control algorithm. Figure 2 A schematic flowchart of an embodiment of the control method for the self-illuminating imaging device provided in this application is shown below. Figure 2 As shown, the control method for the self-illuminating imaging device includes: S201. Control the micro LED to emit light and acquire the photoelectric signal of the current time window detected by the charge coupler.

[0027] The charge-coupled device (CCD) outputs image data after detecting photoelectric signals and adjusting exposure parameters and gain. The photoelectric signals reflect the luminous brightness of the micro LEDs, and the grayscale values ​​of the image data reflect the image brightness.

[0028] Specifically, let Time of charge coupler The photoelectric signal of each pixel is Its value is directly proportional to the intensity of the incident light: ; In the formula, express Time of charge coupler Instantaneous output charge of a pixel (unit: Coulomb). The photoelectric conversion coefficient (unit: C / A·s) represents the sensitivity of the charge-coupled device in converting light intensity into charge. express Time of charge coupler Incident light intensity at each pixel (unit: W / m²) 2 ).

[0029] S202. Integrate the photoelectric signal to obtain the actual integrated quantity, and determine whether the set brightness adjustment conditions are met based on the actual integrated quantity.

[0030] In the time window Inside, for photoelectric signals Integrating, we can obtain the first... Light integration amount per pixel : ; In the formula, Indicates the charge coupler's first Pixels in the time window The integral within the range (unit: Coulomb·s) represents the cumulative luminous flux. This indicates the length of the integration time window (typically 50-200 ms). For a moment.

[0031] The average integral of the entire graph (i.e., the actual integral). for: ; In the formula, N represents the total number of pixels in the charge-coupled device. The number of rows in pixels. The number of columns for pixels.

[0032] To avoid flickering caused by frequent adjustments in the control system, time smoothing is introduced in some embodiments of this application for anti-vibration processing. Specifically, such as... Figure 3 As shown, step S202 includes: S2021. Smooth the actual integral of the previous time window to obtain the smoothed integral of the previous time window.

[0033] S2022. The weighted sum of the actual integral of the current time window and the smoothed integral of the previous time window is obtained to obtain the smoothed integral of the current time window.

[0034] The formula for calculating the smoothed integral of the current time window is: ; In the formula, This represents the actual integral amount within the current time window. This represents the smoothed integral of the previous time window. This represents the smoothed integral value for the current time window. Represents the smoothing coefficient. It ranges from 0.1 to 0.3.

[0035] S2023. Determine whether the smoothing integral of the current time window is higher than the set brightness integral threshold. If the smoothing integral of the current time window is higher than the set brightness integral threshold, then determine that the current brightness adjustment condition is met.

[0036] Setting a luminance integration threshold indicates the maximum allowable luminance integration amount.

[0037] S203. If the current brightness adjustment conditions are met, control the brightness of the micro LED to decrease to the set brightness value, and adjust the parameters of the charge coupler so that the gray value of the image data generated by the charge coupler falls within the set gray value range.

[0038] If the set brightness adjustment conditions are met, the system is determined to be in a prolonged high-brightness operating state. At this time, the system automatically reduces the drive current or duty cycle of the micro LED, thereby reducing its brightness and heat generation. Simultaneously, by adjusting the exposure time and gain parameters of the charge-coupled device (CCD), the grayscale value of the CCD image is maintained at an equivalent level to the original state. The parameters are recalculated and updated in the next cycle, forming a closed-loop control and establishing a complete light integral-brightness (to some extent reflecting heat generation)-exposure feedback model, achieving coordinated self-adjustment of the illumination and imaging modules. This scheme can automatically maintain stable image brightness and reduce the thermal load and energy consumption of the LEDs even under the heat generated by prolonged illumination operation.

[0039] To better control the brightness of the micro LEDs, avoid abrupt changes, and improve comfort, in some embodiments of this application, such as... Figure 4 As shown, in step S203, controlling the luminous brightness of the micro LED to decrease to a set luminous brightness value includes: S401. Calculate the deviation between the actual integral quantity and the set brightness integral threshold.

[0040] S402. Calculate the brightness adjustment ratio based on the deviation and the set brightness adjustment coefficient.

[0041] To better calculate the brightness adjustment ratio, in some embodiments of this application, such as... Figure 5 As shown, step S402 specifically includes: S4021. Calculate the ratio of the deviation to the set brightness integral threshold to obtain the first intermediate value.

[0042] S4022. Calculate the product of the first intermediate value and the set brightness adjustment coefficient to obtain the second intermediate value.

[0043] S4023. Calculate the brightness adjustment ratio based on the second intermediate value; wherein the brightness adjustment ratio decreases as the second intermediate value increases.

[0044] S403. Control the brightness of the micro LED to decrease to the set brightness value by adjusting the brightness ratio.

[0045] Specifically, the formula for adjusting the luminous intensity of a micro LED is: ; In the formula, This represents the luminous intensity of the micro LED at the current moment (0-1 normalized value). This indicates the brightness of the micro LED at the next moment. This represents the brightness adjustment factor (typically 0.05–0.1), used to control the rate at which the brightness decreases. This represents the actual integral amount within the current time window. This indicates that the brightness integral threshold is set. This indicates the deviation between the actual integral and the set brightness integral threshold. Indicates the first intermediate value. Indicates the second intermediate value. This indicates the brightness adjustment ratio.

[0046] Furthermore, a limiting constraint can be introduced in the calculation of the luminous intensity of the current micro LED, as shown in the following formula: ; in, This indicates the upper limit of brightness variation.

[0047] By overcoming the limitations of the above formula, rapid changes in the brightness of the micro LED can be prevented.

[0048] To better control the parameters of the charge coupler, avoid jumps, and improve comfort, in some embodiments of this application, such as... Figure 6 As shown, the parameters of the charge-coupled device (CCD) include the exposure time. Step S203 involves adjusting the CCD parameters so that the grayscale values ​​of the image data generated by the CCD fall within a set grayscale range, including: S601. Calculate the light compensation ratio based on the actual integral quantity and the target integral quantity corresponding to the set image brightness value.

[0049] S602. Control the exposure time of the charge coupler to increase by the light compensation ratio so that the gray value of the image data generated by the charge coupler falls within the set gray value range.

[0050] Specifically, the formula for adjusting the exposure time is: ; In the formula, This indicates the exposure time of the charge-coupled device at the current moment (unit: ms). This indicates the exposure time of the charge-coupled device at the next moment. This represents the actual integral amount within the current time window. This represents the target integral value (the integral value corresponding to the image brightness). This indicates the light compensation ratio.

[0051] Furthermore, a limiting constraint can be introduced to prevent rapid jumps in the image data generated by the charge-coupled device; the specific formula is as follows: ; in, This indicates the upper limit of the exposure time.

[0052] In some embodiments of this application, such as Figure 7 As shown, the parameters of the charge-coupled device (CCD) include gain. In step S203, adjusting the CCD parameters so that the grayscale values ​​of the image data generated by the CCD fall within a set grayscale range includes: S701. Calculate the brightness compensation ratio based on the current brightness of the micro LED and the brightness of the LED at the next moment.

[0053] The brightness of the LED at the next moment is calculated according to the above formula for adjusting the brightness of the micro LED.

[0054] S702. Control the gain of the charge coupler to increase proportionally to the brightness compensation ratio so that the grayscale value of the image data generated by the charge coupler falls within the set grayscale range.

[0055] The gain adjustment formula is: ; In the formula, This represents the gain of the microlens array at the current moment. This indicates the gain of the microlens array at the next moment. This indicates the brightness of the micro LED at the current moment. This indicates the brightness of the micro LED at the next moment. This indicates the brightness compensation ratio.

[0056] When the brightness of the miniature LED decreases, the charge-coupled device (CCD) automatically extends the exposure time or increases the gain to maintain constant imaging brightness. Through this control, the timing and intensity of illumination can be precisely synchronized and coordinated with the exposure time and photosensitive range of the imaging sensor, which is something that traditional discrete systems cannot easily achieve.

[0057] Compared with the prior art, the charge coupler of this application is used as both an image signal acquisition unit and a light intensity detection unit. By introducing a light integration feedback mechanism, a dynamic balance is achieved between the luminous brightness of the micro LED and the exposure parameters (exposure time and gain) of the charge coupler. When the micro LED operates at high brightness for a long time, the luminous brightness of the micro LED is reduced, thereby reducing the thermal effect, extending the life and significantly reducing power consumption. At the same time, the exposure parameters of the charge coupler are adjusted to ensure stable imaging quality.

[0058] Considering factors such as aging, the corresponding brightness curve of each light-emitting unit in a micro LED will change to some extent with time and usage. In short, it will subtly change with use. Therefore, to achieve a relatively ideal display effect with each use and avoid uneven brightness in the image caused by different aging levels of the light-emitting units in the micro LED, some embodiments of this application require pre-calibration of the display effect before each emission. Specifically, such as... Figure 8 As shown, the control method for the self-illuminating imaging device provided in this application further includes: S801: Control the micro LED to be fully excited, obtain the fully excited emission matrix detected in real time by the charge coupler, divide the fully excited emission matrix by the average value of the fully excited emission matrix to obtain the preprocessed matrix.

[0059] S802. Obtain the target emission matrix, divide the target emission matrix by the preprocessed matrix to obtain the driving emission matrix, and control the emission brightness of the micro LED based on the driving emission matrix.

[0060] Considering that some light-emitting units may suddenly brighten or dim during the light-emitting process, to address this issue and reduce processing time while ensuring real-time adjustment, some embodiments of this application employ a keyframe approach. A preset threshold is set, and the entire light-emitting area is only captured when the absolute difference in brightness (i.e., the absolute value of the difference between the actual luminous brightness and the target luminous brightness) of more than a preset percentage (e.g., 30%) of the light-emitting units exceeds the threshold. This ensures real-time adjustment for the vast majority of light-emitting units while reducing processing time. Figure 9 As shown, before dividing the target emission matrix from the preprocessing matrix in step S802, the method further includes: S901. Obtain the actual emission matrix detected in real time by the charge coupler, calculate the absolute value of the difference between each brightness value in the target emission matrix and the corresponding brightness value in the actual emission matrix, and obtain the absolute difference matrix.

[0061] The absolute difference matrix includes multiple absolute differences (i.e., the absolute values ​​of the differences).

[0062] S902. Determine whether there are a preset number of absolute differences in the absolute difference matrix that exceed a set threshold.

[0063] S903. If there are a preset number of absolute differences in the absolute difference matrix that exceed a set threshold, then divide the normalized actual emission matrix by the normalized target emission matrix to obtain the update matrix. Multiply the update matrix by the preprocessing matrix to update the preprocessing matrix.

[0064] The threshold can be set to 0 or other values, such as 1, 2, 3, 4 or 5.

[0065] To facilitate understanding, a concrete example will be used for detailed explanation. Taking a 3×3 light-emitting area of ​​a miniature LED as an example, the luminous intensity of the miniature LED is quantified using a value from 0 to 255. During the calculation process, the value is rounded according to the required precision. Specifically, if the last digit of the retained digit is greater than or equal to 5, the retained digit is rounded up; if the last digit is less than 5, the retained digit remains unchanged. Furthermore, when calculating the driving light-emitting matrix, if the calculated number is greater than 255, it is directly taken as 255.

[0066] Before the miniature LED emits light for display, assuming the miniature LED is fully excited, its ideal emission matrix (i.e., the target emission matrix in the fully excited state) is as follows: ; The actual captured fully excited emission matrix (i.e., the actual emission matrix in the fully excited state) will differ, as shown below: ; As shown above, the average value of the fully excited light-emitting matrix is ​​241.7, which represents the average degree of aging. The brightness values ​​at positions (1,1), (1,2), (2,1), (2,2), and (3,3) in the fully excited light-emitting matrix are all greater than the average value, indicating that the aging degree of the corresponding light-emitting units is relatively lighter and requires a smaller corresponding value of the driving light-emitting matrix. The brightness values ​​at positions (1,3), (2,3), (3,1), and (3,2) are all less than the average value, indicating that the aging degree of the corresponding light-emitting units is relatively more severe and requires a larger corresponding value of the driving light-emitting matrix.

[0067] Divide the total excitation emission matrix by its average value to obtain a preprocessing matrix with the same number of elements as the emitting units. The preprocessing matrix is ​​as follows: ; In the process of miniature light-emitting diode (LED) display, assuming the target emission matrix is: ; The actual emission matrix corresponding to the target emission matrix is: ; As shown above, the absolute value of the difference between the brightness value at positions (2,1), (3,1), and (3,2) in the target emission matrix and the corresponding brightness value in the actual emission matrix exceeds the corresponding set threshold (the threshold is set to 0 here). It is determined that the current preset capture condition is met. Smaller values ​​are needed for the corresponding values ​​of the driving emission matrix at positions (2,1), (3,1), and (3,2), and the preprocessing matrix needs to be updated.

[0068] The target emission matrix is ​​normalized to obtain the normalized target emission matrix, as shown below: ; The actual emission matrix is ​​normalized to obtain the normalized actual emission matrix, as shown below: ; Dividing the normalized actual emission matrix by the normalized target emission matrix yields the update matrix: ; Multiply the update matrix by the preprocessing matrix to obtain the updated preprocessing matrix: ; Divide the target emission matrix by the updated preprocessed matrix to obtain the driving emission matrix, as shown below: ; In one specific embodiment, please refer to Figure 10 and Figure 11 , Figure 10 and Figure 11 The images show the display effects before and after the self-illuminating imaging device performs the aforementioned preprocessing, with the latter showing a significantly better display effect than the former.

[0069] To better implement the control method of the self-illuminating imaging device according to the embodiments of this application, based on a control method of a self-illuminating imaging device, such as Figure 12 As shown, this application also provides an electronic device 1200. The electronic device 1200 includes a processor 1201 and a memory 1202. Figure 12 Only some components of the electronic device 1200 are shown, but it should be understood that it is not required to implement all the components shown, and more or fewer components may be implemented instead.

[0070] In some embodiments, memory 1202 may be an internal storage unit of electronic device 1200, such as a hard disk or memory of electronic device 1200. In other embodiments, memory 1202 may also be an external storage device of electronic device 1200, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc. equipped on electronic device 1200.

[0071] Furthermore, the memory 1202 may include both internal storage units of the electronic device 1200 and external storage devices. The memory 1202 is used to store application software and various types of data installed on the electronic device 1200.

[0072] In some embodiments, processor 1201 may be a central processing unit (CPU), microprocessor or other data processing chip, used to run program code stored in memory 1202 or process data, such as the control method of the self-illuminating imaging device in this application.

[0073] In some embodiments of this application, when the processor 1201 executes the control program for the self-illuminating imaging device in the memory 1202, the following steps can be implemented: (1) Control the micro LED to emit light and acquire the photoelectric signal of the current time window detected by the charge coupler.

[0074] (2) Integrate the photoelectric signal to obtain the actual integral quantity, and determine whether the set brightness adjustment conditions are met based on the actual integral quantity.

[0075] (3) If the current brightness adjustment conditions are met, the brightness of the micro LED is reduced to the set brightness value, and the parameters of the charge coupler are adjusted so that the gray value of the image data generated by the charge coupler falls within the set gray value range.

[0076] It should be understood that when the processor 1201 executes the control program of the self-illuminating imaging device in the memory 1202, in addition to the functions mentioned above, it can also perform other functions, as can be found in the description of the corresponding method embodiments above.

[0077] Furthermore, this application does not specifically limit the type of electronic device 1200 mentioned in the embodiments. Electronic device 1200 can be a mobile phone, tablet computer, personal digital assistant (PDA), wearable device, laptop computer, or other portable electronic device. Exemplary embodiments of portable electronic devices include, but are not limited to, portable electronic devices running iOS, Android, Microsoft, or other operating systems. The aforementioned portable electronic device can also be other portable electronic devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of this application, electronic device 1200 may not be a portable electronic device, but rather a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0078] Accordingly, this application also provides a self-illuminating imaging system, including an electronic device and a self-illuminating imaging device coupled to the electronic device. The specific structure and implementation principle of the electronic device can be found in the corresponding content of the above-mentioned electronic device embodiment, and the specific structure and implementation principle of the self-illuminating imaging device can also be found in the corresponding content of the above-mentioned self-illuminating imaging device embodiment, which will not be repeated here.

[0079] The above are merely preferred embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.

Claims

1. A control method for a self-illuminating imaging device, characterized in that, The self-illuminating imaging device includes stacked miniature light-emitting diodes and charge-coupled devices, and the method includes: The system controls the micro LED to emit light and acquires the photoelectric signal of the current time window detected by the charge coupler. Integrating the photoelectric signal to obtain the actual integrated value, and determining whether the current brightness adjustment condition is met based on the actual integrated value, includes: smoothing the actual integrated value of the previous time window to obtain the smoothed integrated value of the previous time window; performing a weighted summation of the actual integrated value of the current time window and the smoothed integrated value of the previous time window to obtain the smoothed integrated value of the current time window, and determining whether the smoothed integrated value of the current time window is higher than the set brightness integration threshold. If the smoothing integral of the current time window is higher than the set brightness integral threshold, then it is determined that the set brightness adjustment condition is currently met. The actual integral is the average integral of the entire graph. for: ； In the formula, N represents the total number of pixels in the charge-coupled device. The number of rows in pixels. The number of columns for pixels. Indicates the charge coupler's first Pixels in the time window The integral within the range, measured in Coulombs·s, represents the cumulative luminous flux. Indicates the length of the integration time window; If the set brightness adjustment conditions are met, the brightness of the micro LED is reduced to the set brightness value, and the parameters of the charge coupler are adjusted so that the grayscale value of the image data generated by the charge coupler falls within the set grayscale range.

2. The control method for the self-illuminating imaging device according to claim 1, characterized in that, Controlling the luminous intensity of the micro LED to decrease to a set luminous intensity value includes: Calculate the deviation between the actual integral and the set brightness integral threshold; Based on the aforementioned deviation and the set brightness adjustment coefficient, the brightness adjustment ratio is calculated; The brightness of the micro LED is controlled to decrease to a set brightness value by adjusting the brightness ratio.

3. The control method for the self-illuminating imaging device according to claim 2, characterized in that, The step of calculating the brightness adjustment ratio based on the deviation and the set brightness adjustment coefficient includes: Calculate the ratio of the deviation to the set brightness integral threshold to obtain a first intermediate value; Calculate the product of the first intermediate value and the set brightness adjustment coefficient to obtain the second intermediate value; The brightness adjustment ratio is calculated based on the second intermediate value; wherein the brightness adjustment ratio decreases as the second intermediate value increases.

4. The control method for the self-illuminating imaging device according to claim 1, characterized in that, The parameters of the charge-coupled device (CCD) include exposure time. Adjusting the parameters of the CCCD so that the grayscale values ​​of the image data generated by the CCCD fall within a set grayscale range includes: Based on the actual integral quantity and the target integral quantity corresponding to the set image brightness value, the light compensation ratio is calculated. The exposure time of the charge coupler is controlled to increase by the light compensation ratio so that the grayscale value of the image data generated by the charge coupler falls within a set grayscale range.

5. The control method for the self-illuminating imaging device according to claim 1, characterized in that, The parameters of the charge-coupled device (CCD) include gain. Adjusting the parameters of the CCCD so that the grayscale values ​​of the image data generated by the CCCD fall within a set grayscale range includes: Based on the luminance of the micro LED at the current moment and the calculated luminance of the LED at the next moment, calculate the luminance compensation ratio; The gain of the charge coupler is increased by the brightness compensation ratio so that the grayscale value of the image data generated by the charge coupler falls within a set grayscale range.

6. The control method for the self-illuminating imaging device according to claim 1, characterized in that: The method further includes: The micro LED is controlled to be fully excited, and the fully excited emission matrix detected in real time by the charge coupler is obtained. The fully excited emission matrix is ​​divided by the average value of the fully excited emission matrix to obtain the preprocessed matrix. Obtain the target emission matrix, divide the target emission matrix by the preprocessed matrix to obtain the driving emission matrix, and control the emission brightness of the micro LED based on the driving emission matrix.

7. The control method for the self-illuminating imaging device according to claim 6, characterized in that, Before dividing the target emission matrix by the preprocessed matrix, the method further includes: Obtain the actual emission matrix detected in real time by the charge coupler, calculate the absolute value of the difference between each brightness value in the target emission matrix and the corresponding brightness value in the actual emission matrix, and obtain the absolute difference matrix; Determine whether there are a predetermined number of absolute differences in the absolute difference matrix that exceed a set threshold; If a preset number of absolute differences in the absolute difference matrix exceed a set threshold, the normalized actual emission matrix is ​​divided by the normalized target emission matrix to obtain an update matrix. The update matrix is ​​then multiplied by the preprocessing matrix to update the preprocessing matrix.

8. An electronic device, characterized in that, Including memory and processor; The memory is used to store programs; The processor, coupled to the memory, is used to execute the program stored in the memory to implement the steps of the control method for the self-illuminating imaging device according to any one of claims 1 to 7.

9. A self-illuminating imaging system, characterized in that, It includes an electronic device and a self-illuminating imaging device coupled to the electronic device, wherein the electronic device is the electronic device of claim 8.

Images