Display device and display method

Abstract

The invention provides a display device and a display method, the display device comprises a display panel, a processing unit and a driving unit, and a plurality of ambient light sensors are integrated in the display panel. And the processing unit is connected with each ambient light sensor and is used for receiving the ambient light data sensed by each ambient light sensor and analyzing the ambient light data to obtain the distribution information of the ambient light. And the driving unit is connected with the processing unit and the display panel and is used for driving the display panel to adjust the light and shadow data of the display picture according to the distribution information. Therefore, by integrating a plurality of ambient light sensors, analyzing the ambient light data by the processing unit and adjusting the light and shadow data by the driving unit, real-time response to the ambient light is realized, the distribution change of the ambient light can be sensed in real time, the light and shadow data of a display picture is dynamically adjusted according to the distribution change, and the reality sense of the display picture and the scene fusion degree are improved.

Description

Technical Field

[0001] This application relates to the field of display technology, specifically to a display device and display method. Background Technology

[0002] With the increasing prevalence of ultra-high-definition large screens in smart conferencing, digital exhibition halls, and intelligent cockpits, users are demanding higher levels of realism and scene integration from displayed images. Currently, display devices face two major bottlenecks: Regarding ambient light adaptation lag, current display devices typically use a single ambient light sensor for global brightness adjustment, which cannot detect the dynamic changes of incident light from multiple angles in complex lighting environments. When there are directional differences in ambient light (such as a mixture of natural light from side windows and indoor lighting), it can cause a mismatch between the virtual image's lighting and the physical environment. For example, the reflective areas of the screen may conflict with the virtual highlight positions, severely damaging the visual immersion.

[0003] Regarding the limited range of interaction methods, current human-computer interaction still relies primarily on active operations such as touch and gesture recognition, lacking the ability to intelligently respond to changes in ambient light. Users cannot passively trigger content feedback by moving a handheld light source in the direction of the light source or by using natural light, thus limiting the multimodal interaction potential of smart spaces. Summary of the Invention

[0004] This application provides a display device and display method that can sense changes in the distribution of ambient light in real time and dynamically adjust the light and shadow data of the display screen accordingly, thereby improving the realism and scene integration of the display screen.

[0005] In a first aspect, the display device provided in the embodiments of this application includes: The display panel integrates multiple ambient light sensors; The processing unit is connected to each of the ambient light sensors and is used to receive ambient light data sensed by each of the ambient light sensors and analyze the ambient light data to obtain the distribution information of ambient light. The driving unit, connected to the processing unit and the display panel, is used to drive the display panel to adjust the light and shadow data of the displayed image according to the distribution information.

[0006] Secondly, the display method provided in the embodiments of this application is applied to a display device, and the method includes: Receive ambient light data sensed by each ambient light sensor, and analyze the ambient light data to obtain the distribution information of ambient light; Based on the distribution information, the display panel is driven to adjust the light and shadow data of the displayed image.

[0007] In summary, the display device and display method provided in this application, by integrating multiple ambient light sensors, a processing unit to analyze ambient light data, and a driving unit to adjust light and shadow data, achieve real-time response to ambient light. It can perceive changes in the distribution of ambient light in real time and dynamically adjust the light and shadow data of the display screen accordingly, thereby improving the realism and scene integration of the display screen. Attached Figure Description

[0008] The present invention will be further described below with reference to the accompanying drawings. It should be noted that the accompanying drawings described below are merely for illustrating some embodiments of the present invention. Those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0009] Figure 1 This is one of the schematic diagrams of a display device provided for an embodiment of this application.

[0010] Figure 2 A second schematic diagram of a display device is provided for an embodiment of this application.

[0011] Figure 3 This is a schematic diagram of an exemplary structure of an Incell sensor in an embodiment of this application.

[0012] Figure 4 This is an exemplary schematic diagram of light intensity distribution in an embodiment of this application.

[0013] Figure 5 This is an exemplary schematic diagram illustrating the logic and data source for light and shadow synchronization tracking in the embodiments of this application.

[0014] Figure 6 This is an exemplary schematic diagram of the illumination angle in an embodiment of this application.

[0015] Figure 7 This is a schematic diagram of an exemplary structure of the light-gathering aperture in an embodiment of this application.

[0016] Figure 8 This is an exemplary equivalent schematic diagram of a light angle detection circuit in an embodiment of this application. Detailed Implementation

[0017] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0018] The terms "first," "second," etc., used in this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or modules is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other steps or modules inherent to these processes, methods, products, or apparatuses.

[0019] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily imply that all embodiments are the same, nor are they independent or alternative embodiments mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0020] This application provides a display device, which includes, but is not limited to, the following embodiments and combinations thereof.

[0021] In some embodiments, Figure 1 One of the schematic diagrams of a display device provided for an embodiment of this application; Figure 2 A second schematic diagram of a display device is provided for embodiments of this application; in conjunction with Figure 1 and Figure 2 As shown, the display device provided in the embodiments of this application can be, but is not limited to, a Mini / Micro LED direct display screen, a splicing display screen, an OLED flexible giant screen, a laser projection ultra-high-definition large screen, or a quantum dot wide color gamut ultra-high-definition display terminal, etc. The display device may include a display panel, a source driving circuit, a gate driving circuit, a timing controller, a light-emitting controller, a power management chip, a substrate, a data line for transmitting data signals DATA, a scan line for transmitting scan signals SCAN, a power line for transmitting the voltage VDD at the positive terminal of the power line or the voltage VSS at the negative terminal of the power line, a light-emitting control signal line for transmitting light-emitting control signals EM, a pixel array, an encapsulation layer, a polarizer, a color filter, etc.

[0022] The pixel array consists of multiple pixel units arranged in rows and columns, forming multiple pixel rows along the row direction and multiple pixel columns along the column direction. Each pixel row and each pixel column includes multiple pixel units, and each pixel unit includes multiple sub-pixels. Each sub-pixel includes a light-emitting device and pixel circuitry. For ease of description, pixel rows and pixel columns may be referred to as "rows" and "columns" thereafter. The pixel driving circuit may include driving transistors, which are used to control the brightness of the corresponding organic light-emitting devices in the display panel. In actual pixel units, driving transistors may include, but are not limited to, low-temperature polycrystalline silicon (LTPS) and thin-film transistors (TFTs). The TFT may employ a dual-gate structure, with the organic light-emitting device electrically connected to the first or second electrode of the TFT. The organic light-emitting device may include a light-emitting layer, an electron transport layer, a hole transport layer, a cathode, and an anode. Different organic materials can emit light of different wavelengths to achieve full-color display. The encapsulation layer includes a multilayer structure alternating between organic and inorganic materials. The gate driver on array (GOA) circuit is mainly used for scanning and driving pixel rows. For example, the GOA circuit may include cascaded gate driver units, where each stage of the gate driver unit controls one or more pixel rows to achieve pixel unit selection. In some embodiments, the GOA can use single-sided or double-sided driving for multiple pixel rows. Single-sided driving may involve arranging gate driver units only on one side (e.g., left or right side) and scanning and driving multiple pixel rows line by line through cascading. Double-sided driving may involve arranging driver units on both the left and right sides of the multiple pixel row and scanning and driving multiple pixel rows line by line through the coordinated operation of both sides. The source driver circuit is used to provide data signals to the pixel units. The timing controller is used to receive externally input image data and synchronization signals, and generate the signals required by the gate driver circuit and the source driver circuit. The power management chip is used to provide the required operating voltage to various parts of the display panel. It should be noted that... Figure 2 This is an illustrative diagram, and the component connections shown are only used to explain the functional logic of the display panel, and are not intended to limit the actual physical structure.

[0023] In one embodiment, such as Figure 1As shown, the display device 100 specifically includes a display panel 101, a processing unit 102, and a driving unit 103. The display panel 101 integrates multiple ambient light sensors. The processing unit 102 is connected to each ambient light sensor and is used to receive ambient light data sensed by each ambient light sensor and analyze the ambient light data to obtain the distribution information of ambient light. The driving unit 103 is connected to the processing unit 102 and the display panel 101 and is used to drive the display panel to adjust the light and shadow data of the displayed image according to the distribution information.

[0024] It should be noted that an ambient light sensor can be an electronic component capable of detecting the intensity or spectral characteristics of ambient light. Its function is to convert light signals into electrical signals for processing. In this embodiment, the ambient light sensor is integrated inside the display panel to instantly sense the lighting conditions of the environment in which the display device is located.

[0025] The processing unit 102 is connected to each ambient light sensor. This connection can be wired, for example, by transmitting sensor signals to the processing unit via wires or flexible circuit boards; or it can be wireless, for example, by transmitting data via a short-range wireless communication module. The processing unit 102 can be a hardware module responsible for data calculation, analysis, and control, such as a microprocessor, digital signal processor, or application-specific integrated circuit. The processing unit 102 receives data from the ambient light sensors and executes multi-dimensional algorithms to extract effective ambient light information and generate ambient light distribution information. The ambient light data can be unprocessed numerical values ​​of ambient light intensity collected by the ambient light sensors. This ambient light data can be an analog signal or a digital signal after analog-to-digital conversion, reflecting the light intensity at the sensor's location. The ambient light distribution information can be a description of the intensity, direction, or angle of ambient light in space obtained by analyzing ambient light data collected by multiple ambient light sensors. This analysis process can include aggregating the data from each sensor, for example, calculating the average or maximum value, to obtain the overall light intensity. As another analysis method, the processing unit can perform spatial interpolation or fitting on the data from each sensor to construct a preliminary ambient light intensity map.

[0026] The driving unit 103 drives the display panel 101 to adjust the light and shadow data of the displayed image based on the ambient light distribution information provided by the processing unit 102. This distribution information can be a two-dimensional or three-dimensional light field model used to characterize the complex distribution state of ambient light. As an example, the driving unit 103 can be a hardware module responsible for controlling the emission or transmission of light by the pixels of the display panel. The driving unit 103 adjusts the brightness, contrast, color, and light and shadow effects of various areas on the display panel 101 according to the light and shadow adjustment instructions provided by the processing unit 102, thereby achieving dynamic light and shadow adjustment of the displayed image. The light and shadow data of the displayed image can be a set of parameters used to describe visual effects such as highlights, shadows, and reflections in the displayed image. By adjusting the light and shadow data, the lighting performance of virtual objects in the displayed image can be changed to match the lighting conditions of the real environment.

[0027] Multiple ambient light sensors are integrated within the display panel. These sensors can be arranged within the effective display area of ​​the panel, for example, evenly distributed across the entire display area, or arranged in a preset array. Alternatively, the sensors can be integrated into the non-display area of ​​the panel, such as the bezel area. The ambient light sensors can be photoresistors, photodiodes, or phototransistors, used to sense the intensity of ambient light.

[0028] This application achieves detailed perception of ambient light distribution information by integrating multiple ambient light sensors within the display panel. This multi-point distributed sensing capability enables the display device to overcome the limitations of conventional solutions in dynamically perceiving changes in the direction and intensity of incident light from multiple angles, thereby effectively avoiding the problem of disconnect between screen lighting and the physical environment. Thus, the display device of this embodiment not only solves the lag problem in ambient light adaptation of existing display devices, achieving real-time fusion of physical and virtual lighting, but also expands the interaction paradigm of the display device by providing an ambient light-driven dynamic content response mechanism. This solution ensures high-performance lighting adjustment while also considering low power consumption, low latency, and privacy protection, providing a solution for the application of ultra-high-definition large screens in various scenarios.

[0029] In some embodiments of this application, the display panel of the display device integrates multiple ambient light sensors, and the processing unit and driving unit adjust the light and shadow data of the displayed image according to the distribution information of ambient light. However, in actual implementation, how to ensure that the ambient light sensors integrated inside the display panel can accurately and effectively receive external ambient light without affecting the normal display function of the display panel is a technical problem that needs to be solved.

[0030] Based on this, in one embodiment, the display panel 101 includes a black matrix (BM) layer and an array substrate, with multiple ambient light sensors located on the array substrate. The black matrix layer has multiple light-transmitting holes, and each ambient light sensor is configured to correspond to one light-transmitting hole for detecting ambient light incident through the light-transmitting hole.

[0031] The display panel 101 is used to display images and video information, and can be a liquid crystal display panel, an organic light-emitting diode display panel, or a quantum dot display panel, etc. The black matrix layer is a structural layer in the display panel, typically made of a black, opaque material. Its main function is to separate pixel units, prevent light crosstalk, and thus improve display contrast. The array substrate is the bottom substrate of the display panel, and can be made of glass or flexible materials. It integrates circuits that drive the display pixels, such as thin-film transistors, pixel electrodes, data lines, and scan lines. This array substrate can be a glass substrate, a flexible plastic substrate, or a silicon substrate. Multiple ambient light sensors are disposed on the array substrate and directly integrated into the internal structure of the display panel. These ambient light sensors can be directly fabricated in the non-display areas or pixel gaps of the array substrate using semiconductor processes such as thin-film deposition and photolithography, for example, as photodiodes or photoresistors; alternatively, miniaturized ambient light sensor chips can be integrated onto the array substrate using flip-chip bonding or surface mount technology. The black matrix layer has multiple light-transmitting holes, which are openings reserved for each ambient light sensor to allow external light to pass through. These holes can be formed in the black matrix layer through photolithography and etching processes, and their shapes can be circular, square, or other geometric shapes. Each ambient light sensor is configured with a corresponding light-transmitting hole to ensure that each ambient light sensor has a dedicated light transmission path for accurately detecting the ambient light at its location.

[0032] Specifically, the solution in this application integrates multiple ambient light sensors onto the array substrate of the display panel, and utilizes a structure with multiple light-transmitting holes on the black matrix layer to provide a light incident channel for each ambient light sensor. When the display device is operating, external ambient light can pass through the surface of the display panel, through the corresponding light-transmitting holes on the black matrix layer, and directly into the ambient light sensors located on the array substrate. This allows the ambient light sensors to accurately sense the intensity and distribution of external ambient light from within the display panel. After receiving the accurately collected ambient light data through the light-transmitting holes, the processing unit can more accurately analyze the distribution information of the ambient light, thereby enabling the driving unit to finely adjust the light and shadow data of the displayed image. This integration method fully utilizes the existing structure of the display panel, achieving seamless embedding of the ambient light sensors and avoiding interference with the appearance and display effect of the display panel.

[0033] As an example, the display panel 101 can be an LCD panel; the processing unit 102 can be a timing controller (TCON), a microcontroller unit (MCU), or a system on chip (SOC); the ambient light sensor can be an embedded ambient light sensor, which can be referred to as an in-cell sensor or sensor, and the light-transmitting hole (hereinafter referred to as "BM opening") opened on the black matrix layer can be directly opposite the sensor's photometric back channel. Figure 3 This is a schematic diagram of an exemplary Incell sensor structure in an embodiment of this application. It uses a BM (microwave diaphragm) opening directly facing the sensor's back channel for photometry, calculating illumination conditions based on the light intensity sensed by multiple sensors. In some scenarios, due to the large panel size and uneven light source, such as indoor scenes where only a few light sources illuminate the entire room, the light intensity received by each sensor on the panel is uneven. In more extreme scenarios, handheld light sources or table lamps may be used, causing severe unevenness in the light intensity received by sensors at different locations. Therefore, by calculating and matching the intensity, it is possible to determine which part of the panel is more strongly and which is weaker under ambient light radiation, thus inferring the light intensity distribution. Figure 4 This is an exemplary schematic diagram of light intensity distribution in an embodiment of this application, to... Figure 4 For example, when the illuminance of each sensor has the following characteristics... Figure 4 The distribution of light intensity in the image can be calculated using algorithms to determine if the light intensity is biased to the right, meaning the light intensity is higher on the right side. The degree of rightward bias can be calculated by the algorithm based on actual needs. After the lighting conditions are calculated, the relevant positional data is sent to the TCON, MCU, or SOC, and the screen randomly generates synchronized light and shadow changes corresponding to the lighting conditions, thus completing one feedback cycle. For example... Figure 5 As shown, Figure 5 This is an exemplary schematic diagram illustrating the logic and data source for light and shadow synchronization tracking in the embodiments of this application.

[0034] This application cleverly integrates an ambient light sensor into the display panel 101. The display panel 101 includes a black matrix layer, with a specially designed light-transmitting hole on the black matrix layer corresponding to the ambient light sensor. The ambient light sensor receives ambient light through the light-transmitting hole, thereby ensuring the accuracy and reliability of ambient light data acquisition. This integration method avoids the need for additional openings or sensors on the display panel surface, maintaining the integrity and aesthetics of the display panel, and effectively preventing interference with the display image. It provides a solid foundation for the display device to intelligently adjust the display effect according to ambient light.

[0035] In some embodiments of this application, the display device integrates multiple ambient light sensors within the display panel to sense ambient light data and adjusts the light and shadow data of the displayed image based on the distribution information of the ambient light. However, in practical applications, if the correspondence between the ambient light sensor and the light-transmitting hole is too simple, it may result in insufficient precision in the perception of the incident angle of ambient light and the local light intensity distribution, thereby affecting the accuracy of the light and shadow adjustment of the displayed image and the user experience.

[0036] Based on this, in one embodiment, the display panel 101 includes a black matrix layer and an array substrate, a plurality of ambient light sensors are located on the array substrate, the black matrix layer has a plurality of light-transmitting holes, and the orthographic projections of two adjacent ambient light sensors on the black matrix layer are respectively located on both sides of a light-transmitting hole, and are respectively used to detect ambient light incident through the light-transmitting hole.

[0037] In this design, the orthographic projections of two adjacent ambient light sensors onto the black matrix layer are located on either side of a light-transmitting aperture. This means that instead of a single sensor below the aperture, there are two adjacent sensors, positioned either to the left / right or top / bottom of the aperture. This arrangement allows light incident through the same aperture to be detected simultaneously by two adjacent sensors. Each sensor independently detects the incident light, and by comparing their detected light data, the incident direction, angle, or gradient information of the local light intensity distribution can be inferred.

[0038] Specifically, in this application, two adjacent ambient light sensors are designed so that their orthographic projections on the black matrix layer are located on opposite sides of the same light-transmitting aperture. When ambient light enters through the aperture, these two adjacent sensors detect the light independently. This arrangement allows light entering through a single aperture to be sensed by both sensors simultaneously, but due to the different incident angles of the light, the intensity or spot position of the light received by the two sensors may differ. After receiving the ambient light data sensed by each of the two sensors, the processing unit can compare and analyze the data.

[0039] As an example, in some scenarios, the light source is approximately parallel, such as sunlight streaming through a window. In such cases, the sensors described above are insufficient to read the angle of the light rays based on differences in light intensity and their distribution. A higher-precision reading scheme is proposed here. Figure 6 This is an exemplary schematic diagram of the illumination angle in an embodiment of this application. Two sensors are designed, with the opening located in the middle of the two sensors. Due to the thickness of the liquid crystal cell, the angle shift of the light will cause the light intensity received by the two sensors to be different.

[0040] In summary, by placing two adjacent ambient light sensors on either side of the same light-transmitting aperture, the display device can sense the ambient light incident through that aperture. This dual-sensor configuration can capture the directionality of light and local light intensity gradients, thus overcoming the limitation of a single sensor's insufficient light perception under a single light-transmitting aperture. Based on this richer and more accurate ambient light data, the processing unit can generate more refined ambient light distribution information, which in turn guides the drive unit to make more precise and realistic adjustments to the light and shadow data of the displayed image. This improves the matching degree between the displayed image and the actual ambient lighting, enhancing the user's visual immersion and comfort.

[0041] In some embodiments of this application, the display device can acquire ambient light data through an ambient light sensor integrated within the display panel and analyze the distribution information of the ambient light to drive the display panel to adjust the light and shadow data of the displayed image. However, relying solely on the distribution information of the ambient light may not be sufficient to accurately capture the directional characteristics of the ambient light, resulting in a lack of realism and immersion in the display image when adjusting the light and shadow, especially in the presence of side or oblique incident light sources, making it impossible to effectively simulate the realistic light and shadow effects produced by light on objects.

[0042] Based on this, in one embodiment, the display panel 101 further includes a light angle detection circuit, which is connected to two adjacent ambient light sensors respectively, for detecting the resistance values ​​of the two adjacent ambient light sensors respectively, and determining the incident angle of the ambient light based on the resistance values; the driving unit is also connected to the light angle detection circuit, for adjusting the light and shadow data of the display screen according to the distribution information of the ambient light and the incident angle.

[0043] The light angle detection circuit is an electronic circuit used to measure or infer the angle of incident light. Its implementation can include, but is not limited to: using a differential detection circuit based on a photoresistor array to calculate the angle by comparing the resistance changes of photoresistors at different positions; or using a photosensitive chip integrating a microlens array and a photodiode array to infer the incident angle of light by analyzing the differences in the response intensity of different photodiodes.

[0044] As an example, such as Figure 6 The design incorporates two sensors with the opening positioned in the middle of the two sensors. Due to the thickness of the liquid crystal cell, the angle of light shift will cause a difference in the light intensity received by the two sensors. Figure 7 This is a schematic diagram of an exemplary structure of the light inlet aperture in an embodiment of this application. When the light is incident from the left, there is more projection on the right sensor, and the resistance of the right sensor after photosensitive is less than that of the left sensor; wherein, the resistance value of the right sensor can be denoted as R. RThe resistance value of the sensor on the left can be denoted as R. L . Figure 8 This is an exemplary equivalent schematic diagram of the light angle detection circuit in the embodiments of this application, R R <R L If VDD is set to -VSS, then Readout = 2 × VDD × R R / (R R +R L Where VDD is the positive DC power supply voltage provided by the ambient light sensor; VSS is the negative power supply or ground voltage; and Readout is the reading voltage used to determine the incident angle of the light. By calibrating the structure of Readout and the incident angle of the ambient light source, the incident angle can be deduced from this reading.

[0045] The display device of this application can not only sense the intensity distribution of ambient light, but also obtain the incident angle of the ambient light. This allows the driving unit to comprehensively consider the intensity and directionality of light when adjusting the light and shadow data of the display screen, thereby generating more realistic and natural light and shadow effects. For example, when ambient light is incident from a specific direction, objects in the display screen can present shadows and highlights that conform to that incident angle, greatly enhancing the three-dimensionality and immersion of the image. This effectively solves the problem that it is difficult to accurately simulate the influence of light directionality on light and shadow based solely on light distribution information, providing users with a more realistic and comfortable visual experience.

[0046] In some embodiments of this application, ambient light is not constant; its distribution information may change dynamically over time, such as due to user movement, indoor light switching, or changes in natural lighting. If the display device only performs static or periodic lighting adjustments and fails to respond to these dynamic changes in a timely manner, the displayed image may not match the actual ambient lighting, thereby affecting the user's viewing experience and causing visual discomfort or loss of image detail.

[0047] Based on this, in one embodiment, the processing unit 102 is further configured to: trigger the display panel to adjust the light and shadow data of the display screen in real time based on the changes in the distribution information of ambient light.

[0048] Specifically, changes in ambient light distribution information can be identified by the processing unit through continuous monitoring and analysis of ambient light data sensed by ambient light sensors, thereby recognizing the dynamic evolution of ambient light distribution information over time. This involves not only acquiring current distribution information but, more importantly, detecting deviations of this information from a past moment or trend.

[0049] The real-time adjustment of the display panel's light and shadow data can be triggered by detecting changes in ambient light distribution information. The processing unit will then initiate or update the display panel's light and shadow data adjustment process to ensure that the display can quickly adapt to new ambient lighting conditions.

[0050] Specifically, the solution in this application continuously monitors and analyzes the ambient light data sensed by the ambient light sensor through a processing unit. It not only acquires the distribution information of ambient light but also continuously monitors and analyzes the dynamic evolution of this distribution information over time. By comparing the current ambient light distribution information with historical distribution information, or by performing trend analysis on the distribution information, the processing unit can identify significant changes in ambient lighting conditions. Once this change is detected, the processing unit immediately sends a command to the driving unit, triggering the driving unit to instantly adjust the light and shadow data of the display panel. This mechanism ensures that the display panel can quickly respond to dynamic changes in ambient light, such as when a user moves from a bright area to a dim area, or when an external light source suddenly appears or disappears. The display screen can synchronously adjust its brightness, contrast, color temperature, and local lighting effects. In this way, the display device can overcome the limitations of adjusting based solely on static distribution information, thereby continuously providing users with a visually comfortable and detailed display screen that is highly matched to the ambient light under various dynamic lighting environments.

[0051] The display device of this application can trigger the display panel to adjust the light and shadow data of the displayed image in real time based on changes in the distribution of ambient light. This allows the display device to dynamically adapt to constantly changing ambient lighting conditions, avoiding the problem of display images not matching the environment due to sudden changes in ambient light. When viewing the display image, users can obtain a continuously optimized and visually comfortable viewing experience regardless of fluctuations in ambient light, effectively improving the clarity, contrast, and detail of the displayed image, and significantly improving the visual perception quality of users in dynamic lighting environments.

[0052] In some embodiments of this application, the display panel of the display device integrates multiple ambient light sensors to sense ambient light data and adjust the lighting and shadows of the displayed image. However, in practical applications, directly integrating the ambient light sensor into the effective display area of ​​the display panel may have a certain impact on the visual effect of the displayed image.

[0053] Therefore, in one embodiment, each ambient light sensor is distributed in the bezel area of ​​the display panel 101.

[0054] Specifically, this application distributes ambient light sensors along the bezel area of ​​the display panel, enabling the sensors to continuously sense ambient light data without encroaching on the effective display area of ​​the panel. The processing unit receives and analyzes the data sensed by the ambient light sensors in the bezel area to accurately obtain the distribution information of the ambient light. Subsequently, the driving unit adjusts the light and shadow data of the displayed image based on the distribution information provided by the processing unit. This layout ensures that the ambient light sensors can effectively acquire ambient light information while avoiding potential interference with display effects or manufacturing complexity caused by sensors within the display area, thus achieving intelligent adjustment of the display image's light and shadow without affecting display quality.

[0055] As an example, the ambient light sensor can be an Incell sensor, and the distribution can include: multiple Incell sensors distributed on the bottom border; multiple Incell sensors distributed on the top and bottom borders respectively; multiple Incell sensors distributed on the left and right borders respectively; and multiple Incell sensors distributed on the top, bottom, left, and right borders respectively.

[0056] By placing the ambient light sensor in the bezel area of ​​the display panel, the sensor's occupation and interference with the effective display area of ​​the panel are effectively avoided, thus ensuring the visual integrity and display quality of the image. At the same time, this layout simplifies the manufacturing process of the display panel and reduces production costs.

[0057] In some embodiments of this application, in specific display panel structures, how to effectively integrate and accurately lay out ambient light sensors within a limited bezel space without affecting display performance and manufacturing process, so as to ensure accurate ambient light data acquisition, is a technical problem that needs to be solved.

[0058] Based on this, in one embodiment, the display panel is a liquid crystal display panel, the liquid crystal display panel has N flip-chip films, each ambient light sensor is distributed in the lower frame area of ​​the display panel, the number of ambient light sensors is (N-1) or 2×(N-1), the ambient light sensors are disposed between two adjacent flip-chip films, and N is a positive integer greater than one.

[0059] The ambient light sensors are distributed in the lower bezel area of ​​the display panel, which can be a non-display area at the bottom edge of the display panel. The ambient light sensors can be photosensitive elements such as photodiodes, photoresistors, or phototransistors. These sensors can be integrated as discrete components or directly fabricated on the array substrate using thin-film transistor (TFT) technology. The number of ambient light sensors is (N-1) or 2×(N-1), where N is the number of flip-chip films. When the number is (N-1), it can be understood that one sensor is placed between every two adjacent COFs. When the number is 2×(N-1), two sensors can be placed between every two adjacent COFs, for example, symmetrically or spaced apart. The ambient light sensors are positioned between two adjacent flip-chip films, meaning they are physically placed in the area between two adjacent COF modules. This integration typically utilizes the wiring space between COFs or reserved non-wiring areas.

[0060] Specifically, this application uses a liquid crystal display panel (LCD) and its inherent flip-chip thin-film layout structure to precisely integrate an ambient light sensor into the lower bezel area of ​​the display panel, positioned between two adjacent flip-chip thin films. This layout fully utilizes the space between the LCD panel and the COF (Chip-on-Foil) element, avoiding conflicts with the display area or the COF itself. Thus, it achieves effective integration of the ambient light sensor without affecting display performance or manufacturing processes.

[0061] As an example, in a liquid crystal display panel with N=4 flip-chip films, ambient light sensors can be distributed in the lower bezel area of ​​the display panel. According to this scheme, the number of ambient light sensors can be (4-1)=3 or 2×(4-1)=6. When three sensors are selected, they can be respectively positioned between adjacent COF1 and COF2, COF2 and COF3, and COF3 and COF4. The sensor can be in the form of a miniature photodiode array, directly fabricated on the array substrate using thin-film transistor technology, or integrated into the lower bezel area using a flexible printed circuit board.

[0062] This application precisely positions the ambient light sensor in the lower bezel area of ​​the liquid crystal display panel and integrates it using the space between adjacent flip-chip films. This solution effectively solves the problem of how to efficiently and accurately integrate an ambient light sensor within the limited space of the display panel bezel. This layout fully utilizes the inherent structural characteristics of the liquid crystal display panel, avoids interference with the display area, and simplifies the wiring and connection of the sensor. Therefore, it ensures accurate acquisition of ambient light data without significantly increasing manufacturing costs and complexity. Based on the ambient light data, the display device can adjust the light and shadow data of the displayed image, significantly improving the user's visual experience under different ambient light conditions.

[0063] In some embodiments of this application, the raw ambient light data sensed by the ambient light sensor may be affected by various factors, such as sensor error, environmental interference, or instantaneous abnormal lighting, resulting in data deviation or noise. If the unprocessed data is used directly for analysis, the ambient light distribution information may be inaccurate, thereby affecting the accuracy and stability of the display screen's light and shadow adjustment and reducing the user's viewing experience.

[0064] Based on this, in one embodiment, the processing unit 102 is further configured to: perform correction processing on the ambient light data to correct data deviations and noise; the correction processing includes at least one of calibration, filtering, outlier detection and interpolation.

[0065] Correction processing involves performing a series of operations on raw ambient light data to improve its accuracy and reliability, making it more suitable for subsequent analysis. This includes eliminating or reducing errors, noise, and inconsistencies in the data to ensure that the ambient light data accurately reflects actual ambient lighting conditions. Calibration is the process of comparing sensor output with known standards or reference values ​​to identify and correct systematic errors. For example, this can be done by comparing sensor readings with known light values ​​under controlled lighting conditions to generate correction curves or offsets, or by periodically calibrating the sensor against a reference light source integrated within the device. Filtering is the process of removing unwanted components (noise) from a signal or dataset while retaining key information.

[0066] As an example, the processing unit can employ a high-performance microcontroller with sufficient integrated computing resources to execute complex calibration algorithms. In practice, the calibration process can be completed before the device leaves the factory, generating a calibration lookup table stored in the processing unit's non-volatile memory. When the device is running, the data from each ambient light sensor is first calibrated using this lookup table. Subsequently, the calibrated data passes through a digital filter to eliminate high-frequency noise. If a sensor's reading suddenly changes by more than a preset threshold within a short period, it will be identified as an outlier by the outlier detection module and replaced with the previous valid reading. Furthermore, if the display panel requires a more detailed illumination distribution map, the processing unit can also utilize a bilinear interpolation algorithm to estimate the illumination intensity of areas not directly covered by the sensor based on readings from adjacent sensors.

[0067] This application, through the aforementioned technical solution, corrects ambient light data, improving its accuracy and reliability. This ensures that the ambient light distribution information acquired by the processing unit is more precise and stable, enabling the driving unit to adjust the light and shadow data of the displayed image more accurately and smoothly. This helps eliminate data deviations and noise caused by sensor errors, environmental interference, or instantaneous abnormal lighting, thereby avoiding unnecessary brightness jumps or light and shadow distortions in the displayed image, significantly improving user viewing comfort and visual experience.

[0068] In some implementations, adjusting the lighting and shadows solely based on the distribution information of ambient light may not be able to fully respond to the refined interactions made by users through specific light sources, and it is also difficult to effectively manage potential conflicts when multiple light sources operate simultaneously, thus limiting the application potential of the display device in complex interactive scenarios.

[0069] Based on this, in one embodiment, the processing unit 102 is further configured to: identify high-intensity light regions corresponding to multiple light sources operated by the user; determine light source clusters of high-intensity light regions using a preset spatial clustering algorithm; and assign identifiers to generate light source fingerprints, the light source fingerprints including center coordinates, spot size, intensity distribution characteristics, and incident angle; track the movement trajectory of the light source clusters based on the light source fingerprints; identify the behavior patterns of each light source; associate the behavior patterns with the display content of the display device and the light source fingerprints respectively to infer the user's interaction intent; monitor the spot areas of each light source cluster; and trigger a conflict detection mechanism when multiple spot areas are detected to overlap, displaying feedback information through the display panel to prompt the user of the conflict positions of multiple spot areas and guide adjustments.

[0070] One approach is to identify high-intensity light regions corresponding to multiple light sources operated by the user. This can be achieved by analyzing light data received by the ambient light sensor to detect light spots whose local brightness is significantly higher than the surrounding area. These light spots are typically generated by light sources actively used by the user (such as laser pointers or flashlights). This can be accomplished through image processing of the sensor array data, using algorithms such as threshold segmentation, edge detection, or local maximum search. Another approach is to analyze the frequency or modulation characteristics of the light signal using the sensor to distinguish between artificial light sources and natural ambient light.

[0071] Determining light source clusters in high-intensity light regions using a pre-defined spatial clustering algorithm involves grouping multiple detected high-intensity light regions to determine whether they originate from the same physical light source.

[0072] Assigning identifiers to generate light source fingerprints involves assigning a unique identifier to each identified light source cluster and extracting its feature information to construct a "fingerprint." The light source fingerprint includes center coordinates, i.e., the geometric center location of the light spot, which can be obtained by calculating the average or weighted average coordinates of all sensor points within the cluster. The light spot size can be the area or diameter of the region covered by the light spot, which can be determined by calculating the number of sensor points within the cluster or the dimensions of the fitted geometry. Intensity distribution features describe the brightness variation pattern within the light spot.

[0073] By tracking the movement trajectory of a cluster of light sources using light source fingerprints, the position and state of the cluster can be predicted and updated using light source fingerprint information from consecutive time frames. This can be achieved through target tracking algorithms such as Kalman filtering and particle filtering to smooth the motion path of the light sources and predict their future positions.

[0074] Identifying the behavior patterns of individual light sources can be achieved by analyzing the dynamic characteristics of light source clusters, such as their movement trajectory, speed, dwell time, and changes in spot size, to determine the user's possible operational intentions.

[0075] Associating behavioral patterns with the display content of the display device and the fingerprint of the light source to infer the user's interaction intent can be achieved by combining the identified user behavior patterns with the images, text, interactive elements, and other content presented on the current display panel, as well as the characteristics of the light source itself (such as color, brightness, and shape) for comprehensive judgment.

[0076] Monitoring the spot area of ​​each light source cluster allows for the real-time acquisition and maintenance of the precise spatial extent occupied by each cluster on the display panel. This typically involves continuously updating the center coordinates and spot size information in the light source fingerprint, and calculating the boundary or outline of the spot accordingly.

[0077] The collision detection mechanism is triggered when multiple light spot areas are detected to overlap. This means that when the light spot areas of two or more light source clusters intersect on the display panel, a processing flow is automatically initiated. This can be done by comparing the light spot boundaries or pixel masks of different light source clusters to determine whether there are overlapping areas.

[0078] Specifically, this application displays feedback information through a display panel to alert the user to the conflicting locations of multiple light spot areas and guide adjustments. After a conflict is detected, the driving unit controls the display panel to display visual cues in or near the overlapping area, such as flashing, color changing, displaying text warnings, or indicator arrows, to inform the user of the occurrence of the conflict and guide the user to adjust the position of the light source to resolve the conflict.

[0079] The solution proposed in this application integrates multiple ambient light sensors into the display panel and utilizes a processing unit to perform advanced analysis of the sensor data, enabling it to identify and track specific light sources operated by the user. By generating a light source fingerprint for this light source, including its center coordinates, spot size, intensity distribution characteristics, and incident angle, the system gains the ability to perceive user interaction behavior.

[0080] Through the aforementioned technical solution, this application enables a display device to identify and track specific light sources operated by the user from complex ambient light data, and generate detailed fingerprint information for those light sources. This allows the system not only to perceive ambient light but also to understand the specific interactive behaviors performed by the user through light. By associating the behavior patterns of the light source with the display content and the light source fingerprint, the display device can intelligently infer the user's interactive intent, thereby achieving a more advanced and personalized display response and interactive experience. In some implementations, ambient lighting is often uneven on the display panel. If only overall lighting and shadow adjustments are made, it may not be able to fully adapt to the local lighting differences in different areas of the display panel, thereby affecting the overall visual effect of the displayed image.

[0081] Based on this, in one embodiment, the display panel includes multiple display areas, and the driving unit is further configured to: determine the ambient light intensity level corresponding to each display area of ​​the display panel based on the distribution information of ambient light; obtain the light and shadow adjustment data corresponding to each display area by mapping a preset light and shadow parameter matrix according to the light intensity level; wherein, the light and shadow parameter matrix includes light and shadow adjustment data corresponding to different ambient light intensity levels, and the light and shadow adjustment data includes a high gloss coefficient, a shadow density coefficient, and a material reflectivity coefficient; and adjust the light and shadow data of each display area according to the light and shadow adjustment data corresponding to each display area respectively.

[0082] The display panel can be logically or physically divided into multiple independent display areas. These areas can be preset fixed areas, such as dividing the entire display panel into several rectangular grids, or dynamically divided areas based on the displayed content, such as treating different objects or background areas in the display as independent display areas. This division allows the display panel to perform fine-tuned lighting and shadow adjustments for different local ambient light conditions, rather than performing a uniform overall adjustment. The ambient light distribution information received by the processing unit reflects the ambient light intensity at different locations on the display panel. By analyzing this distribution information, a corresponding ambient light intensity level can be assigned to each display area of ​​the display panel.

[0083] In one specific implementation, the display panel can be logically divided into a 10x10 grid, forming 100 independent display areas. The processing unit interpolates and averages the ambient light data sensed by the ambient light sensor array integrated within the display panel to calculate the ambient light intensity of each grid area, classifying it into three ambient light intensity levels: "dark," "medium," and "bright." The driving unit internally stores a preset light and shadow parameter matrix, which defines different specular brightness coefficients, shadow density coefficients, and material reflectivity coefficients for the "dark," "medium," and "bright" levels, respectively.

[0084] This application, through the aforementioned technical solution, enables the display device to overcome the problem of poor display performance under complex ambient lighting conditions in traditional display devices. Since ambient light is often uneven on the display panel, simply adjusting the overall lighting can lead to some areas being too bright or too dark, affecting the viewing experience. This solution divides the display panel into multiple display areas and performs independent, precise lighting adjustments for each area based on its ambient light intensity level, allowing the display to better adapt to local lighting changes. This not only improves the contrast and clarity of the display but also enhances the realism and immersion of the image, ensuring users receive optimal visual effects under various complex lighting conditions and significantly improving the user experience. In some embodiments of this application, the display device can adjust the light and shadow data of the displayed image based on the distribution information of ambient light. However, in practical applications, when there are local strong light sources, simply adjusting the overall light and shadow may not be sufficient to simulate the effect of light on objects in the real world, resulting in a difference between the displayed image and the actual environment, affecting the user's immersion and visual experience.

[0085] Based on this, in one embodiment, the driving unit 102 is further configured to: generate a dynamic light-tracking effect in the corresponding area of ​​the display screen when the ambient light distribution information shows the presence of a local strong light source; wherein the size of the light spot of the light-tracking effect is positively correlated with the light intensity of the local strong light source, and the movement trajectory of the light spot is synchronized with the position change of the local strong light source in real time.

[0086] When ambient light distribution information indicates the presence of localized strong light sources, the processing unit can analyze ambient light data sensed by multiple ambient light sensors to identify one or more regional light sources in the environment with brightness significantly higher than the surrounding ambient light. The processing unit can utilize spatial analysis algorithms, such as local peak detection or gradient analysis of the sensor array data, to determine the location and intensity of these localized strong light sources. Alternatively, the processing unit can construct a virtual illumination intensity map from the ambient light data and then apply image processing techniques, such as threshold segmentation or connected component analysis, to identify and locate bright areas, thereby determining the presence of localized strong light sources.

[0087] Generating a dynamic light-tracing effect in a corresponding area of ​​the displayed image can be achieved by the driving unit, based on the position and intensity information of a local strong light source identified by the processing unit, rendering a simulated light spot or highlight area in real time within the corresponding coordinate area of ​​the displayed image by adjusting display parameters such as pixel brightness, contrast, or color saturation. This simulated light spot aims to visually simulate the local illumination effect produced by a real light source on the displayed content. For example, the driving unit can preset multiple rendering templates for light-tracing effects and select an appropriate template for overlay rendering based on the characteristics of the local strong light source (such as light intensity, color, and incident angle) to enhance the realism of the image.

[0088] The size of the spot in a ray-tracking effect is positively correlated with the intensity of the local strong light source. This means that the higher the brightness of the local strong light source, the larger the spot of the ray-tracking effect generated on the displayed image, and vice versa. This positive correlation can be achieved by maintaining a mapping function or lookup table between light intensity and spot size within the driver unit. When the processing unit detects the light intensity data of the local strong light source, the driver unit calculates the corresponding spot size parameter using this function or lookup table and adjusts the size of the rendered spot accordingly. For example, a non-linear scaling factor can be used to map the normalized local strong light source intensity value to a preset spot size range, thereby achieving dynamic adjustment of the spot size.

[0089] The movement trajectory of the light spot is synchronized in real time with the positional changes of the local strong light source, ensuring that the position of the light spot in the chasing effect on the display screen can follow the movement of the local strong light source in the environment instantly and accurately. The processing unit continuously monitors the ambient light sensor data, updates the position information of the local strong light source in real time, and quickly transmits the updated position data to the driving unit. The driving unit then immediately adjusts the rendering center coordinates of the chasing effect on the display screen based on the latest position information received, ensuring that the visual movement of the light spot maintains a high degree of consistency with the actual movement of the light source.

[0090] This application utilizes multiple ambient light sensors integrated within the display panel to continuously sense ambient light data. The processing unit receives and analyzes this data, obtaining not only the overall distribution information of the ambient light but also identifying and locating localized strong light sources in the environment, acquiring their intensity and location information. Subsequently, the driving unit uses this detailed localized strong light source data to generate a dynamic light-tracking effect on the display panel. This light-tracking effect is not a simple brightness adjustment but rather dynamically adjusts the size of the light spot based on the intensity of the localized strong light source, synchronizing its movement trajectory with the actual positional changes of the localized strong light source in real time. This localized lighting and shadow adjustment mechanism enables the display screen to respond instantly and visually accurately to changes in specific light sources in the environment, thereby simulating more realistic localized lighting and shadow effects in the displayed content, significantly enhancing the realism of the display and the user's immersive experience.

[0091] This application also proposes a display method using the aforementioned display device. The method includes receiving ambient light data sensed by each ambient light sensor, analyzing the ambient light data to obtain ambient light distribution information, and driving the display panel to adjust the light and shadow data of the displayed image based on the distribution information.

[0092] The details of the display method can be found in the previous description of the display device, and will not be repeated here.

[0093] The display device and display method provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the technical solutions and core ideas of this application. Those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. These modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A display device, characterized in that, include: The display panel integrates multiple ambient light sensors; The processing unit is connected to each of the ambient light sensors and is used to receive ambient light data sensed by each of the ambient light sensors and analyze the ambient light data to obtain the distribution information of ambient light. The driving unit, connected to the processing unit and the display panel, is used to drive the display panel to adjust the light and shadow data of the displayed image according to the distribution information.

2. The display device according to claim 1, characterized in that, The display panel includes a black matrix layer and an array substrate. Multiple ambient light sensors are located on the array substrate. The black matrix layer has multiple light-transmitting holes. Each ambient light sensor is correspondingly set with one of the light-transmitting holes and is used to detect ambient light incident through the light-transmitting holes.

3. The display device according to claim 1, characterized in that, The display panel includes a black matrix layer and an array substrate. Multiple ambient light sensors are located on the array substrate. The black matrix layer has multiple light-transmitting holes. The orthographic projections of two adjacent ambient light sensors on the black matrix layer are located on both sides of one of the light-transmitting holes, respectively, and are used to detect ambient light incident through the light-transmitting holes.

4. The display device according to claim 3, characterized in that, The display panel also includes a light angle detection circuit, which is connected to two adjacent ambient light sensors respectively, for detecting the resistance values ​​of the two adjacent ambient light sensors respectively, and determining the incident angle of the ambient light based on the resistance values; The driving unit is also connected to the light angle detection circuit, and is used to adjust the light and shadow data of the display screen according to the distribution information of the ambient light and the incident angle.

5. The display device according to any one of claims 1-4, characterized in that, The processing unit is also used for: Based on the changes in the distribution information of the ambient light, the display panel is triggered to adjust the light and shadow data of the displayed image in real time.

6. The display device according to any one of claims 1-4, characterized in that, Each of the ambient light sensors is located in the bezel area of ​​the display panel.

7. The display device according to claim 6, characterized in that, The display panel is a liquid crystal display panel, which has N flip-chip films. Each of the ambient light sensors is distributed in the lower border area of ​​the display panel. The number of ambient light sensors is (N-1) or 2×(N-1). The ambient light sensors are disposed between two adjacent flip-chip films, where N is a positive integer greater than one.

8. The display device according to claim 1, characterized in that, The processing unit is also used for: The ambient light data is corrected to correct data deviations and noise; the correction process includes at least one of calibration, filtering, outlier detection, and interpolation.

9. The display device according to claim 1, characterized in that, The processing unit is also used for: The system identifies high-intensity light regions corresponding to multiple light sources operated by the user, uses a preset spatial clustering algorithm to determine the light source clusters of the high-intensity light regions, and assigns identifiers to generate light source fingerprints. The light source fingerprints include center coordinates, light spot size, intensity distribution characteristics, and incident angle. The system tracks the movement trajectory of the light source clusters based on the light source fingerprints. Identify the behavior patterns of each of the light sources, and associate the behavior patterns with the display content of the display device and the light source fingerprint, respectively, to infer the user's interaction intent; The system monitors the spot areas of each of the light source clusters and triggers a conflict detection mechanism when multiple spot areas are detected to overlap. Feedback information is displayed on the display panel to inform the user of the conflict locations of the multiple spot areas and guide adjustments.

10. The display device according to claim 1, characterized in that, The display panel includes multiple display areas, and the driving unit is further configured to: Based on the ambient light distribution information, the ambient light intensity level corresponding to each display area of ​​the display panel is determined; Based on the light intensity level mapping preset light and shadow parameter matrix, light and shadow adjustment data corresponding to each of the display areas are obtained; wherein, the light and shadow parameter matrix includes light and shadow adjustment data corresponding to different ambient light intensity levels, and the light and shadow adjustment data includes high gloss coefficient, shadow density coefficient and material reflectivity coefficient; Based on the light and shadow adjustment data corresponding to each of the display areas, the light and shadow data of each display area are adjusted respectively.

11. The display device according to claim 1, characterized in that, The drive unit is also used for: When the ambient light distribution information indicates the presence of a local strong light source, a dynamic light-tracking effect is generated in the corresponding area of ​​the display screen; wherein, the size of the light spot of the light-tracking effect is positively correlated with the light intensity of the local strong light source, and the movement trajectory of the light spot is synchronized in real time with the positional change of the local strong light source.

12. A display method, characterized in that, The method of using the display device according to any one of claims 1-11 includes: Receive ambient light data sensed by each ambient light sensor, and analyze the ambient light data to obtain the distribution information of ambient light; Based on the distribution information, the display panel is driven to adjust the light and shadow data of the displayed image.

Images