Screen illumination distribution reconstruction method and system, and display device

Abstract

The invention discloses a screen illumination distribution reconstruction method and system and a display device. A display area of a display panel is used as an active coding spatial light modulator, an ambient light sensor array is arranged at the edge of a screen, a preset positive coding pattern and negative coding pattern sequence is displayed in sequence, edge sensor signals are collected, and a measurement vector is generated. According to the method, a physical response matrix and a system matrix for describing a light transmission relation from each display partition to a sensor are constructed, light transmission efficiency differences are comprehensively considered, and a two-dimensional environment illumination distribution diagram of the surface of a screen is reconstructed from edge measurement data; for the display device with the partition brightness adjusting function, the target brightness compensation amount on the brightness control unit can be calculated according to the reconstruction result and the optical characteristics of the display panel. On the premise of not occupying a display area and not increasing a front-facing camera, high-precision and non-intrusive reconstruction of screen illumination distribution is realized, and the method can be used for adaptive brightness control of a display and other outdoor display equipment.

Description

Technical Field

[0001] This invention relates to the field of display technology, and in particular to a method and system for reconstructing screen illumination distribution, and a display device. Background Technology

[0002] Displays are widely used in outdoor handheld terminals, vehicle dashboards, and avionics equipment. In actual outdoor use, ambient lighting often exhibits significant spatial unevenness. For example, when a device is in the shade of trees, buildings, or partially obscured by light inside a vehicle, the screen surface will simultaneously have areas of direct sunlight and areas of shadow, resulting in some areas of the screen being brighter than others, severely impacting the accuracy of information recognition and visual comfort. To maintain good display performance in complex lighting environments, it is necessary to obtain the two-dimensional ambient light distribution on the screen surface and accordingly perform zoned or pixel-level compensation of the display light source.

[0003] In existing technologies, a common approach is to place one or a few ambient light sensors on the screen bezel and adjust the overall backlight brightness based on their output. This approach can only provide overall light intensity or approximate location information and cannot reflect the differences in illuminance across different areas of the screen, making it difficult to provide precise compensation for local shadows. Another approach estimates the light distribution by capturing images of screen reflections with a front-facing camera. While this achieves higher spatial resolution, it poses a risk of user privacy breaches and increases the size of the camera aperture, module, and system cost. If a sensor array is directly embedded within the screen display area, it will occupy pixel apertures, introducing bright or dark spots and reducing display quality.

[0004] When sensors are placed only at the edge of the screen, the reflected light from the center region is attenuated significantly as it travels to the edge, making the target signal easily submerged in strong background light and sensor noise. If an idealized mathematical model is directly used to establish the response matrix for solving, the matrix often exhibits highly ill-conditioned behavior due to its excessively large condition number, making it extremely sensitive to noise and resulting in severe distortions in the reconstructed image, such as a dark center and bright edges.

[0005] Therefore, how to reliably obtain the two-dimensional illumination distribution of the screen using only edge sensors without occupying the display area or relying on the front-facing camera, and how to overcome the reconstruction errors caused by low signal-to-noise ratio and model mismatch, is a technical problem that urgently needs to be solved in this field. Summary of the Invention

[0006] The purpose of this invention is to overcome the shortcomings of existing technologies and provide a screen illumination distribution reconstruction method, system, and display device. By utilizing edge sensing arrays and computational imaging technology, the two-dimensional ambient illumination distribution on the screen surface can be accurately reconstructed without encroaching on the display area. This provides high-quality input for zoned brightness adjustment and adaptive brightness control, thereby alleviating the phenomenon of local over-brightness or under-brightness in complex lighting environments and improving outdoor visibility.

[0007] This invention is achieved through the following technical solution:

[0008] A method for reconstructing screen illumination distribution specifically includes the following steps:

[0009] S1. Divide the display area of ​​the display panel into multiple display zones, control the combination display of the display zones under different display states, and use a sensor array arranged on the edge of the display panel to collect corresponding optical response data to construct a physical response model to characterize the light transmission relationship between the display zones and the sensor array.

[0010] S2. Based on the physical response model, feature extraction processing is performed on the light transmission differences between different display partitions and the sensor array to obtain sensitivity feature information for characterizing the optical response differences of each display partition;

[0011] S3. Generate encoded information for modulating the display state of the display partitions based on the number of display partitions, and combine it with the sensitivity feature information to construct a system model for describing the overall optical response relationship between the display partitions and the sensor array;

[0012] S4. Based on the encoded information, control the display panel to operate in at least two different display states and collect corresponding optical response data. By combining and processing the optical response data, observation data for illumination distribution reconstruction is formed.

[0013] S5. Based on the observation data and the system model, construct an optimization model that includes data consistency constraints and spatial prior constraints. Solve the optimization model under non-negative constraints to obtain the illumination distribution results representing the ambient light intensity of each display partition. Reshape the illumination distribution results into a two-dimensional illumination distribution map corresponding to the display partition.

[0014] S6. Based on the two-dimensional illumination distribution map, identify the shadow and highlight areas of the display panel, and establish the corresponding relationship between the display partition and the brightness control unit according to the illuminance of each display partition. Combining the optical reflection and transmission characteristics of the display panel, calculate the supplementary brightness required to maintain the preset visual contrast under the current ambient light, and then generate the target brightness compensation amount of each brightness control unit, and control the brightness control unit to perform partition brightness adjustment.

[0015] In step S1, the combination display of the display partitions under different display states and the acquisition of corresponding optical response data by a sensor array arranged on the edge of the display panel are specifically as follows: each display partition is set to a high brightness state in sequence, and the rest are set to a low brightness or constant state, and the corresponding multi-channel light intensity readings are acquired by a sensor array arranged on the edge of the display panel; the sensor array includes ambient light sensors evenly distributed on the four edges of the display panel, and the ambient light sensors are arranged on the side light emission path facing the display panel. The light emission path includes the side of the light guide component, the side of the encapsulation layer of the display panel, or the side of the substrate, and is used to receive light signals reflected from the surface of the display panel and transmitted to the edge of the display panel.

[0016] In step S3, the encoded information satisfies the conditions of orthogonality, approximate orthogonality, or statistical independence in order to minimize the correlation interference between the optical responses of different display zones.

[0017] In step S3, the system model is established based on the light emission characteristics of the display partition and the response characteristics of the sensor to the light signals of different partitions. The specific construction process is as follows: the light emission characteristic information used to characterize the differences in light transmission of the display partition is introduced into the coding modulation logic, and a comprehensive mapping relationship between the ambient light intensity of the display partition and the response of the sensor array is established, thereby forming a system model.

[0018] The specific details of step S4 are as follows:

[0019] The system controls the display panel to switch between at least two contrasting display states based on the encoded information, and synchronously triggers the sensor array to collect optical response data. The system then processes the collected raw data to generate high signal-to-noise ratio observation data for illumination distribution reconstruction.

[0020] The steps for generating observation data include: fusing the multi-channel optical response data collected by the sensor array to obtain the measurement results corresponding to the current encoding display mode; the observation data is a vector or set of data formed by combining multiple measurement results, and its dimensional form is determined according to the measurement method and system configuration.

[0021] During the measurement process, optical response data corresponding to the same coded display mode were collected multiple times, and the results of the multiple collections were fused through statistical processing. Based on the fusion results obtained under different display states, observation data for subsequent illumination distribution reconstruction was generated.

[0022] A screen illumination distribution reconstruction system, comprising:

[0023] The display panel is used to display images, and its display area is divided into multiple display zones;

[0024] An edge sensor array is disposed in the bezel area of ​​the display panel to collect ambient light signals reflected from the surface of the display panel and transmitted to the edge of the display panel;

[0025] The control and acquisition module is used to control the display panel to display preset coded patterns on each display zone and to trigger the edge sensor array to acquire light intensity data.

[0026] The memory is used to store program code as well as model parameters and calibration information for illumination distribution reconstruction;

[0027] A processor is connected to the display panel, the edge sensor array, the control and acquisition module, and the memory. The processor is configured to execute the program code to implement the screen illumination distribution reconstruction method. When the illumination distribution reconstruction system is used in conjunction with a brightness control unit with partitioned brightness adjustment function, a spatial correspondence is pre-established between the display partition and the brightness control unit with partitioned brightness adjustment function so as to map the reconstructed illuminance of each display partition to the target brightness compensation amount of each brightness control unit.

[0028] The control and acquisition module includes: a display driving unit for outputting coded modulation signals to the display panel through a display interface; and a sensor acquisition unit for connecting to the edge sensor array via a communication link and reading the response data of each sensor. The display driving unit and the sensor acquisition unit are integrated in the same control circuit or are implemented collaboratively by multiple processing units that communicate with each other.

[0029] A display device includes a screen illumination distribution reconstruction system; the display device is equipped with a brightness adjustment mechanism for performing zoned brightness compensation or adjustment of the display light source based on the reconstructed screen illumination distribution results.

[0030] The main technical features and advantages of this invention include:

[0031] Physical response calibration and non-uniformity compensation: Through a calibration process under controlled conditions, calibration information characterizing the light transmission characteristics between the display partition and the sensor is obtained and introduced into the system model to compensate for the response non-uniformity caused by differences in optical paths, thereby ensuring the overall consistency of the illumination distribution reconstruction results.

[0032] Highly robust coding measurement mechanism: A switching measurement strategy based on contrast display status is adopted, and the synchronously acquired optical response data is processed by signal combination, thereby effectively suppressing the interference of ambient background light and system noise on the measurement results and obtaining observation data with high signal-to-noise ratio.

[0033] Reconstruction and Application Based on Spatial Constraints: Construct a reconstruction model that incorporates prior spatial information, solve the two-dimensional illumination distribution on the screen surface under the condition of satisfying physical rationality, and generate control instructions for adjusting display parameters based on the distribution to accurately adapt to the current ambient illumination conditions.

[0034] Flexible extended implementation: This invention supports multiple implementation paths, including using data-driven methods (such as machine learning) to accelerate the reconstruction process to meet real-time requirements, or using multi-channel joint processing technology to further improve the stability and accuracy of reconstruction.

[0035] The advantages of this invention are: by arranging optical sensing units at the edge of the display panel to obtain screen ambient light information, it is possible to effectively perceive and reconstruct the screen illumination distribution without occupying the display area or introducing a front imaging device, while ensuring the display aperture ratio and user privacy.

[0036] This invention effectively reduces the influence of ambient background light and system noise on measurement results by rationally combining and processing optical response data under different display states, thereby improving the signal-to-noise ratio and stability of illumination distribution reconstruction. At the same time, by introducing constraint information to describe the differences in light transmission at the model level, it suppresses reconstruction distortion caused by optical path non-uniformity, making the system highly adaptable to non-ideal factors of display panel display characteristics, which is beneficial for engineering implementation and calibration simplification.

[0037] This invention can output illumination distribution results corresponding to the spatial distribution of the display area, and can use the illumination distribution results for display parameter adjustment based on a pre-established spatial mapping relationship, thereby improving the display effect and enhancing the overall visual contrast in complex lighting environments.

[0038] This invention employs conventional display components and a general control and acquisition architecture, which has good engineering feasibility and mass production feasibility. At the same time, the method and system have a certain degree of scalability and can be adapted or optimized according to application scenarios, computing power conditions and cost constraints. Attached Figure Description

[0039] Figure 1 This is a schematic diagram of the structure of the present invention;

[0040] Figure 2 This is a flowchart of the method of the present invention. Detailed Implementation

[0041] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. Those skilled in the art should understand that these embodiments are for illustrative purposes only and are not intended to limit the scope of protection of the present invention.

[0042] like Figure 2 As shown, a method for reconstructing screen illumination distribution specifically includes the following steps:

[0043] S1. Divide the display area of ​​the display panel into multiple display zones, and sequentially set each display zone to a high-brightness state, while setting the rest to a low-brightness or constant state. Collect corresponding multi-channel light intensity readings using a sensor array arranged at the edge of the display panel. In specific implementation, assume the number of display zones is N and the number of edge sensors is P. Sequentially light up the j-th display zone (j=1, ..., N) and record the reading a{i,j} of the i-th sensor (i=1, ..., P). This establishes a physical response matrix A to characterize the light transmission relationship between each display zone and the sensors:

[0044]

[0045] S2. Based on the physical response model A, feature extraction processing is performed on the light transmission differences between different display partitions and sensors to obtain sensitivity feature information that characterizes the differences in light transmission efficiency among each display partition. Specifically, in this embodiment, the sensitivity feature vector S is obtained by performing statistical operations on the column vectors of the physical response matrix A. Wherein, the sensitivity coefficient of the j-th display partition... :

[0046]

[0047] The sensitivity feature information is used to reflect the non-uniformity of light energy transmission within the display area caused by factors such as spatial location differences and optical path differences.

[0048] S3. Generate encoded information for modulating the display state of the display zones based on the number of display zones, and combine this information with the sensitivity characteristic information to construct a system model describing the overall optical response relationship between the display zones and the sensor. Specifically, generate an encoded matrix H, and transform the sensitivity vector S into a diagonal matrix. Construct a system matrix C containing physical transmission characteristics using the following formula;

[0049]

[0050] At this point, the element C{k,j} in the system matrix C represents the comprehensive contribution weight of the ambient illuminance of the j-th display zone to the observed data in the k-th coded measurement. The coded information has low correlation in an algebraic or statistical sense, such as being orthogonal or approximately orthogonal, to improve distinguishability during the measurement process.

[0051] S4. Based on the encoding information, control the display panel to sequentially display multiple sets of positive and negative encoded patterns, and collect corresponding optical response data through the sensor array. Specifically, for the k-th encoding group, collect readings of the positive pattern respectively. and negative pattern readings The observed values ​​are obtained through difference operations. The observations from all K measurements are aggregated to form the observation vector M.

[0052]

[0053] S5. Using the observed data M and the system model C as input, construct an optimization model that includes data consistency constraints and spatial prior constraints. In this embodiment, a total variational (TV) regularization term is used to construct the following convex optimization objective function under non-negative constraints;

[0054] The convex optimization objective function is:

[0055]

[0056] Where L is the illumination distribution vector to be determined, M is the measurement vector, C is the system matrix, TV(L) is the total variation operator of the image corresponding to the illumination distribution vector, and μ is the regularization parameter.

[0057] S6. Based on the two-dimensional illumination distribution map, identify the shadow and highlight areas of the display panel, and establish the corresponding relationship between the display partition and the brightness control unit according to the illuminance of each display partition. Combining the optical reflection and transmission characteristics of the display panel, calculate the supplementary brightness required to maintain the preset visual contrast under the current ambient light, and then generate the target brightness compensation amount of each brightness control unit, and control the brightness control unit to perform partition brightness adjustment.

[0058]

[0059] in, This represents the target brightness compensation amount for the i-th brightness control unit. R represents the ambient illuminance corresponding to the i-th display zone extracted from the two-dimensional illumination distribution map; R is the average light reflectance of the display panel. This refers to the light transmittance of the display panel at its maximum grayscale. This is the preset target visual contrast threshold. For transflective liquid crystal display panels, the brightness calculated by the above formula is the total transmitted brightness required to maintain the contrast. In actual control, the brightness component contributed by the reflective mode can be further subtracted to achieve energy-saving control.

[0060] In step S1, the sensor array is arranged in the peripheral area of ​​the display panel (such as inside the frame or on the side), and its light-sensing path is coupled to the side light-emitting channel of the display panel to receive light signals reflected from the surface of the display panel and transmitted to the edge through the inside of the panel.

[0061] In step S3, the encoded information has low correlation in an algebraic or statistical sense (e.g., orthogonal or approximately orthogonal) to improve distinguishability during the measurement process. The system model construction process includes: introducing physical characteristic information used to characterize the differences in light transmission between display zones into the encoding modulation logic, establishing a comprehensive mapping relationship between the ambient light intensity of the display zones and the sensor response, thereby forming a system model.

[0062] The specific details of step S4 are as follows:

[0063] The control panel switches between at least two contrasting display states (e.g., modulation state and reference state) based on the encoded information, and simultaneously triggers the sensor array to acquire optical response data. The acquired raw data undergoes signal processing (e.g., data fusion or differential operation) to suppress interference from environmental background and random noise, thereby forming high signal-to-noise ratio observation data for illumination distribution reconstruction.

[0064] The step of generating measurement data includes: fusing the multi-channel optical response data collected by the sensor array to obtain the measurement result corresponding to the current encoding display mode; the observation data is a vector or set of data formed by combining multiple measurement results, and its dimensional form can be determined according to the measurement method and system configuration;

[0065] During the measurement process, optical response data corresponding to the same coded display mode can be acquired multiple times, and the results of multiple acquisitions can be fused through statistical processing to improve the stability of the observation data. Based on the fusion results obtained under different display states, observation values ​​for subsequent illumination distribution reconstruction are generated.

[0066] In step S5, using the observed data and system model as input, a reconstruction model incorporating spatial prior constraints is constructed. Under the condition of satisfying physical rationality, the model is numerically solved to obtain a two-dimensional distribution result reflecting the ambient light intensity of each display zone.

[0067] A screen illumination distribution reconstruction system, characterized in that it comprises:

[0068] The display panel is used to display images, and its display area is logically divided into multiple display zones;

[0069] An edge sensor array is disposed in the peripheral area of ​​the display panel to collect ambient light signals reflected from the surface of the display panel and transmitted to the edge;

[0070] The control and acquisition module is used to control each display zone of the display panel to be in a preset encoding and modulation state, and to synchronously trigger the edge sensor array to acquire light intensity data;

[0071] The memory is used to store program code, as well as calibration information and system model parameters that characterize the optical transmission relationship between the display partition and the sensor;

[0072] The processor, connected to the display panel, the edge sensor array, the control and acquisition module, and the memory, is configured to execute the program code to implement the screen illumination distribution reconstruction method; wherein, the processor is further configured to generate brightness control instructions for the display light source based on the reconstructed screen illumination distribution results, so as to realize the brightness adjustment or compensation of the zones.

[0073] The control and acquisition module includes:

[0074] The display driving unit is used to output encoded modulation signals to the display panel through the display interface and control the switching of display states;

[0075] The sensor acquisition unit is used to connect with the edge sensor array via a communication link and read the response data of each sensor when it receives an acquisition trigger command;

[0076] The display driving unit and the sensor acquisition unit can be integrated on the same control chip, or they can be implemented collaboratively by multiple processing units that communicate with each other.

[0077] A display device includes the aforementioned screen illumination distribution reconstruction system; the display device is equipped with a brightness adjustment mechanism that adjusts the display light source in zones according to the reconstructed screen illumination distribution results to improve the display effect under complex lighting conditions.

[0078] In one embodiment, the method of the present invention includes: calibrating and constructing a physical response model: under controlled illumination, controlling the display partition of the display panel to be in a preset calibration display state, and using a sensor array arranged on the edge of the display panel to collect corresponding light intensity response data; based on the light intensity response data, establishing physical response sensitivity feature information to characterize the light transmission relationship between the display partition and the sensor.

[0079] In one implementation, based on the acquired physical response sensitivity characteristic information, feature analysis or statistical processing is performed on the light transmission data between the display partition and the edge sensor to obtain sensitivity characteristic information (e.g., sensitivity distribution map or vector) to characterize the differences in light transmission efficiency among different display partitions. This sensitivity characteristic information reflects the non-uniformity of light energy transmission within the display area caused by factors such as spatial location differences and optical path differences. Subsequently, according to the encoding and modulation logic of the display partition, the sensitivity characteristic information is introduced into the encoding model to construct a system model incorporating physical transmission characteristics, used to characterize the comprehensive response relationship between the illuminance of the display partition and the sensor observation data.

[0080] Encoding Measurement and Data Acquisition: Based on the encoding logic, the display panel is controlled to switch between at least two display states with a contrasting relationship (e.g., positive and negative complementary states or differential modulation states), and the edge sensor array is synchronously triggered to acquire optical response data. Data acquired under different display states are combined and processed (e.g., differential processing or weighted combination) to reduce the influence of ambient background light and system noise on the measurement results, thereby forming observation data with a high signal-to-noise ratio.

[0081] Illumination Distribution Reconstruction and Application: Based on the observed data and system model, a reconstruction model is constructed, incorporating data consistency constraints and spatial prior constraints (such as spatial continuity or smoothness). The model is solved under the condition of satisfying physical rationality to obtain the ambient illumination distribution results for each display zone. Furthermore, based on the illumination distribution results and a preset spatial mapping relationship, the brightness adjustment requirements of each area of ​​the display panel under the current illumination environment are determined, and corresponding control signals are generated to drive the brightness control unit to perform zoned brightness adjustment, thereby improving display quality or visual contrast.

[0082] In one embodiment, the display device is a liquid crystal display device with local dimming function, such as a transflective display. In this case, the brightness control unit is the partition driving unit of the backlight module, which achieves targeted local brightness compensation by mapping the reconstructed two-dimensional illumination distribution to the backlight partitions. The sensor array is disposed in the bezel area of ​​the display panel, and its photosensitive surface is coupled to the lateral light emission path of the display panel to receive light signals reflected from the surface of the display panel and transmitted through the interior of the panel to the edge.

[0083] In the process of constructing the system model, sensitivity feature information used to describe differences in light transmission is introduced into the coding modulation logic to form a comprehensive model that includes physical transmission characteristics, so as to accurately characterize the mapping relationship between the display partition state and the sensor response. The coding modulation logic aims to improve the distinguishability of the optical responses of different display partitions; in a preferred embodiment, the coding logic satisfies low correlation, non-correlation, or orthogonality conditions in an algebraic or statistical sense, for example, by using orthogonal basis or pseudo-random sequence, to reduce the coupling degree between the responses of different partitions, thereby improving the accuracy and numerical stability of the illumination distribution reconstruction.

[0084] In one alternative embodiment, a data-driven learning model (such as a neural network) can be introduced to accelerate or approximate the solution process of the above physical model, constructing a direct mapping from observation data to illumination distribution; in another alternative embodiment, the independence of the data of each channel in the sensor array can be preserved, and multi-channel joint analysis or joint reconstruction algorithms can be used to further improve the accuracy of illumination distribution reconstruction by utilizing spatial diversity information.

[0085] A screen illumination distribution reconstruction system includes: a display panel for displaying images, the display area of ​​which is logically divided into multiple display zones; an edge sensor array disposed on the border area or side of the display panel for collecting ambient light signals reflected from the surface of the display panel and transmitted to the edge; a control and acquisition module for controlling each display zone of the display panel to be in a preset encoding modulation state and synchronously triggering the edge sensor array to collect light intensity data; a memory for storing program code and calibration information and system model parameters characterizing the light transmission relationship between the display zones and the sensors; and a processor connected to the display panel, the edge sensor array, the control and acquisition module, and the memory, configured to execute the program code to implement the screen illumination distribution reconstruction method.

[0086] The control and acquisition module includes a display driver unit and a sensor acquisition unit, which are used to output encoded display signals and read sensor data, respectively; the two can be integrated on the same processing chip, or implemented collaboratively by multiple processing units that communicate with each other.

[0087] A display device includes the aforementioned screen illumination distribution reconstruction system; the display device is equipped with a brightness adjustment mechanism, which can perform partitioned brightness compensation or adaptive adjustment of the display area according to the reconstructed screen illumination distribution results, so as to improve the display effect under complex lighting conditions.

[0088] This invention provides a screen illumination distribution reconstruction system, the overall structure of which is as follows: Figure 1As shown, it mainly includes: a display panel 101, an edge sensor array 102 disposed in its border area, a control and acquisition module 103, a data processing module 104, and a display light source adjustment unit 105 (e.g., a backlight module or a pixel-level brightness controller). The data processing module 104 is used to execute program logic related to illumination distribution reconstruction and zone brightness adjustment; the display light source adjustment unit 105 is used to adjust the zone brightness of the display area according to control commands.

[0089] The display area of ​​the display panel 101 is logically divided into multiple display zones. During the encoding and measurement phase, the display zones exhibit corresponding brightness modulation states according to preset encoding logic to achieve spatial modulation of reflected ambient light. For display devices with local dimming capabilities, there is a preset spatial mapping relationship between the display zones and the control zones of the display light source adjustment unit, so as to convert the reconstructed display zone illumination distribution results into light source adjustment commands.

[0090] The edge sensor array 102 is arranged in the peripheral area of ​​the display panel 101 (such as inside the bezel or on the side) and includes several photoelectric sensing units. The sensing units are coupled to the lateral light emission path of the display panel and are used to receive light signals reflected from the surface of the display panel and transmitted to the edge via the interior of the panel.

[0091] The control and acquisition module 103 includes a display driving unit and a sensor acquisition unit. The display driving unit outputs coded modulation signals to the display panel 101 through a display interface and controls the switching timing of the coded state. The sensor acquisition unit is connected to the edge sensor array 102 via a communication link and reads the response data of each sensor unit when it receives an acquisition trigger command. In one embodiment, the display driving unit and the sensor acquisition unit can be integrated into the same control chip, or synchronous control can be achieved through cooperative communication.

[0092] The hardware architecture of the display driving unit and sensor acquisition unit is flexible. They can be implemented separately by independent control circuits (such as discrete control boards or external modules) that communicate with each other, or they can be highly integrated into the same processing chip, system-on-a-chip (SoC), or main control circuit to meet the differentiated requirements of different terminal devices for system integration and cost. This invention does not limit the specific physical implementation of the above functional units. System calibration and model construction: Under controlled illumination, by controlling the display partition to be in a preset calibration state combination and synchronously acquiring sensor data, physical response sensitivity characteristic information is established to characterize the optical transmission relationship between the display partition and the edge sensor. Based on this information, the data is analyzed to extract sensitivity characteristics used to characterize the spatial differences in optical transmission efficiency. These sensitivity characteristics are then introduced into the coded imaging logic to construct a system model describing the comprehensive mapping relationship between the ambient illuminance of the display partition and the sensor observation data. The system model comprehensively considers the influence of the spatial location of the display partition, optical path attenuation, and coding modulation method on the observation data.

[0093] In different embodiments, the encoding modulation state can be configured according to actual needs. For example, discrete encoding with binary contrast (such as black / white state) can be used, or multi-level encoding state including intermediate gray levels can be used. By incorporating the optical response under different encoding states into a unified modeling process, the system can effectively adapt to the nonlinear display characteristics of the display panel, reducing model complexity while ensuring the reconstruction accuracy of the illumination distribution.

[0094] Data processing and ensemble construction: The acquired optical response data undergoes combined operations and signal processing (e.g., differential processing or weighted fusion) to suppress interference from ambient background light and random noise, thereby extracting high signal-to-noise ratio features related to the illuminance distribution of the display zones. Subsequently, the processed observation data is aggregated to form a measurement dataset, which is then used as input to the reconstruction model to achieve robust reconstruction without requiring precise modeling of absolute ambient light intensity.

[0095] Illumination Distribution Reconstruction and Brightness Adjustment: Using the measurement data set and system model as input, a reconstruction model is constructed, incorporating data fidelity constraints and spatial prior constraints. A numerical optimization algorithm is used to solve the model while satisfying physical rationality, obtaining the two-dimensional ambient illumination distribution results on the screen surface. Based on these illumination distribution results, the illuminance differences in different areas of the screen are identified. Combining this with the brightness adjustment characteristics of the display device, brightness control commands are generated for different display zones, driving the display light source to perform zoned brightness compensation. This maintains consistent visual contrast and optimizes power consumption under complex lighting conditions.

[0096] In some implementations, the observation data can retain independent information from multiple optical sensing channels, and the illumination distribution can be jointly analyzed or reconstructed based on a system model containing multi-channel observation information, thereby further improving the reconstruction accuracy and stability while allowing for increased computational complexity.

[0097] The embodiments described above are merely illustrative of the technical solutions of the present invention and are not intended to limit the invention. Those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features, without departing from the spirit and scope of the invention. For example, the specific number or arrangement of display partitions and sensor arrays, the specific implementation of the encoding and modulation logic, and the solution strategy for the reconstruction model can all be adjusted according to the actual application scenario. These modifications or equivalent substitutions do not cause the essence of the corresponding technical solutions to depart from the spirit and scope of the present invention, and should all fall within the scope of protection claimed by the present invention.

Claims

1. A method for reconstructing screen illumination distribution, characterized in that: Specifically, the steps include the following: S1. Divide the display area of ​​the display panel into multiple display zones, control the combination display of the display zones under different display states, and use a sensor array arranged on the edge of the display panel to collect corresponding optical response data to construct a physical response model to characterize the light transmission relationship between the display zones and the sensor array. S2. Based on the physical response model, feature extraction processing is performed on the light transmission differences between different display partitions and the sensor array to obtain sensitivity feature information for characterizing the optical response differences of each display partition; S3. Generate encoded information for modulating the display state of the display partitions based on the number of display partitions, and combine it with the sensitivity feature information to construct a system model for describing the overall optical response relationship between the display partitions and the sensor array; S4. Based on the encoded information, control the display panel to operate in at least two different display states and collect corresponding optical response data. By combining and processing the optical response data, observation data for illumination distribution reconstruction is formed. S5. Based on the observation data and the system model, construct an optimization model that includes data consistency constraints and spatial prior constraints. Solve the optimization model under non-negative constraints to obtain the illumination distribution results representing the ambient light intensity of each display partition. Reshape the illumination distribution results into a two-dimensional illumination distribution map corresponding to the display partition. S6. Based on the two-dimensional illumination distribution map, identify the shadow and highlight areas of the display panel, and establish the corresponding relationship between the display partition and the brightness control unit according to the illuminance of each display partition. Combining the optical reflection and transmission characteristics of the display panel, calculate the supplementary brightness required to maintain the preset visual contrast under the current ambient light, and then generate the target brightness compensation amount of each brightness control unit, and control the brightness control unit to perform partition brightness adjustment.

2. The screen illumination distribution reconstruction method according to claim 1, characterized in that: In step S1, the combination display of the display partitions under different display states and the acquisition of corresponding optical response data by a sensor array arranged on the edge of the display panel are specifically as follows: each display partition is set to a high brightness state in sequence, and the rest are set to a low brightness or constant state, and the corresponding multi-channel light intensity readings are acquired by a sensor array arranged on the edge of the display panel; the sensor array includes ambient light sensors evenly distributed on the four edges of the display panel, and the ambient light sensors are arranged on the side light emission path facing the display panel. The light emission path includes the side of the light guide component, the side of the encapsulation layer of the display panel, or the side of the substrate, and is used to receive light signals reflected from the surface of the display panel and transmitted to the edge of the display panel.

3. The screen illumination distribution reconstruction method according to claim 1, characterized in that: In step S3, the encoded information satisfies the conditions of orthogonality, approximate orthogonality, or statistical independence in order to minimize the correlation interference between the optical responses of different display zones.

4. The screen illumination distribution reconstruction method according to claim 1, characterized in that: In step S3, the system model is established based on the light emission characteristics of the display partition and the response characteristics of the sensor to the light signals of different partitions. The specific construction process is as follows: the light emission characteristic information used to characterize the differences in light transmission of the display partition is introduced into the coding modulation logic, and a comprehensive mapping relationship between the ambient light intensity of the display partition and the response of the sensor array is established, thereby forming a system model.

5. The screen illumination distribution reconstruction method according to claim 1, characterized in that, The specific details of step S4 are as follows: The system controls the display panel to switch between at least two contrasting display states based on the encoded information, and synchronously triggers the sensor array to collect optical response data. The system then processes the collected raw data to generate high signal-to-noise ratio observation data for illumination distribution reconstruction. The step of generating observation data includes: fusing the multi-channel optical response data collected by the sensor array to obtain the measurement results corresponding to the current encoding display mode; The observation data is a vector or set of data formed by combining multiple measurement results, and its dimensional form is determined according to the measurement method and system configuration.

6. The screen illumination distribution reconstruction method according to claim 5, characterized in that, During the measurement process, optical response data corresponding to the same coded display mode were collected multiple times, and the results of the multiple collections were fused through statistical processing. Based on the fusion results obtained under different display states, observation data for subsequent illumination distribution reconstruction was generated.

7. A screen illumination distribution reconstruction system, characterized in that, include: The display panel is used to display images, and its display area is divided into multiple display zones; An edge sensor array is disposed in the bezel area of ​​the display panel to collect ambient light signals reflected from the surface of the display panel and transmitted to the edge of the display panel; The control and acquisition module is used to control the display panel to display preset coded patterns on each display zone and to trigger the edge sensor array to acquire light intensity data. The memory is used to store program code as well as model parameters and calibration information for illumination distribution reconstruction; A processor is connected to the display panel, the edge sensor array, the control and acquisition module, and the memory. The processor is configured to execute the program code to implement the screen illumination distribution reconstruction method according to any one of claims 1 to 6. When the illumination distribution reconstruction system is used in conjunction with a brightness control unit having a zone brightness adjustment function, a spatial correspondence is pre-established between the display zones and the brightness control unit having the zone brightness adjustment function, so that the reconstructed illuminance of each display zone is mapped to the target brightness compensation amount of each brightness control unit.

8. A screen illumination distribution reconstruction system according to claim 7, characterized in that, The control and acquisition module includes: a display driving unit for outputting coded modulation signals to the display panel through a display interface; and a sensor acquisition unit for connecting to the edge sensor array via a communication link and reading the response data of each sensor. The display driving unit and the sensor acquisition unit are integrated in the same control circuit or are implemented collaboratively by multiple processing units that communicate with each other.

9. A display device, characterized in that, The system includes the screen illumination distribution reconstruction system as described in claim 7 or 8; the display device is equipped with a brightness adjustment mechanism for performing zoned brightness compensation or adjustment of the display light source based on the reconstructed screen illumination distribution results.

Images