Adjustable spectrum-based liquid crystal display system and control method thereof

Abstract

The invention provides an adjustable spectrum-based liquid crystal display system and a control method thereof, relates to the technical field of display systems, and aims to overcome the limitations of poor environmental adaptability, easiness in causing visual fatigue, single user experience and the like of an existing display. The system creatively integrates a liquid crystal panel, a high-precision multi-main-color Micro-LED backlight, a pixel inner sensing array, an external multi-mode sensing module, a dynamic addressable micro-optical array, a dynamic polarization modulation layer and an optional transparent energy collection layer. The intelligent controller carries out fusion processing on the real-time biological state, environment information and application context data of the user obtained by the multi-source sensor, and carries out accurate state evaluation and future trend prediction. And determining an optimal space-time-direction-spectrum-polarized light field output characteristic and an intelligent energy management strategy through a multi-objective optimization decision engine, and driving each optical regulation and control component to execute in real time. The visual comfort and health level are remarkably improved, and the information fidelity and task performance in a complex environment are ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of display systems, and specifically to a tunable spectrum liquid crystal display system and its control method. Background Art

[0002] Existing display technologies mainly include liquid crystal display (LCD) and organic light-emitting diode (OLED) display, etc., and have been widely used in various electronic devices. Traditional LCDs usually rely on a backlight source (such as an LED) with relatively fixed spectral output characteristics, and generate colors through a color filter array. Its brightness and contrast can be adjusted by the light transmittance of liquid crystal cells. OLED displays directly generate light and colors through self-luminous pixel points.

[0003] Some adaptive adjustment functions have emerged in the prior art. For example, many devices are equipped with ambient light sensors that can automatically adjust the screen brightness according to the ambient brightness. Some systems provide a "night shift mode" or a "reading mode", which adapt to night use or text reading scenarios by reducing the blue light component or adjusting the color temperature, but this usually comes at the cost of color accuracy. These existing adaptive technologies have significant limitations. The spectral output is static or can only be adjusted very limitedly and non-refinedly, and cannot be optimized according to the display content, the complex and variable ambient light spectral characteristics, specific task requirements, and the crucial individual differences of users. The existing adjustment mechanisms lack true personalization and adopt a "one-size-fits-all" mode, ignoring the huge differences among different users in visual perception, color vision sensitivity, fatigue accumulation speed, and real-time physiological and cognitive states. Most adaptive adjustments are passive and reactive, mainly responding to changes in ambient brightness, and cannot actively perceive and respond to internal factors such as the user's visual comfort, attention level, and fatigue state, let alone perform predictive adjustments. Summary of the Invention

[0004] Technical Problems to be Solved

[0005] Aiming at the deficiencies of the prior art, the present invention provides a tunable spectrum liquid crystal display system and its control method, which solve the following problems:

[0006] 1. How to overcome the problem that traditional displays cannot dynamically, finely, and multi-dimensionally adjust their light field output characteristics according to the user's real-time, individualized physiological state, cognitive needs, visual preferences, combined with accurate environmental perception information and specific application task contexts, so as to provide a truly customized visual experience.

[0007] Technical Solutions

[0008] To achieve the above object, the present invention is realized by the following technical solutions: Based on an adjustable spectral liquid crystal display system, characterized in that: the display system includes:

[0009] A display panel layer: for image display; the display panel layer includes the following parts:

[0010] A backlight module, disposed on the back of the display panel layer, including a plurality of independently controllable light-emitting unit arrays, and the light-emitting unit arrays include at least three different primary color light-emitting units;

[0011] An integrated sensing array, integrated or interleaved with the pixel structure of the display panel layer, and the integrated sensing array includes a plurality of sensor units for detecting at least one physical quantity related to the position of the pixel structure;

[0012] A dynamic addressable micro-optical array, disposed in the optical path, configured to spatially addressably change the direction or angular distribution of light passing through it;

[0013] A dynamic polarization modulation layer, disposed in the optical path, configured to spatially addressably change the polarization state of light passing through it;

[0014] An integrated transparent energy harvesting layer, disposed in the stack structure of the display system for harvesting ambient light energy;

[0015] A modality sensing module, configured to obtain at least one external environmental data and / or at least one user-related biometric information;

[0016] An intelligent controller, electrically connected to the backlight module, the integrated sensing array, the dynamic addressable micro-optical array, the dynamic polarization modulation layer, the energy harvesting layer, and the modality sensing module: fusing and processing data from the integrated sensing array, the modality sensing module, and the energy harvesting layer, and combining application context information to evaluate or predict the user state, environmental state, and system energy state;

[0017] Based on the evaluated or predicted state, determining the target space-time, direction, spectrum, polarization, output characteristics, and energy management strategy; and generating control signals to respectively drive the backlight module, the dynamic addressable micro-optical array, the dynamic polarization modulation layer, and execute the energy management strategy, so that the display system generates a light output that meets the target spatio-directional-spectral-polarization output characteristics and optimizes energy use.

[0018] Preferably, the integrated sensing array includes at least one of the following: a micro-optical sensor, a micro-temperature sensor, a micro-capacitance sensor, or a micro-biopotential sensor.

[0019] Preferably, the dynamically addressable micro-optical array includes a liquid crystal lens array, a micro-electro-mechanical system micro-mirror array, or an adjustable optical metasurface array.

[0020] Preferably, the intelligent controller is configured to drive the dynamically addressable micro-optical array to direct light mainly to the user's viewing point based on the user's viewing point position information obtained by the modality perception module.

[0021] Preferably, the intelligent controller is configured to dynamically adjust at least one parameter (including brightness or spectral strategy) in the spatio-temporal-direction-spectral-polarization output characteristics of the target and / or adjust the energy distribution based on the energy harvesting data obtained from the integrated transparent energy harvesting layer.

[0022] Preferably, the intelligent controller is configured to execute a prediction model that predicts the future trends of the user's state (including fatigue level, attention level) based on historical user data, fused real-time sensor data, and application context, and the intelligent controller is also configured to execute data security and privacy protection protocols.

[0023] Preferably, the control method includes the following steps:

[0024] Sp1. Data acquisition and fusion: Collect multi-source data from the integrated sensing array, the modality perception module, and the energy harvesting layer, obtain application context information, and preprocess and fuse the collected multi-source heterogeneous data;

[0025] Sp2. State evaluation and prediction: Evaluate or predict the user's state (including visual comfort, attention, emotion, etc.), the environmental state (including lighting, spatial layout), and the system energy state based on the fused data;

[0026] Sp3. Target determination: Determine the target spatio-temporal-direction-spectral-polarization output characteristic parameters (including intensity, color point, polarization state, direction / angle distribution, etc.) and the corresponding energy management strategy based on the evaluated or predicted state, user preferences, and the current operation mode;

[0027] Sp4. Control signal generation and execution: Generate driving instructions to control the backlight module, the dynamically addressable micro-optical array, and the dynamic polarization modulation layer respectively to achieve the spatio-temporal-direction-spectral-polarization output of the target, and control the energy flow according to the energy management strategy;

[0028] Sp5. Calibration and personalized learning: Execute the initial user calibration program, and use the data during operation and user feedback to continuously update the user model, prediction model, and control strategy through a self-learning mechanism.

[0029] Preferably, the data acquisition and fusion step includes: performing weighted fusion on the pixel-level data (including local light intensity, temperature) from the integrated sensing array and the data (including global ambient light, eye tracking, facial expression) from the modality perception module.

[0030] Preferably, the target determination step includes: calculating the target direction parameter of the dynamic addressable micro-optical array based on the user's viewpoint position determined by eye tracking to optimize the light projection efficiency or achieve privacy protection.

[0031] Preferably, the target determination step includes:

[0032] Sp3.1: Adjusting the display parameters based on the user's reflected light or near-field sensing signal detected from the integrated sensing array to optimize the near-field viewing experience or achieve gesture interaction;

[0033] Sp3.2: Adjusting parameters such as peak brightness, color gamut range, or refresh rate to maximize energy efficiency according to the energy management strategy while ensuring basic visual needs.

[0034] Beneficial effects

[0035] The present invention provides an adjustable spectrum liquid crystal display system and its control method, having the following beneficial effects:

[0036] 1. By the collaborative work of the high-precision multi-primary color Micro-LED array, the dynamic addressable micro-optical array, and the dynamic polarization modulation layer, the present invention realizes the fine, independent, and real-time control ability of the light field in multiple dimensions of "space-time - direction - spectrum - polarization". Combining the ultra-local environment and reflected light information provided by the in-pixel integrated sensing array, it ensures that under various complex ambient light conditions and for specific task requirements, the most optimized visual information presentation can be provided. This not only means achieving color accuracy, grayscale fidelity, and contrast performance beyond existing standards, but also actively eliminating ambient glare interference, accurately projecting light according to the user's viewpoint to maximize the perception effect, and even realizing high-quality glasses-free 3D display or hardware-level privacy protection. This all-round and active light field optimization ability ensures the maximum fidelity and readability of key information, significantly superior to traditional display technologies that can only perform passive adaptation or limited-dimensional control.

[0037] 2. The present invention significantly enhances the comprehensive utility and sustainability of display devices by systematically integrating integrated transparent energy harvesting technology with intelligent energy management strategies and enabling novel near-field non-contact interactions using integrated sensors. The combination of energy harvesting and intelligent power consumption optimization strategies can effectively reduce the device's energy consumption while ensuring excellent display performance, extending the battery life of mobile devices or reducing the usage cost of fixed devices. The possibilities of near-field gesture interaction brought about by the sensing function embedded in the display panel further enrich the dimension of human-computer interaction and improve the operation convenience. This design that deeply integrates energy management, new interaction methods with the core display function makes the display system of this solution no longer just a passive output device, but a more intelligent, efficient, and functionally integrated information interaction platform.

[0038] 3. The present invention realizes an unprecedented depth of personalized visual experience and health care by introducing real-time, multi-modal user biometric information perception and incorporating it into the closed-loop feedback of display control. Different from the prior art that mainly relies on ambient light or preset modes for limited adjustments, this solution can precisely and dynamically match the display output with the immediate visual comfort, attention level, fatigue state, and even emotional state of a specific user, and can intervene in advance based on a prediction model, thereby greatly reducing visual fatigue caused by long-term use while ensuring information acquisition efficiency, improving the overall well-being of users, and elevating the display device from a mere information presentation tool to an intelligent interaction interface that can actively care about the physical and mental health of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 is the system architecture diagram of the present invention;

[0040] Figure 2 is the working flowchart of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0041] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention. Specific Embodiment 1:

[0043] As Figures 1 to 2 shown, based on an adjustable spectral liquid crystal display system, which is characterized in that: the display system includes:

[0044] A display panel layer: for image display; the display panel layer includes the following parts:

[0045] A backlight module is disposed on the back of the display panel layer and includes a plurality of independently controllable light-emitting unit arrays. The light-emitting unit arrays include light-emitting units of at least three different primary colors.

[0046] An integrated sensing array is integrated or interleaved with the pixel structure of the display panel layer. The integrated sensing array includes a plurality of sensor units for detecting at least one physical quantity related to the position of the pixel structure. The integrated sensing array includes at least one of the following: a micro-optical sensor, a micro-temperature sensor, a micro-capacitive sensor, or a micro-biopotential sensor. The integrated sensing array achieves high-resolution and multi-modal sensing closely corresponding to the display pixel positions within the display area, obtaining ultra-local ambient light information, user reflected light information, temperature distribution, and short-range interaction signals. This array is not an independent layer but is directly integrated on the TFT backplane of the display panel through a semiconductor thin-film process (similar to the TFT manufacturing process). The sensor units (such as photodiodes, thermistors, capacitive sensing plates, etc.) are designed to be in a small size and are arranged in an interleaved manner or integrated in the non-light-emitting area of the same pixel unit with the thin-film transistors (TFTs), pixel electrodes, scan lines, data lines, etc. that make up the display pixels (the area covered by the black matrix or the gap between sub-pixels). The electrodes of the sensors are connected to a dedicated readout circuit through the metal wiring layer on the backplane and also include specific semiconductor layers (such as amorphous silicon, oxide semiconductors for photodiodes or the TFT itself as a sensor), dielectric layers (for capacitive sensing), or resistive material layers (for thermistors) according to the sensor type.

[0047] Photoelectric sensing: The internal photodiode generates photocurrent or photovoltage under the irradiation of photons (ambient light or user reflected light). The controller activates the corresponding sensors at specific row / column lines and reads their signal intensities.

[0048] Temperature sensing: The resistance value of the thermistor unit changes with temperature. The controller obtains the local temperature by measuring its resistance value (or measuring its voltage through a constant current source).

[0049] Capacitive sensing: The capacitive sensing plate and the driving electrode form a micro-capacitor. When a user's finger or other object approaches, it will change the dielectric constant or coupling capacitance of the capacitor. The controller determines the proximity or performs gesture recognition by detecting the change in the capacitance value.

[0050] Biopotential sensing: A pair of microelectrodes (requiring a reference electrode) detects near-field bioelectrical signals (including weak body surface signals of electrocardiogram ECG and electromyogram EMG, or auxiliary electrodes for electroencephalogram EEG interfaces), and a high-gain and low-noise amplification circuit is required.

[0051] The addressing and readout of the sensor are usually coordinated with the driving timing of the display pixels. Sensor readout can be performed during the frame blanking period or by line / frame interleaving to avoid interfering with the display, the sensor readout driving IC, or integrating the readout circuit into the panel driving IC or timing controller. The controller activates all or part of the sensors as needed to obtain a sensing image with the required resolution.

[0052] The density of the sensor units can be comparable to or slightly lower than the display pixel density. One sensor group is shared by every 4x4 pixels. The response speed of the sensor needs to be fast enough to capture dynamic changes, including light flicker and gestures. Since the signals are weak and vulnerable to display driving signal interference, optimized circuit designs and signal processing algorithms are required to improve the signal-to-noise ratio. The integration of the sensor will sacrifice a part of the display aperture ratio, which needs to be alleviated by optimizing the layout, including placing it in the non-emitting area or using transparent sensor materials. Calibration of the uniformity and response characteristics of the sensor array is required.

[0053] The dynamically addressable micro-optical array is set in the optical path and is configured to spatially addressably change the direction or angular distribution of the light passing through it; the dynamically addressable micro-optical array actively and finely controls the propagation direction, divergence angle, or focus of the light leaving the display panel at the pixel level or regional level to achieve light field control. A liquid crystal material is filled between two substrates with transparent conductive electrodes (ITO or the like). One or both of the electrodes are patterned into tiny, independently addressable lens-like patterns (such as circular, Fresnel zone plate-like) or pixelated electrode arrays. An alignment layer is usually required. It is usually located between the Micro-LED backlight and the polarization modulation layer / liquid crystal panel, or as a component of the liquid crystal panel. The MEMS micro-mirror array structure: A large number of micron-scale mirrors that can be tilted or translated by electrostatic drive are fabricated on a silicon substrate. Each mirror can be independently controlled and is placed between the backlight and the light guide / diffusion structure, or a relay optical system is required.

[0054] The tunable optical metasurface array constructs a two-dimensional array composed of sub-wavelength-sized nanostructures (nanopillars, nanopores) on a substrate. The geometric shape, material, and arrangement of these structures determine their ability to control the light wavefront (phase, amplitude, polarization). By applying an external field (electric field, using integrated liquid crystal or electro-optic materials), the optical response of the meta-atoms is changed, thereby dynamically controlling the light direction. The integration position is on the surface of the Micro-LED chip, the color filter layer, etc.

[0055] By changing the voltage applied to the lens electrodes, the orientation of the liquid crystal molecules is changed, thereby changing its effective refractive index distribution, forming a variable focal length or variable deflection angle microlens effect. By changing the voltage applied to the micromirror drive electrodes, the tilt angle of the mirror surface (usually two-axis or one-axis) is precisely controlled, thereby changing the direction of the reflected light. By applying an electric field to change the optical response (phase delay gradient) of the metasurface unit, the direction of the transmitted or reflected light wavefront is dynamically changed. An independent driving matrix (TFT active matrix or dedicated driving IC) is required to address each micro-optical unit in the array and apply control voltages / signals. The controller calculates the required control states (voltages, tilt angles, phase delays, etc.) for each micro-optical unit based on the target light direction distribution (output from algorithms such as view point tracking, privacy mode, light field rendering, etc.) and sends them to the driver.

[0056] The dynamic polarization modulation layer is disposed in the optical path and is configured to spatially addressably change the polarization state of the light passing through it. The dynamically addressable micro-optical array includes a liquid crystal lens array, a micro-electromechanical system micromirror array, or an adjustable optical metasurface array; the dynamic polarization modulation layer actively and finely controls the polarization state (polarization direction, ellipticity, optical rotation) of the light leaving the display panel at the pixel level or region level.

[0057] The additional liquid crystal layer uses a fast-response π-cell and a bistable mode that can precisely control the phase delay, which is specifically used for polarization regulation. An independent TFT backplane drive is required.

[0058] The electro-optic polymer film is an organic polymer film with an electro-optic effect. An electric field is applied to change the birefringence, and it is addressed through a patterned transparent electrode.

[0059] The polarization regulation metasurface is based on metasurface technology. The meta-atom structure is designed so that it can efficiently change the polarization state of the transmitted or reflected light (rotate the linear polarization angle, convert linear polarization to circular polarization) under electric field regulation.

[0060] The LC layer changes the effective optical axis orientation or birefringence of the liquid crystal molecules by applying a voltage, thereby changing the phase delay of the passing light and achieving control of the polarization state. Combining with an input polarizer realizes polarization rotation or phase modulation.

[0061] The electro-optic polymer directly changes the birefringence of the material by applying an electric field to control the polarization state.

[0062] The metasurface changes the resonance or coupling characteristics of the meta-atoms by applying an electric field, resulting in different responses to different polarization components and achieving polarization regulation.

[0063] It is achieved through the TFT backplane or cross - matrix electrodes. The controller calculates the control voltage required for each unit according to the target polarization state and sends it to the driver. The original data comes from the data obtained by supporting sensors such as glare elimination algorithms, 3D display requirements, and contrast enhancement logic.

[0064] An integrated transparent energy - harvesting layer is set in the stack structure of the display system for harvesting ambient light energy. The integrated transparent energy - harvesting layer is an innovative technology that combines photovoltaic power generation with optical transparency characteristics. It aims to improve the overall energy efficiency of the system by capturing ambient light energy while maintaining compatibility with display devices. Its core consists of a thin film of transparent photovoltaic material. The materials include donor - acceptor blend systems in organic photovoltaic materials or perovskite materials with tunable bandgaps. Through bandgap engineering design, while retaining more than 70% visible light transmittance, it preferentially absorbs ultraviolet and near - infrared spectral energy to complete photoelectric conversion. The device uses double - transparent conductive electrodes to construct a charge - transport channel. The electrode materials need to balance light transmittance and conductivity. The technical routes cover metal oxides such as indium tin oxide and doped zinc oxide, as well as nanomaterials such as silver nanowires, carbon nanotubes, and graphene. An internal built - in electric field for driving carrier separation is formed through the work - function difference between the upper and lower electrodes. To ensure material stability, the system is equipped with a multi - layer composite encapsulation structure, using polymers and inorganic thin films to block water and oxygen erosion, and improving the device life to the level of thousands of hours.

[0065] At the physical integration level, this layer is deployed in the light - path insensitive area of the display module, such as being embedded between the touch panel and the cover glass, or combined with internal components such as the color filter substrate. Its spatial layout needs to be optimized through optical simulation to minimize interference with display brightness, color gamut, and viewing - angle characteristics. In terms of the working mechanism, the photovoltaic material mainly absorbs the ultraviolet band of 300 - 400 nanometers and the near - infrared band of 700 - 1100 nanometers that are not utilized by the display system. Electron - hole pairs are excited through the heterojunction interface and form a directional current under the guidance of the energy - level gradient. The generated DC electrical energy is transmitted to the power - management integrated circuit through an embedded conductive grid. This chip integrates a maximum - power - point - tracking algorithm, which can adjust the load impedance in real - time to match the light - intensity fluctuations, ensuring dynamic optimization of the energy - extraction efficiency. At the same time, the chip has a multi - power - source coordination function, which can distribute the energy to directly supply power to the display backlight, buffer battery energy storage, or output electrical energy through a standard interface according to the system load requirements. The main controller monitors the power generation power and energy - storage status in real - time through the bus protocol, providing data support for dynamically adjusting the display power - consumption strategy. This technology breaks through the application limitations of traditional photovoltaic modules, provides a sustainable auxiliary power - supply solution for mobile terminals, wearable devices, and Internet - of - Things nodes, and promotes the evolution of self - powered electronic systems towards higher energy efficiency and environmental adaptability.

[0066] A modality perception module, configured to acquire at least one piece of external environment data and / or at least one piece of user-related biometric information; determine a target spatio-temporal, direction, spectrum, polarization, output characteristic, and energy management strategy based on an evaluated or predicted state; and generate a control signal to drive a backlight module, a dynamically addressable micro-optical array, and a dynamic polarization modulation layer respectively, and execute the energy management strategy, so that the display system generates a light output conforming to the target spatio-temporal-direction-spectrum-polarization output characteristic and optimizes energy usage;

[0067] An intelligent controller, electrically connected to the backlight module, the integrated sensing array, the dynamically addressable micro-optical array, the dynamic polarization modulation layer, the energy harvesting layer, and the modality perception module: fuses and processes data from the integrated sensing array, the modality perception module, and the energy harvesting layer, and combines application context information to evaluate or predict the user state, the environmental state, and the system energy state. The intelligent controller is configured to execute a prediction model, which predicts the future trends of the user state (including fatigue level, attention level) based on historical user data, the fused real-time sensor data, and the application context. The intelligent controller is also configured to execute data security and privacy protection protocols. The intelligent controller is configured to drive the dynamically addressable micro-optical array to direct light mainly to the user's viewing point based on the user's viewing point position information acquired by the modality perception module. The intelligent controller is configured to dynamically adjust at least one parameter (including brightness or spectrum strategy) in the target spatio-temporal-direction-spectrum-polarization output characteristic and / or adjust the energy distribution based on the energy harvesting data acquired from the integrated transparent energy harvesting layer. As the core of the multi-dimensional light field control system, the intelligent controller realizes the coordinated optimization of the spatio-temporal, direction, spectrum, polarization (SDSP), and energy of light through a highly integrated sensing-decision-execution architecture. The system relies on a multi-million pixel multi-modal sensing array to process multi-source heterogeneous data streams such as light intensity maps, temperature maps, and capacitance maps in real time, extracts features such as local high-light regions, temperature hotspots, and gesture patterns after noise reduction and calibration, constructs an ultra-high resolution illumination map through the fusion of pixel-level light intensity data and a global ambient light sensor, and provides a sub-millimeter-level regulation basis for the local brightness compensation of the micro-optical array. At the same time, the reflection light intensity is used to determine the user's presence and estimate the viewing distance, the non-contact gesture interaction is analyzed by combining the capacitance sensing map, and pixel-level thermal management is implemented based on the temperature map to prevent local overheating and material property drift.

[0068] The control algorithm of the dynamic micro-optical array is based on real-time eye movement tracking data. By combining the screen geometry and the user's viewing distance, it calculates the light emission angle of each pixel, and through a precise light field rendering algorithm, converges the light rays on the user's pupil, achieving viewing angle limitation in the privacy mode and viewing angle content distribution in the multi-user scenario while improving the light efficiency. The polarization modulation layer analyzes the polarization characteristics of the ambient light and models the reflection path to dynamically generate the polarization state distribution for glare elimination, cooperates with the LCD analyzer to optimize the contrast, and can switch between the spatial / temporal polarization modes to support 3D display. The energy harvesting layer works in coordination with the PMIC to dynamically adjust the display parameters according to the ambient light intensity, battery status, and system load, and intelligently switches between the energy-saving priority, performance priority, and balanced modes.

[0069] A multi-objective optimization engine is constructed. By integrating the prediction model of deep learning and the decision-making framework of reinforcement learning, it coordinates thousands of control variables in the SDSP parameter space in real time. The engine comprehensively considers user behavior prediction (including the gaze point migration trend), environmental state evolution (including the change of the ambient light dynamic range), application scenario requirements (including game / movie mode switching), and user preference settings, and generates a globally optimal regulation strategy under the millisecond-level time delay constraint, driving the synchronous adjustment of the deformation of the microlens array, liquid crystal polarization modulation, and the parameters of the light-emitting unit, and finally achieving the precise regulation of the multi-dimensional light field that conforms to the human eye visual characteristics, has strong environmental adaptability, and is highly energy-efficient. Specific Embodiment 2:

[0071] As Figures 1 to 2 shown, the control method includes the following steps:

[0072] Sp1, Data Acquisition and Fusion: Collect multi-source data from the integrated sensing array, the modality perception module, and the energy harvesting layer, and obtain application context information. Preprocess and fuse the collected multi-source heterogeneous data. The data acquisition and fusion steps include: performing weighted fusion on pixel-level data from the integrated sensing array (including local light intensity, temperature) and data from the modality perception module (including global ambient light, eye tracking, facial expressions); The system performs microscopic-level data acquisition through an integrated sensing array integrated or interleaved with the pixel structure of the display panel. This includes using the micro-optical sensor array therein to continuously obtain the extremely local ambient light intensity, preliminary spectral characteristics (such as simple color ratios), or more importantly, the user's reflected light pattern in each area of the screen. These reflected light patterns can reveal the precise distance between the user and the screen, the presence of obstacles, and even the approximate contour and position of the user's face or hand through specific algorithms; At the same time, use the integrated micro-temperature sensor array to draw a real-time temperature distribution map of the display panel surface; If a micro-capacitive sensor array is integrated, synchronously collect the capacitance change map on the panel surface to detect non-contact user gestures or object approaches at close range. Secondly, the system performs macroscopic and user biometric-level data acquisition through an external modality perception module. Use a spectral sensor to accurately measure the illuminance, color temperature, and complete spectral power distribution of the global ambient light, and possibly identify the direction of the main light source; Use an eye tracker to capture the user's real-time fixation point position, pupil diameter size and its dynamic changes, blink frequency, saccade pattern and speed, etc.; Use an image sensor (camera) combined with face recognition and expression analysis algorithms to obtain information such as the user's head pose, facial micro-expressions (inferring emotional state), and line of sight direction (assisting eye tracking); Receive deeper physiological signal streams (such as heart rate variability HRV, galvanic skin response GSR, specific frequency band energy of brain waves such as Alpha / Beta wave ratio, etc.) from wearable devices (such as smart watches) or brain-computer interface devices through a standard interface; At the same time, the system also monitors the user's explicit input commands. Thirdly, the system will continuously monitor the working state of the integrated transparent energy harvesting layer and collect the current generated voltage and current data to evaluate the real-time energy harvesting efficiency. Finally, the system obtains the current application context information through an interface with the operating system or application program, including the application program type of the active window (such as text editor, image browser, video player, game engine), specific characteristics of the displayed content (such as the proportion of text area, color histogram of images or videos, motion vector information), and the current state of the operating system (such as power mode, whether there are notifications, etc.).None of these raw data collected are used directly. Instead, they first go through a series of preprocessing steps, including time-domain or spatial-domain filtering for sensor noise, sensor response consistency and drift compensation based on factory calibration data, panel brightness and chromaticity uniformity correction, and feature extraction to convert the raw signals into meaningful eigenvalue (calculating volatility metrics from continuous pupil diameter data and emotion classification scores from facial feature point localization). In this preferred solution, data fusion is a key step. The system pays particular attention to effectively combining pixel-level data with high spatial resolution from the integrated sensing array (such as fine local light intensity maps, temperature maps) and global, high-dimensional data from the modal perception module (such as accurate global spectra, precise eye movement trajectories, rich facial expression information). This usually adopts a multi-scale fusion strategy or a weighted fusion algorithm, where the weight factors may be dynamically adjusted based on sensor confidence, data timeliness, current task context, etc., and finally generates a multi-dimensional feature vector that uniformly, comprehensively, and accurately describes the current user-environment-system interaction state, providing high-quality input for subsequent state assessment and prediction. During this process, the processing of user biometric information will strictly comply with the preset data security and privacy protection protocols, such as destroying the raw data after feature extraction or using technologies such as local computing and differential privacy.

[0073] Sp2, State Assessment and Prediction: Based on the fused data, assess or predict the user state (including visual comfort, attention, emotion, etc.), environmental state (including lighting, spatial layout), and system energy state. Based on the multi-dimensional feature vectors processed by Sp1 fusion, quantitatively evaluate the current user state, environmental state, and system energy state, and predict future trends. User state assessment aims to deeply understand the real-time feelings and needs of users, specifically including using eye-tracking data (such as pupil diameter fluctuations, blink frequency, saccade path complexity) combined with historical baselines and models to quantify the degree of user visual fatigue; analyzing the user's attention concentration level through fixation point distribution, duration, response to interference stimuli, etc.; inferring the user's emotional valence (positive / negative) and arousal level (excited / calm) by combining the results of facial expression analysis and physiological signals such as HRV. At the same time, evaluate ergonomic-related factors such as the user's viewing posture, distance, and angle based on camera and eye-tracking data. Environmental state assessment is committed to comprehensively depicting the physical environment where the display is located, including accurately describing the environmental lighting conditions, not only the overall brightness and color temperature, but also the details of the spectral power distribution, the position and intensity of the main light sources, whether there are potential strong glare sources and their characteristics (such as direction, polarization state), and the impact of the spatial layout on light reflection and acoustic environment perceived by depth sensors (if equipped) or other sensing information (such as sound). System energy state assessment involves calculating the current total instantaneous system power consumption, comparing the real-time power generation of the energy harvesting layer with system requirements, monitoring the battery level and health status of the internal battery (if any), and comprehensively predicting the short-term energy balance. Beyond the current state assessment, prediction is another core of this step. The system uses time series analysis models (such as ARIMA, LSTM, etc.) to process historical state data and current trends to predict the short-term evolution of the user state, predict the likelihood of a significant increase in fatigue within the next half hour based on the current reading duration and visual behavior patterns, or predict the risk of upcoming distraction based on the task type and attention metrics. Similarly, the system also predicts changes in the environmental state, such as predicting sudden environmental light changes caused by sunset or indoor light turning on based on time and geographical location information, or predicting possible fluctuations in the power generation of the energy harvesting layer in the next period of time. These prediction results enable subsequent control decisions to be more forward-looking, achieving active adaptation rather than passive response;

[0074] Sp3. Target determination: Based on the evaluated or predicted state, user preferences, and current operating mode, determine the target spatio-temporal-direction-spectral-polarization output characteristic parameters (including intensity, color point, polarization state, direction / angle distribution, etc.) and the corresponding energy management strategy. The target determination step includes: Based on the user's viewpoint position determined by eye tracking, calculate the target direction parameter of the dynamic addressable micro-optical array to optimize the light projection efficiency or achieve privacy protection. Receive the current and predicted user-environment-system state evaluation results from Sp2, and combine the personalized preferences stored in the user profile (preference ranges for brightness, color temperature, contrast, sensitivity thresholds for blue light or flicker, preset modes in specific scenarios) and the user's currently selected operating mode (such as reading mode, cinema mode, e-sports mode, energy-saving mode, anti-peeping mode, etc.). Through a complex multi-objective optimization decision engine, calculate the optimal display output characteristics and energy management strategy for the next moment or stage. Its core goal is to maximize the user's visual comfort and well-being while meeting the current task requirements, optimize the visual effect expressiveness, and at the same time take into account requirements such as energy efficiency and privacy protection. The decision engine needs to calculate a set of detailed target spatio-temporal-direction-spectral-polarization (SDSP) output characteristic parameters, which specifically define the target emission intensity, target color coordinates or spectral energy distribution, target main propagation direction or angle dispersion range of light, and target polarization state for each controllable unit (pixel or area) on the screen. For the spectral dimension, it may be necessary to adjust the peak intensity and wavelength of the blue light band to match the circadian rhythm or reduce visual fatigue; for the direction dimension, it is necessary to determine whether the light should converge on the user's pupil or diverge to cover a wider viewing angle. At the same time, this step also needs to determine the corresponding energy management strategy, such as setting an overall brightness upper limit, selectively turning off the backlight of non-gazed areas, or deciding the priority use of the electricity generated by the energy harvesting layer (supply the system, charge, or idle). In this preferred solution, the user's viewpoint position information determined by eye tracking is directly used to calculate the target direction parameter of the dynamic addressable micro-optical array. The controller will accurately calculate the light emission vector required for each area of the screen to reach the user's current or predicted pupil position, and accordingly set the deflection angle or focusing state of the corresponding unit of the micro-optical array, aiming to direct as much effective energy of the light as possible to the user's eyes, so as to achieve a higher perceived brightness at a lower overall power consumption, that is, optimize the light projection efficiency. In the privacy protection mode, this calculation will generate an extremely narrow directional light beam, strictly restricting the viewing area.In addition, the specific implementation of this step includes two refined sub-strategies: Sp3.1 clearly states that the system will use the user's reflected light pattern detected by the integrated sensing array (identifying a very close viewing distance) or the short-range sensing signal (gestures detected by the capacitive sensor) to dynamically fine-tune the display parameters locally or globally, so as to optimize the text clarity and image detail performance during close viewing, or enable the screen to respond to specific non-contact gesture interaction commands. Sp3.2, on the other hand, elaborates on how the energy management strategy is implemented, that is, according to the energy state evaluated by Sp2 and the current set energy-saving priority, while ensuring that the basic display quality required for core visual tasks (such as text recognition clarity and video smoothness) is not sacrificed, actively adjust the display parameters to maximize energy efficiency. This may include specific measures such as dynamically reducing the overall peak brightness, restricting the display color gamut range (selecting a more energy-efficient color rendering method), and intelligently reducing the refresh rate when the picture content changes little;

[0075] The target determination step includes:

[0076] Sp3.1. Adjust the display parameters based on the user's reflected light or short-range sensing signal detected by the integrated sensing array to optimize the close viewing experience or implement gesture interaction;

[0077] Sp3.2. According to the energy management strategy, adjust parameters such as peak brightness, color gamut range, or refresh rate to maximize energy efficiency while ensuring basic visual requirements;

[0078] Sp4, Control Signal Generation and Execution: Generate drive instructions to control the backlight module, the dynamic addressable micro-optical array, and the dynamic polarization modulation layer respectively to achieve the spatio-temporal-direction-spectral-polarization output of the target, and control the energy flow according to the energy management strategy, converting the abstract and high-level target SDSP parameters and energy strategy determined by Sp3 into specific low-level control instructions that can be understood and executed by the hardware driver. This conversion process involves complex calculations and look-up table operations. Based on the target intensity and color point, combined with the color coordinates, brightness response curves of each primary color Micro-LED in the backlight module, and the current calibration data, calculate the precise pulse width modulation (PWM) duty cycle or current value required to drive each Micro-LED unit. Similarly, according to the target direction parameters, calculate the control voltage or tilt angle signal required to drive each microlens or micro-mirror in the dynamic addressable micro-optical array. According to the target polarization state parameters, calculate the voltage signal required to drive the corresponding unit of the dynamic polarization modulation layer. This conversion process must consider the actual response characteristics of the hardware, cross-coupling effects, and possible non-linearities, and ensure that all control signals are precisely synchronized in time to avoid visual defects caused by operation mismatches between different optical layers (backlight, micro-optics, polarization, liquid crystal panel). Considering the real-time requirements, the controller may need to use efficient algorithms, parallel processing, or hardware acceleration to complete these calculations, and perform instruction interpolation or smoothing when necessary to cope with the rapid changes of the target parameters. After the instructions are generated, the controller sends these control signals to the backlight driver IC, the micro-optical array driver IC, and the polarization modulation layer driver IC respectively through high-speed digital interfaces (such as extended protocols of MIPI DSI, dedicated interfaces, etc.). At the same time, according to the energy management strategy determined by Sp3, the controller sends instructions to the power management integrated circuit (PMIC) to control its routing of the energy collected by the energy harvesting layer (whether to give priority to powering the system operation, charging the internal battery, or outputting externally), and adjust the power consumption status of other components of the system;

[0079] Sp5, Calibration and Personalized Learning: Execute the initial user calibration program, and use the running data and user feedback to continuously update the user model, prediction model, and control strategy through a self-learning mechanism. The system includes an initial user calibration program, which may be launched at the first use or when the user needs it. During this process, the system may display a series of specially designed test patterns, combined with the readings of the integrated sensing array, external modality perception modules (such as cameras to observe user reactions), or direct user feedback (such as ratings, selections), to establish or correct the basic display profile. This includes measuring and compensating for the spatial non-uniformity of the brightness and chromaticity of the display panel; evaluating the individual color vision characteristics of the user (such as the precise white point preference, the presence of color weakness, and generating a compensation lookup table accordingly); determining the user's sensitivity and comfort range for brightness, contrast, blue light level, flicker frequency, etc.; and possibly requiring the user to cooperate to complete some tasks to train the initial attention model or emotion recognition model. Secondly, and more importantly, the system has the ability of continuous personalized learning. During daily operation, the system continuously records key operation data logs, including various sensor data collected by Sp1, the user and environmental states evaluated by Sp2, the control decisions made by Sp3 (i.e., the actual applied SDSP parameters and energy strategies), the execution of Sp4, and most importantly - the subsequent actual observed changes in the user's state (whether fatigue develops as expected, whether attention is maintained) and any explicit or implicit feedback that the user may give (the user manually adjusts the brightness setting, gives a rating of satisfaction or dissatisfaction with a certain automatic adjustment, or even positive or negative responses of certain physiological indicators). These data are used to drive a self-learning mechanism (possibly based on supervised learning, unsupervised learning, or reinforcement learning frameworks). The core goal of this mechanism is to continuously optimize the personalized parameters stored in the user profile; iteratively improve the accuracy of the state prediction model used in Sp2; and continuously adjust the internal parameters, weights, or policy rules of the multi-objective optimization decision engine in Sp3, so that the control decisions it makes can better conform to the long-term preferences of this specific user, improve their usage experience (comfort, work efficiency, etc.), and maximize energy efficiency. This learning enables the display system to truly "understand" the user and achieve the evolution from the factory default settings to highly personalized adaptation. Specific Embodiment Three:

[0081] Based on the technical solutions of Specific Embodiment One and Specific Embodiment Two, the following use cases are further given:

[0082] Radiologists carefully search for early, tiny, and extremely low-contrast lung nodules in a series of chest CT tomographic images. A high degree of concentration is required, and there are almost stringent requirements for the grayscale performance and stability of the display device because changes in ambient light or glare interference may lead to missed diagnoses or misdiagnoses. After startup, the monitor precisely measures and senses the overall characteristics of the current mixed ambient light in the diagnostic reading room (including changes in natural light outside the window and indoor standardized lighting) and the light differences falling on different areas of the screen through its external spectral sensor and micro-optical sensors distributed in the pixel array. Based on these real-time and high-precision data, the intelligent controller dynamically adjusts the output of the multi-primary-color Micro-LED backlight array at the pixel level to ensure that the entire screen strictly and continuously conforms to the DICOM Part 14 grayscale display function standard. This means that regardless of how the external light changes or whether there is slight local reflection, each level of gray scale that the physician sees maintains a stable and accurate perception, which is crucial for distinguishing the subtle density differences between lung tissue and micro-nodules. At the same time, the dynamic polarization modulation layer of the monitor actively works to specifically suppress the reflected glare formed by the ceiling lights or windows in the reading room on the screen surface, avoiding the key details of the blurred edges of nodules that may be masked by these glares. The built-in eye-tracking function of the system not only records the radiologist's reading habits but, more importantly, analyzes them in combination with a fatigue model. When early biological indicators (such as tiny saccade pattern changes, sluggish pupil responses) indicating that the radiologist may experience a decline in attention or visual fatigue due to long-term reading are detected, the controller will make imperceptible fine-tuning of the display spectrum (adjusting the background hue or contrast dynamic characteristics of the non-information area) on the premise of ensuring compliance with the DICOM standard, aiming to maintain the radiologist's visual sensitivity and alertness to reduce the risk of missing lesions. In addition, the dynamically addressable micro-optical array fine-tunes the light output direction according to the radiologist's real-time head position (judged by a camera or eye-tracking assistance), ensuring that even if the radiologist's body moves slightly, the screen brightness and contrast received by them remain consistent, which is particularly helpful for scenarios that require stable observation of three-dimensional reconstructed images.

[0083] It should be noted that in this document, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprising", "including" or any other variant thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising a reference structure" does not exclude the presence of additional identical elements in the process, method, article or device comprising the element.

[0084] Although embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of the present invention, and the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. An adjustable-spectrum liquid crystal display system, characterized in that: The display system includes: A display panel layer: for image display; the display panel layer includes the following parts: A backlight module, disposed on the back of the display panel layer, including a plurality of independently controllable light-emitting unit arrays; An integrated sensing array, integrated or interleaved with the pixel structure of the display panel layer; A dynamically addressable micro-optical array, disposed in the optical path, configured to spatially addressably change the direction or angular distribution of light passing through it; A dynamic polarization modulation layer, disposed in the optical path, configured to spatially addressably change the polarization state of light passing through it; An integrated transparent energy harvesting layer, disposed in the stack structure of the display system, for harvesting ambient light energy; A modality sensing module, configured to obtain at least one piece of external environmental data and / or at least one piece of user-related biometric information; An intelligent controller, electrically connected to the backlight module, the integrated sensing array, the dynamically addressable micro-optical array, the dynamic polarization modulation layer, the energy harvesting layer, and the modality sensing module.

2. The tunable-spectrum liquid crystal display system according to claim 1, wherein The integrated sensing array includes one or any combination of the following: a micro-optical sensor, a micro-temperature sensor, a micro-capacitive sensor, a micro-biopotential sensor.

3. The tunable-spectrum liquid crystal display system according to claim 1, wherein The dynamically addressable micro-optical array includes any one of the following: a liquid crystal lens array, a micro-electro-mechanical system micro-mirror array, or an adjustable optical metasurface array.

4. The tunable-spectrum liquid crystal display system according to claim 1, wherein, The intelligent controller is configured to drive the dynamically addressable micro-optical array to direct light mainly to the user's viewing point based on the user viewing point position information obtained by the modality sensing module.

5. The adjustable-spectrum liquid crystal display system according to claim 1, wherein The intelligent controller is configured to dynamically adjust the parameters of the target in the spatio-temporal-direction-spectral-polarization output characteristics and adjust the energy distribution based on the energy harvesting data obtained from the integrated transparent energy harvesting layer.

6. The adjustable-spectrum liquid crystal display system according to claim 1, wherein, The intelligent controller is configured to execute a prediction model that predicts the future trend of the user state based on historical user data, fused real-time sensor data, and application context, and the intelligent controller is also configured to execute data security and privacy protection protocols.

7. The control method of the tunable spectral liquid crystal display system according to any one of claims 1-6, the control method comprising the following steps: Sp1, Data acquisition and fusion: Collect multi-source data from the integrated sensing array, the modality sensing module, and the energy harvesting layer, and obtain application context information, and preprocess and fuse the collected multi-source heterogeneous data; Sp2, State evaluation and prediction: Evaluate or predict the user state, environmental state, and system energy state based on the fused data; Sp3, Target determination: Determine the target spatio-temporal-direction-spectral-polarization output characteristic parameters and the corresponding energy management strategy based on the evaluated or predicted state, user preferences, and current operating mode; Sp4, Control signal generation and execution: Generate driving instructions to control the backlight module, the dynamically addressable micro-optical array, and the dynamic polarization modulation layer respectively to achieve the target spatio-temporal-direction-spectral-polarization output, and control the energy flow according to the energy management strategy; Sp5, Calibration and Personalized Learning: Execute the initial user calibration procedure, and continuously update the user model, prediction model, and control strategy through a self-learning mechanism using the data during operation and user feedback.

8. The control method of the adjustable-spectrum liquid crystal display system according to claim 7, characterized in that, The data acquisition and fusion step includes: weighted fusion of pixel-level data from the integrated sensing array and data from the modality perception module.

9. The control method of the adjustable-spectrum liquid crystal display system according to claim 7, characterized in that, The target determination step includes: calculating the target direction parameters of the dynamically addressable micro-optical array based on the user's viewing point position determined by eye tracking to optimize the light projection efficiency or achieve privacy protection.

10. The control method of the adjustable-spectrum liquid crystal display system according to claim 7, wherein The target determination step includes: Sp3.1, Based on the user's reflected light or proximity sensing signal detected from the integrated sensing array, adjust the display parameters to optimize the near-viewing experience or enable gesture interaction; Sp3.2, According to the energy management strategy, under the premise of ensuring basic visual needs, adjust parameters such as peak brightness, color gamut range, or refresh rate to maximize energy efficiency.

Images