A method and system for achieving integrated dimming

Abstract

This invention provides a method and system for achieving comprehensive dimming, relating to the field of human-computer interaction technology. The method includes: generating and fixing a static basic mapping table for each display device; extracting the display content features of each display device in real time, as well as the visual attention weight of the operator in the current scene; calculating the global physiological confidence level to verify glare sources; combining the visual attention weights, performing spatial pairing and cross-referencing on each display device to calculate the causal matching degree, generating a spatially selective dynamic attenuation coefficient for each display device; and distributing dimming instructions containing the spatially selective dynamic attenuation coefficient to the corresponding display devices via a hybrid communication network. Each display device performs dynamic compensation and low-level nonlinear inverse mapping by combining its own real-time state parameters with the static basic mapping table, and outputs a pulse width modulation duty cycle for driving light emission.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular to a method and system for achieving integrated dimming. Background Technology

[0002] With the rapid development of modern electronic technology, in complex application scenarios such as special vehicles, aerospace cabins, and large integrated command and control centers, complete system sets are typically equipped with multiple displays, display and control units, and devices with display modules of varying functions. These multi-source display devices serve as the core medium for human-computer interaction, bearing the task of presenting massive amounts of critical information in parallel. Due to the large number of display devices deployed within the system, to ensure the visual comfort of operators and the accuracy of information acquisition, achieving unified switching and synchronous adjustment of the brightness of multiple display devices under different external lighting conditions—that is, integrated synchronous dimming—has become a critical technical requirement.

[0003] Currently, the underlying dimming control of display devices is typically based on pulse width modulation (PWM) technology. However, due to objective physical differences in the batches, internal hardware driver circuit architecture, and optical module design of various display devices within the system, issuing only a uniform PWM duty cycle command to each device will result in inconsistent actual brightness across devices. Furthermore, during long-term iterations, complete systems often contain both old and new devices, exhibiting complex heterogeneous communication topologies. For example, some devices are equipped with Ethernet interfaces, while others only support traditional RS232 serial communication. Traditional dimming solutions, to achieve global synchronization, usually require tedious individual calibration and configuration of each device, or rely on redundant cable connection matrices. This not only leads to slow communication link response but also significantly increases the hardware cost and maintenance difficulty of system integration.

[0004] Furthermore, in the aforementioned specific application scenarios, display devices typically face extremely harsh operating environments (such as extremely wide temperature fluctuation ranges) and long service lives. Existing multi-device dimming solutions mostly rely on static brightness mapping tables measured and stored in local memory before shipment to overcome device differences. However, the backlight source of display devices undergoes irreversible nonlinear light decay during long-term high-load operation, and the aging rate of different physical devices exhibits a discrete distribution; simultaneously, drastic environmental temperature fluctuations can also cause thermal drift in the luminous efficiency of the underlying semiconductor devices. This physical deviation, which evolves dynamically with time and environment, makes display systems that originally relied on static benchmark calibration highly susceptible to significant brightness synchronization problems again after long-term deployment, making it impossible to maintain brightness consistency throughout the entire lifespan.

[0005] More importantly, existing dimming technologies primarily focus on achieving absolute consistency in physical luminous intensity, failing to fully consider the dynamic visual load characteristics during high-intensity human-computer interaction. When performing tasks requiring specific night vision, such as low-light operations at night, operators need to maintain a high degree of visual dark adaptation. Even if the physical backlight brightness of multiple devices within the system is adjusted to be identical, the significant differences in the currently rendered image content on different screens, particularly high-frequency dynamic content and screens with a high proportion of brightness, can still cause localized glare for the operator. Furthermore, when facing sudden changes in external high-intensity light environments or engaging in complex tactical maneuvers, the operator's hands are often under heavy load, making it difficult to manually adjust brightness by turning physical knobs. Existing dimming systems lack the ability to perceive the visual stimuli of displayed content and cannot capture the operator's actual visual physiological feedback to form a control loop. This results in a rigid open-loop dimming process, failing to meet the adaptive and fatigue-resistant display requirements of complex dynamic scenarios. Summary of the Invention

[0006] This invention provides a method for achieving integrated dimming, the method comprising: A static base mapping table generated and fixed for each display device; Real-time extraction of display content features of each display device and visual attention weight of the operator in the current scene; calculation of global physiological confidence to verify glare source; combining visual attention weight, spatial pairing and cross-referencing of each display device to calculate causal matching degree, and generating spatial selective dynamic attenuation coefficient of each display device; The dimming command, which includes a spatially selective dynamic attenuation coefficient, is distributed to the corresponding display device via a hybrid communication network. Each display device performs dynamic compensation and low-level nonlinear inverse mapping by combining its own real-time status parameters with a static basic mapping table, and outputs a pulse width modulation duty cycle for driving light emission.

[0007] Visual attention weights are extracted in the following way: Calculation operators at time nodes Regarding the first Visual attention weight of display devices :

[0008] in, Indicates the effective line of sight and the first The three-dimensional Euclidean distance of the geometric center of the display device. This is the preset field of view span parameter.

[0009] Calculating global physiological confidence includes: obtaining the bright field pixel space ratio of each display device. Assess the current time point The theoretical maximum display radiation baseline posed by the cluster of screens inside the cabin to the operator, i.e., the cabin radiation baseline. :

[0010] in, The total number of display devices performing dimming; In-cabin radiation benchmark Compared with the actual average pupil constriction ratio Perform causal comparisons and calculate global physiological confidence. :

[0011] in, This is the preset response divergence parameter.

[0012] Spatially pairing and cross-referencing are performed on each display device to calculate causal matching degree, including calculating three types of causal matching degree separately: First matching degree :

[0013] Second matching degree :

[0014] Third degree of matching :

[0015] in, It is a time-series dynamic flickering feature. This is a time-series squinting accumulation feature. This represents the average spatial contrast characteristic. For visual attention weights; Based on the above three types of causal matching degrees, the first... Verification interference index of Taiwan display device :

[0016] Generate the spatially selective dynamic attenuation coefficient for each display device, including: for the first Calculate the dynamic attenuation coefficient of the display device. :

[0017] in, The preset dimming damping parameters.

[0018] Each display device performs dynamic compensation by combining its own real-time status parameters with a static base mapping table, including: obtaining underlying physical status parameters, including the real-time temperature of the underlying backlight driver circuit area. And the cumulative backlight illumination time of the device since it left the factory. Construct a temperature compensation coefficient :

[0019] in, The reference ambient temperature during calibration. It is the thermal drift constant; Obtain aging compensation coefficient :

[0020] in, The maximum allowable hardware optical attenuation margin constant. is the aging rate constant.

[0021] Dynamic compensation also includes: calculating the first... Taiwan display device at time node Theoretically, the output should be the adjusted brightness. :

[0022] in, Current brightness level The corresponding theoretical true value of brightness, This is the spatially selective dynamic attenuation coefficient; Taking into account physical losses, calculate the target physical brightness after compensation requested from the electro-optic response curve. :

[0023] The underlying nonlinear inverse mapping includes: calling internally pre-defined electro-optic response curve functions. ; Perform the Newton-Raphson iterative reconstruction process, setting the initial value of the iteration to... , No. The update formula for the next iteration is:

[0024] in, , The first Fitting coefficients for the display device; When the convergence condition is met When the iteration terminates, the value at that time will be... As the final dynamic output duty cycle ,in, This is the minimum duty cycle control accuracy tolerance limit.

[0025] The static base mapping table generated and fixed for each display device includes: calculating the theoretical physical luminance true value corresponding to each luminance level. :

[0026] in, The minimum brightness setting. The maximum physical brightness is set. This represents the total brightness adjustment levels. The current brightness level and .

[0027] The present invention also provides a system for achieving integrated dimming, the system comprising: Basic mapping table construction module: Generates and persists static basic mapping tables for each display device; Feature extraction and verification module: extracts the display content features of each display device in real time, as well as the visual attention weight of the operator in the current scene; calculates the global physiological confidence to verify the glare source; combines the visual attention weight to perform spatial pairing and cross-validation of each display device to calculate the causal matching degree and generate the spatial selective dynamic attenuation coefficient of each display device. Brightness adjustment module: The dimming command containing the spatially selective dynamic attenuation coefficient is distributed to the corresponding display device via the hybrid communication network. Each display device combines its own real-time status parameters with the static basic mapping table to perform dynamic compensation and low-level nonlinear inverse mapping, and outputs the pulse width modulation duty cycle used to drive the light emission.

[0028] This application provides a method and system for comprehensive dimming, achieving a leap from traditional static brightness synchronization to dynamic visual adaptive dimming. The advantage of this application lies in the introduction of a multi-dimensional feature cross-validation mechanism. This mechanism not only independently extracts objective information such as brightness field, contrast, and flicker of the displayed image, but also acquires real-time physiological stress feedback such as the operator's gaze point, pupil contraction, and squinting. Furthermore, it uses causal logic to trace and verify the attributes of internal and external light sources. This mechanism can effectively distinguish whether the operator's physiological discomfort stems from the glare of a specific screen inside the cabin or from sudden interference from strong ambient light outside. When faced with sudden changes in external ambient light, the system can quickly attenuate the causal matching degree, preventing the erroneous decision to blindly reduce the brightness of the screen inside the cabin. This effectively avoids the tactical blinding effect caused by screen dimming under external strong light interference, greatly improving the system's anti-interference stability and information display and control security in extremely complex environments.

[0029] Furthermore, this application deeply integrates spatial mapping patterns from human visual neuroscience into the feature cross-validation process, achieving a spatially selective and refined dimming penalty strategy. The system fully considers the physiological differences in peripheral retinal sensitivity to dynamic flicker, rigorously spatially pairing and validating the physical image characteristics of heterogeneous screens with the operator's visual attention distribution. Through this non-linear spatial cross-validation, the system abandons the one-size-fits-all global dimming mode. When verification determines that anti-glare intervention is necessary, the system can accurately locate and significantly suppress edge screens that are in the operator's peripheral vision area and cause severe light pollution, effectively protecting the operator's nighttime dark adaptation. Simultaneously, for the primary viewing screen that the operator is currently highly focused on, the system endows it with strong anti-suppression protection attributes, ensuring that core tactical information maintains high contrast and high clarity in any sudden lighting conditions, balancing the dual needs of visual anti-glare protection and high-intensity tactical continuity.

[0030] This application overcomes the problem of luminous performance drift in display devices caused by extreme temperature differences and long-term service through a dynamic physical compensation mechanism at the edge. This application decouples high-level dimming decisions from low-level losses. The dimming center only distributes spatially selective dynamic attenuation coefficients to the heterogeneous network, while the specific hardware compensation calculations are delegated to the end-side microcontrollers of each terminal display device. After receiving instructions, the terminal device synchronously collects its real-time driving temperature and historical cumulative illumination time, and constructs a dual compensation model for thermal drift and long-term light decay. This distributed edge compensation mechanism enables each display terminal to accurately reverse-correct the theoretical target brightness based on its own unique semiconductor heat dissipation and light guide module aging. Relying on the synergistic linkage of the above-mentioned heterogeneous network-oriented distribution and end-side low-level dynamic compensation, this application significantly reduces the bandwidth load of the central communication link and avoids network congestion, while fundamentally eliminating the multi-screen brightness synchronization phenomenon caused by batch differences in display devices, different communication protocols, and irreversible physical losses throughout the entire life cycle. This solution not only seamlessly integrates with the complex hardware topology of the complete system where new and old interface devices coexist, but also ensures that the entire system can achieve high-smoothness absolute synchronous dimming under extremely low brightness night vision standards throughout its entire service life and in the full temperature range operating environment. It provides a comprehensive dimming solution for high-intensity human-computer interaction scenarios that conforms to the physiological laws of real vision and has extremely strong underlying hardware adaptive repair capabilities. Attached Figure Description

[0031] Figure 1 A flowchart illustrating the integrated dimming implementation in this application; Figure 2 This is a physiological feedback image of the operator's eyes in this application; Figure 3 A comparison diagram of causal cross-correlation for verifying the authenticity of glare light sources; Figure 4 This is a hardware structure diagram of the display terminal side microcontroller, memory, temperature sensor and backlight driving circuit in this invention. Detailed Implementation

[0032] This embodiment provides a system for achieving integrated dimming, primarily applicable to environments with high demands for human-computer interaction and stringent night vision requirements, such as military special vehicles, aerospace cabins, or large integrated command and control centers. In this application scenario, the system is configured with multiple heterogeneous display devices. Operators need to simultaneously monitor multiple display terminals within a range of ambient light variations, and the display devices are required to meet a minimum night vision standard of 0.17 cd / m² and a maximum brightness greater than or equal to 600 cd / m².

[0033] The overall hardware structure of the system disclosed in this embodiment includes: a multi-dimensional feature sensing unit, a dimming module, a hybrid communication network, and several display devices that perform dimming.

[0034] Specifically, the multi-dimensional feature perception unit is used to collect visual environment and interaction data in dynamic scenes. This unit includes a facial feature acquisition device positioned opposite the operator's workstation, preferably a camera with infrared illumination, used to capture real-time images of the operator's face and eyes to extract physiological feedback features such as pupil constriction ratio, gaze point, and micro-expressions. The unit also includes an image capture module that communicates with the video source interface of each display device, used to acquire the current image data frames to be rendered on each display device in real time, for subsequent analysis of the highlight ratio and pixel contrast of the screen content.

[0035] The dimming module, serving as the decision-making and initiation node of the integrated dimming link, features a mechanical physical dimming knob and a day / night mode switch button on its hardware. The physical dimming knob provides 256 levels of mechanical input adjustment for reference brightness. The dimming module integrates a high-performance main control computing unit, which is electrically connected to the physical dimming knob, the day / night mode switch button, and the multi-dimensional feature sensing unit. This unit is used to fuse and process multi-source feature data, run cross-validation logic, and output dimming command data messages containing compensation parameters.

[0036] Because the system contains heterogeneous devices with different data interface standards, the hybrid communication network is configured to include an Ethernet transmission branch and a serial communication branch. The Ethernet transmission branch includes a network switch, and the dimming module is connected to the network switch via an Ethernet cable. The serial communication branch includes a computer motherboard. The computer motherboard has an Ethernet communication interface and an RS232 serial interface, and its Ethernet communication interface is connected to the network switch. The computer motherboard is configured as a protocol conversion gateway, used to parse the network data packets sent by the dimming module and convert them into serial communication data frames for transparent forwarding.

[0037] The display devices performing dimming are divided into two categories based on their interface types: a first category of display terminals and a second category of display terminals. The first category of display terminals consists of monitors or display control units equipped with Ethernet interfaces, which are directly connected to the network switch via Ethernet cables to receive dimming commands based on UDP datagram format. The second category of display terminals consists of display terminals equipped only with RS232 interfaces, which are connected to the RS232 serial interface of the computer motherboard via RS232 cables to receive converted serial dimming commands.

[0038] To address the light emission deviations caused by differences in underlying hardware and long-term physical environmental aging, this embodiment specifically defines the internal drive control hardware structure of the display device. Both the first and second type of display terminals include an edge microcontroller, a FLASH storage area, an environmental sensing sensor group, and an LED backlight driving circuit.

[0039] Preferably, the end-side microcontroller employs a 32-bit microprocessor. The 32-bit microcontroller provides a high-precision PWM control register, supporting finer PWM duty cycle levels. The FLASH storage area is communicatively connected to the 32-bit microcontroller and contains a pre-programmed static baseline mapping table based on the actual factory optical properties measured for this specific device. This static baseline mapping table is generated by the luminance meter before shipment by measuring the light intensity emitted from the screen and calculating backwards, recording a unique correspondence between brightness levels and a reference PWM duty cycle.

[0040] The LED backlight driving circuit preferably uses the LT3756 constant current LED controller as the backlight driving chip. The PWM control terminal of this chip is electrically connected to the PWM signal output pin of the 32-bit microcontroller. The LT3756 backlight driving chip supports a wide voltage input adjustment of 6V to 100V and an adjustable operating frequency of 100kHz to 1MHz, and also supports day and night modes. The 32-bit microcontroller, combined with the static basic mapping table in memory and the real-time physical parameters collected by the environmental perception sensor group, generates a dynamically adjusted high-precision PWM duty cycle signal and outputs it to the LT3756 backlight driving chip. Finally, this chip precisely drives the LED backlight array of the display panel, achieving flicker-free night vision display with a minimum of 0.17cd / ㎡ and high-precision synchronous dimming of multiple heterogeneous display devices. Through the above hardware architecture selection and topology connection, this application provides a complete execution foundation for the subsequent closed-loop adaptive dimming strategy.

[0041] Based on the aforementioned hardware system, this embodiment discloses in detail S1: system initialization and static benchmark establishment in the multi-device adaptive integrated dimming method of this application.

[0042] In multi-screen display scenarios, the system not only contains heterogeneous display devices due to differences in batches and communication protocols, but also exhibits objective physical differences in the transmittance of the LCD panels, the photoelectric conversion efficiency of the LEDs, and the optical losses of the light guide plates. If a uniform linear pulse width modulation (PWM) duty cycle is used for driving, in low-light environments where the human eye is extremely sensitive to faint light (as low as...),... Even slight differences in physical light emission can cause noticeable inconsistencies in brightness across different screens, severely disrupting the operator's dark adaptation process.

[0043] Step S1 specifically includes the following sub-steps: S11: Target brightness curve assignment: Under military night vision standards, operators are in a state of scotopic or mesoscopic vision. The human eye is extremely sensitive to changes in brightness in the low-brightness range, but relatively insensitive to changes in the high-brightness range. To achieve optimal performance from minimum brightness... (fixed setting) Up to maximum physical brightness (fixed setting) To achieve a smooth visual transition, this step constructs a nonlinear target physical brightness allocation model.

[0044] Set the total brightness adjustment levels issued by the dimming module to (In this embodiment, the corresponding 8 binary control bits have a fixed value of 256). Define the first... Level of brightness ( The corresponding target physical brightness is Calculate the theoretical physical luminance true value corresponding to each luminance level:

[0045] In the low brightness level range (i.e.) When the value is small, the physical brightness difference between adjacent brightness levels is extremely small, making it compatible with up to 32-bit microcontrollers. The high PWM precision enables soft dimming at night; while in the high brightness range (i.e., Value close to (At that time), the physical brightness difference between adjacent levels gradually increases, meeting the need for rapid brightening in strong daylight environments.

[0046] S12: Measurement and polynomial fitting of the electro-optic response curve of the display device: For the first in the system The display device uses a luminance meter to sample and measure the actual light intensity emitted by its screen. Within the full-range PWM control range of the 32-bit microcontroller, it outputs uniformly. The duty cycle of the test is recorded. Each test duty cycle and the corresponding actual luminous intensity measured by the luminance meter ( ).

[0047] Because the LT3756 driver chip exhibits inherent nonlinear changes in junction temperature and internal resistance when driving LED backlight arrays in the high-current and extremely low-current ranges, simple piecewise linear interpolation cannot meet the synchronization accuracy requirements. Therefore, this step employs the least squares method to perform the following steps: Taiwan display device constructs a cubic polynomial electro-optic response curve function :

[0048] in, , , , The first The fitting coefficients for the display device are determined by minimizing the following optimization objective function:

[0049] S13: Generation of the static base mapping table: Obtain the electro-optical response curve function specific to each display device. and globally uniform target brightness Next, it is necessary to calculate the precise input drive signals required by each display device at each brightness level. Define the first... The display device at the The required base duty cycle for output at the brightness level is .

[0050] The calculation process is the inverse solution of the electro-optic response curve function, satisfying the following relationship:

[0051] Considering the truncation error in calculating the analytical inverse function of a cubic polynomial at the device end, the duty cycle division precision of the 32-bit microcontroller is fully utilized to address the physical brightness of each target. Set the initial value of the iteration to , No. The next iteration step ( The update formula for ) is:

[0052] When the convergence condition is met (in The minimum duty cycle control accuracy tolerance limit supported by the 32-bit microcontroller is fixed at [value]. When ), stop iterating and set the value at this point. The value is used as the final base duty cycle. .

[0053] Complete all After calculating the brightness level, for the first... The display device generates a set of independent variables. With dependent variable The data pairs form a static base mapping table. This mapping table serves as the unique reference dimming dictionary for the device, and is burned and stored in the FLASH memory area of ​​the display device's internal control motherboard.

[0054] Each time the system is powered on and initialized, the 32-bit microcontroller of each display device first reads its own static basic mapping table and loads it into memory, thereby eliminating the inherent manufacturing differences between multiple devices. This ensures that when the network issues a unified dimming command, each device can synchronously achieve a consistent physical brightness that conforms to visual perception, thus completing the baseline leveling of the system initialization.

[0055] After completing the system initialization in phase S1, all heterogeneous display devices have achieved strict baseline alignment in terms of luminous intensity. However, in complex display control scenarios, the uniformity of physical luminous intensity does not equate to the uniformity of visual perception load. Due to the different tasks undertaken by each display terminal, the image content currently rendered on the screen varies significantly. If the... One display device shows a large area of ​​bright electronic topographic map, while the adjacent display device shows a radar interface with a black background. Even though the basic duty cycle of both is controlled at the same low brightness level, the large area of ​​bright pixels in the former will still produce strong local glare, which will cause the operator's pupils to contract and disrupt the dark adaptation state established by the operator in low light at night.

[0056] Therefore, to overcome the lack of perception capability of dimming systems in sensing visual stimuli of displayed content, this application uses the image capture module in the multi-dimensional feature perception unit to acquire the image data frames to be rendered from each display device in real time, and extracts the visual stimulus features caused by the distribution of the screen content of each device, namely S2: real-time extraction of multi-source dynamic scene features. S21: Bright field pixel space ratio calculation: Large areas of high brightness are the primary factor inducing visual glare and fatigue. (Setting the first...) The effective display resolution of the display device is wide. Pixels, High Pixels. Image cropping module at the current time point. Capture image data frames from the device, convert them to grayscale color space, and extract the luminance channel matrix. Define... For the first Taiwan display device at time node Pixel coordinates are The grayscale brightness value at that location, where , , The range of values ​​is .

[0057] Set the preset bright field stimulation threshold as For time nodes Calculate the first Bright field pixel space ratio of the display device :

[0058] in, For step indicator function, when hour, ;otherwise . The range of values ​​is , The larger the value, the wider the overall bright area of ​​the current screen image, and the higher the potential for disrupting dark adaptation.

[0059] S22: Local spatial high-contrast feature extraction: In night vision environments, in addition to large areas of bright light, sharp boundaries between light and dark areas can also cause visual fatigue. To quantify this spatial abrupt stimulus, this step uses the central difference operator to calculate the local spatial gradient magnitude of the image.

[0060] For coordinates The pixels at that location, where , Its local spatial gradient magnitude The calculation formula is:

[0061] Further calculation of time nodes Next, the Average spatial contrast characteristics of the entire screen of the display device :

[0062] It can measure the density and contrast intensity of the area where light and dark meet in a screen image. The higher the value of this feature, the heavier the neural load on the human eye's lens focusing.

[0063] S23: Calculation of Timing Dynamic Flicker Characteristics Tactical interfaces often display frequently updated radar scans, flashing warning icons, and rapidly moving target trajectories. Frequent dynamic brightness abrupt changes can cause a buildup of visual stimuli over time. This step introduces a time-sliding window mechanism to quantify the intensity of dynamic changes in the visuals.

[0064] The time window for time series extraction is set to include the total number of consecutive data frames. .definition Frame index within the time window ( ). Calculate the first Timing dynamic flickering characteristics of the display device within the current time window :

[0065] This invention quantifies the flicker frequency and light intensity variation of screen content over time by accumulating the average of the absolute brightness difference between corresponding pixels between two consecutive frames.

[0066] In complex display and control scenarios, whether the brightness stimulus of the objective image truly translates into visual load for the operator depends heavily on the operator's current interactive behavior and physiological state. For example, when performing tactical evasion maneuvers, the operator's gaze may be highly focused on the central main display screen. At this time, even if other screens at the periphery of the field of vision display a large area of ​​bright terrain map, it will not cause direct glare to the fovea of ​​the macula. At the same time, different operators have individual differences in their dark adaptation ability, and open-loop dimming based purely on image content is prone to over-suppression or under-suppression.

[0067] Therefore, in order to solve the technical problem that the dimming mechanism in the prior art is disconnected from the actual physiological experience of the operator, this application extracts the operator's line of sight and eye physiological stress feedback.

[0068] S24: Three-Dimensional Visual Space Projection and Visual Attention Weight Allocation The system is configured to deploy a total of The display device performs dimming. A three-dimensional cockpit coordinate system is established with the optical center of the facial feature acquisition device (infrared camera) as the origin.

[0069] At the current time point The facial pose and eye spatial pose of the operator are acquired through facial feature acquisition equipment, and the three-dimensional spatial coordinates of the operator's eye center are calculated. and spatial line-of-sight vector .

[0070] Pre-calibration Taiwan display device ( The plane containing the physical screen in the cockpit coordinate system Calculate the line-of-sight vector. With each plane The spatial intersection point is selected as the point closest to the center of the eyeball and falling within the effective display and control console area, and this point is taken as the current time node. Effective line of sight .

[0071] Furthermore, the first one is pre-calibrated. The geometric center coordinates of the display device are Considering the attenuation of peripheral vision's perception of light in low-light conditions at night, this step uses a Gaussian attenuation model to calculate the operator's perception at specific time points. Regarding the first Visual attention weight of display devices :

[0072] in, Indicates the effective line of sight and the first The three-dimensional Euclidean distance between the geometric centers of the equipment; This is the preset field of view span parameter. The range of values ​​is , The closer it is to 1, the better. The closer the device is to the operator's current primary gaze area, the higher the conversion rate of the screen content to the actual visual stimulus.

[0073] S25: Pupil constriction ratio extraction In night vision environments, the operator's pupils will dilate spontaneously to capture weak light, a state known as dark adaptation. When the screen brightness is too high or a transient bright light flash occurs (such as a radar alarm), the pupils will contract rapidly and defensively without conscious control.

[0074] The baseline pupil diameter for a typical operator in a dark environment is set as follows: At the time point The facial feature acquisition device extracts the current diameter of the circumcircle of the pupil. To eliminate interference from high-frequency physiological noise such as blinking and saccades, a pupil analysis time window is introduced. .definition For the frame time index within the time window ( ). Calculate the average pupil constriction percentage of the operator within the current time window. :

[0075] We ruled out non-light-induced pupil dilation caused by operator drowsiness and quantified the pupil constriction phenomenon caused by light stimulation. The larger the value, the more severe the damage to the dark adaptation state caused by the current multi-screen integrated lighting environment.

[0076] S26: Based on eye key point feature extraction Besides pupil constriction, squinting is another significant defensive facial expression when the human eye is exposed to localized high-contrast glare. This step extracts key points around the eyes and calculates the aspect ratio of the eyes to represent the frequency and intensity of squinting.

[0077] At the time point Extract the two-dimensional pixel coordinates of six standard facial feature key points from one eye of the operator, and record them sequentially as follows: (in , and The horizontal extreme point of the corner of the eye. (Vertical feature points of the upper and lower eyelids). Calculation time nodes. The aspect ratio of the eyes :

[0078] The baseline eye aspect ratio for operators in a normal, open-eye state is set as follows: To distinguish between normal physiological blinking and persistent squinting caused by anti-glare, this step calculates the squinting intensity in a single frame. :

[0079] Introducing a time window for facial expression analysis (usually set) (To capture more sluggish facial muscle movements). Calculate temporal cumulative features of squinting. :

[0080] S3: Feature cross-validation and global decision-making.

[0081] The sensitivity of the human retina to image features is highly uneven in space. The fovea is sensitive to static high contrast, while the peripheral retina is extremely sensitive to dynamic flicker. Furthermore, when special vehicles leave dark environments, strong external light can cause operators' pupils to constrict violently. If the system blindly dims all in-cabin displays simply based on detecting pupil constriction, it could trigger a fatal tactical blinding effect, causing operators to completely lose critical tactical information on the screen due to external light interference.

[0082] S31: Construction of a comprehensive stimulus surrogate function based on retinal spatial mapping This step aims to extract the screen physical features (brightness ratio) from step S21. Spatial contrast Timing flicker (and the visual attention weights extracted in step S22) Nonlinear spatial coupling, consistent with human visual neurology, is employed to characterize the total amount of real visual stimulation exerted on operators by the in-cabin screen array.

[0083] Based on the physiological characteristics of vision, the human eye's fixation center (macula) has extremely high resolution for static details (contrast), while peripheral vision has low resolution but is extremely sensitive to sudden changes in light intensity (flicker). Therefore, at a certain point in time... Construct a system-wide retinal stimulation surrogate function The mathematical formula is as follows:

[0084] in, This represents the total number of display devices within the system. The preset concave contrast-sensitive gain coefficient; This is the preset peripheral retinal dynamic flicker gain coefficient.

[0085] The technical logic behind this formula lies in: using the screen brightness ratio As the stimulus base; when the first The equipment was directly viewed by the operator. When ), the surrounding items flash. The contrast ratio approaches zero, at which point the screen exhibits high contrast characteristics. This will dominate the stimulus gain; conversely, when the device is at the edge of the operator's peripheral vision ( When the center contrast term approaches zero, its dynamic flickering characteristics... This will be amplified exponentially. This nonlinear coupling strictly maps the actual photosensitivity mechanism of the human eye, eliminating the accumulation of parameters that have no physical meaning.

[0086] S32: Verification of the authenticity of glare sources based on spatiotemporal causal cross-correlation This step is used to determine whether the operator's physiological discomfort (such as pupil constriction) is caused by excessive brightness of the screen inside the cabin or by sudden strong light (environmental interference) outside the cabin, thus achieving glare source verification.

[0087] The core idea is that if physiological discomfort is caused by a screen, then on the timeline, changes in the screen stimulus surrogate function must exhibit a high causal temporal correlation with pupil constriction. This leads to the introduction of a spatiotemporal correlation analysis time window. (set up Covering several consecutive frames from the past (to include the complete physiological neural reflex delay), defined as... For the frame index within the time window ( ).

[0088] Calculate the mean of the retinal stimulation surrogate function within the time window. Mean of the ratio of pupil constriction :

[0089]

[0090] Using the Pearson Cross-Correlation algorithm, the time nodes are calculated. Spatiotemporal causal correlation coefficient :

[0091] The range of values ​​is .when Significantly greater than At that time, it was proven that the increase in screen luminous intensity and pupil contraction were highly consistent in time, indicating that the glare source originated from the screen inside the cabin; when But at this time If the screen remains at a high level, it indicates that the screen has not brightened, but the operator's pupils are still constricting violently, indicating strong light interference from the external environment.

[0092] Based on this, the glare authenticity verification coefficient is calculated. :

[0093] in, For the preset threshold for determining causal correlation (e.g.) ); This is a parameter for controlling the kurtosis of logistic regression. This is the physiological mapping sensitivity parameter.

[0094] This formula holds only if the spacetime causality holds (the first term tends to...). Under the dual verification of significant physiological discomfort (the second item provides strength support), Only then will a significantly non-zero verification strength be output. If it is determined to be external strong light interference (the first term approximation)... This directly cuts off the system's erroneous decision to blindly dim the display, ensuring the anti-interference stability of the display device.

[0095] S33: Generation of Spatial Selective Dynamic Attenuation Coefficient After confirming that screen dimming needs to be implemented (i.e. Afterwards, to ensure tactical continuity, the system must not uniformly dim all screens. This step generates differentiated dynamic attenuation coefficients by calculating the pollution contribution rate of a single device and combining it with the "main view area anti-suppression protection" strategy.

[0096] First, calculate the... Taiwan display device at the current time point Independent contribution percentage to global retinal stimulation :

[0097] Subsequently, regarding the first The device generates a dedicated spatially selective dynamic attenuation coefficient. :

[0098] in, Main visual area anti-suppression protection factor (value limited to) (within the range).

[0099] The ingenuity of this formula lies in its deep integration with the multi-screen human-computer interaction scenario in the cockpit: (1) Precisely strike edge glare sources: If the first The device is the main culprit for glare (contribution percentage) (extremely large), and it is located in the operator's peripheral vision (attention). The negative penalty term within the exponent reaches its maximum. The brightness of the edge screen is rapidly reduced (approaching a smaller decimal), forcing the screen to dark-adapt to a significantly lower level to protect the operator's dark adaptation.

[0100] (2) Prioritize the protection of core tactical screens: If a screen becomes brightly lit, it happens to be the main screen that the operator is currently focusing on (attention). ), in the formula The protective measures will take effect, offsetting most of the penalty. This ensures that even when the screen is very bright, its... The attenuation is also minimal, thus ensuring that operators can interpret the highlighted core tactical information (such as the target lock box) without any obstacles in the fleeting moments of a fighter jet.

[0101] After calculation, the specific dynamic attenuation coefficient for each device is determined. It will be used as an adaptive compensation payload in network data packets and distributed by the dimming module to the heterogeneous network on the end side.

[0102] Next, based on the foregoing embodiments, this embodiment discloses in detail S3: feature cross-validation and global decision-making in the multi-device adaptive integrated dimming method of this application.

[0103] When special vehicles exit a dark tunnel, sudden bursts of bright external light can cause operators to experience severe pupil constriction and frequent squinting. If the system blindly trusts these physiological characteristics and weights them with screen features, it may misjudge the screen as being too bright and trigger a global dimming effect. Under strong external light interference, once the screen dims, operators will completely lose their tactical view, resulting in a tactical blinding effect.

[0104] The spatial perception mechanisms of the human retina are quite different. The fovea (center of fixation) is sensitive to high-contrast details, while the peripheral retina (peripheral light area) is extremely sensitive to dynamic flicker. If the flicker characteristics of the screen are blindly weighted with the operator's line of sight without causal verification of spatial correspondence, incorrect dimming suppression will be applied to non-interference source screens.

[0105] First, it is necessary to determine whether the operator's physiological discomfort is caused by the screen inside the cabin or by external ambient light. Only when the intensity of physiological stress is within a reasonable range of the physical light emission capability of the screen inside the cabin can the physiological characteristics provide sufficient confidence to guide dimming.

[0106] Based on the bright field pixel space ratio of each display device extracted in step S21 Assess the current time point The theoretical maximum display radiation level posed by the cluster of screens inside the cabin to the operators Since any high-brightness screen will increase the overall ambient light level inside the cockpit, all current screens are used here. The maximum bright field ratio of the equipment is used as the benchmark for intra-cabin radiation:

[0107] In-cabin radiation benchmark Compared with the actual average pupil constriction ratio extracted in step S22 Perform causal comparisons and calculate global physiological confidence. :

[0108] in, This is the preset response divergence parameter. This indicates the percentage of pupil constriction of the operator. The brightness exceeded the maximum stimulation currently available on the in-cabin screens. This indicates the presence of strong external light, such as direct sunlight or a flash of light. At this point, the difference increases dramatically, affecting the confidence level. It decays rapidly at an exponential rate to near Conversely, if the pupil constriction is within the screen's light emission range, it indicates that the stimulus is indeed originating from inside the cabin. Stay Nearby. This confidence level fundamentally eliminates the risk of dimming caused by strong external light.

[0109] After confirming that the glare source originates from inside the cabin, it is necessary to further pinpoint which (or several) screens are causing the discomfort. This step, based on the principles of human visual neurology, involves a rigorous spatial pairing and cross-referencing of the screen content features extracted in step S21 with the facial physiological features extracted in step S22. This is specifically for the first... The display devices were used to calculate the causal matching degree under three different physical mechanisms: First matching degree Large bright areas are inevitably accompanied by pupil constriction. The spatial co-occurrence of these two features is verified using the intersection operation (product) in fuzzy logic:

[0110] Only when the screen is indeed a large area of ​​bright light ( (High), and the operator's pupils did indeed constrict ( High), and eliminated interference from external light sources ( When the screen is high, the matching accuracy will increase only if the screen is penalized for being too bright.

[0111] Second matching degree Inside the tactical compartment, the high-frequency refresh radar (scintillation feature) at the edge of the field of view can easily cause visual fatigue, causing operators to unconsciously squint to block stray light.

[0112]

[0113] in, It is a time-series dynamic flickering feature. This is a time-series squinting accumulation feature. For visual attention weights.

[0114] Introducing the space reversal term This means that the logic for triggering squinting only holds true when the high-flicker screen is in the operator's non-focused area (peripheral vision). If the operator is staring intently at the screen... If the screen is flickering, it means that it is actively interpreting dynamic information. In this case, the screen should not be suppressed arbitrarily because of the flickering.

[0115] Third degree of matching When operators are focused on tactical lines with extremely high contrast, excessive tension in the ciliary muscle can also cause them to squint.

[0116]

[0117] Using positive attention weights Ensure that only the screen being viewed directly ( Its high contrast characteristics Only then can it be identified as a cause of squinting. The reason.

[0118] The screen is considered to constitute effective interference if any of the aforementioned genuine physiological discomfort mechanisms are triggered. (Calculate the...) Verification interference index of Taiwan display device :

[0119] The dimming module converts this indicator into specific dimming execution parameters. (Regarding the first...) Calculate the dynamic attenuation coefficient of the display device. :

[0120] in, The preset dimming damping parameter is used to control the smoothness of the dimming effect. The value of is naturally defined in Between. When a screen is verified to not cause interference ( ),That The screen maintains its current static baseline brightness without intervention, ensuring uninterrupted display of tactical information. When a screen is identified as a specific source of glare or flicker, its... Increase, corresponding Less than After the calculations are complete, the dimming module will include the dynamic attenuation coefficients for each display device. The instructions are heterogeneously distributed to the corresponding end-side display devices in accordance with the method of converting Ethernet UDP data packets or computer motherboards into RS232 serial data frames.

[0121] The dynamic attenuation coefficients of each display device were obtained through the S3 stage. Subsequently, the system faces the task of translating decisions into underlying hardware actions. In this invention, the complete system contains both new and old equipment; some equipment has Ethernet interfaces, while some older tactical terminals only retain RS232 serial interfaces. If traditional point-to-point configuration is used, communication link congestion will occur, failing to meet the millisecond-level dimming synchronization requirements of tactical scenarios. Military equipment often faces severe environmental temperature differences. As temperature rises, non-radiative recombination of the LED backlight array semiconductor PN junction increases, leading to a sharp drop in luminous efficiency (thermal decay); simultaneously, thousands of hours of service will cause phosphor aging and yellowing of the light guide plate. If the end-side equipment simply performs a linear multiplication operation on the basic duty cycle based on the received attenuation coefficient, it will produce a serious physical luminous efficiency deviation, completely breaking the physical luminous efficiency benchmark established in stage S1, making 0.17... Flickering occurred at the extreme night vision standard.

[0122] To address the aforementioned issues, this application combines network protocol conversion with edge-side compensation calculation, significantly reducing the bandwidth load on the central communication link while ensuring absolute consistency of luminescence throughout the entire lifecycle and in all temperature ranges.

[0123] S4: Heterogeneous instruction distribution and dynamic execution on the endpoint.

[0124] S41: Heterogeneous Network Packaging and Targeted Distribution of Dimming Commands The dimming module acts as the decision-making center, acquiring the current time point. Dynamic attenuation coefficient of each device In conjunction with the current reference brightness level set by the operator via the physical knob. Then, a unified adaptive dimming data payload is generated.

[0125] For the first type of display terminal (with Ethernet interface), the dimming module will adjust the target brightness level. With exclusive attenuation coefficient Encapsulated as UDP broadcast or multicast data packets, commands are sent to all Class I display terminals within the local area network via Ethernet cables and network switches.

[0126] For the second type of display terminal (without an Ethernet interface), the data packets from the dimming module are first sent to the computer motherboard configured as a protocol conversion gateway. The computer motherboard parses the payload in the UDP packets in real time, unpacks and reassembles them into serial data frames conforming to the RS232 protocol standard, and finally forwards them to the corresponding second type of display terminal via an RS232 cable.

[0127] S42: Display Status Acquisition and Multidimensional Feature Extraction To avoid network congestion caused by the dimming module centrally collecting the temperature of all devices, this step decentralizes the compensation calculation to the edge 32-bit microcontroller of each display device (edge ​​computing).

[0128] At the time point , No. The display device receives dimming commands (including brightness levels) via an internal bus. With attenuation coefficient After that, its internal environmental sensing sensor group synchronously collects its own underlying physical state parameters: Use a digital temperature sensor to read the real-time temperature of the current LED backlight driver circuit area. The cumulative backlight illumination time of the device since it left the factory was read using a cumulative timer. .

[0129] S43: Dynamic physical compensation calculation combined with long-term hardware attenuation Based on the target physical brightness allocation model determined in S11, the current brightness level is extracted. Corresponding theoretical physical brightness true value Combined with the dynamic attenuation coefficient issued by the network. Calculate the first Taiwan display device at time node Theoretically, the adjusted physical brightness should be output. :

[0130] Because the actual luminous efficiency is compromised, the device must output a higher underlying drive signal than the theoretical value to overcome the loss.

[0131] To address the thermal drift phenomenon, a temperature compensation coefficient is constructed. :

[0132] in, The reference ambient temperature for factory S1 calibration, for example, is fixed at [temperature value]. ; This is the pre-determined thermal drift constant of this type of LED array. If the current temperature... When the temperature is higher than the reference temperature, The system will increase the brightness requirement to compensate for the luminous efficiency degradation caused by high temperature.

[0133] To address the long-term aging phenomenon, LED light decay exhibits a non-linear characteristic of rapid initial decay followed by gradual decay in the later stages, and an aging compensation coefficient is obtained. :

[0134] in, This is the maximum allowable hardware optical decay margin constant for this display device; This is the aging rate constant. It increases with cumulative usage time. The increase, Gradually from The light intensity increases to compensate for long-term light decay.

[0135] Based on the above physical losses, calculate the first... Taiwan display device at time node The target physical brightness after compensation needs to be requested from the electro-optic response curve. :

[0136] S44: Low-level nonlinear inverse mapping and high-precision waveform output Calculate the target physical brightness after compensation Subsequently, the 32-bit microcontroller on the edge calls the static basic mapping table logic embedded in its internal FLASH storage area, namely the electro-optic response curve function of the device fitted in step S12. .

[0137] The edge-side 32-bit microcontroller executes a Newton-Raphson iterative reconstruction process in real time. The initial value for the iteration is set to... , No. The next iteration step ( The update formula for ) is:

[0138] When the convergence condition is met When the iteration terminates, the value at that time will be... As the final dynamic output duty cycle .

[0139] Ultimately, the 32-bit microcontrollers of each display device will be customized and highly precise. The PWM control register is written, and the PWM waveform with the corresponding duty cycle is output to the LT3756 backlight driver chip to drive the LED array to emit light. Through the execution of step S4, the system of this application overcomes the obstacles of heterogeneous network transmission and physical lifetime drift, ensuring that any display terminal, regardless of its service life or the extreme temperature it is in, can accurately output a light intensity that matches its visual interference level and physiological stress.

[0140] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0141] In this specification, the same or similar parts between the various embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the descriptions of the embodiments described later are relatively simple, and relevant parts can be referred to the descriptions of the foregoing embodiments.

[0142] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for achieving comprehensive dimming, characterized in that, The method includes: A static base mapping table generated and fixed for each display device; Real-time extraction of display content features of each display device and visual attention weight of the operator in the current scene; calculation of global physiological confidence to verify glare source; combining visual attention weight, spatial pairing and cross-referencing of each display device to calculate causal matching degree, and generating spatial selective dynamic attenuation coefficient of each display device; The dimming command, which includes a spatially selective dynamic attenuation coefficient, is distributed to the corresponding display device via a hybrid communication network. Each display device performs dynamic compensation and low-level nonlinear inverse mapping by combining its own real-time status parameters with a static basic mapping table, and outputs a pulse width modulation duty cycle for driving light emission.

2. The method according to claim 1, characterized in that, Visual attention weights are extracted by calculating the operator's attention at specific time points. Regarding the first Visual attention weight of display devices : in, Indicates the effective line of sight and the first The three-dimensional Euclidean distance of the geometric center of the display device. This is the preset field of view span parameter.

3. The method according to claim 1, characterized in that, Calculating global physiological confidence includes: obtaining the bright field pixel space ratio of each display device. Assess the current time point The theoretical maximum display radiation baseline posed by the cluster of screens inside the cabin to the operator, i.e., the cabin radiation baseline. : in, The total number of display devices performing dimming; In-cabin radiation benchmark Compared with the actual average pupil constriction ratio Perform causal comparisons and calculate global physiological confidence. : in, This is the preset response divergence parameter.

4. The method according to claim 3, characterized in that, Spatially pairing and cross-referencing are performed on each display device to calculate causal matching degree, including calculating three types of causal matching degree separately: First matching degree : Second matching degree : Third matching degree : in, It is a time-series dynamic flickering feature. This is a time-series squinting accumulation feature. This represents the average spatial contrast characteristic. For visual attention weights; Based on the above three types of causal matching degrees, the first... Verification interference index of Taiwan display device : 。 5. The method according to claim 4, characterized in that, Generate the spatially selective dynamic attenuation coefficient for each display device, including: for the first Calculate the dynamic attenuation coefficient of the display device. : in, The preset dimming damping parameters.

6. The method according to claim 1, characterized in that, Each display device performs dynamic compensation by combining its own real-time status parameters with a static base mapping table, including: obtaining underlying physical status parameters, including the real-time temperature of the underlying backlight driver circuit area. And the cumulative backlight illumination time of the device since it left the factory. Construct a temperature compensation coefficient : in, The reference ambient temperature during calibration. It is the thermal drift constant; Obtain aging compensation coefficient : in, The maximum allowable hardware optical attenuation margin constant. is the aging rate constant.

7. The method according to claim 6, characterized in that, Dynamic compensation also includes: calculating the first... Taiwan display device at time node Theoretically, the output should be the adjusted brightness. : in, Current brightness level The corresponding theoretical true value of brightness, This is the spatially selective dynamic attenuation coefficient; Taking into account physical losses, calculate the target physical brightness after compensation requested from the electro-optic response curve. : 。 8. The method according to claim 7, characterized in that, The underlying nonlinear inverse mapping includes: calling internally pre-defined electro-optic response curve functions. ; Perform the Newton-Raphson iterative reconstruction process, setting the initial value of the iteration to... , No. The update formula for the next iteration is: in, , The first Fitting coefficients for display devices; When the convergence condition is met When the iteration terminates, the value at that time will be... As the final dynamic output duty cycle ,in, This is the minimum duty cycle control accuracy tolerance limit.

9. The method according to claim 1, characterized in that, The static base mapping table generated and fixed for each display device includes: calculating the theoretical physical luminance true value corresponding to each luminance level. : in, The minimum brightness setting, The maximum physical brightness is set. This represents the total brightness adjustment levels. The current brightness level and .

10. A system for achieving integrated dimming, characterized in that, The system includes: Basic mapping table construction module: Generates and persists static basic mapping tables for each display device; Feature extraction and verification module: extracts the display content features of each display device in real time, as well as the visual attention weight of the operator in the current scene; calculates the global physiological confidence to verify the glare source; combines the visual attention weight to perform spatial pairing and cross-validation of each display device to calculate the causal matching degree and generate the spatial selective dynamic attenuation coefficient of each display device. Brightness adjustment module: The dimming command containing the spatially selective dynamic attenuation coefficient is distributed to the corresponding display device via the hybrid communication network. Each display device combines its own real-time status parameters with the static basic mapping table to perform dynamic compensation and low-level nonlinear inverse mapping, and outputs the pulse width modulation duty cycle used to drive the light emission.

Images