Environment-aware industrial control tablet display content compensation processing method and system

Abstract

The application discloses an environment-aware industrial control tablet display content compensation processing method and system, and relates to the technical field of image processing.The method comprises the following steps: configuring a plurality of types of environment sensors to collect real-time environment information and generate an environment-aware sequence; separating the environment-aware sequence into a display environment sequence representing a display environment state and a terminal motion sequence representing a terminal motion state; adaptively compensating for a preset image enhancement strategy based on the display environment sequence, a display scene and image features; identifying a minimum periodic motion mode based on the terminal motion sequence to generate a motion compensation strategy; and fusing the image enhancement and motion compensation strategies to implement compensation processing on display content.Further, the technical effect of improving compensation adaptability and compensation efficiency, and improving compensation effect is achieved by combining multi-factor comprehensive compensation.

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to a method and system for compensating the display content of an industrial control tablet computer based on environmental awareness. Background Technology

[0002] Industrial control tablets need to have good display performance to meet operators' needs for accurate information access. In different usage scenarios, various factors such as ambient light intensity, temperature, equipment vibration, and changes in posture can affect the displayed content. For example, in strong light, the displayed content may become difficult to see due to reflection; in scenarios with large temperature variations, the performance of the display device may be affected, leading to color deviation or unstable brightness; and equipment vibration and changes in posture may cause the display image to flicker, affecting the visual experience.

[0003] Traditional methods for compensating display content on industrial control panel PCs typically only address a single environmental factor, neglecting the combined impact of multiple environmental factors. Furthermore, traditional methods often process the entire display screen uniformly during content compensation, increasing the processing load and potentially failing to effectively improve the readability of critical information. Summary of the Invention

[0004] This invention provides an environmentally-aware industrial control tablet display content compensation processing method and system to solve the technical problems of existing technologies, such as single compensation basis, poor environmental adaptability, and impact on compensation efficiency and effect. It achieves the technical effect of combining multi-factor comprehensive compensation, improving compensation adaptability and efficiency, and enhancing compensation effect.

[0005] In a first aspect, the present invention provides an environmentally aware method for compensating the display content of an industrial control tablet, wherein the environmentally aware method for compensating the display content of an industrial control tablet includes:

[0006] By configuring multiple types of environmental sensors, real-time environmental information is collected in the target usage scenario to obtain environmental perception sequence data.

[0007] The environmental perception sequence data is separated to generate display environment sequence data for representing the display environment state and terminal motion sequence data for representing the terminal motion state.

[0008] The preset image enhancement strategy is initialized based on the display environment sequence data, and adaptive compensation is performed on the preset image enhancement strategy in combination with the application scenario characteristics and image characteristics of the displayed content to obtain the image enhancement strategy.

[0009] Based on the terminal motion sequence data, motion state recognition is performed, the minimum period motion pattern with stable periodic characteristics is extracted, and motion compensation of the displayed content is performed according to the minimum period motion pattern to obtain a motion compensation strategy.

[0010] The image enhancement strategy and the motion compensation strategy are combined to perform compensation processing on the displayed content.

[0011] In one feasible implementation, the multi-type environmental sensors include at least a light sensor, a color temperature sensor, an acceleration sensor, and an audio sensor.

[0012] In one feasible implementation, initializing a preset image enhancement strategy based on the display environment sequence data includes:

[0013] Analyze the display environment sequence data to determine the most unfavorable display environment information under the current display conditions.

[0014] Based on the worst-case display environment information, a preset image enhancement strategy is matched and invoked, and then initialized.

[0015] In one feasible implementation, the preset image enhancement strategy is adaptively compensated by combining the application scenario characteristics and image features of the displayed content to obtain the image enhancement strategy, including:

[0016] The application scenario characteristics of the displayed content are obtained, wherein the application scenario characteristics include at least the probability distribution of display format and information density.

[0017] Based on the characteristics of the application scenario, the corresponding first image enhancement compensation strategy is matched in the adaptive compensation rule base.

[0018] Obtain image features of the displayed content, wherein the image features include at least image contrast, information entropy, and color moments.

[0019] Based on the image features, a second image enhancement compensation strategy is matched in the adaptive compensation rule base.

[0020] Based on the first image enhancement compensation strategy and the second image enhancement compensation strategy, the preset image enhancement strategy is jointly compensated to obtain the compensated image enhancement strategy.

[0021] In one feasible implementation, motion state recognition is performed based on the terminal motion sequence data, a minimum periodic motion pattern with stable periodic characteristics is extracted, and motion compensation of the displayed content is performed according to the minimum periodic motion pattern to obtain a motion compensation strategy, including:

[0022] Periodicity is identified in the terminal motion sequence data, and the minimum periodic motion pattern is extracted.

[0023] Wavelet decomposition is performed on the minimum periodic motion pattern to obtain a set of decomposed motion patterns consisting of multiple basic vibration patterns.

[0024] The motion inversion is performed on each of the decomposed motion mode sets to generate a set of periodic motion compensation parameter sequences.

[0025] The set of periodic motion compensation parameter sequences is superimposed and fused, and time alignment processing is performed to output the result as the motion compensation strategy.

[0026] In one feasible implementation, the image enhancement strategy and the motion compensation strategy are combined to perform compensation processing on the displayed content, including:

[0027] Based on the image enhancement strategy and the display environment sequence data, the equivalent display delay for the human eye is calculated.

[0028] Determine whether the equivalent display delay of the human eye exceeds the set delay threshold.

[0029] If the equivalent display delay exceeds the delay threshold, an overshoot is calculated, and the motion compensation strategy is adjusted to resist overshoot based on the overshoot.

[0030] In one feasible implementation, the image enhancement strategy and the motion compensation strategy are combined to perform compensation processing on the displayed content, which further includes:

[0031] A lightweight visual semantic segmentation model is used to identify key information areas in the displayed content.

[0032] The key information areas are functionally classified, and the graphic and text information areas are identified as the first type of key areas, while the color block areas are identified as the second type of key areas.

[0033] For the first type of key regions, both image enhancement and motion compensation strategies are applied simultaneously, while for the second type of key regions, only image enhancement strategies are applied.

[0034] In one feasible implementation, the image enhancement strategy and the motion compensation strategy are combined to perform compensation processing on the displayed content, which further includes:

[0035] The motion compensation strategy is iterated to determine the maximum motion compensation range.

[0036] Configure edge buffer parameters based on the boundary difference between the maximum motion compensation range and the original displayed content.

[0037] The edge regions of the displayed content are buffered and reconstructed based on the edge buffer parameters.

[0038] Secondly, the present invention also provides an environment-aware industrial control tablet display content compensation processing system, wherein the environment-aware industrial control tablet display content compensation processing system includes:

[0039] The environmental perception module is used to collect real-time environmental information in the target usage scenario and obtain environmental perception sequence data through a variety of configured environmental sensors.

[0040] The data separation module is used to separate the environmental perception sequence data to generate display environment sequence data that characterizes the display environment state and terminal motion sequence data that characterizes the terminal motion state.

[0041] The image enhancement strategy acquisition module is used to initialize a preset image enhancement strategy based on the display environment sequence data, and adaptively compensate the preset image enhancement strategy by combining the application scenario characteristics and image features of the displayed content, thereby acquiring the image enhancement strategy.

[0042] The motion compensation strategy acquisition module is used to identify motion state based on the terminal motion sequence data, extract the minimum period motion pattern with stable periodic characteristics, and perform motion compensation of the displayed content according to the minimum period motion pattern to acquire a motion compensation strategy.

[0043] The compensation processing execution module is used to fuse the image enhancement strategy and the motion compensation strategy to perform compensation processing on the displayed content.

[0044] This invention discloses an environmentally aware industrial control tablet display content compensation processing method and system, comprising: acquiring real-time environmental information in a target usage scenario through configured multi-type environmental sensors to obtain environmentally aware sequence data; separating the environmentally aware sequence data to generate display environment sequence data for characterizing the display environment state and terminal motion sequence data for characterizing the terminal motion state; initializing a preset image enhancement strategy based on the display environment sequence data, and adaptively compensating the preset image enhancement strategy in combination with the application scenario characteristics and image features of the display content to obtain an image enhancement strategy; identifying the motion state based on the terminal motion sequence data, extracting the minimum period motion pattern with stable periodic characteristics, and performing motion compensation of the display content according to the minimum period motion pattern to obtain a motion compensation strategy; and fusing the image enhancement strategy and the motion compensation strategy to perform compensation processing on the display content. This invention solves the technical problems of single compensation basis, poor environmental adaptability, and impact on compensation efficiency and effect, achieving the technical effect of combining multi-factor comprehensive compensation, improving compensation adaptability and efficiency, and enhancing compensation effect. Attached Figure Description

[0045] Figure 1 This is a flowchart illustrating a method for compensating display content on an industrial control tablet based on environmental awareness, according to the present invention.

[0046] Figure 2 This is a schematic diagram of the structure of an environmentally aware industrial control tablet display content compensation processing system according to the present invention.

[0047] Figure labeling: 11 Environmental perception module, 12 Data separation module, 13 Image enhancement strategy acquisition module, 14 Motion compensation strategy acquisition module, 15 Compensation processing execution module. Detailed Implementation

[0048] The above technical solutions will now be described in detail with reference to the accompanying drawings and specific embodiments to provide a better understanding of them. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. It should be understood that the present invention is not limited to the exemplary embodiments used only to explain the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention. Furthermore, it should be noted that, for ease of description, only the parts related to the present invention are shown in the drawings, not all of them.

[0049] Example 1, as Figure 1 This is a flowchart illustrating a method for compensating display content on an environmentally aware industrial control tablet according to the present invention. The method includes:

[0050] S100: By configuring multiple types of environmental sensors, it collects real-time environmental information in the target usage scenario and obtains environmental perception sequence data.

[0051] Specifically, multi-type environmental sensors are a variety of sensors used to perceive the non-visual and non-geometric properties of the environment, thereby understanding the current environmental state and improving the contextual adaptability of the perception system.

[0052] Specifically, in the target usage scenario, multiple types of environmental sensors operate in real time to collect various information about the environment. For example, a light sensor converts light signals into current signals using a photodiode, thereby measuring the ambient light intensity. Assuming a strong outdoor light environment, a light sensor can measure light intensity up to 100,000 lux. A color temperature sensor determines the color temperature of ambient light by measuring the spectral distribution of light; for example, in an indoor fluorescent lighting environment, a color temperature sensor can measure a color temperature of approximately 5000K. An accelerometer determines the motion state of a device by detecting changes in acceleration along three axes; for example, when a device vibrates, an accelerometer can detect an acceleration change with a frequency of 10Hz and an amplitude of 0.5g. An audio sensor captures sound signals in the environment; for example, in a noisy factory environment, an audio sensor can measure noise levels up to 85dB. The data collected by these sensors is processed by the system in real time to form an environmental perception sequence data, providing a basis for subsequent display content compensation.

[0053] In some embodiments, the multi-type environmental sensors include at least a light sensor, a color temperature sensor, an acceleration sensor, and an audio sensor.

[0054] Specifically, the various types of environmental sensors include at least:

[0055] Light sensors measure ambient light intensity (in Lux), reflecting the brightness of a scene, and are commonly used for automatic exposure control and night mode switching. Color temperature sensors measure the color temperature of ambient light (in Kelvin), helping to determine the type of light (such as natural light, incandescent light, fluorescent light, etc.), which affects image color reproduction. Accelerometers measure the acceleration of equipment in three axes (in m / s²), which can be used to determine the motion state and vibration of a worktable. Audio sensors collect ambient sound information to help determine the scene type (such as city, tunnel, construction area) or detect specific events (such as horns, collision sounds, etc.).

[0056] Through the above process, configuring multiple types of environmental sensors to collect real-time environmental information enables a comprehensive understanding of the actual operating environment of the industrial control tablet. This multi-dimensional environmental perception provides rich data support for subsequent display content compensation, allowing compensation strategies to more accurately adapt to various complex environments.

[0057] S200: Perform data separation on the environmental perception sequence data to generate display environment sequence data for characterizing the display environment state and terminal motion sequence data for characterizing the terminal motion state.

[0058] Specifically, the purpose of separating environmental perception sequence data is to classify and extract time-series data containing multi-dimensional information collected by various types of environmental sensors according to different functional requirements, forming sub-data streams with independent semantics and uses.

[0059] Among them, display environment sequence data refers to data extracted from raw data to characterize the potential impact of the current external environment on the visibility of displayed content, such as ambient light intensity, color temperature, and background noise energy. Terminal motion sequence data refers to data reflecting the motion state of the industrial control tablet terminal in space, typically including information such as three-axis acceleration and angular velocity, which can be used to determine whether the device is in a state of vibration or tilt, providing a basis for triggering display content stability compensation.

[0060] Specifically, the structure of the environmental perception sequence data is first analyzed to identify the physical meaning and functional attributes of each sensor data channel. Then, according to the preset channel mapping rules, channels directly related to the display environment (such as illumination, color temperature, and audio energy) are extracted as display environment sequence data, and channels related to the terminal's motion state (such as acceleration and angular velocity) are extracted as terminal motion sequence data.

[0061] For example, if the environmental perception data at a certain moment includes light intensity, color temperature, audio energy, and acceleration, the first three data points can be combined into a frame of display environment sequence data, and the last two data points can be combined into a frame of terminal motion sequence data. The acquired sequence data are kept synchronized in the time dimension, enabling the two sub-sequences to support the real-time processing needs of the display compensation and stability judgment modules, respectively.

[0062] By separating the environmental perception sequence data, two sets of data are generated specifically to characterize the display environment state and the terminal motion state. This process enables the system to more accurately identify and process key factors affecting display performance. Specifically, the display environment sequence data can be used to optimize image enhancement strategies, ensuring optimal display performance under different lighting and color temperature conditions; while the terminal motion sequence data is used to optimize motion compensation strategies, reducing the impact of device motion on the displayed content.

[0063] S300: Initialize a preset image enhancement strategy based on the display environment sequence data, and adaptively compensate the preset image enhancement strategy by combining the application scenario characteristics and image characteristics of the displayed content to obtain the image enhancement strategy.

[0064] Specifically, a preset image enhancement strategy refers to a set of image processing rules pre-defined by the system to improve the visual effect of displayed content, such as adjusting brightness, contrast, and color saturation. Adaptive compensation dynamically adjusts the preset image enhancement strategy based on real-time acquired display environment sequence data and the characteristics of the displayed content to adapt to different environments and display needs.

[0065] Specifically, the application scenario characteristics of the displayed content refer to the specific usage scenario in which the displayed content is used, such as industrial monitoring, medical equipment operation, etc. Different scenarios have specific requirements for the readability and visual effects of the displayed content. Image characteristics refer to the characteristics of the displayed content itself, such as image resolution, color distribution, texture, etc.

[0066] In some embodiments, initializing a preset image enhancement strategy based on the display environment sequence data includes:

[0067] Analyze the display environment sequence data to determine the most unfavorable display environment information under the current display conditions; match and invoke a preset image enhancement strategy based on the most unfavorable display environment information, and initialize it.

[0068] Specifically, when a change in the current display environment is detected or the system is started for the first time, a set of image enhancement parameters that best matches the current environmental conditions is automatically selected and activated based on the collected display environment sequence data to optimize the display effect.

[0069] Specifically, the most unfavorable display environment information refers to the environmental state (corresponding to a set of environmental information) that has the greatest impact on image visibility in the current display environment, such as extremely low ambient light (making the screen content difficult to recognize), strong backlight (causing severe screen reflection), and high color temperature deviation (causing color distortion of the picture), etc.

[0070] Specifically, image enhancement strategies typically include parameter adjustment schemes such as brightness enhancement, contrast enhancement, color temperature compensation, and sharpening. Preset strategies are a set of optimal display parameter combinations predefined for typical environmental scenarios (such as indoor low light, outdoor strong light, nighttime operation, etc.).

[0071] Specifically, after collecting display environment sequence data over a period of time, the system first performs statistical analysis and feature extraction to identify key influencing factors of the current environment. For example, if the ambient light intensity obtained from continuous sampling is below 80 Lux and the color temperature is below 3200K, the system can determine that the current environment is a low-light, warm-color environment. Then, through a preset environment classification model or threshold judgment rule, the system identifies the factors most detrimental to the display in the current environment, such as low brightness + high color temperature deviation or strong light reflection.

[0072] Furthermore, the system searches a pre-defined image enhancement strategy library for the strategy that best matches the environmental conditions. For example, in low-light environments, it automatically activates night mode, which reduces screen brightness by 20%, adjusts the color temperature to 4500K, and increases contrast by 15%. This process initializes the image enhancement strategy, ensuring that it can quickly adapt to the current environment without user intervention.

[0073] Through the above process, the display strategy can be quickly matched and initialized at startup or in the early stages of environmental changes, improving the adaptability and visibility of displayed content in different environments. Compared with traditional fixed display parameter settings, this method has stronger environmental adaptability, effectively reducing the image quality degradation caused by environmental changes, and improving user operating efficiency and visual comfort under complex conditions such as industrial, outdoor, and nighttime environments.

[0074] In addition, the mechanism for invoking preset strategies provides a foundation for subsequent dynamic adjustments, enabling the system to continue fine-grained optimization based on environmental changes after strategy initialization, thereby achieving continuous enhancement of display effects.

[0075] In some embodiments, the preset image enhancement strategy is adaptively compensated by combining the application scenario characteristics and image features of the displayed content to obtain the image enhancement strategy, including:

[0076] The process involves: acquiring application scenario features of the displayed content, wherein the application scenario features include at least a probability distribution of display format and information density; matching a corresponding first image enhancement compensation strategy in an adaptive compensation rule base based on the application scenario features; acquiring image features of the displayed content, wherein the image features include at least image contrast, information entropy, and color moments; matching a second image enhancement compensation strategy in the adaptive compensation rule base based on the image features; and performing joint compensation on the preset image enhancement strategy based on the first image enhancement compensation strategy and the second image enhancement compensation strategy to obtain a compensated image enhancement strategy.

[0077] Adaptive compensation refers to the process of dynamically adjusting and optimizing the enhancement strategy based on the existing preset image enhancement strategy, combined with the specific application scenario characteristics of the displayed content and the visual attributes of the image itself, in order to further improve the matching degree and adaptability of the display effect.

[0078] Specifically, the application scenario characteristics of the displayed content refer to the semantic or functional characteristics related to the current display task, such as the probability distribution of display forms (i.e., the statistical distribution of the proportion of text, images, charts, videos, etc. in the current interface) and information density (i.e. the amount of effective information contained in a unit area, such as the number of words, graphic complexity, etc.); image features refer to the visual attribute indicators extracted from the currently displayed image, including contrast (measuring the difference between the brightness and darkness of the image), information entropy (reflecting the richness or complexity of image information), and color moments (statistics describing the overall color distribution of the image).

[0079] Specifically, the adaptive compensation rule base is a pre-defined set of mapping relationships that records image enhancement compensation strategies corresponding to different application scenario features and image features, used to quickly match and adjust display parameters at runtime.

[0080] Specifically, after initializing the image enhancement strategy, the contextual information of the currently displayed content is further obtained. First, by analyzing the structure and content composition of the display interface, the characteristics of the application scenario are obtained. For example, in a certain industrial control interface, if the proportion of charts is 60%, text is 30%, and images are 10%, then the probability distribution of the display form is [charts 0.6, text 0.3, images 0.1]; the information density can be calculated by the number of elements per unit area or the pixel change rate.

[0081] Furthermore, based on the characteristics of the application scenario, the first image enhancement compensation strategy is matched in the adaptive compensation rule base. For example, in scenarios with high information density and dominated by charts, edge sharpness and contrast are enhanced first to improve readability.

[0082] Furthermore, image features are extracted from the currently displayed image, image contrast, information entropy, and color moments are calculated, and a second image enhancement compensation strategy is matched in the rule base accordingly. For example, in an image with low contrast and low information entropy, the brightness range and color saturation are enhanced to improve visual saliency.

[0083] Finally, the first and second compensation strategies are fused with the original preset image enhancement strategy, such as by using weighted average, intersection, union or priority superposition, to generate the final compensated image enhancement strategy.

[0084] Through the above process, not only is the image enhancement strategy initialized based on environmental conditions, but it is also further optimized in a personalized manner by combining the semantic structure of the displayed content and the visual characteristics of the image, thereby achieving a higher precision and more adaptable image enhancement effect. This method can dynamically adjust the enhancement strategy under different display tasks (such as chart display, text reading, and image browsing) and different image quality conditions, avoiding the problems of over-enhancement or under-enhancement, and improving information transmission efficiency and visual experience.

[0085] S400: Based on the terminal motion sequence data, identify the motion state, extract the minimum period motion pattern with stable periodic characteristics, and perform motion compensation of the displayed content according to the minimum period motion pattern to obtain a motion compensation strategy.

[0086] Specifically, terminal motion sequence data refers to a series of data collected by accelerometers and other sensors that reflect the motion state of the industrial control tablet. This data includes information such as the device's acceleration, speed, and displacement at different points in time.

[0087] Specifically, motion state recognition refers to the process of determining the type and state of a device's motion by analyzing the terminal's motion sequence data, such as being stationary, moving at a constant speed, or vibrating. Minimum cycle motion pattern refers to a motion pattern with stable periodic characteristics extracted from motion sequence data. It can be used to predict and compensate for the impact of device motion on displayed content, such as adjusting the refresh rate of the display content or performing image stabilization.

[0088] In some embodiments, motion state recognition is performed based on the terminal motion sequence data, a minimum period motion pattern with stable periodic characteristics is extracted, and motion compensation of the displayed content is performed according to the minimum period motion pattern to obtain a motion compensation strategy, including:

[0089] Periodic identification is performed on the terminal motion sequence data to extract the minimum periodic motion pattern; wavelet decomposition is performed on the minimum periodic motion pattern to obtain a set of decomposed motion patterns composed of multiple basic vibration patterns; motion inversion is performed on each of the decomposed motion pattern sets to generate a set of periodic motion compensation parameter sequences; the set of periodic motion compensation parameter sequences is superimposed and fused, and time alignment processing is performed to output the result as the motion compensation strategy.

[0090] Specifically, terminal motion sequence data refers to a data sequence continuously collected by inertial measurement units (such as accelerometers, gyroscopes, magnetometers, etc.) that describes the motion state of a flat plate in space, typically including information such as acceleration, angular velocity, and attitude angle. Minimum periodic motion pattern, on the other hand, refers to the basic unit within the identified periodic motion that has the shortest time span and can completely describe the characteristics of that motion.

[0091] Specifically, motion compensation strategy refers to a set of parameters that are dynamically adjusted based on the visual offset or blurring of the displayed content caused by the movement of the terminal. It often includes screen position prediction, blur correction, and display delay compensation.

[0092] Specifically, the process begins by periodic detection of the terminal motion sequence data. Methods such as autocorrelation analysis, Fourier transform, or zero-crossing rate analysis can be used to identify the main periodic signals. Next, wavelet decomposition is performed on this periodic motion pattern, such as a three-level decomposition using the Daubechies wavelet, yielding multiple fundamental vibration modes in different frequency bands (e.g., high-frequency noise components, low-frequency oscillation trends). Subsequently, motion inversion processing is performed on each fundamental vibration mode, predicting the motion trend in future moments to generate a corresponding set of periodic motion compensation parameters that cancel out the motion trend. For example, for a low-frequency oscillation trend, the predicted angle change within the next 0.2 seconds is +3°, and an image offset compensation parameter of -3° is generated accordingly.

[0093] Furthermore, multiple compensation parameter sequences are weighted, superimposed, and fused, and temporal alignment (such as using Kalman filtering or time window sliding alignment) is used to ensure the consistency of each component on the time axis, ultimately outputting a complete motion compensation strategy.

[0094] Through the above process, the minimum periodic motion characteristics of the terminal can be automatically identified and modeled based on its actual motion behavior, thereby achieving accurate motion compensation for the displayed content. Compared with traditional static compensation methods, this method has higher dynamic responsiveness and predictive ability, and is particularly suitable for application scenarios with obvious periodic motion, such as handheld walking or the swinging of a robotic arm during robot inspection. Specifically, by using wavelet decomposition and multi-scale motion inversion, it can address the different effects of high-frequency vibration and low-frequency swaying on the displayed content, improving image stability and readability, effectively reducing visual ghosting, image jitter, and other problems, and enhancing display reliability and user experience in complex dynamic environments.

[0095] S500: Combine the image enhancement strategy with the motion compensation strategy to perform compensation processing on the displayed content.

[0096] Specifically, image enhancement strategies refer to processing schemes that improve the visual effect of images by adjusting parameters such as brightness, contrast, and color saturation. Motion compensation strategies refer to processing schemes that reduce the impact of device motion on the displayed content by adjusting the refresh rate of the displayed content and applying image stabilization algorithms.

[0097] By employing image enhancement and motion compensation strategies, the displayed content can be comprehensively optimized to improve its readability and visual effect under different environments and motion conditions. This integrated processing not only considers the impact of environmental factors on display effects but also solves the visual interference problem caused by device movement. For example, in poor lighting conditions and with device vibration, image enhancement strategies can improve the readability of the displayed content, while motion compensation strategies can reduce screen jitter, allowing operators to see stable display content more clearly.

[0098] In some embodiments, the image enhancement strategy and the motion compensation strategy are combined to perform compensation processing on the displayed content, including:

[0099] Based on the image enhancement strategy and the display environment sequence data, the equivalent display delay for the human eye is calculated; it is determined whether the equivalent display delay for the human eye exceeds a set delay threshold; if the equivalent display delay exceeds the delay threshold, an overshoot is calculated, and the motion compensation strategy is adjusted to resist overshoot based on the overshoot.

[0100] Specifically, the equivalent display latency for the human eye refers to the image response latency subjectively perceived by the human eye after comprehensively considering image enhancement strategies, motion compensation strategies, and external display environments (such as terminal acceleration, jitter frequency, and changes in ambient light). This latency includes not only system processing latency (such as image rendering and compensation calculation time) but also prediction errors introduced by motion compensation strategies and the processing load brought by image enhancement processing. The latency threshold is a preset upper limit, usually set based on the perceptible threshold of the human eye (e.g., 20-50ms). Exceeding this threshold may cause image ghosting, visual discomfort, or even motion sickness.

[0101] Specifically, anti-overshoot adjustment refers to the process of adjusting parameters such as prediction amplitude, response speed, or filtering intensity in the motion compensation strategy when the delay exceeds the limit, thereby suppressing image overshoot or reverse jitter caused by overcompensation and stabilizing the visual output.

[0102] Specifically, after independently calculating the image enhancement strategy and motion compensation strategy, the effects of both are further integrated, and combined with real-time acquired display environment sequence data (such as terminal acceleration change rate, angular velocity fluctuation, ambient light intensity changes, etc.), the equivalent display delay for the human eye in the current frame is calculated. For example, if the processing delay introduced by the image enhancement strategy is 12ms, the prediction error introduced by the motion compensation strategy is converted to 8ms, and the visual lag caused by the current acceleration change of the terminal is equivalent to 6ms, then the total equivalent display delay for the human eye is 26ms.

[0103] Furthermore, the equivalent display delay for the human eye is compared with a set threshold (e.g., 25ms). If it exceeds the threshold, an overshoot is calculated (e.g., 1ms). Subsequently, the motion compensation strategy is adjusted to mitigate overshoot. This may include: reducing the compensation gain (e.g., decreasing the angle prediction correction factor from 1.2 to 0.9), shortening the prediction time window (e.g., from 300ms to 200ms), and enhancing the low-pass filter coefficient (e.g., from 0.7 to 0.9), to reduce the compensation response speed and decrease image misalignment or reverse shift caused by prediction errors.

[0104] Through the above process, while integrating image enhancement and motion compensation strategies, the final visual latency can be dynamically evaluated and controlled, ensuring the stability and comfort of image display. Especially in high-dynamic scenarios, such as rapid terminal movement or drastic environmental changes, the anti-overshoot adjustment mechanism suppresses visual overshoot caused by over-prediction or enhancement processing, effectively preventing image jitter or visual bounce. Simultaneously, this mechanism can balance the trade-off between image sharpness and response speed, improving visual consistency and user experience in complex dynamic environments.

[0105] In some embodiments, fusing the image enhancement strategy and the motion compensation strategy to perform compensation processing on the displayed content further includes:

[0106] A lightweight visual semantic segmentation model is used to identify key information regions in the displayed content. These key information regions are then functionally classified, with text and image information regions identified as the first type of key regions and color block regions identified as the second type of key regions. Image enhancement and motion compensation strategies are applied simultaneously to the first type of key regions, while only image enhancement strategies are applied to the second type of key regions.

[0107] Specifically, lightweight visual semantic segmentation models refer to image segmentation algorithms with fast inference capabilities that run on resource-constrained terminal devices (such as handheld devices and inspection robots). They often employ lightweight neural network architectures such as Fast-SCNN or BiSeNet. The goal of this model is to divide an image into semantically meaningful regions, such as text, icons, backgrounds, and color blocks.

[0108] Specifically, key information areas are image content areas that play a crucial role in user perception and task completion, typically including text and image descriptions, interface buttons, and alarm information. Based on the semantics and purpose of these areas, key information areas can be divided into different processing categories. For example, in this embodiment, text and image information areas are defined as the first type of key area, and color block areas are defined as the second type of key area. The purpose of this classification is to customize differentiated image processing strategies for different types of areas to achieve resource optimization and maximize display effects.

[0109] Specifically, after calculating motion compensation and image enhancement strategies, a lightweight semantic segmentation model is further introduced to perform semantic analysis on the current display frame, identifying areas such as text descriptions, icons, and color block backgrounds. For example, in an industrial inspection interface, the model can identify the temperature reading area in the upper left corner (the first type of key area) and the status indicator color block in the lower right corner (the second type of key area). Subsequently, differentiated processing strategies are applied to different areas according to their functional classification. For the first type of key area (text and image information area), both image enhancement strategies (such as edge sharpening and contrast enhancement) and motion compensation strategies (such as image stabilization based on predicted displacement) are applied to ensure that the text information remains clearly readable even when the terminal is in motion. For the second type of key area (color block area), only image enhancement strategies, such as color saturation enhancement and brightness equalization, are applied to reduce the computational load and avoid color shifts or flickering caused by unnecessary compensation.

[0110] Through the above process, not only is intelligent zoning of displayed content achieved, but image processing resources are also dynamically allocated based on the importance and visual sensitivity of each area, improving overall display efficiency and visual experience. Specifically, the dual compensation processing for the first type of key areas ensures the clear discernibility of critical graphic information in dynamic scenes, helping to improve user task completion efficiency and information acquisition accuracy; while the lightweight processing for the second type of areas effectively reduces the system's computational burden, avoiding visual interference or increased energy consumption caused by over-processing.

[0111] In other words, the aforementioned differentiated compensation strategy achieves an optimal balance between system resources and visual quality while ensuring the stability of core information, making it suitable for application scenarios with high requirements for real-time performance and readability.

[0112] In some embodiments, fusing the image enhancement strategy and the motion compensation strategy to perform compensation processing on the displayed content further includes:

[0113] The motion compensation strategy is iterated to determine the maximum motion compensation range; the edge buffer parameters are configured based on the boundary difference between the maximum motion compensation range and the original display content; and the edge areas of the display content are buffered and reconstructed based on the edge buffer parameters.

[0114] Specifically, the maximum motion compensation range refers to the maximum boundary range within which a pixel or region in the displayed content may be translated or transformed under the action of the motion compensation strategy. It is usually determined by factors such as the device's maximum acceleration, angular velocity, and prediction time window.

[0115] Specifically, the edge buffer parameter is designed to address the issue of content loss due to edge cropping or black borders during the compensation process. It reserves a certain number of pixels at the edge of the original displayed content, and its size is dynamically set based on the maximum motion compensation range. Buffer reconstruction is used to introduce additional content or perform image expansion processing in the image edge area to ensure that the display area is always effectively filled during image translation caused by motion compensation, avoiding blank spaces, distortions, or visual jumps.

[0116] Specifically, before executing the motion compensation strategy, the compensation parameter sequence is first traversed to analyze the maximum displacement range that each frame of the image may have under predictive compensation. For example, in a certain scene, the terminal's maximum angular velocity is 10° / s, the prediction time window is 200ms, and combined with the viewpoint transformation model, the maximum displacement of the image can be estimated to be 15 pixels. Based on this, the maximum motion compensation range can be determined to be ±15 pixels, and this value is used as the basis for designing the edge buffer.

[0117] Specifically, the buffer is then expanded outside the boundaries of the original displayed content, such as reserving a 20-pixel area around each side of the image. This buffer can be constructed in various ways, such as mirroring the original image, repeating edge content, filling content based on image context (e.g., using image inpainting algorithms), scaling the original content, or rearranging. During subsequent motion compensation, when the image content shifts due to compensation, the blank areas can be automatically filled using the edge buffer content, ensuring continuous, complete, and visually tear-free image display.

[0118] The above process solves the problem of image edge information loss caused by motion compensation, and improves the integrity and stability of image display, especially in high dynamic mobile scenarios, such as handheld device shaking and robot inspection turning.

[0119] In summary, the environmentally aware industrial control tablet display content compensation processing method provided by the present invention has the following technical effects:

[0120] By configuring multiple types of environmental sensors, real-time environmental information is collected in the target usage scenario to obtain environmental perception sequence data. The environmental perception sequence data is separated to generate display environment sequence data to characterize the display environment state and terminal motion sequence data to characterize the terminal motion state. Based on the display environment sequence data, a preset image enhancement strategy is initialized, and adaptive compensation is performed on the preset image enhancement strategy in combination with the application scenario characteristics and image features of the displayed content to obtain the image enhancement strategy. Based on the terminal motion sequence data, motion state recognition is performed to extract the minimum periodic motion pattern with stable periodic characteristics, and motion compensation of the displayed content is performed according to the minimum periodic motion pattern to obtain the motion compensation strategy. The image enhancement strategy and motion compensation strategy are fused to perform compensation processing on the displayed content, thereby achieving the technical effect of combining multi-factor comprehensive compensation, improving compensation adaptability and compensation efficiency, and improving compensation effect.

[0121] Example 2, as Figure 2 This is a schematic diagram of the structure of an environmentally aware industrial control tablet display content compensation processing system according to the present invention. For example, Figure 1 The flowchart of the environmental sensing industrial control tablet display content compensation processing method of the present invention can be illustrated as follows: Figure 2 The structure shown is implemented.

[0122] Based on the same concept as the environmentally aware industrial control tablet display content compensation processing method in the above embodiment, the present invention also provides an environmentally aware industrial control tablet display content compensation processing system, comprising:

[0123] The environmental perception module 11 is used to collect real-time environmental information in the target usage scenario and obtain environmental perception sequence data through configured multi-type environmental sensors.

[0124] The data separation module 12 is used to separate the environmental perception sequence data to generate display environment sequence data for representing the display environment state and terminal motion sequence data for representing the terminal motion state.

[0125] The image enhancement strategy acquisition module 13 is used to initialize a preset image enhancement strategy based on the display environment sequence data, and adaptively compensate the preset image enhancement strategy by combining the application scenario characteristics and image characteristics of the display content to acquire the image enhancement strategy.

[0126] The motion compensation strategy acquisition module 14 is used to identify motion state based on the terminal motion sequence data, extract the minimum period motion pattern with stable periodic characteristics, and perform motion compensation of the displayed content according to the minimum period motion pattern to acquire a motion compensation strategy.

[0127] The compensation processing execution module 15 is used to fuse the image enhancement strategy and the motion compensation strategy to perform compensation processing on the displayed content.

[0128] In some embodiments, the multi-type environmental sensors include at least a light sensor, a color temperature sensor, an acceleration sensor, and an audio sensor.

[0129] In some embodiments, the image enhancement strategy acquisition module 13 includes:

[0130] The worst display environment information determination unit is used to analyze the display environment sequence data and determine the worst display environment information under the current display conditions.

[0131] The preset image enhancement strategy invocation and initialization unit is used to match and invoke the preset image enhancement strategy according to the worst-case display environment information, and to initialize it.

[0132] In some embodiments, the image enhancement strategy acquisition module 13 further includes:

[0133] An application scenario feature acquisition unit is used to acquire application scenario features of the displayed content, wherein the application scenario features include at least the probability distribution of display format and information density.

[0134] The first image enhancement compensation strategy matching unit is used to match the corresponding first image enhancement compensation strategy in the adaptive compensation rule base according to the application scenario characteristics.

[0135] An image feature acquisition unit is used to acquire image features of the displayed content, wherein the image features include at least image contrast, information entropy, and color moments.

[0136] The second image enhancement compensation strategy matching unit is used to match a second image enhancement compensation strategy in the adaptive compensation rule base according to the image features.

[0137] The image enhancement strategy compensation unit is used to perform joint compensation on the preset image enhancement strategy based on the first image enhancement compensation strategy and the second image enhancement compensation strategy to obtain the compensated image enhancement strategy.

[0138] In some embodiments, the motion compensation strategy acquisition module 14 includes:

[0139] The minimum periodic motion pattern extraction unit is used to identify the periodicity of the terminal motion sequence data and extract the minimum periodic motion pattern.

[0140] The decomposed motion mode set acquisition unit is used to perform wavelet decomposition on the minimum periodic motion mode to obtain a decomposed motion mode set composed of multiple basic vibration modes.

[0141] The periodic motion compensation parameter sequence set generation unit is used to traverse the decomposed motion mode set and perform motion inversion respectively to generate a periodic motion compensation parameter sequence set.

[0142] The motion compensation strategy output unit is used to superimpose and fuse the set of periodic motion compensation parameter sequences, perform time alignment processing, and output the result as the motion compensation strategy.

[0143] In some embodiments, the compensation processing execution module 15 includes:

[0144] The human eye equivalent display delay calculation unit is used to calculate the human eye equivalent display delay based on the image enhancement strategy and the display environment sequence data.

[0145] The delay threshold determination unit is used to determine whether the equivalent display delay of the human eye exceeds the set delay threshold.

[0146] The motion compensation strategy anti-overshoot adjustment unit is used to calculate the overshoot amount if the equivalent display delay exceeds the delay threshold, and adjust the motion compensation strategy to prevent overshoot based on the overshoot amount.

[0147] In some embodiments, the compensation processing execution module 15 further includes:

[0148] The key information region identification unit is used to identify key information regions in the displayed content through a lightweight visual semantic segmentation model.

[0149] The key area functional classification unit is used to classify the key information areas by function, and to determine the graphic information area as the first type of key area and the color block area as the second type of key area.

[0150] The key area compensation strategy application unit is used to apply both image enhancement and motion compensation strategies to the first type of key areas, and to apply only image enhancement strategies to the second type of key areas.

[0151] In some embodiments, the compensation processing execution module 15 further includes:

[0152] The maximum motion compensation range determination unit is used to traverse the motion compensation strategy and determine the maximum motion compensation range.

[0153] The edge buffer parameter configuration unit is used to configure the edge buffer parameters based on the boundary difference between the maximum motion compensation range and the original display content.

[0154] An edge region buffer reconstruction unit is used to perform buffer reconstruction on the edge region of the displayed content based on the edge buffer parameters.

[0155] It should be understood that the focus of the embodiments mentioned in this specification is their difference from other embodiments. The specific embodiments in the aforementioned Embodiment 1 are also applicable to the environmental awareness industrial control tablet display content compensation processing system described in Embodiment 2. For the sake of brevity, they will not be further elaborated here.

[0156] It should be understood that the embodiments disclosed in this invention and the above description enable those skilled in the art to implement this invention. However, this invention is not limited to the embodiments mentioned above. It should be understood that those skilled in the art can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this invention, and should all be included within the protection scope of this invention.

Claims

1. A method for compensating display content on an industrial control tablet with environmental awareness, characterized in that, include: By configuring multiple types of environmental sensors, real-time environmental information is collected in the target usage scenario to obtain environmental perception sequence data; The environmental perception sequence data is separated to generate display environment sequence data for representing the display environment state and terminal motion sequence data for representing the terminal motion state. The preset image enhancement strategy is initialized based on the display environment sequence data, and adaptive compensation is performed on the preset image enhancement strategy in combination with the application scenario characteristics and image characteristics of the display content to obtain the image enhancement strategy. Based on the terminal motion sequence data, motion state recognition is performed, the minimum period motion pattern with stable periodic characteristics is extracted, and motion compensation of the displayed content is performed according to the minimum period motion pattern to obtain a motion compensation strategy. The image enhancement strategy and the motion compensation strategy are combined to perform compensation processing on the displayed content; Specifically, by combining the application scenario characteristics and image features of the displayed content, adaptive compensation is performed on the preset image enhancement strategy to obtain the image enhancement strategy, including: The application scenario characteristics of the displayed content are obtained, wherein the application scenario characteristics include at least the probability distribution of display format and information density; Based on the characteristics of the application scenario, the corresponding first image enhancement compensation strategy is matched in the adaptive compensation rule base; Obtain image features of the displayed content, wherein the image features include at least image contrast, information entropy, and color moments; Based on the image features, a second image enhancement compensation strategy is matched in the adaptive compensation rule base; Based on the first image enhancement compensation strategy and the second image enhancement compensation strategy, the preset image enhancement strategy is jointly compensated to obtain the compensated image enhancement strategy. Specifically, motion state recognition is performed based on the terminal motion sequence data, a minimum period motion pattern with stable periodic characteristics is extracted, and motion compensation of the displayed content is performed according to the minimum period motion pattern to obtain a motion compensation strategy, including: Periodicity identification is performed on the terminal motion sequence data to extract the minimum periodic motion pattern; Wavelet decomposition is performed on the minimum periodic motion pattern to obtain a set of decomposed motion patterns consisting of multiple basic vibration patterns; The decomposed motion mode set is traversed and motion inversion is performed on each mode to generate a set of periodic motion compensation parameter sequences. The set of periodic motion compensation parameter sequences is superimposed and fused, and time alignment processing is performed to output the result as the motion compensation strategy.

2. The method for compensating display content of an industrial control tablet computer based on environmental perception as described in claim 1, characterized in that, The various types of environmental sensors include at least a light sensor, a color temperature sensor, an acceleration sensor, and an audio sensor.

3. The method for compensating display content of an environmentally aware industrial control tablet as described in claim 2, characterized in that, Initialize a preset image enhancement strategy based on the display environment sequence data, including: Analyze the display environment sequence data to determine the most unfavorable display environment information under the current display conditions; Based on the worst-case display environment information, a preset image enhancement strategy is matched and invoked, and then initialized.

4. The method for compensating display content of an industrial control tablet computer based on environmental perception as described in claim 1, characterized in that, By fusing the image enhancement strategy and the motion compensation strategy, compensation processing is performed on the displayed content, including: Based on the image enhancement strategy and the display environment sequence data, the equivalent display delay for the human eye is calculated. Determine whether the equivalent display delay of the human eye exceeds a set delay threshold; If the equivalent display delay exceeds the delay threshold, an overshoot is calculated, and the motion compensation strategy is adjusted to resist overshoot based on the overshoot.

5. The method for compensating the display content of an industrial control tablet computer with environmental awareness as described in claim 4, characterized in that, The method of combining the image enhancement strategy and the motion compensation strategy to perform compensation processing on the displayed content further includes: A lightweight visual semantic segmentation model is used to identify key information areas in the displayed content. The key information areas are functionally classified, and the graphic and text information areas are identified as the first type of key areas, while the color block areas are identified as the second type of key areas. For the first type of key regions, both image enhancement and motion compensation strategies are applied simultaneously, while for the second type of key regions, only image enhancement strategies are applied.

6. The method for compensating display content of an industrial control tablet computer based on environmental perception as described in claim 1, characterized in that, The method of combining the image enhancement strategy and the motion compensation strategy to perform compensation processing on the displayed content further includes: Iterate through the motion compensation strategies to determine the maximum motion compensation range; Configure edge buffer parameters based on the boundary difference between the maximum motion compensation range and the original displayed content; The edge regions of the displayed content are buffered and reconstructed based on the edge buffer parameters.

7. An environmentally-aware industrial control panel display content compensation processing system, characterized in that, A method for compensating the display content of an industrial control tablet computer with environmental awareness as described in any one of claims 1 to 6 includes: The environmental perception module is used to collect real-time environmental information in the target usage scenario through configured multiple types of environmental sensors and obtain environmental perception sequence data; The data separation module is used to separate the environmental perception sequence data to generate display environment sequence data that characterizes the display environment state and terminal motion sequence data that characterizes the terminal motion state. The image enhancement strategy acquisition module is used to initialize a preset image enhancement strategy based on the display environment sequence data, and adaptively compensate the preset image enhancement strategy by combining the application scenario characteristics and image characteristics of the display content to obtain the image enhancement strategy. The motion compensation strategy acquisition module is used to identify motion state based on the terminal motion sequence data, extract the minimum period motion pattern with stable periodic characteristics, and perform motion compensation of the displayed content according to the minimum period motion pattern to acquire the motion compensation strategy. The compensation processing execution module is used to fuse the image enhancement strategy and the motion compensation strategy to perform compensation processing on the displayed content.

Images