Display processing method and device and display equipment

Abstract

The invention discloses a display processing method and device and display equipment, and relates to the field of information processing.The display processing method is applied to the display equipment and comprises the steps that display data are obtained; the display data reflect the display change of the display equipment; obtaining environmental data; the environment data reflect the characteristic change of the environment where the display equipment is located; determining a first association relationship between the display data and the environment data, and performing output display based on the first association relationship; the display data and the environment data have the same timestamp configured by the display equipment.

Description

Technical Field

[0001] This application relates to the field of information processing, and more particularly to a display processing method, apparatus, and display device. Background Technology

[0002] As an important output device, display devices provide users with a rich visual experience. Setting the display device to inappropriate parameters, such as being too bright or too dark, or having an overly cool or warm color tone, will negatively impact the user's visual experience. Therefore, it is necessary to adjust the display device's parameters.

[0003] Adjusting current display parameters typically requires users to manually switch brightness, color temperature, and other display parameters through multiple OSD (on-screen display) menus based on their current usage scenario. Since most users are unfamiliar with the meaning of these parameters, quickly adjusting them to suitable values ​​is impossible, making the process complex. Summary of the Invention

[0004] The first aspect of this application provides a display processing method applied to a display device, comprising:

[0005] Obtain display data; the display data reflects the display changes of the display device;

[0006] Obtain environmental data; the environmental data reflects the characteristic changes of the environment in which the display device is located;

[0007] A first association relationship is determined between the display data and the environmental data, and the output display is performed based on the first association relationship; the display data and the environmental data have the same timestamp configured by the display device.

[0008] A second aspect of this application provides a display processing apparatus, comprising:

[0009] The first module is used to obtain display data; the display data reflects the display changes of the display device.

[0010] The second module is used to obtain environmental data; the environmental data reflects the characteristic changes of the environment in which the display device is located.

[0011] The third module is used to determine a first association between the display data and the environmental data, and to output and display based on the first association; the display data and the environmental data have the same timestamp configured by the display device.

[0012] A third aspect of this application provides a display device, comprising:

[0013] A processor is configured to: acquire display data reflecting changes in the display of a display device; acquire environmental data reflecting characteristic changes in the environment in which the display device is located; determine the correlation between the display data and the environmental data; and ensure that the display data and the environmental data share the same timestamp configured on the display device.

[0014] A display screen is used to display output based on the aforementioned association.

[0015] The fourth aspect of this application provides a computer program product including computer-readable instructions that, when executed on an electronic device, cause the electronic device to implement the display processing method of the first aspect or any implementation thereof.

[0016] A fifth aspect of this application provides an electronic device, comprising at least one processor and a memory connected to the processor, wherein:

[0017] The memory is used to store computer programs;

[0018] The processor is used to execute the computer program so that the electronic device can implement the display processing method of the first aspect or any implementation thereof.

[0019] The sixth aspect of this application provides a computer storage medium carrying one or more computer programs, which, when executed by an electronic device, enable the electronic device to perform the display processing method described in the first aspect or any implementation thereof. Attached Figure Description

[0020] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0021] Figure 1 This is a schematic flowchart of a display processing method provided in an embodiment of this application;

[0022] Figure 2 This is a schematic diagram of the process of obtaining display data, obtaining environmental data, and determining the first association relationship between display data and environmental data provided in the embodiments of this application;

[0023] Figure 3 This is a flowchart illustrating the process of processing a first feature set and a second feature set based on a third model to determine a first association relationship, provided in an embodiment of this application.

[0024] Figure 4 This is a schematic diagram of the process provided in the embodiments of this application for obtaining environmental data, determining a first correlation between display data and environmental data, and outputting and displaying based on the first correlation.

[0025] Figure 5 This is a schematic diagram of the output display based on the second strategy provided in an embodiment of this application;

[0026] Figure 6 This is a schematic diagram illustrating an application scenario of a display processing method provided in an embodiment of this application;

[0027] Figure 7 This is a schematic diagram of the structure of a display processing device provided in an embodiment of this application;

[0028] Figure 8 This is a schematic diagram of the structure of a display device provided in an embodiment of this application. Detailed Implementation

[0029] The embodiments of this application are described below with reference to the accompanying drawings. The terminology used in the implementation section of this application is for explaining specific embodiments only and is not intended to limit the scope of this application.

[0030] The embodiments of this application will now be described with reference to the accompanying drawings. Those skilled in the art will recognize that, with technological advancements and the emergence of new scenarios, the technical solutions provided in the embodiments of this application are equally applicable to similar technical problems.

[0031] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such terms are interchangeable where appropriate; this is merely a way of distinguishing objects with the same attributes in the embodiments of this application. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, so that a process, method, system, product, or apparatus that comprises a series of elements is not necessarily limited to those elements, but may include other elements not explicitly listed or inherent to those processes, methods, products, or apparatuses.

[0032] Reference Figure 1 , Figure 1 This is a flowchart illustrating a display processing method provided in an embodiment of this application, as shown below. Figure 1 As shown in the embodiment of this application, a display processing method can be applied to a display device and may include steps 101 to 103, which are described in detail below.

[0033] 101. Obtain display data; display data reflects changes in the display device's display.

[0034] The display device using this display processing method can be any device with display function, such as a desktop computer, laptop computer, tablet computer, mobile phone, etc. This application does not limit the specific form of the display device.

[0035] This display data can include the display parameters and content of the display device.

[0036] These display parameters can include static capability parameters of the display device such as brightness, hue, contrast ratio, resolution, refresh rate, color mode, and screen size. The display data can be parameters that directly reflect the device's display effect, or it can include the display content. Different display content will also affect the display effect; the display content can be static pages, videos, etc.

[0037] The display change of this display device is a broad term, which can include changes in the value of display parameters / display content, or the value of display parameters / display content remaining unchanged.

[0038] The display data can be obtained by reading the EDID (Extended Display Identification Data). This EDID is a data structure stored internally in the display. It is stored in the EEPROM (Electrically Erasable Programmable Read-Only Memory) of the Scaler chip (a functional chip used to amplify or reduce video signals to adapt to different display devices and resolution requirements), and communicates with the Scaler via I2C (Inter-Integrated Circuit). The Scaler obtains the display data by reading this storage area.

[0039] In one possible implementation, the display data of the display device can be determined based on a preset rhythm mapping table. First, rhythm information (including geographical location, current time, and season) is obtained from the network module of the display device. Then, based on the rhythm mapping table, the display parameters corresponding to the current rhythm information are determined, and the display parameters of the display device are adjusted accordingly.

[0040] 102. Obtain environmental data; environmental data reflects the characteristic changes of the environment in which the display device is located;

[0041] The environment in which the display device is located can include objects that operate the display screen, as well as other objects in the physical environment. The objects that operate the screen can be users viewing the content displayed on the display device. Other objects in the physical environment can be sound, brightness, color, etc.

[0042] This environmental data refers to relevant data from the environment in which the display device is located, reflecting changes in the characteristics of that environment. These changes can be arbitrary, such as variations in brightness, sound, or color.

[0043] 103. Determine the first association between the display data and the environmental data, and output the display based on the first association; the display data and the environmental data have the same timestamp configured by the display device.

[0044] Analyze the display data and environmental data to determine the first correlation between them. This correlation indicates whether changes in the environmental characteristics are affected by changes in the display device. Accordingly, the output display of the display device can be adjusted based on this first correlation.

[0045] In one possible implementation, the same timestamp configured by the display device can be added to both the display data and the environmental data, making them synchronized in time. By combining the same timestamp, the primary correlation between the two can be determined from a time-dimensional analysis.

[0046] For example, by combining timestamp analysis of the display data and environmental data, it can be determined that the display changes of the display device and the characteristic changes of the environment occur at the same time, and that the display changes can lead to the characteristic changes of the environment. Then, the first correlation between the two can be determined, indicating that the characteristic changes of the environment are affected by the display changes of the display device, and the display of the display device can be adjusted subsequently.

[0047] For example, by combining timestamp analysis of the display data and environmental data, it can be determined that the display change of the display device occurs at the same time as the characteristic change of the environment, and that the display change cannot cause the characteristic change of the environment. Then, it can be determined that the first correlation between the two indicates that the characteristic change of the environment is not affected by the display change of the display device. Subsequently, the display of the display device can be maintained without adjustment.

[0048] The output display can be configured in different ways depending on the first association relationship. This includes adjusting the display parameters of the display device before outputting the content, or adjusting the display parameters currently used by the display device before outputting the content.

[0049] In this embodiment, display data reflecting changes in the display device and environmental data reflecting changes in the environment in which the display device is located are obtained. A first correlation between the display data and the environmental data is determined, and output display is performed based on the first correlation. Moreover, the display data and environmental data have the same timestamp configured for the display device. In this process, the display data and environmental data are analyzed in conjunction with the timestamp to determine whether changes in environmental characteristics are related to changes in the display device, thus obtaining the first correlation between the two. Based on the first correlation, it can be determined whether the output display of the display screen needs to be adjusted. This adjustment may include adjusting the display parameters of the display screen without requiring manual adjustment by the user, thereby achieving automatic adjustment of the display parameters of the display screen and improving the efficiency of adjustment.

[0050] Figure 2 This is a flowchart illustrating the process of obtaining display data, obtaining environmental data, and determining a first association between display data and environmental data, as provided in the embodiments of this application. It may include steps 201 to 205, which are described in detail below.

[0051] 201. Obtain the display data;

[0052] This display data can be obtained by reading the EDID, and includes the static capability parameters of the display device and relevant parameters that affect the display.

[0053] For details on the acquisition process, please refer to the explanation of step 101 above.

[0054] 202. Process the display data based on the first model to obtain a first feature set of the display device; the first feature set includes multiple display features arranged according to timestamps;

[0055] The first model can be a large model with a massive number of parameters and strong data processing capabilities, which can support feature extraction from the displayed data.

[0056] The display feature may include at least one of spatial features and temporal features. The spatial feature of the display feature may be obtained by feature extraction of the display data corresponding to a single timestamp, representing the characteristics of the display data at a certain point in time; the temporal feature of the display feature may be obtained by feature extraction of the display data corresponding to multiple consecutive timestamps, representing the characteristics of the display data changes over a period of time.

[0057] In one possible implementation, the first model processes the display data corresponding to each timestamp separately to extract the spatial features of the display data corresponding to that timestamp, and processes the display data corresponding to multiple consecutive timestamps to extract the temporal features of the display data corresponding to those multiple consecutive timestamps.

[0058] For example, the first feature set of the display data includes temporal features such as the brightness corresponding to each timestamp and the brightness changes over multiple time periods. Between 700ms and 1000ms, the display device maintains a brightness of 300 nits; at 1000ms, the brightness spikes to 500 nits; and at 1010ms, the brightness drops back to 300 nits.

[0059] In one possible implementation, the first model can standardize the display data during processing, unifying display parameters from different sources and with different dimensions into a range of values ​​that are easy to process.

[0060] For example, the nit values ​​(0-1000 nits) read from the brightness are normalized to the range of [0, 1]; the Kelvin values ​​(e.g., 2000K-10000K) read from the color temperature are mapped to the range of [-1, 1], where 0 represents the standard value of 6500K.

[0061] 203. Obtain first environmental data; the first environmental data includes image data reflecting changes in the characteristics of the objects being operated on in the environment;

[0062] The first environmental data may be image data obtained by capturing multiple consecutive frames of images of the environment in which the display device is located. This image data includes objects operating within the environment, namely, users who operate the display device.

[0063] There may be multiple people in the environment, such as the person operating in front of the display device (the object of the operation), and people at a distance. By capturing images of the environment where the display device is located, multiple frames of images are obtained. Each frame contains the person operating in front of the display device, and may also contain people at a distance from the display device.

[0064] Moreover, the objects previously operated on by the display device may change in these multi-frame images; for example, the actions of the objects may change.

[0065] In one possible implementation, a data connection is established between the display device and the image acquisition device, which transmits the acquired images to the display device in real time.

[0066] The image acquisition device can be a regular camera, or it can use a high-definition infrared camera and a TOF (Time of Flight) sensor in a display device.

[0067] The images captured by this high-definition infrared camera can also detect whether the object being operated on is a living person, ensuring that the object in the first environmental data is a real user and not a photograph, thus improving security. The TOF sensor measures the distance between the display device and the object being operated on, forming an infrared image. Correspondingly, the subsequent second model can process the captured images and infrared images to obtain object features.

[0068] 204. Based on the second model, process the first environmental data to obtain a second feature set of the operation object; the second feature set includes multiple object features arranged according to timestamps;

[0069] The second model can be a large model that can support feature extraction from image data.

[0070] The object feature may include at least one of spatial features and temporal features. The spatial feature of the object feature may be obtained by feature extraction from image data corresponding to a timestamp, representing the features of the object at a certain point in time; the temporal feature of the object feature may be obtained by feature extraction from image data corresponding to multiple consecutive timestamps, representing the change features of the object over a period of time.

[0071] In one possible implementation, the second model processes the image data corresponding to each timestamp separately to extract the spatial features of the operation object corresponding to that timestamp, and processes the image data corresponding to multiple consecutive timestamps to extract the temporal features of the operation object over a period of time corresponding to those multiple consecutive timestamps.

[0072] In one possible implementation, a data connection is established between the display device and the image acquisition device. The image acquisition device transmits the acquired images to the display device in real time. The display device adds a timestamp to each frame of image data received according to the configured timestamp, and then processes it using a second model to obtain a second feature set of the operation object.

[0073] For example, the spatial features included in this second feature set are the features of the operation object corresponding to each timestamp, and the temporal features included are the action change features of the operation object corresponding to multiple time periods.

[0074] In one possible implementation, the second model can deploy a pruned and quantized AI (Artificial Intelligence) model using an integrated NPU (Neural-network Processing Unit).

[0075] The object features can include the pupil diameter, eyelid height and width, blinking frequency, head Euler angles, and facial feature points of the object being manipulated.

[0076] The second model detects faces / feature points in the input image data, obtaining the localized face bounding box and coordinates of key points such as eyes and mouth. It also performs eye segmentation on the input image data to accurately segment the iris region and calculates the pupil diameter using pixels. Furthermore, the second model can perform pose estimation on the input image data, calculating head Euler angles (pitch, yaw, roll) based on the 3D and 2D projection relationship of feature points, thus determining the pose of the object being manipulated. Finally, the second model can perform attribute analysis on the input image data, classifying or regressing age ranges and gender probabilities based on full-face features.

[0077] For example, the second feature set records the following: the expression of the object being operated on remains unchanged from 700ms to 1000ms; the user squints at 1000ms; the user's squint continues at 1010ms; and the user's eye movement returns to normal at 2000ms.

[0078] In one possible implementation, each frame of the obtained image data is first normalized, and then the image frames are time-aligned and spatially aligned to scale the images to a fixed size required by the second model input. The images are also enhanced to improve the robustness of the second model in feature extraction.

[0079] The enhancement process may include: if the image is an infrared image, performing histogram equalization on the infrared image to enhance contrast; performing noise reduction in low-light environments; and performing grayscale normalization, etc.

[0080] The second model extracts spatial features from the first environmental data mainly using CNN (Convolutional Neural Networks). It extracts features such as eyes, facial texture, shape, and spatial relationships from a single frame image and outputs a high-dimensional feature vector.

[0081] The second model's process of extracting temporal features from the first environmental data is primarily accomplished by recurrent neural networks (LSTM, Long Short-Term Memory) or TCNs (Temporal Convolutional Networks). In this process, a sequence of spatial feature vectors from multiple consecutive frames is input, and the changing patterns of object features over time are analyzed. For example, analyzing the change curve of the "eyelid aspect ratio" over 20 consecutive frames (approximately 0.66 seconds) helps identify a complete "blink" event and its frequency.

[0082] The second model can also combine the distance between the object being operated on and the display device, the height of the object's shoulders, and the relative positional relationship between the head and shoulders, which are measured by the TOF sensor. The data measured by the TOF sensor can be used together with the image as the first environmental data.

[0083] The data measured by this TOF sensor can be used to determine the posture of the object being manipulated. This posture can help determine whether the user is fatigued. Moreover, this process is a long-term change, and it can be analyzed and processed together with image data to determine the object characteristics of the object being manipulated from two dimensions.

[0084] Furthermore, the TOF sensor measures the distance between the user and the screen, which can determine whether the user is too close to the display device and can alert the user if the distance is too close.

[0085] In one possible implementation, the second model processes the first environmental data and is able to obtain the physiological sequence features of the object being operated on, which constitute the second feature set.

[0086] The physiological sequence features can include core physiological indicators, behavioral and postural indicators, and attribute labels. Core physiological indicators can include: pupil diameter sequence (reflecting incoming light flux and cognitive load), blink frequency and complete blink rate sequence (reflecting visual fatigue and dry eye risk), and PERCLOS (Percentage of Eye Lid Closure over the Pupil, over Time) sequence (the gold standard for measuring drowsiness). Behavioral and postural indicators can include: head Euler angle sequence (reflecting postural stability; frequent nodding may indicate drowsiness) and gaze fixation point sequence (reflecting whether attention is focused on the effective screen area). Attribute labels can include: estimated age range (e.g., youth / middle-aged / elderly), gender probability, and identification of wearing glasses.

[0087] 205. Based on the third model, process the first feature set and the second feature set to determine the first association relationship; there is a one-to-one correspondence between each timestamp, each display feature, and each object feature.

[0088] This third model can be a large model that can support the processing of display features and object features, and determine the primary correlation between feature changes of the operating object in the environment and display changes of the display device.

[0089] In one possible implementation, the third model processes the features in the first and second feature sets according to their corresponding timestamps, fuses the multimodal features, and obtains the first association between the object features and the display features.

[0090] Because the second model can process information in multiple dimensions (images, distances, etc.), it can determine the state of the current object by fusing the information in multiple dimensions, thereby improving the accuracy of the determination. Subsequently, the accuracy of the third model in determining the first relationship is also improved.

[0091] In one possible implementation, the third model can map display features and object features according to timestamps, and then analyze the display features and object features corresponding to the timestamps to determine whether there is a relationship between them, thus obtaining the first relationship.

[0092] During the analysis, this third model can combine temporal and spatial features of the display features to determine the changes in the display features; similarly, it can combine temporal and spatial features of the object features to determine the changes in the object features. By combining the display feature status and the changes in object features, this third model analyzes anomalies in the timestamp object features corresponding to specific display features of the display device, and determines whether the two are strongly correlated features.

[0093] Correspondingly, if the display feature and the object feature are strongly correlated features, it can be determined that the correlation between the display data and the first environmental data is that the change in the first environmental data is related to the display change of the display device; if the display feature and the object feature are not strongly correlated features, it can be determined that the correlation between the display data and the first environmental data is that the change in the first environmental data is not related to the display change of the display device.

[0094] In one possible implementation, a high-precision clock synchronization protocol (such as PTP) can be used to assign a unified timestamp to each frame of image data acquired by the image acquisition device and the display data at the same time.

[0095] It should be noted that the process of obtaining and processing the display data to obtain the first feature set in steps 201-202 and the process of obtaining and processing the first environmental data to obtain the second feature set in steps 203-204 are executed in parallel. The display data and the first environmental data obtained in both steps are executed synchronously so that corresponding timestamps can be added to them. This allows for subsequent processing of the first feature set and the second feature set using the timestamps to determine the first association relationship.

[0096] In this embodiment, display data is obtained; the display data is processed based on a first model to obtain a first feature set of the display device; the first feature set includes multiple display features arranged according to timestamps; first environmental data is obtained; the first environmental data includes image data reflecting feature changes of the operating object in the environment; the first environmental data is processed based on a second model to obtain a second feature set of the operating object; the second feature set includes multiple object features arranged according to timestamps; the first feature set and the second feature set are processed based on a third model to determine a first association relationship; each timestamp, each display feature, and each object feature corresponds one-to-one. By setting the first model, the second model, and the third model respectively, the display data of the display device is processed to obtain multiple display features of the display device, and the image data is processed to obtain multiple object features of the operating object. Combining the timestamps of each display feature and object feature, the first association relationship between the display data and the environmental data is determined. Due to the strong processing capability of the model and the combination of timestamps, it is possible to quickly and accurately determine whether there is an association between the display data and the environmental data, thereby improving processing efficiency.

[0097] Figure 3 This is a flowchart illustrating how a first feature set and a second feature set are processed based on a third model to determine a first association relationship, as provided in an embodiment of this application. It may include steps 301 to 302, which are described in detail below.

[0098] 301. If the first display feature and the first object feature corresponding to the first timestamp satisfy the first condition, determine whether the second object feature corresponding to the second timestamp satisfies the second condition; the second timestamp is the next adjacent timestamp of the first timestamp;

[0099] The first condition could be a sudden change in the display features and object features, while the second condition could be a continued change in the object features.

[0100] If the first display feature and the first object feature corresponding to the first timestamp meet the first condition, it can be determined that at the same timestamp, both of them undergo sudden changes simultaneously. Continue to judge whether the second object feature of the subsequent timestamp meets the second condition.

[0101] For example, the first display feature corresponding to the first timestamp is a sudden increase in brightness, and the first object feature is that the object being operated on squints. Both of these changes are sudden and satisfy the first condition.

[0102] If the first display feature and the first object feature corresponding to the first timestamp satisfy the first condition, it indicates that the feature change of the operation object occurs simultaneously with the display data change of the display device, and is caused by the change of the display device.

[0103] Determining whether the second object feature corresponding to the second timestamp satisfies the second condition can determine whether the second object feature is continuous with the first object feature. If they are continuous, it can be determined that it is the corresponding continuous action of the operation object on the first display feature.

[0104] 302. If the second condition is met, it is determined that the change in the object being operated on is affected by the short-term display of the display device.

[0105] If the second object feature satisfies the second condition, it can be determined that the second object feature is continuous with the first object feature and is a response to the first display feature. Then, the change of the operation object composed of the first object feature and the second object feature is due to the influence of the first display feature.

[0106] Since the first display feature characterizes a short-term display change of the display device, it can be inferred that the change of the object being operated on is due to the short-term display effect of the display device.

[0107] For example, the second object feature corresponding to the second timestamp is the rapid contraction of the pupil of the operation object. This second object feature is a continuous action with the first object feature. It can be determined that the second object feature is a subsequent continuous action of the operation object in response to the sudden brightening of the first object feature. It can be determined that the operation object undergoes a series of changes due to the sudden change in the display feature.

[0108] Based on the first display feature and the second object feature corresponding to the first timestamp satisfying the first condition, the display parameters of the display device are determined at the time corresponding to the first timestamp.

[0109] As an example, if the display screen suddenly experiences a momentary brightness flicker, the user's pupils will be normal but they will squint during the flicker. After the brightness returns to normal, the user's pupils will rapidly contract due to physiological reactions and gradually become a continuous squinting that maintains pupil contraction.

[0110] Table 1 below is a table of timestamps, display features and object features provided in the embodiments of this application. The table records a first feature set (display features) and a second feature set (object features) for time periods corresponding to multiple timestamps.

[0111] Table 1

[0112]

[0113] According to Table 1 above, at 1990ms, the pupil of the subject was 3.8mm and calm. At the precise time point of 2000ms, the "sudden increase in display device brightness" and the "subject's squinting" occurred simultaneously, followed immediately (at 2010ms) by the physiological reflex of "pupil contraction." The third model, by analyzing the object and display characteristics corresponding to the same time stamp and combining the object and display characteristics of the preceding and following time stamps, can determine that the subject's squinting was caused by the sudden increase in display device brightness, thus establishing the primary correlation that the sudden increase in display device brightness caused the subject's squinting. Furthermore, the display device flickering is the "cause," and the subject's squinting and pupil contraction are the "effects," confirming that the change in the subject's characteristics was a "stimulating event."

[0114] In this embodiment, if the first display feature and the first object feature corresponding to the first timestamp satisfy the first condition, it is determined whether the second object feature corresponding to the second timestamp satisfies the second condition; the second timestamp is the next adjacent timestamp after the first timestamp; if the second condition is satisfied, it is determined that the change in the operation object is affected by the short-term display of the display device. By indicating that the first display feature and the first object feature corresponding to the first timestamp that suddenly changes satisfy the first condition, it is characterized that the operation object also changes due to the sudden change in the display feature of the display device, and the change in the operation object continues in subsequent moments while the first display feature returns to normal. This indicates that the change in the operation object is caused by the short-term display of the display device. It is possible to determine whether the stimulating event of the short-term display of the display device affects the operation object, providing a basis for subsequent control of the output display of the display device.

[0115] In one possible implementation, the first feature set and the second feature set are processed based on a third model to determine the first association relationship, including:

[0116] If multiple consecutive display features remain unchanged, and the corresponding changes in multiple object features satisfy the third condition, it can be determined that the change in the object being operated on is affected by the long-term display of the display device.

[0117] The third condition can be a change in the characteristics of the object, which can represent a gradual deterioration of the physiological indicators of the object being operated on. This deterioration can be a gradual change from normal physiological indicators to physiological indicators of fatigue.

[0118] As an example, multiple object characteristics indicate that the object first exhibits a decrease in blinking frequency, followed by prolonged eye closure and head drooping. These characteristics indicate that the object's condition is deteriorating and it is showing signs of fatigue.

[0119] If multiple consecutive display features arranged according to timestamps remain unchanged, but the corresponding multiple object features gradually deteriorate, it can be determined that this is due to changes in the operating objects affected by the long-term display of the display device.

[0120] As an example, when static text content is displayed on a display device for an extended period of time, the display device's display characteristics remain stable, while the characteristics of the object being manipulated gradually deteriorate. This change in the object is a long-term phenomenon caused by fatigue from prolonged use of the display screen.

[0121] Table 2 below is another table of timestamps, display features and object features provided in the embodiments of this application. The table records the first feature set (display features) and the second feature set (object features) for multiple timestamps corresponding to different time periods.

[0122] Table 2

[0123]

[0124] As shown in Table 2 above, under the premise that the display device is stable, the user's physiological indicators gradually deteriorate (reduced blinking, eye closure, head nodding). The deterioration lasted for 70 seconds, with the middle 60 seconds and the most recent 10 seconds showing a slow, continuous trend, rather than a reaction to a single instantaneous event. The third model, analyzing the object and display characteristics corresponding to the same timestamp and combining the object and display characteristics of preceding and following timestamps, can determine that prolonged focus on the object is the "cause," while reduced tear secretion and eye muscle fatigue are the "effects." Therefore, the changes in the object's characteristics can be identified as a "fatigue-related event."

[0125] In this embodiment, if multiple consecutive display features remain unchanged, and the changes in the corresponding multiple object features satisfy the third condition, it is determined that the change in the operation object is affected by the long-term display of the display device. This can be used to determine the fatigue caused by the user using the display screen for a long time while the display of the display device remains unchanged, providing a basis for subsequent control of the output display of the display device.

[0126] In one possible implementation, the display processing method further includes:

[0127] Configure the same timestamp for display data and environmental data collected at the same time; the timestamp includes a point in time or a period of time, and the timestamp is related to the usage scenario of the display device.

[0128] Since the display data of display devices changes differently in different usage scenarios, different types of timestamps can be set according to the usage scenarios to conduct corresponding follow-up analysis for different usage scenarios, obtain accurate processing results, and determine the primary correlation between display data and environmental data.

[0129] If the displayed data of the electronic device changes frequently, instantaneous events will often occur in this scenario. Precise time points can be added as timestamps to the displayed data and environmental data.

[0130] For example, scenarios where adding time points and timestamps is needed can be scenarios where the displayed content is frequently switched, such as video playback, gaming, meetings, and reading with frequent page turning.

[0131] As an example, when a display device is showing a video, the user is watching the video. Since the content of each frame in the video may change abruptly, such as the image in the video suddenly switching from a dark indoor environment to a bright outdoor environment, in order to improve the accuracy of the analysis in this usage scenario, timestamps of time points can be added to the display data and environmental data to fully capture the instantaneous changes and provide a sufficiently accurate basis for subsequent model processing.

[0132] If the display data of the electronic device does not change frequently, but the environmental data changes, and this change is a long and continuous one, then a broader time period can be added as a timestamp for both the display data and the environmental data.

[0133] In one possible implementation, the current usage scenario can be determined by combining the application currently displayed on the display device.

[0134] As an example, if the application corresponding to the currently displayed content is a game application, video application, or other application whose displayed content changes frequently, timestamps can be added according to the time point; if the application corresponding to the currently displayed content is a text application or other application whose displayed content is stable, timestamps can be added according to the time period.

[0135] In one possible implementation, the current usage scenario can be determined by combining the application displayed on the current display device. Display data and environmental data can then be collected according to a set time point or time period based on the current usage scenario, and corresponding timestamps can be added.

[0136] As an example, in the current use case of video playback, display data and environmental data are collected according to the corresponding time points, and the corresponding time point timestamps are added; if the current use case is a static image display, display data and environmental data are collected according to the corresponding time period, and the corresponding time period timestamps are added.

[0137] In one possible implementation, display data and environmental data can be collected according to a set period. After the display data and environmental data are collected, the application displayed on the current display device determines the current usage scenario, and in combination with the usage scenario, it is determined whether to add a time point timestamp to the currently collected display data and environmental data, or to add a time period timestamp to the collected display data and environmental data according to the time period.

[0138] As an example, the display device is configured to collect display data and environmental data according to a set period. In the current use case of video playback, display data and environmental data are collected at the corresponding time points and timestamps are added accordingly. In the current use case of static image display, the collected display data and environmental data are retained according to the corresponding time periods. One set of display data and environmental data is retained for each time period and a timestamp for the corresponding time period is added.

[0139] In this embodiment, the same timestamp is configured for display data and environmental data collected at the same time. This timestamp includes a point in time or a time period, and is related to the usage scenario of the display device. By configuring the same timestamp for display data and environmental data collected at the same time, which can be a time period or a point in time, and by setting timestamps of different time lengths according to the usage scenario of the display device, it is possible to obtain as complete a record of changes in both display and environmental data as possible, while also reducing the data processing burden on the display device when changes in display and environmental data are infrequent.

[0140] Figure 4 This is a flowchart illustrating the process of obtaining environmental data, determining a first association between display data and environmental data, and outputting and displaying data based on the first association, provided in an embodiment of this application. It may include steps 401 to 403, which are described in detail below.

[0141] 401. Obtain first environmental data; the first environmental data includes image data reflecting the characteristic changes of the objects being operated on in the environment;

[0142] The environmental data surrounding the display device may include image data reflecting changes in the characteristics of objects being operated on in the environment, as well as detection data reflecting changes in the characteristics of the environment in which it is used.

[0143] The first environmental data is the image data obtained by acquiring images of the object being operated on. This image data can be multiple frames of image data corresponding to timestamps.

[0144] As an example, the image acquisition device that is paired with the display device continuously acquires images of the object being operated on to obtain the first environmental data.

[0145] 402. If the first correlation between the first environmental data and the display data indicates that the change in the operating object is unrelated to the display of the display device, then second environmental data is obtained; the second environmental data includes detection data reflecting changes in the characteristics of the usage environment.

[0146] By analyzing the first environmental data and the display data, a first correlation between the two is obtained. This first correlation indicates that the change of the operation object is unrelated to the display of the display device. That is, the characteristics of the operation object indicate that the operation object has changed, but the change is unrelated to the display of the display device.

[0147] For the analysis of the correlation between the first environmental data and the displayed data, please refer to the explanation in the foregoing embodiments, which will not be repeated here.

[0148] After determining that the change in the object being manipulated is unrelated to the display on the display device, we further determine whether the change in the object being manipulated is related to changes in the environment.

[0149] The second environmental data and the first environmental data are added with the same timestamp of the display device configuration. Using this same timestamp, it can be determined whether the change of the operation object is related to the change of the environment.

[0150] The second environmental data includes detection data that reflects changes in the characteristics of the environment in which the data is used, such as ambient light and ambient sound.

[0151] In one possible implementation, an ambient light sensor is placed in the environment where the display device is located. The ambient light sensor can collect light parameters such as illuminance (in lux) and color temperature (in Kelvin) in the environment. By reading the parameters collected by the ambient light sensor, the second environmental data can be obtained.

[0152] The ambient light sensor can be built into the display device or placed in the same physical environment as the display device. The collected light parameters can be used as the light parameters of the environment where the display device is located.

[0153] In one possible implementation, a sound sensor is placed in the environment where the display device is located. The sound sensor can detect the sound in the environment and collect sound parameters such as volume. By reading the parameters collected by the sound sensor, the second environmental data can be obtained.

[0154] The sound sensor can be built into the display device or placed in the same physical environment as the display device. The collected sound parameters can be used as the sound parameters of the environment where the display device is located.

[0155] In one possible implementation, a fourth model can also be set up to process the second environmental data and obtain a third feature set of the environment, which contains multiple environmental sound features arranged in timestamp order.

[0156] As an example, while viewing the content displayed on the display device, the user suddenly closes their eyes. During this process, the displayed content and display parameters remain unchanged. Analyzing the first environmental data and the display data, it is determined that the change in the user is unrelated to the change in the display data. The second environmental data is sound data; a loud noise occurs in the environment at the moment the user closes their eyes. Combining the characteristic changes of the user in the first environmental data and the characteristic changes in the second environmental data, it can be determined that the correlation between the two indicates that the change in the user is due to environmental influences.

[0157] Correspondingly, the third model can process various types of data and determine the correlation between input data. In addition to analyzing display features and object features to determine the first correlation between display data and environmental data, it can also analyze object features and environmental features to determine the second correlation between the first environmental data and the second environmental data.

[0158] 403. If the second correlation between the second environmental data and the first environmental data indicates that the change in the operation object is affected by the environment, the output is displayed based on the first strategy; the first strategy includes outputting the first prompt information.

[0159] If the analysis determines that the second correlation between the second environmental data and the first environmental data indicates that the change in the operation object is due to environmental impact, then a first strategy can be determined based on this second correlation, and the first strategy can be used to output prompt information, which can be a prompt aimed at reducing environmental impact.

[0160] For example, the first prompt information output by the first strategy can be used to alert attention to changes in environmental characteristics, or to indicate that the change in the current operation object is caused by changes in environmental characteristics, so that the operation object can quickly understand the reason for the current change and perform the corresponding operation.

[0161] For example, if the second association represents a change in the object of operation caused by a sudden loud noise in the environment, or if the second association represents a change in the object of operation caused by a sudden flash of light in the environment, the generated prompt message can remind the user to pay attention to the surrounding environment and protect their ears / eyes.

[0162] Table 3 below shows the timestamps, display features, object features, and ambient sound features provided in the embodiments of this application. The table records feature sets for multiple timestamps corresponding to different time periods. In Table 3, the ambient sound volume (in dB) of the display device's environment is processed as the second environmental data.

[0163] Table 3

[0164]

[0165] According to Table 1 above, at 1800ms, the subject's pupils were at 3.8mm, indicating calmness. At the precise time point of 1810ms, the "sudden increase in volume" and the "subject's initial closing of eyes" occurred simultaneously, followed immediately (at 1830ms) by the physiological reflex of "covering ears." The third model, by analyzing the object and sound characteristics corresponding to the same time stamp and combining the object and sound characteristics of preceding and following time stamps, can determine that the subject's eye-closing and ear-covering actions were caused by a sudden increase in the volume of sound in the environment. The first correlation is determined to be that the subject's eye-closing and ear-covering actions are unrelated to the display characteristics of the display device. The second correlation is determined to be that the sudden increase in ambient volume caused the subject's eye-closing and ear-covering actions. It can be concluded that the sudden increase in ambient volume is the "cause," and the subject's eye-closing and ear-covering actions are the "effect." This is a "stimulating event," and this stimulating event is unrelated to the display device but related to the surrounding environment. The display device can output a prompt message: "The environment is noisy; please be careful."

[0166] In this embodiment, first environmental data reflecting image data showing changes in the characteristics of an object being operated on in the environment is obtained. If a first correlation between the first environmental data and the display data indicates that the change in the object being operated on is unrelated to the display of the display device, second environmental data reflecting detection data showing changes in the characteristics of the usage environment is obtained. If a second correlation between the second environmental data and the first environmental data indicates that the change in the object being operated on is influenced by the environment, output display is performed based on a first strategy. The first strategy includes outputting a first prompt message. The environmental data may include image data reflecting changes in the characteristics of the object being operated on and detection data reflecting changes in the characteristics of the usage environment. If the change in the object being operated on is unrelated to the display of the display device, and if it is determined that the change in the object being operated on is related to changes in environmental characteristics, then a first prompt message is output according to the first strategy so that the object being operated on can quickly understand the reason for the current change and perform corresponding operations.

[0167] In one possible implementation, the output is displayed based on the first association relationship, including at least one of the following:

[0168] 1. In response to the first association indicating that the characteristic change of the environment is affected by the display of the display device, the output display is performed based on the second strategy; the second strategy includes at least one of adjusting the display parameters of the display device to reduce or enhance the influence, and outputting a second prompt message; the characteristic change of the environment includes the characteristic change of the operating object or the usage environment;

[0169] If the first association indicates that the change in the characteristics of the environment where the display device is located is due to the display effect of the display device, the display effect of the display device can be weakened or strengthened in subsequent moments as needed, or a prompt can be given, or the display effect can be adjusted and a prompt can be given.

[0170] The changes in the characteristics of the environment include changes in the characteristics of the operation object, which is the user operating the display device. Accordingly, if the changes in the characteristics of the operation object are due to the display of the display device, the subsequent output display based on the second strategy needs to be set according to the influence of the operation object.

[0171] In one possible implementation, it is determined whether the display effect of the display device on the characteristics of the manipulated object is better or worse. The third model can define rules for setting "better" and "worse." If it is determined that the characteristic change of the manipulated object is better, then the second strategy could be to adjust the display parameters of the display device to enhance the effect, making the characteristic change of the manipulated object better or maintaining its current better state. If it is determined that the characteristic change of the manipulated object is worse, then the second strategy could be to adjust the display parameters of the display device to reduce the effect, making the characteristic change of the manipulated object no longer worse or better.

[0172] For example, if the display device suddenly flickers and the user squints, this change in environmental characteristics has an adverse effect on human eye health. The second strategy is to subsequently reduce the brightness of the flickering content and then suddenly increase it to a higher value to protect the user's eyes.

[0173] As an example, the second strategy is to immediately implement anti-flicker measures and slightly reduce the global brightness over the next few seconds as compensation to relax the user's eye muscles. A specific control strategy that can be implemented is to activate / enhance the dynamic backlight smoothing algorithm, smoothly transitioning the brightness from 300 nits to 280 nits.

[0174] The changes in the environment include changes in the usage environment, which is the environment in which the display device is located. Accordingly, if the changes in the environment are due to the display of the display device, the settings for subsequent output display based on the second strategy need to be based on the influence of this environment.

[0175] In one possible implementation, it is determined whether the display effect of the display device on the characteristics of the surrounding environment is better or worse. The third model can set rules to determine whether the environment is better or worse. If it is determined that the change in the characteristics of the environment is better, then the second strategy to be executed could be to adjust the display parameters of the display device to enhance the effect, so that the environment is either better or maintains its current better state. If it is determined that the change in the characteristics of the environment is worse, then the second strategy to be executed could be to adjust the display parameters of the display device to reduce the effect, so that the change in the characteristics of the environment no longer worsens or improves.

[0176] For example, if the brightness of the display device increases, the brightness of the environment in which the display device is located will also increase. However, the increase in the brightness of the environment is meaningless. Therefore, the second strategy is to reduce the brightness parameter of the display device.

[0177] The display device can adjust the display parameters according to the second strategy, or it can generate a prompt message instead of making any adjustments, prompting the user to adjust the display parameters. This prompt message can indicate the specific operation process of the adjustment so that the user can quickly understand the operation method.

[0178] The display device can also generate a prompt message after adjusting the display parameters according to the second strategy. This prompt message is used to indicate that the display parameters have been adjusted, so that users can understand the current operating status of the display device.

[0179] In one possible implementation, the display device adjusts its display parameters according to a second strategy, which can be based on changes in environmental characteristics, the real-time environment of the display device, the rhythm, and the current display parameters of the display device.

[0180] As an example, this change in environmental characteristics indicates that the user's fatigue level is high. The second strategy is to relieve fatigue and promote relaxation. Specific control strategies that can be implemented include slowly adjusting the color temperature from 6500K to 5500K, reducing blue light by 30%, and displaying a gentle "look into the distance for 20 seconds" prompt in the corner via the OSD.

[0181] As an example, an adjustment strategy mapping table can be preset. If the change in environmental characteristics determines that the user's fatigue level is >70, the corresponding strategy can be determined based on the mapping table as a 500K reduction in color temperature and a 20% reduction in brightness. Then, the adjustment corresponding to the second strategy is to reduce the color temperature of the display device by 500K and reduce the brightness by 20%.

[0182] After generating the adjustment strategy, the relevant adjustments in the adjustment strategy can be converted into specific register write instructions or protocol commands that can be executed by the display device hardware.

[0183] Second, in response to the first association relationship characterizing the changes in the characteristics of the environment that are unrelated to the display of the display device, the output display is performed based on the third strategy; the third strategy includes at least one of outputting a third prompt message and not interfering with the output display of the display device.

[0184] If the first association represents a change in the characteristics of the environment that is unrelated to the display of the display device, and the change in the object characteristics of the operation object may be due to its own reasons, then the output display is based on the third strategy.

[0185] In one possible implementation, a third prompt message could be generated by combining the characteristics of the object being operated on.

[0186] For example, if the object characteristic of the operation is an elderly person, the third prompt message output to the elderly person could be "Please wear reading glasses"; if the object characteristic of the operation is a child, the third prompt message output to the child could be "You have been using the display device for 20 minutes. Please take a break and pay attention to eye hygiene".

[0187] Since the changes in the characteristics of the environment are unrelated to the display of the display device, the output display of the display device can be displayed without interference, and the display device can continue to display using the previous display data.

[0188] In this embodiment, the characteristic changes of the environment in which the display device is located include characteristic changes of the operating object or the usage environment. If the first correlation indicates that the characteristic changes of the environment are affected by the display device or are unrelated to the display device, different strategies can be adopted for output display in the two cases. If they are related, the display parameters of the display device can be adjusted to reduce or enhance the impact, or a second prompt message can be output to provide a prompt, thereby achieving a response to the impact of the display device. If they are unrelated, output display is based on a third strategy; the third strategy includes at least one of outputting a third prompt message or not interfering with the output display of the display device. This implements different response strategies for different situations.

[0189] Figure 5 This is a flowchart illustrating the output display based on the second strategy provided in this application embodiment, which may include steps 501 to 504, and these steps are described in detail below.

[0190] 501. Determine the first display parameter based on the preset mapping table. The preset mapping table records the correspondence between the display device's time and physical space and the display parameter.

[0191] This preset mapping table records the correspondence between the display device's location and physical space and display parameters. It can be a pre-selected data stored in the mapping table within the display device. Alternatively, it can be a rhythm table, which is a predicted ideal color temperature curve generated based on geographical location, time, and season.

[0192] Based on the current time and physical space of the display device, the corresponding first display parameter is determined in the preset mapping table.

[0193] This time can include information such as date and current time.

[0194] The time zone is determined based on the obtained geographical location, the season is determined based on the date, and the time zone, season, and current time are mapped onto the color temperature curve to determine the current display parameters.

[0195] Network time (NTP) and rough IP (Internet Protocol) geolocation information can be obtained through the network module of the display device or the connected PC (Personal Computer) host.

[0196] The network module can be Wi-Fi (Wireless Fidelity), Ethernet, etc., and this application does not restrict the specific implementation of the network module.

[0197] The first display parameter can be the display parameter currently used by the display device; or it can be the first display parameter that the current display device preferably uses, but which is not currently used by the display device due to the modification of the operation object.

[0198] 502. Based on the first association relationship, determine the second display parameter;

[0199] If the first correlation characterizes the change in the features of the environment as being affected by the display of the display device, then a second display parameter is determined in conjunction with this effect. This second display parameter can be used to enhance or reduce the effect.

[0200] As an example, the second display parameter is to smoothly transition the brightness from 300 nits to 280 nits.

[0201] 503. Determine the third display parameter based on the first and second display parameters;

[0202] The third display parameter can be obtained by weighting the first and second display parameters mentioned above.

[0203] 504. Adjust the display parameters of the display device according to the third display parameter.

[0204] The weighting settings can be configured according to the actual situation.

[0205] The operation object tends to provide display parameters that fit the operation object's needs, giving higher weight to the second display parameter, and vice versa, giving higher weight to the first display parameter.

[0206] For example, the brightness in the first display parameter is 350 nits, the brightness in the second display parameter is 280 nits, the weight of the first display parameter is 0.6, the weight of the second display parameter is 0.4, and the weighted sum of the two results in a brightness of 322 nits in the third display parameter. The brightness of the display device is then adjusted based on this 322 nits.

[0207] After determining the third display parameter, the display parameters of the display device are adjusted based on the third display parameter.

[0208] In this embodiment, a first display parameter is determined based on a preset mapping table, which records the correspondence between the display device's location and physical space and the display parameters. A second display parameter is determined based on this first correlation. A third display parameter is determined based on the first and second display parameters. The display parameters of the display device are then adjusted based on the third display parameter. The determined third display parameter considers both the general requirements for display parameter settings and the impact of the current environment on the display device. Adjusting the display parameters based on this third display parameter better meets actual needs.

[0209] Figure 6 This is a schematic diagram of an application scenario for a display processing method provided in an embodiment of this application. In this application scenario, the display device is functionally divided into 5 layers: data acquisition layer 601, feature processing layer 602, decision layer 603, control layer 604, and control execution layer 605.

[0210] The following functions are performed in the data acquisition layer 061: acquire environmental images using an image acquisition device; acquire the current time and geographical location through a network module; acquire information such as ambient light and ambient volume through sensors; and read the EDID to obtain display data from the display device.

[0211] In the feature processing layer 602, the first model is used to process the display data to obtain the first feature set, and the second model is used to process the acquired environmental image to obtain the second feature set of the operation object; a fourth model can also be set to process environmental volume, ambient light, etc., to obtain the corresponding feature set.

[0212] In the decision layer 603, the feature set obtained from the feature processing layer is processed by the third model. The feature set is fused and decided for the multimodal features to determine the first correlation between the display data and the environmental data. Based on the first correlation, the corresponding control strategy is determined. The environmental data includes environmental images, ambient light, and ambient volume, etc.

[0213] In control layer 604, intervention instructions are generated based on the strategy generated by the decision layer.

[0214] In the control execution layer 605, in response to the intervention command, the parameters of the control display device are adjusted and corresponding prompts are generated.

[0215] The above describes a display processing method provided by an embodiment of this application. The following will describe the apparatus for performing the above display processing method.

[0216] Figure 7 This is a schematic diagram of a display processing device 700 provided in an embodiment of this application. The display processing device 700 includes:

[0217] The first module 701 is used to obtain display data; the display data reflects the display changes of the display device.

[0218] The first module can be configured with a first model, which can process display data and obtain a first feature set of the display device; the first feature set includes multiple display features arranged according to timestamps.

[0219] The second module 702 is used to obtain environmental data; the environmental data reflects the characteristic changes of the environment in which the display device is located.

[0220] The second module can be configured with a second model that can process environmental data and obtain a second feature set of the object to be operated on; the second feature set includes multiple object features arranged according to timestamps.

[0221] The third module 703 is used to determine the first association between the display data and the environmental data, and to output the display based on the first association; the display data and the environmental data have the same timestamp configured by the display device.

[0222] The third module can be configured with a third model that can process the first feature set and the second feature set to determine the first correlation between the displayed data and the environmental data.

[0223] Moreover, there is a one-to-one correspondence between each timestamp, each display feature, and each object feature.

[0224] It should be noted that the specific functional implementation and corresponding explanations of the first, second, and third modules can be found in the explanations in the aforementioned method embodiments, and will not be repeated here.

[0225] In this embodiment, the display processing device includes: a first module that obtains display data; the display data reflects display changes of the display device; a second module that obtains environmental data; the environmental data reflects characteristic changes of the environment in which the display device is located; and a third module that determines a first correlation between the display data and the environmental data, and performs output display based on the first correlation; the display data and the environmental data have the same timestamp configured by the display device. This display processing device, in conjunction with the timestamp, uses three modules to analyze the display data and environmental data to determine whether changes in environmental characteristics are related to display changes of the display device, obtaining a first correlation between the two. Based on this first correlation, it can determine whether to adjust the output display of the display screen. This adjustment may include adjusting the display parameters of the display screen, eliminating the need for manual adjustment by the user, thus achieving automatic adjustment of the display parameters and improving adjustment efficiency.

[0226] The above describes a display processing method provided by an embodiment of this application. The following will describe a display device that performs the above display processing method.

[0227] Figure 8 This is a schematic diagram of the structure of a display device 800 provided in an embodiment of this application. The display device 800 includes:

[0228] Processor 801 is used to obtain display data; the display data reflects the display changes of the display device; obtain environmental data; the environmental data reflects the characteristic changes of the environment in which the display device is located; determine the correlation between the display data and the environmental data; the display data and the environmental data have the same timestamp configured by the display device;

[0229] The processor can be a functional structure with strong data processing capabilities. The processor can adopt NPU, CPU (Central Processing Unit), etc. The processor can carry multiple processing models. The first model can process display data and obtain a first feature set of the display device; the second model can process environmental data and obtain a second feature set of the operation object; the third model can process the first feature set and the second feature set to determine the first correlation between the display data and the environmental data.

[0230] Display screen 802 is used for output display based on association relationships.

[0231] Based on the relationship, the display parameters of the display screen can be adjusted before the display screen outputs subsequent display content; based on the relationship, the display content of the display screen can be adjusted before output.

[0232] For details on the specific output display method, please refer to the explanation in the aforementioned method embodiments, which will not be repeated here.

[0233] In this embodiment, the display device includes a processor for obtaining display data; the display data reflects changes in the display of the display device; obtaining environmental data; the environmental data reflects changes in the characteristics of the environment in which the display device is located; determining the correlation between the display data and the environmental data; the display data and the environmental data having the same timestamp configured by the display device; and a display screen for output display based on the correlation. In this process, the processor combines the timestamp to analyze the display data and environmental data to determine whether changes in environmental characteristics are related to changes in the display of the display device, obtaining a first correlation between the two. Based on this first correlation, it can determine whether to adjust the output display of the display screen. This adjustment may include adjusting the display parameters of the display screen, eliminating the need for manual adjustment by the user and achieving automatic adjustment of the display parameters, thus improving adjustment efficiency.

[0234] This application also provides a computer program product including computer-readable instructions, which, when executed on an electronic device, cause the electronic device to implement any of the display processing methods provided in this application.

[0235] This application also provides an electronic device, including at least one processor and a memory connected to the processor, wherein: the memory is used to store a computer program; the processor is used to execute the computer program, causing the electronic device to implement any of the display processing methods provided in this application.

[0236] This application also provides a computer-readable storage medium that carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any of the display processing methods provided in this application.

[0237] It is understood that before using the technical solutions disclosed in the various embodiments of this application, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this application in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0238] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0239] It should also be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. In addition, in the device embodiment drawings provided in this application, the connection relationship between modules indicates that they have a communication connection, which can be implemented as one or more communication buses or signal lines.

[0240] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware, or it can be implemented by special-purpose hardware including application-specific integrated circuits, special-purpose CPUs, special-purpose memory, special-purpose components, etc. Generally, any function performed by a computer program can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be diverse, such as analog circuits, digital circuits, or special-purpose circuits. However, for this application, software program implementation is more often the preferred implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk, or optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, training equipment, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0241] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product.

[0242] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, training device, or data center to another website, computer, training device, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)).

Claims

1. A display processing method, applied to a display device, comprising: Obtain the display data; The display data reflects the display changes of the display device; Obtain environmental data; The environmental data reflects the characteristic changes of the environment in which the display device is located; A first association relationship is determined between the display data and the environmental data, and the output display is performed based on the first association relationship; the display data and the environmental data have the same timestamp configured by the display device.

2. The display processing method according to claim 1, comprising obtaining display data, obtaining environmental data, and determining a first association relationship between the display data and the environmental data, including: Obtain the display data; Based on the first model, the display data is processed to obtain a first feature set of the display device; The first feature set includes multiple display features arranged according to timestamps; Obtain first environmental data; the first environmental data includes image data reflecting the characteristic changes of the objects being operated on in the environment; The first environmental data is processed based on the second model to obtain a second feature set of the operation object; the second feature set includes multiple object features arranged according to timestamps; The first feature set and the second feature set are processed based on the third model to determine the first association relationship; There is a one-to-one correspondence between each timestamp, each display feature, and each object feature.

3. The display processing method according to claim 2, wherein the first feature set and the second feature set are processed based on a third model to determine the first association relationship, comprising: If the first display feature and the first object feature corresponding to the first timestamp satisfy the first condition, determine whether the second object feature corresponding to the second timestamp satisfies the second condition. The second timestamp is the next adjacent timestamp after the first timestamp; If the second condition is met, it is determined that the change in the object being operated on is affected by the short-term display of the display device.

4. The display processing method according to claim 2, wherein the first feature set and the second feature set are processed based on a third model to determine the first association relationship, comprising: If multiple consecutive display features remain unchanged, and the corresponding changes in multiple object features satisfy the third condition, it is determined that the change in the operation object is affected by the long-term display of the display device.

5. The display processing method according to claim 1, further comprising: Configure the same timestamp for display data and environmental data collected at the same time; The timestamp includes a point in time or a period of time, and the timestamp is related to the usage scenario of the display device.

6. The display processing method according to claim 1, wherein obtaining environmental data, determining a first correlation between the display data and the environmental data, and performing output display based on the first correlation includes: Obtain initial environmental data; The first environmental data includes image data reflecting changes in the characteristics of the objects being operated on in the environment; If the first correlation between the first environmental data and the display data indicates that the change in the operating object is unrelated to the display of the display device, second environmental data is obtained; the second environmental data includes detection data reflecting changes in the characteristics of the usage environment; If the second correlation between the second environmental data and the first environmental data indicates that the change in the operation object is affected by the environment, the output is displayed based on the first strategy; the first strategy includes outputting a first prompt message.

7. The display processing method according to claim 1, wherein the output display based on the first association relationship includes at least one of the following: In response to the first association indicating that the characteristic change of the environment is affected by the display of the display device, an output display is performed based on a second strategy; the second strategy includes at least one of adjusting the display parameters of the display device to reduce or enhance the influence, and outputting a second prompt message; the characteristic change of the environment includes the characteristic change of the environment used by the operating object; In response to the fact that the first association relationship indicates that the changes in the characteristics of the environment are unrelated to the display of the display device, the output display is performed based on a third strategy; the third strategy includes at least one of outputting a third prompt message and not interfering with the output display of the display device.

8. The display processing method according to claim 7, wherein output display is performed based on a second strategy, comprising: Based on a preset mapping table, a first display parameter is determined, wherein the preset mapping table records the correspondence between the display device's time and physical space and the display parameter; Based on the first association relationship, determine the second display parameter; Based on the first and second display parameters, the third display parameter is determined; The display parameters of the display device are adjusted according to the third display parameter.

9. A display processing device, comprising: The first module is used to obtain display data; The display data reflects the display changes of the display device; The second module is used to obtain environmental data; The environmental data reflects the characteristic changes of the environment in which the display device is located; The third module is used to determine a first association between the display data and the environmental data, and to output and display based on the first association; the display data and the environmental data have the same timestamp configured by the display device.

10. A display device, comprising: A processor is used to acquire display data, which reflects changes in the display of the display device; and to acquire environmental data. The environmental data reflects the characteristic changes of the environment in which the display device is located; the correlation between the display data and the environmental data is determined; the display data and the environmental data have the same timestamp configured on the display device; A display screen is used to display output based on the aforementioned association.

Images