A display screen display control system and method based on data analysis

Abstract

The application discloses a display screen display control system and method based on data analysis, and belongs to the technical field of display control. The system comprises a data processing module, a user demand analysis module, a brightness adjusting module and a system optimization module; the data processing module is used for detecting whether a user is near a display screen and collecting eye movement data and environmental illumination data of the user; the user demand analysis module is used for dividing areas and priorities according to the user's demand; the brightness adjusting module is used for adjusting the brightness of the display screen; and the system optimization module is used for avoiding repeated analysis processes and directly adjusting the brightness. Through area division and analysis of the display screen, the system can identify the user's sight area, intelligently adjust the area brightness according to the eye movement data, improve the readability and visibility of display content, automatically adjust the screen brightness, reduce unnecessary energy consumption, and thus effectively save energy consumption.

Description

Technical Field

[0001] This invention relates to the field of display control technology, specifically to a display screen control system and method based on data analysis. Background Technology

[0002] In modern technology, display control, including brightness adjustment, is a crucial technology. Its goal is to provide a better visual experience while minimizing potential adverse effects on the user's eyesight. As people use various devices, from smartphones to computer monitors, in different environments and lighting conditions, the importance of display brightness adjustment technology is becoming increasingly apparent.

[0003] Current display brightness adjustment technologies mainly fall into two categories: manual and automatic. However, both methods have limitations. Manual adjustment requires users to adjust the brightness according to their own needs, but it cannot perform fine-grained adjustments based on specific content and environmental changes, and adjustments in different scenarios are cumbersome and time-consuming. Automatic adjustment attempts to adjust brightness based on ambient lighting conditions, but current automatic adjustment technologies often only adjust the entire screen and cannot consider the user's different brightness requirements for different areas. Summary of the Invention

[0004] The purpose of this invention is to provide a display control system and method based on data analysis to solve the problems mentioned in the background art.

[0005] To solve the above-mentioned technical problems, the present invention provides the following technical solution:

[0006] A display control system based on data analysis, the system further includes a data processing module, a user demand analysis module, a brightness adjustment module and a system optimization module;

[0007] The data processing module collects the user's eye movement data and ambient light data through an eye tracker and a light sensor, and detects whether the user is near the display screen through an infrared sensor.

[0008] The user needs analysis module divides the display screen into several areas based on the layout, content, and structure of the page currently being viewed by the user. It then maps the user's eye movement data to the corresponding areas, analyzes the distribution of the user's gaze points in each area, generates a gaze heatmap, and prioritizes the brightness adjustment of each area.

[0009] The brightness adjustment module gradually adjusts the brightness of the entire display screen based on ambient light data, and adjusts the brightness value of each area based on the gaze heatmap and priority of each area.

[0010] The system optimization module directly adjusts the brightness based on the historical information of the display screen's brightness adjustment, avoiding repetitive analysis processes.

[0011] The output of the data processing module is electrically connected to the input of the user demand analysis module, the output of the user demand analysis module is electrically connected to the input of the brightness adjustment module, and the output of the system optimization module is electrically connected to the input of the brightness adjustment module.

[0012] Furthermore, the data processing module includes an infrared sensing unit, an ambient light acquisition unit, and an eye tracker acquisition unit;

[0013] The infrared sensing unit is an infrared sensor, which is set at the edge of the display screen. The infrared sensor will continuously monitor the changes in the surrounding heat. When the sensor detects a change in heat, it indicates that there is a human body nearby. At the same time, the system begins to collect and process data, including the acquisition of eye tracker data and the recording of ambient light intensity.

[0014] The ambient light acquisition unit is a light sensor, including a photoresistor and a photodiode, used to acquire current light intensity data;

[0015] The eye tracker acquisition unit tracks the user's eye movements and collects eye movement data, including the location information of the user's gaze point, for use in user behavior analysis.

[0016] The output terminal of the infrared sensing unit is electrically connected to the input terminal of the ambient light acquisition unit, the output terminal of the infrared sensing unit is electrically connected to the input terminal of the eye tracker acquisition unit, the output terminal of the eye tracker acquisition unit is electrically connected to the input terminal of the user needs analysis module, and the output terminal of the ambient light acquisition unit is electrically connected to the input terminal of the brightness adjustment module.

[0017] Furthermore, the user demand analysis module includes a region segmentation unit, an eye-tracking data analysis unit, and a region sorting unit;

[0018] The area division unit divides the display screen into several areas based on the layout, content, and structure of the pages browsed by the user, thereby obtaining an area distribution map of the display screen to analyze user behavior and needs.

[0019] The eye-tracking data analysis unit analyzes the current user's gaze location information and generates a gaze heatmap. Based on the set of gaze points E = {1, 2, 3, ..., N} collected within a unit of time, where 1, 2, 3, ..., N represent the 1st, 2nd, 3rd, ..., Nth gaze points collected within the unit of time, a two-dimensional coordinate system is established for the display screen. The x-axis represents the horizontal direction, the y-axis represents the vertical direction, and the origin (0,0) is located at the lower left corner of the screen. The x-axis extends to the right, and the y-axis extends upwards. The x and y coordinates of the gaze points are divided by the width and height of the page, respectively, to obtain normalized coordinates (x, y) ranging from 0 to 1. i ,y i ),x i Represents the normalized x-coordinate and y-coordinate of any captured gaze point. i The y-coordinate represents the normalized coordinate of any captured gaze point;

[0020] For any captured fixation point, the color intensity around the fixation point is calculated using a Gaussian kernel function, which has the following form:

[0021]

[0022] Where K(x,y) is the Gaussian kernel function value at position (x,y), and σ is the standard deviation of the Gaussian kernel function, which controls the degree of diffusion of the heatmap;

[0023] Through formula I(x,y) represents the color intensity value. The calculation result of the Gaussian kernel function is mapped to the range of color intensity. The result is normalized to the range of 0 to 300 to obtain the color intensity value at each position. Among them, max(K) is the maximum value of the Gaussian kernel function value at all positions.

[0024] Based on the calculated color intensity values, the corresponding colors are filled into the corresponding positions on the page to form a gaze heatmap of the regional distribution map. The color of each position in the gaze heatmap reflects the gaze distribution of users in different areas of the page.

[0025] The region sorting unit defines corresponding boundary coordinates for several regions. The boundary coordinates are used to determine whether the gaze point is located within a specific region. The position coordinates of the gaze point are traversed within a unit of time. The position coordinates of the gaze point are compared with the boundary coordinates of each region. It is checked whether the position coordinates of the gaze point are inside the region enclosed by the boundary coordinates of a certain region. If so, it is determined that the gaze point is located within the corresponding region.

[0026] Check whether adjacent fixation points are located in the same area. If adjacent fixation points are located in different areas, it is considered that the user's gaze has moved from one area to another and is recorded as a gaze shift. For each area, calculate how many times the gaze has shifted from other areas to that area.

[0027] Based on the number of gaze shifts in each area, each area is sorted and assigned a priority, and the brightness of each area of ​​the display screen is adjusted according to the priority.

[0028] The output of the region division unit is electrically connected to the input of the region sorting unit, the output of the region division unit is electrically connected to the input of the eye-tracking data analysis unit, the output of the eye-tracking data analysis unit is electrically connected to the input of the brightness adjustment module, the output of the region sorting unit is electrically connected to the input of the brightness adjustment module, and the output of the eye-tracking data analysis unit is electrically connected to the input of the system optimization module.

[0029] Furthermore, the brightness adjustment module includes a regional brightness adjustment unit and a brightness smoothing adjustment unit;

[0030] The area brightness adjustment unit determines the brightness value of each area of ​​the display screen based on the color intensity value analyzed by the user demand analysis module according to the stored first relationship table, which defines the correspondence between color intensity values ​​and display screen brightness values, and adjusts the brightness of each area of ​​the display screen according to priority.

[0031] The brightness smoothing adjustment unit acquires the current ambient light intensity data to obtain the current light intensity L, and then uses the formula... The light intensity L is mapped to a brightness value range, and the result is normalized to a range of 0 to 1000 to obtain the brightness value P. The system then gradually adjusts the brightness value of the display screen to P, where L... max This is the maximum value of the set light intensity;

[0032] The output of the ambient light acquisition unit is electrically connected to the input of the brightness smoothing adjustment unit, and the output of the eye-tracking data analysis unit is electrically connected to the input of the brightness smoothing adjustment unit.

[0033] Furthermore, the system optimization module includes a storage unit and an optimization unit;

[0034] The storage unit stores a first relation table, a second relation table, and the user's historical display screen adjustment records. The first relation table defines the correspondence between color intensity values ​​and display screen brightness values. The second relation table defines the correspondence between color intensity values ​​and colors. The user's historical display screen adjustment records include the layout, content, and structure of the page the user was browsing at the time, the gaze point position, the generated gaze heatmap, and the corresponding brightness adjustment values.

[0035] The optimization unit is used to find the same gaze point position information and corresponding brightness adjustment value in the historical display adjustment record when the user visits the same page. The system directly applies these adjustment values ​​to adjust the brightness of the current display, improves the system performance, and makes the user experience smoother and more efficient.

[0036] The output of the storage unit is electrically connected to the input of the optimization unit, and the output of the optimization unit is electrically connected to the input of the brightness adjustment module.

[0037] To better implement the above system, a display control method based on data analysis is also proposed, including the following steps:

[0038] S10. Use infrared sensor devices to detect human body heat near the display screen in real time. When a change in human body heat is detected, the system starts collecting eye tracker data and recording ambient light intensity.

[0039] S20. Adjust the brightness of the entire display screen to the optimal brightness value that best matches the ambient light intensity.

[0040] S30. Divide the display screen into several areas based on the layout, content and structure of the page currently being viewed by the user, analyze the required brightness values ​​for each area in conjunction with the user's eye movement data, prioritize each area, and adjust the brightness values ​​of the required areas first.

[0041] Furthermore, in step S20, the current ambient light intensity data is acquired through a light sensor to obtain the current light intensity L, which is then calculated using the formula... The light intensity L is mapped to a brightness value range, and the result is normalized to a range of 0 to 1000 to obtain the brightness value P. The system then gradually adjusts the brightness value of the display screen to P, where L... max This is the maximum value of the set light intensity.

[0042] Furthermore, step S30 also includes the following steps:

[0043] S301. Analyze the current user's gaze position information. Based on the set of gaze points collected within a unit time, E = {1, 2, 3, ..., N}, where 1, 2, 3, ..., N represent the 1st, 2nd, 3rd, ..., Nth gaze points collected within a unit time, establish a two-dimensional coordinate system for the display screen. The x-axis represents the horizontal direction, and the y-axis represents the vertical direction. The origin (0,0) is located at the lower left corner of the screen. The x-axis extends to the right, and the y-axis extends upward. Divide the x and y coordinates of the gaze point by the width and height of the page, respectively, to obtain normalized coordinates (x, y) ranging from 0 to 1. i ,y i),x i Represents the normalized x-coordinate and y-coordinate of any captured gaze point. i The y-coordinate represents the normalized coordinate of any captured gaze point;

[0044] S302. For any gaze point acquired, use a Gaussian kernel function to calculate the color intensity around the gaze point. The Gaussian kernel function has the following form:

[0045]

[0046] Where K(x,y) is the Gaussian kernel function value at position (x,y), and σ is the standard deviation of the Gaussian kernel function, which controls the degree of diffusion of the heatmap;

[0047] S303, through formula I(x,y) represents the color intensity value. The calculation result of the Gaussian kernel function is mapped to the range of color intensity. The result is normalized to the range of 0 to 300 to obtain the color intensity value at each position. Among them, max(K) is the maximum value of the Gaussian kernel function value at all positions.

[0048] S304. Based on the calculated color intensity values, fill the corresponding colors into the corresponding positions on the page to form a gaze heatmap of the regional distribution map.

[0049] S305. Define corresponding boundary coordinates for the divided regions. The boundary coordinates are used to determine whether the gaze point is located within a specific region. Traverse the position coordinates of the gaze point within a unit of time, compare the position coordinates of the gaze point with the boundary coordinates of each region, and check whether the position coordinates of the gaze point are inside the region enclosed by the boundary coordinates of a certain region. If so, determine that the gaze point is located within the corresponding region.

[0050] Check whether adjacent fixation points are located in the same area. If adjacent fixation points are located in different areas, it is considered that the user's gaze has moved from one area to another and is recorded as a gaze shift. For each area, calculate how many times the gaze has shifted from other areas to that area.

[0051] Based on the number of times each area's gaze shifts, sort each area and assign it a priority.

[0052] S306. According to the stored first relationship table, which defines the correspondence between color intensity values ​​and display brightness values, the brightness values ​​of each area of ​​the display screen are determined based on the color intensity values, and the brightness of each area of ​​the display screen is adjusted according to priority.

[0053] Compared with existing technologies, the beneficial effects achieved by this invention are as follows: This invention combines eye trackers, ambient light sensors, and user demand analysis techniques to achieve intelligent adaptive adjustment of display screen brightness in different areas. By analyzing the user's gaze point position and dwell time, the system can identify the area of ​​focus on the display screen, and then adjust the brightness of the corresponding area according to the user's interests and environmental requirements, improving the readability and visibility of the displayed content. At the same time, the system can automatically adjust the screen brightness, reducing unnecessary energy consumption, thereby achieving effective energy saving. Attached Figure Description

[0054] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0055] Figure 1 This is a schematic diagram of the module composition of a display screen control system based on data analysis according to the present invention;

[0056] Figure 2 This is a schematic diagram of the module connection structure of a display screen control system based on data analysis according to the present invention;

[0057] Figure 3 This is a two-dimensional coordinate schematic diagram of the display screen of a display screen display control system based on data analysis according to the present invention. Detailed Implementation

[0058] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0059] Please see Figure 1 The present invention provides a technical solution: a display screen control system based on data analysis, the system further comprising a data processing module, a user demand analysis module, a brightness adjustment module and a system optimization module;

[0060] The output of the data processing module is electrically connected to the input of the user demand analysis module, the output of the user demand analysis module is electrically connected to the input of the brightness adjustment module, and the output of the system optimization module is electrically connected to the input of the brightness adjustment module.

[0061] The data processing module collects the user's eye movement data and ambient light data through an eye tracker and a light sensor, and detects whether the user is near the display screen through an infrared sensor.

[0062] The data processing module includes an infrared sensing unit, an ambient light acquisition unit, and an eye tracker acquisition unit.

[0063] The infrared sensing unit is an infrared sensor, which is set at the edge of the display screen. The infrared sensor will continuously monitor the changes in the surrounding heat. When the sensor detects a change in heat, it indicates that there is a human body nearby. At the same time, the system begins to collect and process data, including the acquisition of eye tracker data and the recording of ambient light intensity.

[0064] The ambient light acquisition unit is a light sensor, including a photoresistor and a photodiode, used to acquire current light intensity data;

[0065] The eye tracker acquisition unit tracks the user's eye movements and collects eye movement data, including the location information of the user's gaze point, for use in user behavior analysis.

[0066] Please see Figure 2 The output terminal of the infrared sensing unit is electrically connected to the input terminal of the ambient light acquisition unit, the output terminal of the infrared sensing unit is electrically connected to the input terminal of the eye tracker acquisition unit, the output terminal of the eye tracker acquisition unit is electrically connected to the input terminal of the user demand analysis module, and the output terminal of the ambient light acquisition unit is electrically connected to the input terminal of the brightness adjustment module.

[0067] The user needs analysis module divides the display screen into several areas based on the layout, content, and structure of the page currently being viewed by the user. It then maps the user's eye movement data to the corresponding areas, analyzes the distribution of the user's gaze points in each area, generates a gaze heatmap, and prioritizes the brightness adjustment of each area.

[0068] The user demand analysis module includes a region division unit, an eye-tracking data analysis unit, and a region sorting unit.

[0069] The area division unit divides the display screen into several areas based on the layout, content, and structure of the pages browsed by the user, thereby obtaining an area distribution map of the display screen to analyze user behavior and needs.

[0070] In this embodiment, the user opens a news website page. The page includes a title, main content, images, and a sidebar. Based on the layout and content of this page, the system divides the page into four areas: the title area, the main content area, the image area, and the sidebar area. The title area is located at the top of the page and includes the news title and publication date. The main content area is located below the title and occupies the main content area of ​​the page, including the news article and related information. The image area is located next to the main content and is related to the main content. The sidebar area is located on the right side of the page and contains other related links and recommended content.

[0071] The eye-tracking data analysis unit is used to analyze the current user's gaze location information and generate a gaze heatmap. Based on the set of gaze points collected within a unit of time, E = {1, 2, 3, ..., N}, where 1, 2, 3, ..., N represent the 1st, 2nd, 3rd, ..., Nth gaze points collected within the unit of time, please refer to... Figure 3 Establish a two-dimensional coordinate system for the display screen, where the x-axis represents the horizontal direction and the y-axis represents the vertical direction. The origin (0,0) is located at the lower left corner of the screen. The x-axis extends to the right, and the y-axis extends upward. Divide the x and y coordinates of the gaze point by the width and height of the page, respectively, to obtain normalized coordinates (x, y) ranging from 0 to 1. i ,y i ),x i Represents the normalized x-coordinate and y-coordinate of any captured gaze point. i The y-coordinate represents the normalized coordinate of any captured gaze point;

[0072] For any captured fixation point, the color intensity around the fixation point is calculated using a Gaussian kernel function, which has the following form:

[0073]

[0074] Where K(x,y) is the Gaussian kernel function value at position (x,y), and σ is the standard deviation of the Gaussian kernel function, which controls the degree of diffusion of the heatmap;

[0075] Through formula I(x,y) represents the color intensity value. The calculation result of the Gaussian kernel function is mapped to the range of color intensity. The result is normalized to the range of 0 to 300 to obtain the color intensity value at each position. Among them, max(K) is the maximum value of the Gaussian kernel function value at all positions.

[0076] Based on the calculated color intensity values, the corresponding colors are filled into the corresponding positions on the page to form a gaze heatmap of the regional distribution map. The color of each position in the gaze heatmap reflects the user's gaze distribution in different areas of the page. If the color of an area is darker, it means that the user has been looking at that area for a longer time, and the brightness needs to be increased to ensure that the user can read the relevant content better. If the color of an area is lighter, it means that the user has less interest, and the brightness does not need to be too high to reduce eye fatigue.

[0077] In this embodiment, the coordinates of the user's gaze point 1 are obtained as (13.6, 12.8). The collected gaze point coordinates are normalized to adapt to the actual size of the page. The x and y coordinates of the gaze point are divided by the width 20 and height 15 of the page, respectively, to obtain normalized coordinates (0.68, 0.8533) in the range of 0 to 1. The standard deviation σ of the Gaussian kernel function is set to 0.1.

[0078] The Gaussian kernel function for fixation point 1 is in the form of:

[0079]

[0080] The color intensity of points around fixation point 1 is calculated as follows, specifically at coordinates (0.6, 0.75) and (0.5, 0.8). The Gaussian kernel function values ​​are as follows:

[0081]

[0082]

[0083] max(K) is 0.7816;

[0084] The color intensity value at position (0.6, 0.75) is calculated as follows:

[0085]

[0086] The region sorting unit defines corresponding boundary coordinates for several regions. The boundary coordinates are used to determine whether the gaze point is located within a specific region. The position coordinates of the gaze point are traversed within a unit of time. The position coordinates of the gaze point are compared with the boundary coordinates of each region. It is checked whether the position coordinates of the gaze point are inside the region enclosed by the boundary coordinates of a certain region. If so, it is determined that the gaze point is located within the corresponding region.

[0087] Check whether adjacent fixation points are located in the same area. If adjacent fixation points are located in different areas, it is considered that the user's gaze has moved from one area to another and is recorded as a gaze shift. For each area, calculate how many times the gaze has shifted from other areas to that area.

[0088] Based on the number of gaze shifts in each area, each area is sorted and assigned a priority, and the brightness of each area of ​​the display screen is adjusted according to the priority.

[0089] The output of the region division unit is electrically connected to the input of the region sorting unit, the output of the region division unit is electrically connected to the input of the eye-tracking data analysis unit, the output of the eye-tracking data analysis unit is electrically connected to the input of the brightness adjustment module, the output of the region sorting unit is electrically connected to the input of the brightness adjustment module, and the output of the eye-tracking data analysis unit is electrically connected to the input of the system optimization module.

[0090] The brightness adjustment module gradually adjusts the brightness of the entire display screen based on ambient light data, and adjusts the brightness value of each area based on the gaze heatmap and priority of each area.

[0091] The brightness adjustment module includes a regional brightness adjustment unit and a brightness smoothing adjustment unit.

[0092] The area brightness adjustment unit determines the brightness value of each area of ​​the display screen based on the color intensity value analyzed by the user demand analysis module according to the stored first relationship table, which defines the correspondence between color intensity values ​​and display screen brightness values, and adjusts the brightness of each area of ​​the display screen according to priority.

[0093] The brightness smoothing adjustment unit acquires the current ambient light intensity data to obtain the current light intensity L, and then uses the formula... The light intensity L is mapped to a brightness value range, and the result is normalized to a range of 0 to 1000 to obtain the brightness value P. The system then gradually adjusts the brightness value of the display screen to P, where L... max This is the maximum value of the set light intensity;

[0094] The output of the ambient light acquisition unit is electrically connected to the input of the brightness smoothing adjustment unit, and the output of the eye-tracking data analysis unit is electrically connected to the input of the brightness smoothing adjustment unit.

[0095] The system optimization module directly adjusts the brightness based on the historical information of the display screen's brightness adjustment, avoiding repetitive analysis processes.

[0096] The system optimization module includes a storage unit and an optimization unit.

[0097] The storage unit stores a first relation table, a second relation table, and the user's historical display screen adjustment records. The first relation table defines the correspondence between color intensity values ​​and display screen brightness values. The second relation table defines the correspondence between color intensity values ​​and colors. The user's historical display screen adjustment records include the layout, content, and structure of the page the user was browsing at the time, the gaze point position, the generated gaze heatmap, and the corresponding brightness adjustment values.

[0098] The optimization unit is used to find the same gaze point position information and corresponding brightness adjustment value in the historical display adjustment record when the user visits the same page. The system directly applies these adjustment values ​​to adjust the brightness of the current display, improves the system performance, and makes the user experience smoother and more efficient.

[0099] The output of the storage unit is electrically connected to the input of the optimization unit, and the output of the optimization unit is electrically connected to the input of the brightness adjustment module.

[0100] To better implement the above system, a display control method based on data analysis is also proposed, including the following steps:

[0101] S10. Use infrared sensor devices to detect human body heat near the display screen in real time. When a change in human body heat is detected, the system starts collecting eye tracker data and recording ambient light intensity.

[0102] S20. Adjust the brightness of the entire display screen to the optimal brightness value that best matches the ambient light intensity.

[0103] S30. Divide the display screen into several areas based on the layout, content and structure of the page currently being viewed by the user, analyze the required brightness values ​​for each area in conjunction with the user's eye movement data, prioritize each area, and adjust the brightness values ​​of the required areas first.

[0104] In step S20, the ambient light intensity data is acquired using a light sensor to obtain the current light intensity L, which is then calculated using the formula... The light intensity L is mapped to a brightness value range, and the result is normalized to a range of 0 to 1000 to obtain the brightness value P. The system then gradually adjusts the brightness value of the display screen to P, where L... max This is the maximum value of the set light intensity.

[0105] Step S30 further includes the following steps:

[0106] S301. Analyze the current user's gaze position information. Based on the set of gaze points collected within a unit time, E = {1, 2, 3, ..., N}, where 1, 2, 3, ..., N represent the 1st, 2nd, 3rd, ..., Nth gaze points collected within a unit time, establish a two-dimensional coordinate system for the display screen. The x-axis represents the horizontal direction, and the y-axis represents the vertical direction. The origin (0,0) is located at the lower left corner of the screen. The x-axis extends to the right, and the y-axis extends upward. Divide the x and y coordinates of the gaze point by the width and height of the page, respectively, to obtain normalized coordinates (x, y) ranging from 0 to 1. i ,y i ),x i Represents the normalized x-coordinate and y-coordinate of any captured gaze point. i The y-coordinate represents the normalized coordinate of any captured gaze point;

[0107] S302. For any gaze point acquired, use a Gaussian kernel function to calculate the color intensity around the gaze point. The Gaussian kernel function has the following form:

[0108]

[0109] Where K(x,y) is the Gaussian kernel function value at position (x,y), and σ is the standard deviation of the Gaussian kernel function, which controls the degree of diffusion of the heatmap;

[0110] S303, through formula I(x,y) represents the color intensity value. The calculation result of the Gaussian kernel function is mapped to the range of color intensity. The result is normalized to the range of 0 to 300 to obtain the color intensity value at each position. Among them, max(K) is the maximum value of the Gaussian kernel function value at all positions.

[0111] S304. Based on the calculated color intensity values, fill the corresponding colors into the corresponding positions on the page to form a gaze heatmap of the regional distribution map.

[0112] S305. Define corresponding boundary coordinates for the divided regions. The boundary coordinates are used to determine whether the gaze point is located within a specific region. Traverse the position coordinates of the gaze point within a unit of time. By comparing the position coordinates of the gaze point with the boundary coordinates of each region, check whether the position coordinates of the gaze point are inside the region enclosed by the boundary coordinates of a certain region. If so, determine that the gaze point is located within the corresponding region.

[0113] Check whether adjacent fixation points are located in the same area. If adjacent fixation points are located in different areas, it is considered that the user's gaze has moved from one area to another and is recorded as a gaze shift. For each area, calculate how many times the gaze has shifted from other areas to that area.

[0114] Based on the number of times each area's gaze shifts, sort each area and assign it a priority.

[0115] S306. According to the stored first relationship table, which defines the correspondence between color intensity values ​​and display brightness values, the brightness values ​​of each area of ​​the display screen are determined based on the color intensity values, and the brightness of each area of ​​the display screen is adjusted according to priority.

[0116] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0117] Finally, it should be noted that the above descriptions are merely preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A display screen control system based on data analysis, characterized in that: The system also includes a data processing module, a user needs analysis module, a brightness adjustment module, and a system optimization module; The data processing module collects the user's eye movement data and ambient light data through an eye tracker and a light sensor, and detects whether the user is near the display screen through an infrared sensor. The user needs analysis module divides the display screen into several areas based on the layout, content, and structure of the page currently being viewed by the user. It then maps the user's eye movement data to the corresponding areas, analyzes the distribution of the user's gaze points in each area, generates a gaze heatmap, and prioritizes the brightness adjustment of each area. The brightness adjustment module gradually adjusts the brightness of the entire display screen based on ambient light data, and adjusts the brightness value of each area based on the gaze heatmap and priority of each area. The system optimization module directly adjusts the brightness based on the historical information of the display screen's brightness adjustment. The output of the data processing module is electrically connected to the input of the user demand analysis module, the output of the user demand analysis module is electrically connected to the input of the brightness adjustment module, and the output of the system optimization module is electrically connected to the input of the brightness adjustment module. The data processing module includes an infrared sensing unit, an ambient light acquisition unit, and an eye tracker acquisition unit. The infrared sensing unit is an infrared sensor, which is set at the edge of the display screen. The infrared sensor will continuously monitor the changes in the surrounding heat. When the sensor detects a change in heat, it indicates that there is a human body nearby. At the same time, the system begins to collect and process data, including the acquisition of eye tracker data and the recording of ambient light intensity. The ambient light acquisition unit is a light sensor, including a photoresistor and a photodiode, used to acquire current light intensity data; The eye tracker acquisition unit tracks the user's eye movements and collects eye movement data, including the location information of the user's gaze point; The output terminal of the infrared sensing unit is electrically connected to the input terminal of the ambient light acquisition unit, the output terminal of the infrared sensing unit is electrically connected to the input terminal of the eye tracker acquisition unit, the output terminal of the eye tracker acquisition unit is electrically connected to the input terminal of the user demand analysis module, and the output terminal of the ambient light acquisition unit is electrically connected to the input terminal of the brightness adjustment module. The user demand analysis module includes a region segmentation unit, an eye-tracking data analysis unit, and a region sorting unit. The area division unit divides the display screen into several areas based on the layout, content, and structure of the page browsed by the user, thus obtaining an area distribution map of the display screen. The eye-tracking data analysis unit analyzes the current user's gaze location information and generates a gaze heatmap. Based on the set of gaze points E={1, 2, 3, ..., N} collected within a unit of time, where 1, 2, 3, ..., N represent the 1st, 2nd, 3rd, ..., Nth gaze points collected within the unit of time, a two-dimensional coordinate system is established for the display screen. The x-axis represents the horizontal direction, the y-axis represents the vertical direction, and the origin (0, 0) is located at the lower left corner of the screen. The x-axis extends to the right, and the y-axis extends upwards. The x and y coordinates of the gaze points are divided by the width and height of the page, respectively, to obtain normalized coordinates (x, y) ranging from 0 to 1. i ,y i ),x i Represents the normalized x-coordinate and y-coordinate of any captured gaze point. i The y-coordinate represents the normalized coordinate of any captured gaze point; For any captured fixation point, the color intensity around the fixation point is calculated using a Gaussian kernel function, which has the following form: in, The standard deviation of the Gaussian kernel function; Through formula , Representing the color intensity value, the calculation result of the Gaussian kernel function is mapped to the range of color intensity, and the result is normalized to the range of 0 to 300 to obtain the color intensity value at each position. It is the maximum value of the Gaussian kernel function at all locations; Based on the calculated color intensity values, the corresponding colors are filled into the corresponding positions on the page to form a gaze heatmap of the regional distribution map; The region sorting unit defines corresponding boundary coordinates for several regions. The boundary coordinates are used to determine whether the gaze point is located within a specific region. The position coordinates of the gaze point are traversed within a unit of time. The position coordinates of the gaze point are compared with the boundary coordinates of each region. It is checked whether the position coordinates of the gaze point are inside the region enclosed by the boundary coordinates of a certain region. If so, it is determined that the gaze point is located within the corresponding region. Check whether adjacent fixation points are located in the same area. If adjacent fixation points are located in different areas, it is considered that the user's gaze has moved from one area to another and is recorded as a gaze shift. For each area, calculate how many times the gaze has shifted from other areas to that area. Based on the number of gaze shifts in each area, each area is sorted and assigned a priority, and the brightness of each area of ​​the display screen is adjusted according to the priority. The output of the region division unit is electrically connected to the input of the region sorting unit, the output of the region division unit is electrically connected to the input of the eye-tracking data analysis unit, the output of the eye-tracking data analysis unit is electrically connected to the input of the brightness adjustment module, the output of the region sorting unit is electrically connected to the input of the brightness adjustment module, and the output of the eye-tracking data analysis unit is electrically connected to the input of the system optimization module.

2. The display control system based on data analysis according to claim 1, characterized in that: The brightness adjustment module includes a regional brightness adjustment unit and a brightness smoothing adjustment unit; The area brightness adjustment unit determines the brightness value of each area of ​​the display screen based on the color intensity value analyzed by the user demand analysis module according to the stored first relationship table, which defines the correspondence between color intensity values ​​and display screen brightness values, and adjusts the brightness of each area of ​​the display screen according to priority. The brightness smoothing adjustment unit acquires the current ambient light intensity data to obtain the current light intensity L, and then uses the formula... The system maps the light intensity L to a range of brightness values, standardizes the result to a range of 0 to 1000, and obtains the brightness value P. The system then gradually adjusts the brightness value of the display screen to P. This is the maximum value of the set light intensity; The output of the ambient light acquisition unit is electrically connected to the input of the brightness smoothing adjustment unit, and the output of the eye-tracking data analysis unit is electrically connected to the input of the brightness smoothing adjustment unit.

3. A display screen control system based on data analysis according to claim 2, characterized in that: The system optimization module includes a storage unit and an optimization unit; The storage unit stores a first relation table, a second relation table, and the user's historical display screen adjustment records. The first relation table defines the correspondence between color intensity values ​​and display screen brightness values. The second relation table defines the correspondence between color intensity values ​​and colors. The user's historical display screen adjustment records include the layout, content, and structure of the page the user was browsing at the time, the gaze point position, the generated gaze heatmap, and the corresponding brightness adjustment values. The optimization unit is used to find the same gaze point position information and corresponding brightness adjustment value in the historical display adjustment record when the user visits the same page, and the system directly applies these adjustment values ​​to adjust the brightness of the current display. The output of the storage unit is electrically connected to the input of the optimization unit, and the output of the optimization unit is electrically connected to the input of the brightness adjustment module.

4. A display screen display control method based on data analysis, wherein the method is applied to the implementation of the display screen display control system based on data analysis as described in any one of claims 1-3, characterized in that: The method includes the following steps: S10. Use infrared sensor devices to detect human body heat near the display screen in real time. When a change in human body heat is detected, the system starts collecting eye tracker data and recording ambient light intensity. S20. Adjust the brightness of the entire display screen to the optimal brightness value that best matches the ambient light intensity. S30. Divide the display screen into several areas according to the layout, content and structure of the page currently being viewed by the user, analyze the required brightness values ​​of each area in combination with the user's eye movement data, prioritize each area, and adjust the brightness values ​​of the required areas first. Step S30 also includes the following steps: S301. Analyze the current user's gaze location information and generate a gaze heatmap. Based on the set of gaze points collected within a unit time, E={1, 2, 3, ..., N}, where 1, 2, 3, ..., N represent the 1st, 2nd, 3rd, ..., Nth gaze points collected within a unit time, establish a two-dimensional coordinate system for the display screen. The x-axis represents the horizontal direction, the y-axis represents the vertical direction, and the origin (0, 0) is located at the lower left corner of the screen. The x-axis extends to the right, and the y-axis extends upward. Divide the x and y coordinates of the gaze points by the width and height of the page, respectively, to obtain normalized coordinates (x, y) ranging from 0 to 1. i ,y i ),x i Represents the normalized x-coordinate and y-coordinate of any captured gaze point. i The y-coordinate represents the normalized coordinate of any captured gaze point; S302. For any gaze point acquired, use a Gaussian kernel function to calculate the color intensity around the gaze point. The Gaussian kernel function has the following form: in, The standard deviation of the Gaussian kernel function controls the degree of diffusion in the heatmap; S303, through formula , Representing the color intensity value, the calculation result of the Gaussian kernel function is mapped to the range of color intensity, and the result is normalized to the range of 0 to 300 to obtain the color intensity value at each position. It is the maximum value of the Gaussian kernel function at all locations; S304. Based on the calculated color intensity values, fill the corresponding colors into the corresponding positions on the page to form a gaze heatmap of the regional distribution map. S305. Define corresponding boundary coordinates for the divided regions. The boundary coordinates are used to determine whether the gaze point is located within a specific region. Traverse the position coordinates of the gaze point within a unit of time, compare the position coordinates of the gaze point with the boundary coordinates of each region, and check whether the position coordinates of the gaze point are inside the region enclosed by the boundary coordinates of a certain region. If so, determine that the gaze point is located within the corresponding region. Check whether adjacent fixation points are located in the same area. If adjacent fixation points are located in different areas, it is considered that the user's gaze has moved from one area to another and is recorded as a gaze shift. For each area, calculate how many times the gaze has shifted from other areas to that area. Based on the number of times each area's gaze shifts, sort each area and assign it a priority. S306. According to the stored first relationship table, which defines the correspondence between color intensity values ​​and display brightness values, the brightness values ​​of each area of ​​the display screen are determined based on the color intensity values, and the brightness of each area of ​​the display screen is adjusted according to priority.

5. The display control method for a screen based on data analysis according to claim 4, characterized in that: In step S20, the current ambient light intensity data is acquired using a light sensor to obtain the current light intensity L, which is then calculated using the formula... The system maps the light intensity L to a range of brightness values, standardizes the result to a range of 0 to 1000, and obtains the brightness value P. The system then gradually adjusts the brightness value of the display screen to P. This is the maximum value of the set light intensity.

Images