Display system for power consumption optimization

Abstract

The invention discloses a display system for power consumption optimization, and relates to the technical field of display power consumption optimizing.An eye coordinate system and a display screen coordinate system are established, sight line drop point coordinate data are calculated, and a display screen is divided into a plurality of areas; establishing a second corresponding relation among the area analysis result, the light emitting diode coordinate data at the content main body coverage position and the light emitting diode coordinate data at the background coverage position, detecting whether the sight line drop point coordinate data is located in the edge area of the display screen or not, outputting a behavior detection result, and controlling the light emitting diodes of the display screen. Through the sight tracking module and the content recognition module, display brightness and resolution are dynamically adjusted, energy consumption is remarkably reduced, the sight of a user is monitored in real time, the brightness of a region of interest is improved, and meanwhile the brightness of a background region is reduced, so that unnecessary energy consumption is reduced; the display parameters of the current page are optimized during page switching, and energy efficiency maximization is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of display power consumption optimization, and in particular to a display system for power consumption optimization. Background Art

[0002] With the development of display technology and the diversification of application scenarios, the power consumption of display devices has received increasing attention, especially on large-screen displays and mobile devices. Long-term high-brightness and high-definition resolution display will significantly increase the energy consumption of the device, shorten the service life of the device, and have a negative impact on battery-powered devices. In order to address these issues, optimizing the energy consumption management of display devices has become an important research topic.

[0003] At present, the Chinese invention patent with application number CN201910739380.3 discloses a SOC power consumption and performance optimization device and method based on display processing logic. The device includes: a SOC screen display control and processing logic unit, which is used to take out the display data corresponding to the display layers 1 to N in the SOC system memory, process and synthesize them, and then output them line by line to the external display screen; a SOC data bus performance control unit, which is used to control the bus performance of the SOC screen display control and processing logic unit in the process of taking data from the SOC system memory. The bus performance includes the SOC data bus priority, and a SOC CLOCK control unit, which controls the CLOCK frequency switching and the CLOCK switch in real time, so that the CLOCK frequency corresponding to the SOC screen display control and processing logic unit matches the display data volume of the display layers 1 to N, thereby achieving the purpose of improving power consumption and improving performance.

[0004] The above technology is difficult to track the brightness and resolution according to the user's line of sight, and it is difficult to perform zone-based adjustment according to the display content, which makes it difficult to optimize power consumption and causes waste of resources. Summary of the invention

[0005] The technical problem solved by the present invention is that it is difficult to perform tracking brightness and resolution adjustment according to the user's line of sight in the above-mentioned technology, and it is difficult to perform partition-based adjustment according to the display content, and it is difficult to optimize power consumption, resulting in waste of resources.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions:

[0007] A display system for power consumption optimization includes a sight tracking module, a region division module, a content recognition module, a behavior detection module and a parameter adjustment module:

[0008] The sight tracking module is used to establish the eye coordinate system and the display screen coordinate system, and calculate the sight point coordinate data;

[0009] The area division module is used to divide the display screen into several areas, obtain the area boundary coordinate data and the light-emitting diode coordinate data in the area according to the display screen coordinate system, establish a first corresponding relationship between the area boundary coordinate data and the light-emitting diode coordinate data, analyze the area where the sight point coordinate data is located, and output the area analysis result;

[0010] The content recognition module is used to identify the content body and background in the area according to the area analysis result, determine the content body type according to the content body, obtain the LED coordinate data of the content body covered and the LED coordinate data of the background covered according to the first corresponding relationship, and establish a second corresponding relationship between the area analysis result, the LED coordinate data of the content body covered and the LED coordinate data of the background covered;

[0011] The behavior detection module is used to detect whether the sight point coordinate data is located in the edge area of ​​the display screen, and output the behavior detection result;

[0012] The parameter adjustment module is used to control the light emitting diodes of the display screen according to the area analysis result, the second corresponding relationship and the behavior detection result.

[0013] Preferably, the sight tracking module includes a coordinate system definition unit and a coordinate calculation unit;

[0014] The coordinate system definition unit is used to establish a three-dimensional coordinate system with the pupil center as the origin, and output it as the eye coordinate system, and to establish a plane coordinate system with the lower left corner of the display screen as the origin, and output it as the real screen coordinate system.

[0015] Preferably, the coordinate calculation unit is used to calculate the vector data of the sight line direction, including horizontal sight line direction vector data, vertical sight line direction vector data and sight line forward component data:

[0016] The mathematical expression for calculating the horizontal sight direction vector data is:

[0017] V x = sin(θ h )

[0018] The mathematical expression for calculating the vertical sight line direction vector data is:

[0019] V y = sin(θ v )

[0020] The mathematical expression for calculating the forward component of line of sight data is:

[0021] V z =cos(θ h )cos(θ v )

[0022] Among them, V x is the horizontal sight line direction vector, V y is the vertical sight direction vector, V z is the forward component of the line of sight, θ h is the horizontal yaw angle, θ v is the vertical pitch angle;

[0023] Define the starting point of sight as the pupil position coordinate data (X eye , Y eye , Z eye ), calculate the parametric equation of the line of sight, the mathematical expression is:

[0024] X=X eye +t·V x

[0025] Y=Y eye +t·V y

[0026] Z=Z eye +t·V z

[0027] Wherein, X is the horizontal coordinate data of the sight line parameter, Y is the vertical coordinate data of the sight line parameter, Z is the vertical coordinate data of the sight line parameter, and t is the parameter variable of the sight line;

[0028] Substituting into the pupil position coordinates, the coordinate data of the intersection of the line of sight and the screen is:

[0029] X screen =X eye +t·V x

[0030] Y screen =Y eye +t·V y

[0031] Among them, X screen Y is the horizontal coordinate data of the intersection of the line of sight and the screen, screen The vertical coordinate data of the intersection of the line of sight and the screen;

[0032] Normalize the intersection coordinate data to the display screen coordinate system, and obtain the sight point coordinate data as follows:

[0033]

[0034] Among them, X pixel Y is the horizontal coordinate data of the sight point coordinate data, pixel is the vertical coordinate data of the sight point coordinate data, W screen To display screen width data, H screenTo display screen height data, X min To display the minimum value of the horizontal coordinate of the screen coordinate system, X max To display the maximum value of the horizontal coordinate of the screen coordinate system, Y min To display the minimum value of the vertical coordinate of the screen coordinate system, Y min To display the maximum value data of the vertical coordinate of the screen coordinate system.

[0035] Preferably, the region division module includes a region division unit, a boundary calculation unit, a diode mapping unit and a region analysis unit;

[0036] The area division unit is used to define the number of area divisions, and divide the display screen into a number of areas equal to the number of area divisions according to the size of the display screen and the display screen coordinate system;

[0037] The boundary calculation unit is used to calculate the coordinate data of the region boundary, and the mathematical expression is:

[0038]

[0039] Among them, X left is the left boundary coordinate data, X right is the right boundary coordinate data, Y bottom is the lower boundary coordinate data, Y top is the upper boundary coordinate data, j is the column number where the area is located, i is the row number where the area is located, N is the number of divisions of the horizontal axis of the display screen coordinate system, and M is the number of divisions of the vertical axis of the display screen coordinate system.

[0040] Preferably, the diode mapping unit is used to obtain the light-emitting diode coordinate data in each area according to the area boundary coordinate data, and establish a first corresponding relationship between the area edge coordinates and the light-emitting diode coordinate data;

[0041] The regional analysis unit is used to determine the region (i, j) according to the sight point coordinate data and the region boundary coordinate data, and output the regional analysis result.

[0042] Preferably, the content identification module includes a content detection unit, a coverage calculation unit and a relationship establishment unit;

[0043] The content detection unit is used to identify the text area, image area and background area other than the text area and image area in the area where the regional analysis result is located based on the regional analysis result;

[0044] The coverage calculation unit is used to obtain the LED coordinate data of the text area, the image area and the background area according to the first corresponding relationship, output it as the text area LED coordinate data, the image area LED coordinate data and the background area LED coordinate data, and merge the text area LED coordinate data, the image area LED coordinate data and the background area LED coordinate data to output as the area content coordinate data;

[0045] The relationship establishing unit is used to establish a second corresponding relationship between the region analysis result and the region content coordinate data.

[0046] Preferably, the behavior detection module includes an edge detection unit and a behavior recognition unit;

[0047] The edge detection unit is used to mark the outermost area of ​​the display screen coordinate system as the edge area, determine whether the sight point coordinate data is within the edge coordinate area, and output the determination result;

[0048] The behavior recognition unit is used to perform behavior analysis according to the judgment result:

[0049] If the result of the judgment is that the coordinate data of the sight point is within the edge coordinate area, it is judged as a page turning behavior;

[0050] If the judgment result is that the coordinate data of the sight point is not within the edge coordinate area, it is judged as an observation behavior;

[0051] The behavior detection result is output, where the behavior detection result includes page turning behavior and observing behavior.

[0052] Preferably, the parameter adjustment module includes a brightness adjustment unit and a resolution adjustment unit;

[0053] The brightness adjustment unit is used to control the light emitting diodes of the display screen according to the area analysis result, the second corresponding relationship and the behavior detection result;

[0054] If the behavior detection result is an observed behavior, obtain the LED coordinate data in the area analysis result, perform a first-level brightness increase adjustment on the LED corresponding to the LED coordinate data, obtain the text area LED coordinate data of the text area in the second corresponding relationship, perform a second-level brightness increase adjustment on the LED corresponding to the text area LED coordinate data, obtain the background area LED coordinate data of the background area in the second corresponding relationship, and perform a first-level brightness decrease adjustment on the LED corresponding to the background area LED coordinate data;

[0055] If the behavior detection result is a page turning behavior, the light emitting diodes corresponding to the light emitting diode coordinate data in the current display screen page are adjusted to have a secondary brightness reduction;

[0056] The resolution adjustment unit is used to control the display screen according to the region analysis result, the second corresponding relationship and the behavior detection result;

[0057] If the behavior detection result is an observed behavior, the region in the region analysis result is adjusted to increase the primary resolution, the image region in the second corresponding relationship is adjusted to increase the secondary resolution, and the background region in the second corresponding relationship is adjusted to decrease the primary resolution;

[0058] If the behavior detection result is a page turning behavior, the second-level resolution reduction adjustment is performed on the current display screen page.

[0059] An electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a display system for optimizing power consumption is implemented.

[0060] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the display system for optimizing power consumption is implemented.

[0061] Beneficial effects of the present invention: The present invention dynamically adjusts display brightness and resolution through an eye tracking module and a content recognition module, significantly reduces energy consumption, monitors the user's eye line in real time, increases the brightness of the focus area, and reduces the brightness of the background area, thereby reducing unnecessary energy consumption, and intelligently identifies the user's page-turning behavior, optimizes the display parameters of the current page when switching pages, ensuring maximum energy efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 A schematic diagram of a basic flow of a display system for power consumption optimization provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0063] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings. It is obvious that the described embodiments are only part of the embodiments of the present invention, but not all of the embodiments.

[0064] Example, see Figure 1 , provides a display system for power consumption optimization, including a gaze tracking module, a region division module, a content recognition module, a behavior detection module and a parameter adjustment module:

[0065] The sight tracking module is used to establish the eye coordinate system and the display screen coordinate system, and calculate the coordinate data of the sight point.

[0066] The area division module is used to divide the display screen into several areas, obtain the area boundary coordinate data and the light-emitting diode coordinate data in the area according to the display screen coordinate system, establish the first correspondence between the area boundary coordinate data and the light-emitting diode coordinate data, analyze the area where the line of sight point coordinate data is located, and output the area analysis results.

[0067] The content recognition module is used to identify the content body and background in the area according to the regional analysis results, determine the content body type according to the content body, obtain the LED coordinate data at the content body coverage and the LED coordinate data at the background coverage according to the first correspondence, and establish a second correspondence between the regional analysis results, the LED coordinate data at the content body coverage and the LED coordinate data at the background coverage.

[0068] The behavior detection module is used to detect whether the sight point coordinate data is located in the edge area of ​​the display screen and output the behavior detection result.

[0069] The parameter adjustment module is used to control the light emitting diodes of the display screen according to the regional analysis result, the second corresponding relationship and the behavior detection result.

[0070] The sight tracking module includes a coordinate system definition unit and a coordinate calculation unit.

[0071] The coordinate system definition unit is used to establish a three-dimensional coordinate system with the pupil center as the origin, and output it as the eye coordinate system, and to establish a plane coordinate system with the lower left corner of the display screen as the origin, and output it as the real screen coordinate system.

[0072] The coordinate system definition unit provides a unified reference frame for gaze tracking, ensuring the accuracy of subsequent coordinate calculations and facilitating the precise correspondence between eye movement data and content on the display screen.

[0073] The coordinate calculation unit is used to calculate the vector data of the sight direction, including the horizontal sight direction vector data, the vertical sight direction vector data and the sight forward component data:

[0074] The mathematical expression for calculating the horizontal sight direction vector data is:

[0075] V x = sin(θ h )

[0076] The mathematical expression for calculating the vertical sight line direction vector data is:

[0077] V y = sin(θ v )

[0078] The mathematical expression for calculating the forward component of line of sight data is:

[0079] Vz =cos(θ h )cos(θ v )

[0080] Among them, V x is the horizontal sight line direction vector, V y is the vertical sight direction vector, V z is the forward component of the line of sight, θ h is the horizontal yaw angle, θ v is the vertical pitch angle.

[0081] Define the starting point of sight as the pupil position coordinate data (X eye , Y eye , Z eye ), calculate the parametric equation of the line of sight, the mathematical expression is:

[0082] X=X eye +t·V x

[0083] Y=Y eye +t·V y

[0084] Z=Z eye +t·V z

[0085] Among them, X is the horizontal coordinate data of the sight line parameter, Y is the vertical coordinate data of the sight line parameter, Z is the vertical coordinate data of the sight line parameter, and t is the parameter variable of the sight line.

[0086] Substituting into the pupil position coordinates, the coordinate data of the intersection of the line of sight and the screen is:

[0087] X screen =X eye +t·V x

[0088] Y screen =Y eye +t·V y

[0089] Among them, X screen Y is the horizontal coordinate data of the intersection of the line of sight and the screen, screen It is the vertical coordinate data of the intersection of the line of sight and the screen.

[0090] Normalize the intersection coordinate data to the display screen coordinate system, and obtain the sight point coordinate data as follows:

[0091]

[0092] Among them, X pixel Y is the horizontal coordinate data of the sight point coordinate data, pixelis the vertical coordinate data of the sight point coordinate data, W screen To display screen width data, H screen To display screen height data, X min To display the minimum value of the horizontal coordinate of the screen coordinate system, X max To display the maximum value of the horizontal coordinate of the screen coordinate system, Y min To display the minimum value of the vertical coordinate of the screen coordinate system, Y min To display the maximum value data of the vertical coordinate of the screen coordinate system.

[0093] The coordinate calculation unit accurately obtains the coordinate data of the sight point and responds to the area of ​​the user's attention in real time. By normalizing the intersection coordinate data to the display screen coordinate system, the consistency of the sight position in different display environments is ensured, laying the foundation for subsequent area division and content recognition.

[0094] The eye tracking module ensures that the present invention can accurately locate the user's gaze point, providing basic data for subsequent area division and content recognition, thereby optimizing display effects and energy consumption management.

[0095] The region division module includes a region division unit, a boundary calculation unit, a diode mapping unit and a region analysis unit.

[0096] The area division unit is used to define the number of area divisions, and divide the display screen into a number of areas equal to the number of area divisions according to the size of the display screen and the display screen coordinate system.

[0097] The area division unit effectively organizes and manages the display content, and provides clear area division for subsequent analysis, so that the present invention can perform specific adjustments and optimizations for different areas.

[0098] The boundary calculation unit is used to calculate the coordinate data of the area boundary. The mathematical expression is:

[0099]

[0100] Among them, X left is the left boundary coordinate data, X right is the right boundary coordinate data, Y bottom is the lower boundary coordinate data, Y top is the upper boundary coordinate data, j is the column number where the area is located, i is the row number where the area is located, N is the number of divisions of the horizontal axis of the display screen coordinate system, and M is the number of divisions of the vertical axis of the display screen coordinate system.

[0101] The boundary calculation unit provides precise regional boundary information to ensure the accuracy of regional division and lay the foundation for subsequent diode mapping and regional analysis.

[0102] The diode mapping unit is used to obtain the light-emitting diode coordinate data in each area according to the area boundary coordinate data, and establish a first corresponding relationship between the area edge coordinates and the light-emitting diode coordinate data.

[0103] The diode mapping unit ensures that the LEDs within a region can be accurately identified and controlled, so that brightness and resolution can be adjusted for specific areas, thereby achieving more effective energy consumption optimization.

[0104] The regional analysis unit is used to determine the region (i, j) according to the sight point coordinate data and the regional boundary coordinate data, and output the regional analysis result.

[0105] The area analysis unit feeds back the user's focus area in real time, and provides key information for the content recognition module, thereby improving the responsiveness and user experience of the present invention and ensuring the effectiveness of energy consumption management.

[0106] The region division module provides basic information for content recognition and subsequent parameter adjustment, thereby optimizing display effects and energy consumption management.

[0107] The content recognition module includes a content detection unit, a coverage calculation unit and a relationship establishment unit.

[0108] The content detection unit is used to identify the text area, the image area and the background area other than the text area and the image area in the area where the regional analysis result is located based on the regional analysis result.

[0109] The content detection unit effectively distinguishes different types of content and provides accurate information, ensuring that subsequent adjustments can be optimized for specific content, thereby improving the accuracy of content identification.

[0110] The coverage calculation unit is used to obtain the LED coordinate data covered by the text area, image area and background area according to the first corresponding relationship, and output it as the text area LED coordinate data, image area LED coordinate data and background area LED coordinate data, and merge the text area LED coordinate data, image area LED coordinate data and background area LED coordinate data into area content coordinate data.

[0111] The coverage calculation unit ensures that the present invention can understand the relationship between each content area and a specific light emitting diode, so that subsequent brightness and resolution adjustments can be accurate to the specific area and content, thereby optimizing energy consumption.

[0112] The relationship establishing unit is used to establish a second corresponding relationship between the region analysis result and the region content coordinate data.

[0113] The relationship building unit provides important context information for the present invention, so that the content recognition result is combined with the actual display control, further enhancing the intelligence level of the present invention and ensuring the effectiveness of energy consumption optimization.

[0114] The content recognition module ensures that the present invention can intelligently respond to the content that the user is concerned about and improve the visual effect.

[0115] The behavior detection module includes an edge detection unit and a behavior recognition unit.

[0116] The edge detection unit is used to mark the outermost area of ​​the display screen coordinate system as the edge area, determine whether the line of sight point coordinate data is within the edge coordinate area, and output the determination result.

[0117] The edge detection unit identifies whether the user's line of sight is close to the edge of the screen, providing basic data for subsequent behavior recognition, and ensuring that the present invention can correctly understand the user's intention.

[0118] The behavior recognition unit is used to perform behavior analysis based on the judgment results:

[0119] If the judgment result is that the coordinate data of the sight point is within the edge coordinate area, it is judged as a page turning behavior.

[0120] If the judgment result is that the coordinate data of the sight point is not within the edge coordinate area, it is judged as an observation behavior.

[0121] The behavior detection result is output, where the behavior detection result includes page turning behavior and observing behavior.

[0122] The behavior recognition unit accurately identifies user behavior, optimizes energy consumption and improves user experience.

[0123] The behavior detection module ensures that the present invention can adapt to the user's interaction mode, optimize energy consumption and enhance user experience.

[0124] The parameter adjustment module includes a brightness adjustment unit and a resolution adjustment unit.

[0125] The brightness adjustment unit is used to control the light emitting diodes of the display screen according to the area analysis result, the second corresponding relationship and the behavior detection result.

[0126] If the behavior detection result is the behavior under observation, obtain the LED coordinate data in the area analysis result, and perform a first-level brightness increase adjustment on the LED corresponding to the LED coordinate data; obtain the text area LED coordinate data of the text area in the second corresponding relationship, and perform a second-level brightness increase adjustment on the LED corresponding to the text area LED coordinate data; obtain the background area LED coordinate data of the background area in the second corresponding relationship, and perform a first-level brightness decrease adjustment on the LED corresponding to the background area LED coordinate data.

[0127] If the behavior detection result is a page turning behavior, the light emitting diodes corresponding to the light emitting diode coordinate data in the current display screen page are adjusted to have secondary brightness reduction.

[0128] The brightness adjustment unit controls the brightness of the LED according to the regional analysis result, the second corresponding relationship and the behavior detection result. If it is an observation behavior, the brightness of the LED in the focus area is increased to ensure that the content that the user is focusing on is more prominent, the brightness of the text area is further improved, and the brightness of the background area is appropriately reduced to reduce visual interference. If it is a page turning behavior, the brightness of all LEDs on the current page is reduced to reduce energy consumption and avoid discomfort to the user caused by sudden brightness changes.

[0129] The resolution adjustment unit is used to control the display screen according to the region analysis result, the second corresponding relationship and the behavior detection result.

[0130] If the behavior detection result is an observed behavior, the area in the regional analysis result is adjusted to increase the first-level resolution, the image area in the second corresponding relationship is adjusted to increase the second-level resolution, and the background area in the second corresponding relationship is adjusted to decrease the first-level resolution.

[0131] If the behavior detection result is a page turning behavior, the second-level resolution reduction adjustment is performed on the current display screen page.

[0132] The resolution adjustment unit controls the resolution of the display screen according to the regional analysis results, the second correspondence and the behavior detection results. If it is an observation behavior, the resolution of the focus area is increased to improve the detail performance; the resolution of the background area is reduced to further reduce resource consumption. If it is a page turning behavior, the resolution of the current page is reduced as a whole to optimize performance and reduce power consumption.

[0133] The parameter adjustment module optimizes the display effect and reduces energy consumption by intelligently adjusting the brightness and resolution of the display screen according to the user's behavior and focus content, ensuring that the present invention can flexibly respond to user needs and improve visual experience and energy efficiency.

[0134] The present invention can detect the user's line of sight in real time, and dynamically adjust the brightness and resolution of the display area according to the line of sight position and content type. When the user focuses on a certain content area, the present invention will increase the brightness and resolution of the area to ensure that the content is clearly visible, while for the background area, the brightness and resolution are appropriately reduced, thereby effectively reducing power consumption. Through the area division module, the display screen is divided into multiple areas, and the content body and background of each area are identified, ensuring that the present invention can perform specific adjustment strategies for different types of content, making the optimization effect more targeted and effective. Through the behavior detection module, the user's line of sight behavior is monitored in real time, and the user's page turning behavior and observation behavior can be identified. When the user turns the page, the brightness and resolution of the current page are reduced, and at the same time, the brightness and resolution are pre-adjusted for the content to be displayed, thereby improving the fluency and comfort of page switching.

[0135] It should be understood by those skilled in the art that the embodiments of the present invention can be provided as methods, systems or computer program products. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program codes. Among them, the storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, referred to as EPROM), programmable read-only memory (Programmable Red-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic memory, flash memory, disk or optical disk. These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0136] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A display system for power consumption optimization, characterized in that: Including gaze tracking module, area division module, content recognition module, behavior detection module and parameter adjustment module: The sight tracking module is used to establish the eye coordinate system and the display screen coordinate system, and calculate the sight point coordinate data; The area division module is used to divide the display screen into several areas, obtain the area boundary coordinate data and the light-emitting diode coordinate data in the area according to the display screen coordinate system, establish a first corresponding relationship between the area boundary coordinate data and the light-emitting diode coordinate data, analyze the area where the sight point coordinate data is located, and output the area analysis result; The content recognition module is used to identify the content body and background in the area according to the area analysis result, determine the content body type according to the content body, obtain the LED coordinate data of the content body covered and the LED coordinate data of the background covered according to the first corresponding relationship, and establish a second corresponding relationship between the area analysis result, the LED coordinate data of the content body covered and the LED coordinate data of the background covered; The behavior detection module is used to detect whether the sight point coordinate data is located in the edge area of ​​the display screen, and output the behavior detection result; The parameter adjustment module is used to control the light emitting diodes of the display screen according to the area analysis result, the second corresponding relationship and the behavior detection result.

2. A display system for power consumption optimization as claimed in claim 1, characterized in that: The sight tracking module includes a coordinate system definition unit and a coordinate calculation unit; The coordinate system definition unit is used to establish a three-dimensional coordinate system with the pupil center as the origin, and output it as the eye coordinate system, and to establish a plane coordinate system with the lower left corner of the display screen as the origin, and output it as the real screen coordinate system.

3. A display system for power consumption optimization as claimed in claim 2, characterized in that: The coordinate calculation unit is used to calculate the vector data of the sight direction, including horizontal sight direction vector data, vertical sight direction vector data and sight forward component data: The mathematical expression for calculating the horizontal sight direction vector data is: V x =sin(θ h ) The mathematical expression for calculating the vertical sight line direction vector data is: V y =sin(θ v ) The mathematical expression for calculating the forward component of line of sight data is: V z =cos(θ h )cos(θ v ) Among them, V x is the horizontal sight line direction vector, V y is the vertical sight direction vector, V z is the forward component of the line of sight, θ h is the horizontal yaw angle, θ v is the vertical pitch angle; Define the starting point of sight as the pupil position coordinate data (X eye ,Y eye ,Z eye ), calculate the parametric equation of the line of sight, the mathematical expression is: X=X eye +t·V x Y=Y eye +t·V y Z=Z eye +t·V z Wherein, X is the horizontal coordinate data of the sight line parameter, Y is the vertical coordinate data of the sight line parameter, Z is the vertical coordinate data of the sight line parameter, and t is the parameter variable of the sight line; Substituting into the pupil position coordinates, the coordinate data of the intersection of the line of sight and the screen is: X screen =X eye +t·V x Y screen =Y eye +t·V y Among them, X screen Y is the horizontal coordinate data of the intersection of the line of sight and the screen, screen The vertical coordinate data of the intersection of the line of sight and the screen; Normalize the intersection coordinate data to the display screen coordinate system, and obtain the sight point coordinate data as follows: Among them, X pixel Y is the horizontal coordinate data of the sight point coordinate data, pixel is the vertical coordinate data of the sight point coordinate data, W screen To display screen width data, H screen To display screen height data, X min To display the minimum value of the horizontal coordinate of the screen coordinate system, X max To display the maximum value of the horizontal coordinate of the screen coordinate system, Y min To display the minimum value of the vertical coordinate of the screen coordinate system, Y min To display the maximum value data of the vertical coordinate of the screen coordinate system.

4. A display system for power consumption optimization as claimed in claim 3, characterized in that: The region division module includes a region division unit, a boundary calculation unit, a diode mapping unit and a region analysis unit; The area division unit is used to define the number of area divisions, and divide the display screen into a number of areas equal to the number of area divisions according to the size of the display screen and the display screen coordinate system; The boundary calculation unit is used to calculate the coordinate data of the region boundary, and the mathematical expression is: Among them, X left is the left boundary coordinate data, X right is the right boundary coordinate data, Y bottom is the lower boundary coordinate data, Y top is the upper boundary coordinate data, j is the column number where the area is located, i is the row number where the area is located, N is the number of divisions of the horizontal axis of the display screen coordinate system, and M is the number of divisions of the vertical axis of the display screen coordinate system.

5. A display system for power consumption optimization as claimed in claim 4, characterized in that: The diode mapping unit is used to obtain the light-emitting diode coordinate data in each area according to the area boundary coordinate data, and establish a first corresponding relationship between the area edge coordinates and the light-emitting diode coordinate data; The regional analysis unit is used to determine the region (i, j) according to the sight point coordinate data and the region boundary coordinate data, and output the regional analysis result.

6. A display system for power consumption optimization as claimed in claim 5, characterized in that: The content identification module includes a content detection unit, a coverage calculation unit and a relationship establishment unit; The content detection unit is used to identify the text area, image area and background area other than the text area and image area in the area where the regional analysis result is located based on the regional analysis result; The coverage calculation unit is used to obtain the LED coordinate data of the text area, the image area and the background area according to the first corresponding relationship, output it as the text area LED coordinate data, the image area LED coordinate data and the background area LED coordinate data, and merge the text area LED coordinate data, the image area LED coordinate data and the background area LED coordinate data to output as the area content coordinate data; The relationship establishing unit is used to establish a second corresponding relationship between the region analysis result and the region content coordinate data.

7. A display system for power consumption optimization as claimed in claim 6, characterized in that: The behavior detection module includes an edge detection unit and a behavior recognition unit; The edge detection unit is used to mark the outermost area of ​​the display screen coordinate system as the edge area, determine whether the sight point coordinate data is within the edge coordinate area, and output the determination result; The behavior recognition unit is used to perform behavior analysis according to the judgment result: If the result of the judgment is that the coordinate data of the sight point is within the edge coordinate area, it is judged as a page turning behavior; If the judgment result is that the coordinate data of the sight point is not within the edge coordinate area, it is judged as an observation behavior; The behavior detection result is output, where the behavior detection result includes page turning behavior and observing behavior.

8. A display system for power consumption optimization as claimed in claim 7, characterized in that: The parameter adjustment module includes a brightness adjustment unit and a resolution adjustment unit; The brightness adjustment unit is used to control the light emitting diodes of the display screen according to the area analysis result, the second corresponding relationship and the behavior detection result; If the behavior detection result is an observed behavior, obtain the LED coordinate data in the area analysis result, perform a first-level brightness increase adjustment on the LED corresponding to the LED coordinate data, obtain the text area LED coordinate data of the text area in the second corresponding relationship, perform a second-level brightness increase adjustment on the LED corresponding to the text area LED coordinate data, obtain the background area LED coordinate data of the background area in the second corresponding relationship, and perform a first-level brightness decrease adjustment on the LED corresponding to the background area LED coordinate data; If the behavior detection result is a page turning behavior, the light emitting diodes corresponding to the light emitting diode coordinate data in the current display screen page are adjusted to have a secondary brightness reduction; The resolution adjustment unit is used to control the display screen according to the region analysis result, the second corresponding relationship and the behavior detection result; If the behavior detection result is an observed behavior, the region in the region analysis result is adjusted to increase the primary resolution, the image region in the second corresponding relationship is adjusted to increase the secondary resolution, and the background region in the second corresponding relationship is adjusted to decrease the primary resolution; If the behavior detection result is a page turning behavior, the second-level resolution reduction adjustment is performed on the current display screen page.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the display system for optimizing power consumption as described in any one of claims 1 to 8 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the display system for optimizing power consumption according to any one of claims 1 to 8 is implemented.

Images