Display device power consumption

Abstract

The invention provides "display device power consumption". When operating the display device at a predetermined voltage, a fitting function is determined based on a corresponding grayscale image output by the display device. A respective actual power consumption of the display device is determined for a respective color image output by the display device. For respective color images, respective power consumption of the display device is predicted based on the fitting function. A best fit line is determined based on the respective actual power consumption and the respective predicted power consumption. When outputting an image via the display device, a total power consumption of the display device is predicted based on the best fit line and the fit function.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to determining power consumption of a display device in a vehicle. BACKGROUND

[0002] Mobile and / or systems having mobile components, including vehicles, robots, drones, cell phones, etc., can operate by acquiring and processing sensor data, including data about the state of the system and data about the environment surrounding the system. For example, a computing device included in a vehicle can format data and output it to a display device for viewing and interaction by a vehicle occupant. The display device can display a wide variety of data, including but not limited to vehicle control screens that control vehicle systems such as climate control and vehicle propulsion, vehicle status data such as vehicle speed, energy usage, and vehicle service notifications, data about the environment surrounding the vehicle such as traffic and navigation maps, entertainment data such as cable television, movies, video games, and internet via a web browser, and cellular telephone data such as text messages. SUMMARY

[0003] Vehicle operation will be used herein as a non-limiting example of a system that can include a display. A vehicle can include one or more display devices. Vehicle data that can be displayed on a display device includes vehicle operation data such as vehicle speed, amount of vehicle energy (e.g., remaining fuel or battery charge), and alert messages about vehicle systems (e.g., low tire pressure alert, engine temperature alert, etc.). A vehicle display device can display the status of vehicle components such as climate control and lighting. In conjunction with touch screen technology or voice recognition technology, a display device can display data about vehicle components and receive input from an occupant about control of the vehicle components. A vehicle display device can also be used to display image data from computing device memory or external sources such as the internet. Examples of image data display include navigation data, videos, and web browsing.

[0004] A display device may include a liquid crystal display (LCD) and an array of addressable light-emitting diodes (LEDs) arranged to backlight the LCD. Backlighting is a technique for applying illumination to the LCD from below. An addressable LED array includes one or more LEDs in addressable areas, meaning that the LEDs in each area can be controlled individually. That is, LED areas can be individually controlled to supply light to corresponding LCD pixel areas to accommodate different image and lighting requirements. However, individually controlling LED areas results in non-linear output brightness and total power consumption of the display device, which reduces the likelihood of reliably predicting the total power consumption of the display device when displaying various images. Reliable prediction of the total power consumption of the display device when displaying various images helps in developing display devices that meet power consumption constraints when operating in vehicles with limited power for various components (e.g., due to battery capacity).

[0005] As disclosed herein, the display device can operate at a predetermined voltage to output various grayscale images and various color images. A fitting function can be determined based on the various grayscale images. An optimal fitting line can be determined based on the actual power consumption used to output the various color images and the predicted power consumption used to output the various color images, as determined by the fitting function. The total power consumption of the display device for outputting the images can be predicted based on the fitting function and the optimal fitting line. Predicting the total power consumption based on the fitting function and the optimal fitting line increases the possibility of reliably (i.e., with reliable accuracy) predicting the total power consumption by taking into account the nonlinearity introduced by the addressable LED areas, thereby contributing to the development of display devices that meet the power consumption constraints of vehicles. Furthermore, predicting the total power consumption allows for the development of displays with reduced heat dissipation and reduces the need for an active cooling system within the display, which can also reduce the power drawn by the display from the vehicle battery.

[0006] A system includes a computer comprising a processor and a memory storing instructions executable by the processor to: determine a fitting function based on a corresponding grayscale image output by the display device when operating the display device at a predetermined voltage; determine a corresponding actual power consumption of the display device for a corresponding color image output by the display device; predict a corresponding power consumption of the display device based on the fitting function for a corresponding color image; determine an optimal fitting line based on the corresponding actual power consumption and the corresponding predicted power consumption; and predict the total power consumption of the display device based on the optimal fitting line and the fitting function when outputting an image via the display device.

[0007] The instructions may further include instructions for performing the following operations: generating a corresponding grayscale image defining a corresponding LCD pixel region for a corresponding color image. The corresponding grayscale image can represent pixels in the corresponding LCD pixel region as corresponding grayscale values. The instructions may further include instructions for performing the following operations: determining a corresponding grayscale value based on the maximum red, green, and blue (RGB) pixel values ​​of the pixels in the corresponding LCD pixel region. The instructions may further include instructions for performing the following operations: determining a corresponding grayscale change of the corresponding color image based on the corresponding difference between corresponding grayscale values ​​of adjacent corresponding LCD pixel regions combined within the corresponding grayscale image. The instructions may further include instructions for performing the following operations: further determining an optimal fitting line based on the corresponding grayscale change. The instructions may further include instructions for performing the following operations: further predicting the corresponding power consumption of the display device based on the corresponding grayscale value and the number of corresponding LCD pixel regions.

[0008] The instructions may also include instructions for performing the following operations: operating the display device at a predetermined voltage to output an image.

[0009] The instructions may also include instructions to operate the display device at a predetermined voltage to output a corresponding color image. The instructions may also include instructions to determine the corresponding current input to the display device for the corresponding color image output by the display device. The actual power consumption of the display device can be determined based on the corresponding current and the predetermined voltage.

[0010] A method includes: determining a fitting function based on a corresponding grayscale image output by the display device when operating the display device at a predetermined voltage. The method further includes: determining a corresponding actual power consumption of the display device for a corresponding color image output by the display device. The method further includes: predicting a corresponding power consumption of the display device based on the fitting function for the corresponding color image. The method further includes: determining an optimal fitting line based on the corresponding actual power consumption and the corresponding predicted power consumption. The method further includes: predicting the total power consumption of the display device based on the optimal fitting line and the fitting function when outputting an image via the display device.

[0011] The method may further include: generating a corresponding grayscale image defining corresponding LCD pixel regions for a corresponding color image. The corresponding grayscale image can represent pixels in the corresponding region as corresponding grayscale values. The method may further include: determining the corresponding grayscale value based on the maximum red, green, and blue (RGB) pixel values ​​of the pixels in the corresponding LCD pixel region. The method may further include: determining the corresponding grayscale change of the corresponding color image based on the corresponding difference between the corresponding grayscale values ​​of adjacent corresponding LCD pixel regions combined within the corresponding grayscale image. The method may further include: further determining an optimal fitting line based on the corresponding grayscale change. The method may further include: further predicting the corresponding power consumption of the display device based on the corresponding grayscale value and the number of corresponding LCD pixel regions.

[0012] The method may further include: operating the display device at a predetermined voltage to output an image.

[0013] The method may further include: operating the display device at a predetermined voltage to output a corresponding color image. The method may also include: determining a corresponding current input to the display device for the corresponding color image output by the display device. The actual power consumption of the display device may be determined based on the corresponding current and the predetermined voltage.

[0014] This document also discloses a computing device programmed to perform any of the above-described method steps. It further discloses a computer program product comprising a computer-readable medium storing instructions executable by a computer processor to perform any of the above-described method steps. Attached Figure Description

[0015] Figure 1 It is a block diagram showing the simulation system.

[0016] Figure 2 This is an illustration of an example liquid crystal display (LCD).

[0017] Figure 3 This is a diagram of an example light-emitting diode (LED) array.

[0018] Figure 4 This is a cross-sectional view of the example display device.

[0019] Figure 5 This is a flowchart of an example process for determining the fitting function and best-fit line for a display device.

[0020] Figure 6 This is a flowchart of an example process for predicting the total power consumption of a display device when outputting an image. Detailed Implementation

[0021] refer to Figure 1 Example simulation system 100 includes computer 110. Simulation system 100 can simulate the operating conditions of a display device. For example, the display device may be included in various objects (e.g., in a vehicle, a computer monitor, a handheld device, etc.) to display various data at various brightness levels based on the illumination of the environment surrounding the display device (e.g., natural or artificial lighting, static or dynamic brightness levels, etc.). Computer 110 is configured to: determine a fitting function based on a corresponding grayscale image output by the display device when the display device is operating at a predetermined voltage. Computer 110 is also programmed to: determine the corresponding actual power consumption of the display device for a corresponding color image output by the display device. Computer 110 is also programmed to: predict the corresponding power consumption of the display device based on the fitting function for a corresponding color image. Computer 110 is also programmed to: determine an optimal fitting line based on the corresponding actual power consumption and the corresponding predicted power consumption. Computer 110 is also programmed to: predict the total power consumption of the display device based on the optimal fitting line and the fitting function when an image is output via the display device.

[0022] The simulation system 100 may include hardware and software such as those known (and / or that may be developed or built in the future). The simulation system 100 may include a computer 110, a sensor 115, a display controller 117, and a display device 120. As discussed further below, the simulation system 100 may simulate the operation of the display device 120.

[0023] Computer 110 includes a processor and memory. Furthermore, the memory includes one or more forms of computer-readable medium and stores instructions executable by the processor to perform various operations, including those disclosed herein. Computer 110 is typically arranged for communication over a communication network, which may include a Controller Area Network (CAN) and / or other wired and / or wireless mechanisms. Via the communication network, computer 110 can receive messages (e.g., CAN messages) from various devices in the simulation system 100 (e.g., sensors 115, display controllers 117, etc.). For example, sensor 115 may provide data to computer 110 regarding a display device 120 used for simulation. As another example, display controller 117 may receive visual data from computer 110 to be displayed on display device 120 in a visual format. As mentioned below, various controllers and / or sensors 115 may provide data to computer 110 via the communication network. Additionally, computer 110 may transmit messages to remote server computer 140 (e.g., via network 135 discussed below).

[0024] Computer 110 can collect and process data regarding the display device 120 used for simulation. Based on the data, computer 110 can actuate the display device 120 during simulation. For example, computer 110 can control the actuation of the simulated display device 120 (e.g., to display various images). Computer 110 may be an electronic control unit (ECU). An “electronic control unit” (ECU) is a device that includes a processor and a memory, the memory including programming for controlling vehicle components or subsystems (such as a subsystem including one or more display devices 120) (i.e., the memory stores instructions executable by the processor).

[0025] Sensor 115 may include a variety of devices. For example, sensor 115 may include a camera, a light sensor (e.g., a photodiode, a photoresistor, a phototransistor, a photovoltaic light sensor, etc.), a light emission sensor, etc., to provide data (e.g., data related to current, brightness, etc.) to computer 110 via wired communication.

[0026] Display controller 117 may be a computing device programmed to monitor and control display device 120. The controller may be an ECU, possibly including additional programming as described herein. Display controller 117 may be communicatively connected to computer 110 and receive instructions from said computer (e.g., via a communication network) to actuate display device 120 according to those instructions. For example, display controller 117 may receive instructions from computer 110 to display various images on display device 120. Alternatively, display controller 117 may be included within computer 110.

[0027] The simulation system 100 also includes a human-machine interface (HMI) 118. The HMI 118 includes user input devices such as knobs, buttons, switches, pedals, joysticks, touchscreens, and / or microphones. The input devices may include sensors 115 to detect user input and provide user input data to a computer 110. That is, the computer 110 may be programmed to receive user input from the HMI 118. The user may provide user input via the HMI 118 (e.g., by selecting a virtual button on a touchscreen display, by providing voice commands, etc.). For example, the touchscreen display included in the HMI 118 may include sensors 115 to detect when the user has selected a virtual button on the touchscreen display to, for example, select or deselect various images to be displayed via a display device 120, and this input may be received in the computer 110 and used to determine the selection of the user input.

[0028] HMI 118 typically also includes output devices that output signals or data to occupants, such as displays (including touchscreen displays), speakers, and / or lights. For example, HMI 118 may include display device 120. As another example, HMI 118 may include an output display different from display device 120. That is, display device 120 may be separate from HMI 118. HMI 118 may be coupled to computer 110 via wired communication and may send and / or receive messages to / from computer 110 and other vehicle subsystems.

[0029] Display device 120 displays two-dimensional visual data to the occupants of the vehicle. Display device 120 can display the visual data in monochrome or color, and the visual data can be updated at a certain frame rate, such as 60 frames per second. The displayed visual data can be a static image, in which most of the two-dimensional area does not change with each frame, or it can be a dynamic image, in which most of the two-dimensional area changes with each frame. For static images, changes in the brightness of the LED area occur at a frame rate less than a threshold, and typically the change does not exceed a small percentage of the display area. For example, a static image might be data included in a climate control panel display, where changes occur only in response to occupant input or changes in the vehicle's interior temperature. For dynamic images, changes in the brightness of the LED area can occur at a frame rate greater than a threshold, and a large percentage of the display area changes. Examples of dynamic images include video content and web browsers. The threshold can be specified as the video frame rate (i.e., 60 frames per second).

[0030] Network 135 represents one or more mechanisms through which computer 110 can communicate with remote computing devices (e.g., remote server computer 140, mobile devices, etc.). Therefore, network 135 can be one or more of a variety of wired or wireless communication mechanisms, including any desired combination of wired (e.g., cable and fiber optic) and / or wireless (e.g., cellular, wireless, satellite, microwave, and radio frequency) communication mechanisms, and any desired network topology (or multiple topologies when multiple communication mechanisms are utilized). Exemplary communication networks include wireless communication networks that provide data communication services (e.g., using...). Low power (BLE), IEEE 802.11, vehicle-to-vehicle (V2V) communication such as Dedicated Short Range Communication (DSRC), local area networks (LAN) and / or wide area networks (WAN), including the Internet.

[0031] The remote server computer 140 may be a conventional computing device (i.e., including one or more processors and one or more memories) programmed to provide operations such as those disclosed herein. Furthermore, the remote server computer 140 may be accessed via a network 135 (e.g., the Internet, a cellular network, and / or some other wide area network).

[0032] Figure 2 These are illustrations of two cross-sectional views of portions of liquid crystal displays (LCDs) 202 and 204. LCD 202 is a cross-sectional view of a twisted nematic liquid crystal display in the on state, and LCD 204 is a cross-sectional view of a twisted nematic liquid crystal display in the off state. LCDs 202 and 204 include two pairs of polarizer layers 210, 216 and 226, 230. Depending on the desired appearance of the display device 120, the pairs of polarizer layers 210, 216 are arranged at a polarization angle of 90 degrees (normally closed) or 0 degrees (normally open). The internal spaces 206, 222 of the LCDs may be filled with liquid crystal molecules 208, 224, which may be materials that rotate the polarization of light, such as twisted nematic liquid crystal molecules. LCDs 202 and 204 do not directly emit light, but instead transmit input light 218, 236 to varying degrees depending on the voltage 234 applied to the pairs of electrodes 212, 214 and 228, 232, thereby generating output light 220, 238. Electrodes can be applied to a glass substrate and can be made of transparent conductive materials such as indium tin oxide (ITO).

[0033] Assuming the LCD 202 is normally on (i.e., providing 90-degree polarization when input light is applied), in the off state, the liquid crystal molecules 208 form a spiral pattern between electrodes 212 and 214. This spiral pattern imparts 90-degree polarization to the light 218 transmitted by the LCD 202. This 90-degree polarization of the light matches the input polarizer 216 with the output polarizer 210, allowing a large percentage of the input light 218 to manifest as output light 220. Applying a voltage 234 to electrodes 228 and 232 aligns the liquid crystal molecules 224 with one end facing one electrode 228 and the other end facing the other electrode 232. This prevents the liquid crystal molecules from imparting polarization to the input light 236, which then allows light to be blocked by the polarizer layers 226 and 230, thus preventing the LCD 204 from transmitting light and reducing the light output 238 from the LCD 204. Changing the voltage 234 changes the light output 220 and 238 from bright (no voltage) to dark (maximum voltage).

[0034] Besides changing the voltage 234 to determine the light output 238, the light outputs 220 and 238 can also depend on the light inputs 218 and 236. Backlighting is a technique used to apply illumination to the LCDs 202 and 204 from below the lower polarizers 216 and 230. The backlighting technique uses an addressable LED array to backlight the LCDs 202 and 204. For example... Figure 3As shown, the addressable LED array includes one or more LEDs in addressable areas, meaning that the LEDs in each area can be controlled individually. Each LED area may include multiple LEDs, which can be individually controlled to produce white light of any intensity, from LED off (black) to maximum intensity. This allows LED backlighting to illuminate different sections of LCDs 202 and 204 that have different types of backlighting requirements.

[0035] Figure 3 This is an illustration of an example LED backlight 300. The LED backlight 300 includes an array of LEDs 304 arranged in LED areas 302. Each LED area 302 may include one or more LEDs 304. The LEDs 304 in the LED areas 302 can be individually controlled to generate backlight illumination patterns to illuminate different portions of the LCDs 202 and 204. See below for more details. Figure 4 As described, LED 304 in LED area 302 can be energized to different brightness levels, while adjacent LCD pixel areas 412, 414 are energized to different levels of transparency and opacity to display various visual data via display device 120.

[0036] Figure 4 This is an illustration of an example cross-sectional view of a display device 120. The display device 120 includes a display substrate 402, which includes LED regions 302a and 302b and matched LCD regions 412 and 414 respectively disposed in a plane formed by the display substrate 402. The LCD pixel regions 412 and 414 may include various numbers of pixels, each of which may include red, green, and blue sub-pixels, indicated by three different types of cross-shading lines. The LEDs included in the LED regions 302a and 302b emit different levels of brightness (e.g., light) in response to being energized by different voltages applied to the LEDs in the LED regions 302a and 302b by the display controller 117, providing backlight illumination for the LCD pixel regions 412 and 414. The LCD pixel regions 412 and 414 are as follows... Figure 2The structures shown are connected so that they can be individually controlled by the display controller 117 (e.g., to transmit or block light emitted by LED areas 302a, 302b to generate various colors) to transmit display data. In response to being energized by a voltage applied to the LCD pixel areas 412, 414 by the display controller 117, the LCD pixel areas 412, 414 transmit different amounts of brightness emitted by the LED areas 302a, 302b, causing the LCD pixel areas 412, 414 to switch between transparent and opaque states. Furthermore, the LCD pixel areas 412, 414 may include color filters that can output different colors based on the amount of brightness emitted by the LED areas 302a, 302b and the transparency level of the LCD pixel areas 412, 414.

[0037] Computer 110 is programmed to determine a fitting function based on a grayscale image. The fitting function represents the relationship between the current input to display device 120 and the grayscale image output by display device 120. A grayscale image is an image in which each pixel has the same pixel value within a grayscale range (e.g., 0 to 255, including extreme values). Various grayscale images can be stored in a database, etc. Computer 110 can access the database (e.g., stored in the memory of computer 110) to iteratively or sequentially select grayscale images until display device 120 has output each grayscale image. As another example, computer 110 can select a grayscale image in response to receiving a corresponding user input specifying a corresponding grayscale image (e.g., via HMI 118).

[0038] Computer 110 operates display device 120 at a predetermined voltage to output a grayscale image. The predetermined voltage can be determined empirically, for example (e.g., based on testing and / or simulation to determine the voltage that allows display device 120 to output light at a brightness that meets design parameters). As another example, computer 110 can determine the predetermined voltage in response to (e.g., via HMI 118) receiving user input specifying the predetermined voltage. The predetermined voltage can be stored (e.g., stored in the memory of computer 110).

[0039] To display a grayscale image, computer 110 powers display device 120 (i.e., LED area 302 and LCD pixel areas 412, 414) with a predetermined voltage to generate pixel values ​​specified by the grayscale image. Computer 110 can then determine the current input to display device 120, which causes the grayscale image to be output at the predetermined voltage. For example, computer 110 can receive sensor 115 data indicating the current input to display device 120. Computer 110 can then determine the current input to display device 120, which causes various grayscale images to be output in this manner.

[0040] Then, computer 110 can generate a graph graphically representing the input current of display device 120 and the corresponding grayscale image output by display device 120. Computer 110 can perform curve fitting operations to determine a fitting function. The fitting function is stored (e.g., stored in the memory of computer 110). Curve fitting operation is programming to generate a function representing the relationship between the current input of display device 120 and the grayscale image output by display device 120. Examples of curve fitting operations include those generated by... Manufactured in (Natick, Massachusetts, 01760) In the software library. Curve fitting operations can be stored (e.g., stored in the memory of computer 110).

[0041] When outputting a grayscale image, the fitting function predicts the current input of the display device 120:

[0042] I c =a0+a1x+a2x 2 +a3x 3 +…+a n x n (1)

[0043] Where x is the pixel value, and the coefficients a1 to a... n Represents the polynomial coefficients describing the fitted function, and a0 is the offset (i.e., the total current input used to operate the display device 120 to display a black image).

[0044] Additionally, computer 110 is programmed to determine the best-fit line based on the actual power consumption of display device 120 when outputting a color image and the predicted power consumption of display device 120 when outputting a color image. A color image is an image in which each pixel has a vector of three values ​​representing the pixel's components (e.g., red, green, and blue). Various color images can be stored in a second database, etc. Computer 110 can access the second database (e.g., stored in the memory of computer 110) to iteratively or sequentially select color images until display device 120 has output each color image. As another example, computer 110 can select a color image in response to receiving corresponding user input specifying a corresponding color image (e.g., via HMI 118). Color images can be manually generated to represent various visual data to be presented to the vehicle user.

[0045] Computer 110 operates display device 120 at a predetermined voltage to output a color image. To display the color image, computer 110 powers display device 120 with the predetermined voltage to generate corresponding colors corresponding to the respective LCD pixel areas 412, 414. Computer 110 can then determine the current input to display device 120, which results in the output of a color image at the predetermined voltage (via data from sensor 115 as discussed above). Computer 110 can then determine the actual power consumption of display device 120 when outputting the color image according to the following formula:

[0046] P a =V*I a (2)

[0047] Where P a This is the actual power consumption of the display device 120 when outputting a color image, where V is a predetermined voltage, and I... a It is the current input of the display device 120 for outputting color images.

[0048] To predict the power consumption of the display device 120 when outputting a color image, the computer 110 can determine the maximum RGB value for each LCD pixel region 412, 414 (e.g., by comparing the RGB values ​​of corresponding sub-pixels within the respective LCD pixel regions 412, 414 with each other), and can set the RGB value of each sub-pixel within the respective LCD pixel regions 412, 414 to the maximum RGB value of the corresponding sub-pixel within the respective LCD pixel regions 412, 414. A grayscale image is generated by setting the RGB value of each sub-pixel within the respective LCD pixel regions 412, 414 to the maximum RGB value, the grayscale image representing the various LCD pixel regions 412, 414 as corresponding grayscale values.

[0049] For each LCD pixel region 412, 414, computer 110 can input grayscale values ​​into a fitting function, which outputs a predicted current input for LCD pixel regions 412, 414. Computer 110 predicts the power consumption of LCD pixel regions 412, 414 when outputting a color image based on the following formula:

[0050] P z =V / N*I p (3)

[0051] Where P z This is the predicted power consumption of LCD pixel areas 412 and 414 when outputting color images, and I p It is the current output derived from the fitted function.

[0052] Then, the computer 110 can predict the power consumption P for each LCD pixel area 412, 414.z The summation is used to predict the power consumption of the display device 120 when outputting a color image:

[0053]

[0054] Computer 110 can be based on actual power consumption P a and predicted power consumption P p Determine the power offset P of the display device 120 when outputting a color image. o :

[0055]

[0056] Computer 110 can determine the power offset P used to output each color image in the manner described above. o .

[0057] In addition, computer 110 can determine the grayscale changes in a grayscale image. The grayscale change is the sum of the differences between the grayscale values ​​of adjacent LCD pixel regions 412 and 414. Computer 110 can determine the grayscale change using the following formula:

[0058]

[0059] Among them G v It's a grayscale change, G 1…N These are the grayscale values ​​of LCD pixel regions 412 and 414, where N is the number of LCD pixel regions 412 and 414 in the grayscale image, and G... a is the grayscale value of adjacent LCD pixel regions 412, 414, and n is the number of adjacent LCD pixel regions 412, 414. Computer 110 can determine the grayscale used to output each color image in the manner just described.

[0060] As a non-limiting example, computer 110 may determine that LCD pixel regions 412 and 414 are adjacent to each other based on the fact that they are continuous in the horizontal direction relative to display device 120 (i.e., sharing at least a portion of their boundaries). As another non-limiting example, computer 110 may determine that LCD pixel regions 412 and 414 are adjacent to each other based on the fact that they are continuous in the vertical direction relative to display device 120. As yet another non-limiting example, computer 110 may determine that LCD pixel regions 412 and 414 are adjacent to each other based on the fact that they are continuous in both the vertical and horizontal directions. As yet another non-limiting example, computer 110 may determine that LCD pixel regions 412 and 414 are adjacent to each other based on the fact that they are continuous in the vertical and horizontal directions and at least one oblique direction (i.e., neither parallel nor perpendicular to the vertical or horizontal direction). As yet another non-limiting example, computer 110 may determine adjacent LCD pixel regions 412, 414 in response to receiving user input specifying adjacent pixels (e.g., via HMI 118).

[0061] Computer 110 can scale grayscale variations (e.g., scale by a factor of 10, 100, etc.). The scaling factor can be proportional to the number of adjacent LCD pixel regions 412, 414. As an example, computer 110 can determine the scaling factor in response to receiving user input specifying a scaling factor (e.g., via HMI 118). As another example, computer 110 can determine the scaling factor based on a grayscale variation greater than or equal to a threshold (e.g., stored in the memory of computer 110). The threshold can be determined empirically (e.g., based on testing and / or simulation to determine the range of grayscale variations that allows for the determination of the best-fit line within a specified time period (e.g., based on available computing resources)). The scaling factor can be stored (e.g., stored in the memory of computer 110).

[0062] Computer 110 can then generate graphs that graphically represent grayscale changes and corresponding power shifts associated with various color images. Computer 110 determines the best-fit line for the grayscale changes and power shifts (e.g., according to current calculation methods such as linear least squares, linear regression, random sample consensus (RANSAC), etc.). The best-fit line is a line through points (representing the power shifts corresponding to the grayscale changes) that minimizes the corresponding distance between the points and the line. The best-fit line can be stored (e.g., in the memory of computer 110).

[0063] After determining the fitting function and the best-fit line, computer 110 is programmed to predict the total power consumption of display device 120 when it outputs an image. For example, computer 110 can receive the image from remote server computer 140 (e.g., via network 135). As another example, the image can be stored by the remote device (e.g., stored in its memory). The remote device can be connected to computer 110 via a wired connection. In this case, computer 110 can access the remote device's memory (e.g., via a wired connection) to obtain the image.

[0064] Computer 110 operates display device 120 to display an image. Specifically, computer 110 powers LCD pixel areas 412 and 414 with a predetermined voltage to display the image. Computer 110 can generate a grayscale image of the image and determine the grayscale changes of the image in the same manner as described above. Then, computer 110 can determine the power offset P for outputting the image based on the best-fit line of the image and the grayscale changes. oI For example, computer 110 can input the grayscale changes of an image into a power offset P that defines the output image. oI The function that best fits the line.

[0065] Furthermore, computer 110 can determine the grayscale value for each LCD pixel region 412, 414, as discussed above. Computer 110 can predict the power consumption P of display device 120 when outputting an image based on inputting the grayscale values ​​into a fitting function and equations 3 and 4. p As discussed above. Then, computer 110 predicts the total power consumption P of display device 120 when outputting an image according to the following formula. T :

[0066]

[0067] Figure 5 This is a flowchart of a process 500 for determining a fitting function and best-fit line for display device 120. Process 500 can be implemented as software executing on computer 110 and hardware including display device 120 as described herein. Process 500 includes multiple blocks that can be executed in the order shown. Alternatively or additionally, process 500 may include fewer blocks and may include blocks executed in a different order. Process 500 begins in block 505.

[0068] In box 505, computer 110 selects a grayscale image. For example, computer 110 may iteratively select grayscale images from a database, as discussed above. As another example, computer 110 may select a grayscale image based on user input specifying a grayscale image, as discussed above. Process 500 continues in box 510.

[0069] In block 510, computer 110 determines the current input to display device 120. For example, computer 110 may actuate display device 120 with a predetermined voltage to output a selected grayscale image, as discussed above. Computer 110 may then determine the current input to display device 120 to output the selected grayscale image, for example, based on sensor 115 data, as discussed above. Process 500 continues in block 515.

[0070] In box 515, computer 110 determines whether at least one grayscale image remains unselected. For example, computer 110 may access a database to determine whether each grayscale image has been selected. If computer 110 determines that at least one grayscale image in the database is indicated as unselected, process 500 returns to box 505. If computer 110 determines that all grayscale images in the database are indicated as selected, process 500 continues in box 520.

[0071] In block 520, computer 110 determines a fitting function based on the grayscale image and the input current. As discussed above, the fitting function represents the relationship between the current input to display device 120 and the grayscale image output by display device 120. Computer 110 may, for example, generate a graph representing the pixel values ​​of the grayscale image and the corresponding current entering display device 120. Computer 110 may determine the fitting function based on curve fitting operations, as discussed above. The fitting function is stored (e.g., in the memory of computer 110). Process 500 continues in block 525.

[0072] In box 525, computer 110 selects a color image. For example, computer 110 may iteratively select a color image from a second database, as discussed above. As another example, computer 110 may select a color image based on a second user input specifying the color image, as discussed above. Process 500 continues in box 530.

[0073] In block 530, computer 110 determines the actual power consumption of display device 120 when outputting the selected color image. For example, computer 110 may actuate display device 120 with a predetermined voltage to output the selected color image, as discussed above. Computer 110 may then determine the current input of display device 120 for outputting the selected color image, for example, based on sensor 115 data, as discussed above. Computer 110 may determine the actual power consumption of display device 120 according to Equation 2, as discussed above. Process 500 continues in block 535.

[0074] In box 535, computer 110 determines the grayscale variation of the selected color image. For example, computer 110 may then set the pixel value of each sub-pixel in the corresponding LCD pixel regions 412, 414 to the maximum RGB value of the sub-pixel in the corresponding LCD pixel regions 412, 414, as discussed above. Computer 110 may then determine the grayscale variation based on the summation of the differences between the pixel values ​​of adjacent LCD pixel regions 412, 414 (e.g., according to Equation 3), as discussed above. Computer 110 may scale the grayscale variation (e.g., based on the number of adjacent LCD pixel regions 412, 414 (e.g., specified by user input)), as discussed above. Process 500 continues in box 540.

[0075] In block 540, computer 110 predicts the power consumption of display device 120 when outputting a selected color image based on a fitting function. For example, for each LCD pixel region 412, 414, computer 110 can input the maximum RGB value of the corresponding LCD pixel region 412, 414 into the fitting function for the predicted output current, as discussed above. Computer 110 can then predict the power consumption of LCD pixel regions 412, 414 according to Equation 3. To predict the power consumption of display device 120 when outputting the selected color image, computer 110 can sum the predicted power consumption of LCD pixel regions 412, 414, as discussed above. The process continues in block 545.

[0076] In box 545, computer 110 determines the power offset P according to equation 5. o Process 500 continues in box 550.

[0077] In box 550, computer 110 determines whether at least one color image needs to be selected. For example, computer 110 may access a second database to determine whether each color image has already been selected. If computer 110 determines that at least one color image in the second database is indicated as needing to be selected, process 500 returns to box 525. If computer 110 determines that all color images in the second database are indicated as selected, process 500 continues in box 555.

[0078] In block 555, computer 110 determines a best-fit line based on grayscale changes and corresponding power shifts associated with various color images. Computer 110 may, for example, generate a graph representing the grayscale changes and corresponding power shifts associated with various color images. Computer 110 may determine the best-fit line according to current computational methods, as discussed above. Computer 110 may store the best-fit line (e.g., in its memory). After block 555, process 500 ends.

[0079] Figure 6 This is a flowchart of a process 600 for predicting the total power consumption of display device 120 when it outputs an image. Process 600 can be implemented as software executing on computer 110 and hardware including display device 120 as described herein. Process 600 includes multiple blocks that can be executed in the order shown. Alternatively or additionally, process 600 may include fewer blocks and may include blocks executed in a different order. Process 600 begins in block 605.

[0080] In box 605, computer 110 receives an image. For example, computer 110 may receive an image from a remote computer, as discussed above. That is, the image does not exist in the database and the second database. Process 600 continues in box 610.

[0081] In box 610, computer 110 determines the grayscale changes of the image. Box 610 is substantially the same as box 535 in process 500, and therefore will not be described further to avoid redundancy. Process 600 continues in box 615.

[0082] In box 615, computer 110 determines the power offset P based on the best-fit line. oI For example, computer 110 can input the grayscale changes of an image into a power offset P that defines the output image. oI The best-fit line function is as discussed above. Procedure 600 continues in box 620.

[0083] In block 620, computer 110 predicts the power consumption of display device 120 when outputting an image. Block 620 is substantially the same as block 540 in process 500, and therefore will not be described further to avoid redundancy. Process 600 continues in block 625.

[0084] In box 625, computer 110 then predicts the total power consumption of display device 120 when outputting an image according to equation 7. T Process 600 ends after box 625.

[0085] Computing devices such as those described herein typically each include commands that can be executed by one or more computing devices such as those identified above and are used to implement blocks or steps of the processes described above. For example, a process block described above may embody a computer-executable command.

[0086] Computer-executable commands can be compiled or interpreted by computer programs created using a variety of programming languages ​​and technologies, including but not limited to single or combined forms of the following: Java TMC, C++, Python, Julia, SCALA, Visual Basic, JavaScript, Perl, HTML, etc. Typically, a processor (i.e., a microprocessor) receives (i.e., from memory, computer-readable media, etc.) commands and executes these commands, thereby performing one or more procedures, including those described herein. Such commands and other data may be stored in files and transferred using various computer-readable media. Files in a computing device are typically collections of data stored on computer-readable media such as storage media, random access memory, etc.

[0087] Computer-readable media (also known as processor-readable media) include any non-transitory (i.e., tangible) medium that contributes to providing data (i.e., instructions) that can be read by a computer (i.e., by the computer's processor). Such media can take many forms, including but not limited to non-volatile and volatile media. Instructions can be transmitted via one or more transmission media, including optical fibers, wires, wireless communications, and internal components that constitute a system bus coupled to the computer's processor. Common forms of computer-readable media include, for example, RAM, PROM, EPROM, FLASH-EEPROM, any other memory chip or magnetic tape, or any other medium from which a computer can read.

[0088] Unless otherwise expressly indicated herein, all terms used in the claims are intended to be given the ordinary and common meaning as understood by one of ordinary skill in the art. Specifically, unless the claim statement expressly limits it to the contrary, the use of singular articles such as “a,” “the,” or “the” should be interpreted as one or more of the elements indicated by the statement.

[0089] The term “exemplary” is used in this document to mean an example (i.e., the candidate for “exemplary widget” should be interpreted as referring only to an example of a widget).

[0090] The adverb "approximately" when modifying a value or result implies that the shape, structure, measurement, value, determination, calculation, etc., may deviate from the exact description of the geometry, distance, measurement, value, determination, calculation, etc. due to defects in materials, machining, manufacturing, sensor measurement, calculation, processing time, communication time, etc.

[0091] In the accompanying drawings, the same reference numerals indicate the same elements. Regarding the media, processes, systems, methods, etc., described herein, it should be understood that although the steps or blocks of such processes, etc., are described as occurring in a specific sequence, such processes can be practiced by performing the described steps in an order other than that described herein. It should also be understood that some steps may be performed simultaneously, other steps may be added, or some steps described herein may be omitted. In other words, the description of processes herein is provided for the purpose of illustrating certain embodiments and should in no way be construed as limiting the claimed invention.

[0092] According to the present invention, a system is provided comprising a computer including a processor and a memory, the memory storing instructions executable by the processor to: determine a fitting function based on a corresponding grayscale image output by the display device when the display device is operated at a predetermined voltage; determine a corresponding actual power consumption of the display device for a corresponding color image output by the display device; predict a corresponding power consumption of the display device based on the fitting function for the corresponding color image; determine an optimal fitting line based on the corresponding actual power consumption and the corresponding predicted power consumption; and predict the total power consumption of the display device based on the optimal fitting line and the fitting function when an image is output via the display device.

[0093] According to an embodiment, the instructions further include instructions for performing the following operations: generating a corresponding grayscale image for a corresponding color image that defines a corresponding LCD pixel region, wherein the corresponding grayscale image represents the pixels in the corresponding LCD pixel region as corresponding grayscale values.

[0094] According to an embodiment, the instructions further include instructions for performing the following operations: determining a corresponding grayscale value based on the maximum red, green, and blue (RGB) pixel values ​​of the pixels in the corresponding LCD pixel region.

[0095] According to an embodiment, the instructions further include instructions for performing the following operations: determining a corresponding grayscale change of a corresponding color image based on a corresponding difference between corresponding grayscale values ​​of corresponding LCD pixel regions that are adjacent to each other in the corresponding grayscale image.

[0096] According to an embodiment, the instructions also include instructions for performing the following operations: additionally determining the best-fit line based on the corresponding grayscale changes.

[0097] According to an embodiment, the instructions also include instructions for performing the following operations: additionally predicting the corresponding power consumption of the display device based on the corresponding grayscale value and the corresponding number of LCD pixel areas.

[0098] According to an embodiment, the instructions further include instructions for performing the following operation: operating the display device at a predetermined voltage to output an image.

[0099] According to an embodiment, the instructions further include instructions for performing the following operations: operating the display device at a predetermined voltage to output a corresponding color image.

[0100] According to an embodiment, the instructions further include instructions for performing the following operation: determining a corresponding current input to the display device for a corresponding color image output by the display device.

[0101] According to an embodiment, the actual power consumption of the display device is determined based on the corresponding current and a predetermined voltage.

[0102] According to the present invention, a method includes: determining a fitting function based on a corresponding grayscale image output by the display device when operating the display device at a predetermined voltage; determining a corresponding actual power consumption of the display device for a corresponding color image output by the display device; predicting a corresponding power consumption of the display device based on the fitting function for the corresponding color image; determining an optimal fitting line based on the corresponding actual power consumption and the corresponding predicted power consumption; and predicting the total power consumption of the display device based on the optimal fitting line and the fitting function when outputting an image via the display device.

[0103] In one aspect of the invention, the method includes: generating a corresponding grayscale image for a corresponding color image that defines a corresponding LCD pixel region, the corresponding grayscale image representing pixels in the corresponding region as corresponding grayscale values.

[0104] In one aspect of the invention, the method includes: determining a corresponding grayscale value based on the maximum red, green, and blue (RGB) pixel values ​​of a pixel in a corresponding LCD pixel region.

[0105] In one aspect of the invention, the method includes: determining a corresponding grayscale change of a corresponding color image based on a corresponding difference between corresponding grayscale values ​​of corresponding LCD pixel regions that are adjacent to each other in a corresponding grayscale image.

[0106] In one aspect of the invention, the method includes: further determining the best-fit line based on the corresponding grayscale changes.

[0107] In one aspect of the invention, the method includes: additionally predicting the corresponding power consumption of the display device based on the corresponding grayscale value and the corresponding number of LCD pixel regions.

[0108] In one aspect of the invention, the method includes: operating a display device at a predetermined voltage to output an image.

[0109] In one aspect of the invention, the method includes: operating a display device at a predetermined voltage to output a corresponding color image.

[0110] In one aspect of the invention, the method includes: determining a corresponding current input to the display device for a corresponding color image output by the display device.

[0111] In one aspect of the invention, the actual power consumption of the display device is determined based on the corresponding current and a predetermined voltage.

Claims

1. A method comprising: When the display device is operated at a predetermined voltage, a fitting function is determined based on the corresponding grayscale image output by the display device; For the corresponding color image output by the display device, determine the corresponding actual power consumption of the display device; For the corresponding color image, the power consumption of the display device is predicted based on the fitting function; The optimal fitting line is determined based on the corresponding actual power consumption and the corresponding predicted power consumption. as well as When outputting an image via the display device, the total power consumption of the display device is predicted based on the best-fit line and the fitting function.

2. The method of claim 1, further comprising: For the corresponding color image, a corresponding grayscale image is generated that defines the corresponding LCD pixel area. The corresponding grayscale image represents the pixels in the corresponding area as the corresponding grayscale value.

3. The method of claim 2, further comprising determining the corresponding grayscale value based on the maximum red, green, and blue (RGB) pixel values ​​of the pixel in the corresponding LCD pixel region.

4. The method of claim 2, further comprising: The corresponding grayscale change of the corresponding color image is determined based on the corresponding difference between the corresponding grayscale values ​​of the corresponding LCD pixel regions that are adjacent to each other in the corresponding grayscale image.

5. The method of claim 4, further comprising: Furthermore, the optimal fitting line is determined based on the corresponding grayscale changes.

6. The method of claim 2, further comprising: Furthermore, the power consumption of the display device is predicted based on the corresponding grayscale value and the number of corresponding LCD pixel areas.

7. The method of claim 1, further comprising: The display device is operated at the predetermined voltage to output the image.

8. The method of claim 1, further comprising: The display device is operated at the predetermined voltage to output the corresponding color image.

9. The method of claim 8, further comprising: For the corresponding color image output by the display device, determine the corresponding current input of the display device.

10. The method of claim 9, wherein the corresponding actual power consumption of the display device is determined based on the corresponding current and the predetermined voltage.

11. A computer programmed to perform the method as described in any one of claims 1 to 10.

12. A computer program product comprising instructions for performing the method as described in any one of claims 1 to 10.

Images