Information processing device and control method

Abstract

In systems where the application does not require a specific refresh rate, appropriately reducing the refresh rate to effectively lower the display's power consumption. [Solution] The information processing device comprises a first processor that executes processing based on the OS and programs executed on the OS, a second processor that outputs display data in frame order after image processing of a display image to be displayed on a display unit based on the processing by the first processor, and a third processor that detects the amount of variation between frames of the output display data for multiple frames and controls the refresh rate of the display unit based on instructions from the second processor. The first processor instructs the second processor on the refresh rate based on events occurring on the OS and the amount of variation detected by the third processor, and the second processor instructs the third processor on the refresh rate instructed by the first processor.

Description

Technical Field

[0004] , , , , , , , , , ,

[0005] , , , , , , ,

[0003]

[0001] The present invention relates to an information processing apparatus and a control method.

Background Art

[0002] The power consumption of a display is closely related to the refresh frequency (refresh rate) of the display. Generally, the lower the refresh rate, the lower the power consumption (see, for example, Patent Document 1). For example, the logic and analog power of a display are approximately proportional to the frequency. Also, the more frequently the graphics processing is rewritten (the higher the frequency), the greater the power consumption.

[0003] In some devices such as smartphones and smartwatches, there are some that lower the refresh rate of the display to suppress power consumption. This is achieved by each application declaring and requesting the required refresh rate to the OS side. For example, widgets that are always displayed are requested a lower refresh rate than normal applications, while games that require high-speed animations are requested a higher refresh rate than normal applications.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, some systems, such as Windows (registered trademark), do not support application-specific refresh rate settings. In such systems, lowering the refresh rate requires a different method than the one used to set the refresh rate for each application as described above.

[0006] The present invention has been made in view of the above circumstances, and one of its objectives is to provide an information processing device and a control method that can appropriately reduce the refresh rate and effectively reduce the power consumption of a display in a system in which the application does not require an appropriate refresh rate. [Means for solving the problem]

[0007] The present invention has been made to solve the above problems, and the information processing device according to the first aspect of the present invention comprises: a memory for temporarily storing OS (Operating System) programs and programs executed on the OS; a first processor that executes processing based on the programs stored in the memory; a second processor that performs image processing on a display image to be displayed on a display unit based on the processing by the first processor and outputs the display data after image processing in frame order; and a third processor that detects the amount of variation between frames of the display data to be displayed on the display unit based on the display data of multiple frames output from the second processor and controls the refresh rate of the display unit by instruction from the second processor, wherein the first processor instructs the second processor on the refresh rate of the display unit based on events occurring on the OS and the amount of variation detected by the third processor, and the second processor controls and outputs the frame rate of the display data based on the refresh rate instructed by the first processor and instructs the third processor on the refresh rate instructed by the first processor.

[0008] In the above-described information processing device, the events occurring on the OS are UI (User Interface) events including cursor movement or window movement and changes displayed on the display unit, and the first processor may instruct a higher refresh rate when an event is occurring on the OS compared to when no event is occurring.

[0009] In the above-described information processing device, the first processor may instruct a refresh rate that is lower the smaller the amount of fluctuation detected by the third processor.

[0010] In the above-described information processing device, if a change occurs between frames of the display data to be displayed on the display unit, the first processor may further instruct the refresh rate of the display unit based on the position on the screen of the display unit where the change occurred.

[0011] In the above-described information processing device, the first processor may, based on the position where the fluctuation occurred within the screen of the display unit, instruct a refresh rate corresponding to video display when fluctuations that do not change position continue to occur.

[0012] In the above-described information processing device, the first processor may instruct a lower refresh rate when the position where the fluctuation occurs on the screen of the display unit is far from the position of the cursor displayed on the display unit, compared to when it is close.

[0013] In the above-described information processing device, the first processor may instruct a lower refresh rate when the position where the fluctuation occurs on the screen of the display unit is at the periphery of the screen of the display unit compared to when it is at the center.

[0014] Furthermore, a control method for an information processing apparatus according to a second aspect of the present invention, comprising a memory for temporarily storing programs of an OS (Operating System) and programs executed on the OS, a first processor for executing processing based on programs stored in the memory, a second processor, and a third processor, the method comprising: the second processor performing image processing on a display image to be displayed on a display unit based on processing by the first processor, and outputting the display data after image processing in frame order; the third processor detecting the amount of variation between frames of the display data to be displayed on the display unit based on the display data of multiple frames output from the second processor; the first processor instructing the second processor on the refresh rate of the display unit based on events occurring on the OS and the amount of variation detected by the third processor; the second processor controlling and outputting the frame rate of the display data based on the refresh rate instructed by the first processor, and instructing the third processor on the refresh rate instructed by the first processor; and the third processor controlling the refresh rate of the display unit based on instructions from the second processor. [Effects of the Invention]

[0015] According to the above-described aspect of the present invention, in a system where the application does not require an appropriate refresh rate, the refresh rate can be appropriately reduced to effectively lower the power consumption of the display. [Brief explanation of the drawing]

[0016] [Figure 1] A perspective view showing the external appearance of an information processing device according to the first embodiment. [Figure 2] A block diagram showing an example of the hardware configuration of an information processing device according to the first embodiment. [Figure 3] A diagram showing an example of refresh rate settings according to the first embodiment. [Figure 4] A block diagram showing an example of a configuration related to the refresh rate change process according to the first embodiment. [Figure 5] A block diagram showing an example of the configuration of the timing controller according to the first embodiment. [Figure 6] A flowchart showing a first example of the refresh rate change process according to the first embodiment. [Figure 7] A flowchart showing a second example of the refresh rate change process according to the first embodiment. [Figure 8] A flowchart showing an example of the refresh rate change process according to the second embodiment. [Figure 9] A block diagram showing an example of a configuration related to the refresh rate change process according to the third embodiment. [Figure 10] A schematic block diagram showing an example of the hardware configuration according to the third embodiment. [Figure 11] A block diagram showing a first example of a configuration related to the refresh rate change process according to the fourth embodiment. [Figure 12] A block diagram showing a second example of a configuration related to the refresh rate change process according to the fourth embodiment.

Mode for Carrying Out the Invention

[0017] Hereinafter, embodiments of the present invention will be described with reference to the drawings. <First Embodiment> First, the first embodiment of the present invention will be described. FIG. 1 is a perspective view showing the appearance of the information processing apparatus 10 according to the present embodiment. As shown in FIG. 1, the information processing apparatus 10 according to the present embodiment is an example of a computer apparatus, and is, for example, a clamshell type (notebook type) PC (Personal Computer). The information processing apparatus 10 includes a display unit 15 that displays a display image based on the processing executed by the information processing apparatus 10.

[0018] [Hardware Configuration of Information Processing Apparatus 10] Figure 2 is a schematic block diagram showing an example of the hardware configuration of the information processing device 10 according to this embodiment. The illustrated information processing device 10 includes a display unit 15, a USB connector 16, a communication unit 17, a storage unit 18, an input unit 19, an EC (Embedded Controller) 20, a power supply unit 21, a battery 22, and a system processing unit 100.

[0019] The display unit 15 includes a liquid crystal display (LCD) or an organic EL (electroluminescence) display. The display unit 15 displays images based on display data based on the control of the system processing unit 100. The display data includes still images, moving images, and text data acquired or generated by the processing of the OS (Operating System) or applications running on the OS.

[0020] USB connector 16 is a connection terminal for connecting peripheral devices that utilize USB (Universal Serial Bus). For example, USB connector 16 is a receptacle-side terminal compliant with the USB Type-C standard. USB connector 16 can also be used to connect an external power supply, such as an AC adapter that supports the USB Type-C standard.

[0021] The communication unit 17 connects to other devices via a wireless or wired communication network and transmits and receives various types of data. For example, the communication unit 17 is configured to include a wired LAN interface such as Ethernet® and a wireless LAN interface such as Wi-Fi®.

[0022] The storage unit 18 is comprised of storage media such as an HDD (Hard Disk Drive), SSD (Solid State Drive), RAM (Random Access Memory), and ROM (Read Only Memory). For example, the storage unit 18 stores programs such as the OS, various drivers, various services / utilities, and applications, as well as various data.

[0023] The input unit 19 is an input unit that receives user input and is configured to include a keyboard, for example, as shown in the information processing device 10 in Figure 1. The input unit 19 receives user operations on the keyboard and outputs an operation signal corresponding to the user's operation to the EC20. The input unit 19 may also be configured to include a touch panel, touchpad, etc., in addition to or instead of a keyboard. Furthermore, the input unit 19 may be connected by wired or wireless connection to an external operating device such as a mouse or an external keyboard, and may receive user operations on the connected external operating device.

[0024] The EC20 is a one-chip microcomputer that monitors and controls various devices (peripherals, sensors, etc.) regardless of the OS system state. The EC20 is composed of a CPU (Central Processing Unit), RAM, ROM, etc. (not shown), and is equipped with multiple A / D input terminals, D / A output terminals, a timer, and digital input / output terminals. The input unit 19, power supply unit 21, and system processing unit 100 are connected to the EC20 via these input / output terminals. The EC20 receives or transmits various signals to each of the connected units.

[0025] For example, EC20 acquires operation signals output from the input unit 19 and executes processing based on the acquired operation signals. EC20 outputs operation signals related to the processing of the system processing unit 100 to the system processing unit 100. EC20 also controls the power supply unit 21 according to the system state of the OS, etc. For example, EC20 outputs control signals to the power supply unit 21 to control the power supply according to the system state, etc. Furthermore, EC20 acquires information about the state of the battery 22 (such as remaining capacity) from the power supply unit 21 by communicating with it.

[0026] The power supply unit 21 includes, for example, a DC / DC converter and a charge / discharge circuit for controlling the charging or discharging of the battery 22. The power supply unit 21 converts the DC power supplied from the battery 22 or from an external power supply (not shown, such as an AC adapter) into multiple voltages necessary to operate each part of the information processing device 10. The power supply unit 21 supplies power to each part of the information processing device 10 based on the control of the EC20.

[0027] Battery 22 is a secondary battery that supplies power to each part of the information processing device 10 when power is not supplied from an external power source (such as an AC adapter). When power is supplied from an external power source (such as an AC adapter), battery 22 is charged by that power via the power supply unit 21 until it is fully charged. When power is not supplied from an external power source (such as an AC adapter), the power stored in battery 22 is discharged and supplied to each part of the information processing device 10 via the power supply unit 21.

[0028] The system processing unit 100 consists of a CPU 101, a graphics controller 102, a memory controller 103, an I / O (Input-Output) controller 104, and system memory 105. The CPU 101 and the graphics controller 102 are sometimes collectively referred to as the processor.

[0029] CPU101 executes processing by programs such as the OS, various drivers, various services / utilities, and applications. As an example of an OS, Windows (registered trademark) is used.

[0030] The graphics controller 102 is connected to the display unit 15. Based on the processing performed by the CPU 101, the graphics controller 102 performs image processing on the display image to be displayed on the display unit 15 and generates display data. The graphics controller 102 outputs the generated display data to the display unit 15.

[0031] The memory controller 103 controls the reading and writing of data from the system memory 105 and storage unit 18, etc., by the processing of the CPU 101 and graphics controller 102. The I / O controller 104 controls the input and output of data to and from the display unit 15, USB connector 16, communication unit 17, and EC20, etc.

[0032] System memory 105 is writable memory used as a reading area for programs executed by processors such as the CPU 101 and graphics controller 102, or as a work area for writing processing data for such programs. For example, system memory 105 is composed of multiple DRAM (Dynamic Random Access Memory) chips. Programs include the OS, various drivers for controlling peripheral devices, various service / utility programs, and application programs.

[0033] The CPU 101, graphics controller 102, memory controller 103, I / O (Input-Output) controller 104, and system memory 105 may be configured as a single integrated processor, or some or each of them may be configured as individual processors.

[0034] [Configuring the refresh rate change process] Next, a configuration in the information processing device 10 according to this embodiment that optimizes power consumption by appropriately changing the display refresh rate will be described. The information processing device 10 uses, for example, Windows® as its OS, and does not support setting the refresh rate for each application. Therefore, each application cannot set the refresh rate it needs.

[0035] Therefore, the information processing device 10 sets an appropriate refresh rate based on events occurring on the OS and the amount of change on the display unit 15 screen (amount of change in display data). For example, the information processing device 10 sets a high refresh rate for displays that require a fast response speed (fast response), but sets a low refresh rate to reduce power consumption for displays that do not require a fast response speed.

[0036] Figure 3 shows an example of refresh rate settings according to this embodiment. For example, the information processing device 10 sets a high refresh rate when there are UI (User Interface) events occurring on the OS. UI events include, for example, cursor movement on the screen (e.g., mouse cursor), and movement and changes (opening, closing, etc.) of application windows. Since such cursor movement and window movement on the screen require high-speed response, the information processing device 10 sets a high refresh rate (e.g., 60Hz).

[0037] On the other hand, if there are no UI (User Interface) events occurring on the OS, the information processing device 10 sets the refresh rate based on the amount of screen variation (the amount of variation in displayed data). For example, if there is no variation, the information processing device 10 sets the refresh rate to the lowest possible value (e.g., 1 Hz).

[0038] Furthermore, the information processing device 10 sets a relatively low refresh rate (e.g., 15Hz) for small fluctuations (e.g., less than 10 pixels), such as cursor or timer numbers. The information processing device 10 also sets a medium refresh rate (e.g., 30Hz) for moderate fluctuations (e.g., 10 pixels or more but less than 100 pixels), such as character input. Finally, the information processing device 10 sets a high refresh rate (e.g., 60Hz) for large fluctuations (e.g., 100 pixels or more), such as scrolling.

[0039] Figure 4 is a schematic block diagram showing an example of a configuration related to the refresh rate change process in the information processing device 10 according to this embodiment. In Figure 4, the components corresponding to each part in Figure 2 are denoted by the same reference numerals.

[0040] In Figure 4, the system processing unit 100 is shown to consist of an OS 111, a frequency control unit 112, and a graphics driver 113 (G-driver), which are realized by the CPU 101 executing a program. The OS 111 is configured to perform OS processing. The frequency control unit 112 is configured to perform processing for a specific application running on the OS and has the function of controlling the refresh rate as explained with reference to Figure 3. The graphics driver 113 executes driver software processing for the CPU 101 to communicate with the graphics controller 102.

[0041] The graphics controller 102 performs image processing on the display image to be shown on the screen of the display unit 15 based on the processing performed by the CPU 101, and outputs the processed display data to the display unit 15 in frame order. For example, the CPU 101 and the graphics controller 102 are connected via the I / O controller 104, but in this diagram, the configuration of the system processing unit 100 other than the CPU 101 and the graphics controller 102 is omitted.

[0042] The display unit 15 comprises a display panel 150 and a timing controller 151 (T-con). The timing controller 151 acquires the display data output from the graphics controller 102 in frame order and controls it to display on the display panel 150. The timing controller 151 also detects the amount of variation in the display data between frames based on the display data of multiple frames output from the graphics controller 102 and transmits the detected amount of variation to the frequency control unit 112.

[0043] The frequency control unit 112 sets the refresh rate of the display unit 15 based on UI events from the OS 111 and the amount of variation transmitted from the timing controller 151. The frequency control unit 112 then instructs the timing controller 151 to use the set refresh rate by transmitting a refresh rate control signal (RC) to the timing controller 151.

[0044] When the timing controller 151 receives a refresh rate control signal (RC) from the frequency control unit 112, it controls the refresh rate of the display unit 15 according to the instructions from the frequency control unit 112.

[0045] Figure 5 is a schematic block diagram showing an example of the configuration of the timing controller 151 according to this embodiment. The timing controller 151 includes a receiving unit 1511, an output control unit 1512, a frame buffer 1513, a comparison unit 1514, and a fluctuation amount calculation unit 1515. The receiving unit 1511 acquires the display data output from the system processing unit 100 (graphics controller 102) in frame order and transmits it to the output control unit 1512 in the order it was acquired.

[0046] The output control unit 1512 performs data conversion and timing control on the display data transmitted from the receiving unit 151 in frame order, and outputs it to the display panel 150 for display. The receiving unit 1511, upon acquiring display data from the system processing unit 100 (graphics controller 102), outputs the acquired display data for one frame to the comparison unit 1514 and stores it in the frame buffer 1513.

[0047] The comparison unit 1514 compares the display data for one frame output from the receiving unit 1511 with the display data for the previous frame stored in the frame buffer 1513, pixel by pixel, and outputs the comparison result to the variation amount calculation unit 1515.

[0048] The variation amount calculation unit 1515 calculates the number of pixels that have been updated between frames (pixels whose values ​​have changed) based on the comparison results from the comparison unit 1514, and transmits the calculated number of pixels updated between frames (number of pixels that have changed between frames) as the screen variation amount to the system processing unit 100 (frequency control unit 112). The variation amount calculation unit 1515 may also include the position of the updated pixels relative to the screen area (row or block, etc.) in the variation amount transmitted to the system processing unit 100 (frequency control unit 112).

[0049] Furthermore, the display data stored in the frame buffer 1513 is overwritten by the display data acquired after comparison by the comparison unit 1514.

[0050] Of the components of the timing controller 151, the receiving unit 1511, the output control unit 1512, and the frame buffer 1513 are configurations included in conventional timing controllers. On the other hand, the comparison unit 1514 and the variation amount calculation unit 1515 are configurations newly added in this embodiment as necessary for detecting the amount of variation on the screen (the amount of variation in the displayed data).

[0051] Here, the refresh rate modification process described above may be modified according to the power policy. For example, when the battery 22 is low (below a predetermined value), the information processing device 10 may control the refresh rate to 30Hz or less as a battery saving mode. Also, when the battery 22 is abundant (above a predetermined value), the information processing device 10 may apply the refresh rate modification process described with reference to Figure 3 as a balanced mode. Similarly, when the information processing device 10 is powered by an AC adapter, the refresh rate modification process described with reference to Figure 3 may be applied as a high-performance mode.

[0052] [Refresh rate change process behavior] Next, the operation of the refresh rate change process according to this embodiment will be described. Figure 6 is a flowchart showing a first example of the refresh rate change process according to this embodiment. The example shown in Figure 6 shows the refresh rate change process when the power policy is in High Performance mode or Balanced mode (i.e., the change process according to the refresh rate setting example shown in Figure 3).

[0053] This refresh rate change process is performed for each frame. The CPU 101 (frequency control unit 112) determines whether there are any UI events such as cursor movement (e.g., mouse cursor) or movement and changes (open, close, etc.) of application windows (step S101).

[0054] If the CPU 101 (frequency control unit 112) determines that there is a UI event (step S101: YES), it sets the refresh rate to 60Hz and instructs the display unit 15 (timing controller 151) to do so. On the other hand, if the CPU 101 (frequency control unit 112) determines that there is no UI event (step S101: NO), it proceeds to the process in step S103.

[0055] The CPU 101 (frequency control unit 112) determines, for example, the amount of screen change (number of updated pixels) acquired from the display unit 15 (timing controller 151) (step S103). If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is 100 pixels or more, it sets the refresh rate to 60Hz and instructs the display unit 15 (timing controller 151) to do so.

[0056] If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is less than 100 pixels (10 pixels or more), it instructs the display unit 15 (timing controller 151) to set the refresh rate to 30Hz.

[0057] If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is less than 10 pixels (1 pixel or more), it instructs the display unit 15 (timing controller 151) to set the refresh rate to 15Hz.

[0058] If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is 0, it sets the refresh rate to 1 Hz and instructs the display unit 15 (timing controller 151) to do so.

[0059] Furthermore, when the information processing device 10 is in high-performance mode and powered by an AC adapter, it may not perform any control to reduce the refresh rate and may always maintain a high refresh rate (for example, 60Hz).

[0060] Figure 7 is a flowchart showing a second example of the refresh rate change process according to this embodiment. The example shown in Figure 6 shows the refresh rate change process when the power policy is in battery saver mode. As mentioned above, in battery saver mode, the refresh rate is controlled to 30Hz or less.

[0061] This refresh rate change process is performed for each frame. The CPU 101 (frequency control unit 112) determines whether there are any UI events such as cursor movement (e.g., mouse cursor) or movement and changes (open, close, etc.) of application windows (step S101).

[0062] If the CPU 101 (frequency control unit 112) determines that there is a UI event (step S101: YES), it sets the refresh rate to 30Hz and instructs the display unit 15 (timing controller 151) to do so. On the other hand, if the CPU 101 (frequency control unit 112) determines that there is no UI event (step S101: NO), it proceeds to the process in step S103.

[0063] The CPU 101 (frequency control unit 112) determines, for example, the amount of screen change (number of updated pixels) acquired from the display unit 15 (timing controller 151) (step S103). If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is 100 pixels or more, it sets the refresh rate to 30Hz and instructs the display unit 15 (timing controller 151) to do so.

[0064] If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is less than 100 pixels (10 pixels or more), it instructs the display unit 15 (timing controller 151) to set the refresh rate to 30Hz.

[0065] If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is less than 10 pixels (1 pixel or more), it instructs the display unit 15 (timing controller 151) to set the refresh rate to 15Hz.

[0066] If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is 0, it sets the refresh rate to 1 Hz and instructs the display unit 15 (timing controller 151) to do so.

[0067] As described above, the information processing device 10 according to this embodiment includes a system memory 105 (an example of memory) that temporarily stores OS programs and programs executed on the OS, a CPU 101 (an example of a first processor) that executes processing based on the programs stored in the system memory 105, a graphics controller 102 (an example of a second processor), and a timing controller 151 (an example of a third processor). The graphics controller 102 performs image processing on the display image to be displayed on the display unit 15 based on the processing by the CPU 101, and outputs the display data after image processing in frame order. The timing controller 151 detects the amount of variation between frames of the display data to be displayed on the display unit 15 (the amount of screen variation) based on the display data of multiple frames output from the graphics controller 102, and controls the refresh rate of the display unit 15 according to instructions from the CPU 101. The CPU 101 then instructs the timing controller 151 on the refresh rate of the display unit 15 based on events occurring on the OS and the amount of variation detected by the timing controller 151.

[0068] As a result, the information processing device 10 can reduce the power consumption of the display by appropriately lowering the refresh rate based on OS events and the amount of screen fluctuation, even in systems where the application does not require an appropriate refresh rate.

[0069] For example, events occurring on the OS include UI events such as cursor movement or window movement and changes displayed on the display unit 15. When an event occurs on the OS, the CPU 101 instructs a higher refresh rate compared to when no event occurs. This is based on the understanding that cursor responsiveness is important in operating systems operated by cursors, such as Windows®, and that a decrease in the refresh rate makes the deterioration of cursor responsiveness more noticeable.

[0070] As a result, the information processing device 10 can increase the refresh rate when a fast response speed is required for a display, but reduce power consumption by setting a lower refresh rate when a slower response speed is acceptable for a display.

[0071] The CPU 101 instructs a lower refresh rate the smaller the amount of fluctuation detected by the timing controller 151. This is based on the understanding that when the amount of screen fluctuation is small, a lower refresh rate is less likely to be noticed.

[0072] As a result, the information processing device 10 can appropriately control the refresh rate according to the amount of screen fluctuation, and when the amount of screen fluctuation is small, a slow response speed is acceptable, so the refresh rate can be set low to reduce power consumption.

[0073] Furthermore, the control method in the information processing device 10 according to this embodiment includes the steps of: a graphics controller 102 (an example of a second processor) performing image processing on a display image to be displayed on the display unit 15 based on processing by a CPU 101 (an example of a first processor), and outputting the display data after image processing in frame order; a timing controller 151 (an example of a third processor) detecting the amount of variation between frames of the display data to be displayed on the display unit 15 based on the display data of multiple frames output from the graphics controller 102; a CPU 101 instructing the timing controller 151 to set the refresh rate of the display unit 15 based on events occurring on the OS and the amount of variation detected by the timing controller 151; and a timing controller 151 controlling the refresh rate of the display unit 15 based on instructions from the CPU 101.

[0074] As a result, the control method in the information processing device 10 can reduce the power consumption of the display by appropriately lowering the refresh rate based on OS events and the amount of screen fluctuation, even in systems where the application does not require an appropriate refresh rate.

[0075] Conventional technology involves lowering the refresh rate as much as possible when there is no screen change, and returning it to normal when there is even a slight change in the screen. However, this method of controlling the refresh rate based solely on screen changes may return the reduced refresh rate to normal even if only a slight change occurs, such as when the clock display at the edge of the screen changes, which would actually be sufficient with a low refresh rate, resulting in little power saving. Furthermore, since screen changes cannot be detected until they actually occur, if, for example, the graphics processing is also set to a low refresh rate, even if an event requiring a high refresh rate occurs, it cannot be detected until the next frame, resulting in a delayed response to increase the refresh rate. For this reason, this method requires restrictions, such as limiting the refresh rate reduction to only when there is no screen change for a long time, resulting in little power saving. In contrast, this embodiment effectively reduces the power consumption of the display by appropriately reducing the refresh rate based not only on screen changes but also on both OS events and screen changes (amount of change). In addition, this embodiment improves the response when an increase in the refresh rate is necessary by controlling the refresh rate based on both OS events and screen changes (amount of change).

[0076] <Second Embodiment> Next, a second embodiment of the present invention will be described. In the first embodiment, an example was described in which the refresh rate is controlled based on UI events on the OS and the amount of screen fluctuation. However, the refresh rate may also be controlled based on the position where the fluctuation occurs within the screen. For example, the CPU 101 (frequency control unit 112) may estimate that a video is being displayed when a fluctuation that does not change position within the screen of the display unit 15 continues to occur, and set the refresh rate to a level corresponding to video display (video playback) (e.g., 30Hz).

[0077] Figure 8 is a flowchart showing an example of the refresh rate change process according to this embodiment. The example shown in Figure 8 is the refresh rate change process when the power policy is in High Performance mode or Balanced mode, and differs from the example shown in Figure 6 in that a video detection is added when the number of updated pixels is 100 pixels or more.

[0078] This refresh rate change process is performed for each frame. The CPU 101 (frequency control unit 112) determines whether there are any UI events such as cursor movement (e.g., mouse cursor) or movement and changes (open, close, etc.) of application windows (step S201).

[0079] If the CPU 101 (frequency control unit 112) determines that there is a UI event (step S201: YES), it sets the refresh rate to 60Hz and instructs the display unit 15 (timing controller 151) to do so. On the other hand, if the CPU 101 (frequency control unit 112) determines that there is no UI event (step S201: NO), it proceeds to the process in step S203.

[0080] The CPU 101 (frequency control unit 112) determines, for example, the amount of screen change (number of updated pixels) obtained from the display unit 15 (timing controller 151) (step S203). If the CPU 101 (frequency control unit 112) determines that the number of updated pixels is 100 pixels or more, it proceeds to the process in step S205.

[0081] The CPU 101 (frequency control unit 112) determines whether or not a video is being displayed based on whether or not a continuous fluctuation occurs within the screen of the display unit 15 without changing position (step S205). For example, the CPU 101 (frequency control unit 112) determines that a video is being displayed if pixel updates continue in consecutive frames without changing position within a predetermined position (range) on the screen.

[0082] If the CPU 101 (frequency control unit 112) determines that a video is being displayed (step S205: YES), it instructs the display unit 15 (timing controller 151) to set the refresh rate to 30Hz. On the other hand, if the CPU 101 (frequency control unit 112) determines that a video is not being displayed (step S205: NO), it instructs the display unit 15 (timing controller 151) to set the refresh rate to 60Hz.

[0083] Furthermore, in step S203, if the CPU 101 (frequency control unit 112) determines that the number of updated pixels is less than 100 pixels (10 pixels or more), it instructs the display unit 15 (timing controller 151) to set the refresh rate to 30Hz.

[0084] Furthermore, in step S203, if the CPU 101 (frequency control unit 112) determines that the number of updated pixels is less than 10 pixels (1 pixel or more), it instructs the display unit 15 (timing controller 151) to set the refresh rate to 15Hz.

[0085] Furthermore, in step S203, if the CPU 101 (frequency control unit 112) determines that the number of updated pixels is 0, it sets the refresh rate to 1 Hz and instructs the display unit 15 (timing controller 151) to do so.

[0086] Furthermore, when the information processing device 10 is in high-performance mode and powered by an AC adapter, it may not perform any control to reduce the refresh rate and may always maintain a high refresh rate (for example, 60Hz).

[0087] As described above, in the information processing device 10 according to this embodiment, if a change occurs between frames of the display data to be displayed on the display unit 15, the CPU 101 further instructs the refresh rate of the display unit 15 based on the position within the screen of the display unit 15 where the change occurred.

[0088] This allows the information processing device 10 to appropriately control the refresh rate based on the location where the change occurs within the screen.

[0089] For example, the CPU 101, based on the position where a change occurs within the screen of the display unit 15, instructs a refresh rate (e.g., 30Hz) that corresponds to video display (video playback) when a continuous change occurs that does not change the position.

[0090] As a result, when the information processing device 10 determines that a video is being displayed, it can reduce the refresh rate to one suitable for video display, even if the amount of screen fluctuation is large (for example, from 60Hz to 30Hz), thereby reducing power consumption.

[0091] Furthermore, the CPU 101 may instruct a lower refresh rate when the location of a fluctuation within the display unit 15 is far from the position of the cursor displayed on the display unit 15, compared to when the cursor is close. This is based on the understanding that if a small area fluctuation occurs at a location far from the point of interest, a lower refresh rate will not be easily recognized.

[0092] As a result, the information processing device 10 can reduce power consumption by setting a lower refresh rate (for example, from 30Hz to 15Hz) when the content that is not being viewed by the user is changing.

[0093] Furthermore, the CPU 101 may instruct a lower refresh rate when the location of the fluctuation within the display unit 15 is at the periphery of the display unit 15's screen compared to when the fluctuation occurs at the center.

[0094] As a result, the information processing device 10 can reduce power consumption by setting a lower refresh rate (for example, from 30Hz to 15Hz) when the content that is not being viewed by the user is changing.

[0095] <Third Embodiment> Next, a third embodiment of the present invention will be described. In the first embodiment, the detection of screen fluctuations (display data fluctuations) was performed within the timing controller 151, but external hardware may also be used to detect screen fluctuations (display data fluctuations).

[0096] Figure 9 is a schematic block diagram showing an example of a configuration related to the refresh rate change process according to this embodiment. In Figure 9, the same reference numerals are used for the components corresponding to the parts in Figure 4, and their descriptions are omitted. The display unit 15A differs from the timing controller 151 in Figure 4 in that the timing controller 151A does not include a comparison unit 1514 and a variation amount calculation unit 1515.

[0097] The configuration corresponding to the comparison unit 1514 and the variation amount calculation unit 1515 in Figure 4 is provided in Figure 9 as an external small hardware 30 (Small HW) that has the function of detecting the amount of variation in the screen (the amount of variation in the displayed data). The frequency control unit 112 acquires the amount of variation between frames of the displayed data from the hardware 30. The frequency control unit 112 also transmits a refresh rate control signal (RC) to the hardware 30.

[0098] Figure 10 is a schematic block diagram showing an example of the configuration of the hardware 30 according to this embodiment. The hardware 30 includes a receiving unit 301, a transmitting unit 302, a frame buffer 303, a comparison unit 304, and a variation amount calculation unit 305.

[0099] The receiving unit 301 acquires the display data output from the system processing unit 100 (graphics controller 102) in frame order and outputs it to the transmitting unit 302 in the order it was acquired. The transmitting unit 302 transmits the display data to the display unit 15A via pass-through in the order it was acquired. The transmitting unit 302 also acquires the refresh rate control signal (RC) from the frequency control unit 112 and transmits the acquired refresh rate control signal (RC) via pass-through to the display unit 15A (timing controller 151A).

[0100] Furthermore, when the receiving unit 301 acquires display data from the system processing unit 100 (graphics controller 102), it outputs the acquired display data for one frame to the comparison unit 304 and stores it in the frame buffer 303.

[0101] The frame buffer 303, comparison unit 304, and variation amount calculation unit 305 correspond to the frame buffer 1513, comparison unit 1514, and variation amount calculation unit 1515 in Figure 4, respectively. The variation amount calculation unit 305 calculates the number of pixels updated between frames (pixels whose values ​​have changed) based on the comparison results from the comparison unit 304, and transmits the calculated number of pixels updated between frames as the screen variation amount to the system processing unit 100 (frequency control unit 112). The variation amount calculation unit 305 may also include the position of the updated pixels relative to the screen area (such as a row or block) in the variation amount transmitted to the system processing unit 100 (frequency control unit 112).

[0102] Thus, the third processor of the present invention may be configured as hardware 30 and a timing controller 151A, wherein the hardware 30 detects the amount of variation between frames of display data (screen variation) to be displayed on the display unit 15 based on the display data of multiple frames output from the graphics controller 102, and the timing controller 151A controls the refresh rate of the display unit 15 according to instructions from the CPU 101.

[0103] Even with this configuration, the refresh rate control processing described in the first and second embodiments can be applied, and the same effects as in the first and second embodiments can be achieved.

[0104] In the first embodiment, since the amount of screen fluctuation can be detected using the frame buffer within the timing controller 151 without requiring external hardware 30, there is an advantage in that the circuit size can be reduced. On the other hand, in this embodiment, since the timing controller 151A has a conventional general configuration, there is an advantage in that there is no need to add any new configuration to the timing controller 151A.

[0105] <Fourth Embodiment> Next, a fourth embodiment of the present invention will be described. In the first to third embodiments, a configuration was described in which power consumption is optimized by controlling the refresh rate of the display unit 15 (15A). However, in addition to controlling the refresh rate, the frequency (frame rate) of the display data output from the graphics controller 102 may also be changed. When setting a low refresh rate, power consumption can be further reduced by setting a low frame rate as well.

[0106] Figure 11 is a schematic block diagram showing a first example of the configuration related to the refresh rate change process according to this embodiment. In Figure 11, the components corresponding to the parts in Figure 4 are denoted by the same reference numerals, and their descriptions are omitted.

[0107] The configuration example shown in Figure 11 is similar to the configuration shown in Figure 4 in that the timing controller 151 detects the amount of screen fluctuation (amount of display data fluctuation). However, it differs from the configuration in Figure 4 in that the frequency control unit 112 sends the refresh rate control signal (RC) to the graphics controller 102 instead of the timing controller 151.

[0108] The graphics controller 102 controls the frame rate of the display data based on the frequency of the refresh rate control signal (RC) acquired from the frequency control unit 112. The graphics controller 102 also transmits the refresh rate control signal (RC) acquired from the frequency control unit 112 to the timing controller 151. As a result, the timing controller 151 controls the refresh rate based on the refresh rate control signal (RC) acquired from the graphics controller 102.

[0109] Figure 12 is a schematic block diagram showing a second example of the configuration related to the refresh rate change process according to this embodiment. In Figure 12, the components corresponding to the parts in Figure 9 are denoted by the same reference numerals, and their descriptions are omitted.

[0110] The configuration example shown in Figure 12, like the configuration shown in Figure 9, uses hardware 30 to detect the amount of screen fluctuation (amount of display data fluctuation). However, it differs from the configuration in Figure 9 in that the frequency control unit 112 sends the refresh rate control signal (RC) to the graphics controller 102 instead of to hardware 30.

[0111] The graphics controller 102 controls the frame rate of the display data based on the frequency of the refresh rate control signal (RC) acquired from the frequency control unit 112. The graphics controller 102 also transmits the refresh rate control signal (RC) acquired from the frequency control unit 112 to the timing controller 151A via the hardware 30. As a result, the timing controller 151A controls the refresh rate based on the refresh rate control signal (RC) acquired from the hardware 30.

[0112] As described above, the information processing device 10 according to this embodiment includes a system memory 105 (an example of memory) that temporarily stores OS programs and programs executed on the OS, a CPU 101 (an example of a first processor) that executes processing based on the programs stored in the system memory 105, a graphics controller 102 (an example of a second processor), and a timing controller 151 or timing controller 151A and hardware 30 (an example of a third processor). The graphics controller 102 performs image processing on the display image to be displayed on the display unit 15 (15A) based on the processing by the CPU 101, and outputs the display data after image processing in frame order. The timing controller 151 or hardware 30 detects the amount of variation between frames of the display data to be displayed on the display unit 15 (15A) (the amount of screen variation) based on the display data of multiple frames output from the graphics controller 102. The timing controller 151 (151A) controls the refresh rate of the display unit 15 (15A) according to instructions from the CPU 101. The CPU 101 then instructs the graphics controller 102 to set the refresh rate of the display unit 15 (15A) based on events occurring on the OS and the amount of fluctuation detected by the timing controller 151. The graphics controller 102 controls and outputs the frame rate of the display data based on the refresh rate instructed by the CPU 101, and also instructs the timing controller 151 (151A) to set the refresh rate instructed by the CPU 101.

[0113] As a result, the information processing device 10 can reduce the power consumption of the display by appropriately lowering the refresh rate based on OS events and the amount of screen fluctuation, even in systems where the application does not require an appropriate refresh rate.

[0114] Furthermore, the control method in the information processing device 10 according to this embodiment includes the steps of: a graphics controller 102 (an example of a second processor) performing image processing on the display image to be displayed on the display unit 15 (15A) based on processing by the CPU 101 (an example of a first processor), and outputting the display data after image processing in frame order; a timing controller 151 or hardware 30 (an example of a third processor) detecting the amount of variation between frames of the display data to be displayed on the display unit 15 (15A) based on the display data of multiple frames output from the graphics controller 102; and the CPU 101 checking the timing coordinates with events occurring on the OS. The process includes the steps of: instructing the graphics controller 102 to set the refresh rate of the display unit 15 (15A) based on the amount of fluctuation detected by the controller 151 or hardware 30; the graphics controller 102 controlling and outputting the frame rate of the display data based on the refresh rate instructed by the CPU 101, and instructing the timing controller 151 (151A) to set the refresh rate instructed by the CPU 101; and the timing controller 151 (151A) controlling the refresh rate of the display unit 15 (15A) based on the instructions from the graphics controller 102.

[0115] As a result, the control method in the information processing device 10 can reduce the power consumption of the display by appropriately lowering the refresh rate based on OS events and the amount of screen fluctuation, even in systems where the application does not require an appropriate refresh rate.

[0116] Although embodiments of this invention have been described in detail above with reference to the drawings, the specific configuration is not limited to those described above, and various design changes can be made without departing from the spirit of this invention.

[0117] In the above embodiment, the refresh rate is determined by referring to the state of the screen and detecting the difference in pixel values ​​between the displayed frame and the display data of the past frame (the amount of screen change). Therefore, it takes at least one frame for an appropriate refresh rate to be determined. For this reason, when increasing the refresh rate, the refresh rate is increased immediately when the amount of screen change is detected. On the other hand, when decreasing the refresh rate, a timer of several hundred milliseconds (ms) to several seconds (s) may be set to confirm that the conditions for lowering the refresh rate are continuing before lowering it. This control allows for appropriate control of the refresh rate. For example, if a large change occurs on the screen from a state of 1Hz, the refresh rate can be immediately increased to display with a response corresponding to the screen change. When decreasing the refresh rate, the refresh rate is lowered only after confirming that it is safe to do so, rather than based on a temporary screen condition.

[0118] Furthermore, in the above embodiment, when increasing the refresh rate, the refresh rate can be increased immediately (after 1 frame) when a change in the screen is detected. This allows for more appropriate control of the refresh rate compared to conventional methods where the refresh rate could only be changed at limited update timings (up to 1 second later). Also, because the refresh rate can be increased immediately (after 1 frame), it is possible to actively control the refresh rate to decrease it.

[0119] Furthermore, in the above embodiment, the refresh rate can be changed in stages based on OS events and the amount or position of screen changes. Therefore, compared to conventional control methods that simply switch between two types of refresh rates based on whether or not there is a change in the screen, the refresh rate can be controlled more appropriately.

[0120] Furthermore, the information processing device 10 described above has a computer system inside. The processing in each configuration of the information processing device 10 described above may be performed by recording a program for realizing the functions of each configuration of the information processing device 10 onto a computer-readable recording medium, loading the program recorded on this recording medium into the computer system, and executing it. Here, "loading the program recorded on the recording medium into the computer system and executing it" includes installing the program into the computer system. Here, "computer system" includes hardware such as the OS and peripheral devices. Furthermore, "computer system" may include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Thus, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM.

[0121] Furthermore, the recording medium also includes internal or external recording media accessible from the distribution server for distributing the program. The program may be divided into multiple parts, downloaded at different times, and then combined in each configuration of the information processing device 10. The distribution servers for each of the divided programs may also be different. Moreover, "computer-readable recording media" includes volatile memory (RAM) within computer systems that act as servers or clients when a program is transmitted over a network, which retains the program for a certain period of time. The program itself may also be intended to implement some of the functions described above. Furthermore, the program may be a so-called differential file (differential program) that can implement the functions described above in combination with a program already recorded in the computer system.

[0122] Furthermore, some or all of the functions of the information processing device 10 in the above-described embodiment may be implemented as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processorized, or some or all of them may be integrated into a single processor. In addition, the method of implementing the integrated circuit is not limited to LSIs; it may also be implemented using dedicated circuits or general-purpose processors. Furthermore, if an integrated circuit technology that can replace LSIs emerges due to advances in semiconductor technology, an integrated circuit using that technology may be used.

[0123] Furthermore, although the above-described embodiment described an example in which the information processing device 10 is a clamshell-type (notebook-type) PC, it may also be a desktop-type or tablet-type PC. [Explanation of Symbols]

[0124] 1 Information processing system, 5 USB cable, 10 Information processing device, 15,15A Display unit, 16 USB connector, 17 Communication unit, 18 Storage unit, 19 Input unit, 20 EC, 21 Power supply unit, 22 Battery, 30 Hardware, 100 System processing unit, 101 CPU, 102 Graphics controller, 103 Memory controller, 104 I / O controller, 105 System memory, 150 Display panel, 151,151A Timing controller, 301 Receiving unit, 302 Transmitting unit, 303 Frame buffer, 304 Comparison unit, 305 Fluctuation amount calculation unit, 1511 Receiving unit, 1512 Output control unit, 1513 Frame buffer, 1514 Comparison unit, 1515 Fluctuation amount calculation unit

Claims

1. Memory that temporarily stores OS (Operating System) programs and programs executed on the OS, A first processor that executes processing based on a program stored in the memory, A second processor performs image processing on the display image to be displayed on the display unit based on the processing by the first processor, and outputs the display data after image processing in frame order. A third processor detects the amount of change between frames of display data to be displayed on the display unit based on the display data of multiple frames output from the second processor, by the number of pixels updated between frames, transmits the detected amount of change to the first processor, and controls the refresh rate of the display unit according to instructions from the second processor. Equipped with, The first processor is, The amount of variation transmitted from the aforementioned third processor is acquired, Based on the events occurring on the OS in which the first processor itself executes a program and the amount of change detected by the third processor, the refresh rate of the display unit is instructed to the second processor. When the first processor is set to the first power policy, if the amount of fluctuation satisfies predetermined conditions, it determines whether or not a video is being displayed based on whether or not fluctuations that do not change position within the screen of the display unit continue to occur, and if a video is being displayed, it instructs the second processor to use a refresh rate different from the one used when no video is being displayed. When the first processor is set to the second power policy, it instructs the second processor to set the refresh rate of the display unit based on the event and the amount of variation, regardless of whether a video is being displayed or not. The second processor is, The frame rate of the display data is controlled and output based on the refresh rate instructed by the first processor, and the refresh rate instructed by the first processor is instructed to the third processor. A refresh rate is set for each of at least three types of the aforementioned fluctuation amounts. Information processing device.

2. The events occurring on the aforementioned OS are UI (User Interface) events including "movement of the cursor displayed on the display unit" or "movement and change of the window," The first processor is, When an event occurs on the aforementioned OS, a higher refresh rate is instructed compared to when no event occurs. The information processing apparatus according to claim 1.

3. The first processor is, The smaller the amount of fluctuation detected by the third processor, the lower the refresh rate it instructs. The information processing apparatus according to claim 1.

4. The aforementioned third processor is The position within the display unit where the fluctuation occurred is included in the amount of fluctuation and transmitted to the first processor. The first processor is, If a change occurs between frames of the display data to be displayed on the display unit, the refresh rate of the display unit is further instructed based on the position within the screen of the display unit where the change occurred. The information processing apparatus according to claim 1.

5. The first processor is, Based on the position where the fluctuation occurred within the screen of the display unit, if a fluctuation that does not change position continues to occur, the refresh rate corresponding to video display is instructed. The information processing apparatus according to claim 4.

6. The events occurring on the aforementioned OS are UI (User Interface) events, including the movement of the cursor displayed on the display unit. The first processor is, When the position where the fluctuation occurs within the display unit's screen is far from the position of the cursor displayed on the display unit, a lower refresh rate is instructed compared to when it is closer. The information processing apparatus according to claim 4.

7. The first processor is, When the location where the fluctuation occurs within the display unit's screen is at the periphery of the display unit's screen, a lower refresh rate is instructed compared to when it occurs at the center. The information processing apparatus according to claim 4.

8. A control method for an information processing device comprising: a memory for temporarily storing OS (Operating System) programs and programs executed on the OS; a first processor for executing processing based on the programs stored in the memory; a second processor; and a third processor, wherein The second processor performs image processing on the display image to be displayed on the display unit based on the processing performed by the first processor, and outputs the display data after image processing in frame order. The third processor detects the amount of change between frames of the display data to be displayed on the display unit based on the display data of multiple frames output from the second processor, by the number of pixels updated between frames, and transmits the detected amount of change to the first processor. The first processor obtains the amount of change transmitted from the third processor, The first processor instructs the second processor to set the refresh rate of the display unit based on events occurring on the OS in which the first processor itself runs a program and the amount of change detected by the third processor. When the first processor is set to a first power policy, if the amount of fluctuation satisfies a predetermined condition, it determines whether or not a video is being displayed based on whether or not fluctuations that do not change position within the screen of the display unit continue to occur, and if a video is being displayed, it instructs the second processor to use a refresh rate different from the one used when no video is being displayed. If the first processor is set to a second power policy, the step of instructing the second processor to set the refresh rate of the display unit based on the event and the amount of variation, regardless of whether a video is being displayed or not. The second processor controls and outputs the frame rate of the display data based on the refresh rate instructed by the first processor, and also instructs the third processor to use the refresh rate instructed by the first processor. The third processor controls the refresh rate of the display unit based on instructions from the second processor, Includes, A refresh rate is set for each of at least three types of the aforementioned fluctuation amounts. Control method.

Images