Display method, storage medium, electronic device and program product
By dynamically adjusting the number and mode of data channels of electronic devices, according to changes in screen refresh rate, the waste of power consumption in low refresh rate scenarios and image stability in high refresh rate scenarios are solved, and power consumption optimization and image quality are achieved. balance.
Patent Information
- Application Number
- CN202410774640.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-17
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-06-17
AI Technical Summary
In electronic devices, in low refresh rate scenarios, power consumption is wasted due to the long idle waiting time when the application processor transmits image data to the display driver chip, and in high refresh rate scenarios, the stability and clarity of the displayed image need to be ensured. .
By detecting changes in screen refresh rate, dynamically adjusting the number and mode of data channels, reducing data channels at low refresh rate to reduce power consumption, and increasing data channels at high refresh rate to ensure image stability and clarity. Specific methods include reducing multiple data channels to a small number of channels when the refresh rate is switched from high to low, and setting at least one channel to a low power mode; conversely, reverting a small number of channels to a large number of channels when switching from low to high. and enter high-speed mode.
It effectively reduces power consumption in low refresh rate scenarios, and ensures image stability and clarity in high refresh rate scenarios, avoiding unnecessary power consumption due to excessive data channels.
Smart Images

Figure CN118426574B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of terminal technology, and in particular to a display method, a storage medium, an electronic device and a program product. Background Art
[0002] The process of displaying images on electronic devices such as mobile phones usually includes: the application (APP) sets the frame rate according to the content to be displayed, and sends the content to be displayed and the set frame rate to the application processor (AP); the AP processes the content to be displayed to obtain image data, and sends the image data to the display driver integrated circuit (DDIC) through multiple data channels fixed by the display interface at the corresponding frame rate; the DDIC processes the received image data and drives the screen of the mobile phone to display the corresponding content at the refresh rate corresponding to the frame rate of the received data. Among them, the higher the frame rate, the higher the refresh rate. For example, when the AP transmits image data to the DDIC at an interval of about 8.34 milliseconds, the screen refresh rate of the mobile phone is 120 hertz (Hz); when the AP transmits image data to the DDIC at an interval of about 16.67 milliseconds, the screen refresh rate of the mobile phone is 60Hz. It can be understood that the lower the refresh rate, the longer the idle waiting time during the AP to transmit image data to the DDIC. For example, if the refresh rate is 60 Hz, the AP needs to wait for about 16.67 milliseconds after transmitting each frame of image before transmitting the next frame of image.
[0003] However, regardless of whether the mobile phone is in a high refresh rate scenario or a low refresh rate scenario, the AP usually sends image data to the DDIC through multiple fixed data channels, that is, each data channel is in a working state, so that each data channel generates operating power consumption. However, in the low refresh rate scenario, the idle waiting time during the AP transmitting image data to the DDIC is long, resulting in a waste of mobile phone power consumption. Summary of the invention
[0004] Embodiments of the present invention provide a display method, a storage medium, an electronic device, and a program product.
[0005] In a first aspect, the present invention provides a display method, which is applied to an electronic device, wherein the electronic device includes a driving module and a display module that controls the screen of the electronic device, and the method includes: the driving module detects that the screen refresh rate of the electronic device switches from a first refresh rate to a second refresh rate, and adjusts the number of data channels from a first number to a second number, wherein the data channels are used for the driving module to send image data to the display module, and corresponding to the second refresh rate being less than the first refresh rate, the second number is less than the first number; the driving module sends the image data to the display module through the second number of data channels.
[0006] In an embodiment of the present invention, in response to the electronic device detecting that the screen refresh rate switches from a high refresh rate to a low refresh rate, the electronic device reduces the data channel used to transmit image data to reduce the transmission power consumption of the electronic device in a low refresh rate scenario.
[0007] In a possible implementation of the first aspect above, the method also includes: corresponding to the situation where the second refresh rate is less than the first refresh rate; the driving module detects that the screen refresh rate of the electronic device is the first refresh rate, and the driving module sends image data to the display module through a first number of data channels, wherein the first number of data channels are in a high-speed mode; the driving module detects that the screen refresh rate of the electronic device switches from the first refresh rate to the second refresh rate, and the driving module sets at least one data channel of the first number of data channels as a first idle channel to reduce the number of data channels from the first number to the second number, and the driving module sends image data to the display module through the second number of data channels, wherein the second number of data channels are in a high-speed mode.
[0008] In a possible implementation of the first aspect above, the driving module sets at least one data channel of the first number of data channels as a first idle channel, including: the driving module controls at least one data channel of the first number of data channels to enter a low power consumption mode, and uses the data channel entering the low power consumption mode as the first idle channel.
[0009] In a possible implementation of the first aspect above, the data channel includes a first channel and at least one second channel, wherein the first channel and the second channel are used for the driving module to send image data to the display module, and the first channel is also used for transmitting control instructions between the driving module and the display module; and the driving module controls at least one data channel of the first number of data channels to enter a low power consumption mode, including: the driving module controls at least one second channel of the data channel to enter a low power consumption mode.
[0010] In a possible implementation of the first aspect, the method further includes: corresponding to the second refresh rate being greater than the first refresh rate, the second number is greater than the first number.
[0011] In an embodiment of the present invention, in response to the electronic device detecting that the screen refresh rate switches from a low refresh rate to a high refresh rate, the electronic device restores or adds a data channel for transmitting image data to ensure the stability and clarity of the image displayed by the electronic device in a high refresh rate scenario.
[0012] In a possible implementation of the first aspect above, corresponding to the situation where the second refresh rate is greater than the first refresh rate; the driving module detects that the screen refresh rate of the electronic device is the first refresh rate, and a first number of data channels and at least one first idle channel are included between the driving module and the display module, and the driving module sends image data to the display module through the first number of data channels, wherein the first number of data channels are in high-speed mode and the first idle channel is in low power consumption mode; the driving module detects that the screen refresh rate of the electronic device switches from the first refresh rate to the second refresh rate, and the driving module controls at least one first idle channel to enter the high-speed mode to increase the number of data channels from the first number to the second number, and the driving module sends image data to the display module through the second number of data channels, wherein the second number of data channels are in high-speed mode.
[0013] In a possible implementation of the first aspect above, the driving module controls at least one first idle channel to enter a high-speed mode, including: the driving module controls a first number of data channels to enter a low power consumption mode to obtain a first number of second idle channels; the driving module controls the first number of second idle channels and at least one first idle channel to synchronously enter a high-speed mode to obtain a second number of data channels.
[0014] In a possible implementation of the first aspect above, an interface module for connection is provided between the driving module and the display module, and the interface module includes a data channel, wherein the interface module includes a MIPI DSI.
[0015] In a second aspect, an embodiment of the present invention provides a readable storage medium having instructions stored thereon, which, when executed on an electronic device, enables the electronic device to implement any one of the display methods provided by the first aspect and various possible implementations of the first aspect.
[0016] In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a memory for storing instructions executed by one or more processors of the electronic device; and a processor, which is one of the processors of the electronic device, for executing the instructions stored in the memory to implement any one of the display methods provided by the first aspect and various possible implementations of the first aspect.
[0017] In a fourth aspect, an embodiment of the present invention provides a computer program product, which includes instructions, and when the instructions are executed by an electronic device, the electronic device can implement any display method provided by the first aspect and various possible implementations of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1According to some embodiments of the present invention, an example schematic diagram of a main interface of a mobile phone 10 is shown;
[0019] Figure 2 According to some embodiments of the present invention, an example schematic diagram of a negative one screen interface of a mobile phone 10 is shown;
[0020] Figure 3 According to some embodiments of the present invention, an example schematic diagram of connecting an AP to a DDIC is shown;
[0021] Figure 4 According to some embodiments of the present invention, a framework diagram of switching from a high refresh rate to a low refresh rate is shown;
[0022] Figure 5 According to some embodiments of the present invention, a flow chart of 4lane switching 3lane is shown;
[0023] Figure 6 According to some embodiments of the present invention, a framework diagram of switching from a low refresh rate to a high refresh rate is shown;
[0024] Figure 7 According to some embodiments of the present invention, a flow chart of 3lane switching to 4lane is shown;
[0025] Figure 8 According to some embodiments of the present application, a module diagram of a mobile phone 10 is shown;
[0026] Fig. 9 According to some embodiments of the present application, a flowchart of the steps of a display method is shown;
[0027] Fig.10 According to some embodiments of the present invention, a structural diagram of a mobile phone 10 is shown. DETAILED DESCRIPTION
[0028] Illustrative embodiments of the present invention include, but are not limited to, a display method, a storage medium, an electronic device, and a program product.
[0029] The following is combined with Figures 1 to 10 The technical solution of the present invention is introduced.
[0030] In some embodiments, when a user is using an electronic device such as a mobile phone, the screen refresh rate of the mobile phone may change according to user operations, APP display requirements, etc.
[0031] For example, Figure 1As shown, when a user uses the mobile phone 10 to slide left and right on the main interface 1A (such as the desktop) to switch interfaces, in order to ensure the stability and clarity of images such as the desktop displayed on the screen of the mobile phone 10 during the interface switching process, the mobile phone 10 usually sets the screen refresh rate to a higher refresh rate, such as 120Hz, 144Hz, etc. during the interface switching process.
[0032] For example, Figure 1 and Figure 2 As shown, the user uses the mobile phone 10 to Figure 1 After sliding right on the main interface 1A, the mobile phone 10 switches to Figure 2 As shown in the negative one screen interface 2A. It can be understood that in the mobile phone 10 Figure 1 The main interface 1A shown switches to Figure 2 During the negative one screen interface 2A process shown, the screen refresh rate of the mobile phone 10 is a relatively high refresh rate.
[0033] Then, the mobile phone 10 switches to Figure 2 After the negative one screen interface 2A is shown, if the mobile phone 10 does not detect any response operation within a certain period of time, in order to reduce the power consumption of the mobile phone 10, the mobile phone 10 usually adjusts the screen refresh rate from a higher refresh rate to a lower refresh rate, such as 60Hz, 30Hz, etc.
[0034] Furthermore, after the mobile phone 10 adjusts the screen refresh rate to a lower refresh rate, if the mobile phone 10 detects the user's operation on the interface of the mobile phone 10, such as switching interfaces, the mobile phone 10 adjusts the screen refresh rate from a lower refresh rate to a higher refresh rate to ensure the stability and clarity of the image displayed on the screen of the mobile phone 10.
[0035] It is understandable that the above example of the user switching interface is only an example of a screen refresh rate change scenario of the present application. In other embodiments, the screen refresh rate change scenario may also be a user switching apps, such as switching an e-book app with a lower refresh rate display requirement to a game app with a higher refresh rate display requirement, or any scenario that produces a refresh rate change, without specific limitation.
[0036] It is understood that the above mobile phone is only an example of an electronic device of the present application. In other embodiments, the electronic device includes but is not limited to any device with a display screen and display function, such as a smart TV, a wearable device, a tablet computer, etc., without specific limitation. The following uses a mobile phone as an example of an electronic device to explain the embodiments of the present application.
[0037] In some embodiments, the process of adjusting the screen refresh rate and displaying an image on a mobile phone includes the following steps: the APP obtains the content to be displayed and sets the frame rate according to the display requirements of the content to be displayed, and then sends the content to be displayed and the set frame rate to the AP; the AP synthesizes, converts, decodes, and other operations on the content to be displayed to load image data, and stores the image data in a corresponding buffer; then, the AP sends the image data to the DDIC at the corresponding frame rate through a display interface, such as a mobile processor interface display serial interface (MIPI DSI); the DDIC processes the received image data and drives the screen of the mobile phone to display the corresponding content at the refresh rate corresponding to the frame rate of the received data.
[0038] It can be understood that the higher the frame rate, the higher the refresh rate. For example, when the corresponding frame rate is 120 frames per second, the AP transmits 120 frames of image data to the DDIC through the MIPI DSI per second, that is, the corresponding mobile phone screen refresh rate is 120Hz; for another example, when the corresponding frame rate is 60 frames per second, the AP transmits 60 frames of image data to the DDIC through the MIPI DSI per second, that is, the corresponding mobile phone screen refresh rate is 60Hz. In other words, the higher the screen refresh rate of the mobile phone, the higher the rate at which the AP transmits image data to the DDIC; the lower the screen refresh rate of the mobile phone, the lower the rate at which the AP transmits image data to the DDIC.
[0039] In some embodiments, Figure 3 As shown, the AP and DDIC are connected through data channel 0 (referred to as lane0), data channel 1 (referred to as lane1), data channel 2 (referred to as lane2), data channel 3 (referred to as lane3) and clock channel (referred to as mipi clk). In other embodiments, the data channel can also be one or two or other number of configurations, without specific limitation. The following takes the connection between AP and DDIC through four data channels and one clock channel as an example to explain the embodiments of the present application.
[0040] In some embodiments, the AP typically transmits image data to the DDIC in parallel through four data channels, and provides a synchronous clock signal to the DDIC through a clock channel to ensure that the DDIC correctly decodes the image data and drives the display.
[0041] In some embodiments, when the AP is transmitting image data, the AP needs to generate an idle waiting time according to the frame rate. For example, if the corresponding frame rate is 120 frames per second, that is, the screen refresh rate of the mobile phone is 120Hz, then the AP needs to wait for about 8.34 milliseconds before transmitting the next frame of the image after each frame of the image is transmitted; for another example, if the corresponding frame rate is 60 frames per second, that is, the screen refresh rate of the mobile phone is 60Hz, then the AP needs to wait for about 16.67 milliseconds before transmitting the next frame of the image after each frame of the image is transmitted.
[0042] It can be understood that the higher the screen refresh rate of the mobile phone, the shorter the idle waiting time during the AP transmitting image data to the DDIC; the lower the screen refresh rate of the mobile phone, the longer the idle waiting time during the AP transmitting image data to the DDIC.
[0043] As mentioned above, since the AP usually transmits image data to the DDIC in parallel through four data channels, that is, each data channel is in working state, each data channel will generate operating power consumption. However, when the screen refresh rate of the mobile phone is at a low refresh rate, the idle waiting time during the AP transmitting image data to the DDIC is long, resulting in power consumption waste.
[0044] To this end, the present application proposes a display method in which, in response to a mobile phone detecting that the screen refresh rate switches from a high refresh rate to a low refresh rate, the mobile phone reduces the data channel used to transmit image data to reduce the transmission power consumption of the mobile phone in a low refresh rate scenario.
[0045] In some embodiments, in response to the mobile phone detecting that the screen refresh rate switches from a low refresh rate to a high refresh rate, the mobile phone restores or adds a data channel for transmitting image data to ensure the stability and clarity of the displayed image in the high refresh rate scenario of the mobile phone.
[0046] The following is an exemplary description of the process of switching the refresh rate of a mobile phone screen from a high refresh rate to a low refresh rate in conjunction with the accompanying drawings.
[0047] In some embodiments, the following Figure 4 and Figure 5 The example of switching a mobile phone from a high refresh rate scene, such as 120 Hz, to a low refresh rate scene, such as 60 Hz, is used to illustrate the process of reducing the four data channels used to transmit image data to three data channels in the mobile phone.
[0048] In some embodiments, Figure 4As shown, the mobile phone includes an application layer 101, a display service (surface flinger, SF) 102, a hardware composer (hardware composer, HWC) 103, a driver (such as a screen display engine (screen display engine, SDE) driver) 104, and hardware (such as DSI hardware) 105.
[0049] Exemplarily, the application layer 101 is used to detect an APP to request an APP to switch frame rates. Figure 1 and Figure 2 As shown, when the mobile phone 10 is Figure 1 The main interface 1A shown switches to Figure 2 As shown in the negative one screen interface 2A, the refresh rate of the mobile phone 10 is 120 Hz, that is, the corresponding frame rate is 120 frames per second; subsequently, if the mobile phone 10 does not detect any response operation within a certain period of time, in order to reduce the power consumption of the mobile phone 10, the mobile phone 10 requests SF102 through the application layer 101 to switch the frame rate from 120 frames per second to 60 frames per second, that is, the switching frame rate is 60 frames per second.
[0050] Exemplarily, SF102 switches modes based on the request sent by the application layer 101. It can be understood that in SF102, different frame rates correspond to different modes, and when the frame rate changes, SF102 needs to switch modes accordingly. For example, when the refresh rate of the mobile phone 10 is 120Hz, the mode of SF102 is the mode corresponding to the frame rate of 120 frames per second; when SF102 receives a request from the application layer 101 to switch the frame rate to 60 frames per second, SF102 switches from the mode corresponding to the frame rate of 120 frames per second to the mode corresponding to the frame rate of 60 frames per second, so that SF102 adapts to the new frame rate requirement. Subsequently, SF102 notifies HWC103 of the need to switch the frame rate and transmits the new frame rate, such as 60 frames per second, to HWC103.
[0051] Exemplarily, HWC103 switches modes based on the notification sent by SF102. It can be understood that in HWC103, different frame rates correspond to different modes, and when the frame rate changes, HWC103 needs to switch modes accordingly. For example, when the refresh rate of the mobile phone 10 is 120Hz, the mode of HWC103 is the mode corresponding to the frame rate of 120 frames per second; when HWC103 receives the notification from SF102 to switch the frame rate to 60 frames per second, HWC103 switches from the mode corresponding to the frame rate of 120 frames per second to the mode corresponding to the frame rate of 60 frames per second, so that HWC103 adapts to the new frame rate requirements to ensure normal display effects under the new refresh rate.
[0052] Exemplarily, HWC 103 transmits the new frame rate to driver 104 to request driver 104 to switch the refresh rate. For example, HWC 103 requests driver 104 to switch the refresh rate to switch the refresh rate from 120 Hz to 60 Hz.
[0053] Exemplarily, when the driver 104 determines that the mobile phone switches from a high refresh rate scenario to a low refresh rate scenario, the driver 104 sends an adjustment instruction to the hardware 105 so that the hardware 105 adjusts the number of data channels and the data transmission rate.
[0054] In some embodiments, when the driver 104 switches the refresh rate, the driver 104 first determines the size relationship between the original refresh rate and the switching frame rate. If the original refresh rate is greater than 60 and the switching frame rate is less than or equal to 60, it is determined that the screen refresh rate of the mobile phone is switched from a high refresh rate to a low refresh rate, that is, the mobile phone switches from a high refresh rate scene to a low refresh rate scene.
[0055] In some embodiments, in order to reduce the power consumption of the mobile phone in a low refresh rate scenario, the mobile phone controls the reduction of the data channel used to transmit image data through the driver 104 .
[0056] For example, as mentioned above Figure 3 As shown, the AP usually transmits image data to the DDIC in parallel through four data channels in the hardware 105 (such as MIPI DSI); in order to reduce power consumption, in the low refresh rate scenario, the driver 104 controls one of the four data channels of the hardware 105 to be in low power (LP) mode, so that the data channel in the low power mode is in an idle state. That is, when the mobile phone switches from a high refresh rate scenario to a low refresh rate scenario, the driver 104 controls the four data channels used to transmit image data in the hardware 105 to switch to three data channels (i.e., 4lane switches to 3lane), and the AP transmits image data to the DDIC through three data channels (3lane). That is, only three data channels are in working state during the AP transmitting image data to the DDIC, which can effectively reduce the power consumption of the mobile phone in the low refresh rate scenario compared to the four data channels being in working state.
[0057] It can be understood that in other embodiments, without affecting the transmission of image data, the driver 104 can also control multiple data channels used to transmit image data in the hardware 105 to be in low power consumption mode, such as two or three channels, so as to further reduce the power consumption of the mobile phone in low refresh rate scenarios, without specific limitation.
[0058] The following describes an example in which the driver 104 controls a data channel for transmitting image data in the hardware 105 to be in a low power consumption mode.
[0059] It is understandable that Figure 3 As shown, lane 0 (corresponding to an instance of the first channel, i.e., a specific representation of the first channel) in the hardware 105 is used for transmission of control instructions between the AP and the DDIC in addition to image data transmission between the AP and the DDIC, i.e., normal communication between the AP and the DDIC requires lane 0 to be in a working state. That is, when the driver 104 controls one of the four data channels in the hardware 105 to be in a low power consumption mode, one of the data channels is usually selected from lane 1 to lane 3 (corresponding to an instance of the second channel) to control the data channel to be in a low power consumption mode.
[0060] Exemplarily, the driver 104 can control lane 3 in the hardware 105 to be in a low power mode, for example, to control lane 3 to be in the lp00 ultra low power state (ULPS) in the low power mode, and control lane 3 not to transmit image data, so that the AP transmits image data to the DDIC in parallel through three data channels from lane 0 to lane 2. It can be understood that the idle lane 3 is in a low power mode, and lanes 0 to lane 2 transmitting image data are in a high speed (HS) mode, for example, lanes 0 to lane 2 are in a high speed data transmission mode (HSDT) in the high speed mode.
[0061] At the same time, the driver 104 controls the hardware 105 to transmit the image data according to the new configuration of 60 frames per second according to the received new refresh rate of 60 Hz, so as to ensure that the image data can be transmitted to the display screen according to the new refresh rate of 60 Hz.
[0062] Combination Figure 4 , Figure 5 According to some embodiments of the present application, a schematic flow chart of a 4-lane switching 3-lane process is shown.
[0063] like Figure 5 As shown, the process may include the following steps:
[0064] S01: The SDE driver 106 starts switching the refresh rate.
[0065] In some embodiments, Figure 1 and Figure 2 As shown, when the mobile phone 10 is Figure 1 The main interface 1A shown switches to Figure 2When the negative one screen interface 2A is shown, the refresh rate of the mobile phone 10 is 120Hz; then, if the mobile phone 10 does not detect any response operation within a certain period of time, in order to reduce the power consumption of the mobile phone 10, the mobile phone 10 switches the refresh rate from 120Hz to 60Hz through the SDE driver 106. For details, please refer to the above Figure 4 The descriptions of the application layer 101, SF 102, HWC 103, and driver 104 are not repeated here.
[0066] S02: SDE driver 106 controls lane 4 to switch lane 3 and configures registers.
[0067] In some embodiments, when the SDE driver 106 switches the refresh rate from 120 Hz to 60 Hz, the SDE driver 106 first determines the magnitude relationship before and after the refresh rate switching. For example, if the refresh rate is 120 Hz before the refresh rate switching and 60 Hz after the refresh rate switching, it is determined that the screen refresh rate switches from a high refresh rate to a low refresh rate, that is, the mobile phone switches from a high refresh rate scene to a low refresh rate scene.
[0068] Furthermore, in order to reduce the power consumption of the mobile phone in a low refresh rate scenario, the SDE driver 106 controls one of the four data channels in the DSI hardware 107 to be in a low power consumption mode. Figure 3 As shown, the SDE driver 106 controls lane 3 in the DSI hardware 107 to be in low power consumption mode, and configures registers corresponding to lane 3 in low power consumption mode, so that the data channel in low power consumption mode does not transmit image data.
[0069] S03: The SDE driver 106 sends an instruction to the DSI hardware 107 to switch the timing.
[0070] In some embodiments, the SDE driver 106 switches timing based on the switching refresh rate, for example, adjusting timing parameters such as frame rate, pixel clock frequency, horizontal synchronization signal, vertical synchronization signal, pulse width, etc. based on the switching refresh rate of 60 Hz; at the same time, the SDE driver 106 sends instructions to the DSI hardware 107 to enable the DSI hardware 107 to adjust the number of data channels and the data transmission rate.
[0071] S04: The DSI hardware 107 receives the instruction sent by the SDE driver 106 and forwards it to the display screen 108, switching 3 lanes.
[0072] In some embodiments, Figure 3As shown, based on the instruction of SDE driver 106, DSI hardware 107 controls lane 3 to be in low power consumption mode, so that lane 3 does not transmit image data, and then switches the four data channels used to transmit image data to three data channels (i.e., switches 3 lanes), so that AP transmits image data to DDIC through three data channels from lane 0 to lane 2. It can be understood that only three data channels are in working state during the process of AP transmitting image data to DDIC, which can effectively reduce the power consumption of mobile phones in low refresh rate scenarios compared to all four data channels being in working state.
[0073] Furthermore, the DSI hardware 107 transmits image data at 60 frames per second and forwards the instructions sent by the SDE driver 106 to the display screen 108 to ensure that the image data can be transmitted to the display screen 108 at a refresh rate of 60 Hz.
[0074] S05: The display screen 108 receives image data via 3lane and switches the refresh rate.
[0075] In some embodiments, the display screen 108 receives image data based on three data channels, lane0 to lane2, and displays images at a refresh rate switched from 120 Hz to 60 Hz according to instructions forwarded by the DSI hardware 107 .
[0076] The following is an exemplary description of the process of switching the refresh rate of a mobile phone screen from a low refresh rate to a high refresh rate in conjunction with the accompanying drawings.
[0077] In some embodiments, the following Figure 6 and Figure 7 The example of switching a mobile phone from a low refresh rate scene such as 60 Hz to a high refresh rate scene such as 120 Hz is used to illustrate the process of increasing the three data channels used to transmit image data to four data channels by the mobile phone.
[0078] In some embodiments, Figure 6 As shown, the mobile phone includes an application layer 101, a display service 102 (SF102 for short), a hardware synthesizer 103 (HWC103 for short), a driver 104, and hardware 105. It can be understood that compared to Figure 4 , Figure 6 The difference is the judgment result in driver 104. Figure 4 The judgment result is that the mobile phone switches from a high refresh rate scene to a low refresh rate scene, and Figure 6 The judgment result is that the mobile phone switches from a low refresh rate scene to a high refresh rate scene. For details, see the following description.
[0079] In some embodiments, if the mobile phone is in the screen-on state and no response operation is detected within a certain period of time, the mobile phone usually adjusts the screen refresh rate to a lower refresh rate of 60Hz, that is, the corresponding frame rate is 60 frames per second; when the mobile phone adjusts the screen refresh rate to a lower refresh rate, if the mobile phone detects the user's operation on the mobile phone interface, such as switching interface operation, in order to ensure the stability and clarity of the image displayed on the mobile phone screen, the mobile phone requests SF102 through the application layer 101 to switch the frame rate from 60 frames per second to 120 frames per second, that is, the switching frame rate is 120 frames per second. Further, SF102 switches the mode based on the request sent by the application layer 101 and notifies HWC103 that the frame rate needs to be switched and the new frame rate is transmitted, such as 120 frames per second. Subsequently, HWC103 switches the mode based on the notification sent by SF102 and transmits the new frame rate to the driver 104 to request the driver 104 to switch the refresh rate. For example, HWC103 requests the driver 104 to switch the refresh rate to switch the refresh rate from 60Hz to 120Hz.
[0080] In some embodiments, when the driver 104 switches the refresh rate, the driver 104 first determines the size relationship between the original refresh rate and the switching frame rate. If the original refresh rate is less than or equal to 60, and the switching frame rate is greater than 60, it is determined that the screen refresh rate is switched from a low refresh rate to a high refresh rate, that is, the mobile phone switches from a low refresh rate scene to a high refresh rate scene.
[0081] As before Figure 4 and Figure 5 From the description, it can be seen that in a low refresh rate scenario, the mobile phone switches four data channels for transmitting image data to three data channels to reduce power consumption. When the mobile phone switches from a low refresh rate scenario to a high refresh rate scenario, in order to ensure the stability and clarity of the image displayed in the high refresh rate scenario of the mobile phone, the mobile phone controls the recovery or increase of the data channels for transmitting image data through the driver 104.
[0082] Exemplarily, when the driver 104 determines that the mobile phone switches from a low refresh rate scenario to a high refresh rate scenario, the driver 104 sends an adjustment instruction to the hardware 105 so that the hardware 105 adjusts the number of data channels and the data transmission rate.
[0083] For example, Figures 3 to 5, in the low refresh rate scenario, lane 3 of the mobile phone is in low power consumption mode. Thus, when the mobile phone switches from the low refresh rate scenario to the high refresh rate scenario, the driver 104 controls the lane 3 in the hardware 105 which is in low power consumption mode to exit the low power consumption mode and enter the high speed mode to start transmitting data. That is, when the mobile phone switches from the low refresh rate scenario to the high refresh rate scenario, the driver 104 controls the three data channels used to transmit image data in the hardware 105 to switch to four data channels (i.e., 3 lanes switch to 4 lanes), i.e., the AP transmits image data to the DDIC through four data channels (4 lanes) to ensure the stability and clarity of the displayed image in the high refresh rate scenario. At the same time, according to the received new refresh rate of 120 Hz, the driver 104 controls the hardware 105 to transmit image data according to the new configuration of 120 frames per second to ensure that the image data can be transmitted to the display screen according to the new refresh rate of 120 Hz.
[0084] It can be understood that in other embodiments, if the number of data channels used to transmit image data in a low refresh rate scenario is 2, then in a high refresh rate scenario, one more channel may be added or four channels may be restored for transmission without specific limitation.
[0085] Combination Figure 6 , Figure 7 According to some embodiments of the present application, a schematic flow chart of a 3lane switching 4lane process is shown.
[0086] like Figure 7 As shown, the process may include the following steps:
[0087] S11: The SDE driver 106 starts switching the refresh rate.
[0088] In some embodiments, if the mobile phone is in the screen-on state and no response operation is detected within a certain period of time, the mobile phone usually adjusts the screen refresh rate to a lower refresh rate of 60Hz; after the mobile phone adjusts the screen refresh rate to a lower refresh rate, if the mobile phone detects the user's operation on the mobile phone interface, such as switching interface operations, in order to ensure the stability and clarity of the image displayed on the mobile phone screen, the mobile phone switches the refresh rate from 60Hz to 120Hz through the SDE driver 106. For details, please refer to the aforementioned Figure 6 The descriptions of the application layer 101, SF 102, HWC 103, and driver 104 are not repeated here.
[0089] S12: The SDE driver 106 controls the DSI hardware 107 to enter an idle state.
[0090] Combination Figures 3 to 6As described above, when the refresh rate is switched from 60Hz to 120Hz, lane 3 in low power mode needs to be controlled to exit low power mode and enter high speed mode to start transmitting data. That is, lane 3 in low power mode needs to be configured to be in high speed mode with the same timing state as lanes 0 to 2.
[0091] In some embodiments, to ensure that the four data channels from lane 0 to lane 3 have the same timing state when they are in high-speed mode to meet the MIPI DSI protocol requirements, the SDE driver 106 first controls the DSI hardware 107 to enter an idle state, that is, controls all data channels in the DSI hardware 107 to be in an idle state. For example, the SDE driver 106 controls lanes 0 to lane 2 in the DSI hardware 107 to enter the lp00 ultra-low power consumption mode to ensure that all data channels from lane 0 to lane 3 are in a known stable state.
[0092] S13: The DSI hardware 107 is in an idle state.
[0093] In some embodiments, the DSI hardware 107 responds to the control of the SDE driver 106, and lanes 0 to 3 in the DSI hardware 107 are all in the lp00 ultra-low power consumption mode, that is, the DSI hardware 107 enters an idle state.
[0094] S14: the display screen 108 performs a command (CMD) screen self-refresh.
[0095] In some embodiments, CMD screen self-refresh is a display technology that allows DDIC to automatically maintain the current display content when no new image data is received, that is, DDIC can autonomously maintain and refresh the image currently displayed on the display screen 108. It can be understood that when lanes 0 to 3 are all in the lp00 ultra-low power mode, the display screen 108 cannot receive new image data. In this way, the display screen 108 performs CMD screen self-refresh to autonomously maintain and refresh the current display content of the display screen 108.
[0096] S15: SDE driver 106 controls lane 3 to switch lane 4 and configures registers.
[0097] In some embodiments, the SDE driver 106 controls the four data channels lane 0 to lane 3 in the DSI hardware 107 to transmit image data, that is, switches from three data channels in a low refresh rate scenario to four data channels in a high refresh rate scenario, and performs register configuration according to the data channels used to transmit image data so that the data channels perform normal image data transmission.
[0098] S16: The SDE driver 106 controls the DSI hardware 107 to exit the idle state, sends instructions to the DSI hardware 107, and switches the timing.
[0099] In some embodiments, the SDE driver 106 controls the DSI hardware 107 to exit the idle state, so as to control lanes 0 to lane 3 to exit the lp00 ultra-low power mode at the same time. It can be understood that when lanes 0 to lane 3 exit the lp00 ultra-low power mode, all data channels will be reinitialized and the state transition will be performed synchronously. At this time, it can be ensured that all data channels are synchronously switched from the low power mode to the high speed mode.
[0100] Furthermore, the SDE driver 106 performs switching timing based on the switching refresh rate, for example, adjusting timing parameters such as frame rate, pixel clock frequency, horizontal synchronization signal, vertical synchronization signal, and pulse width based on the switching refresh rate of 120 Hz; at the same time, the SDE driver 106 sends instructions to the DSI hardware 107 to enable the DSI hardware 107 to adjust the number of data channels and the data transmission rate.
[0101] S17: The DSI hardware 107 receives the instruction sent by the SDE driver 106 and forwards it to the display screen 108, switching 4 lanes.
[0102] In some embodiments, the DSI hardware 107 exits the idle state based on the instruction of the SDE driver 106 and controls lanes 0 to lane 3 to synchronously enter the high-speed data transmission mode in the high-speed mode, so that lanes 0 to lane 3 simultaneously transmit image data, and then the three data channels used to transmit image data are switched to four data channels (i.e., 4 lanes are switched), so that the AP transmits image data to the DDIC through the four data channels of lanes 0 to lane 3. It can be understood that the AP transmits image data to the DDIC through four data channels to ensure the stability and clarity of the displayed image in the high refresh rate scenario.
[0103] Furthermore, the DSI hardware 107 transmits image data at 120 frames per second and forwards the instructions sent by the SDE driver 106 to the display screen 108 to ensure that the image data can be transmitted to the display screen 108 at a refresh rate of 120 Hz.
[0104] S18: The display screen 108 receives image data via 4 lanes and switches the refresh rate.
[0105] In some embodiments, the display screen 108 receives image data based on four data channels, lane 0 to lane 3, and displays images at a refresh rate switched from 60 Hz to 120 Hz according to instructions forwarded by the DSI hardware 107 .
[0106] The following combination Figures 1 to 7 , the embodiments of the present application are further illustrated.
[0107] Figure 8 According to some embodiments of the present application, a module diagram of a mobile phone 10 is shown. Figure 8 As shown, the mobile phone 10 includes a driving module 81 , an interface module 82 and a display module 83 .
[0108] In some embodiments, the driver module 81 is used to detect changes in the screen refresh rate of the mobile phone 10, and control the modes of the various data channels in the interface module 82 based on the changes in the screen refresh rate of the mobile phone 10. For example. When the driver module 81 detects that the mobile phone 10 changes from a high refresh rate to a low refresh rate, at least one data channel in the control interface module 82 enters a low power consumption mode; for another example, when the driver module 81 detects that the mobile phone 10 changes from a low refresh rate to a high refresh rate, all data channels in the control interface module 82 enter a high speed mode. The specific functions and effects of the driver module 81 can be found in the aforementioned Figure 3 Medium AP, Figure 4 and Figure 6 Display services, hardware synthesizers, drivers, Figure 5 and Figure 7 The relevant description of the SDE driver in is not repeated here.
[0109] In some embodiments, the interface module 82 is used to adjust the mode of the data channel according to the instruction information of the driver module 81. For example, the data transmission from four data channels is switched to three data channels, or the data transmission from three data channels is switched to four data channels. Figure 3 MIPI DSI, Figure 4 and Figure 6 Medium hardware, Figure 5 and Figure 7 The description of DSI hardware is not repeated here.
[0110] In some embodiments, the display module 83 is used to receive the image data transmitted by the driving module 81 through the interface module 82, and present the image data on the display screen at a corresponding refresh rate according to the received frame rate. Figure 3 Medium DDIC, Figure 5 and Figure 7 The description of the display screen is omitted here.
[0111] Combination Figure 8 , Fig. 9 According to some embodiments of the present application, a flow chart of an implementation of a display method is shown. Fig. 9 As shown, the implementation process includes the following steps:
[0112] S91: The driving module detects that the screen refresh rate of the mobile phone is switched from the first refresh rate to the second refresh rate, and adjusts the number of data channels from the first number to the second number.
[0113] In some embodiments, corresponding to the case where the second refresh rate is less than the first refresh rate, for example Figure 4 and Figure 5 As shown, the driver (corresponding to the instance of the driver module) detects that the screen refresh rate of the mobile phone needs to be switched from 120Hz (corresponding to the instance of the first refresh rate) to 60Hz (corresponding to the instance of the second refresh rate), that is, switching from a high refresh rate to a low refresh rate. In this way, in order to reduce the power consumption of the mobile phone in the low refresh rate scenario, the lane 3 (corresponding to the instance of the first idle channel) of lanes 0 to 3 (corresponding to the instance of the data channel) of the driver control hardware (corresponding to the instance of the interface module) enters a low power consumption mode, so that the driver module switches from transmitting data at 120 frames per second through four data channels from lanes 0 to lane 3 (corresponding to the first number of instances) to transmitting image data to the display module in parallel through three data channels from lanes 0 to lane 2 (corresponding to the second number of instances) at 60 frames per second.
[0114] In some other embodiments, corresponding to the case where the second refresh rate is greater than the first refresh rate, for example Figure 6 and Figure 7 As shown, the driver (corresponding to the instance of the driver module) detects that the screen refresh rate of the mobile phone needs to be switched from 60Hz (corresponding to the instance of the first refresh rate) to 120Hz (corresponding to the instance of the second refresh rate), that is, from a low refresh rate to a high refresh rate. In this way, in order to ensure the stability and clarity of the displayed image in the high refresh rate scenario, the driver first controls lanes 0 to lane 2 of the hardware (corresponding to the instance of the interface module) to enter a low power consumption mode so that the state of lanes 0 to lane 2 (corresponding to the instance of the second idle channel) is the same as the state of lane 3 (corresponding to the instance of the first idle channel), and then controls lanes 0 to lane 3 to enter a high-speed mode synchronously, so that the driver module switches from transmitting data at 60 frames per second through three (corresponding to the first number of instances) data channels from lanes 0 to lane 2 to transmitting image data to the display module in parallel through four (corresponding to the second number of instances) data channels from lanes 0 to lane 3 at 120 frames per second.
[0115] S92: The driving module sends the image data to the display module through the second number of data channels.
[0116] In some embodiments, when the mobile phone switches from a high refresh rate scene to a low refresh rate scene, the driving module transmits image data to the display module in parallel through three data channels from lane0 to lane2 at 60 frames per second. The display module controls the mobile phone screen to display the image based on the received image data at a refresh rate corresponding to 60Hz.
[0117] In other embodiments, when the mobile phone switches from a low refresh rate scene to a high refresh rate scene, the driving module transmits image data to the display module in parallel through four data channels from lane0 to lane3 at 120 frames per second, and the display module controls the mobile phone screen to display the image based on the received image data at a refresh rate corresponding to 120Hz.
[0118] Fig.10 According to some embodiments of the present application, a hardware structure diagram of a mobile phone 10 is shown.
[0119] like Fig.10 As shown, the mobile phone 10 may include a processor 110, an external memory interface 120, an internal memory 121, a universal USB interface 130, a charging management module 140, a power management module 141, a battery module 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0120] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, etc. Among them, different processing units may be independent devices or integrated into one or more processors.
[0121] The controller may be the nerve center and command center of the mobile phone 10. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions. The control method executed by the mobile phone 10 in the embodiment of the present application may be specifically executed by the processor 110.
[0122] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, etc. It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the mobile phone 10.
[0123] The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery module 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery module 142 and / or the charging management module 140 to provide power to the processor 110, the internal memory 121, the external memory, the display screen 194, etc.
[0124] The wireless communication function of the mobile phone 10 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0125] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on mobile phone 10. Wireless communication module 160 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), etc. applied on mobile phone 10.
[0126] The mobile phone 10 implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor.
[0127] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the mobile phone 10 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0128] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 10. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function.
[0129] The internal memory 121 may be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the mobile phone 10 by running the instructions stored in the internal memory 121 .
[0130] The mobile phone 10 can implement audio functions through the audio module 170, such as music playing, recording, etc.
[0131] The button 190 includes a power button, a volume button, etc. The button 190 may be a mechanical button or a touch button. The motor 191 may generate a vibration prompt. The indicator 192 may be an indicator light. The SIM card interface 195 may be used to connect a SIM card.
[0132] It is to be understood that the structure illustrated in the present application does not constitute a specific limitation on the mobile phone 10. In other embodiments, the mobile phone 10 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0133] In some embodiments, the embodiments of the present application further provide a computer-readable medium, which stores a program code. When the computer program code runs on a computer, the computer executes the methods in the above aspects.
[0134] In some embodiments, the embodiments of the present application further provide a computer program product, which includes: a computer program code, which enables the computer to execute the methods in the above aspects when the computer program code runs on a computer.
[0135] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be required. Instead, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. In addition, the inclusion of structural or method features in a particular figure does not mean that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.
[0136] It should be noted that the units / modules mentioned in the various device embodiments of the present invention are all logical units / modules. Physically, a logical unit / module can be a physical unit / module, or a part of a physical unit / module, or can be implemented as a combination of multiple physical units / modules. The physical implementation of these logical units / modules themselves is not the most important. The combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed by the present invention. In addition, in order to highlight the innovative part of the present invention, the above-mentioned device embodiments of the present invention do not introduce units / modules that are not closely related to solving the technical problems proposed by the present invention, which does not mean that there are no other units / modules in the above-mentioned device embodiments.
[0137] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one" do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0138] While the present invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention.
Claims
1. A display method, applied to an electronic device, characterized in that: The electronic device includes a driving module and a display module for controlling a screen of the electronic device, and the method includes: The driving module detects that the screen refresh rate of the electronic device is switched from a first refresh rate to a second refresh rate, and adjusts the number of data channels from a first number to a second number, wherein the data channels are used for the driving module to send image data to the display module, and corresponding to the second refresh rate being less than the first refresh rate, the second number is less than the first number; The driving module sends the image data to the display module through a second number of data channels; Wherein, corresponding to the case where the second refresh rate is less than the first refresh rate, the screen refresh rate of the electronic device is switched from the first refresh rate to the second refresh rate, at least comprising: after the electronic device switches from the first interface to the second interface, if no response operation is detected within a preset time, the screen refresh rate of the electronic device is switched from the first refresh rate to the second refresh rate; The method further comprises: corresponding to the second refresh rate being greater than the first refresh rate, the second number being greater than the first number; Wherein, it corresponds to the case where the second refresh rate is greater than the first refresh rate; The driving module detects that the screen refresh rate of the electronic device is a first refresh rate, the driving module and the display module include the first number of data channels and at least one first idle channel, and, The driving module sends the image data to the display module through the first number of data channels, wherein the first number of data channels are in a high-speed mode and the first idle channel is in a low-power consumption mode; The driving module detects that the screen refresh rate of the electronic device switches from the first refresh rate to the second refresh rate, and the driving module controls at least one of the first idle channels to enter the high-speed mode to increase the number of the data channels from the first number to the second number, and The driving module sends the image data to the display module through the second number of data channels, wherein the second number of data channels are in a high-speed mode; The driving module controls at least one of the first idle channels to enter a high-speed mode, including: The driving module controls the first number of data channels to enter the low power consumption mode to obtain the first number of second idle channels; The driving module controls the first number of second idle channels and at least one of the first idle channels to synchronously enter the high-speed mode to obtain the second number of data channels.
2. The method according to claim 1, characterized in that The method further comprises: Corresponding to the situation where the second refresh rate is lower than the first refresh rate; The driving module detects that the screen refresh rate of the electronic device is a first refresh rate, and the driving module sends the image data to the display module through the first number of data channels, wherein the first number of data channels are in a high-speed mode; The driving module detects that the screen refresh rate of the electronic device is switched from a first refresh rate to a second refresh rate, and the driving module sets at least one of the first number of data channels as a first idle channel to reduce the number of the data channels from the first number to the second number, and The driving module sends the image data to the display module through the second number of the data channels, wherein the second number of the data channels are in a high-speed mode.
3. The method according to claim 2, characterized in that The driving module sets at least one of the first number of data channels as a first idle channel, including: The driving module controls at least one of the first number of data channels to enter a low power consumption mode, and uses the data channel entering the low power consumption mode as the first idle channel.
4. The method according to claim 3, characterized in that The data channel includes a first channel and at least one second channel, wherein the first channel and the second channel are used for the driving module to send image data to the display module, and the first channel is also used for control instruction transmission between the driving module and the display module; and The driving module controls at least one of the first number of data channels to enter a low power consumption mode, including: The driving module controls at least one of the second channels among the data channels to enter a low power consumption mode.
5. The method according to any one of claims 1 to 4, characterized in that An interface module for connection is provided between the driving module and the display module, and the interface module includes the data channel, wherein: The interface module includes MIPI DSI.
6. A computer-readable storage medium, characterized in that: The readable storage medium stores instructions, which, when executed on an electronic device, enable the electronic device to implement the method according to any one of claims 1 to 5.
7. An electronic device, characterized in that: include: a memory for storing instructions to be executed by one or more processors of the electronic device; and a processor, which is one of the processors of the electronic device, configured to execute instructions stored in the memory to implement the method according to any one of claims 1 to 5.
8. A computer program product, characterized in that The program product includes instructions, and when the instructions are executed on an electronic device, the electronic device implements the method according to any one of claims 1 to 5.
