Control method and device and electronic equipment

Abstract

The invention provides a control method and device and electronic device.The control method is applied to first electronic equipment and comprises the steps that under the condition that a display signal sent by second electronic equipment is not received, a display interface of the first electronic equipment is controlled to display a first image according to a target refresh rate, the first image is an image cached in a frame buffer area of the first electronic equipment; in response to the received display signal sent by the second electronic equipment, the first refresh rate of the display interface of the first electronic equipment is adjusted to be a second refresh rate in a hierarchical mode, the display interface is controlled to display a second image according to the second refresh rate, and the second image is generated based on the display signal.

Description

Technical Field

[0001] The present disclosure relates to the field of display drive control, and particularly to a control method, apparatus, and electronic device. Background Art

[0002] With the improvement of the display resolution, the dynamic power consumption has gradually become an important part. Therefore, the Panel Self Refresh (PSR) technology has emerged, which realizes energy saving by dynamically adjusting the refresh rate. However, currently, when the refresh rate of the screen self-refresh function changes, it adopts a sudden change form, resulting in a screen flashing phenomenon. Summary of the Invention

[0003] In view of the above problems, the present disclosure provides a control method, apparatus, and electronic device.

[0004] According to a first aspect of the present disclosure, a control method is provided, including: when a display signal sent by a second electronic device is not received, controlling a display interface of a first electronic device to display a first image at a target refresh rate, where the first image is an image cached in a frame buffer area of the first electronic device; in response to receiving the display signal sent by the second electronic device, stepwise adjusting a first refresh rate of the display interface of the first electronic device to a second refresh rate, and controlling the display interface to display a second image at the second refresh rate, where the second image is generated based on the display signal.

[0005] According to an embodiment of the present disclosure, in response to receiving the display signal sent by the second electronic device, stepwise adjusting the first refresh rate of the display interface of the first electronic device to the second refresh rate includes: obtaining characteristic parameters of the display signal, and determining the second refresh rate according to the characteristic parameters; based on a difference between the second refresh rate and the first refresh rate, determining at least one refresh rate step point between the first refresh rate and the second refresh rate; and based on the at least one refresh rate step point, stepwise adjusting the first refresh rate of the display interface to the second refresh rate.

[0006] According to an embodiment of the present disclosure, controlling the display interface to display the second image at the second refresh rate includes: adjusting a display frequency of the second image based on a reception frequency of the display signal, so that the second image is displayed on the display interface at the display frequency, and the display frequency matches the second refresh rate.

[0007] According to an embodiment of the present disclosure, the method further includes: when an image feature of the second image satisfies a first preset condition, determining at least one refresh rate step point greater than a first threshold; or when the image feature of the second image does not satisfy the first preset condition, determining at least one refresh rate step point less than or equal to a second threshold, where the second threshold is less than the first threshold.

[0008] According to an embodiment of the present disclosure, the method further includes: when the second refresh rate is less than the first refresh rate and less than or equal to the refresh rate threshold, setting the number of refresh rate step points to be greater than the first threshold.

[0009] According to an embodiment of the present disclosure, based on at least one refresh rate step point, stepwise adjusting the first refresh rate of the display interface to the second refresh rate includes: determining a linear change step based on the first refresh rate, the second refresh rate, and the number of refresh rate step points; and successively adjusting the first refresh rate to the second refresh rate according to the linear change step.

[0010] According to an embodiment of the present disclosure, based on at least one refresh rate step point, stepwise adjusting the first refresh rate of the display interface to the second refresh rate further includes: determining a non-linear change function based on the first refresh rate, the second refresh rate, and the number of refresh rate step points; and adjusting the first refresh rate to the second refresh rate according to the non-linear change function.

[0011] A second aspect of the present disclosure provides a control device, including: a first control module, configured to control a display interface of a first electronic device to display a first image at a target refresh rate when a display signal sent by a second electronic device is not received, where the first image is an image cached in a frame buffer area of the first electronic device; and a second control module, configured to, in response to receiving the display signal sent by the second electronic device, stepwise adjust the first refresh rate of the display interface of the first electronic device to the second refresh rate, and control the display interface to display a second image at the second refresh rate, where the second image is generated based on the display signal.

[0012] According to an embodiment of the present disclosure, the second control module includes: an acquisition module, configured to obtain characteristic parameters of the display signal and determine the second refresh rate according to the characteristic parameters; a determination module, configured to determine at least one refresh rate step point between the first refresh rate and the second refresh rate based on a difference between the second refresh rate and the first refresh rate; and an adjustment module, configured to stepwise adjust the first refresh rate of the display interface to the second refresh rate based on at least one refresh rate step point.

[0013] A third aspect of the present disclosure provides an electronic device, including: one or more processors; and a storage device, configured to store one or more programs, where when the one or more programs are executed by the one or more processors, the one or more processors are caused to execute the following method: controlling a display interface of a first electronic device to display a first image at a target refresh rate when a display signal sent by a second electronic device is not received, where the first image is an image cached in a frame buffer area of the first electronic device; and in response to receiving the display signal sent by the second electronic device, stepwise adjusting the first refresh rate of the display interface of the first electronic device to the second refresh rate, and controlling the display interface to display a second image at the second refresh rate, where the second image is generated based on the display signal.

[0014] The fourth aspect of the present disclosure provides a computer-readable storage medium, on which executable instructions are stored, and when the instructions are executed by a processor, the steps of the above control method are implemented.

[0015] The fifth aspect of the present disclosure further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above control method are implemented.

[0016] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. Description of the Drawings

[0017] The drawings are used to better understand the solution and do not constitute a limitation to the present disclosure. Among them:

[0018] Figure 1 Schematically shows a schematic diagram of square wave switching refresh rate in the prior art;

[0019] Figure 2 Schematically shows an application scenario diagram of the control method, device and electronic device according to an embodiment of the present disclosure;

[0020] Figure 3 Schematically shows a flowchart of the control method according to an embodiment of the present disclosure;

[0021] Figure 4 Schematically shows a flowchart of determining whether to perform refresh rate switching according to an embodiment of the present disclosure;

[0022] Figure 5 Schematically shows a schematic diagram of linear switching refresh rate according to an embodiment of the present disclosure;

[0023] Figure 6 Schematically shows a schematic diagram of non-linear switching refresh rate according to an embodiment of the present disclosure;

[0024] Figure 7 Schematically shows a flowchart of setting the refresh rate step points according to an embodiment of the present disclosure;

[0025] Figure 8 Schematically shows a block diagram of the control device according to an embodiment of the present disclosure; and

[0026] Figure 9 Schematically shows a block diagram of an electronic device suitable for implementing the control method according to an embodiment of the present disclosure. Detailed Embodiments

[0027] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are merely exemplary and are not intended to limit the scope of the present disclosure. In the following detailed description, for the sake of explanation, numerous specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is obvious that one or more embodiments can also be implemented without these specific details. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily confusing the concepts of the present disclosure.

[0028] The terms used herein are merely for describing specific embodiments and are not intended to limit the present disclosure. The terms "including", "comprising", etc. used herein indicate the presence of features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0029] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0030] It should be noted that in the technical solution of the present disclosure, the processing of the user's personal information, such as collection, storage, use, processing, transmission, provision, disclosure, and application, all comply with the provisions of relevant laws and regulations, take necessary confidentiality measures, and do not violate public order and good customs. In the technical solution of the present disclosure, before obtaining or collecting the user's personal information, the authorization or consent of the user has been obtained.

[0031] In the description of this specification, the description referring to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0032] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" can explicitly or implicitly include at least one of the features. In the description of the present application, "a plurality" means two or more, unless otherwise specifically defined.

[0033] It has been found through research that in the related art, as an important part of electronic products, reducing the power consumption of a display not only conforms to the environmental protection trend but also helps the product meet the energy efficiency standards and enhance its market competitiveness. The power consumption of a display can be divided into two parts: dynamic power consumption and static power consumption. The dynamic power consumption mainly comes from the power consumed when writing signals to each pixel during the process of refreshing the display screen, while the static power consumption mainly comes from parts such as the backlight. The Panel Self-Refresh technology can effectively reduce the dynamic power consumption by reducing unnecessary data transmission and refresh operations. The core of this technology is to dynamically adjust the refresh rate (Refresh Rate, the unit can be Hz, that is, the number of times the display device updates the image per second) according to the display content. For example, when displaying a static image (such as reading text), the refresh rate can be reduced to 1 Hz. When displaying a dynamic image (such as a video or a game), the refresh rate can be increased to 60 Hz / 120 Hz or even higher. This adjustment reduces the overall power consumption of the system by reducing the frequency of data transmission from the Graphics Processing Unit (GPU) to the screen and reducing the logical power consumption of the screen. However, currently, when the screen self-refresh function performs the refresh rate switching, the switching method is a sudden change form (that is, the square wave switching as shown in Figure 1 ). At this time, since the time difference for the screen to maintain the potential of one frame in the low refresh rate and high refresh rate conditions is relatively large, even in the same picture situation, due to the different pixel potential maintenance times brought about by different frame rates, and the inevitable device leakage of the Thin Film Transistor (TFT) devices in the panel, the pixel potential difference between the front and back frames is too large when the refresh rate is switched, resulting in a screen flicker phenomenon.

[0034] In view of this, the embodiments of the present disclosure provide a control method, device, and electronic device. The control method, device, and electronic device will be introduced below with reference to the accompanying drawings.

[0035] Figure 2 FIG. 200 schematically shows an application scenario diagram of the control method, device, and electronic device according to the embodiments of the present disclosure.

[0036] It should be noted that Figure 2 The figure shown is only an example of the scenario where the embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments, or scenarios.

[0037] As Figure 2As shown, the application scenario 200 according to this embodiment may include first electronic devices 201, 202, 203, a network 204, and a second electronic device 205. The network 204 is used to provide a medium for communication links between the first electronic devices 201, 202, 203 and the second electronic device 205. The network 204 may include various connection types, such as wired, wireless communication links, or fiber optic cables, etc.

[0038] Users can use the first electronic devices 201, 202, 203 to interact with the second electronic device 205 through the network 204 to receive or send messages, etc. Various communication client applications may be installed on the first electronic devices 201, 202, 203, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for examples).

[0039] The first electronic devices 201, 202, 203 may be various electronic devices with a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, and desktop computers, etc.

[0040] The second electronic device 205 is used to provide various background services for the first electronic devices 201, 202, 203. For example, a background management server that supports the refresh rate controlled by the user using the first electronic devices 201, 202, 203 (only for examples). The second electronic device 205 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Optionally, the second electronic device 205 provides background services for the system settings in multiple first electronic devices 201, 202, 203 at the same time.

[0041] It should be noted that the control method provided by the embodiments of the present disclosure can generally be applied to the first electronic devices 201, 202, 203. The control method provided by the embodiments of the present disclosure can also be integrated or deployed in other intelligent devices or systems that are different from the first electronic devices 201, 202, 203 and can be compatible with or communicate with the first electronic devices 201, 202, 203.

[0042] It should be understood that Figure 2 the numbers of the first electronic devices, the network, and the second electronic device in

[0043] Based on the Figure 2 scenario described below, the control method of the embodiments of the present disclosure will be described in detail through Figures 3 - 7 the following content.

[0044] Figure 3 FIG. schematically shows a flowchart of a control method according to an embodiment of the present disclosure.

[0045] As Figure 3 shown, the control method of this embodiment includes S310 to S320.

[0046] In S310, in the case where a display signal sent by a second electronic device is not received, the display interface of the first electronic device is controlled to display a first image at a target refresh rate, and the first image is an image cached in the frame buffer area of the first electronic device.

[0047] Exemplarily, the first electronic device may be a display with a display interface, capable of presenting various images, videos, and text information. The second electronic device may be a host, such as a personal computer (PC) that can drive the Panel replay function.

[0048] The first electronic device may establish a communication connection with the second electronic device. At the same time, the first electronic device may continuously monitor whether a display signal sent by the second electronic device is received. In the case where a display signal sent by the second electronic device is not received, it can be considered that the current second electronic device does not output new frame data to the first electronic device. At this time, the first electronic device may control its own display interface to display the first image at a preset target refresh rate. The first image may refer to an image stored in the frame buffer area (frame buffer) of the first electronic device. Among them, the frame buffer area may be a memory area dedicated to storing image data, that is, a temporary image warehouse. When the host outputs new frame data, these data can be first stored in the frame buffer area, and then the display reads the data from the frame buffer area for display.

[0049] Figure 4 FIG. schematically shows a flowchart of determining whether to perform a refresh rate switch according to an embodiment of the present disclosure.

[0050] As Figure 4As shown, exemplarily, it is assumed that the user is using a PC connected to a monitor that supports the Panel replay function for work and has enabled this function in the OSD (On-Screen Display). When the user does not perform any operations for a period of time, such as not opening a new application or not scrolling the web page, etc., the PC with the Panel replay function enabled, its graphics card (GPU) can recognize that the output content has not changed. At this time, the graphics card can stop outputting new frame data to the scalar (a processing unit or chip for processing image signals and controlling display output) of the monitor. When the scalar detects that there is no source input from the current graphics card, that is, no display signal input, it can read the previously stored frame from the frame buffer area. This frame can be the last cached frame of the monitor, that is, the last valid image seen by the user. Then, the scalar can output data to the screen at the target refresh rate, such as the lowest refresh rate supported by the monitor, to display the first image.

[0051] In the above manner, the first electronic device (monitor) can continue to display a stable image without a new display signal input. At the same time, since the lower refresh rate consumes less energy when the monitor refreshes the image, the power consumption can be reduced.

[0052] In S320, in response to receiving the display signal sent by the second electronic device, the first refresh rate of the display interface of the first electronic device is adjusted in steps to the second refresh rate, and the display interface is controlled to display the second image at the second refresh rate. The second image is generated based on the display signal.

[0053] The first electronic device can monitor in real time whether it receives the display signal sent by the second electronic device. In the case of receiving the display signal sent by the second electronic device, that is, the second electronic device has new frame data that needs to be output to the first electronic device for display. At this time, the first electronic device (monitor) can adjust the refresh rate. The monitor can adjust the first refresh rate of the current display interface in steps to the preset second refresh rate. Adjusting in steps means that the refresh rate will not directly jump from the first refresh rate to the second refresh rate, but will go through a gradual change process. For example, if the first refresh rate is 1Hz and the second refresh rate is 60Hz, then the refresh rate can first rise from 1Hz to 5Hz, and then rise to 10Hz, and so on, until it finally reaches 60Hz. Conversely, if it is a decrease from a high refresh rate to a low refresh rate, a similar gradual decrease method can also be adopted.

[0054] It should be noted that the first refresh rate can be the target refresh rate or the refresh rate that needs to be adjusted again after adjustment.

[0055] For example, when a user switches from reading a static e - book to watching a high - definition video, the video image is dynamic and changes rapidly, requiring a higher refresh rate to ensure the smoothness and clarity of the image. At this time, the graphics card can re - output a display signal to the scalar. After the scalar detects the output of a signal source, it can start the refresh rate adjustment mechanism and gradually adjust the first refresh rate to a higher value, such as 60 Hz or even 120 Hz.

[0056] While the refresh rate is adjusted in steps, the display can control the display interface to display a second image generated according to the display signal at the adjusted second refresh rate. Continuing with the above - mentioned office scenario as an example, when the user opens a new application or performs some operations that cause changes in the image content, the graphics card of the PC will re - output a data signal to the scalar of the display. At this time, when the scalar detects the output of a signal source, it can execute the refresh rate switching algorithm for step - by - step adjustment.

[0057] Continue to refer to Figure 4 , taking the above - mentioned office scenario as an example, when the user opens a new application or performs other operations that cause changes in the image content, the graphics card of the PC can re - output a display signal to the scalar of the display. At this time, when the scalar detects the output of a signal source, it can execute the refresh rate switching algorithm and adjust step - by - step to the refresh rate value set by the user.

[0058] It can be understood that, in the case of a display signal input, automatically adjusting the refresh rate according to the dynamic changes of the screen content can reduce unnecessary energy consumption and optimize the display effect. At the same time, adjusting the refresh rate in steps can reduce the pixel potential difference between the front and rear frames caused by the leakage of the TFT device, thereby reducing the risk of screen flashing.

[0059] Based on the above - mentioned embodiments, in this embodiment, in response to receiving a display signal sent by a second electronic device, step - by - step adjusting the first refresh rate of the display interface of the first electronic device to a second refresh rate includes: obtaining characteristic parameters of the display signal and determining the corresponding second refresh rate according to the characteristic parameters; determining at least one refresh rate step point between the first refresh rate and the second refresh rate based on the difference between the second refresh rate and the first refresh rate; and step - by - step adjusting the first refresh rate of the display interface to the second refresh rate based on at least one refresh rate step point.

[0060] Obtain the characteristic parameters of the display signal, such as resolution, original frame rate, and scene complexity, etc. Among them, the frame rate represents the number of image frames displayed per second. High-frame-rate videos such as 120fps (frames per second) require a higher refresh rate to ensure the smoothness of the picture; high-resolution videos such as 4K resolution have rich picture details and also require a higher resolution to ensure the clarity of the picture; for game signals, etc., the scene complexity of the game can also be involved. For example, complex scene rendering in large 3D games requires a higher refresh rate to reduce picture stuttering and latency.

[0061] After obtaining the characteristic parameters, according to the pre-set rules and algorithms, combined with the characteristic parameters of the display signal, the corresponding second refresh rate can be determined. For example, if the display signal is a high-definition video with a frame rate of 60fps, the system can determine the second refresh rate as 60Hz to achieve synchronous refreshing of the video picture and avoid picture tearing and stuttering phenomena.

[0062] At the same time, based on the difference between the determined second refresh rate and the first refresh rate, at least one refresh rate step point can be determined between the first refresh rate and the second refresh rate, and then, according to the pre-set order and time interval, the refresh rate of the display interface is adjusted to each step point in turn. For example, when the step points from 1Hz to 60Hz are determined as 5Hz, 10Hz, 20Hz, 30Hz, 40Hz, 50Hz, the refresh rate can be first adjusted from 1Hz to 5Hz and maintained for a period of time to allow the monitor to have enough time to adapt to the new refresh rate. This period of maintenance time can be set according to the characteristics of the monitor and actual requirements and can be from dozens of milliseconds to hundreds of milliseconds. Then, the refresh rate can be adjusted from 5Hz to 10Hz and maintained for a period of time until the final second refresh rate of 60Hz is reached.

[0063] It can be understood that determining the second refresh rate based on the characteristic parameters can ensure that the second refresh rate matches the requirements of the display content, thus providing the best visual experience for users. In addition, inserting at least one refresh rate step point to achieve a smooth transition of the refresh rate can avoid the screen flashing phenomenon caused by sudden changes in the refresh rate and improve the stability and smoothness of the picture.

[0064] Based on the above embodiments, in this embodiment, based on at least one refresh rate step point, the first refresh rate of the display interface is adjusted in stages to the second refresh rate, including: determining the linear change step length based on the first refresh rate, the second refresh rate, and the number of refresh rate step points; and adjusting the first refresh rate to the second refresh rate in turn according to the linear change step length.

[0065] The linear change step, i.e., the "stride" during the process of the refresh rate change, determines the magnitude of each refresh rate adjustment. By calculating the difference between the first refresh rate and the second refresh rate and dividing it by the number N of refresh rate step points, the linear change step can be obtained. That is, the linear change step step = (the second refresh rate - the first refresh rate) / N. For example, if the first refresh rate is 10Hz, the second refresh rate is 60Hz, and the number of refresh rate step points is 5, then the linear change step step = (60 - 10) / 5 = 10Hz.

[0066] When the second refresh rate is lower than the first refresh rate, the linear change step is equal to the absolute value of the second refresh rate minus the first refresh rate, and then divided by the number N of refresh rate step points.

[0067] Based on the pre-calculated linear change step, the refresh rate of the display interface can be gradually adjusted from the first refresh rate to the second refresh rate. Taking the linear change step step = 10Hz obtained in the above embodiment as an example, assuming the first refresh rate is 10Hz and the second refresh rate is 50Hz. First, the refresh rate can be adjusted from 10Hz to 20Hz, that is, the first adjustment, and the adjustment magnitude is the linear change step 10Hz. Then, the refresh rate can be adjusted from 20Hz to 30Hz, that is, the second adjustment, and the adjustment magnitude is also 10Hz. And so on, then the refresh rate is adjusted to 40Hz, and finally reaches the second refresh rate 50Hz. At this time, the waveform of the stepped refresh rate change switch is as Figure 5 shown.

[0068] As Figure 5 shown, in the linear change mode, the change of the refresh rate can present a regular stepped waveform. The height of each step corresponds to the linear change step, and the number of steps is related to the number of refresh rate step points. This regular waveform indicates that the refresh rate increases or decreases step by step according to a fixed step, and the change process is relatively clear and stable.

[0069] It can be understood that the refresh rate increases or decreases step by step according to the linear change step, and the mode is relatively simple, easy to implement, and has relatively low requirements for hardware and software.

[0070] Based on the above embodiments, in this embodiment, based on at least one refresh rate step point, the first refresh rate of the display interface is adjusted in stages to the second refresh rate, and further includes: determining a non-linear change function based on the first refresh rate, the second refresh rate, and the number of refresh rate step points; adjusting the first refresh rate to the second refresh rate according to the non-linear change function.

[0071] The nonlinear change function is a mathematical function that describes the non-uniform and non-fixed step relationship in the refresh rate change process. It can be a sine wave function with different waveform shapes, frequencies, amplitudes and other parameters designed and selected according to actual needs, such as sine wave function, cosine wave function and triangle wave function. By reasonably selecting and determining the nonlinear change function, the change of the refresh rate can be made more consistent with the dynamic characteristics of the displayed content, thereby achieving more accurate refresh rate control. For example, when displaying some scenes with more drastic dynamic changes, a nonlinear change function with faster changes in the early stage and slower changes in the later stage can be used to quickly respond to changes in the displayed content while avoiding too frequent adjustments to the refresh rate in the later stage.

[0072] Using a predetermined nonlinear change function, the refresh rate value corresponding to each refresh rate step point can be calculated, and the refresh rate can be dynamically adjusted according to these values ​​to obtain a more comfortable and realistic visual experience.

[0073] For example, Figure 6 As shown, taking the sine wave function as an example, assuming that the first refresh rate is 20Hz, the second refresh rate is 80Hz, and the number of refresh rate step points is 4, a sine wave type nonlinear change function can be designed so that the refresh rate changes faster in the early stage and slower in the later stage. At the same time, according to the function, the refresh rate of the first step point can be calculated to be 30Hz, the refresh rate of the second step point to be 45Hz, the refresh rate of the third step point to be 60Hz, and the refresh rate of the fourth step point to be 70Hz. Then, the refresh rate of the display interface can be adjusted to the corresponding value calculated in turn.

[0074] It can be understood that through the adjustment method based on the nonlinear change function, the refresh rate change is no longer uniform, but presents a nonlinear change trend according to the characteristics of the function, which can better adapt to the dynamic changes of the display content and bring greater flexibility and adaptability to the adjustment of the refresh rate.

[0075] Based on the above embodiments, in this embodiment, the display interface is controlled to display the second image at a second refresh rate, including: adjusting the display frequency of the second image based on the receiving frequency of the display signal, so as to display the second image at the display frequency on the display interface, and the display frequency matches the second refresh rate.

[0076] When receiving the display signal sent by the second electronic device, that is, when the content of the source input changes, Scalar can monitor the reception frequency of the display signal in real time. According to the real-time change of the reception frequency, through its built-in frequency adjustment mechanism, it can adjust the signal frequency output to the display interface in real time to control the display frequency of the second image. During the adjustment process, the current characteristics of the source content (such as frame rate, resolution, color depth, etc.) can be comprehensively considered, and the screen display ability can be evaluated, and a preset algorithm (such as proportional scaling or linear interpolation) can be used to calculate the optimal display frequency that matches the reception frequency. Then, the display frequency instruction that matches the second refresh rate can be sent to the display driver unit to drive the display interface to display the second image at this frequency.

[0077] When the display frequency matches the second refresh rate, that is, when the two are consistent, the second electronic device can update the image at the most appropriate speed, ensuring the smoothness and stability of the picture. If the display frequency is lower than the second refresh rate, since the screen cannot be refreshed in time to display the new image content, it may cause the picture to freeze or tear. On the contrary, if the display frequency is higher than the second refresh rate, although theoretically it can provide a smoother picture, in fact, it may waste system resources because the screen cannot be physically refreshed at a higher speed. If there is a problem that the display frequency deviates from the second refresh rate, the driving parameters can also be automatically fine-tuned to eliminate the difference.

[0078] It can be understood that based on the dynamic adjustment mechanism of the reception frequency, it can not only better match the content of the source input, but also ensure a high degree of matching between the display frequency and the second refresh rate, thus enabling the image to be updated at the most appropriate speed and reducing stuttering.

[0079] In the embodiments of the present disclosure, the method further includes: when the image characteristics of the second image meet the first preset condition, determining at least one refresh rate step point greater than the first threshold; or, when the image characteristics of the second image do not meet the first preset condition, determining at least one refresh rate step point less than or equal to the second threshold, where the second threshold is less than the first threshold.

[0080] By deeply analyzing the characteristics of the second image, the image characteristics of the second image can be obtained, such as brightness characteristics, contrast characteristics, color characteristics, and texture characteristics, etc.

[0081] Exemplarily, the second image can be converted into an appropriate color space, such as RGB (Red, Green, Blue, i.e., the primary color model of red, green, and blue), HSV (Hue, Saturation, Value, i.e., the color space of hue, saturation, and value), or YUV (Luminance, Chrominance). In the color space, components such as red (R), green (G), blue (B) or luminance (Luminance, Y), chrominance (Chrominance, U, blue difference), and chrominance (Chrominance, V, red difference) of the image can be examined separately. If the value of the luminance component is low and concentrated within a certain small range, then this image can be considered a low gray-scale image, having the image characteristics of low gray-scale (low luminance or low gray level).

[0082] The leakage of the TFT device has a greater impact on the pixel potential of the screen at low gray levels (the potential determines the luminous intensity or color performance of the pixel), that is, screen flickering is more likely to occur in low gray-level pictures. To solve this problem, the embodiments of the present disclosure further propose that an identification algorithm can be built into the Tcon IC (Timing Controller Integrated Circuit) or scaler IC (Scaler Integrated Circuit). When it is recognized that the picture meets the first preset condition, that is, when it is determined to be a low gray-level picture, the switching mechanism of more refresh rate ladder points can be automatically triggered, that is, refresh rate ladder points greater than the first threshold are inserted. Otherwise, refresh rate ladder points less than or equal to the second threshold (the second threshold is less than the first threshold) are inserted to effectively solve the problem of screen flickering at low gray levels. The Tcon IC is a key component in display technology, responsible for controlling the timing and signal driving of the screen, ensuring that pixel data can be transmitted in the correct order and forming an image. The scaler IC can perform scaling processing on the input video signal to adapt to display screens of different resolutions.

[0083] Figure 7 Schematically shows a flowchart of the refresh rate ladder point setting according to an embodiment of the present disclosure.

[0084] As Figure 7 shown, exemplarily, this process starts with the user enabling the screen self-refresh function. The scaler of the display can determine whether there is a source input from the graphics card. When a display signal output from the source can be received, a judgment algorithm can be added. That is, it is judged whether the picture is a low gray-level (it can be Gray level≤64) picture. When it is judged that the picture is a low gray-level picture, an algorithm with more inserted refresh rate ladder points (the number of ladder points is represented by N) can be started, and at this time N is greater than the first threshold. When it is judged that the picture is not a low gray-level picture, an algorithm with fewer inserted refresh rate ladder points (the number of ladder points is represented by n) can be started, and at this time n is less than or equal to the second threshold. In this step-by-step refresh rate algorithm, N > n.

[0085] It should be noted that for the details not described in this embodiment, please refer to the implementation details of the foregoing embodiment.

[0086] It can be understood that when it is determined that the screen is a low gray-scale screen, that is, when the first preset condition is met, more refresh rate step points are inserted for switching, and the switching time required will be longer, so that the switching time of the refresh rate when the screen flashing phenomenon is not serious at high gray scales can be saved, and the delay can be reduced.

[0087] In an embodiment of the present disclosure, the method further includes: when the second refresh rate is less than the first refresh rate and less than or equal to the refresh rate threshold, setting the number of refresh rate step points to be greater than the first threshold.

[0088] In the case of a low refresh rate, the potential holding time of each frame of the screen is relatively long, resulting in a longer action time of the leakage phenomenon in the TFT device, a greater impact on the pixel potential, which may cause a significant change in the pixel potential, and thus trigger a screen flashing phenomenon. At this time, more refresh rate step point switches can also be performed. First, the refresh rate state of the current display screen can be monitored in real time through a built-in sensor or algorithm. When it is detected that the updated second refresh rate is a low refresh rate, that is, the second refresh rate is less than the first refresh rate and at the same time less than or equal to the preset refresh rate threshold (such as a relatively small 10 Hz), more refresh rate step points can be dynamically calculated and set according to the preset algorithm logic. For example, the number of refresh rate step points is set to be greater than the first threshold, so that the refresh rate can be finely adjusted within a smaller range.

[0089] It can be understood that by increasing the number of refresh rate step points, more frequent and fine refresh rate adjustments can be performed in a low refresh rate environment to reduce the impact of TFT leakage on the pixel potential, thereby reducing the occurrence probability of the screen flashing phenomenon and improving the user's visual experience.

[0090] Figure 8 The block diagram of the control device according to an embodiment of the present disclosure is schematically shown.

[0091] As Figure 8 shown, the control device 800 includes a first control module 810 and a second control module 820.

[0092] According to some embodiments of the present disclosure, the control device 800 can be used to implement the control method according to the embodiment of the present disclosure described with reference to Figures 3 - 7 the description.

[0093] The first control module 810 may perform, for example, operation S310 to control the display interface of the first electronic device to display a first image at a target refresh rate when a display signal sent by a second electronic device is not received, where the first image is an image cached in the frame buffer area of the first electronic device.

[0094] The second control module 820 may perform, for example, operation S320 to stepwise adjust a first refresh rate of the display interface of the first electronic device to a second refresh rate in response to receiving a display signal sent by the second electronic device, and control the display interface to display a second image at the second refresh rate, where the second image is generated based on the display signal.

[0095] For example, any one or more of the first control module 810 and the second control module 820 may be combined and implemented in one module, or any one of them may be split into multiple modules. Or, at least part of the functions of one or more of these modules may be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the first control module 810 and the second control module 820 may be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on chip, a system on substrate, a system on package, an application specific integrated circuit (ASIC), or may be implemented by any other reasonable way of integrating or packaging circuits, etc., in hardware or firmware, or implemented in any one of the three implementation manners of software, hardware, and firmware, or in an appropriate combination of any several of them. Or, at least one of the first control module 810 and the second control module 820 may be at least partially implemented as a computer program module, and when the computer program module runs, it may perform corresponding functions.

[0096] Based on the above embodiments, the second control module 820 includes an acquisition module, a determination module, and an adjustment module. Among them, the acquisition module is used to obtain characteristic parameters of the display signal and determine the second refresh rate according to the characteristic parameters. The determination module is used to determine at least one refresh rate step point between the first refresh rate and the second refresh rate based on the difference between the second refresh rate and the first refresh rate. The adjustment module is used to stepwise adjust the first refresh rate of the display interface to the second refresh rate based on at least one refresh rate step point.

[0097] It should be understood that the control device in the embodiments of the present disclosure corresponds to the control method part in the embodiments of the present disclosure, and their specific implementation details are also the same, which will not be elaborated herein.

[0098] It should be noted that in the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision, disclosure, and application, etc., of the user's personal information all comply with the provisions of relevant laws and regulations, necessary confidentiality measures are taken, and public order and good customs are not violated. In the technical solution of the present disclosure, before obtaining or collecting the user's personal information, the authorization or consent of the user is obtained.

[0099] Figure 9 A block diagram of an electronic device suitable for implementing a control method according to an embodiment of the present disclosure is schematically shown.

[0100] As Figure 9 shown, the electronic device 900 according to an embodiment of the present disclosure includes a processor 901, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 902 or the program loaded from the storage section 908 into the random access memory (RAM) 903. The processor 901 can include, for example, a general microprocessor (such as a CPU), an instruction set processor, and / or a related chipset, and / or a dedicated microprocessor (such as an application specific integrated circuit (ASIC)), etc. The processor 901 can also include on-board memory for caching purposes. The processor 901 can include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0101] In the RAM 903, various programs and data required for the operation of the electronic device 900 are stored. The processor 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. The processor 901 performs various operations of the method flow according to an embodiment of the present disclosure by executing the program in the ROM 902 and / or the RAM 903. It should be noted that the program can also be stored in one or more memories other than the ROM 902 and the RAM 903. The processor 901 can also perform various operations of the method flow according to an embodiment of the present disclosure by executing the program stored in the one or more memories.

[0102] According to an embodiment of the present disclosure, the electronic device 900 may further include an input / output (I / O) interface 905, and the input / output (I / O) interface 905 is also connected to the bus 904. The electronic device 900 may further include one or more of the following components connected to the I / O interface 905: an input portion 906 including a keyboard, a mouse, etc.; an output portion 907 including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage portion 908 including a hard disk, etc.; and a communication portion 909 including a network interface card such as a LAN card, a modem, etc. The communication portion 909 performs communication processing via a network such as the Internet. The drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed so that a computer program read therefrom is installed into the storage portion 908 as needed.

[0103] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist separately without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the one or more programs are executed, the method according to the embodiments of the present disclosure is implemented.

[0104] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the above-described ROM 902 and / or RAM 903 and / or one or more memories other than ROM 902 and RAM 903.

[0105] An embodiment of the present disclosure also includes a computer program product, which includes a computer program containing program code for executing the method shown in the flowchart. When the computer program product runs in a computer system, the program code is used to cause the computer system to implement the control method provided by the embodiments of the present disclosure.

[0106] When the computer program is executed by the processor 901, the above functions defined in the system / apparatus of the embodiments of the present disclosure are executed. According to an embodiment of the present disclosure, the above-described systems, apparatuses, modules, units, etc. can be implemented by computer program modules.

[0107] In one embodiment, the computer program can rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program can also be transmitted and distributed in the form of signals on a network medium, and be downloaded and installed through the communication part 909, and / or be installed from the removable medium 911. The program code included in the computer program can be transmitted by any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0108] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or be installed from the removable medium 911. When the computer program is executed by the processor 901, the above functions defined in the system of the embodiments of the present disclosure are executed. According to an embodiment of the present disclosure, the above-described systems, devices, apparatuses, modules, units, etc. can be implemented by computer program modules.

[0109] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiments of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages include but are not limited to, such as Java, C++, python, the "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, by using an Internet service provider to connect through the Internet).

[0110] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a portion of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur in a different order than that noted in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, as well as combinations of blocks in the block diagram or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or by a combination of dedicated hardware and computer instructions.

[0111] Those skilled in the art will appreciate that the features recited in the various embodiments and / or claims of the present disclosure can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly recited in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features recited in the various embodiments and / or claims of the present disclosure can be combined and / or combined in various ways. All such combinations and / or combinations fall within the scope of the present disclosure.

[0112] The embodiments of the present disclosure have been described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments have been described separately above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. The scope of the present disclosure is defined by the appended claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art can make various substitutions and modifications, and all such substitutions and modifications should fall within the scope of the present disclosure.

Claims

1. A control method, applied to a first electronic device, comprising: In the case where the display signal sent by the second electronic device is not received, controlling the display interface of the first electronic device to display a first image at a target refresh rate, where the first image is an image cached in a frame buffer area of ​​the first electronic device; In response to receiving a display signal sent by the second electronic device, the first refresh rate of the display interface of the first electronic device is adjusted in stages to a second refresh rate, and the display interface is controlled to display a second image at the second refresh rate, and the second image is generated based on the display signal.

2. The method according to claim 1, wherein in response to receiving a display signal sent by the second electronic device, adjusting the first refresh rate of the display interface of the first electronic device to the second refresh rate in stages comprises: Obtaining characteristic parameters of the display signal, and determining the second refresh rate according to the characteristic parameters; Determining at least one refresh rate step point between the first refresh rate and the second refresh rate based on a difference between the second refresh rate and the first refresh rate; Based on the at least one refresh rate step point, the first refresh rate of the display interface is adjusted in stages to the second refresh rate.

3. The method according to claim 1, wherein controlling the display interface to display the second image at the second refresh rate comprises: The display frequency of the second image is adjusted based on the reception frequency of the display signal, so that the second image is displayed on the display interface according to the display frequency, and the display frequency matches the second refresh rate.

4. The method according to claim 2, further comprising: When the image feature of the second image satisfies a first preset condition, determining at least one refresh rate step point greater than a first threshold; Alternatively, when the image feature of the second image does not satisfy the first preset condition, at least one refresh rate step point that is less than or equal to a second threshold is determined, and the second threshold is less than the first threshold.

5. The method according to claim 4, further comprising: When the second refresh rate is less than the first refresh rate and less than or equal to a refresh rate threshold, the number of the refresh rate step points is set to be greater than the first threshold.

6. The method according to claim 2, wherein based on the at least one refresh rate step point, the first refresh rate of the display interface is adjusted in stages to the second refresh rate, comprising: Determine a linear change step length based on the first refresh rate, the second refresh rate, and the number of refresh rate step points; According to the linear change step, the first refresh rate is adjusted to the second refresh rate in sequence.

7. The method according to claim 2, wherein the adjusting the first refresh rate of the display interface to the second refresh rate in stages based on the at least one refresh rate step point further comprises: Determine a nonlinear change function based on the first refresh rate, the second refresh rate, and the number of refresh rate step points; According to the nonlinear change function, the first refresh rate is adjusted to the second refresh rate.

8. A control device comprising: A first control module, configured to control a display interface of the first electronic device to display a first image at a target refresh rate when a display signal sent by the second electronic device is not received, wherein the first image is an image cached in a frame buffer area of ​​the first electronic device; The second control module is used to adjust the first refresh rate of the display interface of the first electronic device to a second refresh rate in stages in response to receiving a display signal sent by the second electronic device, and control the display interface to display a second image at the second refresh rate, wherein the second image is generated based on the display signal.

9. The device according to claim 8, wherein the second control module comprises: an acquisition module, configured to obtain characteristic parameters of the display signal, and determine the second refresh rate according to the characteristic parameters; a determination module, configured to determine at least one refresh rate step point between the first refresh rate and the second refresh rate based on a difference between the second refresh rate and the first refresh rate; An adjustment module is used to adjust the first refresh rate of the display interface to the second refresh rate in stages based on the at least one refresh rate step point.

10. An electronic device comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors execute the following method: In the case where the display signal sent by the second electronic device is not received, controlling the display interface of the first electronic device to display the first image at the target refresh rate, where the first image is an image cached in the frame buffer area of ​​the first electronic device; In response to receiving a display signal sent by the second electronic device, the first refresh rate of the display interface of the first electronic device is adjusted in stages to a second refresh rate, and the display interface is controlled to display a second image at the second refresh rate, and the second image is generated based on the display signal.

Images