Image refreshing method, device, apparatus and medium

Abstract

The application discloses an image refreshing method, an image refreshing device, an image refreshing equipment and a computer storage medium, relates to the technical field of image display, and comprises the following steps: determining an image to-be-refreshed region in a display interface and effective coordinates of the image to-be-refreshed region in the display interface; acquiring effective image data corresponding to the determined region in the display interface of the effective coordinates; and refreshing a current frame image in the display interface based on the effective image data to obtain a next frame image. Through the mode of optimizing the data amount size pushed by MCU to the panel screen, only the effective image data corresponding to the image to-be-refreshed region is transmitted, the whole frame image data does not need to be transmitted, the data transmission amount is reduced, the data transmission time is shortened, the display frame rate is improved, and the power consumption is reduced.

Description

Technical Field

[0001] This invention relates to the field of image display technology, and more particularly to an image refresh method, an image refresh device, an image refresh equipment, and a computer storage medium. Background Technology

[0002] Currently, with the rise of AR (Augmented Reality) and smartwatches in recent years, and the demand for low power consumption in these devices, more and more of them are adopting an MCU (Microcontroller Unit) + SPI (Serial Peripheral Interface) panel display method. However, because the MCU platform is generally single-core and has low performance, this method results in long GUI (Graphical User Interface) rendering time, which in turn leads to long SPI transmission time. This results in technical problems such as large amounts of image data to be transmitted and low screen display frame rates. Summary of the Invention

[0003] The main objective of this invention is to provide an image refresh method, an image refresh device, an image refresh equipment, and a computer storage medium, aiming to solve the technical problems of large image data transmission volume and low screen display frame rate in the prior art.

[0004] To achieve the above objectives, the present invention provides an image refresh method, comprising the following steps:

[0005] Determine the area of ​​the image to be refreshed in the display interface and the valid coordinates of the area of ​​the image to be refreshed in the display interface;

[0006] Obtain valid image data corresponding to the area defined by the valid coordinates in the display interface;

[0007] The current frame image in the display interface is refreshed based on the valid image data to obtain the next frame image.

[0008] Further, the step of determining the area of ​​the image to be refreshed in the display interface includes:

[0009] Before rendering the next frame image, determine the area of ​​the image to be refreshed;

[0010] Alternatively, before rendering the next frame image, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed in the image is determined by comparing the current frame image and the next frame image.

[0011] Further, the step of determining the effective coordinates of the image to be refreshed area in the display interface includes:

[0012] The coordinates of the row boundary of the area to be refreshed in the image are determined as the valid coordinates;

[0013] Alternatively, the coordinates of the column boundary of the image to be refreshed area can be determined as the valid coordinates;

[0014] Alternatively, the coordinates of the row and column boundaries of the area to be refreshed in the image can be determined as the valid coordinates.

[0015] Further, the step of determining the valid coordinates of the area to be refreshed in the image includes:

[0016] Determine the area ratio between the image area to be refreshed and the area where the row boundary of the image area to be refreshed is located, as well as the pixel count ratio in the row direction;

[0017] The effective coordinates of the area to be refreshed in the image are determined based on the area ratio and the pixel count ratio.

[0018] Further, the step of determining the effective coordinates of the image to be refreshed region based on the area ratio and the pixel count ratio includes:

[0019] When the area ratio is greater than the preset area ratio value, the effective coordinates are determined to be the coordinates of the row boundary of the image to be refreshed area;

[0020] When the area ratio is not greater than a preset area ratio and the pixel number ratio is greater than a preset number ratio, the effective coordinates are determined to be the coordinates of the column boundary of the image to be refreshed area;

[0021] When the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, the effective coordinates are determined to be the coordinates of the row and column boundaries of the image area to be refreshed.

[0022] Furthermore, the image refresh method further includes:

[0023] Determine the current remaining computing power and the current refresh rate of the display interface;

[0024] When the current remaining computing power is less than the preset lower limit computing power and the current refresh frame rate is greater than the preset lower limit frame rate, the current refresh frame rate is reduced to refresh the image.

[0025] Furthermore, the step of reducing the current refresh frame rate to refresh the image includes:

[0026] Determine the frame rate difference between the current refresh frame rate and the preset lower limit frame rate;

[0027] Image frames corresponding to the frame rate difference are extracted at uniform intervals;

[0028] Alternatively, determine the computing power difference between the current remaining computing power and the preset lower limit computing power, and extract image frames corresponding to the computing power difference at uniform intervals.

[0029] Furthermore, to achieve the above objectives, the present invention also provides an image refresh device, the device comprising:

[0030] The determination module is used to determine the area of ​​the image to be refreshed in the display interface and the effective coordinates of the area of ​​the image to be refreshed in the display interface.

[0031] The acquisition module is used to acquire valid image data corresponding to the area defined by the valid coordinates in the display interface;

[0032] The refresh module is used to refresh the current frame image in the display interface based on the valid image data to obtain the next frame image.

[0033] In addition, to achieve the above objectives, the present invention also provides an image refresh device, the image refresh device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the image refresh method as described in any of the preceding claims.

[0034] In addition, to achieve the above objectives, the present invention also provides a computer storage medium storing a computer program, which, when executed by a processor, implements the steps of the image refresh method as described in any of the preceding claims.

[0035] The image refresh method, image refresh device, image refresh equipment, and computer storage medium proposed in this invention determine the image area to be refreshed in the display interface and the effective coordinates of the image area to be refreshed in the display interface; obtain the effective image data corresponding to the area determined by the effective coordinates in the display interface; refresh the current frame image in the display interface based on the effective image data to obtain the next frame image.

[0036] In the application, when the GUI library is rendering an image, it saves the coordinates of the area to be refreshed in the rendered image; when transmitting data from the MCU to the panel, it obtains the valid coordinates of the area to be refreshed in the rendered image of this frame; based on the valid coordinates, it selects the valid image data to be transmitted in a frame and transmits it, thereby refreshing the current frame image to obtain the next frame image.

[0037] The application proposes a segmented screen refresh method for image refresh. By optimizing the amount of data pushed from the MCU to the panel screen, only the effective image data corresponding to the area to be refreshed is transmitted, without transmitting the entire frame of image data. This reduces the amount of data sent (the amount of data transmitted via SPI), shortens the data transmission time, and thus improves the display frame rate and reduces power consumption. Attached Figure Description

[0038] Figure 1 This is a schematic diagram of the hardware operation of the terminal device involved in the embodiment of the present invention;

[0039] Figure 2 This is a flowchart illustrating an embodiment of an image refresh method according to the present invention;

[0040] Figure 3 This is a diagram illustrating image refresh.

[0041] Figure 4 This is a schematic diagram of the area to be refreshed in a traditional image;

[0042] Figure 5 This is a schematic diagram of the image area to be refreshed according to an embodiment of an image refresh method of the present invention;

[0043] Figure 6 This is a schematic diagram of an image refresh device according to the present invention.

[0044] The objectives, features, and advantages of this invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0045] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0046] like Figure 1 As shown, Figure 1 This is a schematic diagram of the hardware operating environment of the terminal device involved in the embodiment of the present invention.

[0047] It should be noted that, Figure 1 This can be a structural diagram of the hardware operating environment of the terminal device. In this embodiment of the invention, the terminal device can be a storage device based on NAND flash as the storage medium, executing the image refresh method provided by this invention. Specifically, the terminal device can be a mobile terminal, a data storage control terminal, a PC, or a portable computer, etc.

[0048] like Figure 1As shown, the terminal device may include: a processor 1001, such as a CPU; a network interface 1004; a user interface 1003; a storage device 1005; and a communication bus 1002. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and an input unit such as a keyboard. Optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The storage device 1005 may be a non-volatile storage device (such as a Flash memory device), a high-speed RAM storage device, or a stable storage device (non-volatile memory), such as a disk storage device. Optionally, the storage device 1005 may also be a storage device independent of the aforementioned processor 1001.

[0049] Those skilled in the art will understand that Figure 1 The terminal device structure shown does not constitute a limitation on the terminal device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0050] like Figure 1 As shown, the storage device 1005, which serves as a computer storage medium, may include an operating system, a network communication module, a user interface module, and computer programs. The operating system is a program that manages and controls the hardware and software resources of the sample terminal device, supporting the operation of computer programs and other software or programs.

[0051] exist Figure 1 In the terminal device shown, the user interface 1003 is mainly used for data communication with various terminals; the network interface 1004 is mainly used for connecting to the backend server and communicating with the backend server; and the processor 1001 can be used to call the computer program stored in the storage device 1005 and perform the following operations:

[0052] Determine the area of ​​the image to be refreshed in the display interface and the valid coordinates of the area of ​​the image to be refreshed in the display interface;

[0053] Obtain valid image data corresponding to the area defined by the valid coordinates in the display interface;

[0054] The current frame image in the display interface is refreshed based on the valid image data to obtain the next frame image.

[0055] Furthermore, the processor 1001 can call computer programs stored in the storage device 1005 and also perform the following operations:

[0056] The step of determining the area of ​​the image to be refreshed in the display interface includes:

[0057] Before rendering the next frame image, determine the area of ​​the image to be refreshed;

[0058] Alternatively, before rendering the next frame image, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed in the image is determined by comparing the current frame image and the next frame image.

[0059] Further, the step of determining the effective coordinates of the image to be refreshed area in the display interface includes:

[0060] The coordinates of the row boundary of the area to be refreshed in the image are determined as the valid coordinates;

[0061] Alternatively, the coordinates of the column boundary of the image to be refreshed area can be determined as the valid coordinates;

[0062] Alternatively, the coordinates of the row and column boundaries of the area to be refreshed in the image can be determined as the valid coordinates.

[0063] Furthermore, the processor 1001 can call computer programs stored in the storage device 1005 and also perform the following operations:

[0064] The step of determining the valid coordinates of the area to be refreshed in the image includes:

[0065] Determine the area ratio between the image area to be refreshed and the area where the row boundary of the image area to be refreshed is located, as well as the pixel count ratio in the row direction;

[0066] The effective coordinates of the area to be refreshed in the image are determined based on the area ratio and the pixel count ratio.

[0067] Furthermore, the processor 1001 can call computer programs stored in the storage device 1005 and also perform the following operations:

[0068] The step of determining the effective coordinates of the image to be refreshed region based on the area ratio and the pixel number ratio includes:

[0069] When the area ratio is greater than the preset area ratio value, the effective coordinates are determined to be the coordinates of the row boundary of the image to be refreshed area;

[0070] When the area ratio is not greater than a preset area ratio and the pixel number ratio is greater than a preset number ratio, the effective coordinates are determined to be the coordinates of the column boundary of the image to be refreshed area;

[0071] When the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, the effective coordinates are determined to be the coordinates of the row and column boundaries of the image area to be refreshed.

[0072] Furthermore, the processor 1001 can call computer programs stored in the storage device 1005 and also perform the following operations:

[0073] The image refresh method further includes:

[0074] Determine the current remaining computing power and the current refresh rate of the display interface;

[0075] When the current remaining computing power is less than the preset lower limit computing power and the current refresh frame rate is greater than the preset lower limit frame rate, the current refresh frame rate is reduced to refresh the image.

[0076] Furthermore, the processor 1001 can call computer programs stored in the storage device 1005 and also perform the following operations:

[0077] The step of reducing the current refresh frame rate to refresh the image includes:

[0078] Determine the frame rate difference between the current refresh frame rate and the preset lower limit frame rate;

[0079] Image frames corresponding to the frame rate difference are extracted at uniform intervals;

[0080] Alternatively, determine the computing power difference between the current remaining computing power and the preset lower limit computing power, and extract image frames corresponding to the computing power difference at uniform intervals.

[0081] Please refer to Figure 2 , Figure 2 This is a flowchart illustrating an embodiment of the image refresh method of the present invention.

[0082] In this embodiment, the image refresh method of the present invention includes:

[0083] Step S10: Determine the area of ​​the image to be refreshed in the display interface and the effective coordinates of the area of ​​the image to be refreshed in the display interface.

[0084] Step S20: Obtain the valid image data corresponding to the area defined by the valid coordinates in the display interface.

[0085] Step S30: Refresh the current frame image in the display interface based on the valid image data to obtain the next frame image.

[0086] Reference Figure 3 , Figure 3This is a diagram illustrating image refresh. Traditional frame transmission methods require transmitting the entire frame buffer to the panel, such as... Figure 4 As shown, this is a significant burden for a single-core MCU. Because the MCU platform typically has only one core and low performance, this traditional image refresh method results in long GUI (Graphical User Interface) rendering times and long SPI transmission times, leading to technical problems such as large amounts of image data to be transmitted and low screen display frame rates.

[0087] Reference Figure 5 , Figure 5 This is a schematic diagram of the image area to be refreshed according to an embodiment of an image refresh method of the present invention. In this embodiment, when the GUI library performs image rendering, it saves the coordinates of the rendered image area to be refreshed; when transmitting data from the MCU to the panel, it obtains the valid coordinates of the image area to be refreshed in this frame; based on the valid coordinates, it selects the valid image data to be transmitted in a frame and transmits it, thereby refreshing the current frame image to obtain the next frame image.

[0088] In this embodiment, a segmented screen refresh method is proposed. By optimizing the amount of data pushed from the MCU to the panel screen, only the effective image data corresponding to the area to be refreshed is transmitted, without transmitting the entire frame of image data. This reduces the amount of data sent (the amount of data transmitted via SPI), shortens the data transmission time, and thus improves the display frame rate and reduces power consumption.

[0089] Optionally, the step of determining the area of ​​the image to be refreshed in the display interface includes:

[0090] Before rendering the next frame image, determine the area of ​​the image to be refreshed;

[0091] Alternatively, before rendering the next frame image, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed in the image is determined by comparing the current frame image and the next frame image.

[0092] In this embodiment, the area to be refreshed in the image can be determined when the GUI library renders the next frame image, or it can be determined by comparing the current frame image and the next frame image to be rendered after aligning the pixels of the current frame image and the next frame image to be rendered, and determining the difference area between the two frames as the area to be refreshed in the image.

[0093] Optionally, the step of determining the valid coordinates of the image to be refreshed area in the display interface includes:

[0094] The coordinates of the row boundary of the area to be refreshed in the image are determined as the valid coordinates;

[0095] Alternatively, the coordinates of the column boundary of the image to be refreshed area can be determined as the valid coordinates;

[0096] Alternatively, the coordinates of the row and column boundaries of the area to be refreshed in the image can be determined as the valid coordinates.

[0097] Reference Figure 5 The image update area is Figure 5 The effective coordinates for determining the area to be refreshed in the image, where the "smiley face" is located, can be either the column coordinates of the "smiley face" area or the coordinates of the area defined by the boundary coordinates of the "smiley face" area. While both of these methods are complex and impractical, in practical applications, it is preferable to determine the effective coordinates of the area to be refreshed as follows: Figure 5 The coordinates of the row where the "smiley face" is located are shown.

[0098] In another embodiment of the image refresh method of the present invention, the step of determining the effective coordinates of the image to be refreshed area includes:

[0099] Determine the area ratio between the image area to be refreshed and the area where the row boundary of the image area to be refreshed is located, as well as the pixel count ratio in the row direction;

[0100] The effective coordinates of the area to be refreshed in the image are determined based on the area ratio and the pixel count ratio.

[0101] In this embodiment, when determining the valid coordinates of the area to be refreshed in an image, the valid coordinates are determined based on the area and width of the area to be refreshed. The area to be refreshed is determined as follows: Figure 5 After determining the area where the "smiley face" is located, the coordinates of the row boundary and column boundary of the image area to be refreshed are determined. Then, the area ratio and the pixel count ratio in the row direction of the image area to be refreshed are determined. Specifically, in this embodiment, the area ratio refers to... Figure 5 The ratio of the area of ​​the "smiley face" region to the area of ​​its row boundary region, as shown, refers to the pixel count ratio. Figure 5 The ratio of the number of pixels at the column boundary of the region where the "smiley face" is located to the number of pixels in the entire row boundary region.

[0102] Optionally, the step of determining the effective coordinates of the image to be refreshed region based on the area ratio and the pixel count ratio includes:

[0103] When the area ratio is greater than the preset area ratio value, the effective coordinates are determined to be the coordinates of the row boundary of the image to be refreshed area;

[0104] When the area ratio is not greater than a preset area ratio and the pixel number ratio is greater than a preset number ratio, the effective coordinates are determined to be the coordinates of the column boundary of the image to be refreshed area;

[0105] When the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, the effective coordinates are determined to be the coordinates of the row and column boundaries of the image area to be refreshed.

[0106] When the area ratio is greater than the preset area ratio, it means that the area of ​​the image to be refreshed is close to the area of ​​the row boundary. At this time, by transmitting the image data of the entire row boundary area, the effective coordinates are determined to be the coordinates of the row boundary of the image to be refreshed area.

[0107] When the area ratio is not greater than the preset area ratio and the pixel number ratio is greater than the preset number ratio, it means that the area of ​​the image to be refreshed is small. Therefore, it is not necessary to transmit the image data of the entire row boundary area. Only the image data of the column boundary area of ​​the image to be refreshed area needs to be transmitted. So the effective coordinates are determined to be the coordinates of the column boundary of the image to be refreshed area.

[0108] When the area ratio is not greater than the preset area ratio and the pixel number ratio is not greater than the preset number ratio, it means that the area of ​​the image to be refreshed can be ignored. The outer region defined by the row and column boundaries of the image to be refreshed can be directly transmitted. Therefore, the effective coordinates are the coordinates of the row and column boundaries of the image to be refreshed.

[0109] In this embodiment, when the area to be refreshed is large and wide in the row direction, the screen is refreshed by transmitting the image data of the entire row boundary area in the simplest way. When the area to be refreshed is small and narrow in the row direction, the image data of the intersection area of ​​the row and column boundaries is transmitted directly to refresh the screen with the minimum data transmission amount. In the image area to be refreshed in between, the image data of the column area is transmitted as a compromise for screen refresh. This better matches and balances the relationship between the amount of image data transmitted and the size and width of the image area to be refreshed, transmitting a larger amount of data with less power consumption.

[0110] In another embodiment of the image refresh method of the present invention, before the step of determining the effective coordinates of the image to be refreshed area in the display interface, the method further includes:

[0111] The operation commands that trigger image refresh are classified, and the refresh frame rate corresponding to each operation command is determined.

[0112] The step of determining the valid coordinates of the area to be refreshed in the image includes:

[0113] Determine the current operation command that triggers image refresh and the current refresh frame rate corresponding to the current operation command;

[0114] The effective coordinates of the area of ​​the image to be refreshed are determined based on the current refresh frame rate.

[0115] Based on the varying degrees of difficulty in refreshing images with different effective coordinates in the above embodiments, in this embodiment, the effective coordinates of the area to be refreshed in the image can be determined according to the type of different operation commands that trigger image refresh.

[0116] Before determining the valid coordinates of the area to be refreshed in the image, the operation commands that trigger image refresh are categorized, such as swipe operations and click operations, or categorized according to the refresh screen and refresh action corresponding to the operation command, such as page turning operations and play / pause operations. Then, the refresh frame rate corresponding to each operation command is determined based on the type of operation command. For example, the refresh frame rate for swipe operations is 45 fps (Frames Per Second), the refresh frame rate for click operations is 30 fps, and the refresh frame rate for play operations is 60 fps. Different operation commands correspond to different refresh frame rates.

[0117] When determining the valid coordinates of the area to be refreshed in an image, the operation command that triggers the image refresh is first determined. Then, the corresponding refresh frame rate is determined according to the type of operation command. Finally, the valid coordinates of the area to be refreshed in the image are determined based on the corresponding refresh frame rate. Different refresh frame rates correspond to different valid coordinates of the same area to be refreshed in the image.

[0118] Optionally, the step of determining the effective coordinates of the image to be refreshed area based on the current refresh frame rate includes:

[0119] When the current refresh frame rate is within a preset first frame rate range, the effective coordinates of the image to be refreshed area are determined to be the coordinates of the row boundary of the image to be refreshed area.

[0120] When the current refresh frame rate is within a preset second frame rate range, the effective coordinates of the image to be refreshed area are determined to be the coordinates of the column boundary of the image to be refreshed area.

[0121] When the current refresh frame rate is within a preset third frame rate range, the effective coordinates of the image to be refreshed area are determined to be the coordinates of the row boundary and column boundary of the image to be refreshed area;

[0122] Wherein, the minimum value of the preset first frame rate interval is greater than the maximum value of the preset second frame rate interval, and the minimum value of the preset second frame rate interval is greater than the maximum value of the preset third frame rate interval.

[0123] When determining different valid coordinates of the same image's refresh area based on the refresh frame rate corresponding to the operation command, if the refresh frame rate is in the largest preset first frame rate range, then the image needs to be refreshed at the largest refresh frame rate. In this case, the valid coordinates of the image's refresh area are determined as the row coordinates of the image's refresh area, using the simplest and easiest-to-implement valid coordinates for image refresh. If the refresh frame rate is in the second largest preset second frame rate range, then the image needs to be refreshed at the second largest refresh frame rate. In this case, the valid coordinates of the image's refresh area are determined as the column coordinates of the image's refresh area. If the refresh frame rate is in the smallest preset third frame rate range, then only the smallest refresh frame rate is needed for image refresh. In this case, the valid coordinates of the image's refresh area are determined as the area coordinates defined by the boundary coordinates of the image's refresh area.

[0124] In another embodiment of the image refresh method of the present invention, the image refresh method further includes:

[0125] Determine the current remaining computing power and the current refresh rate of the display interface;

[0126] When the current remaining computing power is less than the preset lower limit computing power and the current refresh frame rate is greater than the preset lower limit frame rate, the current refresh frame rate is reduced to refresh the image.

[0127] When refreshing an image, based on the above embodiments, the amount of data pushed by the MCU to the panel screen can be reduced by determining the effective coordinates of the area to be refreshed. Only the effective image data corresponding to the area to be refreshed is transmitted, so that the entire frame of image data does not need to be transmitted, thereby improving the display frame rate and reducing power consumption.

[0128] In this embodiment, a method is proposed to appropriately reduce the current refresh rate under high load and high power consumption conditions. This ensures that while reducing the refresh rate corresponding to the operation command, the user's viewing experience is not affected, and power consumption is reduced simultaneously. When the remaining computing power is less than a preset lower limit, it indicates that the operation is under high load and high power consumption. If the current refresh rate is greater than the preset lower limit, the current refresh rate is reduced. The preset lower limit can be a frame rate that does not affect the user's viewing experience, such as 24 FPS corresponding to the persistence of vision principle, or other preset lower limit frame rates corresponding to operation commands that do not affect the user's viewing experience.

[0129] Optionally, the step of reducing the current refresh frame rate to refresh the image includes:

[0130] Determine the frame rate difference between the current refresh frame rate and the preset lower limit frame rate;

[0131] Image frames corresponding to the frame rate difference are extracted at uniform intervals;

[0132] Alternatively, determine the computing power difference between the current remaining computing power and the preset lower limit computing power, and extract image frames corresponding to the computing power difference at uniform intervals.

[0133] In this embodiment, the current refresh frame rate can be reduced by uniformly extracting image frames corresponding to the frame rate difference or computing power difference based on the frame rate difference between the current refresh frame rate and the preset lower limit frame rate, or based on the computing power difference between the current remaining computing power and the preset lower limit computing power.

[0134] In one embodiment, the current refresh rate is 30 FPS, the preset lower limit is 24 FPS, and it is determined that the remaining computing power is less than the preset lower limit. Therefore, the current refresh rate is reduced to 24 FPS for image refresh by uniformly sampling frame rate differences of 6 FPS. In the most extreme and ideal case, where the current refresh rate is 30 frames per second, the current refresh rate is reduced to 24 frames per second by uniformly sampling 6 frames per second.

[0135] In addition, refer to Figure 6 This invention also provides an image refresh device, the device comprising:

[0136] The determination module C1 is used to determine the area of ​​the image to be refreshed in the display interface and the effective coordinates of the area of ​​the image to be refreshed in the display interface.

[0137] The acquisition module C2 is used to acquire the valid image data corresponding to the area defined by the valid coordinates in the display interface;

[0138] The refresh module C3 is used to refresh the current frame image in the display interface based on the valid image data to obtain the next frame image.

[0139] Optionally, the determining module is further configured to:

[0140] Before rendering the next frame image, determine the area of ​​the image to be refreshed;

[0141] Alternatively, before rendering the next frame image, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed in the image is determined by comparing the current frame image and the next frame image.

[0142] Optionally, the determining module is further configured to:

[0143] The coordinates of the row boundary of the area to be refreshed in the image are determined as the valid coordinates;

[0144] Alternatively, the coordinates of the column boundary of the image to be refreshed area can be determined as the valid coordinates;

[0145] Alternatively, the coordinates of the row and column boundaries of the area to be refreshed in the image can be determined as the valid coordinates.

[0146] Optionally, the image refreshing device further includes:

[0147] The classification module is used to determine the area of ​​the image to be refreshed before the valid coordinates in the display interface.

[0148] The operation commands that trigger image refresh are classified, and the refresh frame rate corresponding to each operation command is determined.

[0149] Optionally, the determining module is further configured to:

[0150] Determine the area ratio between the image area to be refreshed and the area where the row boundary of the image area to be refreshed is located, as well as the pixel count ratio in the row direction;

[0151] The effective coordinates of the area to be refreshed in the image are determined based on the area ratio and the pixel count ratio.

[0152] Optionally, the determining module is further configured to:

[0153] When the area ratio is greater than the preset area ratio value, the effective coordinates are determined to be the coordinates of the row boundary of the image to be refreshed area;

[0154] When the area ratio is not greater than a preset area ratio and the pixel number ratio is greater than a preset number ratio, the effective coordinates are determined to be the coordinates of the column boundary of the image to be refreshed area;

[0155] When the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, the effective coordinates are determined to be the coordinates of the row and column boundaries of the image area to be refreshed.

[0156] Optionally, the image refreshing device further includes:

[0157] The reduction module is used to determine the current remaining computing power and the current refresh frame rate of the display interface;

[0158] When the current remaining computing power is less than the preset lower limit computing power and the current refresh frame rate is greater than the preset lower limit frame rate, the current refresh frame rate is reduced to refresh the image.

[0159] Optionally, the reduction module is further configured to:

[0160] Determine the frame rate difference between the current refresh frame rate and the preset lower limit frame rate;

[0161] Image frames corresponding to the frame rate difference are extracted at uniform intervals;

[0162] Alternatively, determine the computing power difference between the current remaining computing power and the preset lower limit computing power, and extract image frames corresponding to the computing power difference at uniform intervals.

[0163] The image refresh device provided by this invention employs the image refresh method described in the above embodiments, solving the technical problems of large image data transmission volume and low screen display frame rate in the prior art. Compared with the prior art, the beneficial effects of the image refresh device provided by the embodiments of this invention are the same as those of the image refresh method provided in the above embodiments, and other technical features in this image refresh device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0164] Furthermore, embodiments of the present invention also propose an image refresh device, the image refresh device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the image refresh method as described in any of the preceding claims.

[0165] Furthermore, embodiments of the present invention also propose a computer storage medium, characterized in that the computer storage medium stores a computer program, which, when executed by a processor, implements the steps of the image refresh method as described in any of the preceding claims.

[0166] The steps implemented when the computer program running on the processor is executed can be referred to in various embodiments of the image refresh method of the present invention, and will not be repeated here.

[0167] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0168] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0169] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a computer storage medium (such as a Flash storage device, ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a controller in a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to control the data read and write operations of the storage medium to execute the methods described in the various embodiments of the present invention.

[0170] The above are merely preferred embodiments of the present invention and do not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. An image refresh method, characterized in that, The image refresh method includes the following steps: The method determines the area of ​​the image to be refreshed in the display interface and its valid coordinates within the display interface. Specifically, it determines the area ratio between the area to be refreshed and the area containing the row boundary of the area to be refreshed, as well as the pixel ratio in the row direction. The pixel ratio refers to the ratio of the number of pixels at the column boundary of the area to be refreshed to the number of pixels in the entire row boundary area. When the area ratio is greater than a preset area ratio value, the valid coordinates are determined to be the coordinates of the row boundary of the area to be refreshed. When the area ratio is not greater than the preset area ratio value and the pixel ratio is greater than a preset number ratio value, the valid coordinates are determined to be the coordinates of the column boundary of the area to be refreshed. When the area ratio is not greater than the preset area ratio value and the pixel ratio is not greater than the preset number ratio value, the valid coordinates are determined to be the coordinates of both the row boundary and the column boundary of the area to be refreshed. Obtain valid image data corresponding to the area defined by the valid coordinates in the display interface; The current frame image in the display interface is refreshed based on the valid image data to obtain the next frame image.

2. The image refresh method as described in claim 1, characterized in that, The step of determining the area of ​​the image to be refreshed in the display interface includes: Before rendering the next frame image, determine the area of ​​the image to be refreshed; Alternatively, before rendering the next frame image, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed in the image is determined by comparing the current frame image and the next frame image.

3. The image refresh method as described in claim 1, characterized in that, The image refresh method further includes: Determine the current remaining computing power and the current refresh rate of the display interface; When the current remaining computing power is less than the preset lower limit computing power and the current refresh frame rate is greater than the preset lower limit frame rate, the current refresh frame rate is reduced to refresh the image.

4. The image refresh method as described in claim 3, characterized in that, The step of reducing the current refresh frame rate to refresh the image includes: Determine the frame rate difference between the current refresh frame rate and the preset lower limit frame rate; Image frames corresponding to the frame rate difference are extracted at uniform intervals; Alternatively, determine the computing power difference between the current remaining computing power and the preset lower limit computing power, and extract image frames corresponding to the computing power difference at uniform intervals.

5. An image refresh device, characterized in that, The device includes: A determining module is used to determine the area of ​​an image to be refreshed in the display interface and the effective coordinates of the area of ​​the image to be refreshed in the display interface; wherein, it determines the area ratio between the area of ​​the image to be refreshed and the area where the row boundary of the image to be refreshed is located, and the pixel count ratio in the row direction, wherein the pixel count ratio refers to the ratio of the number of pixels at the column boundary of the image to be refreshed to the number of pixels in the entire row boundary area; when the area ratio is greater than a preset area ratio value, the effective coordinates are determined to be the coordinates of the row boundary of the image to be refreshed; when the area ratio is not greater than a preset area ratio value and the pixel count ratio is greater than a preset count ratio value, the effective coordinates are determined to be the coordinates of the column boundary of the image to be refreshed; when the area ratio is not greater than a preset area ratio value and the pixel count ratio is not greater than a preset count ratio value, the effective coordinates are determined to be the coordinates of both the row boundary and the column boundary of the image to be refreshed. The acquisition module is used to acquire valid image data corresponding to the area defined by the valid coordinates in the display interface; The refresh module is used to refresh the current frame image in the display interface based on the valid image data to obtain the next frame image.

6. An image refresh device, characterized in that, The image refresh device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the image refresh method as described in any one of claims 1 to 4.

7. A computer storage medium, characterized in that, The computer storage medium stores a computer program, which, when executed by a processor, implements the steps of the image refresh method as described in any one of claims 1 to 4.

Images