Image processing methods, apparatus and electronic equipment

Abstract

This invention discloses an image processing method, apparatus, and electronic device. The image processing method includes: receiving multiple frames of first-part images and multiple frames of second-part images, wherein the first-part images are images of mouse cursors in a display frame, and the second-part images are images in a display frame excluding the first-part images; acquiring the position information of the mouse cursor in each display frame; determining whether the second-part image of the current frame is the same as the second-part image of the previous frame, obtaining a first determination result, and determining whether the position information of the mouse cursor corresponding to the second-part image of the current frame is the same as the position information of the mouse cursor corresponding to the second-part image of the previous frame, obtaining a second determination result; and, if the first determination result indicates yes and the second determination result indicates yes or no, generating a target display frame based on target image information, without generating a trigger signal to trigger the processor to update the display frame.

Description

Technical Field

[0001] This invention relates to the field of display technology, and more specifically, to an image processing method, apparatus, and electronic device. Background Technology

[0002] Panel Self-Refresh (PSR) is a power-saving mode that stores the entire frame of a static image when it is detected at the DisplayPort (DP) interface source. When the image is not updated, the TCON chip automatically displays this frame, and the graphics card stops sending video data. This significantly reduces the power consumption of the processor and other components when displaying static images, thus greatly increasing battery life in portable environments. Building on this, Panel Self-Refresh-2 (PSR2) technology with regional refresh capabilities further extends power saving to scenarios where only a portion of the image changes. It functions similarly to PSR for static images; however, when there is a partial update, the graphics card only sends the changed video data. Compared to PSR, PSR2 reduces the processing time for the graphics processor, further lowering system power consumption and achieving even greater power savings. This feature of PSR2 is called Partial Update.

[0003] However, for products that already use PSR technology, the entire screen is updated as soon as there is a slight change in the image, which only saves power when displaying static images. For products that already use PSR2 technology, the screen updates only as many lines as there is a change in the image, which can further reduce power consumption compared to PSR. However, in reality, in situations other than games and videos with large dynamics, such as relatively static images in office work, the screen will still be updated in multiple lines due to constant mouse movement, which will cause the processor to consume power due to the action. Summary of the Invention

[0004] The main objective of this invention is to provide an image processing method, apparatus, and electronic device to solve the problem of high power consumption in the prior art for processors used to control displays for image display, which are frequently in operation.

[0005] To achieve the above objectives, according to one aspect of the present invention, an image processing method is provided, comprising: receiving multiple frames of first partial images and multiple frames of second partial images, wherein the first partial images and the second partial images correspond one-to-one, and the first partial image is an image of a mouse cursor in a frame of display, and the second partial image is an image in a frame of display excluding the first partial image; acquiring the position information of the mouse cursor in each frame of display; determining whether the second partial image of the current frame is the same as the second partial image of the previous frame, obtaining a first determination result, and determining whether the position information of the mouse cursor corresponding to the second partial image of the current frame is the same as the position information of the mouse cursor corresponding to the second partial image of the previous frame, obtaining a second determination result; if the first determination result indicates yes and the second determination result indicates yes or no, generating a target display screen according to target image information, without generating a trigger signal to trigger the processor to update the display screen, and if the first determination result indicates no and the second determination result indicates yes or no, generating a trigger signal, wherein the target image information includes at least: display data of the second partial image of the current frame, display data of the first partial image corresponding to the second partial image of the current frame, and position information of the mouse cursor corresponding to the second partial image of the current frame.

[0006] Optionally, receiving multiple frames of the first part image and multiple frames of the second part image includes: receiving multiple frames of the first part image through a first data channel and receiving multiple frames of the second part image through a second data channel.

[0007] Optionally, acquiring multiple mouse position information corresponding to multiple frames of the second part image includes: determining the first horizontal edge and the first vertical edge of the target second part image, and determining the first intersection point where the first horizontal edge and the first vertical edge meet; establishing an image coordinate system corresponding to the target second part image with the first intersection point as the origin, the first horizontal edge as the x-coordinate, and the first vertical edge as the y-coordinate; and determining the mouse coordinates corresponding to the target second part image based on the image coordinate system, wherein the mouse coordinates are used to represent the mouse position information corresponding to the target second part image.

[0008] Optionally, the above image processing method further includes: determining whether the first part of the image in the current frame is the same as the first part of the image in the previous frame, and obtaining a third determination result; if the first determination result indicates yes, the second determination result indicates yes or no, and the third determination result indicates no, generating a target display screen based on the target image information, without generating a trigger signal, wherein the target image information also includes the display information of the first part of the image in the current frame.

[0009] Optionally, the above image processing method further includes: sending the target display image to a buffer, wherein the buffer is used to send the target display image to a display for display.

[0010] Optionally, determining whether the second part of the current frame image is the same as the second part of the previous frame image and outputting a first determination result includes: determining whether the first target data row in the display data of the second part of the current frame image is the same as the second target data row in the display data of the second part of the previous frame image and outputting a first determination result, wherein the display data of the second part of each frame image is displayed on the display line by line, the first target data row is any row of display data in the display data of the second part of the current frame image, the second target data row is the display data in the display data of the second part of the previous frame image that is in the same row as the first target data row, and the display data of the second part of the previous frame image is stored in the buffer area.

[0011] Optionally, the above image processing method further includes: if the first judgment result indicates no, sending the second target data line and the trigger signal to the processor, wherein the processor stores the display data of the second part of the previous frame image, and the processor is used to convert the second target data line into an analog signal after receiving the trigger signal, and send the analog signal corresponding to the second target data to the display for display.

[0012] According to another aspect of the present invention, an image processing apparatus is also provided, comprising: a receiving module, configured to receive multiple frames of first partial images and multiple frames of second partial images, wherein the first partial images and the second partial images correspond one-to-one, and the first partial image is an image of a mouse cursor in a frame of a display screen, and the second partial image is an image in a frame of a display screen excluding the first partial image; an acquiring module, configured to acquire position information of the mouse cursor in each frame of the display screen; and a judging module, configured to judge whether the second partial image of the current frame is the same as the second partial image of the previous frame, obtain a first judging result, and judge the position information of the mouse cursor corresponding to the second partial image of the current frame. The second judgment result is obtained by determining whether the position information of the mouse cursor corresponding to the second part of the image in the previous frame is the same. The generation module is used to generate a target display screen according to the target image information when the first judgment result indicates yes and the second judgment result indicates yes or no, and not to generate a trigger signal to trigger the processor to update the display screen. When the first judgment result indicates no and the second judgment result indicates yes or no, a trigger signal is generated. The target image information includes at least: the display data of the second part of the image in the current frame, the display data of the first part of the image corresponding to the second part of the image in the current frame, and the position information of the mouse cursor corresponding to the second part of the image in the current frame.

[0013] According to another aspect of the present invention, an electronic device is also provided, comprising: a processor; a memory for storing processor-executable instructions; and a display communicating with the processor; wherein the processor is configured to execute instructions, and the processor includes: a timing control chip for executing the above-described image processing method to generate a target display image; a driver chip communicating with the timing control chip for converting the target display image into an analog signal and sending the analog signal corresponding to the target display image to the display for display; and the display communicating with the driver chip for displaying the target display image.

[0014] According to another aspect of the present invention, a computer-readable storage medium is also provided, which, when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the image processing method described above.

[0015] Applying the technical solution of this invention, an image processing method is provided. This method first receives multiple frames of first-part images and multiple frames of second-part images, with a one-to-one correspondence between the first-part images and the second-part images. The first-part image is the image of the mouse cursor in a displayed frame, and the second-part image is the image in a displayed frame excluding the first-part image. Then, the position information of the mouse cursor in each displayed frame is obtained, and it is determined whether the second-part image of the current frame is the same as the second-part image of the previous frame, obtaining a first determination result. Furthermore, it is determined whether the position information of the mouse cursor corresponding to the second-part image of the current frame is the same as the position information of the mouse cursor corresponding to the second-part image of the previous frame, obtaining a second determination result. Since the above method only generates images when the first determination result indicates no and the second determination result indicates yes or no... The method generates a trigger signal, thereby updating the image through the processor. When the first judgment result indicates yes and the second judgment result indicates yes or no, the above method can generate a target display screen based on the target image information without generating a trigger signal to trigger the processor to update the display screen. The target image information includes at least the display information of the second part of the current frame image, the display information of the first part of the image corresponding to the second part of the current frame image, and the position information of the mouse cursor corresponding to the second part of the current frame image. Thus, when the cursor moves in the display screen and the screen other than the cursor is static, power consumption can be further reduced by not triggering the processor action. This avoids the power consumption caused by frequent exits of panel self-refresh (PSR or PSR2) technology due to frequent movement of the mouse cursor under daily office conditions. Attached Figure Description

[0016] The accompanying drawings, which form part of this specification, are used to provide a further understanding of the invention. The illustrative embodiments of the invention and their descriptions are used to explain the invention and do not constitute an undue limitation of the invention. In the drawings:

[0017] Figure 1 This is a flowchart illustrating an image processing method according to Embodiment 1 of the present invention;

[0018] Figure 2 This is a flowchart illustrating image processing via a TCON chip according to Embodiment 1 of the present invention;

[0019] Figure 3 This is a flowchart illustrating another image processing method using a TCON chip according to Embodiment 1 of the present invention;

[0020] Figure 4 This is a block diagram of an image processing apparatus according to Embodiment 2 of the present invention;

[0021] Figure 5 This is a device block diagram of a terminal according to an embodiment of the present invention. Detailed Implementation

[0022] It should be noted that, unless otherwise specified, the embodiments and features described in the present invention can be combined with each other. The present invention will now be described in detail with reference to the accompanying drawings and embodiments.

[0023] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0024] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of the invention described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0025] Example 1

[0026] According to an embodiment of the present invention, an embodiment of an image processing method is provided. Figure 1 This is a flowchart of the image processing method according to Embodiment 1 of the present invention, as follows: Figure 1 As shown, the method includes the following steps:

[0027] Step S102: Receive multiple frames of first part images and multiple frames of second part images, wherein the first part images and the second part images correspond one-to-one, and the first part images are images of the mouse cursor in a frame of the display screen, and the second part images are images in a frame of the display screen other than the first part images.

[0028] Step S104: Obtain the position information of the mouse cursor in each frame of the display screen;

[0029] Step S106: Determine whether the second part of the image in the current frame is the same as the second part of the image in the previous frame to obtain a first determination result, and determine whether the position information of the mouse cursor corresponding to the second part of the image in the current frame is the same as the position information of the mouse cursor corresponding to the second part of the image in the previous frame to obtain a second determination result.

[0030] Step S108: If the first judgment result indicates yes and the second judgment result indicates yes or no, generate a target display screen based on the target image information, and do not generate a trigger signal to trigger the processor to update the display screen. If the first judgment result indicates no and the second judgment result indicates yes or no, generate a trigger signal. The target image information includes at least: display data of the second part of the image of the current frame, display data of the first part of the image corresponding to the second part of the image of the current frame, and position information of the mouse cursor corresponding to the second part of the image of the current frame.

[0031] Since the above method generates a trigger signal only when the first judgment result indicates no and the second judgment result indicates yes or no, thereby updating the image through the processor, and when the first judgment result indicates yes and the second judgment result indicates yes or no, the above method can generate a target display screen based on the target image information without generating a trigger signal to trigger the processor to update the display screen. The target image information includes at least the display data of the second part of the image of the current frame, the display data of the first part of the image corresponding to the second part of the image of the current frame, and the position information of the mouse cursor corresponding to the second part of the image of the current frame. Thus, when the cursor moves in the display screen and the screen other than the cursor is static, power consumption can be further reduced by not triggering the processor action. This avoids the power consumption caused by frequent exits of panel self-refresh (PSR or PSR2) technology due to frequent movement of the mouse cursor under daily office conditions. Compared with the existing PSR (or PSR2) technology, the mouse wake-up time can be advanced by 0 to 1 frame.

[0032] In step S102 above, multiple frames of first part images and multiple frames of second part images are received. The first part images and the second part images correspond one-to-one. The first part image is the image of the mouse cursor in a frame of the display screen, and the second part image is the image in a frame of the display screen other than the first part image.

[0033] In some optional implementations, receiving multiple frames of the first portion image and multiple frames of the second portion image includes: receiving multiple frames of the first portion image through a first data channel and receiving multiple frames of the second portion image through a second data channel. By separating the image of the mouse cursor in the same frame of the display screen from the images in the display screen other than the mouse cursor image, and then transmitting the two parts of the image through different data channels and processing them after reception, it is possible to effectively determine whether the images in the display screen other than the cursor have changed when the cursor moves. That is, the screen with only the cursor moving can be identified as a static screen, and it can be processed separately from the moving cursor, thereby improving processing efficiency.

[0034] For example, the split multi-frame first part image and multi-frame second part image are transmitted and stored to the timing controller (TCON) chip via embedded DisplayPort (eDP). eDP is an image transmission interface standard developed by the Video Electronics Standards Association (VESA) for mobile device applications. Its transmission rate is higher than that of the traditional Low Voltage Differential Signaling (LVDS) interface, and it can be applied to various products with embedded display panels. The basic architecture of eDP includes a main transmission channel, an auxiliary channel (AUX channel), and a link training. The first data channel used to transmit the image of the mouse cursor is the auxiliary channel, and the second data channel used to transmit the image of the display screen other than the image of the mouse cursor is the main transmission channel. The main transmission channel can be a differential signal line.

[0035] In step S104 above, the position information of the mouse cursor in each frame of the display screen is obtained.

[0036] In some optional implementations, acquiring multiple mouse position information corresponding to multiple frames of the second part image includes: determining the first horizontal edge and the first vertical edge of the target second part image, and determining the first intersection point where the first horizontal edge and the first vertical edge meet; establishing an image coordinate system corresponding to the target second part image with the first intersection point as the origin, the first horizontal edge as the x-coordinate, and the first vertical edge as the y-coordinate; and determining the mouse coordinates corresponding to the target second part image based on the image coordinate system, wherein the mouse coordinates are used to represent the mouse position information corresponding to the target second part image. By establishing a coordinate system, the movement position of the cursor can be accurately located, thereby making the cursor position in the synthesized target display screen more precise.

[0037] For example, using the first horizontal and first vertical edges of the second part of the image that intersect at the lower left corner as axes and the intersection point as the origin, x and y coordinates are established respectively. Then, the mouse position information corresponding to the second part of the image in the current frame is determined to obtain coordinate values ​​(x1, y1). Thus, in the subsequent step of generating the target display screen, the position of the first part of the image (the image of the mouse cursor) in the current frame can be restored according to the above coordinate values ​​(x1, y1) in the second part of the image in the current frame (the image other than the image of the mouse cursor in the same frame display screen). After compositing the first part of the image and the second part of the image, the display screen of the current frame (i.e., the target display screen) is obtained.

[0038] In step S106 above, it is determined whether the second part of the image in the current frame is the same as the second part of the image in the previous frame to obtain a first determination result, and it is determined whether the position information of the mouse cursor corresponding to the second part of the image in the current frame is the same as the position information of the mouse cursor corresponding to the second part of the image in the previous frame to obtain a second determination result.

[0039] The image processing method described in this embodiment further includes: sending the target display image to a buffer, wherein the buffer is used to send the target display image to a display for display.

[0040] For example, the TCON chip has a buffer area, and the split multi-frame first part image and multi-frame second part image are transmitted and stored in the buffer area via eDP.

[0041] In some optional implementations, determining whether the second part of the current frame image is the same as the second part of the previous frame image and outputting a first determination result includes: determining whether the first target data row in the display data of the second part of the current frame image is the same as the second target data row in the display data of the second part of the previous frame image and outputting a first determination result, wherein the display data of the second part of each frame image is displayed on the display line by line, the first target data row is any row of display data in the display data of the second part of the current frame image, the second target data row is the display data in the display data of the second part of the previous frame image that is located in the same row as the first target data row, and the display data of the second part of the previous frame image is stored in a buffer.

[0042] In the above optional implementation, if the first determination result indicates no, the second target data line and the trigger signal are sent to the processor. The processor stores the display data of the second part of the previous frame image. After receiving the trigger signal, the processor replaces the second target data line with the first target data line to obtain an updated target display screen, converts the updated target display screen into an analog signal, and sends the analog signal to the display for display.

[0043] Specifically, the split first-part image and second-part image can be transmitted and stored in the buffer of the TCON chip via eDP. Before outputting the target display screen, the TCON chip compares the display data of any row in the second-part image of the current frame with the display data of the same row in the second-part image of the previous frame. If the two rows of data are the same, the buffer stores the display data of the second-part image of the current frame. The TCON chip combines the stored second-part image of the current frame with the first-part image according to the position information of the mouse cursor corresponding to the second-part image of the current frame to form the target display screen.

[0044] If the display data of any row in the second part of the current frame is different from the display data of the same row in the second part of the previous frame, a trigger signal is generated by the TCON chip, and the trigger signal and the display data of the arbitrary row are sent to the processor. The driver chip in the processor converts the display data of the arbitrary row into an analog signal and sends it to the display for display, so as to save power.

[0045] In some optional implementations, the image processing method described above in this embodiment further includes: determining whether the first part of the image in the current frame is the same as the first part of the image in the previous frame, and obtaining a third determination result; if the first determination result indicates yes, the second determination result indicates yes or no, and the third determination result indicates yes or no, generating a target display screen based on the target image information, without generating a trigger signal, wherein the target image information also includes display information of the first part of the image in the current frame. By adopting the above implementation, when the mouse cursor shape changes while the screen other than the cursor is static, the processor is not triggered to display the image, thereby further reducing power consumption due to not triggering processor actions.

[0046] For example, if the first part of the image in the current frame is different from the first part of the image in the previous frame, the difference between the first part of the image can be caused by the cursor blinking. In this case, since no processor action is triggered, power consumption can be reduced.

[0047] In step S108 above, if the first judgment result indicates yes and the second judgment result indicates yes or no, a target display screen is generated based on the target image information, and no trigger signal is generated to trigger the processor to update the display screen. If the first judgment result indicates no and the second judgment result indicates yes or no, a trigger signal is generated. The target image information includes at least: display information of the second part of the image of the current frame, display information of the first part of the image corresponding to the second part of the image of the current frame, and position information of the mouse cursor corresponding to the second part of the image of the current frame.

[0048] Specifically, such as Figure 2As shown, in a feasible embodiment, after the display port source (eDP Source) of the eDP interface detects a static image (ignoring mouse cursor movement), it transmits the split multi-frame first part image (the image of the mouse cursor) and multi-frame second part image (the images in the display screen other than the image of the mouse cursor). The first part image is transmitted to the receiving end (DPRX) of the eDP TCON through the DP AUX channel, and the second part image is transmitted to the DPRX through the DPMain Lane, and then to PSR2 (or PSR). PSR2 (or PSR) stores only the second part image in the first buffer (Frame Buffer) in the TCON chip through Mouse Refresh (MR), and then the graphics card stops sending data. When a change in the first part image is detected, the first part image is stored in the second buffer (Mouse Refresh Buffer, MR Buffer) built into the TCON in real time every frame through the DP AUX channel. At the same time, the DP AUX channel transmits the cursor coordinates to the MR in real time. Then, the TCON restores the stored first part image and the second part image in the Frame Buffer in real time to form the initial image and outputs it to the display for display.

[0049] In the above feasible embodiments, the first part of the image may include not only the image of the mouse cursor, but also the image of the surrounding area of ​​the mouse cursor. In this case, the second part of the image is the image on the display screen excluding the image of the mouse cursor and the image of the surrounding area. Specifically, when the mouse hovers over an icon, causing the icon to be selected or the annotation to pop up, the image of this changed area is also packaged together with the mouse cursor image and stored in the MRBuffer in TCON as a unit to be updated.

[0050] like Figure 3As shown, in another feasible embodiment, after the eDP Source detects a static image (ignoring mouse cursor movement), it transmits the split multi-frame first part image (the image of the mouse cursor) and multi-frame second part image (the images in the display screen other than the image of the mouse cursor). The first part image is transmitted to DPRX via DP Main Lane, and the second part image is transmitted to DPRX via DP Main Lane, and then to PSR2 (or PSR). PSR2 (or PSR) stores only the second part image in the Frame Buffer via MR, and then the graphics card stops sending data. At this time, when a change in the first part image is detected, the first part image is stored in the MRBuffer in real time by DP Main Lane every frame. At the same time, DP Main Lane transmits the cursor coordinates to MR in real time. Then, in TCON, the stored first part image and the second part image in the Frame Buffer are restored and synthesized in real time to form the initial image for display.

[0051] Example 2

[0052] According to embodiments of the present invention, an apparatus for implementing the above-described image processing method is also provided. Figure 4 This is a structural block diagram of a testing device for an application programming interface according to Embodiment 2 of the present invention, as shown below. Figure 4 As shown, the device includes: a receiving module 202, an acquisition module 204, a judgment module 206, and a generation module 208. The device will be described in detail below.

[0053] The receiving module 202 is used to receive multiple frames of first part images and multiple frames of second part images, wherein the first part images and the second part images correspond one-to-one, and the first part image is the image of the mouse cursor in a frame of the display screen, and the second part image is the image in a frame of the display screen other than the first part image.

[0054] The acquisition module 204 is used to acquire the position information of the mouse cursor in each frame of the display screen;

[0055] The judgment module 206 is used to judge whether the second part of the image in the current frame is the same as the second part of the image in the previous frame, to obtain a first judgment result, and to judge whether the position information of the mouse cursor corresponding to the second part of the image in the current frame is the same as the position information of the mouse cursor corresponding to the second part of the image in the previous frame, to obtain a second judgment result.

[0056] The generation module 208 is used to generate a target display screen based on the target image information when the first judgment result indicates yes and the second judgment result indicates yes or no, and not to generate a trigger signal to trigger the processor to update the display screen. When the first judgment result indicates no and the second judgment result indicates yes or no, a trigger signal is generated. The target image information includes at least: display data of the second part of the image of the current frame, display data of the first part of the image corresponding to the second part of the image of the current frame, and position information of the mouse cursor corresponding to the second part of the image of the current frame.

[0057] It should be noted that the receiving module 202, the obtaining module 204, the judging module 206 and the generating module 208 mentioned above correspond to steps S102 to S108 in Embodiment 1. The multiple modules and the corresponding steps implement the same instances and application scenarios, but are not limited to the content disclosed in Embodiment 1.

[0058] Example 3

[0059] Embodiments of the present invention can provide an electronic device, which can be a terminal or a server. In this embodiment, the security early warning system, as a terminal, can be any computer terminal device in a group of computer terminals. Optionally, in this embodiment, the terminal can also be a mobile terminal or other terminal device.

[0060] Optionally, in this embodiment, the terminal may be located in at least one of a plurality of network devices in a computer network.

[0061] Optionally, Figure 5 This is a structural block diagram of a terminal according to an exemplary embodiment. For example... Figure 5 As shown, the terminal may include: one or more (only one is shown in the figure) processors 31 and a memory 32 for storing processor-executable instructions; wherein, the processor 31 is configured to execute instructions, and the processor 31 includes: a timing control chip for executing the above-described image processing method to generate a target display image; a driver chip, communicating with the timing control chip, for converting the target display image into an analog signal and sending the analog signal corresponding to the target display image to the display for display; and a display, communicating with the driver chip, for displaying the target display image.

[0062] The memory can be used to store software programs and modules, such as the program instructions / modules corresponding to the image processing method and apparatus in this embodiment of the invention. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, thereby realizing the aforementioned image processing method. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to a computer terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0063] The processor can invoke information and application programs stored in the memory through the transmission device to perform the following steps: receiving multiple frames of first part images and multiple frames of second part images, wherein the first part images and the second part images correspond one-to-one, and the first part image is the image of the mouse cursor in a frame of display, and the second part image is the image in a frame of display excluding the first part image; acquiring the position information of the mouse cursor in each frame of display; determining whether the second part image of the current frame is the same as the second part image of the previous frame, obtaining a first determination result, and determining whether the position information of the mouse cursor corresponding to the second part image of the current frame is the same as the position information of the mouse cursor corresponding to the second part image of the previous frame, obtaining a second determination result; if the first determination result indicates yes and the second determination result indicates yes or no, generating a target display screen according to the target image information, without generating a trigger signal to trigger the processor to update the display screen, and if the first determination result indicates no and the second determination result indicates yes or no, generating a trigger signal, wherein the target image information includes at least: display data of the second part image of the current frame, display data of the first part image corresponding to the second part image of the current frame, and position information of the mouse cursor corresponding to the second part image of the current frame.

[0064] Optionally, the processor may also execute program code that performs the following steps: receiving multiple frames of a first part image and multiple frames of a second part image, including: receiving multiple frames of the first part image through a first data channel and receiving multiple frames of the second part image through a second data channel.

[0065] Optionally, the processor may also execute program code that performs the following steps: acquiring multiple mouse position information corresponding to multiple frames of the second part image, including: determining the first horizontal edge and the first vertical edge of the target second part image, and determining the first intersection point where the first horizontal edge and the first vertical edge meet; establishing an image coordinate system corresponding to the target second part image with the first intersection point as the origin, the first horizontal edge as the x-coordinate, and the first vertical edge as the y-coordinate; and determining the mouse coordinates corresponding to the target second part image according to the image coordinate system, wherein the mouse coordinates are used to represent the mouse position information corresponding to the target second part image.

[0066] Optionally, the processor may also execute program code that performs the following steps: determining whether the first part of the image in the current frame is the same as the first part of the image in the previous frame, and obtaining a third determination result; if the first determination result indicates yes, the second determination result indicates yes or no, and the third determination result indicates yes or no, generating a target display screen based on the target image information, without generating a trigger signal, wherein the target image information also includes the display information of the first part of the image in the current frame.

[0067] Optionally, the processor may also execute program code that sends the target display image to a buffer, the buffer being used to send the target display image to a display for display.

[0068] Optionally, the processor may also execute program code with the following steps: determining whether the second part of the current frame image is the same as the second part of the previous frame image, and outputting a first determination result, including: determining whether the first target data line in the display data of the second part of the current frame image is the same as the second target data line in the display data of the second part of the previous frame image, and outputting a first determination result, wherein the display data of the second part of each frame image is displayed in rows on the display, the first target data line is any row of display data in the display data of the second part of the current frame image, the second target data line is the display data in the display data of the second part of the previous frame image that is in the same row as the first target data line, and the display data of the second part of the previous frame image is stored in a buffer.

[0069] Optionally, the processor may also execute program code that performs the following steps: if the first judgment result indicates no, the second target data line and the trigger signal are sent to the processor, the processor stores the display data of the second part of the previous frame image, and the processor is used to convert the second target data line into an analog signal after receiving the trigger signal, and send the analog signal corresponding to the second target data to the display for display.

[0070] Those skilled in the art will understand that Figure 5The structure shown is for illustrative purposes only. For example, the terminal mentioned above can also be a smartphone (such as an Android phone, an iOS phone, etc.), a tablet computer, a mobile internet device (MID), a PAD, and other terminal devices. Figure 5 This does not limit the structure of the aforementioned electronic device. For example, it may also include devices that are more... Figure 5 The more or fewer components shown (such as network interfaces, display devices, etc.), or having the same Figure 5 The different configurations shown.

[0071] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0072] Example 4

[0073] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, which, when executed by a processor of a terminal, enable the terminal to perform any of the image processing methods described above. Optionally, the computer-readable storage medium may be a non-transitory computer-readable storage medium, such as a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device.

[0074] Optionally, in this embodiment, the computer-readable storage medium described above can be used to store the program code executed by the image processing method provided in Embodiment 1.

[0075] Optionally, in this embodiment, the computer-readable storage medium may be located in any computer terminal in a group of computer terminals in a computer network, or in any mobile terminal in a group of mobile terminals.

[0076] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: receiving multiple frames of first partial images and multiple frames of second partial images, wherein the first partial images and the second partial images correspond one-to-one, and the first partial image is an image of the mouse cursor in a frame of a display screen, and the second partial image is an image in a frame of a display screen excluding the first partial image; obtaining the position information of the mouse cursor in each frame of the display screen; determining whether the second partial image of the current frame is the same as the second partial image of the previous frame, obtaining a first determination result, and determining whether the position information of the mouse cursor corresponding to the second partial image of the current frame is the same as that of the previous frame. The second judgment result is obtained by determining whether the position information of the mouse cursor corresponding to the second part of the image is the same. If the first judgment result indicates yes and the second judgment result indicates yes or no, a target display screen is generated according to the target image information, and no trigger signal is generated to trigger the processor to update the display screen. If the first judgment result indicates no and the second judgment result indicates yes or no, a trigger signal is generated. The target image information includes at least: the display data of the second part of the image of the current frame, the display data of the first part of the image corresponding to the second part of the image of the current frame, and the position information of the mouse cursor corresponding to the second part of the image of the current frame.

[0077] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: receiving multiple frames of a first portion image and multiple frames of a second portion image, including: receiving multiple frames of the first portion image through a first data channel and receiving multiple frames of the second portion image through a second data channel.

[0078] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: obtaining multiple mouse position information corresponding to multiple frames of the second part image, including: determining the first horizontal edge and the first vertical edge of the target second part image, and determining the first intersection point where the first horizontal edge and the first vertical edge meet; establishing an image coordinate system corresponding to the target second part image with the first intersection point as the origin, the first horizontal edge as the abscissa, and the first vertical edge as the ordinate; determining the mouse coordinates corresponding to the target second part image according to the image coordinate system, wherein the mouse coordinates are used to characterize the mouse position information corresponding to the target second part image.

[0079] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: determining whether the first part of the image in the current frame is the same as the first part of the image in the previous frame, and obtaining a third determination result; if the first determination result indicates yes, the second determination result indicates yes or no, and the third determination result indicates yes or no, generating a target display screen according to the target image information, without generating a trigger signal, wherein the target image information also includes display information of the first part of the image in the current frame.

[0080] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: sending the target display screen to a buffer, the buffer being used to send the target display screen to a display for display.

[0081] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: determining whether the second part of the current frame image is the same as the second part of the previous frame image, and outputting a first determination result, including: determining whether the target data row in the first display data of the second part of the current frame image is the same as the second target data row in the display data of the second part of the previous frame image, and outputting a first determination result, wherein the display data of each frame of the second part image is displayed in rows on the display, the target data row is any row of display data in the display data of the second part of the current frame image, the second target data row is the display data in the display data of the second part of the previous frame image that is located in the same row as the first target data row, and the display data of the second part of the previous frame image is stored in a buffer.

[0082] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: if the first determination result indicates no, sending the second target data line and a trigger signal to the processor, the processor storing display data of the second part of the previous frame image, the processor being used to convert the second target data line into an analog signal after receiving the trigger signal, and sending the analog signal corresponding to the second target data to the display for display.

[0083] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0084] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0085] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection of units or modules may be electrical or other forms.

[0086] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0087] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0088] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0089] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. An image processing method, characterized by, include: Receive multiple frames of first part images and multiple frames of second part images, wherein the first part images and the second part images correspond one-to-one, and the first part images are the images of the mouse cursor in a frame of the display screen, and the second part images are the images in the frame of the display screen other than the first part images; Obtain the position information of the mouse cursor in each frame of the displayed screen; Determine whether the second part of the image in the current frame is the same as the second part of the image in the previous frame to obtain a first determination result, and determine whether the position information of the mouse cursor corresponding to the second part of the image in the current frame is the same as the position information of the mouse cursor corresponding to the second part of the image in the previous frame to obtain a second determination result. If the first judgment result indicates yes and the second judgment result indicates yes or no, a target display screen is generated based on the target image information, and no trigger signal is generated to trigger the processor to update the display screen. If the first judgment result indicates no and the second judgment result indicates yes or no, the trigger signal is generated. The target image information includes at least: display data of the second part of the image of the current frame, display data of the first part of the image corresponding to the second part of the image of the current frame, and position information of the mouse cursor corresponding to the second part of the image of the current frame.

2. The image processing method of claim 1, wherein, The receiving of multiple frames of the first part of the image and multiple frames of the second part of the image includes: The first part of the multi-frame image is received through the first data channel, and the second part of the multi-frame image is received through the second data channel.

3. The image processing method of claim 1, wherein, Before determining whether the position information of the mouse cursor corresponding to the second part of the image in the current frame is the same as the position information of the mouse cursor corresponding to the second part of the image in the previous frame, and obtaining the second determination result, the method further includes: Determine the first horizontal and first vertical edges of the second part of the target image, and determine the first intersection point where the first horizontal and first vertical edges meet; With the first intersection point as the origin, the first horizontal edge as the abscissa, and the first vertical edge as the ordinate, an image coordinate system corresponding to the second part of the target image is established; Based on the image coordinate system, the mouse coordinates corresponding to the second part of the target image are determined, wherein the mouse coordinates are used to represent the position information of the mouse cursor corresponding to the second part of the target image.

4. The image processing method of any one of claims 1 to 3, characterized in that, Also includes: Determine whether the first part of the image in the current frame is the same as the first part of the image in the previous frame, and obtain a third determination result; If the first judgment result indicates yes, the second judgment result indicates yes or no, the second judgment result indicates yes or no, and the third judgment result indicates no, the target display screen is generated according to the target image information, and the trigger signal is not generated. The target image information also includes the display information of the first part of the image of the current frame.

5. The image processing method of any one of claims 1 to 3, characterized in that, Also includes: The target display screen is sent to the buffer, which is used to send the target display screen to the display for display.

6. The image processing method of claim 5, wherein, The step of determining whether the second part of the current frame image is the same as the second part of the previous frame image and outputting a first determination result includes: Determine whether the first target data line in the display data of the second part of the current frame is the same as the second target data line in the display data of the second part of the previous frame, and output the first determination result. The display data of the second part of each frame is displayed on the display line by line. The first target data line is any line of display data in the display data of the second part of the current frame. The second target data line is the display data in the display data of the second part of the previous frame that is in the same line as the first target data line. The display data of the second part of the previous frame is stored in the buffer.

7. The image processing method of claim 6, wherein, Also includes: If the first judgment result indicates no, the second target data line and the trigger signal are sent to the processor. The processor stores the display data of the second part of the previous frame image. After receiving the trigger signal, the processor converts the second target data line into an analog signal and sends the analog signal corresponding to the second target data line to the display for display.

8. An image processing apparatus characterized by comprising: include: The receiving module is used to receive multiple frames of first part images and multiple frames of second part images, wherein the first part images and the second part images correspond one-to-one, and the first part images are the images of the mouse cursor in a frame of the display screen, and the second part images are the images in the frame of the display screen other than the first part images. The acquisition module is used to acquire the position information of the mouse cursor in each frame of the display screen; The judgment module is used to determine whether the second part image of the current frame is the same as the second part image of the previous frame, to obtain a first judgment result, and to determine whether the position information of the mouse cursor corresponding to the second part image of the current frame is the same as the position information of the mouse cursor corresponding to the second part image of the previous frame, to obtain a second judgment result. The generation module is configured to generate a target display screen based on the target image information when the first judgment result indicates yes and the second judgment result indicates yes or no, without generating a trigger signal to trigger the processor to update the display screen; and to generate the trigger signal when the first judgment result indicates no and the second judgment result indicates yes or no. The target image information includes at least: display data of the second part of the image of the current frame, display data of the first part of the image corresponding to the second part of the image of the current frame, and position information of the mouse cursor corresponding to the second part of the image of the current frame.

9. An electronic device, comprising: include: processor; Memory used to store the processor's executable instructions; The display communicates with the processor; The processor is configured to execute the instructions, and the processor includes: A timing control chip is used to execute the image processing method according to any one of claims 1 to 7 to generate a target display screen; The driver chip communicates with the timing control chip to convert the target display screen into an analog signal and send the analog signal corresponding to the target display screen to the display for display.

10. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is able to perform the image processing method as described in any one of claims 1 to 7.

Images