A display device and a method of visualizing revocation or restoration

Abstract

The application provides a display device and a visual display method for undoing or restoring, which comprises, when an undoing or restoring operation is performed, combining the redrawing time length of a processing object and the operation frequency of a user operating an undo function control or a restore function control to determine the display mode of the execution result. For fast undoing or undoing mode, there is no visual animation effect, and the execution result corresponding to the undoing or restoring is directly displayed. If it is a visual display effect, the corresponding animation process is displayed through an undo window or a restore window. By storing a preset number of frame processing images, the problem of large image data quantity can be avoided, a new frame processing image is generated after each editing operation, and the undoing or restoring steps are no longer limited, thereby solving the problem that the undoing or restoring steps are limited when the undoing or restoring operation is performed, and solving the problem that the undoing or restoring display is not intuitive through the visual process of undoing or restoring.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a visual display method for revoking or restoring. Background Technology

[0002] An interactive whiteboard is a touch-screen display device that allows users to write on the whiteboard using a pen, hand, or other touch-sensitive object. Due to its ease of use and intelligent features, interactive whiteboards are widely used in video conferencing and educational settings.

[0003] When an error is made while writing on an electronic whiteboard, an undo operation can be performed. For example, in application CN108491145B, entitled "Method and Apparatus for Undoing Handwriting in Writing Applications, Storage Medium, and Terminal Device," a multi-step undo function can be implemented. In application CN112462989A, entitled "Operation Method, Apparatus, Intelligent Interactive Flat Panel, and Medium," a visualization function for multi-step undo can be achieved by previewing the historical operation list and undoing to a specific historical moment. In application CN202110439201.1, entitled "An Interactive Electronic Whiteboard with Non-linear Undo and its Non-linear Undo Method," the undo process can be displayed as a thumbnail using a non-linear undo method. In application CN109165626A, entitled "Method, Apparatus, Device, and Storage Medium for Processing Writing Strokes on an Electronic Whiteboard," a function to undo selected content can be implemented.

[0004] However, in the above undo methods, the object needs to be redrawn on the electronic whiteboard canvas after undoing. When undoing to a certain step and then redrawing the canvas, a large number of objects can easily cause lag. To avoid lag, each step of the operation can be saved as a canvas in advance. However, due to memory limitations, only a few canvases can be saved, so the number of undo steps is limited to the few most recent saved steps. Similarly, the same problem exists with redo steps, namely, the number of undo steps is limited. Furthermore, during the undo or redo process, the user may not be able to see the objects being undone or redoed. Therefore, when performing undo or redo operations, there are problems with the limited number of undo or redo steps and the lack of intuitive display of the objects being undone or redoed. Summary of the Invention

[0005] Some embodiments of this application provide a display device and a visual display method for undoing or redoing, to solve the problems that the steps for undoing or redoing are limited and the objects to be processed for undoing or redoing are not displayed intuitively when performing undo or redo operations.

[0006] In a first aspect, some embodiments of this application provide a display device, including:

[0007] The display is configured to show a user interface, which includes undo and redo controls.

[0008] The controller is configured as follows:

[0009] In response to a cancel or redo command on the object being processed, calculate the redraw duration required to redraw the object being processed.

[0010] If the redraw duration is less than or equal to the preset duration, execute the undo command or the restore command, and control the display to redraw the execution result corresponding to the undo command or the restore command in the current user interface;

[0011] If the redraw duration is greater than a preset duration, the operation frequency of the undo or redo function control is obtained. In response to the operation frequency being higher than or equal to a frequency threshold, the display is controlled to show the execution result in the user interface. In response to the operation frequency being lower than the frequency threshold, when the number of clicks on the undo or redo function control is a preset number, the display is controlled to show the undo or redo window in the user interface in a visual form. The undo or redo includes the frame processing image stored when each processing is performed on the processing object.

[0012] Secondly, some embodiments of this application provide a visual display method for reversing or restoring, which can be applied to the display device of the first aspect. The visual display method for reversing or restoring includes:

[0013] In response to a cancel or redo command on the object being processed, calculate the redraw duration required to redraw the object being processed.

[0014] If the redraw duration is less than or equal to the preset duration, execute the undo command or the restore command, and control the display to redraw the execution result corresponding to the undo command or the restore command in the current user interface;

[0015] If the redraw duration is greater than a preset duration, the operation frequency of the undo or redo function control is obtained. In response to the operation frequency being higher than or equal to a frequency threshold, the display is controlled to show the execution result in the user interface. In response to the operation frequency being lower than the frequency threshold, when the number of clicks on the undo or redo function control is a preset number, the display is controlled to show the undo or redo window in the user interface in a visual form. The undo or redo includes the frame processing image stored when each processing is performed on the processing object.

[0016] As can be seen from the above technical solutions, some embodiments of this application provide a display device and a visual display method for undoing or redoing. The display device includes determining the display method of the execution result by combining the redrawing time of the processed object and the frequency of user operation of the undo or redo function control when performing an undo or redo operation. For the quick undo or redo method, there is no visual animation effect; the execution result corresponding to the undo or redo is directly displayed. If a visual display effect is required, the corresponding animation process is displayed through the undo or redo window. By storing a preset number of frame processing images, the problem of large image data volume can be avoided. A new frame processing image is generated after each editing operation, and the undo or redo steps are no longer restricted, thereby solving the problem of limited undo or redo steps when performing undo or redo operations. The problem of insufficient intuitiveness in displaying undo or redo is solved by visualizing the undo or redo process. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in some embodiments of this application or in the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0019] Figure 2 Hardware configuration block diagrams of display devices provided in some embodiments of this application;

[0020] Figure 3 Hardware configuration block diagrams of control devices provided in some embodiments of this application;

[0021] Figure 4 This is a schematic diagram of the software configuration in a display device provided in some embodiments of this application;

[0022] Figure 5 A schematic flowchart illustrating a visual display method for performing undo or restore on a display device, provided in some embodiments of this application;

[0023] Figure 6 This is a schematic diagram of the frame processing image editing process provided in some embodiments of this application;

[0024] Figure 7 A flowchart illustrating the display of execution results in a user interface using a display device provided in some embodiments of this application;

[0025] Figure 8A schematic diagram illustrating the process of performing a single undo operation on a display device provided in some embodiments of this application;

[0026] Figure 9 This application provides a schematic diagram illustrating a scenario where a display device cancels the writing object, based on some embodiments thereof.

[0027] Figure 10 This application provides schematic diagrams illustrating the effect of a display device retracting a writing object in some embodiments.

[0028] Figure 11 This application provides a schematic diagram illustrating another scenario where a writing object is revoked on a display device, based on some embodiments thereof.

[0029] Figure 12 This application provides a schematic diagram illustrating another scenario of canceling the writing object in a display device, as shown in some embodiments of the present application.

[0030] Figure 13 The display device provided in some embodiments of this application is used to visually display a flowchart illustrating the process of canceling an image object;

[0031] Figure 14 This application provides a display device for displaying a scene diagram of a revoked image object in a visual form, as shown in some embodiments of the present application.

[0032] Figure 15 This application provides schematic diagrams illustrating scenarios where the erased object is removed from the display device, as shown in some embodiments.

[0033] Figure 16 This application provides schematic diagrams illustrating scenarios where a display device revokes a full-screen editing object, as shown in some embodiments.

[0034] Figure 17 This is a schematic diagram illustrating a scenario where a selected editing object is undone, provided in some embodiments of this application. Detailed Implementation

[0035] To make the objectives, technical solutions, and advantages of some embodiments of this application clearer, the technical solutions of some embodiments of this application will be clearly and completely described below with reference to specific embodiments and corresponding drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.

[0036] It should be noted that the brief descriptions of terms in some embodiments of this application are only for the convenience of understanding the implementation methods described below, and are not intended to limit the implementation methods of some embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0037] In some embodiments of this application, the terms "first," "second," "third," etc., in the specification, claims, and accompanying drawings are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms can be used interchangeably where appropriate.

[0038] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0039] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0040] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, the user can operate the display device 200 through the mobile terminal 300 and the control device 100.

[0041] In some embodiments, the mobile terminal 300 may install software applications with the display device 200 to establish a connection and communication via a network communication protocol, thereby achieving one-to-one control operation and data communication. Alternatively, audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 to achieve synchronous display.

[0042] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0043] In addition to providing broadcast television reception functions, the display device 200 can also be equipped with intelligent network television functions that provide computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0044] Figure 2 This is a hardware configuration block diagram of a display device 200 provided in some embodiments of this application.

[0045] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0046] In some embodiments, the detector 230 is used to collect signals from the external environment or to interact with the outside world.

[0047] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving image display, a component for receiving image signals output from a controller, and a user control UI interface, etc.

[0048] In some embodiments, the communicator 220 is a component for communicating with external devices or the server 400 according to various communication protocol types.

[0049] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0050] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0051] In some embodiments, user interface 280 is an interface that can be used to receive control input.

[0052] Figure 3 This is a hardware configuration block diagram of a control device provided in some embodiments of this application. For example... Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0053] The control device 100 is configured to control the display device 200, and to receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0054] In some embodiments, the control device 100 may be an intelligent device. For example, the control device 100 may be equipped with various applications for controlling the display device 200 according to user needs.

[0055] In some embodiments, such as Figure 1 As shown, the mobile terminal 300 or other smart electronic devices can perform similar functions to the control device 100 after installing the application of the control display device 200.

[0056] The controller 110 includes a processor unit 112, RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0057] Under the control of the controller 110, the communication interface 130 enables communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of other near-field communication modules such as WiFi chip 131, Bluetooth module 132, and NFC module 133.

[0058] User input / output interface 140, wherein the input interface includes at least one of other input interfaces such as microphone 141, touchpad 142, sensor 143, button 144, etc.

[0059] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, which can encode user input commands via WiFi, Bluetooth, or NFC protocols and send them to the display device 200.

[0060] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can also store various control signal instructions input by the user.

[0061] The power supply 180 is used to provide operating power support for the various components of the control device 100 under the control of the controller.

[0062] Figure 4 The diagram illustrates the software configuration in a display device according to some embodiments of this application. In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (hereinafter referred to as the "Application Layer"), the Application Framework layer (hereinafter referred to as the "Framework Layer"), the System Library layer (hereinafter referred to as the "System Runtime Library Layer"), and the Kernel Layer.

[0063] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs that come with the operating system, system settings programs, clock programs, camera applications, etc., or they may be applications developed by third-party developers.

[0064] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer.

[0065] like Figure 4 As shown, in some embodiments of this application, the application framework layer includes managers, content providers, and a view system. The managers include at least one of the following modules: an Activity Manager for interacting with all activities running in the system; a Location Manager for providing system services or applications with access to system location services; a Package Manager for retrieving various information related to application packages currently installed on the device; a Notification Manager for controlling the display and clearing of notification messages; and a Window Manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0066] In some embodiments, the Activity Manager is used to: manage the lifecycle of individual applications and the usual navigation back functionality.

[0067] In some embodiments, the window manager is used to manage all window programs.

[0068] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is accessed, the operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0069] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.).

[0070] In some embodiments, the kernel layer also includes a power driver module for power management.

[0071] In some embodiments, Figure 4 The software programs and / or modules corresponding to the software architecture in the document are stored in [the relevant database]. Figure 2 or Figure 3 In the first or second memory shown.

[0072] The aforementioned display device 200 can output specific display images. In some embodiments, the display device 20 can be a smart TV, communication terminal, smart advertising screen, projector, electronic whiteboard, or other terminal device. Taking an electronic whiteboard as an example, an electronic whiteboard is a touch-enabled display device. By touching the whiteboard with a pen, hand, or other touch object, writing operations can be performed on the electronic whiteboard. Due to its ease of use and intelligent features, electronic whiteboards can be widely used in video conferencing or teaching, among other fields.

[0073] An electronic whiteboard combines the functions of a computer and a projector, enabling paperless office and teaching. Like a regular whiteboard or blackboard, it allows direct writing with a pen, and allows for undoing mistakes. For example, when a user selects to undo or redo, the operation can be performed on all processed objects. After completion, the canvas is cleared, and the undone or redone objects are drawn back onto the canvas. Other undo methods are also possible, but this application does not specifically limit them.

[0074] For newly created processing objects, each frame of the processed image corresponding to the operation on the processing object can be saved in advance. When performing undo or redo, the corresponding frame of the processed image can be found according to the undo or redo steps. If the processing object is image data, the corresponding frame of the processed image can be found and reloaded. If the processing object is non-image data such as text data, the stage processing data for the text data can be saved in advance. When performing undo or redo, the corresponding processing stage and the corresponding stage processing data can be found according to the undo or redo steps and redrawn.

[0075] However, in the above undo methods, the object needs to be redrawn on the electronic whiteboard canvas after each undo. When undoing to a certain step and then redrawing the canvas, lag can easily occur when dealing with a large number of objects. To avoid lag, each step of the operation can be saved as a canvas in advance. However, due to memory limitations, only a few canvases can be saved, so the number of undo steps is limited to the few most recent steps saved. Similarly, the undo process faces the same problem.

[0076] In other words, during the undo or redo process, the user may not be able to identify the object being undone or redoed. Therefore, when performing an undo or redo operation, there are issues such as limited undo or redo steps and the undo or redo object not being displayed intuitively.

[0077] To address the issues of limited undo or redo steps and insufficiently intuitive display of the processed object during undo or redo operations, some embodiments of this application provide a display device 200, comprising a display 260 and a controller 250. The display 260 is configured to display a user interface, which may include undo and redo function controls; the controller 250 is configured to execute a visual display method for undo or redo. When performing undo or redo operations on an electronic whiteboard, the display device 200 can store a preset number of processed frames of images obtained after processing the processed object, eliminating the need to store every single processed frame and avoiding the problem of large image data volumes. Furthermore, the display method of the execution result can be determined by combining the redrawing time of the processed object and the frequency of user operations on the undo or redo function controls. If the operation frequency is higher than or equal to the frequency threshold, the control display 260 displays the execution result in the user interface; if the operation frequency is lower than the frequency threshold, when the number of clicks on the undo or redo function control is a preset number, the control display 260 displays the undo or redo window in the user interface in a visual form. Here, undo or redo includes the frame processing image stored when each processing is performed on the processing object, thereby solving the problem that the steps of undo or redo are limited and the processing object of undo or redo is not displayed intuitively when performing undo or redo operations.

[0078] To facilitate understanding of the technical solutions in some embodiments of this application, the steps are described in detail below with reference to some specific embodiments and accompanying drawings. Figure 5 This application provides some embodiments of a visualization display method for performing undo or redo on a display device, as shown in the following flowchart. Figure 5 As shown, in some embodiments, when the display device 200 performs the undo or redo visualization display method, it may include the following steps S1-S3, the specific contents of which are as follows:

[0079] Step S1: In response to the undo or redo command for the processed object, the display device 200 calculates the redrawing time required to redraw the processed object.

[0080] To reduce the amount of image data when storing images, in some embodiments, in response to creating a new processing object and processing instructions to perform processing on the processing object or an existing processing object, the display device 200 may store a preset number of frame processing images obtained after processing the processing object. The frame processing images are continuous, and the last frame processing image is the image displayed in the user interface showing the completed processing of the processing object.

[0081] In some embodiments, the preset number can be 3. For example, to avoid the problem of storing a large amount of image data for each frame, this application embodiment only saves three consecutive processed frames of images. Figure 6 This is a schematic diagram of the frame processing image editing process provided in some embodiments of this application, such as... Figure 6 As shown, when creating a new processing object or performing editing operations such as zooming in, zooming out, writing, inserting images, and moving on an existing processing object, taking the undo operation as an example, after undoing the operation on the processing object, the image of the current interface after the operation is completed is the current frame processing image currentBitmap in the first row, and the corresponding current time is time N. The processing image of the previous frame before time N-1, i.e., the image before undoing, is preBitmap, and the image corresponding to the last frame processing image at time N-2, i.e., the image corresponding to the previous time before undoing, is lastBitmap.

[0082] Based on the three frames processed in the first row, when the display device 200 performs an undo operation, the current frame processed image `currentBitmap` switches to the previous frame processed image `preBitmap` (see the second row). After the undo operation is complete, the previous frame processed image `preBitmap` becomes the current frame processed image `currentBitmap`, the last frame processed image `lastBitmap` in the first row becomes the previous frame processed image `preBitmap` in the second row, and the current frame processed image `currentBitmap` in the first row becomes the next frame processed image `nextBitmap` in the second row. Based on the three frames processed in the second row, when undoing again, the previous frame processed image `preBitmap` in the second row becomes the current frame processed image `currentBitmap` in the third row, and the current frame processed image `currentBitmap` in the second row becomes the next frame processed image `nextBitmap` in the third row. Based on the three frames processed in the third row, when performing a restore operation, the next frame processed image `nextBitmap` in the third row becomes the current frame processed image `currentBitmap` in the fourth row, and the current frame processed image `currentBitmap` in the third row becomes the previous frame processed image `preBitmap`.

[0083] Therefore, in the above editing process, each time an operation is performed on the object being processed, a new preset number of frame-processed images are generated, without needing to save each processed frame object. Thus, storing a preset number of frame-processed images avoids the problem of large image data volume. Furthermore, since a new frame-processed image is generated after each editing operation, both undo and redo operations can be performed without restriction on the undo or redo steps, thus solving the problem of limited undo or redo steps when performing undo or redo operations.

[0084] During the undo process, it's necessary to clear the currently drawn processing objects and revert to the previous step. In some embodiments, the frame processing image before undo can be directly replaced with the current frame processing image. However, due to memory limitations, it's impossible to retain all frame processing images. In other embodiments, only the data related to operations on the processing objects can be recorded, and the scene state of all processing objects at the corresponding moment can be redrawn each time. When there are few processing objects in the user interface, the redrawing process can be completed quickly. However, when there are many processing objects, the redrawing time will be prolonged, resulting in low drawing efficiency. Therefore, the redrawing duration is an important factor to consider in the undo process.

[0085] In order to calculate the redrawing time of the processed object, in some embodiments, the display device 200 can obtain the number of objects contained in the processed object, the object types, the duration of drawing each object in the processed object, and the redrawing time coefficient of the object type corresponding to each object, and then calculate the redrawing time required to redraw the processed object based on the number of objects, object types, duration, and redrawing time coefficient.

[0086] For example, the redrawing time depends not only on the number of objects being processed but also on their complexity. For instance, drawing complex objects like brushstrokes or images takes longer than drawing simple objects without special brushstroke effects. Furthermore, it is also related to the size of the objects. For example, a 3-centimeter-long brushstroke takes longer than a 1-centimeter-long brushstroke. Therefore, calculating the redrawing time for a processed object depends on factors such as the number of objects, the types of objects, and the duration of drawing each object within the processed object.

[0087] In some embodiments, the redraw duration of the processed object can be calculated based on the number of objects, object type, duration, and redraw time coefficient. For example, the redraw duration of the processed object can be calculated using the following formula: Where N is a positive integer representing the number of objects to be processed, iObjTime is the duration of the i-th object, and iObjTypeK is the redraw time coefficient for the corresponding type of the i-th object. After step S1 is completed, step S2 can be executed.

[0088] Step S2: If the redraw duration is less than or equal to the preset duration, the display device 200 executes the undo or redo command, and controls the display 260 to redraw the execution result corresponding to the undo or redo command in the current user interface.

[0089] In this embodiment, both reversal and restoration are operations performed on the processing object. Reversal or restoration includes storing the frame processing image at each processing step of the processing object. For example, reversal refers to reverting the current processing state of the processing object to the frame processing image corresponding to the previous processing step. Restoration is the reverse process of reversal, which restores the previous processing step to the current processing state. The process of reversing the processing object will be described in detail below using the reversal process as an example. It can be understood that restoration is the reverse process of reversal, which is the process of restoring the reversal process.

[0090] In some embodiments, the preset duration can be 100ms. If the redrawing time of the processed object is less than or equal to 100ms, it indicates that the redrawing time of the processed object is short. In this case, the display device 200 can directly redraw all objects when executing the undo or redo command. After the drawing is completed, the display 260 can be controlled to redraw the execution result corresponding to the undo or redo command in the current user interface. After step S2 is completed, step S3 can be executed.

[0091] Step S3: If the redraw duration is longer than the preset duration, the display device 200 obtains the operation frequency of the undo or redo function control. In response to the operation frequency being higher than or equal to the frequency threshold, the display 260 is controlled to display the execution result in the user interface. In response to the operation frequency being lower than the frequency threshold, when the number of clicks on the undo or redo function control is a preset number, the display 260 is controlled to display the undo or redo window in the user interface in a visual form.

[0092] When the redrawing time of the processed object exceeds the preset time, it indicates that the redrawing process is taking too long. If redrawing is still used in this case, the process will be time-consuming, requiring the user to wait and impacting the user experience. To address this scenario, the display device 200 can determine the undo or redo process based on the frequency of user operations on the undo or redo controls. For example, if the user quickly clicks the undo control, it indicates a desire to quickly revert to a specific step. In this scenario, the display device 200 will not display a visual representation of the undo process but will instead quickly switch to the target step. If the user only clicks undo once or operates the undo or redo controls slowly, the user may need a visual representation of the undo or redo effect. In this scenario, the undo or redo process can be displayed visually.

[0093] In some embodiments, the display device 200 can obtain the operation frequency of the undo or redo function control. If the operation frequency is higher than or equal to a frequency threshold, the user clicks quickly. In this case, the display device 200 will directly control the display 260 to display the execution result in the user interface, instead of displaying the corresponding visualization process. The undo process for a processed object is described in detail below, using undo as an example.

[0094] Figure 7 This application provides some embodiments of a display device that displays execution results in a user interface, as shown in the following flowcharts. Figure 7 As shown, when the frequency of user operations on the undo function control exceeds a frequency threshold, it indicates that the user is rapidly clicking the undo function control to quickly reach the target operation step. Therefore, the display device 200 no longer dynamically displays the undo process. In response to the undo command, the display device 200 first records the number of clicks N on the undo function control, where the number of clicks can be greater than or equal to 2, and controls the display 260 to display the undo frame animation of the undo function in the current user interface's overlay. Simultaneously, a first sub-thread can calculate the first operation data for undoing the object to the penultimate step, draw the first operation data on the current user interface, and save the first frame processing image data corresponding to the first operation data. A second sub-thread then calculates the second operation data for undoing the object to the penultimate step and saves the second frame processing image data corresponding to the second operation data. Then, the execution progress of the undo frame animation and the first frame processed image data is detected, and the following judgment is made: if the undo frame animation has been generated but the first frame processed image data has not been completed, the display device 200 can continue to draw the first frame processed image data until the first frame processed image data and the second frame processed image data are completed; if the first frame processed image data has been completed but the undo frame animation has not been generated, the display device 200 can delete the overlay and control the display 260 to display the execution result corresponding to the first frame processed image data in the user interface.

[0095] For example, when a user performs an undo operation, the relationship with a frequency threshold can be determined by the number of clicks and the click frequency of the undo function control. When the operation frequency is higher than the frequency threshold, the display device 200 can control the display 260 to display the undo frame animation of the undo function in a floating layer. In some embodiments, N can be 3, that is, the user quickly clicks the undo function control 3 times. When the undo function is performed, the image displayed in the current user interface is the current frame processed image. Clicking the undo function control 3 times will revert to the processed image of the frame before the frame before the current frame processed image, that is, the third to last step of the current operation flow. In some embodiments, a sub-thread can calculate the calculation of undoing the processing object to the penultimate step, and draw the calculation result on the current user interface and save the first frame processed image data. Then, a sub-thread can calculate the calculation of undoing the processing object to the penultimate step and save the second frame processed image data corresponding to the calculation. Next, it is determined which of the undo frame animation and the drawing process is completed first. If the undo frame animation is completed first, the display device 200 can continue to draw the first frame processed image data until the drawing process is completed. If the drawing process is completed but the undo frame animation is not generated, the display device 200 can delete the overlay to cancel the animation effect and directly display the corresponding interface effect of the three undo steps on the processed object in the user interface.

[0096] In other words, if the operation frequency is higher than or equal to the frequency threshold, it indicates that the user clicked relatively quickly. In this case, the display device 200 will directly control the monitor 260 to display the execution result in the user interface, instead of displaying the corresponding visualization process. It can be understood that, in response to a restore command, the display device 200 will acquire the frame processing image corresponding to the undo process and perform a restore operation on the frame processing image, restoring it to the execution result before undoing.

[0097] In response to an operation frequency below a frequency threshold, when the number of clicks on the undo or redo function controls is a preset number, the display device 200 can control the monitor 260 to visually display the undo or redo window in the user interface. Taking the undo process as an example... Figure 8 This is a schematic diagram illustrating the process of performing a single undo operation on a display device provided in some embodiments of this application, such as... Figure 8As shown, in some embodiments, the preset number of times can be 1. When the user performs an undo, the display device 200 can control the display 260 to display the undo frame animation of the current frame processed image on the floating layer of the current user interface. Then, a sub-thread executes the undo of the object data, draws the undo data on the current user interface, and saves the undo result as the current frame processed image data `curentBitmap`. Before saving, the original `curentBitmap` is assigned the value `nextBitmap`. Simultaneously, a sub-thread executes the previous undo of the object data and saves the result as the previous frame processed image data `preBitmap`. After both sub-threads have finished executing, it is determined whether the undo frame animation has been completed. If the undo frame animation has been completed, the floating layer is deleted, and the display is controlled to display the undo frame animation in the user interface. If the undo frame animation has not been completed, the floating layer is deleted after the undo frame animation reaches a completion state, and the display is controlled to play the undo frame animation in the user interface. Understandably, in response to a click count of 1 on the restore function control, the display device 200 can restore the undo operation on the processed object, generate a restore frame animation of the restore process, and control the display to play the restore frame animation in the user interface.

[0098] In some embodiments, the operation before undoing can be the creation of a new processing object, such as adding a new line or inserting a new image, or it can be an editing operation on an existing processing object, such as zooming in, zooming out, or panning based on the screen. The animation effects implemented will differ depending on the operation performed on different processing objects. The following section will still use the undo process as an example to explain the undo process for different processing objects in detail.

[0099] In some embodiments, the processing object may include a writing object. When the processing object is a writing object, the display device 200 may visually display the undo or redo process in the user interface as follows: Taking undo as an example, in response to an undo command on the writing object, the display device 200 may acquire the current frame processing image. The current frame processing image is a processing image of writing along the writing direction against a writing background. Then, sampling points, the sampling point order, the number of sampling points, and the time interval for drawing the sampling points are extracted from the current frame processing image. The time interval is the ratio of the redrawing time of the writing object to the number of sampling points. The sampling points are then undone one by one in reverse order of the time interval and sampling point order, and the undo or redo process is generated into an undo frame animation. Finally, the display 260 is controlled to play the undo frame animation in the user interface.

[0100] For example, if the operation before undoing is writing an object, then the undoing process is the process of undoing the writing object. Figure 9This application provides schematic diagrams illustrating a scenario where a display device cancels the writing object, as shown in some embodiments. Figure 9 As shown, to more clearly illustrate the undo process, in some embodiments, a patterned background can be used, such as... Figure 9 The background contains the written marks of 12345. Figure 9 (1) is the background image preBitmap before writing. Figure 9 (2) is a diagram showing the writing direction. The direction of the dashed arrow indicates the writing direction of the object being written. Figure 9 (3) is the effect image after writing is completed, which is the current frame processing image currentBitmap. When undoing, in response to the undo command on the writing object, the display device 200 can obtain the current frame processing image, starting from the current frame processing image currentBitmap. Figure 9 (4) is Figure 9 (3) The area corresponding to the writing object is in the background of the preBitmap. Figure 9 (5) indicates the direction of undoing the writing object. The process of undoing the writing object can be presented by drawing lines in reverse order. Figure 9 (1) in the image is also the result of the cancellation.

[0101] Figure 10 This is a schematic diagram illustrating the effect of a display device retracting a writing object, provided in some embodiments of this application. Figure 10 As shown, during the writing process of the object, the sampling points, sampling order, number of sampling points, and time interval of sampling point drawing can be extracted from the image processed in the current frame. Figure 10 (1) in the text refers to the various sampling points that were obtained. Figure 10 (2) in the image represents the sampling point of the writing object in the background image. Figure 10 In the diagram, (3) indicates the direction of sampling point cancellation, and the arrows point in the direction of cancellation for each sampling point. The writing process is actually the process of connecting each sampling point according to the writing direction, while the cancellation process is the process of canceling sampling points in reverse order. Figure 9 and Figure 10 The comparison reveals that the writing direction and the undo direction of the writing object are opposite.

[0102] In practical applications, the duration of the undo frame animation can be changed. When undoing, sample points can be undone according to the time interval during writing; the writing time interval of the writing object can be the duration corresponding to the user's writing action. In some embodiments, the time interval between the drawing of two adjacent sample points can be equal to the time interval between cancellation.

[0103] In other embodiments, when undoing the writing object, the display device 200 can begin executing the undo function in response to the user clicking the undo function control. Since the sub-thread executing the undo process needs to redraw the background corresponding to the previous step, when the above method is used—that is, when the time interval for undoing is equal to the time interval for writing—the time interval may be very short, leading to situations where the background loading is incomplete. To address this scenario, when undoing the writing object, a redraw duration for the writing object can be used. This redraw duration can be obtained when the writing object is generated, thus avoiding the problem of incomplete background loading. The specific duration of the undo frame animation can be determined according to actual needs, and this application does not limit it. For example, the speed during undoing can be the original speed during writing, or it can be slower or faster than the original speed.

[0104] Figure 10 (4) is a schematic diagram showing the effect of reversing the drawing of 4 sampling points, i.e., canceling 4 sampling points. Figure 10 (5) is a schematic diagram of the effect of reversing the 5 sampling points, i.e. canceling the 5 sampling points. Figure 10 (6) is a schematic diagram showing the effect of reversing all sampling points, i.e., undoing all sampling points. It is understood that when a user performs a restore operation on a writing object, in response to the restore command, the undo operation on the writing object is restored, and a restore frame animation is generated during the restore process. Furthermore, the display 260 is controlled to play the restore frame animation in the user interface. It is understood that in this embodiment, the reverse process or reverse direction refers to a process opposite to the initial direction. For example, if the initial direction is from left to right, then the reverse process or reverse direction is from right to left; if the initial direction is from inside to outside, then the reverse process or reverse direction is from outside to inside.

[0105] Figure 11 This is a schematic diagram illustrating another scenario where the writing object is undone on a display device, provided in some embodiments of this application. Figure 12 This is a schematic diagram illustrating another scenario of canceling the writing object in a display device, as provided in some embodiments of this application. Figure 11 and Figure 12 As shown, with Figure 9 Similarly, after writing on an object in the correct writing direction, the writing can be undone in the opposite direction. To dynamically display the undone or redo process, the display device 200 can generate an undone frame animation, and then control the display 260 to play the undone frame animation in the user interface. For example, the user interface can have an undone or redo window, which can dynamically and visually display the undone or redo process.

[0106] In some embodiments, the processing object also includes the inserted image object. When the processing object is the inserted image object, the display device 200 controls the display 260 to visually display the undo or redo process in the user interface, which may include the following. Figure 13 The display device provided in some embodiments of this application displays a flowchart of the process of canceling an image object in a visual form, such as... Figure 13 As shown, in response to an undo command on an image object, the display device 200 can obtain the background of the inserted image object, then obtain the insertion position of the image object in the background, and determine the background area corresponding to the image object based on the insertion position and the background. Next, the display device 200 can set the undo direction when the image object is undoed in the background area, and undo the image object according to the undo direction. Furthermore, it can generate an undo frame animation of the undo process, and finally control the display 260 to play the undo frame animation in the user interface.

[0107] For example, Figure 14 This application provides some embodiments of a display device that visually displays a scene diagram of an undoing image object, such as... Figure 14 As shown, if the operation before undoing was inserting an image object, then the undo operation is the process of the image object disappearing. When undoing an image object, Figure 14 (1) in the image is the background of the inserted image object. Figure 14 (2) in the figure represents the insertion position of the image object. Figure 14 (3) in the figure represents the background area corresponding to the image object. When setting the undo direction of the image object, the display device 200 can generate corresponding animation effects according to the undo direction. For example, the undo direction of the image object can be from the inside to the outside or from the outside to the inside, or from the left to the right or from the right to the left, or from the top to the bottom or from the bottom to the top. It can also be set to display directly without animation effects. The specific method can be set according to the actual situation, and this application does not make specific limitations. Figure 14 (4) Taking the cancellation direction from the inside out as an example, start by canceling a portion. Figure 14 Part of (5) was cancelled, and finally, after the cancellation was completed, it was restored to the original state. Figure 14 The effect of (1) is as follows. The display device 200 can form the above-mentioned undo process into an undo frame animation and display the animation effect in the corresponding undo window. It is understood that, in response to the restore command for the image object, the display device 200 can restore the undo operation on the image object and generate a restore frame animation for the restore process, and control the display 260 to play the restore frame animation in the user interface.

[0108] In some embodiments, the processing object may include a deleted object. If the operation before undoing was deleting an object, then the undo operation is the process of restoring the deleted object. For example, the deleted object can be some independent objects. In response to the delete command, the display device 200 will delete the entire object. The deletion process can be animated, or the corresponding execution result can be displayed directly.

[0109] In some embodiments, the processing object may include an erase object. When the processing object is an erase object, the display device 200 may visually display the undo or redo process in the user interface, including the following: In response to an undo command for the erase object, the display device 200 may obtain the erase background of the erase object before erasure, then obtain the erase position of the erase object in the erase background, and obtain the redraw duration, erase path, number of erase sampling points, and time interval between each sampling point erased. The time interval is the ratio of the redraw duration to the number of erase sampling points. Then, the erase sampling points are erased one by one in reverse order of the erase path and the time interval, and the undo process is generated into an undo frame animation. Finally, the display device 260 is controlled to play the undo frame animation in the user interface.

[0110] For example, erasing an object involves an erasing action on the processed object. In some embodiments, the erasing action may include line erasing and whiteboard erasing. Line erasing refers to erasing the processed object by drawing lines. The effect of line erasing is that processed objects intersecting with the drawn lines are erased one by one. Undoing line erasing restores the erased objects one by one. Whiteboard erasing, on the other hand, erases the processed object through a path generated by the whiteboard. The effect of whiteboard erasing is that all processed objects along the path traversed by the whiteboard are erased. Undoing whiteboard erasing restores the erased objects one by one.

[0111] Figure 15 This is a schematic diagram illustrating a scenario where the erased object is removed from a display device, as provided in some embodiments of this application. Figure 15 As shown, in response to an undo command on the object to be erased, the display device 200 can acquire the erasure background of the object before erasure. Figure 15 (1) and the erase position of the erased object in the erase background. Figure 15 (2) in the middle Figure 15 In (2), the arrow direction is the erasure path and erasure direction, and the dashed part is the erasure width. The erasure sampling points can be preset, and the time interval between two adjacent sampling points can be calculated. Figure 15 (3) is the effect diagram after the erase operation is completed. When the display device 200 performs the operation to undo the erased object, it can undo the erased sampling points one by one according to the reverse order of the erase path and the time interval, such as Figure 15 (5) in the text represents the effect of canceling part of the effect. Figure 15Part of (6) was cancelled. After all cancellations are completed, it will return to the previous state. Figure 15 The effect of (1) is as follows. The display device 200 can generate an undo frame animation, and finally control the display 260 to play the undo frame animation in the user interface.

[0112] In some embodiments, the processing object may further include a full-screen editing object. When the processing object is a full-screen editing object, the display device 200 may visually display the undo or redo process in the user interface as follows: In response to an undo command on the full-screen editing object, the display device 200 may acquire the full-screen editing object before scaling or moving, and then acquire the scaling ratio or movement direction of the full-screen editing object. The full-screen editing object is then scaled in reverse according to the scaling ratio, and the scaling process is formed into a scaling undo frame animation; or the full-screen editing object is moved in reverse according to the movement direction, and the movement process is formed into a movement undo frame animation. Finally, the display 260 is controlled to play the scaling undo frame animation and / or the movement undo frame animation in the user interface.

[0113] For example, if the operation before undoing was full-screen scaling or moving, then the undo operation is the reverse of the original operation. Figure 16 This is a schematic diagram illustrating a scenario where a display device undone a full-screen editing object, as provided in some embodiments of this application. Figure 16 As shown, Figure 16 The center point in the text is the center point of the screen. If the operation before undoing was a zoom-in operation based on the center point of the screen, such as... Figure 16 In (1), the undo operation is the reverse operation of the magnification, such as... Figure 16 In step (2), the effect before magnification is achieved. The display device 200 can form a zoom-undo frame animation of the zooming process and control the display 260 to play the zoom-undo frame animation in the user interface. Similarly, zooming or panning is based on the same principle, and the restoration process is also based on the same principle, which will not be described again in this application.

[0114] In some embodiments, the processing object may further include a selected editing object. When the processing object is a selected editing object, the display device 200 may visually display the undo or redo process in the user interface as follows: In response to an undo command on the selected editing object, the display device 200 may acquire the selected editing object and the unselected object before scaling or moving, and draw the unselected object on a floating layer. Then, it may acquire the scaling ratio or movement direction of the selected editing object, and then scale the selected editing object in reverse according to the scaling ratio, and overlay the scaled-in selected editing object and the drawn unselected object; or, it may move the selected editing object in reverse according to the movement direction, and overlay the moved selected editing object and the drawn unselected object. The display device 200 then generates an undo frame animation from the reverse scaling and overlay process or the reverse movement and overlay process, and finally controls the display 260 to play the undo frame animation in the user interface. In this way, during the visualization of the undo or redo process, the user can intuitively see the processing object targeted by the undo or redo, solving the problem of the undo or redo processing object not being displayed intuitively.

[0115] For example, Figure 17 This application provides schematic diagrams illustrating scenarios where a selected editing object is deselected in a display device, as shown in some embodiments. Figure 17 As shown, editing actions for a selected object can include scaling or moving the selected object, while the undo operation is the reverse editing process for the selected object. Figure 17 In the diagram (1), the selected and unselected objects are shown before scaling or moving. The objects inside the dashed box are the selected objects, and the objects outside the dashed box are the unselected objects. Figure 17 (2) in the text refers to the zoom-out editing operation on the selected editing object. Figure 17 (3) in the image represents an unselected object drawn on the overlay, which is then... Figure 17 The interface shown in (4) depicts the editing state of the selected object, which can then be overlaid. Figure 17 (3) and Figure 17 The layer corresponding to (4) in the middle is obtained. Figure 17 The effect diagram in (5) shows the completed zoom-out editing operation on the selected editing object. When performing an undo operation on the selected editing object, the display device 200 can switch to undo according to the reverse algorithm of the selected editing object. Figure 17 The state of (6) in the process can be used to generate an undo frame animation. Similarly, zooming or panning follows the same principle, as does the restoration process, which will not be described again in this application.

[0116] As can be seen from the above technical solutions, the above embodiments provide a display device that, in response to an undo or redo instruction on a processed object, calculates the redrawing time required to redraw the processed object. If the redrawing time is less than or equal to a preset time, the undo or redo instruction is executed, and the display is controlled to redraw the execution result corresponding to the undo or redo instruction in the current user interface. If the redrawing time is greater than the preset time, the operation frequency of the undo or redo function control is obtained. In response to the operation frequency being higher than or equal to a frequency threshold, the display is controlled to display the execution result in the user interface; in response to the operation frequency being lower than the frequency threshold, when the number of clicks on the undo or redo function control is a preset number, the display is controlled to display the undo or redo window in a visual form in the user interface. When performing an undo or redo operation, the display device can combine the redrawing time of the processed object and the operation frequency of the user's operation on the undo or redo function control to determine the display method of the execution result, i.e., whether to use a quick undo or redo method or a visual display method. For the quick undo or redo method, there is no visual animation effect, and the execution result corresponding to the undo or redo is directly displayed. If it is a visual display effect, the corresponding animation process will be displayed through the undo or redo window. By storing a preset number of processed images, the problem of large image data volume can be avoided. Moreover, a new processed image is generated after each editing operation. Undo or redo operations can be performed, and the undo or redo steps are no longer restricted. This solves the problem of limited undo or redo steps when performing undo or redo operations. The visualization process of undo or redo also solves the problem of the undo or redo display not being intuitive enough.

[0117] Based on the display device 200 described above, some embodiments of this application also provide a method for undoing or resuming a visual display, which can be applied to the display device 200. In some embodiments, the method for undoing or resuming a visual display may include the following steps:

[0118] In response to a cancel or redo command on the object being processed, the display device 200 calculates the redrawing time required to redraw the object being processed.

[0119] If the redraw duration is less than or equal to the preset duration, the display device 200 executes the undo or redo command, and controls the display 260 to redraw the execution result corresponding to the undo or redo command in the current user interface;

[0120] If the redraw duration exceeds the preset duration, the display device 200 obtains the operation frequency of the undo or redo function control. In response to the operation frequency being higher than or equal to a frequency threshold, the display 260 is controlled to display the execution result in the user interface. In response to the operation frequency being lower than the frequency threshold, when the number of clicks on the undo or redo function control is a preset number, the display 260 is controlled to display the undo or redo window in the user interface in a visual form. Undo or redo includes the frame processing image stored when each processing is performed on the processing object.

[0121] As can be seen from the above technical solutions, the above embodiments provide a visual display method for undoing or redoing. The method includes determining the display method of the execution result by combining the redrawing time of the processed object and the frequency of user operation of the undo or redo function controls when performing an undo or redo operation. For quick undo or redo methods, there is no visual animation effect; the execution result corresponding to the undo or redo is directly displayed. If a visual display effect is required, the corresponding animation process is displayed through the undo or redo window. Storing a preset number of frame processing images avoids the problem of large image data volume. A new frame processing image is generated after each editing operation, and the undo or redo steps are no longer restricted, thus solving the problem of limited undo or redo steps when performing undo or redo operations. The visual process of undo or redo solves the problem of the undo or redo display being not intuitive enough.

[0122] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0123] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0124] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0125] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The display is configured to show a user interface, which includes undo and redo controls. The controller is configured as follows: In response to a cancel or redo command on the object being processed, calculate the redraw duration required to redraw the object being processed. If the redraw duration is less than or equal to the preset duration, execute the undo command or the restore command, and control the display to redraw the execution result corresponding to the undo command or the restore command in the current user interface; If the redraw duration is greater than a preset duration, the operation frequency of the undo or redo function control is obtained. In response to the operation frequency being higher than or equal to a frequency threshold, the display is controlled to show the execution result in the user interface. In response to the operation frequency being lower than the frequency threshold, when the number of clicks on the undo or redo function control is a preset number, the display is controlled to show the undo or redo window in the user interface in a visual form. The undo or redo includes the frame processing image stored when each processing is performed on the processing object.

2. The display device according to claim 1, characterized in that, The controller is further configured to: In response to creating a new processing object and processing instructions to perform processing on the processing object or an existing processing object, a preset number of frame-processed images obtained after processing the processing object are stored. The frame-processed images are continuous, and the last frame-processed image is the image displayed in the user interface showing the completed processing of the object.

3. The display device according to claim 1, characterized in that, The step of the controller performing the calculation of the redraw time required to redraw the processed object is further configured to: Obtain the number of objects contained in the processing object, the types of objects, the duration of drawing each object in the processing object, and the redraw time coefficient of each object type; The redrawing time required to redraw the processed object is calculated based on the number of objects, the type of objects, the duration, and the redrawing time coefficient.

4. The display device according to claim 1, characterized in that, The controller, which performs the step of controlling the display to show the execution result in the user interface, is further configured to: In response to the undo command, the number of clicks on the undo function control is recorded, wherein the number of clicks is greater than or equal to 2; Control the display to show the undo frame animation of the undo function in the overlay of the current user interface; The first sub-thread calculates the first operation data for undoing the processing object to the penultimate step, draws the first operation data on the current user interface, and saves the first frame processing image data corresponding to the first operation data; the second sub-thread calculates the second operation data for undoing the processing object to the penultimate step, and saves the second frame processing image data corresponding to the second operation data. Detect the execution progress of the undo frame animation and the first frame processed image data; If the undo frame animation has been generated and the first frame processed image data has not been drawn, continue drawing the first frame processed image data until the first frame processed image data and the second frame processed image data are drawn. If the first frame processed image data has been drawn and the undo frame animation has not been generated, delete the overlay and control the display to show the execution result corresponding to the first frame processed image data in the user interface.

5. The display device according to claim 1, characterized in that, The processing object includes a writing object, and the controller, which performs the step of controlling the display to visually display the undo or redo process in the user interface, is further configured to: In response to an undo command on the writing object, the current frame processing image is obtained, wherein the current frame processing image is a processing image of writing along the writing direction against a writing background; Extract sampling points, sampling point order, number of sampling points, and time interval for drawing sampling points from the current frame processed image; the time interval is the ratio of the redrawing time of the writing object to the number of sampling points; The sampling points are cancelled one by one in reverse order of the time interval and sampling point order, and the cancellation or restoration process is generated into a cancellation frame animation. Control the display to play the undo frame animation in the user interface.

6. The display device according to claim 1, characterized in that, The processing object includes the inserted image object, and the controller performs the step of controlling the display to visually display the undo or redo process in the user interface, and is further configured to: In response to an undo command on an image object, obtain the background of the image object that was inserted; Obtain the insertion position of the image object in the background; The background area corresponding to the image object is determined based on the insertion position and the background. Sets the undo direction when the image object is undoed in the background area; The image object is revoked according to the revocation direction, and the revocation process is generated into an revocation frame animation; Control the display to play the undo frame animation in the user interface.

7. The display device according to claim 1, characterized in that, The processing object also includes an erase object, and the controller, which performs the step of controlling the display to visually display the undo or redo process in the user interface, is further configured to: In response to an undo command on the erased object, obtain the erase background of the erased object before erasure; Obtain the erasure position of the object in the erasure background; The redraw duration, erase path, number of erase sampling points, and time interval between each erase sampling point are obtained for the erased object; the time interval is the ratio of the redraw duration to the number of erase sampling points. The erase sampling points are revoked one by one in reverse order of the erase path and the time interval, and the revocation process is generated into an revocation frame animation. Control the display to play the undo frame animation in the user interface.

8. The display device according to claim 1, characterized in that, The processing object also includes a full-screen editing object, and the controller, which performs the step of controlling the display to visually display the undo or redo process in the user interface, is further configured to: In response to an undo command on a full-screen edit object, retrieve the full-screen edit object before scaling or moving; Obtain the scaling ratio or movement direction of the full-screen editing object; The full-screen editing object is scaled in reverse according to the stated scaling ratio, and the scaling process is formed into a scaling undo frame animation; or the full-screen editing object is moved in reverse according to the stated movement direction, and the movement process is formed into a movement undo frame animation. Control the display to play the zoom undo frame animation and / or the move undo frame animation in the user interface.

9. The display device according to claim 1, characterized in that, The processing object also includes a selected editing object, and the controller performs the step of controlling the display to visually display the undo or redo process in the user interface, further configured to: In response to an undo command on a selected editable object, retrieve the selected editable object and the unselected object before scaling or moving; Draw unselected objects on the overlay; Obtain the scaling ratio or movement direction of the selected edit object; The selected editing object is scaled in reverse according to the scaling ratio, and the scaled-in reverse selected editing object and the drawn unselected object are superimposed; or, the selected editing object is moved in reverse according to the movement direction, and the moved-in reverse selected editing object and the drawn unselected object are superimposed. Generate undo frame animations from the reverse scaling and overlay process or the reverse moving and overlay process. Control the display to play the undo frame animation in the user interface.

10. A visual display method for undoing or redoing, characterized in that, Applied to the display device according to any one of claims 1-9, the display device comprising a display and a controller, the method comprises: In response to a cancel or redo command on the object being processed, calculate the redraw duration required to redraw the object being processed. If the redraw duration is less than or equal to the preset duration, execute the undo command or the restore command, and control the display to redraw the execution result corresponding to the undo command or the restore command in the current user interface; If the redraw duration is greater than a preset duration, the operation frequency of the undo or redo function control is obtained. In response to the operation frequency being higher than or equal to a frequency threshold, the display is controlled to show the execution result in the user interface. In response to the operation frequency being lower than the frequency threshold, when the number of clicks on the undo or redo function control is a preset number, the display is controlled to show the undo or redo window in the user interface in a visual form. The undo or redo includes the frame processing image stored when each processing is performed on the processing object.

Images