Display device and trajectory drawing method

Abstract

The invention provides a display device and a trajectory drawing method, and the method can respond to a touch instruction input by a user, detect a newly added trajectory point in a touch trajectory, and erase a historical endpoint graph when the newly added trajectory point is detected. The historical endpoint graph is an endpoint graph associated with historical track points, and the historical track points are track points in the previous sampling frame. A path track is drawn on the basis of the newly-added track points and the historical track points, an endpoint graph is added to the tail end of the path track, and the path track is a line drawing track between the historical track points and the newly-added track points. Finally, a refreshing area is defined, the refreshing area is refreshed on the user interface, and the refreshing area comprises the area where the historical endpoint graph is located, the area where the path track is located and the area where the endpoint graph at the tail end of the path track is located. According to the method, a segmentation method is adopted, the part needing to be erased and redrawn after drawing and the part not needing to be erased and redrawn after drawing are drawn and refreshed separately, and therefore the track line drawing speed is increased.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a trajectory drawing method. Background Art

[0002] Display devices refer to terminal devices that can output specific display images, which can be terminal devices such as smart TVs, communication terminals, smart advertising screens, projectors, etc. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.

[0003] For display devices that support touch interaction, you can run a whiteboard application and implement writing or drawing functions based on the touch actions input by the user. In order to increase the diversity of line drawing, the display device can set multiple line drawing types, for example, setting a pen tip model at the end of the line drawing, adding a pen tip prediction effect at the end of the line drawing, and adding a decorative head such as an arrow at the end of the line drawing. For another example, the line drawing can be set to a line type such as a dotted line.

[0004] However, for lines with end effects, the end position keeps changing during the drawing process, which will cause the drawn lines to be erased and redrawn continuously. For different line types, in order to ensure the display effect of the lines, it is also necessary to continuously erase and redraw the drawn path lines during the drawing process, thereby reducing the drawing speed. Summary of the invention

[0005] The present application provides a display device and a trajectory drawing method to solve the problem of slow drawing speed of the display device.

[0006] In a first aspect, an embodiment of the present application provides a display device, comprising: a display and a controller. The display is configured to display a user interface. The display is connected to a touch interaction module, and the touch interaction module is used to receive a touch instruction input by a user. The controller is configured to execute the following program steps:

[0007] In response to a touch command input by a user, detecting a newly added track point in a touch track;

[0008] When a new track point is detected, a historical endpoint graphic is erased, where the historical endpoint graphic is an endpoint graphic associated with a historical track point, where the historical track point is a track point in a previous sampling frame;

[0009] Drawing a path track based on the newly added track point and the historical track point, and adding an endpoint graphic at the end of the path track, the path track being a line drawing track between the historical track point and the newly added track point;

[0010] A refresh area is defined, and the refresh area is refreshed on the user interface, wherein the refresh area includes an area where the historical endpoint graphics are located, an area where the path track is located, and an area where the endpoint graphics at the end of the path track are located.

[0011] In a second aspect, an embodiment of the present application further provides a trajectory drawing method, which is applied to the above-mentioned display device, comprising:

[0012] In response to a touch command input by a user, detecting a newly added track point in a touch track;

[0013] When a new track point is detected, a historical endpoint graphic is erased, where the historical endpoint graphic is an endpoint graphic associated with a historical track point, where the historical track point is a track point in a previous sampling frame;

[0014] Drawing a path track based on the newly added track point and the historical track point, and adding an endpoint graphic at the end of the path track, the path track being a line drawing track between the historical track point and the newly added track point;

[0015] A refresh area is defined, and the refresh area is refreshed in the user interface, wherein the refresh area includes an area where the historical endpoint graphics are located, an area where the path track is located, and an area where the endpoint graphics at the end of the path track are located.

[0016] In a third aspect, an embodiment of the present application further provides a trajectory drawing method, which is applied to the above-mentioned display device, comprising:

[0017] In response to a touch command input by a user, detecting a newly added track point in a touch track;

[0018] When a new track point is detected, a historical drawing line is erased, where the historical drawing line is a drawing line drawn according to a starting point and a historical track point, where the historical track point is a track point of a previous sampling frame, and the starting point is a touch position where a drop event is generated in the touch instruction;

[0019] Redrawing the drawing line indicated by the touch control instruction according to the starting point and the newly added track point;

[0020] Delimiting a refresh area according to the historical track points and the newly added track points;

[0021] The refresh area is refreshed in the user interface.

[0022] It can be seen from the above technical solutions that the present application provides a display device and a trajectory drawing method, which can respond to the touch command input by the user, detect the newly added trajectory point in the touch trajectory, and erase the historical endpoint graphics when the newly added trajectory point is detected. The historical endpoint graphics are the endpoint graphics associated with the historical trajectory points, and the historical trajectory points are the trajectory points in the previous sampling frame. Then, based on the newly added trajectory points and the historical trajectory points, the path trajectory is drawn, and the endpoint graphics are added at the end of the path trajectory. The path trajectory is the line drawing trajectory between the historical trajectory points and the newly added trajectory points. Finally, the refresh area is defined, and the refresh area is refreshed in the user interface. The refresh area includes the area where the historical endpoint graphics are located, the area where the path trajectory is located, and the area where the endpoint graphics at the end of the path trajectory are located. The method adopts a segmentation method to draw and refresh the part that needs to be erased and redrawn after drawing separately from the part that does not need to be erased and redrawn after drawing, thereby improving the drawing speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0024] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0025] Figure 2 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0026] Figure 3 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0027] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0028] Figure 5 A schematic diagram of operating parameters of touch interaction data provided by some embodiments of the present application;

[0029] Figure 6 A schematic diagram of a whiteboard interface provided for some embodiments of the present application;

[0030] Figure 7 A structural diagram of a display system provided for some embodiments of the present application;

[0031] Figure 8 A schematic diagram of an acceleration layer and an OSD layer provided for some embodiments of the present application;

[0032] Fig. 9 A schematic diagram of a set square provided for some embodiments of the present application;

[0033] Fig.10 A schematic diagram of a pen stroke effect provided in some embodiments of the present application;

[0034] Fig.11 A schematic diagram of a line drawing with a decorative head provided for some embodiments of the present application;

[0035] Fig.12 A schematic diagram of dashed lines provided for some embodiments of the present application;

[0036] Fig.13 A schematic diagram of a line drawing with an arrowhead added to the end provided in some embodiments of the present application;

[0037] Fig.14 A schematic diagram of a flow chart of a trajectory drawing method provided in some embodiments of the present application;

[0038] Fig.15 A structural diagram of a line drawing with an arrowhead added to the end provided in some embodiments of the present application;

[0039] Fig.16 A schematic diagram of drawing arrow endpoint graphics provided in some embodiments of the present application;

[0040] Fig.17 A schematic diagram of drawing a T-shaped endpoint graph provided in some embodiments of the present application;

[0041] Fig.18 A schematic diagram of drawing an X-shaped endpoint graph provided in some embodiments of the present application;

[0042] Fig.19 A schematic diagram of a refresh area provided in some embodiments of the present application;

[0043] Fig. 20 A schematic diagram of another refresh area provided for some embodiments of the present application;

[0044] Fig.21 A schematic diagram of a straight line provided for some embodiments of the present application;

[0045] Fig. 22 A schematic diagram of dotted lines drawn when the input speeds of touch actions provided in some embodiments of the present application are different;

[0046] Fig.23 A dotted line drawing flow chart provided for some embodiments of the present application;

[0047] Fig.24 A schematic diagram of dashed lines provided for some embodiments of the present application;

[0048] Fig.25 A dotted line schematic diagram of adding an arrow decorative head to the end provided in some embodiments of the present application. DETAILED DESCRIPTION

[0049] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0050] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0051] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0052] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0053] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0054] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0055] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through the mobile terminal 300 and the control device 100 .

[0056] In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0057] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0058] In addition to providing the broadcast receiving television function, the display device 200 may also provide an intelligent network television function with computer support functions, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0059] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0060] In some embodiments, the display device 200 includes at least one of a tuner 210 , a communicator 220 , a detector 230 , a device interface 240 , a controller 250 , a display 260 , an audio output interface 270 , a memory, a power supply, and a communication device interface 280 .

[0061] In some embodiments, the communicator 220 is a component for communicating with an external device or a server 400 according to various communication protocol types.

[0062] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0063] In some embodiments, the device interface 240 may include, but is not limited to, any one or more of the following interfaces: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0064] For example, in order to enrich the display types of the display device 200, an HDMI interface and a USB interface may be provided on the display device 200, wherein the HDMI interface may be connected to a device having video and audio input / output functions, and the corresponding audio and video output / input functions may be realized through the HDMI driver. The USB interface may be connected to a device having signal and data transmission functions and interactive functions, and based on the USB driver, access signals, transmit data, and perform specific interactive actions.

[0065] In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0066] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0067] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0068] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from a controller, display video content, image content, and a menu control interface component and a user control UI interface, etc.

[0069] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0070] In some embodiments, the display device 200 may also support touch interaction, that is, a touch interaction module may be provided on the display device 200, and the touch interaction module may be a built-in module or an external module. For example, in order to implement touch interaction operations, a touch panel (TP) may be provided on the display 260 of the display device 200, and the touch panel may receive touch signals input by fingers, contacts, styluses, etc., and execute touch interaction responses according to a pre-set interaction strategy. Of course, the display device 200 may also be a touch-integrated screen.

[0071] For the display device 200 with an external touch interaction module, a terminal, device, or component with a touch function can be connected through the device interface 240 of the display device 200. For example, the USB or USB-C interface of the display device 200 is connected to a touch panel, and the touch panel can receive the touch data input by the user in real time and transmit the touch data to the display device 200 through the USB channel. The display device 200 can perform an interactive response based on the received touch data in combination with the touch application, so that the display device 200 supports touch interaction operations.

[0072] In some embodiments, the communication device interface 280 is an interface that can be used to receive control input.

[0073] Figure 3 Some embodiments of the present application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 includes a controller 110 , a communication interface 130 , a user input / output interface, a memory 190 , and a power supply 180 .

[0074] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0075] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0076] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0077] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0078] The communication interface 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0079] The user input / output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .

[0080] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0081] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0082] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0083] Figure 4 Some embodiments of the present application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0084] The application layer mainly includes commonly used applications on TV and application frameworks. Common applications are mainly applications developed based on browsers, such as HTML5 APPs and native APPs.

[0085] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0086] Native apps can support online or offline, message push or local resource access.

[0087] The middleware layer includes various TV protocols, multimedia protocols, system components and other middleware. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.

[0088] The hardware layer mainly includes the hardware abstraction layer (HAL) interface, hardware and drivers. The HAL interface is a unified interface for all TV chips to connect, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0089] For a display device 200 that supports touch interaction operations, the touch interaction data input by the user can be received through the touch interaction module. According to the interaction principle of the touch interaction module, the touch interaction module can detect relevant parameters in the touch action. For example, a capacitive touch layer is provided on the display 260 of the display device 200. When the user's finger touches any position of the touch layer, the capacitance of the touch layer at the touch position will change. At this time, the touch interaction module can record the position of the capacitance change, and record the time when the capacitance change occurs in combination with the timer in the controller to generate touch interaction data.

[0090] In some embodiments, the physical signal detected by the touch interaction module needs to be converted before it can be read by the controller 250 of the display device 200. For example, the analog signal of the capacitance change needs to be converted into a digital signal and then transmitted to the controller 250 of the display device 200. In order to adapt to the screen display process of the display device 200, the touch data detected by the touch interaction module also needs to be coordinate mapped so that the position point corresponding to the touch data can have a corresponding relationship with the display 260 of the display device 200 or the pixel point in the user interface. For example, the coordinate position detection accuracy of the touch interaction module is 65536×65536, and the resolution of the display 260 of the display device 200 is 3840×2160. After the touch interaction module detects the touch data, the coordinate mapping of the touch point position in the width and height directions can be performed according to the ratio of 65536 / 3840 and 65536 / 2160, so that the display device 200 can perform related operation responses based on the mapped touch point position coordinates.

[0091] The touch interaction data may include different operation parameters according to the user's input method. Figure 5 As shown, the touch data may include the touch time, touch position, touch event type, number of touch points, etc. of the touch operation. In a touch interaction process, the touch event types that can be detected by the touch interaction module include: the down event, move event, and up event of the touch action. Corresponding to the entire touch track, a starting point, a track point, and an end point can be formed. Each touch event records the corresponding touch time and touch position.

[0092] In the process of executing the touch interaction response, the display device 200 can classify different touch times, touch positions, the number of touch points, and the type of touch events, so as to detect the user's touch input gesture, thereby performing different interactive responses for different input gestures. For example, when the number of touch points in the touch data detected by the touch interaction module is 1, the touch event type only includes a down event and an up event, and the time interval between the down event and the up event is less than the single-click event time threshold, and the touch position change distance of the down event and the up event is less than the jitter distance threshold, it can be determined that the current user's touch input gesture is a click gesture. Based on the click gesture, the display device 200 executes the operation of starting the application according to the icon in the area where the touch position corresponding to the click gesture is located.

[0093] Similarly, the display device 200 can also detect other touch interaction gestures input by the user based on the touch time, touch position, number of touch points and touch event type, such as double-click gesture, slide gesture, long press gesture, multi-finger click gesture, multi-finger slide gesture, etc. Different interaction gestures can derive different touch parameters. For example, a slide gesture can also generate parameters such as slide distance, slide speed, slide direction, slide track shape, etc. Different touch parameters can be used to perform different interactive controls.

[0094] In some embodiments, in order to enrich the touch interaction types supported by the display device 200, the display device 200 can also perform complex gesture detection based on the dynamic change rules of touch time, touch position, number of touch points and touch event type. For example, when the touch interaction module detects that the touch data input by the user includes multiple touch points, and the touch position of each touch point is close to each other as the user inputs, it can be determined that the touch gesture currently input by the user is a grab gesture. Based on complex gesture detection, the display device 200 can perform more interactive responses. For example, when the detected touch gesture is a grab operation for an image view, the display device 200 can respond to the grab gesture and perform a control action to move the image display position.

[0095] In some embodiments, the touch gesture can also be combined with the touch position to form a touch interaction operation based on a specific position. For example, when the touch interaction module detects that the down event position during the touch operation is at the top of the display 260, the touch point position corresponding to the move event moves downward. When the up event is detected, the display device 200 can determine that the current touch gesture is to slide down from the top of the screen. Therefore, the display device 200 can respond to the touch gesture and control the display 260 to present a drop-down list.

[0096] Some touch interaction gestures can be used to perform interactive actions based on the operating system of the display device 200, which are called global gestures. For example, the operation of sliding down from the top of the screen to call out a drop-down list in the above example of the display device 200. Some touch interaction gestures can be used to perform interactive actions based on specific touch applications. For example, when the display device 200 runs a whiteboard application, the sliding touch operation input by the user can be used to draw a track line on the whiteboard.

[0097] The touch application can be a system application or a third-party application developed based on a specific display device type and user needs. The touch application can be installed in the display device 200 and started to run under user control. For example, the user can control the display device 200 to run the whiteboard application by clicking the "whiteboard" application icon in the application interface of the display device 200.

[0098] It should be noted that the above-mentioned whiteboard application can be an independent application, an associated application, or a functional module in a touch application. Different forms of whiteboard applications can have different startup methods. For example, a user can start an independent whiteboard application through the application interface of the display device 200; a user can also start a whiteboard application by executing a "whiteboard" operation on a conference application; a user can also control the conference application to start the whiteboard functional module by clicking the "whiteboard" icon on the conference application.

[0099] Different forms of whiteboard applications may present different forms of whiteboard application interfaces after startup. For example, when a user starts a whiteboard application in an associated application form, the display device 200 may automatically enter a dual-screen (or split-screen) mode. In the dual-screen (or split-screen) mode, the display device 200 may display a user interface through two display areas, i.e., the main screen displays the original application (such as a conference application) interface, and the secondary screen displays the whiteboard application interface.

[0100] After the whiteboard application is running, the display device 200 can be switched to display a whiteboard interface. Figure 6 As shown, the whiteboard interface may include drawing tool controls for drawing operations, such as pen shape, graphics, line shape, color, erase, clear screen, selection, etc. The user can click any control to draw graphics according to specific drawing needs.

[0101] like Figure 7 As shown, the display device 200 can render and display the drawing picture in real time through an image generation (Image Producer) module, an image rendering (surface flinger) module, a synthesis (Composer) module, a video process (Video Processing Unit hardware, VPU hardware) module and a display (screen).

[0102] In the process of displaying the drawn picture, the graphics interface (openGLES) of the image generation module can be connected to the whiteboard application to generate the drawn image content and pass the image content to the image rendering module. The image rendering module is used to control the display 260 to display the content, that is, to render the image content through the user interaction layer (UI layer) or the video layer (video layer) according to the image content. In order to obtain a better display effect, the image content of the UI layer can be rendered by the GPU component, so as to form a picture frame for display in the synthesis module. Among them, the synthesis module can form the picture content by software or hardware, for example, the synthesis module can be a hardware synthesis (Hardware Composer, HWC) module.

[0103] In the synthesis module, the picture frames can be stored through the frame buffer and the video buffer, and the picture content can be formed in the corresponding layers through the video process module. That is, the image frames generated by the video playback process form the picture content through the video plane, and the image frames of other image pictures (such as touch tracks, graphics, etc.) form the picture content through the primary OSD plane. Finally, the display device 200 forms the final picture through the blending unit of the video process module and displays it on the display 260.

[0104] Since the whiteboard application will present the user's touch trajectory in real time according to the user's touch operation, in order to present a better real-time response effect, the display device 200 should shorten the touch action input time and the delay time of the drawing result display. To this end, in some embodiments, the display device 200 can present a real-time painting effect by setting an acceleration layer. That is, in the video process module of the display device 200, an additional extended display layer (external OSD plane) can be set on the basis of the main OSD layer and the video layer. Among them, the extended display layer can be configured with different layer characteristics according to the specific display effect requirements. For example, the bitmap refresh mode of the extended display layer can be modified so that the extended display layer is refreshed in real time according to the region, thereby improving the display speed of the graphics. At this time, the extended display layer can be used as an acceleration layer in scenes with high dynamic display effects.

[0105] Taking the display device 200 running a whiteboard application as an example, in order to improve the real-time response speed of the line drawing process, after detecting the user's touch operation, the touch track can be drawn in real time on the extended display layer (acceleration layer). Figure 8As shown, the display level of the acceleration layer can be higher than other layers, and when the user completes the touch input, the lines drawn by the acceleration layer are updated to other layers, thereby reducing input delay and improving the real-time display effect of the whiteboard application drawing process.

[0106] In some embodiments, the extended display layer can also work together with other graphics to improve display quality. For example, the acceleration layer can respond to the touch events input by the user at the same time as the main OSD layer, and draw graphics separately. However, since the acceleration layer is displayed above the main OSD layer, the graphics drawn by the acceleration layer can block the graphics drawn by the OSD layer to maintain real-time response speed. After the user inputs the touch interaction action, the content displayed by the acceleration layer can be released directly, and the OSD layer directly forms the drawn graphics, so there is no need for the acceleration layer to refresh the drawn graphics to the OSD layer, reducing the graphics mixing time. It not only improves the real-time display effect of the graphics drawing process, but also improves the final presentation quality of the graphics drawing.

[0107] In some embodiments, in order to meet different user needs, the whiteboard application can also dynamically configure different interface contents. Fig. 9 As shown, a "teaching tool" option may be included in a whiteboard application run by a display device 200 applied to the field of education. When a user clicks on the teaching tool option, a teaching tool list may pop up. The teaching tool list may include tool options of the type "ruler", "set square", "protractor", etc. After the user clicks on the "set square" tool option, the "set square" tool may be called to assist in drawing. At this time, the display device 200 may add a movable set square tool graphic to the whiteboard drawing interface, and when the user's touch operation track approaches the edge of the set square tool graphic, a straight line segment may be drawn along the edge of the set square tool graphic.

[0108] In some embodiments, the whiteboard application can also store the graphic objects drawn by each user touch action. Among them, a touch action refers to the process from the user's finger (or stylus) contacting the touch layer to the user's finger (or stylus) leaving the touch layer. That is, if the user inputs a click action, a touch action should include a down event and an up event. If the user inputs a sliding action, a touch action should include a down event, a move event, and an up event. Each touch action can generate a drawing object, and the whiteboard application can record the drawing object, so that the user can perform actions such as selection, undo, and redo.

[0109] When storing graphics, the whiteboard application can also set associated information for the graphic object according to the graphic characteristics and input status. For example, after the user draws a straight line, the whiteboard application can set a shape identifier for the straight line object. The shape identifier can be stored in association with the straight line object and can be called by other modules of the whiteboard application or other applications to facilitate operations such as object selection, object retrieval, and object deletion.

[0110] In some embodiments, the whiteboard application interface may also provide drawing auxiliary tools and menus for adjusting the drawing content. For example, the whiteboard application interface may include a "select" tool, and when the user clicks the "select" tool icon, the whiteboard application may be controlled to enter the object selection mode. In the object selection mode, the display device 200 may call the drawing object that intersects with the touch position based on the touch position under the down event, move event, and / or up event in the user's touch interaction operation, so as to achieve the purpose of multi-graphic selection.

[0111] In some embodiments, the whiteboard application may also support multiple gesture interaction operations, and have different control functions for different gesture interaction operations. For example, the whiteboard application may move the whiteboard drawing area along the multi-finger sliding track in response to the user's multi-finger sliding operation. The whiteboard application may also execute an erase function in response to the user's entire palm sliding operation to erase the drawing graphics covered by the palm sliding operation track.

[0112] In some embodiments, in order to improve the diversity of line drawing, the whiteboard application can also set multiple line drawing types, and then different types of line drawing can be drawn according to the touch action input by the user. For example, the user can click the "Line" control in the toolbar provided by the whiteboard application to call out the line selection menu, and click any line option according to the specific drawing needs to set the line drawing type. For example, Fig.10 As shown in FIG. 1 , the user selects the “pen stroke effect” option. When the user writes or draws on the whiteboard application, the whiteboard application can set a pen stroke effect for the handwriting. Fig.11 As shown in FIG. 1 , the user selects the “Decoration Head” option. When the user writes or draws on the whiteboard application, the whiteboard application can add a decoration head at the end of the writing. Fig.12 As shown, the user can also select the "dotted line" option. When the user writes text or draws on the whiteboard application, the whiteboard application can process the handwriting to make the handwriting present a dotted line effect.

[0113] In some embodiments, the whiteboard application is a graphic object drawn according to each touch action input by the user. Among them, for a display device 200 that supports touch interaction operations, the touch action input by the user can be received through a touch interaction module. For example, the touch interaction module is a touch layer set on the screen of the display 260 of the display device 200. A touch action refers to the process from the user's finger (or stylus) contacting the touch layer to the user's finger (or stylus) leaving the touch layer. That is, if the user inputs a click action, a touch action should include a down event and an up event. If the user inputs a sliding action, a touch action should include a down event, a move event, and an up event. Corresponding to the entire touch track, a starting point, a track point, and an end point can be formed.

[0114] Therefore, for the above-mentioned line drawing with end effect, in order to ensure the display effect, during the drawing process, the display device 200 needs to detect the newly added track points in the touch action according to the preset sampling frame rate, and continuously update the end effect of the line drawing according to the position of the newly added track points. Fig.13 As shown, taking the line drawing with an arrow decoration head added at the end as an example, during the drawing process, the display device 200 detects through the touch interaction module that the trajectory points of two adjacent sampling frames are points P1 and P2, that is, the touch action input by the user moves from point P1 to point P2. In order to display the line drawing effect with the end effect, the display device 200 needs to erase the line drawing between the starting point P0 and the trajectory point P1, redraw the line drawing between the starting point P0 and the trajectory point P2, and refresh the redrawn line drawing on the display 260. As a result, the line drawing along the user's touch trajectory always has an arrow decoration head.

[0115] Similarly, for different line types, in order to ensure the display effect of the line, it is also necessary to continuously erase and redraw the drawn path line according to the changes in the trajectory points during the drawing process. For example, taking the drawing of a dotted line as an example, in order to keep the intervals between the dotted line points in the dotted line consistent, during the drawing process, the display device 200 detects the newly added trajectory points in the touch action input by the user according to the preset sampling frame rate. When the newly added trajectory points are detected, the drawn dotted line is erased, and the dotted line is redrawn according to the starting point and the newly added trajectory points. Finally, the redrawn dotted line is refreshed and displayed on the display 260.

[0116] Obviously, the above trajectory line drawing method requires continuous erasing and redrawing of the line, resulting in a decrease in the drawing speed.

[0117] In order to improve the line drawing speed, some embodiments of the present application provide a trajectory line drawing method, which is applied to a display device 200. The display device 200 to which the trajectory line drawing method can be applied includes: a display 260 and a controller 250. The display 260 is configured to display a user interface. The display 260 is connected to a touch interaction module, and the touch interaction module is used to receive a touch instruction input by a user. The controller 250 is configured to execute the above-mentioned trajectory line drawing method, such as Fig.14 As shown, Fig.14 The schematic diagram of the flow chart of the trajectory drawing method provided in the embodiment of the present application specifically includes the following contents:

[0118] In order to improve the drawing speed, when the display device 200 is running the whiteboard application, it can respond to the touch command input by the user based on the touch interaction module, and use the segmentation method to draw and refresh the part that needs to be erased and redrawn after drawing separately from the part that does not need to be erased and redrawn after drawing. That is, with the touch command input by the user, the display device 200 can detect the newly added track point according to the preset sampling frame rate, and when the newly added track point is detected, the historical endpoint graphic is erased. Among them, the historical endpoint graphic is the endpoint graphic associated with the historical track point, and the historical track point is the track point of the previous sampling frame.

[0119] After erasing the historical endpoint graphics, a path track is drawn based on the newly added track points and the historical track points, and an endpoint graphic is added at the end of the path track. The path track is a line drawing track between the historical track points and the newly added track points. Finally, the erased and redrawn content is refreshed to the user interface presented by the display 260, thereby completing a line drawing update.

[0120] For example, when the user controls the touch point to move on the touch interaction module of the display device 200, the touch interaction module can collect the track point according to the preset sampling frame rate and send the collected track point data to the controller 250 of the display device 200. Fig.15 Taking the arrow line drawing shown as an example, for the line drawing with an arrow decoration head added at the end, as the user touch point changes, the part that does not need to be redrawn is the line body part Path1 between the starting point P0 and the track point P1. The parts that need to be erased and redrawn are the arrow part Path2 corresponding to the track point P1, the arrow part Path4 corresponding to the track point P2, and the path part Path3 between the track point P1 and the track point P2.

[0121] When the controller 250 of the display device 200 receives the newly added track point P2, it erases the historical endpoint graphic associated with the historical track point P1, that is, the arrow part Path2. Then, it draws the path track Path3 between the track point P1 and the track point P2, and adds an endpoint graphic, that is, the arrow part Path4, at the end of the path track Path3.

[0122] Similarly, when a new track point P3 is detected, the arrow part of track point P2 can be erased according to the above steps, the path track between track point P2 and track point P3 can be drawn, and the arrow part can be added at the end of the path track. In this way, the end effect of the line drawing is continuously updated with the position of the new track point.

[0123] For line drawing with end effects (endpoint graphics), only the position of the endpoint graphics is updated as the user inputs the touch trajectory. Therefore, in order to improve the drawing speed, for the drawing of the endpoint graphics, since the endpoint graphics change direction according to the user's touch trajectory, the endpoints of the endpoint graphics can be calculated based on the touch trajectory and the trigonometric function relationship, and then the endpoints are connected according to the types of different endpoint graphics to form the corresponding endpoint graphics. The display device 200 can obtain the line drawing type set by the user before inputting the touch command, calculate the endpoints of the endpoint graphics according to the line drawing type, path trajectory and historical trajectory points, and connect the endpoints according to the line drawing type to complete the drawing of the endpoint graphics.

[0124] For example, Fig.16 As shown, Fig.13 Take the drawing of the arrow head as an example. The endpoint graphics to be drawn are two straight lines with an angle of 30° with the path trajectory and a side length of L. According to the touch trajectory and the trigonometric function relationship, the coordinates of the three endpoints (A, B, C) of the endpoint graphic (arrow) can be calculated. And according to the line drawing type of the endpoint graphic, connect endpoint A with endpoint B, and connect endpoint C with endpoint B to form an arrow.

[0125] Similarly, if Fig.17 As shown, for Fig.11 The drawing of the T-shaped and X-shaped endpoint graphics shown in the figure requires that the T-shaped endpoint graphics to be drawn is a straight line with an angle of 90° with the path track and a side length of L. According to the touch track and the trigonometric function relationship, the coordinates of the endpoints (A, B, C) of the endpoint graphics can be calculated. And according to the line drawing type of the endpoint graphics, the endpoints are connected to form a T-shaped endpoint graphics.

[0126] like Fig.18 As shown, for Fig.11 The X-shaped endpoint graphics shown in the figure need to be drawn as two straight lines with an angle of 45° with the path track and a side length of L. According to the touch track and the trigonometric function relationship, the coordinates of the endpoints (A, B, C, D, E) of the endpoint graphics can be calculated. And according to the line drawing type of the endpoint graphics, the endpoints are connected to form an X-shaped endpoint graphics.

[0127] by Fig.15Taking the arrow drawing line shown as an example, when drawing the arrow portion Path4, the display device 200 can directly query the endpoint graphic of the arrow type in the endpoint graphic library and paste it to the end of the path track Path3.

[0128] In some embodiments, in order to achieve a real-time drawing effect, the display device 200 can draw a touch track in real time in an extended display layer (acceleration layer). That is, in response to a down event generated by a touch instruction input by a user, the extended display layer is called to draw the touch track in real time in the extended display layer. In other words, the above-mentioned drawing operations of erasing historical endpoint graphics, drawing path tracks, and adding endpoint graphics at the end of the path track can all be drawn and refreshed in real time in the extended display layer. When an up event generated by a touch instruction input by a user is detected, it means that a touch track has been drawn, and the touch track in the extended display layer can be refreshed to the display layer (OSD layer) in response to the up event. Thereby improving the display speed of the graphics.

[0129] Since the entire line drawing process is executed and displayed on the extended display layer, for the erasing operation of the endpoint graphics, if the extended display layer has no background and is a transparent display layer, you can use the redrawing method, that is, you can use the brush clear mode (PorterDuff.Mode.CLEAR mode) to redraw the drawn path to achieve the purpose of erasing. If the extended display layer itself has a background, you can use the above redrawing method or the background overlay method.

[0130] The clear mode refers to a mixed mode in which the source path and the target path are superimposed, so that the transparency value (alpha value) and the color value (RGB value) of the intersection area of ​​the source path and the target path are both 0, so that the intersection area is displayed transparently. That is, the display device 200 can create a brush, set the brush to the clear mode, redraw the historical endpoint graphic on the historical endpoint graphic based on the clear mode, and set the alpha value and the RGB value of the intersection area of ​​the redrawn historical endpoint graphic and the historical endpoint graphic to 0, so that the intersection area of ​​the redrawn historical endpoint graphic and the historical endpoint graphic is transparent, thereby realizing the erasing operation.

[0131] When erasing the historical endpoint graphic, the display device 200 sets the drawing color to a transparent color, and redraws the historical endpoint graphic using the transparent color on the historical endpoint graphic. In other words, a completely transparent historical endpoint graphic is drawn at the location of the historical endpoint graphic, so that the transparent historical endpoint graphic covers the original historical endpoint graphic, thereby implementing the erasing operation.

[0132] In some embodiments, the above step of refreshing the display of the erased and redrawn content can refresh the entire user interface. In order to increase the drawing speed, a refresh area can be set. That is, in some embodiments, the display device 200 can define a refresh area and refresh the refresh area in the user interface. The refresh area includes the area where the historical endpoint graphics are located, the area where the path track is located, and the area where the endpoint graphics at the end of the path track are located.

[0133] The refresh area may be a closed graphic area constructed based on the historical endpoint graphics, the path track, and the endpoint graphics at the end of the path track. Fig.19 FIG. 1 is a schematic diagram of a refresh area provided in an embodiment of the present application. Fig.15 Taking the arrow drawing line shown as an example, the refresh area Rect is a rectangular graphic area including the arrow part Path2, the path track Path3 and the arrow part Path4.

[0134] It is understandable that the refresh area may be a regular graphic area, such as a rectangular graphic, a circular graphic, a triangular graphic, etc. The refresh area may also be an irregular graphic area.

[0135] In order to define the refresh area more carefully, the display device 200 can separately define the area to be erased and the area to be drawn. That is, in some embodiments, the display device 200 can define the historical endpoint area, the newly added endpoint area, and the path area. And perform a union operation on the historical endpoint area, the newly added endpoint area, and the path area to obtain the refresh area.

[0136] Among them, the historical endpoint area is a closed graphic area constructed based on historical trajectory points and historical endpoint graphics, the newly added endpoint area is a closed graphic area constructed based on the endpoint graphics at the end of the path trajectory, and the path area is a closed graphic area constructed based on historical trajectory points, newly added trajectory points and path trajectory.

[0137] For example, Fig. 20 FIG. 1 is a schematic diagram of another refresh area provided in an embodiment of the present application. Fig.15 Taking the arrow drawing line shown as an example, after performing the erase and redraw operation, the display device 200 can construct a rectangular graphic area Rect1 according to the track point P1 and the arrow part Path2, construct a rectangular graphic area Rect2 according to the arrow part Path4, and construct a rectangular graphic area Rect3 according to the track point P1, the track point P2 and the path track Path3. Then, the union area of ​​the area Rect1, the area Rect2 and the area Rect3 is taken as the refresh area, and the refresh area is refreshed to the user interface, so that the user interface presents an interface effect of continuously updating the end effect along the touch track input by the user.

[0138] In this embodiment, during the drawing process, when the display device 200 detects a new trajectory point, it does not erase and redraw the entire drawing line, but divides the part that needs to be erased and redrawn from the part that does not need to be erased and redrawn. The area where the drawing line trajectory remains unchanged is not processed, and only the area where the drawing line trajectory changes is drawn and refreshed, thereby improving the drawing speed.

[0139] The above is for drawing a line with an end effect. For a line without an end effect, it does not involve an erase operation. Therefore, the display device 200 can delineate a new area based on the new track points and the historical track points, and draw and refresh in the new area. That is, in some embodiments, the display device 200 can detect the new track points in the touch track in response to the touch command input by the user. When the new track points are detected, the historical track points are obtained, and a closed graph is constructed based on the current track points and the historical track points to obtain the new area. Draw a new line in the new area, and refresh the new line in the new area to the user interface.

[0140] For example, Fig.21 As shown, taking a straight line as an example, during the drawing process, the display device 200 detects through the touch interaction module that the trajectory points of two adjacent sampling frames are points P5 and P6, that is, the touch action input by the user moves from point P5 to point P6. The display device 200 constructs a rectangular graphic area Rect5 based on the trajectory points P5 and P6. A new line Path6 between the trajectory point P5 and the trajectory point P6 is drawn in the area Rect5, and the graphic area Rect5 is refreshed so that the new line Path6 and the original line Path5 form a line drawn along the touch trajectory input by the user.

[0141] Based on the above trajectory drawing method, dotted lines can also be drawn. However, when drawing dotted lines based on the above area segmentation drawing and refreshing method, due to the different input speeds when users perform touch actions, the intervals between dotted lines will be inconsistent at different input speeds. For example, Fig. 22 As shown in the figure, when the user inputs too slowly when performing a touch action, the intervals between the dotted lines are small, so that the drawn dotted line appears to be similar to a solid line. When the user inputs unevenly when performing a touch action, the intervals between the dotted lines are uneven, so that the dotted line and the solid line are combined.

[0142] In order to ensure that the interval of the drawn dotted lines remains unchanged while increasing the drawing speed, the display device 200 can adopt the method of overall redrawing and regional refreshing for the drawing lines. Overall redrawing refers to erasing and redrawing the drawn line track, thereby ensuring that the interval of the dotted lines of the drawing lines remains unchanged. At the same time, in order to increase the drawing speed, only the newly added area currently drawn is refreshed.

[0143] Therefore, if Fig.23 As shown, it is a dotted line drawing flow chart provided by an embodiment of the present application. With the touch command input by the user, the display device 200 can detect the newly added track points in the touch track according to the preset sampling frame rate, and when the newly added track points are detected, the historical drawing line is erased. Among them, the historical drawing line is a drawing line drawn according to the starting point and the historical track points, the historical track points are the track points of the previous sampling frame, and the starting point is the touch position where the drop event is generated in the touch command.

[0144] Among them, when erasing the historical drawing, all the drawing lines drawn from the starting point to the historical trajectory point are erased. Therefore, the erasing can be achieved by clearing the extended display layer. That is, when erasing the historical drawing, the display device 200 can clear the content on the extended display layer to achieve the purpose of erasing the historical drawing. Of course, the historical drawing can also be erased based on the above-mentioned erasing method of the historical endpoint graphics.

[0145] After erasing the historical drawing line, the drawing line indicated by the touch command is redrawn according to the starting point and the newly added track point, and the refresh area is delineated according to the historical track point and the newly added track point. Finally, the refresh area is refreshed in the user interface to complete a line update.

[0146] For example, Fig.24 As shown in FIG. 1 , the down event generated by the touch command input by the user can form a starting point P0 on the entire touch track. The move event generated by the subsequent touch command input by the user can form a track point on the entire touch track. Fig.24 As shown, when the touch command input by the user moves from point P7 to point P8, a historical track point P7 and a newly added track point P8 can be formed. In order to ensure that the dashed line interval drawn between the historical track point P7 and the newly added track point P8 is evenly connected with the dashed line interval drawn between the starting point P0 and the historical track point P7, the display device 200 can erase the historical line Path7 between the starting point P0 and the historical track point P7, and redraw the line Path8 between the starting point P0 and the newly added track point P8. In order to increase the drawing speed, after redrawing, a rectangular graphic area is constructed according to the historical track point P7 and the newly added track point P8 to obtain a refresh area Rect7, and only the refresh area is refreshed.

[0147] The above trajectory drawing method is also applicable to dotted lines with terminal effects. The difference between dotted lines with terminal effects and dotted lines without terminal effects lies in the demarcation of the refresh area. For dotted lines without terminal effects, a closed graph can be constructed based on historical trajectory points and newly added trajectory points to obtain the refresh area. For dotted lines with terminal effects, the area to be erased and the area to be drawn can be separately demarcated, and the union area is taken as the refresh area.

[0148] That is, in some embodiments, the display device 200 can obtain the line drawing type set by the user before inputting the line drawing instruction, and the line drawing type includes an endpoint type and a non-endpoint type. If the line drawing type is a non-endpoint type, a closed graph is constructed according to the historical trajectory points and the newly added trajectory points to obtain a refresh area. If the line drawing type is an endpoint type, a historical endpoint area, a newly added endpoint area, and a path area are delineated, and a union operation is performed on the historical endpoint area, the newly added endpoint area, and the path area to obtain a refresh area.

[0149] For example, Fig.25 As shown, Fig.15 Taking the example that the drawn line with the arrow head is a dotted line, according to the touch command input by the user, the display device 200 can detect the starting point P0, the historical track point P1 and the newly added track point P2. In order to ensure that the dotted line interval drawn between the historical track point P1 and the newly added track point P2 is evenly connected with the dotted line interval drawn between the starting point P0 and the historical track point P1, the display device 200 can erase the path track Path1 between the starting point P0 and the historical track point P1, and the endpoint graphic Path2 associated with the historical track point P1, redraw the path track Path1′ between the starting point P0 and the newly added track point P2, and add the endpoint graphic Path4 at the end of the path track Path1′.

[0150] To increase the drawing speed, Fig. 20 As shown, the above steps of defining the refresh area can be referred to. After redrawing, a rectangular graphic area Rect1 is constructed according to the historical track point P1 and the endpoint graphic Path2, a rectangular graphic area Rect2 is constructed according to the newly added track point P2 and the endpoint graphic Path4, and a rectangular graphic area Rect3 is constructed according to the historical track point P1 and the newly added track point P2. Then, the union area of ​​the area Rect1, the area Rect2 and the area Rect3 is taken as the refresh area, and the refresh area is refreshed to the user interface.

[0151] Based on the above trajectory drawing method. In some embodiments of the present application, a display device 200 is also provided, including: a display 260 and a controller 250. Among them, the display 260 is configured to display a user interface. The display 260 is connected to a touch interaction module, and the touch interaction module is used to receive a touch instruction input by a user. The controller 250 is configured to execute the following program steps:

[0152] In response to a touch command input by a user, a newly added track point in a touch track is detected.

[0153] When a new track point is detected, the historical endpoint graphics are erased.

[0154] The historical endpoint graph is an endpoint graph associated with a historical trajectory point, and the historical trajectory point is a trajectory point in a previous sampling frame.

[0155] Draw a path track based on the newly added track points and historical track points, and add an endpoint graphic at the end of the path track.

[0156] Among them, the path trajectory is the line trajectory between the historical trajectory points and the newly added trajectory points.

[0157] A refresh area is defined, and the refresh area is refreshed in the user interface.

[0158] The refresh area includes an area where the historical endpoint graphics are located, an area where the path track is located, and an area where the endpoint graphics at the end of the path track are located.

[0159] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0160] It can be seen from the above technical solutions that the display device and trajectory drawing method provided by the above embodiments can detect the newly added trajectory points in the touch trajectory in response to the touch instructions input by the user, and erase the historical endpoint graphics when the newly added trajectory points are detected. The historical endpoint graphics are the endpoint graphics associated with the historical trajectory points, and the historical trajectory points are the trajectory points in the previous sampling frame. Then, based on the newly added trajectory points and the historical trajectory points, the path trajectory is drawn, and the endpoint graphics are added at the end of the path trajectory. The path trajectory is the line drawing trajectory between the historical trajectory points and the newly added trajectory points. Finally, the refresh area is defined, and the refresh area is refreshed in the user interface. The refresh area includes the area where the historical endpoint graphics are located, the area where the path trajectory is located, and the area where the endpoint graphics at the end of the path trajectory are located. The method adopts a segmentation method to draw and refresh the part that needs to be erased and redrawn after drawing separately from the part that does not need to be erased and redrawn after drawing, thereby improving the drawing speed.

[0161] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0162] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0163] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: A display configured to display a user interface, the display being connected to a touch interaction module, the touch interaction module being used to receive a touch instruction input by a user; The controller is configured as: In response to a touch command input by a user, detecting a newly added track point in a touch track; When a new track point is detected, a historical endpoint graphic is erased, where the historical endpoint graphic is an endpoint graphic associated with a historical track point, where the historical track point is a track point in a previous sampling frame; Drawing a path track based on the newly added track point and the historical track point, and adding an endpoint graphic at the end of the path track, the path track being a line drawing track between the historical track point and the newly added track point; A refresh area is defined, and the refresh area is refreshed on the user interface, wherein the refresh area includes an area where the historical endpoint graphics are located, an area where the path track is located, and an area where the endpoint graphics at the end of the path track are located.

2. The display device according to claim 1, characterized in that The controller performs calculations to refresh the region and is configured to: Delineating a historical endpoint area, a newly added endpoint area and a path area, wherein the historical endpoint area is obtained according to the historical track points and the historical endpoint graph, the newly added endpoint area is obtained according to the endpoint graph at the end of the path track, and the path area is obtained according to the historical track points, the newly added track points and the path track; A union operation is performed on the historical endpoint area, the newly added endpoint area, and the path area to obtain the refresh area.

3. The display device according to claim 2, characterized in that The controller is configured to: Constructing a closed graph according to the historical trajectory points and the historical endpoint graph to obtain the historical endpoint region; Constructing a closed graph according to the endpoint graph at the end of the path trajectory to obtain the newly added endpoint area; A closed graph is constructed according to the historical trajectory points, the newly added trajectory points and the path trajectory to obtain the path area.

4. The display device according to claim 1, characterized in that The controller is also configured to: In response to a drop event generated by a touch command input by a user, calling an extended display layer; Drawing a touch track in real time in the extended display layer; In response to a lift-up event generated by a touch instruction input by a user, the touch track in the extended display layer is refreshed to the display layer.

5. The display device according to claim 4, characterized in that The controller executes erasing the historical endpoint graph and is configured to: Redrawing the historical endpoint graphic on the historical endpoint graphic; The transparency value and color value of the intersection area of ​​the redrawn historical endpoint graphic and the historical endpoint graphic are set to 0.

6. The display device according to claim 1, characterized in that The controller performs adding an endpoint graphic at the end of the path trajectory and is further configured to: Obtaining the line drawing type set by the user before inputting the touch command; Calculate the endpoints of the endpoint graph according to the line drawing type, the path trajectory and the historical trajectory points; The endpoints are connected according to the line drawing type to form the endpoint graphic.

7. A display device, characterized in that: include: A display configured to display a user interface, the display being connected to a touch interaction module, the touch interaction module being used to receive a touch instruction input by a user; The controller is configured as: In response to a touch command input by a user, detecting a newly added track point in a touch track; When a new trajectory point is detected, a historical trajectory point is obtained, where the historical trajectory point is a trajectory point of a previous sampling frame; Constructing a closed graph according to the current trajectory point and the historical trajectory point to obtain a newly added area; Draw a new line in the newly added area; The new line in the newly added area is refreshed to the user interface.

8. A display device, characterized in that: include: A display configured to display a user interface, the display being connected to a touch interaction module, the touch interaction module being used to receive a touch instruction input by a user; The controller is configured as: In response to a touch command input by a user, detecting a newly added track point in a touch track; When a new track point is detected, a historical drawing line is erased, where the historical drawing line is a drawing line drawn according to a starting point and a historical track point, where the historical track point is a track point of a previous sampling frame, and the starting point is a touch position where a drop event is generated in the touch instruction; Redrawing the drawing line indicated by the touch control instruction according to the starting point and the newly added track point; Delimiting a refresh area according to the historical track points and the newly added track points; The refresh area is refreshed in the user interface.

9. The display device according to claim 8, characterized in that The controller calculates a refresh area according to the historical track points and the newly added track points, and is further configured to: Acquire the line drawing type set by the user before inputting the line drawing instruction, wherein the line drawing type includes an endpoint type and a non-endpoint type; If the line drawing type is a non-endpoint type, a closed graph is constructed according to the historical track points and the newly added track points to obtain the refresh area; If the line drawing type is an endpoint type, a historical endpoint area, a newly added endpoint area and a path area are delineated, and a union operation is performed on the historical endpoint area, the newly added endpoint area and the path area to obtain the refresh area, the historical endpoint area is a closed graphic area constructed according to the historical trajectory points and the endpoint graphics associated with the historical trajectory points, the newly added endpoint area is a closed graphic area constructed according to the newly added trajectory points and the endpoint graphics associated with the newly added trajectory points, and the path area is a closed graphic area constructed according to the historical trajectory points and the newly added trajectory points.

10. A trajectory drawing method, characterized in that: include: In response to a touch command input by a user, detecting a newly added track point in a touch track; When a new track point is detected, a historical endpoint graphic is erased, where the historical endpoint graphic is an endpoint graphic associated with a historical track point, where the historical track point is a track point in a previous sampling frame; Drawing a path track based on the newly added track point and the historical track point, and adding an endpoint graphic at the end of the path track, the path track being a line drawing track between the historical track point and the newly added track point; A refresh area is defined, and the refresh area is refreshed in the user interface, wherein the refresh area includes an area where the historical endpoint graphics are located, an area where the path track is located, and an area where the endpoint graphics at the end of the path track are located.

Images