Display device and stroke trajectory drawing method

Abstract

The embodiment of the invention provides a display device and a stroke trajectory drawing method, and the method can respond to a touch interaction instruction input by a user, and obtain a touch area generated by the touch interaction instruction in real time. Generating a stroke model according to the touch area, and drawing a stroke trajectory line at the tail end of the touch trajectory according to the stroke model. Wherein the stroke model is a dot matrix model generated based on touch points, contour points and standby points in the touch area; the touch point is at least one contact point in the touch area, and the contour point is at least one contact point located at the position of the pen tip edge in the touch area; the standby point divides the distance between the touch point and the contour point into preset equal parts. Through the brush tip model, the brush tip effect can be kept in the brush tip drawing process, the brush tip effect is uniform and smooth, and user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for drawing a pen trajectory line. Background Art

[0002] Display devices are intelligent devices that can present user interfaces and support user interaction. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users. Display devices can realize touch interactive operations through built-in or external touch devices.

[0003] For display devices that support touch interaction, you can run a whiteboard application and implement writing or drawing functions based on the touch area of ​​the whiteboard application. To achieve better writing or drawing effects, the display device can also add a pen tip effect at the end of the touch area when running the whiteboard application. The pen tip effect is an effect that smoothly changes the thickness of the writing or drawing handwriting, which can be used to decorate the writing or drawing handwriting.

[0004] When the whiteboard application realizes the pen stroke effect, the pen stroke effect can be drawn without the pen stroke effect during the drawing process, and the pen stroke effect can be drawn after the hand is raised. The pen stroke effect is drawn according to the writing speed or the contact area. However, drawing the pen stroke according to the writing speed will cause the handwriting width to be too thin when the writing speed is too fast, and the pen stroke effect will not be obvious when the writing speed is too slow. Drawing the pen stroke according to the contact area will also cause the contact area to be large when the pen is put down, and the handwriting will be too thick; when the contact area changes slowly, the pen stroke effect will not be obvious, that is, the drawing pen stroke effect is uneven and not smooth. Summary of the invention

[0005] The present application provides a display device and a pen tip trajectory line drawing method to solve the problem that the pen tip effect of the display device is uneven and unsmooth.

[0006] In a first aspect, the present application provides a display device, comprising: a display and a controller, wherein the display is configured to display a user interface; the display is connected to a touch interaction module, and the touch interaction module is used to obtain a touch interaction instruction input by a user; and the controller is configured to execute the following program steps:

[0007] Responding to a touch interaction instruction input by a user, acquiring a touch area and a touch track;

[0008] Generate a pen tip model according to the touch area, the pen tip model is a dot matrix model generated based on touch points, contour points and spare points in the touch area; the touch point is at least one contact point in the touch area, the contour point is at least one contact point in the touch area located at the edge of the pen tip; the spare point divides the distance between the touch point and the contour point into preset equal parts;

[0009] According to the pen tip model, a pen tip trajectory line is drawn at the end of the touch trajectory.

[0010] In a second aspect, some embodiments of the present application further provide a method for drawing a pen tip trajectory line, which is applied to the display device provided in the first aspect above, and the method comprises:

[0011] Responding to a touch interaction instruction input by a user, acquiring a touch area and a touch track;

[0012] Generate a pen tip model according to the touch area, the pen tip model is a dot matrix model generated based on touch points, contour points and spare points in the touch area; the touch point is at least one contact point in the touch area, the contour point is at least one contact point in the touch area located at the edge of the pen tip; the spare point divides the distance between the touch point and the contour point into preset equal parts;

[0013] According to the pen tip model, a pen tip trajectory line is drawn at the end of the touch trajectory.

[0014] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a method for drawing a pen tip trajectory line, which can respond to the touch interaction command input by the user and obtain the touch area generated by the touch interaction command in real time. And generate a pen tip model according to the touch area, and draw the pen tip trajectory line at the end of the touch trajectory according to the pen tip model. Among them, the pen tip model is a dot matrix model generated based on the touch point, contour point and spare point in the touch area; the touch point is at least one contact point in the touch area, and the contour point is at least one contact point located at the edge of the pen tip in the touch area; the spare point divides the distance between the touch point and the contour point into preset equal parts. The pen tip model can maintain the pen tip effect during the drawing process, and the pen tip effect is uniform and smooth, which improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 A schematic diagram showing usage scenarios of a display device in some embodiments of the present application;

[0017] Figure 2 A hardware configuration block diagram of a display device provided in some embodiments of the present application;

[0018] Figure 3 A hardware configuration block diagram of a control device provided in some embodiments of the present application;

[0019] Figure 4 A schematic diagram of software configuration in a display device provided in some embodiments of the present application;

[0020] Figure 5 A schematic diagram of touch tracks provided in some embodiments of the present application;

[0021] Figure 6 A schematic diagram of a whiteboard application interface provided in some embodiments of the present application;

[0022] Figure 7 A schematic diagram of a whiteboard application display system provided in some embodiments of the present application;

[0023] Figure 8 A schematic diagram of an acceleration layer provided for some embodiments of the present application;

[0024] Fig. 9 Schematic diagram of teaching tools provided for some embodiments of the present application;

[0025] Fig.10 A schematic diagram of pen stroke effects provided in some embodiments of the present application;

[0026] Fig.11 A schematic diagram of a pen tip trajectory drawing process provided in some embodiments of the present application;

[0027] Fig.12 A schematic diagram of a touch area and a touch point based on a touch track provided in some embodiments of the present application;

[0028] Fig.13 A schematic diagram of a touch area and a touch point based on a contact area provided for some embodiments of the present application;

[0029] Fig.14 A schematic diagram of a dot matrix structure of a pen tip model provided in some embodiments of the present application;

[0030] Fig.15 A schematic diagram of quasi-contour points of a pen tip model provided in some embodiments of the present application;

[0031] Fig.16 A schematic diagram of the pen tip shape provided for some embodiments of the present application;

[0032] Fig.17 Schematic diagram of an updated pen stroke model provided for some embodiments of the present application. DETAILED DESCRIPTION

[0033] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0034] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0035] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0036] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0037] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0038] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0039] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through the mobile terminal 300 and the control device 100 .

[0040] In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0041] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0042] In addition to providing the broadcast receiving television function, the display device 200 may also provide an intelligent network television function with computer support functions, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0043] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0044] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0045] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0046] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from a controller, display video content, image content, and a menu control interface component and a user control UI interface, etc.

[0047] In some embodiments, the display 260 is connected to a touch interaction module so that the display device 200 supports touch interaction operations. The touch interaction module can be a built-in module or an external module. For example, in order to implement touch interaction operations, for a display device 200 with a built-in touch interaction module, the display 260 can be a touch screen, which can receive touch signals input by fingers, contacts, styluses, etc., and execute touch interaction responses according to a pre-set interaction strategy.

[0048] For the display device 200 with an external touch interaction module, a terminal, device, or component with a touch function can be connected through the device interface of the display device 200. For example, the USB or USB-C interface of the display device 200 is connected to a touch panel, and the touch panel can receive the touch data input by the user in real time and transmit the touch data to the display device 200 through the USB channel. The display device 200 can perform an interactive response based on the received touch data in combination with the touch application, so that the display device 200 supports touch interaction operations.

[0049] In some embodiments, the communicator 220 is a component for communicating with an external device or a server 400 according to various communication protocol types.

[0050] In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0051] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0052] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0053] In some embodiments, the user interface 280 is an interface that can be used to receive control input.

[0054] Figure 3 Some embodiments of the present application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0055] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0056] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0057] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0058] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0059] The communication interface 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0060] The user input / output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .

[0061] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0062] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0063] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0064] Figure 4 Some embodiments of the present application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0065] The application layer mainly includes commonly used applications on TV and application frameworks. Common applications are mainly applications developed based on browsers, such as HTML5 APPs and native APPs.

[0066] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0067] Native apps can support online or offline, message push or local resource access.

[0068] The middleware layer includes various TV protocols, multimedia protocols, system components and other middleware. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.

[0069] The hardware layer mainly includes the hardware abstraction layer (HAL) interface, hardware and drivers. The HAL interface is a unified interface for all TV chips to connect, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0070] The hardware layer of the display device 200 may also deploy other device interfaces, hardware, and drivers according to the specific display requirements of the display device 200. For example, in order to enrich the display types of the display device 200, an HDMI interface and a USB interface may be provided on the display device 200, wherein the HDMI interface may be connected to a device with video and audio input / output functions, and the corresponding audio and video output / input functions may be implemented through the HDMI driver. The USB interface may be connected to a device with signal and data transmission functions and interactive functions, and based on the USB driver, access signals, transmit data, and perform specific interactive actions.

[0071] For a display device 200 that supports touch interaction operations, the display device 200 has a built-in touch interaction module, and can receive touch data input by the user through the touch interaction module. According to the interaction principle of the touch interaction module, the touch interaction module can detect relevant parameters in the touch action. For example, a capacitive touch layer is provided on the display 260 of the display device 200. When the user's finger touches any position of the touch layer, the capacitance of the touch layer at the touch position will change. At this time, the touch interaction module can record the position of the capacitance change, and record the time when the capacitance change occurs in combination with the timer in the controller to generate touch data.

[0072] In some embodiments, the physical signal detected by the touch interaction module needs to be converted before it can be read by the controller 250 of the display device 200. For example, the analog signal of the capacitance change needs to be converted into a digital signal and then transmitted to the controller 250 of the display device 200. In order to adapt to the screen display process of the display device 200, the touch data detected by the touch interaction module also needs to be coordinate mapped so that the position point corresponding to the touch data can have a corresponding relationship with the display 260 of the display device 200 or the pixel point in the user interface. For example, the coordinate position detection accuracy of the touch interaction module is 65536×65536, and the resolution of the display 260 of the display device 200 is 3840×2160. After the touch interaction module detects the touch data, the coordinate mapping of the touch point position in the width and height directions can be performed according to the ratio of 65536 / 3840 and 65536 / 2160, so that the display device 200 can perform related operation responses based on the mapped touch point position coordinates.

[0073] The touch data may include different operation parameters according to the user's input method. Figure 5 As shown, the touch data may include the touch time, touch position, touch event type, number of touch points, etc. of the touch operation. In a touch interaction process, the touch event types that can be detected by the touch interaction module include: down events, move events, and up events of touch actions. Corresponding to the entire touch trajectory, a starting point [down; x1, y1, t1], a trajectory point [move; x2, y2, t2], and an end point [up; x3, y3, t3] can be formed. Each touch event records the corresponding touch time t and touch position (x, y).

[0074] It should be noted that, since the user's finger or touch device is in surface contact with the touch interaction module when performing touch interaction operations, that is, the touch interaction module can detect a contact area, and the contact area includes multiple contact points. Therefore, when the display device 200 performs interactive control, it can detect (or specify) a contact point in the contact area as a touch point. For example, when the contact area is an elliptical area formed when the user's finger contacts the touch interaction module, the display device 200 can traverse the contact point coordinates in the elliptical area, determine the coordinate extremes in two mutually perpendicular directions, to delineate the major axis and minor axis of the elliptical area, and use the contact point at the intersection of the major axis and the minor axis as the touch point.

[0075] In the process of executing the touch interaction response, the display device 200 can classify different touch times, touch positions, the number of touch points and the type of touch events, so as to detect the user's touch input gestures, thereby performing different interactive responses for different input gestures. For example, when the number of touch points in the touch data detected by the touch interaction module is 1, the touch event type only includes the down event and the up event, and the time interval between the down event and the up event is less than the single-click event time threshold. In addition, if the touch position change distance of the down event and the up event is less than the jitter distance threshold, it can be determined that the current user's touch input gesture is a click gesture. Based on the click gesture, the display device 200 executes the operation of starting the application according to the icon in the area where the touch position corresponding to the click gesture is located.

[0076] Similarly, the display device 200 can also detect other touch interaction gestures input by the user based on the touch time, touch position, number of touch points and touch event type, such as double-click gesture, slide gesture, long press gesture, multi-finger click gesture, multi-finger slide gesture, etc. Different interaction gestures can derive different touch parameters. For example, a slide gesture can also generate parameters such as slide distance, slide speed, slide direction, slide track shape, etc. Different touch parameters can be used to perform different interactive controls.

[0077] In some embodiments, in order to enrich the touch interaction types supported by the display device 200, the display device 200 can also perform complex gesture detection based on the dynamic change rules of touch time, touch position, number of touch points and touch event type. For example, when the touch interaction module detects that the touch data input by the user includes multiple touch points, and the touch position of each touch point is close to each other as the user inputs, it can be determined that the touch gesture currently input by the user is a grab gesture. Based on complex gesture detection, the display device 200 can perform more interactive responses. For example, when the detected touch gesture is a grab operation for an image view, the display device 200 can respond to the grab gesture and perform a control action to select and move the image display position.

[0078] In some embodiments, the touch gesture can also be combined with the touch position to form a touch interaction operation based on a specific position. For example, when the touch interaction module detects that the down event position during the touch operation is at the top of the display 260, the touch point position corresponding to the move event moves downward. When the up event is detected, the display device 200 can determine that the current touch gesture is to slide down from the top of the screen. Therefore, the display device 200 can respond to the touch gesture and control the display 260 to present a drop-down list.

[0079] Some touch interaction gestures can be used to perform interactive actions based on the operating system of the display device 200, which are called global gestures. For example, the operation of sliding down from the top of the screen to call out a drop-down list in the above example of the display device 200. Some touch interaction gestures can be used to perform interactive actions based on specific touch applications. For example, when the display device 200 runs a whiteboard application, the sliding touch operation input by the user can be used to draw a track line on the whiteboard.

[0080] The touch application can be a system application or a third-party application developed based on a specific display device type and user needs. The touch application can be installed in the display device 200 and started to run under user control. For example, the user can control the display device 200 to run the whiteboard application by clicking the "whiteboard" application icon in the application interface of the display device 200.

[0081] It should be noted that the whiteboard application can be an independent application, an associated application, or a functional module in a touch application. Different forms of whiteboard applications can have different startup or calling methods. For example, a user can start an independent whiteboard application through the application interface of the display device 200; a user can also start a whiteboard application by executing a "whiteboard" operation on a conference application; a user can also control the conference application to start the whiteboard functional module by clicking the "whiteboard" icon on the conference application.

[0082] Different forms of whiteboard applications may present different forms of whiteboard application interfaces after startup. For example, when a user starts a whiteboard application in an associated application form, the display device 200 may automatically enter a dual-screen (or split-screen) mode. In the dual-screen (or split-screen) mode, the display device 200 may display a user interface through two display areas, i.e., the main screen displays the original application (such as a conference application) interface, and the secondary screen displays the whiteboard application interface.

[0083] After the whiteboard application is running, the display device 200 can be switched to display a whiteboard interface. Figure 6 As shown, the whiteboard interface may include drawing tool controls for drawing operations, such as pen shape, graphics, line shape, color, erase, clear screen, selection, etc. The user can click any control to draw graphics according to specific drawing needs.

[0084] like Figure 7 As shown, the display device 200 can render and display the drawn picture in real time through an image generation (Image Producer) module, an image rendering (surface flinger) module, a hardware synthesis (Hardware Composer, HWC) module, a video process (Video Processing Unit hardware, VPU hardware) module and a display (screen).

[0085] In the process of displaying the drawn picture, the graphic interface (openGLES) of the image generation module can be connected to the whiteboard application to generate the drawn image content and pass the image content to the image rendering module. The image rendering module is used to control the display 260 to display the content, that is, to render the image content through the user interaction layer (UI layer) or the video layer (video layer) according to the image content. In order to obtain a better display effect, the image content of the UI layer can be rendered by the GPU component, so as to form a picture frame for display in the HWC module. Among them, the picture frames can be stored in the HWC module through the frame buffer (framebuffer) and the video buffer (video buffer), and the picture content is formed in the corresponding layer through the video process module. That is, the image frames generated by the video playback process form the picture content through the video layer (video plane), and the image frames of other image pictures (such as touch tracks, graphics, etc.) form the picture content through the primary OSD layer (primary OSD plane). Finally, the display device 200 forms the final picture through the blending unit (blend) of the video process module and displays it on the display 260.

[0086] Since the whiteboard application will present the user's touch trajectory in real time according to the user's touch operation, in order to present a better real-time response effect, the display device 200 should shorten the touch action input time and the delay time of the drawing result display. To this end, in some embodiments, the display device 200 can present a real-time painting effect by setting an acceleration layer. That is, in the video process module of the display device 200, an additional extended display layer (external OSD plane) can be set on the basis of the main OSD layer and the video layer. Among them, the extended display layer can be configured with different layer characteristics according to the specific display effect requirements. For example, the bitmap refresh mode of the extended display layer can be modified so that the extended display layer is refreshed in real time according to the region, thereby improving the display speed of the graphics. At this time, the extended display layer can be used as an acceleration layer in scenes with high dynamic display effects.

[0087] Taking the display device 200 running a whiteboard application as an example, in order to improve the real-time response speed of the line drawing process, after detecting the user's touch operation, the touch track can be drawn in real time on the extended display layer (acceleration layer). Figure 8 As shown, the display level of the acceleration layer can be higher than other layers, and when the user completes the touch input, the lines drawn by the acceleration layer are updated to other layers, thereby reducing input delay and improving the real-time display effect of the whiteboard application drawing process.

[0088] In some embodiments, the extended display layer can also work together with other graphics to improve display quality. For example, the acceleration layer can respond to the touch events input by the user at the same time as the main OSD layer, and draw graphics separately. However, since the acceleration layer is displayed above the main OSD layer, the graphics drawn by the acceleration layer can block the graphics drawn by the OSD layer to maintain real-time response speed. After the user inputs the touch interaction action, the content displayed by the acceleration layer can be released directly, and the OSD layer directly forms the drawn graphics, so there is no need for the acceleration layer to refresh the drawn graphics to the OSD layer, reducing the graphics mixing time. It not only improves the real-time display effect of the graphics drawing process, but also improves the final presentation quality of the graphics drawing.

[0089] In some embodiments, in order to meet different user needs, the whiteboard application can also dynamically configure different interface contents. Fig. 9As shown, a "teaching tool" option may be included in a whiteboard application run by a display device 200 applied to the field of education. When a user clicks on the teaching tool option, a teaching tool list may pop up. The teaching tool list may include tool options of the type "ruler", "set square", "protractor", etc. After the user clicks on the "set square" tool option, the "set square" tool may be called to assist in drawing. At this time, the display device 200 may add a movable set square tool graphic to the whiteboard drawing interface, and when the user's touch operation track approaches the edge of the set square tool graphic, a straight line segment may be drawn along the edge of the set square tool graphic.

[0090] In some embodiments, the whiteboard application can also store the graphic objects drawn by each user touch action. Among them, a touch action refers to the process from the user's finger (or stylus) contacting the touch layer to the user's finger (or stylus) leaving the touch layer. That is, if the user inputs a click action, a touch action should include a down event and an up event. If the user inputs a sliding action, a touch action should include a down event, a move event, and an up event. Each touch action can generate a drawing object, and the whiteboard application can record the drawing object, so that the user can perform actions such as selection, undo, and redo.

[0091] When storing graphics, the whiteboard application can also set associated information for the graphic object according to the graphic characteristics and input status. For example, after the user draws a straight line, the whiteboard application can set a shape identifier for the straight line object. The shape identifier can be stored in association with the straight line object and can be called by other modules of the whiteboard application or other applications to facilitate operations such as object selection, object retrieval, and object deletion.

[0092] In some embodiments, the whiteboard application interface may also provide drawing auxiliary tools and menus for adjusting the drawing content. For example, the whiteboard application interface may include a "select" tool, and when the user clicks the "select" tool icon, the whiteboard application may be controlled to enter the object selection mode. In the object selection mode, the display device 200 may call the drawing object that intersects with the touch position based on the touch position under the down event, move event, and / or up event in the user's touch interaction operation, so as to achieve the purpose of multi-graphic selection.

[0093] In some embodiments, the whiteboard application may also support multiple gesture interaction operations, and have different control functions for different gesture interaction operations. For example, the whiteboard application may move the whiteboard drawing area along the multi-finger sliding track in response to the user's multi-finger sliding operation. The whiteboard application may also execute an erase function in response to the user's entire palm sliding operation to erase the drawing graphics covered by the palm sliding operation track.

[0094] In some embodiments, the whiteboard application can also render and process the graphics drawn by the user to make the graphics drawn by the user more detailed or accurate. Fig.10 As shown, when a user writes or draws on a whiteboard application, the whiteboard application can set a pen tip effect for the handwriting. The pen tip effect refers to the effect that the end of the drawn line has a gradually tapering effect. The whiteboard application can dynamically adjust the pen tip effect according to parameters such as the movement trend and movement speed of the touch track during the user's drawing process. For example, the faster the user writes, the longer the pen tip length; the slower the user writes, the shorter the pen tip length.

[0095] The process of rendering and processing the graphics drawn by the user by the whiteboard application can be implemented based on a preset graphics algorithm model. For example, the pen stroke effect can draw the tip effect through a water drop-shaped pen stroke model, and the tip effect is added to the end of the drawn graphic. For example, the whiteboard application can detect the shape of the user's drawn graphics within a preset drawing cycle, and replace the drawn shape with a standard graphics model to improve the standardization of the drawn graphics. To this end, a graphic recognition model can be built into the whiteboard application, and all the lines drawn by the user within the preset drawing cycle can form an image to be recognized, and the image to be recognized is processed by the graphic recognition model to identify the standard graphics similar to the drawn graphics within the drawing cycle, thereby replacing the drawn graphics displayed in the whiteboard application interface.

[0096] Among them, for the pen stroke effect rendered by the whiteboard application, the display device 200 may not add the pen stroke effect in real time during the drawing process, but add the pen stroke effect after the touch is raised (i.e., a touch interaction is completed). The drawing of the pen stroke effect can be based on the moving speed or contact area of ​​the track point in the touch track. When the pen stroke is drawn based on the moving speed, the handwriting width will be too thin when the writing speed is too fast; and the pen stroke effect will not be obvious when the writing speed is too slow. When drawing lines based on the contact area, there will also be problems such as a large contact area when the pen is put down, too thick handwriting, and slow changes, and the pen stroke effect will not be obvious.

[0097] For example, after the user touches and raises his hand, the whiteboard application of the display device 200 can use the last N points or the trajectory points within the last N milliseconds (ms) to draw the pen stroke effect according to the speed or contact area, but because the movement speed or contact area changes too drastically or too slowly, the pen stroke effect will be unsatisfactory, and there will be no pen stroke effect during the drawing process, resulting in a poor user experience.

[0098] In some embodiments, the display device 200 can also draw the pen stroke effect in real time during the drawing process, that is, the display device 200 can continuously draw the latest path into a thin line, and then draw the previous path into a thick line, and then use the method of filling points to form the pen stroke. For example, the display device 200 draws the latest newPath as a thin line. If the touch device continues to move at this time and a new touch point appears, a new path is formed, and the previous newPath will become the previous path, named lastPath. The lastPath needs to be re-drawn into a thick line with a set line width. However, since the latest path, newPath, and the previous path, lastPath have different line widths, circular handwriting needs to be supplemented to make it smooth. The smaller the interval between the circular handwriting, the smoother it is, but the slower the speed is, so it is difficult to balance the effect and speed.

[0099] To this end, in some embodiments of the present application, the display device 200 can create a pen stroke model according to the touch area and draw the pen stroke effect in real time based on the pen stroke model when running the whiteboard application. Fig.11 As shown, the controller 250 of the display device 200 is configured to perform the following method steps:

[0100] S100: Acquire a touch area and a touch track in response to a touch interaction instruction input by a user.

[0101] Among them, the touch interaction instruction refers to the touch action output by the user through the touch interaction module. For example, when the user inputs a sliding touch action, the touch interaction module can generate a touch interaction instruction by detecting the sliding action. The touch track is the track formed by the change in the contact position between the finger or touch device and the touch interaction component when the user performs a touch interaction operation. The touch area is the area formed by the touch interaction action, which can be the entire or a section of the touch track formed by the touch sliding process, or it can be the contact area formed by a single touch process.

[0102] S200: Generate a pen stroke model according to the touch area.

[0103] The pen tip model is a dot matrix model generated based on the touch points, contour points and spare points in the touch area. The touch point is at least one contact point in the touch area, the contour point is at least one contact point in the touch area located at the edge of the pen tip, and the spare point is a point that divides the distance between the touch point and the contour point into preset equal parts.

[0104] In order to generate the pen tip model, in some embodiments, the display device 200 can extract the center line of the touch area, wherein the center line of the touch area is parallel to the direction line of the touch track, and then extract a preset number of touch points in the touch area based on the center line of the touch area, wherein the preset number is set according to the shape of the pen tip model. Then, based on the touch point, contour points are generated according to the line width of the touch track; and according to the shape of the pen tip model, the spare point is added between the touch point and the contour point.

[0105] For example, when the user controls the touch point to move on the touch interaction module of the display device 200, the touch interaction module can collect touch data and send the collected touch data to the controller 250 of the display device 200. The controller 250 can use the last N points in the collected touch data, or the N points predicted based on the previously collected touch data, or the points within N ms to construct the pen stroke model.

[0106] It should be noted that the above touch area can be a broad touch area, that is, the entire touch track or a section of the touch track formed by the user's touch operation, or a narrow touch area, that is, the contact area formed on the touch interaction module when the user's finger or touch device touches the touch interaction module. For touch areas with different meanings, the methods of extracting touch points in the touch area are also different.

[0107] That is, in some embodiments, if the touch area is a touch track formed by multiple touch points, the display device 200 can extract N continuous touch points from the touch track. The touch point is a point in the contact area formed on the touch interaction module when the user's finger or touch device contacts the touch interaction module.

[0108] The display device 200 can extract a preset number of contact areas from the touch track according to the pen tip refresh cycle, wherein the pen tip refresh cycle is greater than or equal to the sampling cycle of the touch interaction module. According to the line width of the touch track, the direction line of the touch track is delineated. Then, along the direction line of the touch track, the touch points are extracted from the contact areas in sequence, wherein the touch points are contact points in the contact area located on the direction line.

[0109] For example, Fig.12 As shown, when the contact area is an ellipse, the display device 200 can use the intersection of the major axis and the minor axis of the ellipse as the touch point. In addition, as the user's touch movement operation is performed, multiple contact areas can be formed along the touch track in chronological order, and a touch point can be determined in each contact area. Then, the current latest touch point and the first N-1 touch points of the current touch point can be extracted to construct a pen tip model.

[0110] By extracting the touch points from the touch trajectory, the constructed pen stroke model can be made to conform to the pen stroke effect at one end and the line width form at the other end. Therefore, during the user's touch movement, the pen stroke effect drawn by the pen stroke model can be better connected with the previously input touch point position, thereby increasing the continuity of the pen stroke effect.

[0111] In some embodiments, if the touch area is the contact area between the user's finger or the touch device and the touch interaction module, the display device 200 can first determine the center line of the contact area according to the moving direction of the touch trajectory, and then extract N contact points in sequence along the center line at equal intervals or specific intervals, and use the extracted N contact points as touch points to construct a pen stroke model.

[0112] The display device 200 can traverse the contact point coordinates in the contact area to obtain edge contact points. Then, the center line of the contact area is delineated according to the edge contact points, and a preset number of contact points are extracted from the contact area according to the center line of the contact area as the touch points. The center line of the contact area is parallel to the direction line of the touch track.

[0113] For example, Fig.13 As shown, when a user inputs a touch command by touching the touch screen with a finger, the finger touching the touch interaction module forms an elliptical contact area, and as the user's touch moves, the long axis of the contact ellipse is approximately parallel to the moving direction of the touch track. The display device 200 can extract N contact points at equal intervals in the contact elliptical area as touch points, and construct a pen stroke model based on the N touch points.

[0114] The pen stroke model constructed by extracting touch points in the contact area can better adapt to the user's input of touch interaction commands. The contact shape of the finger or touch device and the touch interaction module can act on the pen stroke model, so that the pen stroke effect can be dynamically adjusted according to the contact method, thereby improving the flexibility of pen stroke drawing.

[0115] Since the more touch points, contour points, and spare points included in the pen stroke model, the more detailed the pen stroke graphic is, and the better the corresponding pen stroke effect is, therefore, in some embodiments, the application ID of the calling whiteboard application is obtained, and the current usage scenario is queried according to the application ID. If the current usage scenario is the first scenario, a first number of touch points are extracted from the touch area; if the current usage scenario is the second scenario, a second number of touch points are extracted from the touch area. The second number is less than the first number.

[0116] The display device 200 can detect the current usage scenario according to the application tag that calls the whiteboard application. When the usage scenario of the whiteboard application is the first scenario with a high demand for pen stroke effects, the number of touch points collected in the touch data can be increased, that is, for usage scenarios of demonstration functions such as calligraphy and painting, the display device 200 can increase the value of N when detecting the usage scenario to improve the fineness of the pen stroke graphics. When the current usage scenario is detected as the second scenario with a low demand for pen stroke effects, the number of touch points collected in the touch data can be reduced to reduce the amount of data processing and improve the calculation speed of the pen stroke effect.

[0117] For example, the display device 200 can monitor the current application calling status. When it is detected that the application calling the whiteboard application is a painting application, the application ID of the painting application can be read, and the usage scenario to which the painting application belongs can be detected according to the application type table pre-stored in the display device 200. That is, according to the application ID of the painting application, it is determined that the current usage scenario is drawing mode, which belongs to the first scenario. At this time, the number of touch points of the pen stroke model can be set to N=6, that is, 6 touch points are extracted at the midline position of the touch area, and a more complex pen stroke model is constructed based on the extracted 6 touch points.

[0118] When it is detected that the application calling the whiteboard application is a conference application, the display device 200 can read the application ID of the conference application and determine that the usage scenario to which the conference application belongs is meeting mode according to the application ID, which belongs to the second scenario. Therefore, the display device 200 can set the number of touch points of the pen stroke model N=3, that is, extract 3 touch points at the midline position of the touch area, and construct a simpler pen stroke model based on the extracted 3 touch points.

[0119] Since the pen tip effect is that the line width becomes thinner as it is drawn to the end, if only the pen tip is used to build the model, the pen tip model will have no continuity during the movement of the touch point and cannot be well connected with the previous model. Fig.14 As shown, the display device 200 can generate a pen stroke model through a dot matrix composed of touch points, contour points and spare points. For example, a pen stroke model composed of 6 touch points is used, where P10, P20...P60 are touch points located at the midline of the touch area. The points located on the contour line of the touch area are contour points. The contour points are the coordinates of the circumscribed points of two circles with two adjacent touch points such as P1 and P2 as the center and the set line width as the diameter, that is, P11, P12 and P21 and P22 are the contour points of touch point P1 and touch point P2 respectively. Among them, the set line width can be set according to the major axis, minor axis or fixed value of the touch point.

[0120] According to the effect that the pen tip becomes thinner towards the top, the pen tip model can divide the two contour points of the touch point into N parts according to the Yang Hui triangle principle, and each divided node can be used as a spare point, and the spare points can be stored in a two-dimensional array. Fig.15 The contour point pairs P11', P11", P12', P12", P13', P13" shown occupy 4 / 10, 7 / 10, 10 / 10 of the touch area diameter d (line width) respectively, that is, the thinnest part of the pen tip has a line width of 0, and the thickest part is equal to the line width.

[0121] S300: Drawing a pen tip trajectory line at the end of the touch trajectory according to the pen tip model.

[0122] After constructing the pen stroke model, the display device 200 can render the pen stroke effect based on the pen stroke model. The display device 200 can run a whiteboard application, use the contour points participating in the contour line connection calculation according to the Pascal's triangle as quasi-contour points, and use the midpoints of adjacent contour points as the starting and ending points of the Bezier curve respectively, which are connected to form a pen stroke model.

[0123] That is, in some embodiments, quasi-contour points in the pen tip model are extracted, and the quasi-contour points are touch points, contour points and spare points located at the edge of the pen tip shape. Then, the midpoints between adjacent quasi-contour points are calculated, and a Bezier curve is constructed with the midpoints and / or the quasi-contour points as the starting and ending points to generate a pen tip graphic.

[0124] For example, Fig.15 As shown, at the touch point P10, the outermost contour points P13' and P13" can be selected as quasi-contour points; at the touch point P20, the outermost contour points P23' and P23" can be selected as quasi-contour points; at the touch point P30, the outermost contour points P33' and P33" can be selected as quasi-contour points; at the touch point P40, the outer candidate points P42' and P42" can be selected as quasi-contour points; at the touch point P50, the inner candidate points P51' and P51" can be selected as quasi-contour points; at the touch point P60, the touch point P60 is directly selected as the quasi-contour point. Therefore, a dot matrix model of a pentagonal structure, that is, a pen tip model, can be constructed.

[0125] Based on the pen stroke model, Fig.16 As shown, the display device 200 can draw the pen stroke effect based on the midpoints between adjacent quasi-contour points according to the Pascal's triangle principle, such as the midpoint PP1 between P13' and P23', the midpoint PP2 between P23' and P33', the midpoint PP3 between P33' and P42', the midpoint PP4 between P42' and P51', the midpoint PP5 between P51' and P60... and based on the midpoints PP1, PP2...PP1', PP2'..., and the quasi-contour points as the starting and ending points of the Bezier curve.

[0126] It can be seen that in the above embodiments, by generating a dot matrix model based on the touch points, contour points and spare points in the touch area, the pen stroke style can be determined according to the shape of the touch area, and the pen stroke shape can be formed based on the midpoints of adjacent contour points as the starting and ending points of the Bezier curve, thereby adding a pen stroke effect to the touch trajectory in real time.

[0127] As the user's touch sliding operation continues, a new touch area will appear as the touch point continues to move forward, and a new touch point P will be determined based on the new touch area. The pen tip model can move forward in sequence along the touch trajectory, and the display device 200 can use spare points or contour points to replace the previously determined quasi-contour points based on the positional relationship between the touch points to update the position of the pen tip model. That is, the display device 200 can calculate the newly added points and related spare points as the new first point, and the original first point is replaced by the spare point at the inner preset equal position. Contour points that are also quasi-contour points are replaced by adjacent contour points.

[0128] That is, in some embodiments, the display device 200 can obtain a new touch point in the touch track, and then generate contour points and spare points associated with the new touch point based on the new touch point. Then, the new touch point, the contour point and the spare point are used to replace the quasi-contour point to update the position of the pen stroke model.

[0129] For example, Fig.17 As shown, when the user forms a touch track through a touch operation, the display device 200 can detect a new touch point P, and the new touch point P can replace the original starting point P60 as the new starting point of the pen stroke model. Based on the position of the new first point P, the inner spare points P61 and P61' corresponding to the touch point P60 can be used as new quasi-contour points, that is, the original first point P60 is no longer used as a quasi-contour point, and is replaced by a contour point pair with a line width of 4 / 10 of the line width of the P60 position; the outer spare points P52 and P52' corresponding to the touch point P50 are used as new quasi-contour points, that is, the spare point pair at 4 / 10 of the line width of the P50 position in the original pen tip model is no longer used as a quasi-contour point, and is replaced by a spare point pair at 7 / 10 of the line width of the P50 position; the contour points P43 and P43' corresponding to the touch point P40 are used as new quasi-contour points, that is, the spare points at 7 / 10 of the line width of the original P40 position are no longer used as quasi-contour points, and are replaced by a contour point pair at the P40 position, and so on and so forth, until the original end points P13 and P13' in the original pen tip model are removed from the pen tip model.

[0130] Based on the new pen stroke model, the display device 200 can confirm the midpoint of adjacent quasi-contour points through the Pascal's triangle principle in the manner provided in the above embodiment, and draw the pen stroke effect based on the quasi-contour points in the newly generated pen stroke model as the start and end points of the Bezier curve. Since the contour point at the 100% line width position corresponding to the touch point is used as the quasi-contour point when the end of the pen stroke model replaces the old and new models, the pen stroke effects drawn by two adjacent pen stroke models can be connected by connecting straight lines, so that the newly generated pen stroke model can be seamlessly connected with the previous pen stroke model.

[0131] In some embodiments, the display device 200 may preset a plurality of different forms of pen stroke models. Since the pen stroke model is a dot matrix model composed of touch points, contour points, and spare points, the number of touch points, contour points, and spare points contained in different forms of pen stroke models, the positional relationship between points, and the dot matrix shape composed of multiple points are different. For example, in order to obtain an ink pen stroke effect, the display device 200 may adjust the number, positional relationship, and shape of the touch points, contour points, and spare points according to the brush tip structure to generate a water drop-shaped pen stroke model; in order to obtain a fountain pen effect, the display device 200 may adjust the number, positional relationship, and shape of the touch points, contour points, and spare points according to the brush tip structure to generate a triangular pen stroke model.

[0132] Since the input speed of the user when performing a touch action is different, and the sampling frame rate of the touch interaction module corresponding to the display device 200 is fixed, the distance between two adjacent touch points in the touch track will be non-fixed under different input speeds. For example, when the user's finger movement speed when performing a touch action on the touch interaction component is v1, and the sampling frame rate of the touch interaction module is F, the interval between two samplings of the touch interaction component is 1 / F. Based on this, the distance between two adjacent touch points is v1 / F. It can be seen that when the finger movement speed is different, the distance between two adjacent touch points is also inconsistent, that is, the greater the finger movement speed, the greater the distance between adjacent touch points.

[0133] In order to make the pen stroke effect seamless, when it is detected that the interval between the touch points is relatively large, the interpolation method can be used to fill in the points so that the pen stroke can be more seamlessly connected during the movement. That is, in some embodiments, the display device 200 can obtain the interval distance between the new touch point and the original starting point of the pen stroke model, wherein the original starting point is a quasi-contour point at the edge position along the touch track direction in the pen stroke model. If the interval distance is greater than the distance threshold, an interpolation point is added between the new touch point and the original starting point of the pen stroke model, and the contour points and spare points associated with the interpolation point are generated based on the interpolation point, and the pen stroke model is reconstructed based on the interpolation point. If the interval distance is less than or equal to the distance threshold, the pen stroke model can be constructed based on the new touch point, that is, the step of generating the contour points and spare points associated with the new touch point based on the new touch point is performed.

[0134] After detecting a new touch point, the display device 200 can calculate the interval distance between the new touch point and the original first point in the original pen stroke model, and then judge the interval distance. If the interval distance is greater than or equal to the distance threshold, at least one interpolation point is inserted according to the interval distance, and the associated contour point and spare point are determined according to the line width. Thus, the interpolation point is used as the new first point of the new pen stroke model to construct the pen stroke model.

[0135] For example, as the user inputs a touch interaction instruction, when the display device 200 detects a new touch point P', it can calculate the interval distance L between the new touch point P' and the original touch point P60. When the interval distance L is less than the distance threshold ΔL, the new touch point P' is directly used as the first point of the new pen stroke model, and the position of the pen stroke model is updated in the manner provided in the above embodiment. When the interval distance L is greater than or equal to the distance threshold ΔL, the display device 200 can insert an interpolation point P" between the touch point P' and the touch point P60, and use the interpolation point P" as the first point of the new pen stroke model.

[0136] After updating the position of the pen stroke model by taking the interpolation point as the first point of the new pen stroke model, the display device 200 can draw the pen stroke graphics according to the updated pen stroke model position. After the pen stroke effect is drawn based on the pen stroke model of the interpolation point, the display device 200 can also use the new touch point (ie, P') as the pen stroke model to update the pen stroke model again to adapt to the subsequent touch point.

[0137] In some embodiments, when an interpolation point is inserted between a new touch point and the original starting point of the pen tip model, the position of the interpolation point can be determined based on the spacing distance between the new touch point and the original starting point of the pen tip model. For example, when the spacing distance L is greater than the distance threshold ΔL, and the spacing distance L is less than or equal to twice the distance threshold (i.e., 2ΔL), the interpolation point can be set at the midpoint between the new touch point and the original starting point of the pen tip model. When the spacing distance L is greater than twice the distance threshold (i.e., 2ΔL), the interpolation point can be set at 1 / 3 of the spacing distance between the new touch point and the original starting point of the pen tip model.

[0138] In other embodiments, when inserting an interpolation point between the new touch point and the original starting point of the pen stroke model, the position of the interpolation point can be determined according to a distance threshold. For example, when the interval distance L is greater than the distance threshold ΔL, the display device 200 can insert the interpolation point at a position where the distance from the original starting point P60 is the distance threshold ΔL.

[0139] Since the whiteboard application requires the display device 200 to display the pen stroke effects in real time, in order to obtain a better response speed, the display device 200 can use a regional refresh method during the writing process to display the pen stroke effects in the application interface.

[0140] Based on this, in some embodiments, in response to the touch interaction instruction, touch data is obtained. A touch track is drawn in the acceleration layer according to the touch data, wherein the acceleration layer is a display layer that performs regional refresh based on the coverage area of ​​the pen tip model. When a lift event in the touch track is detected, the touch track drawn in the acceleration layer is copied to the OSD layer, wherein the display level of the OSD layer is lower than the acceleration layer. Finally, the touch track and pen tip effect drawn in the acceleration layer are cleared.

[0141] After obtaining the touch command input by the user, the display device 200 can obtain touch data from the touch interaction module and call the acceleration layer. Then, based on the acceleration layer, the pen stroke graphics are drawn in real time according to the pen stroke model. Among them, the acceleration layer can be set to adopt a regional refresh method, such as refreshing the area where the entire pen stroke model is located, thereby improving the writing speed, and the user can clearly see the blurring effect of the pen stroke moving forward, thereby improving the user experience.

[0142] Based on the above display device 200, some embodiments of the present application further provide a method for drawing a pen tip trajectory line, comprising the following steps:

[0143] In response to a touch interaction instruction input by a user, acquiring a touch area generated by the touch interaction instruction in real time;

[0144] Generate a pen tip model according to the touch area, the pen tip model is a dot matrix model generated based on touch points, contour points and spare points in the touch area; the touch point is at least one contact point in the touch area, the contour point is at least one contact point in the touch area located at the edge of the pen tip; the spare point divides the distance between the touch point and the contour point into preset equal parts;

[0145] According to the pen tip model, a pen tip trajectory line is drawn at the end of the touch trajectory.

[0146] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a method for drawing a pen tip trajectory line, which can respond to the touch interaction command input by the user and obtain the touch area generated by the touch interaction command in real time. And generate a pen tip model according to the touch area, and then draw the pen tip trajectory line at the end of the touch trajectory according to the pen tip model. Among them, the pen tip model is a dot matrix model generated based on the touch point, contour point and spare point in the touch area; the touch point is at least one contact point in the touch area, and the contour point is at least one contact point located at the edge of the pen tip in the touch area; the spare point divides the distance between the touch point and the contour point into preset equal parts. The pen tip model can maintain the pen tip effect during the drawing process, and the pen tip effect is uniform and smooth, which improves the user experience.

[0147] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0148] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0149] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0150] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; The display is connected to a touch interaction module, and the touch interaction module is used to obtain a touch interaction instruction input by a user; The controller is configured as: Responding to a touch interaction instruction input by a user, acquiring a touch area and a touch track; Generate a pen tip model according to the touch area, the pen tip model is a dot matrix model generated based on touch points, contour points and spare points in the touch area; the touch point is at least one contact point in the touch area, the contour point is at least one contact point in the touch area located at the edge of the pen tip; the spare point divides the distance between the touch point and the contour point into preset equal parts; According to the pen tip model, a pen tip trajectory line is drawn at the end of the touch trajectory.

2. The display device according to claim 1, characterized in that The controller generates a pen stroke model according to the touch area, and is further configured to: Extracting a center line of the touch area, wherein the center line of the touch area is parallel to a direction line of the touch track; Extracting a preset number of touch points in the touch area based on the center line of the touch area, wherein the preset number is set according to the shape of the pen tip model; Taking the touch point as a reference, generating contour points according to the line width of the touch track; The spare point is added between the touch point and the contour point according to the shape of the pen stroke model.

3. The display device according to claim 2, characterized in that The controller extracts a preset number of touch points in the touch area based on the center line of the touch area, and is further configured to: Get the application ID that calls the whiteboard application; Query the current usage scenario according to the application ID; If the current usage scenario is the first scenario, extracting a first number of touch points in the touch area; If the current usage scenario is the second scenario, a second number of touch points is extracted from the touch area, and the second number is smaller than the first number.

4. The display device according to claim 2, characterized in that The touch area is a touch track formed during the touch sliding process, and the controller is further configured as follows: Extracting a preset number of contact areas from the touch track according to a pen tip refresh cycle, wherein the pen tip refresh cycle is greater than or equal to a sampling cycle of the touch interaction module; Delineating a direction line of the touch track according to the line width of the touch track; The touch points are extracted from the contact area in sequence along the direction line of the touch track, wherein the touch points are contact points in the contact area that are located on the direction line.

5. The display device according to claim 2, characterized in that The touch area is a contact area formed by a single touch process, and the controller is further configured to: Traversing the contact point coordinates in the contact area to obtain edge contact points; Delineating a center line of the contact area according to the edge contact point, wherein the center line of the contact area is parallel to a direction line of the touch track; According to the center line of the contact area, a preset number of contact points are extracted from the contact area to serve as the touch points.

6. The display device according to claim 1, characterized in that The controller executes drawing a pen tip trajectory line at the end of the touch trajectory according to the pen tip model, and is further configured to: Extracting quasi-contour points in the pen tip model, wherein the quasi-contour points are touch points, contour points and spare points located at the edge of the pen tip shape; Calculate the midpoint between adjacent quasi-contour points; A Bezier curve is constructed with the midpoint and / or the quasi-contour point as the starting and ending points to generate a stroke graphic.

7. The display device according to claim 6, characterized in that The controller executes drawing a pen tip trajectory line at the end of the touch trajectory according to the pen tip model, and is further configured to: Acquire a new touch point in the touch track; generating contour points and spare points associated with the new touch point based on the new touch point; The new touch point, the contour point and the spare point are used to replace the quasi-contour point to update the position of the pen stroke model.

8. The display device according to claim 7, characterized in that After the controller executes the step of acquiring a new touch point in the touch track, the controller is further configured to: Acquire the interval distance between the new touch point and the original starting point of the pen tip model, where the original starting point is a quasi-contour point at the edge of the pen tip model along the touch track direction; If the interval distance is greater than the distance threshold, adding an interpolation point between the new touch point and the original first point of the pen stroke model, and generating contour points and spare points associated with the interpolation point based on the interpolation point; If the interval distance is less than or equal to the distance threshold, the step of generating contour points and spare points associated with the new touch point based on the new touch point is performed.

9. The display device according to claim 1, characterized in that: The controller is also configured to: In response to the touch interaction instruction, acquiring touch data; Draw a touch track on an acceleration layer according to the touch data, where the acceleration layer is a display layer that performs regional refresh based on the coverage area of ​​the pen stroke model; Upon detecting a lift event in the touch track, copying the touch track drawn in the acceleration layer to an OSD layer, wherein the display level of the OSD layer is lower than that of the acceleration layer; Clear the touch track drawn in the acceleration layer.

10. A method for drawing a pen tip trajectory line, characterized in that: include: In response to a touch interaction instruction input by a user, acquiring a touch area generated by the touch interaction instruction in real time; Generate a pen tip model according to the touch area, the pen tip model is a dot matrix model generated based on touch points, contour points and spare points in the touch area; the touch point is at least one contact point in the touch area, the contour point is at least one contact point in the touch area located at the edge of the pen tip; the spare point divides the distance between the touch point and the contour point into preset equal parts; According to the pen tip model, a pen tip trajectory line is drawn at the end of the touch trajectory.

Images