Display device and touch track calibration display method
By calculating the expected color information in the display device and writing to the acceleration layer, the problem that the transparent color written to the FB acceleration layer is different from the actual color after superposition is solved, and dynamic adaptation of the superposition effect of different platform layers is achieved.
Patent Information
- Application Number
- CN202311500720.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-13
- Publication Date
- 2025-05-13
AI Technical Summary
In the display device, there is a problem that the transparent color written to the FB acceleration layer has a difference from the actual color after superposition.
By obtaining the track color information of the touch track, if transparency is included, the desired color information is calculated based on the track color information and calibration parameters, and a touch track line is generated and written to the acceleration layer for display. The calibration parameters show deviation values obtained by comparing the track color information and the target display color information.
Dynamically adapted to the layer overlay effect of different platforms, solving the problem that when displaying colors with transparency, the display color after layer overlay is different from the actual color.
Smart Images

Figure CN119987641A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of display devices, and in particular to a display device and a touch track calibration display method. Background Art
[0002] Display devices are intelligent devices that can present whiteboard application interfaces and support user interaction. Taking smart TV as an example, smart TV is based on Internet application technology, has an open operating system and chip, has an open application platform, can realize two-way human-computer interaction, and is a TV product that integrates multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users. Display devices can realize touch interactive operations through built-in or external touch devices.
[0003] In order to meet the needs of conference and education scenarios, for display devices that support touch interaction operations, you can run whiteboard applications and implement writing or drawing functions based on the touch area of the whiteboard application. The whiteboard application can respond to the touch interaction actions input by the user in real time and display the touch track.
[0004] In the process of displaying the touch track, in order to ensure the hand tracking and smoothness of the writing process, an additional frame buffer (FB) acceleration layer can be added to the synthesis module, and the handwritten data can be directly written to the FB acceleration layer, and then displayed on the screen after being synthesized and superimposed by the synthesis module. However, due to the differences in the superposition order and algorithm of the video layer, graphic layer and FB acceleration layer in the synthesis module of different platform solution providers, there will be a problem that the transparent color written to the FB acceleration layer is different from the actual color after superposition. Summary of the invention
[0005] The present application provides a display device and a touch track calibration display method to solve the problem that the transparent color written to the FB acceleration layer by the display device is different from the actual color after superposition.
[0006] In a first aspect, some embodiments of the present application provide a display device, comprising: a display and a controller. The display is configured to display a whiteboard application interface; the display is connected to a touch interaction module, and the touch interaction module is used to obtain a touch track input by a user; when a touch track of a drawing event is detected, the display also displays the touch track through an acceleration layer, and when the end point of the touch track is detected, the acceleration layer is released;
[0007] The controller is configured to perform the following program steps:
[0008] In response to a touch track of a drawing event, obtaining track color information of the touch track, wherein the track color information includes a color attribute value associated with the touch track;
[0009] If the track color information includes transparency, the expected color information is calculated according to the track color information and a calibration parameter, wherein the calibration parameter is a display deviation value obtained by comparing the track color information with target display color information, and the target display color information includes a color attribute value of the touch track displayed in the whiteboard application interface under the track color information;
[0010] Generate a touch trajectory line according to the expected color information;
[0011] The touch track line is written into the acceleration layer, so that the display displays the touch track line in the whiteboard application interface.
[0012] In a second aspect, some embodiments of the present application further provide a touch track calibration display method, which is applied to the display device provided in the first aspect, wherein the display device includes a display and a controller, and the display is configured to display a whiteboard application interface; the display is connected to a touch interaction module, and the touch interaction module is used to obtain a touch track input by a user; when a touch track of a drawing event is detected, the display also displays the touch track through an acceleration layer, and when an end point of the touch track is detected, the acceleration layer is released; the method includes:
[0013] In response to a touch track of a drawing event, obtaining track color information of the touch track, wherein the track color information includes a color attribute value associated with the touch track;
[0014] If the track color information includes transparency, the expected color information is calculated according to the track color information and a calibration parameter, wherein the calibration parameter is a display deviation value obtained by comparing the track color information with target display color information, and the target display color information includes a color attribute value of the touch track displayed in the whiteboard application interface under the track color information;
[0015] Generate a touch trajectory line according to the expected color information;
[0016] The touch track line is written into the acceleration layer, so that the display displays the touch track line in the whiteboard application interface.
[0017] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a touch track calibration display method, which can obtain the track color information of the touch track after obtaining the touch track of the drawing event, and calculate the expected color information according to the track color information and calibration parameters set for the touch point in the touch track, thereby generating a touch track line according to the expected color information, and writing the touch track line into the acceleration layer. Among them, the calibration parameter is a display deviation value obtained by comparing the track color information and the target display color information, and the target display color information includes the color attribute value of the touch track displayed in the whiteboard application interface under the track color information. By calculating the expected color information, the layer overlay effects of different platforms can be dynamically adapted to solve the problem that when displaying colors with transparency, the displayed color after layer overlay and the actual color are different. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0019] Figure 1 A schematic diagram showing usage scenarios of a display device in some embodiments of the present application;
[0020] Figure 2 A hardware configuration block diagram of a display device provided in some embodiments of the present application;
[0021] Figure 3 A hardware configuration block diagram of a control device provided in some embodiments of the present application;
[0022] Figure 4 A schematic diagram of software configuration in a display device provided in some embodiments of the present application;
[0023] Figure 5 A schematic diagram of touch tracks provided in some embodiments of the present application;
[0024] Figure 6 A schematic diagram of a whiteboard application interface provided in some embodiments of the present application;
[0025] Figure 7 A schematic diagram of a whiteboard application display system provided in some embodiments of the present application;
[0026] Figure 8 A schematic diagram of an acceleration layer provided for some embodiments of the present application;
[0027] Fig. 9Schematic diagram of teaching tools provided for some embodiments of the present application;
[0028] Fig.10 A schematic diagram of a touch track calibration display method flow chart provided in some embodiments of the present application;
[0029] Fig.11 A diagram of the relationship between acceleration layer calls provided in some embodiments of the present application;
[0030] Fig.12 A schematic diagram of a process of performing color calibration according to transparency provided in some embodiments of the present application;
[0031] Fig.13 A schematic diagram of a process for generating calibration parameters provided in some embodiments of the present application;
[0032] Fig.14 A schematic diagram of a color calibration control provided for some embodiments of the present application;
[0033] Fig.15 A schematic diagram of a flow chart of generating calibration parameters for different color channels provided in some embodiments of the present application. DETAILED DESCRIPTION
[0034] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.
[0035] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.
[0036] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
[0037] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
[0038] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0039] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0040] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , the user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100 .
[0041] In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.
[0042] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.
[0043] In addition to providing the broadcast receiving television function, the display device 200 may also provide an intelligent network television function with computer support functions, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.
[0044] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.
[0045] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
[0046] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
[0047] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from a controller, display video content, image content, and a menu control interface component and a user control UI interface, etc.
[0048] In some embodiments, the display 260 is connected to a touch interaction module so that the display device 200 supports touch interaction operations. The touch interaction module can be a built-in module or an external module. For example, in order to implement touch interaction operations, for a display device 200 with a built-in touch interaction module, the display 260 can be a touch screen, which can receive touch signals input by fingers, contacts, styluses, etc., and execute touch interaction responses according to a pre-set interaction strategy.
[0049] For the display device 200 with an external touch interaction module, a terminal, device, or component with a touch function can be connected through the device interface of the display device 200. For example, the USB or USB-C interface of the display device 200 is connected to a touch panel, and the touch panel can receive the touch data input by the user in real time and transmit the touch data to the display device 200 through the USB channel. The display device 200 can perform an interactive response based on the received touch data in combination with the touch application, so that the display device 200 supports touch interaction operations.
[0050] In some embodiments, the communicator 220 is a component for communicating with an external device or a server 400 according to various communication protocol types.
[0051] In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.
[0052] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0053] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).
[0054] In some embodiments, the user interface 280 is an interface that can be used to receive control input.
[0055] Figure 3 Some embodiments of the present application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.
[0056] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .
[0057] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.
[0058] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .
[0059] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.
[0060] The communication interface 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.
[0061] The user input / output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .
[0062] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.
[0063] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.
[0064] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.
[0065] Figure 4 Some embodiments of the present application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.
[0066] The application layer mainly includes commonly used applications on TV and application frameworks. Common applications are mainly applications developed based on browsers, such as HTML5 APPs and native APPs.
[0067] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).
[0068] Native apps can support online or offline, message push or local resource access.
[0069] The middleware layer includes various TV protocols, multimedia protocols, system components and other middleware. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.
[0070] The hardware layer mainly includes the hardware abstraction layer (HAL) interface, hardware and drivers. The HAL interface is a unified interface for all TV chips to connect, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.
[0071] The hardware layer of the display device 200 may also deploy other device interfaces, hardware, and drivers according to the specific display requirements of the display device 200. For example, in order to enrich the display types of the display device 200, an HDMI interface and a USB interface may be provided on the display device 200, wherein the HDMI interface may be connected to a device with video and audio input / output functions, and the corresponding audio and video output / input functions may be implemented through the HDMI driver. The USB interface may be connected to a device with signal and data transmission functions and interactive functions, and based on the USB driver, access signals, transmit data, and perform specific interactive actions.
[0072] For a display device 200 that supports touch interaction operations, the display device 200 has a built-in touch interaction module, and can receive touch data input by the user through the touch interaction module. According to the interaction principle of the touch interaction module, the touch interaction module can detect relevant parameters in the touch action. For example, a capacitive touch layer is provided on the display 260 of the display device 200. When the user's finger touches any position of the touch layer, the capacitance of the touch layer at the touch position will change. At this time, the touch interaction module can record the position of the capacitance change, and record the time when the capacitance change occurs in combination with the timer in the controller to generate touch data.
[0073] In some embodiments, the physical signal detected by the touch interaction module needs to be converted before it can be read by the controller 250 of the display device 200. For example, the analog signal of the capacitance change needs to be converted into a digital signal and then transmitted to the controller 250 of the display device 200. In order to adapt to the screen display process of the display device 200, the touch data detected by the touch interaction module also needs to be coordinate mapped so that the position point corresponding to the touch data can have a corresponding relationship with the display 260 of the display device 200 or the pixel point in the user interface. For example, the coordinate position detection accuracy of the touch interaction module is 65536×65536, and the resolution of the display 260 of the display device 200 is 3840×2160. After the touch interaction module detects the touch data, the coordinate mapping of the touch point position in the width and height directions can be performed according to the ratio of 65536 / 3840 and 65536 / 2160, so that the display device 200 can perform related operation responses based on the mapped touch point position coordinates.
[0074] The touch data may include different operation parameters according to the user's input method. Figure 5 As shown, the touch data may include the touch time, touch position, touch event type, number of touch points, etc. of the touch operation. In a touch interaction process, the touch event types that can be detected by the touch interaction module include: down events, move events, and up events of touch actions. Corresponding to the entire touch trajectory, a starting point [down; x1, y1, t1], a trajectory point [move; x2, y2, t2], and an end point [up; x3, y3, t3] can be formed. Each touch event records the corresponding touch time t and touch position (x, y).
[0075] It should be noted that, since the user's finger or touch device is in surface contact with the touch interaction module when performing touch interaction operations, that is, the touch interaction module can detect a contact area, and the contact area includes multiple contact points. Therefore, when the display device 200 performs interactive control, it can detect (or specify) a contact point in the contact area as a touch point. For example, when the contact area is an elliptical area formed when the user's finger contacts the touch interaction module, the display device 200 can traverse the contact point coordinates in the elliptical area, determine the coordinate extremes in two mutually perpendicular directions, to delineate the major axis and minor axis of the elliptical area, and use the contact point at the intersection of the major axis and the minor axis as the touch point.
[0076] In the process of executing the touch interaction response, the display device 200 can classify different touch times, touch positions, the number of touch points and the type of touch events, so as to detect the user's touch input gestures, thereby performing different interactive responses for different input gestures. For example, when the number of touch points in the touch data detected by the touch interaction module is 1, the touch event type only includes the down event and the up event, and the time interval between the down event and the up event is less than the single-click event time threshold. In addition, if the touch position change distance of the down event and the up event is less than the jitter distance threshold, it can be determined that the current user's touch input gesture is a click gesture. Based on the click gesture, the display device 200 executes the operation of starting the application according to the icon in the area where the touch position corresponding to the click gesture is located.
[0077] Similarly, the display device 200 can also detect other touch interaction gestures input by the user based on the touch time, touch position, number of touch points and touch event type, such as double-click gesture, slide gesture, long press gesture, multi-finger click gesture, multi-finger slide gesture, etc. Different interaction gestures can derive different touch parameters. For example, a slide gesture can also generate parameters such as slide distance, slide speed, slide direction, slide track shape, etc. Different touch parameters can be used to perform different interactive controls.
[0078] In some embodiments, in order to enrich the touch interaction types supported by the display device 200, the display device 200 can also perform complex gesture detection based on the dynamic change rules of touch time, touch position, number of touch points and touch event type. For example, when the touch interaction module detects that the touch data input by the user includes multiple touch points, and the touch position of each touch point is close to each other as the user inputs, it can be determined that the touch gesture currently input by the user is a grab gesture. Based on complex gesture detection, the display device 200 can perform more interactive responses. For example, when the detected touch gesture is a grab operation for an image view, the display device 200 can respond to the grab gesture and perform a control action to select and move the image display position.
[0079] In some embodiments, the touch gesture can also be combined with the touch position to form a touch interaction operation based on a specific position. For example, when the touch interaction module detects that the down event position during the touch operation is at the top of the display 260, the touch point position corresponding to the move event moves downward. When the up event is detected, the display device 200 can determine that the current touch gesture is to slide down from the top of the screen. Therefore, the display device 200 can respond to the touch gesture and control the display 260 to present a drop-down list.
[0080] Some touch interaction gestures can be used to perform interactive actions based on the operating system of the display device 200, which are called global gestures. For example, the operation of sliding down from the top of the screen to call out a drop-down list in the above example of the display device 200. Some touch interaction gestures can be used to perform interactive actions based on specific touch applications. For example, when the display device 200 runs a whiteboard application, the sliding touch operation input by the user can be used to draw a track line on the whiteboard.
[0081] The touch application can be a system application or a third-party application developed based on a specific display device type and user needs. The touch application can be installed in the display device 200 and started to run under user control. For example, the user can control the display device 200 to run the whiteboard application by clicking the "whiteboard" application icon in the application interface of the display device 200.
[0082] It should be noted that the whiteboard application can be an independent application, an associated application, or a functional module in a touch application. Different forms of whiteboard applications can have different startup or calling methods. For example, a user can start an independent whiteboard application through the application interface of the display device 200; a user can also start a whiteboard application by executing a "whiteboard" operation on a conference application; a user can also control the conference application to start the whiteboard functional module by clicking the "whiteboard" icon on the conference application.
[0083] Different forms of whiteboard applications may present different forms of whiteboard application interfaces after startup. For example, when a user starts a whiteboard application in an associated application form, the display device 200 may automatically enter a dual-screen (or split-screen) mode. In the dual-screen (or split-screen) mode, the display device 200 may display a user interface through two display areas, i.e., the main screen displays the original application (such as a conference application) interface, and the secondary screen displays the whiteboard application interface.
[0084] After the whiteboard application is running, the display device 200 can be switched to display a whiteboard interface. Figure 6 As shown, the whiteboard interface may include drawing tool controls for drawing operations, such as pen shape, graphics, line shape, color, erase, clear screen, selection, etc. The user can click any control to draw graphics according to specific drawing needs.
[0085] like Figure 7 As shown, the display device 200 can render and display the drawing picture in real time through an image generation (Image Producer) module, an image rendering (surface flinger) module, a synthesis (Composer) module, a video process (Video Processing Unit hardware, VPU hardware) module and a display (screen).
[0086] In the process of displaying the drawing picture, the graphic interface (openGLES) of the image generation module can be connected to the whiteboard application to generate the drawing image content and pass the image content to the image rendering module. The image rendering module is used to control the display 260 to display the content, that is, to render the image content through the user interaction layer (UI layer) or the video layer (video layer) according to the image content. In order to obtain a better display effect, the image content of the UI layer can be rendered by the GPU component, so as to form a picture frame for display in the synthesis module. Among them, the picture frames can be stored in the synthesis module through the frame buffer (framebuffer) and the video buffer (video buffer), respectively, and the picture content is formed in the corresponding layer through the video process module. That is, the image frames generated by the video playback process form the picture content through the video layer (video plane), and the image frames of other image pictures (such as touch tracks, graphics, etc.) form the picture content through the primary OSD layer (primary OSD plane). Finally, the display device 200 forms the final picture through the blending unit (blend) of the video process module and displays it on the display 260.
[0087] Since the whiteboard application will present the user's touch trajectory in real time according to the user's touch operation, in order to present a better real-time response effect, the display device 200 should shorten the touch action input time and the delay time of the drawing result display. To this end, in some embodiments, the display device 200 can present a real-time painting effect by setting an acceleration layer. That is, in the video process module of the display device 200, an additional extended display layer (external OSD plane) can be set on the basis of the main OSD layer and the video layer. Among them, the extended display layer can be configured with different layer characteristics according to the specific display effect requirements. For example, the bitmap refresh mode of the extended display layer can be modified so that the extended display layer is refreshed in real time according to the region, thereby improving the display speed of the graphics. At this time, the extended display layer can be used as an acceleration layer in scenes with high dynamic display effects.
[0088] Taking the display device 200 running a whiteboard application as an example, in order to improve the real-time response speed of the line drawing process, after detecting the user's touch operation, the touch track can be drawn in real time on the extended display layer (acceleration layer). Figure 8 As shown, the display level of the acceleration layer can be higher than other layers, and when the user completes the touch input, the lines drawn by the acceleration layer are updated to other layers, thereby reducing input delay and improving the real-time display effect of the whiteboard application drawing process.
[0089] In some embodiments, the extended display layer can also work together with other graphics to improve display quality. For example, the acceleration layer can respond to the touch events input by the user at the same time as the main OSD layer, and draw graphics separately. However, since the acceleration layer is displayed above the main OSD layer, the graphics drawn by the acceleration layer can block the graphics drawn by the OSD layer to maintain real-time response speed. After the user inputs the touch interaction action, the content displayed by the acceleration layer can be released directly, and the OSD layer directly forms the drawn graphics, so there is no need for the acceleration layer to refresh the drawn graphics to the OSD layer, reducing the graphics mixing time. It not only improves the real-time display effect of the graphics drawing process, but also improves the final presentation quality of the graphics drawing.
[0090] In some embodiments, in order to meet different user needs, the whiteboard application can also dynamically configure different interface contents. Fig. 9 As shown, a "teaching tool" option may be included in a whiteboard application run by a display device 200 applied to the field of education. When a user clicks on the teaching tool option, a teaching tool list may pop up. The teaching tool list may include tool options of the type "ruler", "set square", "protractor", etc. After the user clicks on the "set square" tool option, the "set square" tool may be called to assist in drawing. At this time, the display device 200 may add a movable set square tool graphic to the whiteboard drawing interface, and when the user's touch operation track approaches the edge of the set square tool graphic, a straight line segment may be drawn along the edge of the set square tool graphic.
[0091] In some embodiments, the whiteboard application can also store the graphic objects drawn by each user touch action. Among them, a touch action refers to the process from the user's finger (or stylus) contacting the touch layer to the user's finger (or stylus) leaving the touch layer. That is, if the user inputs a click action, a touch action should include a down event and an up event. If the user inputs a sliding action, a touch action should include a down event, a move event, and an up event. Each touch action can generate a drawing object, and the whiteboard application can record the drawing object, so that the user can perform actions such as selection, undo, and redo.
[0092] When storing graphics, the whiteboard application can also set associated information for the graphic object according to the graphic characteristics and input status. For example, after the user draws a straight line, the whiteboard application can set a shape identifier for the straight line object. The shape identifier can be stored in association with the straight line object and can be called by other modules of the whiteboard application or other applications to facilitate operations such as object selection, object retrieval, and object deletion.
[0093] In some embodiments, the whiteboard application interface may also provide drawing auxiliary tools and menus for adjusting the drawing content. For example, the whiteboard application interface may include a "select" tool, and when the user clicks the "select" tool icon, the whiteboard application may be controlled to enter the object selection mode. In the object selection mode, the display device 200 may call the drawing object that intersects with the touch position based on the touch position under the down event, move event, and / or up event in the user's touch interaction operation, so as to achieve the purpose of multi-graphic selection.
[0094] In some embodiments, the whiteboard application may also support multiple gesture interaction operations, and have different control functions for different gesture interaction operations. For example, the whiteboard application may move the whiteboard drawing area along the multi-finger sliding track in response to the user's multi-finger sliding operation. The whiteboard application may also execute an erase function in response to the user's entire palm sliding operation to erase the drawing graphics covered by the palm sliding operation track.
[0095] Based on the above whiteboard application, the display device 200 displays the whiteboard application interface after running the whiteboard application. The user can draw or write the touch trajectory line of the touch trajectory in real time based on the touch interaction command input by the user interface. In the process of drawing the touch trajectory line, the user can set the trajectory color information associated with the touch trajectory, and set the pixel value for the pixel point corresponding to the touch trajectory line according to the touch trajectory color information. Among them, the trajectory color information is the color attribute value associated with the touch trajectory, and the color attribute value may include RGB value and Alpha value. RGB value is the value of the red channel, green channel and blue channel, which is used to represent the color; Alpha value is the value of the Alpha channel, which is used to represent transparency. For example, the user can click on the color setting control in the whiteboard application interface to control the display device 200 to display the color palette. After the user clicks on a color option in the color palette, it means that the track color information associated with the touch track is set to that color, and the color attribute value is (R, G, B, A), where R represents the color value of the red channel, G represents the color value of the green channel, and B represents the color value of the blue channel. The color value of each channel is 0-255; A is the value of the Alpha channel, which is used to represent the transparency value, and the transparency value range is 0-1.
[0096] Depending on the application scenario, the content of the track color information set for the touch point is also different. That is, in some scenarios, the touch track line displayed by the display device 200 is an opaque track line. In other scenarios, the touch track line displayed by the display device 200 is a transparent track line. Whether the touch track line of the touch track is transparent depends on the Alpha channel in the touch color information associated with the touch track. For ease of distinction, in the embodiment of the present application, the RGB value is referred to as the color value, and the Alpha value is referred to as the transparency value.
[0097] Therefore, the track color information of the touch track may include color values under multiple channels. For example, the track color information includes color values under the red channel, the green channel, and the blue channel, respectively. Then, the track color information may be expressed as (R, G, B). For the track color information including the transparency value, in addition to the color values under multiple channels, it also includes a value indicating the degree of transparency. That is, the touch color information with the transparency value may be expressed as (R, G, B, A).
[0098] It should be noted that the transparency value described in the embodiment of the present application is used to indicate the degree to which the touch track does not block the underlying screen, that is, the lower the transparency value, the more transparent the touch track is, and the less it can block the underlying screen; conversely, the higher the transparency value of the touch track, the more opaque the touch track is, and the more it can block the underlying screen. For example, a touch track with a transparency value of 1 completely blocks the underlying screen, and a touch track with a transparency value of 0 does not block the underlying screen at all, that is, when the transparency value is not equal to 1, the track color information of the touch track includes transparency, and when the transparency value is equal to 1, the track color information does not include transparency.
[0099] After setting the track color information, the display device 200 can draw the touch track line in real time through the acceleration layer according to the touch color value and touch transparency value in the track color information. Since the content of the acceleration layer needs to be superimposed with the content of the video layer and the OSD layer through the mixing unit to form a display screen, the color with transparency written to the FB acceleration layer will be different from the actual color after superposition due to the influence of the superposition order and the synthesis algorithm. In addition, when different solution providers synthesize the video layer, OSD layer and FB acceleration layer in the synthesis module, there are differences in the superposition order and synthesis algorithm, which leads to large differences in the display effects of the display devices 200 of different solution providers.
[0100] In order to improve the problem that when displaying colors with transparency, there is a difference between the displayed color after layer superposition and the actual color, a touch track calibration display method is provided in some embodiments of the present application, and the method can be applied to the display device 200. In order to meet the implementation of the touch track calibration display method, the display device 200 should at least include a display 260 and a controller 250, wherein the display 260 is configured to display a whiteboard application interface, and the display 260 can also be connected to a touch interaction module to form an integrated touch screen, so as to obtain the touch track of the user input through the touch interaction module. When the touch track of the drawing event is detected, the display 260 also displays the touch track through the acceleration layer, and releases the acceleration layer when the end point of the touch track is detected; such as Fig.10 As shown, the controller 250 is used to execute the program steps of the touch track calibration display method, including the following contents:
[0101] S100: In response to the touch track, obtaining track color information of the touch track.
[0102] Since the whiteboard application interface includes multiple executable controls, such as a color setting control, a line control, an erase control, etc., when the user inputs a touch interaction instruction for these controls, the display device 200 can determine whether the user inputs a touch track for executing a writing or drawing action, that is, whether the touch track of a drawing event is input, according to the position of the touch point. Therefore, the touch track of a drawing event includes a sliding instruction, a click instruction, etc. input by the user in the drawing or writing area.
[0103] Among them, the touch track of the drawing event includes the color attribute value associated with the touch track. The touch track is a touch data set formed by at least one touch point generated by the user performing sequential interactive operations. The touch track can be a dynamic data set. For example, after the display device 200 detects a down event located in the drawing or writing area, it starts to record the touch track. As the user slides, the touch interaction module will detect touch points of multiple move events, and the touch track is a touch point set consisting of the touch point of the down event and all the touch points of the move events from the down event to the current time.
[0104] The display device 200 can set the track color information associated with the touch track according to the interactive actions of the user when performing writing or drawing operations. For example, after the user clicks the red option on the color palette and enters a sliding touch command in the writing or drawing area, the display device 200 can set the track color information containing a red color value for each touch point generated by the sliding touch command, such as (R, 0, 0, 1). Similarly, when the user draws a red touch track with transparency, the display device 200 can set the track color information with transparency for each touch point in the touch track according to the transparency selected by the user, such as (R, 0, 0, A), 0≤A<1.
[0105] Depending on the drawing content, the display device 200 sets different track color information for the touch points in the touch track. That is, the display device 200 can draw a solid color touch track and a colored touch track according to the user's selection. For a solid color touch track, the display device 200 can set the same track color information for all touch points; and for a colored touch track, the display device 200 can set different track color information for different touch points. Similarly, for track color information with transparency, the transparency set for different touch points can be the same or different.
[0106] In some embodiments, when the display device 200 displays the touch track in real time through the acceleration layer, the display device 200 can write the set track color information into the acceleration layer. The acceleration layer is a display layer that refreshes the display content according to the unit area. The acceleration layer has good real-time display and can be used to display the touch track in real time. After receiving the touch track of the drawing event, the display device 200 can call the acceleration layer to display the touch track line of the touch track.
[0107] It should be noted that the acceleration layer can be hidden or displayed depending on whether a writing or drawing operation occurs on the display device 200. The display or hiding of the acceleration layer can be achieved by calling or stopping the use, or by changing the display hierarchy relationship of the acceleration layer, the video layer, and the OSD layer. Fig.11 As shown, the display level of the acceleration layer is higher than the video layer and the graphics layer when the user inputs a touch interaction instruction; the display level of the acceleration layer is lower than the video layer and / or the graphics layer when the user does not input a touch interaction instruction.
[0108] After acquiring the touch track, the display device 200 can extract the track color information of the touch track. And perform color calibration according to the track color information. Since the final display color presented by the display device 200 is different from the actual color because the mixing unit affects the color with transparency when superimposing the acceleration layer, the video layer, and the graphics layer, and the color without transparency is usually not affected, in some embodiments, the display device 200 can read the track color information after acquiring the touch track to determine whether the track color information contains transparency.
[0109] Among them, whether the trajectory color information includes transparency can be determined by parsing the value of the data flag of the trajectory color information, that is, parsing the transparency value in the trajectory color information. For example, after the display device 200 obtains the touch trajectory, the trajectory color information (R, G, B, A) of each touch point in the touch trajectory can be traversed. If the value corresponding to the "A" data item is not equal to 1, it means that the trajectory color information includes transparency. If the trajectory color information is (R, G, B, 1), that is, the value corresponding to the "A" data item is equal to 1, it means that the trajectory color information does not include transparency.
[0110] S200: If the track color information includes transparency, calculate the expected color information according to the track color information and the calibration parameters
[0111] If the track color information includes transparency, it is determined that the touch track line of the touch track includes transparency, and it is necessary to perform color calibration, so the expected color information can be calculated according to the track color information and the calibration parameters. If the track color information does not include transparency, it is determined that the touch track line of the touch track does not include transparency, and it is not necessary to perform color calibration on the touch track, so the touch track line can be generated according to the track color information, and the touch track line is written into the acceleration layer so that the display displays the touch track line, that is, the touch track line is directly displayed according to the touch color value. For example, Fig.12 As shown, when the transparency value in the track color information is not equal to 1, the expected color information is calculated according to the track color information and the calibration parameters; when the transparency value in the track color information is equal to 1, a touch track line is generated according to the current track color information, and the touch track line is written into the acceleration layer. It should be noted that, in some embodiments, the touch track includes multiple touch points, and the color attribute values associated with the pixels corresponding to different touch points in the track touch information may be different. Therefore, when determining whether the track color information contains transparency, the display device 200 needs to traverse the color attribute values of all the pixels corresponding to the touch points in the current touch track. When the color attribute value of any pixel does not include transparency, the step of calculating the expected color information according to the track color information and the calibration parameters is executed. For example, when the transparency value in the color attribute value corresponding to any pixel is not equal to 1, the step of calculating the expected color information according to the track color information and the calibration parameters is executed. The display device 200 can also only judge whether the color attribute value of the current pixel contains transparency, so that when the track color information of the current pixel contains transparency, color calibration is only performed on the current pixel.
[0112] After obtaining the track color information and determining that the track color information includes transparency, the display device 200 can calculate the expected color information according to the track color information and the calibration parameter. The calibration parameter is a parameter preset by the display device 200. The calibration parameter is a display deviation value obtained by comparing the track color information with the target display color information; the target display color information includes the color attribute value of the touch track displayed in the whiteboard application interface under the track color information.
[0113] In order to obtain the calibration parameters, the display device 200 may calculate the calibration parameters in advance through other touch tracks, such as Fig.13 As shown, in some embodiments, the display device 200 can obtain a calibration track, wherein the calibration track is a touch track for performing calibration. The calibration track also includes at least one touch point, and the calibration track is provided with calibration color information, the calibration color information includes a color attribute value associated with the calibration track, and the color attribute value associated with the calibration track includes a calibration color value and a calibration transparency value.
[0114] The calibration track can be manually generated by the user by performing a touch interaction operation. For example, when the display device 200 runs the whiteboard application for the first time, the display device 200 can enter a setting mode for generating calibration parameters. At this time, the display device 200 can display a prompt message "Please draw a red line" through the whiteboard application interface to guide the user to enter the calibration track.
[0115] The calibration track can also be automatically generated by the display device 200 by running the whiteboard application, that is, when the display device 200 runs the whiteboard application for the first time, the display device 200 automatically enters the setting mode and draws a monochrome line in the whiteboard application interface by simulating touch events to obtain the calibration track.
[0116] like Fig.14 As shown, in some embodiments, in order to obtain the calibration track, a color calibration control may be provided in the whiteboard application interface. When the calibration parameters need to be generated, the display device 200 may control the display 260 to display the color calibration control in the whiteboard application interface. And detect the interactive action performed by the user on the color calibration control. When the user selects the color calibration control, the display device 200 may obtain the calibration color information of the selected color calibration control in response to the selection instruction input by the user based on the color calibration control. Then, based on the calibration color information, a calibration track line of the calibration track is added at a preset position of the whiteboard application interface.
[0117] After obtaining the calibration track, the display device 200 generates a calibration track line according to the calibration color information, and controls the display to display the calibration track line in the whiteboard application interface. For the display device 200 that displays the touch track in real time through the acceleration layer, after obtaining the calibration track, the acceleration layer can be called, and the calibration track line can be written into the acceleration layer, and then the display 260 can be controlled to display the superimposed display screen of the acceleration layer, the video layer, and the graphics layer to form the whiteboard application interface.
[0118] The display device 200 then takes a screenshot of the whiteboard application interface to generate a calibration image including the calibration trajectory, extracts calibration display color information of the calibration trajectory from the calibration image, and obtains the calibration parameters by comparing the calibration color information with the calibration display color information.
[0119] In some embodiments, in order to obtain calibration parameters, the display device 200 may read the calibration color value and the calibration transparency value from the calibration color information when comparing the calibration color information with the calibration display color information. Then, the theoretical color value is calculated based on the calibration color value and the intermediate value. The intermediate value is equal to the difference obtained by subtracting the calibration transparency value from 1; the theoretical color value is the product of the calibration color value and the intermediate value. Then, the calibration display color value is read from the calibration image, and the calibration parameters are calculated based on the theoretical color value and the calibration display color value, wherein the calibration parameters are the ratio of the calibration display color value to the theoretical color value.
[0120] For example, the calibration color information of the calibration track setting is (r1, 0, 0, a1), that is, the track data formed by the calibration track in the acceleration layer only has the color value red r1 and the transparency value a1. After being superimposed on the whiteboard application interface through the acceleration layer, a calibration track line image with red r1 and transparency a1 can be formed. After the display device 200 takes a screenshot of the formed image, it can analyze the color value of the corresponding track position and obtain that the screen displays red r2. According to the transparency effect calculation, the expected color value should be red r1*(1-a1), but the result of the screenshot analysis is r2, that is, the synthesis module generates a color error r1*(1-a1)*aa=r2 during the superposition process, thereby obtaining the calibration parameter, that is, the transparency error aa=r2 / (r1*(1-a1)).
[0121] After obtaining the calibration parameters, the display device 200 can store the calibration parameters and clear the calibration track in the whiteboard application interface so that the user can perform subsequent writing or drawing operations. Since the color displayed by the display device 200 can be displayed by a combination of three primary color channels: red (R), green (G), and blue (B), and the color presentation effect under different channels is affected by transparency to different degrees, in some embodiments, the calibration parameters include first channel parameters, second channel parameters, and third channel parameters. Fig.15 As shown, when generating calibration parameters, the display device 200 can draw, screenshot and compare different channels respectively, so as to determine the calibration parameters under each channel. That is, after clearing the calibration track line in the whiteboard application interface, the display device 200 can also change the calibration color information to re-acquire the calibration track line using the changed calibration color information.
[0122] For example, after drawing, displaying, screenshotting, extracting color information, and comparing the calibration track with only the red color value r1 and the transparency value a1 to obtain the calibration parameters applicable to the red channel; the display device 200 can clear the red track in the whiteboard application interface, and then draw the green calibration track according to the calibration color information (0, g1, 0, a1), and draw, display, screenshot, extract color information, and compare the calibration track in accordance with the method provided in the above embodiment to obtain the calibration parameters applicable to the green channel. Similarly, after drawing, displaying, screenshotting, extracting color information, and comparing the calibration track with only the green g1 and the transparency value a1 to obtain the calibration parameters applicable to the green channel, the blue calibration track is drawn according to the calibration color information (0, 0, b1, a1), and draw, display, screenshot, extract color information, and compare the calibration track in accordance with the method provided in the above embodiment to obtain the calibration parameters applicable to the blue channel. The calibration parameters calculated under the three channels of R, G, and B are combined and stored for subsequent use when drawing the touch track of the color to be transparent.
[0123] After the calibration parameters are generated through the above-mentioned embodiment, the display device 200 can call the stored calibration parameters after obtaining the track color information, and calculate the expected color information according to the track color information and the calibration parameters. Obviously, when the calibration parameters include calibration parameters under multiple channels, the display device 200 can perform calibration calculations on different color channels respectively, that is, in some embodiments, the display device 200 can extract the first channel color, the second channel color, and the third channel color from the track color information. Then calculate the first expected color according to the first channel color and the first channel parameter; and calculate the second expected color according to the second channel color and the second channel parameter; and calculate the third expected color according to the third channel color and the third channel parameter. Then synthesize the first expected color, the second expected color, and the third expected color into the expected color information.
[0124] For example, when the track color information corresponding to the touch track includes transparency, the corresponding R, G, and B data are respectively corrected for transparency errors to obtain R1=R*(1-A) / aa, G1=G*(1-A) / aa, and B1=B*(1-A) / aa; then the (R1, G1, B1, A) color value of each point on the track after adjusting the error is written into the FB acceleration layer, and an error of aa will be generated when the synthesis module is synthesized. Since the newly calculated value and the error are offset, the color of the touch track line displayed on the whiteboard application interface after synthesis by the synthesis module is the expected (R, G, B, A).
[0125] S300: Generate a touch trajectory line according to the expected color information.
[0126] After obtaining the expected color information by calculation, the display device 200 can generate a touch trajectory line according to the expected color information. For the display process of the touch trajectory in real time, since the touch trajectory adds touch points of the move event in real time with the user's touch input, the display device 200 can draw the newly added trajectory segment in real time based on the newly added touch points, using the color value and transparency corresponding to the expected color information, and form a touch trajectory line with the already drawn touch trajectory.
[0127] In some real-time examples, when the display device 200 displays the touch track in real time through the acceleration layer, the display device 200 can respond to the operation event of detecting a new touch point in the touch track, and draw a refresh track line on the acceleration layer according to the expected color information. Then send the refresh track line to the synthesis module, and control the synthesis module to superimpose the display content of the acceleration layer, the video layer, and the graphics layer to form a display screen of the touch track line, and display it through the display 260.
[0128] S400: Writing the touch track line into the acceleration layer, so that the display displays the touch track line in the whiteboard application interface.
[0129] The display device 200 generates a touch track line of the touch track according to the expected color information, and then directly writes the touch track line into the acceleration layer. Since the expected color information contains the error after the display device 200 superimposes and displays, the touch track line generated according to the expected color information is written into the acceleration layer, which is not limited to the superposition algorithm and superposition sequence used by the display device 200, and eliminates the problem of differences between the touch track displayed on the acceleration layer and the touch track displayed on the OSD layer.
[0130] It can be seen that in the above embodiment, the display device 200 can add a color calibration function so that the user can first perform color calibration before using the whiteboard application, compare the color with transparency and the color value after being displayed through the current platform acceleration layer to obtain the transparency difference value aa, and then when drawing the transparent color trajectory on the acceleration layer, reversely superimpose the transparency difference value aa to ensure that the color finally displayed after the acceleration layer is superimposed is the desired color.
[0131] Based on the above touch track calibration display method, some embodiments of the present application further provide a display device 200, which includes a display 260 and a controller 250. The display 260 is configured to display a whiteboard application interface; the display 260 is connected to a touch interaction module, and the touch interaction module is used to obtain a touch interaction instruction input by a user; the controller 250 is configured to execute the following program steps:
[0132] S100: In response to a touch track of a drawing event, obtaining track color information of the touch track, where the track color information includes a color attribute value associated with the touch track;
[0133] S200: If the track color information includes transparency, calculate expected color information according to the track color information and a calibration parameter, wherein the calibration parameter is a display deviation value obtained by comparing the track color information with target display color information, and the target display color information includes a color attribute value of the touch track displayed in the whiteboard application interface under the track color information;
[0134] S300: Generate a touch trajectory line according to the expected color information;
[0135] S400: Writing the touch track line into the acceleration layer, so that the display displays the touch track line in the whiteboard application interface.
[0136] It can be seen from the above technical solution that the display device provided by the above embodiment can obtain the track color information of the touch track after obtaining the touch track of the drawing event, and calculate the expected color information according to the track color information and calibration parameters set for the touch point in the touch track, thereby generating a touch track line according to the expected color information, and writing the touch track line into the acceleration layer. Among them, the calibration parameter is a display deviation value obtained by comparing the track color information and the target display color information, and the target display color information includes the color attribute value of the touch track displayed in the whiteboard application interface under the track color information. By calculating the expected color information, the layer overlay effects of different platforms can be dynamically adapted to solve the problem that when displaying colors with transparency, the displayed color after layer overlay and the actual color are different.
[0137] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.
[0138] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.
[0139] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A display device, characterized in that: include: A display configured to display a whiteboard application interface; The display is connected to a touch interaction module, and the touch interaction module is used to obtain a touch track input by a user; When a touch track of a drawing event is detected, the display further displays the touch track through an acceleration layer, and when an end point of the touch track is detected, the acceleration layer is released; The controller is configured as: In response to a touch track of a drawing event, obtaining track color information of the touch track, wherein the track color information includes a color attribute value associated with the touch track; If the track color information includes transparency, the expected color information is calculated according to the track color information and a calibration parameter, wherein the calibration parameter is a display deviation value obtained by comparing the track color information with target display color information, and the target display color information includes a color attribute value of the touch track displayed in the whiteboard application interface under the track color information; Generate a touch trajectory line according to the expected color information; The touch track line is written into the acceleration layer, so that the display displays the touch track line in the whiteboard application interface.
2. The display device according to claim 1, characterized in that The controller is also configured to: Acquire calibration color information of the calibration track, wherein the calibration color information includes a color attribute value associated with the calibration track; Generating a calibration trajectory line according to the calibration color information; Controlling the display to display the calibration trajectory line in the whiteboard application interface; Taking a screenshot of the whiteboard application interface to generate a calibration image including the calibration trajectory; Extracting calibration display color information of the calibration trajectory from the calibration image, wherein the calibration display color information is a color attribute value of the calibration trajectory displayed in a whiteboard application interface under the calibration color information; The calibration color information and the calibration display color information are compared to obtain the calibration parameters.
3. The display device according to claim 2, characterized in that The controller controls the display to display the calibration trajectory in the whiteboard application interface, and is further configured to: Calling the acceleration layer; Writing the calibration trajectory into the acceleration layer; The display is controlled to display a superimposed display screen of the acceleration layer, the video layer, and the graphics layer to form the whiteboard application interface.
4. The display device according to claim 3, characterized in that The controller is also configured to: In response to detecting an operation event of adding a touch point in the touch track, drawing a refresh track line in the acceleration layer according to the expected color information; Sending the refresh trajectory to a synthesis module; The synthesis module is controlled to superimpose the display contents of the acceleration layer, the video layer, and the graphic layer to display the touch trajectory line.
5. The display device according to claim 2, characterized in that The controller generates a calibration trajectory according to the calibration color information, and is further configured to: Controlling the display to display a color calibration control in the whiteboard application interface; In response to a selection instruction input by a user based on the color calibration control, obtaining calibration color information of the selected color calibration control; The calibration trajectory line is added at a preset position of the whiteboard application interface based on the calibration color information.
6. The display device according to claim 2, characterized in that The controller compares the calibration color information with the calibration display color information to obtain the calibration parameter, and is further configured to: Reading a calibration color value and a calibration transparency value from the calibration color information; Calculating a theoretical color value based on the calibrated color value and an intermediate value, wherein the intermediate value is equal to a difference obtained by subtracting the calibrated transparency value from 1; The theoretical color value is the product of the calibrated color value and the intermediate value; reading the calibration display color value from the calibration image; A calibration parameter is calculated according to the theoretical color value and the calibrated display color value, wherein the calibration parameter is a ratio of the calibrated display color value to the theoretical color value.
7. The display device according to claim 2, characterized in that After the step of obtaining the calibration parameters, the controller is further configured to: storing the calibration parameters; Clearing the calibration track line in the whiteboard application interface; The calibration color information is changed to re-acquire the calibration trajectory line using the changed calibration color information.
8. The display device according to claim 1, characterized in that The calibration parameters include first channel parameters, second channel parameters, and third channel parameters. The controller calculates the expected color information according to the track color information and the calibration parameters, and is further configured to: Extracting a first channel color, a second channel color, and a third channel color from the track color information; Calculate a first desired color according to the first channel color and the first channel parameter; and, calculate a second desired color according to the second channel color and the second channel parameter; and, calculate a third desired color according to the third channel color and the third channel parameter; The first desired color, the second desired color, and the third desired color are synthesized into the desired color information.
9. The display device according to claim 1, characterized in that: The controller executes acquiring the track color information of the touch track, and is further configured to: If the track color information does not include transparency, generating a touch track line according to the track color information; The touch track line is written into the acceleration layer, so that the display displays the touch track line in the whiteboard application interface.
10. A touch track calibration display method, characterized in that: The display device according to any one of claims 1 to 9 comprises a display and a controller, wherein the display is configured to display a whiteboard application interface; the display is connected to a touch interaction module, and the touch interaction module is used to obtain a touch track input by a user; when a touch track of a drawing event is detected, the display further displays the touch track through an acceleration layer, and when an end point of the touch track is detected, the acceleration layer is released; the method comprises: In response to a touch track of a drawing event, obtaining track color information of the touch track, wherein the track color information includes a color attribute value associated with the touch track; If the track color information includes transparency, the expected color information is calculated according to the track color information and a calibration parameter, wherein the calibration parameter is a display deviation value obtained by comparing the track color information with target display color information, and the target display color information includes a color attribute value of the touch track displayed in the whiteboard application interface under the track color information; Generate a touch trajectory line according to the expected color information; The touch track line is written into the acceleration layer, so that the display displays the touch track line in the whiteboard application interface.