Display device and content display method
By generating and processing touch tracks in the display device, superimposing to the first layer using the first blending mode and removing the first layer after the second layer is refreshed, the splash screen and transparency superposition problems during the display process of the GOP layer and the OSD layer are solved, and a smooth rendering content display is achieved.
Patent Information
- Application Number
- CN202410127736.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-30
- Publication Date
- 2025-08-08
AI Technical Summary
In display devices, drawing content with transparency cannot guarantee seamless linkage during the display and undo process of GOP and OSD layers, resulting in problems with splash screens or transparency overlays.
Using a display device and content display method, the first drawn content is generated by receiving the touch track through the controller, and superimposed on the first layer in a first blending mode. After detecting that the touch input is completed, it is superimposed on the second layer for refreshing and displaying, and the first layer is removed after the second layer is refreshed to avoid splash screen and transparency overlay.
It can avoid splash screens and transparency overlays in the display device, ensure the smooth display effect of the drawn content, and improve the user interaction experience.
Smart Images

Figure CN120448000A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of display devices, and in particular to a display device and a content display method. Background Art
[0002] A display device refers to a terminal device that can output a specific display image. The display of a display device is used as a medium for interaction and information exchange with the user. To meet the diverse needs of users, touch components can be integrated into the display to implement the touch function of the display device to meet the user's touch interaction. In educational scenarios, a whiteboard application can be set up in the display device, and users can use the whiteboard application to perform whiteboard presentations on the display device.
[0003] When using a whiteboard application, the user touches the display, and the display device renders the user's touch trajectory to generate the corresponding drawing content. In related technologies, to improve trajectory rendering speed, the user's touch trajectory is usually copied to the GOP (Group of Pictures) layer for refresh display. After the user completes the drawing, the touch trajectory is refreshed to the OSD (on-screen display) layer to display the drawing content, and then the GOP layer is revoked. The GOP layer is higher than the OSD layer.
[0004] However, in the above-mentioned rendering process of the drawing content, for the drawing content with transparency, if the display of the GOP layer and the cancellation of the ODS layer cannot ensure seamless connection, it will cause screen flashing or transparency superposition. Summary of the Invention
[0005] The present application provides a display device and a content display method to solve the current rendering process of drawn content. For line drawing content with transparency, if the display of the GOP layer and the cancellation of the ODS layer cannot ensure seamless connection, it will cause technical problems such as screen flashing or transparency superposition.
[0006] In a first aspect, some embodiments of the present application provide a display device, including:
[0007] a display configured to display a user interface;
[0008] A touch component configured to detect a touch track of a user input;
[0009] The controller is configured as:
[0010] receiving the touch track from the touch component, and generating first drawing content based on the touch track;
[0011] If the image blending mode of the first layer is the first blending mode, the first drawing content is superimposed on the first layer for refresh display, wherein the layer below the first layer is the second layer, the first layer also displays the layer content of the second layer, and the layer content of the second layer includes at least background content. The first blending mode is an image blending mode that preserves both the drawing content and the target content when superimposing the currently drawn drawing content on the target content, and the first drawing content is drawing content with transparency.
[0012] If it is detected that the current touch track input is completed, the first drawing content is superimposed on the second layer for refresh display, wherein the image blending mode of the second layer is the first blending mode;
[0013] After the second layer finishes refreshing and displaying the first drawing content, the first layer is removed, so that the second layer after refreshing and displaying the first drawing content is displayed on the display.
[0014] In a second aspect, some embodiments of the present application provide a content display method, applied to a display device, wherein the display of the display device is configured to display a user interface, and the touch component of the display device is configured to detect a touch trajectory input by a user, the content display method comprising:
[0015] receiving the touch track from the touch component, and generating first drawing content based on the touch track;
[0016] If the image blending mode of the first layer is the first blending mode, the first drawing content is superimposed on the first layer for refresh display, wherein the layer below the first layer is the second layer, the first layer also displays the layer content of the second layer, and the layer content of the second layer includes at least background content. The first blending mode is an image blending mode that preserves both the drawing content and the target content when superimposing the currently drawn drawing content on the target content, and the first drawing content is drawing content with transparency.
[0017] If it is detected that the current touch track input is completed, the first drawing content is superimposed on the second layer for refresh display, wherein the image blending mode of the second layer is the first blending mode;
[0018] After the second layer finishes refreshing and displaying the first drawing content, the first layer is removed, so that the second layer after refreshing and displaying the first drawing content is displayed on the display.
[0019] As can be seen from the above technical solutions, the present application provides a display device and content display method. A controller receives a touch track input by a user from a touch component and generates first drawn content based on the touch track. If the image blending mode of the first layer is the first blending mode, which is an image blending mode that preserves both the drawn content and the target content when overlaying the currently drawn content onto the target content, the first drawn content is overlaid onto the first layer for refresh display. The next layer below the first layer is the second layer, and the layer content of the second layer is displayed on the first layer. The layer content of the second layer includes at least background content. The first drawn content is drawn content with transparency. If the current touch track input is detected to be complete, the first drawn content is overlaid onto the second layer for refresh display. After the refresh display of the second layer is complete, the first layer is removed, so that the refreshed second layer is displayed on the display. Removing the first layer after refreshing the first drawn content on the second layer avoids screen flickering. Furthermore, because the layer content of the second layer is displayed on the first layer, even if the first drawn content on the first and second layers coexists, the first layer can obscure the second layer, thereby preventing the transparency of the two first drawn contents from overlapping. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0021] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in an embodiment of the present application;
[0022] Figure 2 A hardware configuration block diagram of the control device 100 provided in an embodiment of the present application;
[0023] Figure 3 A hardware configuration block diagram of a display device 200 provided in an embodiment of the present application;
[0024] Figure 4 A software configuration diagram of the display device 200 provided in an embodiment of the present application;
[0025] Figure 5 A schematic diagram of the display effect of a whiteboard application provided in some embodiments of the present application;
[0026] Figure 6 Schematic diagram of multiple layers in a display device 200 provided in some embodiments of the present application;
[0027] Figure 7 Schematic diagram of display layers in a display device 200 provided in some embodiments of the present application;
[0028] Figure 8 A schematic diagram of an acceleration layer in a display device 200 provided in some embodiments of the present application;
[0029] Figure 9 A schematic diagram illustrating the principle of superposition of an acceleration layer and a display layer in a display device 200 provided in some embodiments of the present application;
[0030] Figure 10 A schematic diagram of the superposition effect of the acceleration layer and the display layer in the display device 200 provided in some embodiments of the present application;
[0031] Figure 11 A schematic diagram illustrating the principle of simultaneously displaying first drawn content on an acceleration layer and a display layer in a display device 200 provided in some embodiments of the present application;
[0032] Figure 12 A schematic diagram of a superimposed effect of simultaneously displaying a first drawn content on an acceleration layer and a display layer in a display device 200 provided in some embodiments of the present application;
[0033] Figure 13 A schematic flow chart of a content display method executed by a display device 200 provided in some embodiments of the present application;
[0034] Figure 14a A schematic diagram of the display relationship between drawn content and target content when the image blending mode provided in some embodiments of the present application is the first blending mode;
[0035] Figure 14b A schematic diagram of the display relationship between drawn content and target content when the image blending mode provided in some embodiments of the present application is the second blending mode;
[0036] Figure 15 A schematic diagram illustrating the principle of superposition of a first layer and a second layer in a display device 200 provided in some embodiments of the present application;
[0037] Figure 16 A schematic diagram of the principle of superimposing a first layer and a second layer in another display device 200 provided in some embodiments of the present application;
[0038] Figure 17 A schematic diagram of the superposition effect of the first layer and the second layer in the display device 200 provided in some embodiments of the present application;
[0039] Figure 18 A schematic diagram of the segmented rendering principle in the display device 200 provided in some embodiments of the present application;
[0040] Figure 19A schematic diagram illustrating eliminating the superposition effect during segmented rendering in the display device 200 provided in some embodiments of the present application;
[0041] Figure 20 A schematic diagram illustrating the effect of a first layer being penetrated when the image blending mode provided in some embodiments of the present application is the second blending mode;
[0042] Figure 21 Schematic diagram of the principle of superposition of the intermediate drawing layer and the background layer in the display device 200 provided in some embodiments of the present application;
[0043] Figure 22 A schematic diagram illustrating the principle of intercepting the intermediate drawing layer during the regional refresh process provided in some embodiments of the present application;
[0044] Figure 23 A schematic diagram illustrating the principle of background layer capture during a region refresh process provided in some embodiments of the present application;
[0045] Figure 24 This is an effect diagram of the superposition of the middle line drawing layer content and the background layer content provided in some embodiments of the present application;
[0046] Figure 25 Schematic diagram of the principle of overlaying the menu layer, the middle drawing layer, and the background layer provided in some embodiments of the present application;
[0047] Figure 26 A schematic diagram illustrating the principle of eliminating the overlapping area between the first drawn content and the menu area provided in some embodiments of the present application;
[0048] Figure 27 A schematic diagram of the effect of eliminating the overlapping area between the first drawn content and the menu area provided in some embodiments of the present application. DETAILED DESCRIPTION
[0049] To make the purpose, technical solutions and advantages of this application more clear, the following will clearly and completely describe the exemplary embodiments of this application in conjunction with the exemplary embodiments of this application and the corresponding drawings. Obviously, the exemplary embodiments described are only part of the embodiments of this application, not all of them.
[0050] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of some embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.
[0051] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.
[0052] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0053] The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a smart TV, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc.
[0054] Figure 1 and Figure 3 This is a specific implementation of the display device of the present application.
[0055] Figure 1 Schematic diagram of the operation scene between the display device and the control device in the exemplary embodiment of this application. Figure 1 As shown in FIG, a user can operate the display device 200 through the mobile terminal 300 and the control device 100 .
[0056] In some embodiments, the control device 100 may be a remote controller. Communication between the remote controller and the display device may include infrared protocol communication, Bluetooth protocol communication, or other short-range communication methods, and the display device 200 may be controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, and the like.
[0057] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) can also be used to control the display device 200. For example, the display device 200 can be controlled using an application running on the smart device.
[0058] In some embodiments, the display device may not use the aforementioned smart device or control device to receive instructions, but may receive user control through touch or gestures.
[0059] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.
[0060] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be connected to a local area network (LAN), a wireless local area network (WLAN), or other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be a single cluster or multiple clusters, and may include one or more types of servers.
[0061] Figure 2 FIG. 1 exemplarily shows a hardware configuration block diagram of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation instructions and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200. Figure 3 The display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a processor 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
[0062] In some embodiments, the processor includes a video processor, an audio processor, a graphics processor, RAM, ROM, and first through nth interfaces for input / output. Display 260 includes a display screen component for displaying images, a driver component for driving the image display, and components for receiving image signals output from the processor to display video content, image content, a menu control interface, and a user control UI interface. Display 260 can be a liquid crystal display, an OLED display, or a projection display, and can also be a projection device and projection screen.
[0063] Communicator 220 is a component used to communicate with external devices or servers using various communication protocols. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, or other network communication protocol chip or a near-field communication protocol chip, as well as an infrared receiver. Display device 200 can use communicator 220 to send and receive control signals and data signals with external control device 100 or server 400.
[0064] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote controller, etc.).
[0065] Detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or detector 230 includes an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or detector 230 includes a sound collector, such as a microphone, for receiving external sounds.
[0066] The external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces.
[0067] The tuner-demodulator 210 receives broadcast television signals via a wired or wireless reception method, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
[0068] In some embodiments, the processor 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box.
[0069] Processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. Processor 250 controls the overall operation of display device 200. For example, in response to receiving a user command to select a UI object to be displayed on display 260, processor 250 may perform operations related to the object selected by the user command.
[0070] In some embodiments, the processor includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (Random Access Memory, RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.
[0071] The user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific voice or gesture, and the user input interface may recognize the voice or gesture through a sensor to receive the user input command.
[0072] A user interface is the medium through which an application or operating system interacts with a user and exchanges information. It converts information between its internal form and a user-friendly format. A common user interface is the graphical user interface (GUI), which refers to a graphical user interface related to computer operations. It can be an icon, window, control, or other interface element displayed on an electronic device's display. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0073] like Figure 4 As shown, the system of the display device is divided into three layers, namely the application layer, the middleware layer and the hardware layer from top to bottom.
[0074] The application layer mainly includes commonly used applications on the TV and the application framework. Among them, commonly used applications are mainly applications developed based on the browser, such as HTML5 APPs; and native applications (Native APPs).
[0075] The Application Framework is a complete programming model that provides all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces for these functions (toolbars, status bars, menus, and dialog boxes).
[0076] Native apps can support online or offline, message push or local resource access.
[0077] The middleware layer includes various TV protocols, multimedia protocols, and system components. Middleware uses the basic services (functions) provided by system software to connect various parts of the application system or different applications on the network, enabling resource and function sharing.
[0078] The hardware layer mainly includes the HAL interface, hardware, and drivers. The HAL interface is a unified interface for all TV chips, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WiFi driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.
[0079] In some embodiments, the display device 200 can support touch interaction functions by adding a touch component. Generally, the touch component and the display 260 can form a touch screen. On the touch screen, users can input different control commands through touch operations. For example, users can input touch commands such as click, slide, long press, double-click, etc. Different touch commands can represent different control functions.
[0080] In order to realize the above-mentioned different touch actions, the touch component can generate different electrical signals when the user inputs different touch actions, and send the generated electrical signals to the controller 250. After receiving the electrical signal, the controller 250 can first judge the duration of the level corresponding to the touch action in the electrical signal. When the duration is less than the preset time threshold, it recognizes that the user input is a click touch instruction. The controller 250 then extracts the position features generated by the electrical signal to determine the touch position. When the touch position is within the display range of the application icon, it is determined that the user has entered a click touch instruction at the application icon position. Accordingly, the click touch instruction is used to execute the function of running the corresponding application in the current scenario, so the controller 250 can start running the corresponding application.
[0081] For another example, when the user inputs a sliding action in the media display page, the touch component will also send the sensed electrical signal to the controller 250. The controller 250 first determines the duration of the signal corresponding to the touch action in the electrical signal. When it is determined that the duration is greater than the preset time threshold, the position change of the signal generation is judged. Obviously, for interactive touch actions, the position where the signal is generated will change, thereby determining that the user has input a sliding touch instruction. The controller 250 then determines the sliding direction of the sliding touch instruction based on the change in the signal generation position, and controls the page turning of the display screen in the media display page to display more media options. Furthermore, the controller 250 can also extract features such as the sliding speed and sliding distance of the sliding touch instruction, and control the page turning screen according to the extracted features to achieve a hand-following effect, etc.
[0082] Similarly, for touch commands such as double-click and long press, the controller 250 can extract different features, determine the type of touch command based on the features, and then execute the corresponding control function according to the preset interaction rules. In some embodiments, the touch component also supports multi-touch, allowing the user to input touch actions on the touch screen using multiple fingers, such as multi-finger click, multi-finger long press, multi-finger slide, etc.
[0083] The aforementioned touch actions can also be combined with specific applications to implement specific functions. For example, when a user opens a "whiteboard" application, the display 260 can present a drawing area, and the user can use sliding touch commands to draw a specific touch action trajectory in the drawing area. The controller 250 then determines the touch action pattern based on the touch action detected by the touch component and controls the display 260 to display it in real time to achieve a satisfactory demonstration effect.
[0084] Figure 5 FIGURE 2 shows an exemplary diagram of the display effect of a whiteboard application according to some embodiments. Figure 5 As shown, the user can install a drawing application such as a whiteboard through the display device 200, and the user selects the whiteboard application in the display device 200, controls the display device 200 to start the whiteboard application, and displays the whiteboard application on the display 260. Figure 5 In the application's touch interface, users can write, draw lines, and perform other operations. The display device can generate touch tracks based on the user's touch actions, enabling the user to perform whiteboard presentations on the display device through the whiteboard application. At the same time, the application's touch interface can be provided with a menu bar such as a toolbar. Taking the toolbar as an example, a variety of tool controls are provided, such as multiple brush controls for providing various styles of handwriting and an eraser control for erasing touch tracks.
[0085] Figure 6 exemplarily shows a schematic diagram of multiple layers in the display device 200 according to some embodiments. In order to achieve a real-time display effect, the display device 200 can display the drawing process by superimposing multiple layers. Generally, the display device 200 can use one layer to display the user's touch track in real time, and another layer to display the whiteboard interface, and the final image presented on the display 260 is a superposition of these two layers. For ease of distinction, such as Figure 6As shown, in the embodiment of the present application, the layer used to display the touch track pattern in real time is called the first layer, the first layer (acceleration layer) is the picture group layer (Group of Pictures, GOP), the layer used to display the whiteboard interface is called the second layer, and the second layer (display layer) is the screen menu adjustment layer (on-screen display, OSD). Among them, the GOP layer is also called the native layer, GOP2 layer or acceleration layer, which can be used to display temporarily drawn content displayed on the upper layer of the menu. The OSD layer is also called the display layer, middle layer or menu layer, and is used to display content such as the application interface, application menu, and toolbar.
[0086] Obviously, to present the final image, the display device 200 can present not only the two layers mentioned above, but also other layers for displaying different image content. For example, the display device 200 can also include a video layer (Video). The video layer is also called the bottom layer and is generally used to display the image content corresponding to the external signal connected to the TV.
[0087] You can set up hierarchical relationships between different layers to achieve specific display effects. For example, the hierarchical relationship between the GOP layer, OSD layer, and Video layer can be: GOP layer - OSD layer - Video layer. That is, the Video layer is displayed at the bottom layer, showing the content of the external signal screen. The OSD layer is displayed above the Video layer, allowing the application menu to float above the external signal screen for display. The GOP layer is displayed above the OSD layer so that it can be highlighted when the user inputs and draws graphics.
[0088] In some embodiments, since the GOP layer is used to display temporarily drawn content, the image displayed in the GOP layer will present different content as the user's drawing action inputs. Therefore, in actual applications, to meet drawing requirements, after a sliding touch action input is completed, the display device 200 can update the drawn pattern to the OSD layer for display, and continue to display other touch track content through the GOP layer. To facilitate understanding of the solution, the following solution description will refer to the OSD layer as the display layer and the GOP layer as the acceleration layer.
[0089] The display layer usually includes the canvas background, the drawn content, the application menu and other contents. In order to facilitate the understanding of the scheme, the embodiment of the present application only displays the canvas background and the drawn content in the display layer. Figure 7The display layer (second layer) shown includes a canvas background (background content) filled with a light gray lower diagonal line and a medium gray curve segment (second drawing content). The medium gray curve segment is the drawn drawing content, and the medium gray curve segment can be a transparent curve segment or a non-transparent curve segment. The acceleration layer background is transparent (no background) and includes the drawing content being drawn. For example, Figure 8 The acceleration layer shown includes a dark gray curve segment being drawn (first drawing content), wherein the dark gray curve segment is also a curve segment with transparency.
[0090] In actual application, the second drawing content drawn on the acceleration layer is submitted to the display layer for display, and then the acceleration layer is canceled. The final display effect is as follows Figure 9 and Figure 10 As shown, Figure 9 This is a schematic diagram of the acceleration layer and display layer superposition process. Figure 10 This is the final display effect after the acceleration layer and the display layer are superimposed. While the user is drawing a second drawing, if the second drawing is completed on the display layer and the acceleration layer is removed simultaneously, the user will perceive a normal drawing effect. However, the timing of the second drawing on the display layer is difficult to determine.
[0091] If the acceleration layer is canceled before the first drawing content is displayed on the display layer, the first drawing content will not be displayed on the screen between the cancellation of the acceleration layer and the completion of the display of the second drawing content on the display layer. The first drawing content will be displayed on the screen only after the first drawing content is displayed on the display layer. This situation will give the user a flashing screen effect. For example, Figure 9 In the case of a glitch, if the acceleration layer is revoked before the first drawing content on the acceleration layer is submitted to the display layer for display, the display layer without the first drawing content will be presented to the user. After the first drawing content is drawn on the display layer, the display layer with the first drawing content is presented to the user. Only then can the first drawing content be displayed on the screen.
[0092] If the acceleration layer is canceled after the first drawing content is displayed on the display layer, the first drawing content will be displayed on both the acceleration layer and the display layer. Since the first drawing content is transparent, the effect presented to the user is the superposition of the transparency of the two first drawing contents. For example, Figure 11 In the example above, before the acceleration layer is canceled, the first drawing content has been displayed on the display layer. At this time, the acceleration layer and the display layer coexist, so the final effect presented to the user is Figure 12 The transparency overlay effect of the two first drawing contents is shown (after the two transparent drawing contents are overlaid, the color of the drawing contents will be darker).
[0093] In view of the above problems, some embodiments of the present application provide a content display method applied to a display device 200. To facilitate understanding of the technical solutions in some embodiments of the present application, each step is described in detail below with reference to some specific embodiments and drawings. Figure 13 Schematic diagram of the flow of the content display method performed by the display device 200 provided in some embodiments of the present application. Figure 13 As shown, the controller 250 in some embodiments of the present application is configured to perform the following steps:
[0094] Step S601: receiving the touch track from the touch component, and generating first drawing content based on the touch track.
[0095] The display device 200 may be installed with the whiteboard application. When the display device 200 receives a start instruction input by the user by clicking on the application icon of the whiteboard application, the display device 200 starts the whiteboard application in response to the start instruction. Figure 5 The whiteboard application interface shown.
[0096] In some embodiments, the user can also start the whiteboard application by voice control of the display device 200. For example, after receiving the wake-up word "whiteboard" input by the user, the display device 200 generates a startup instruction to start the whiteboard application. In response to the startup instruction, the whiteboard application is started, and the display may display the following: Figure 5 The whiteboard application interface shown.
[0097] in Figure 5 After using the whiteboard application interface shown, users can Figure 5 In the whiteboard application interface shown, a touch track is input. In this embodiment of the present application, the touch component detects the touch track input by the user, and then the touch component sends the touch track input by the user to the controller. After receiving the touch track from the touch component, the controller generates the first drawing content based on the touch track.
[0098] Step S602: If the image blending mode of the first layer is the first blending mode, the first drawing content is superimposed on the first layer for refresh display, wherein the layer below the first layer is the second layer, the first layer also displays the layer content of the second layer, and the layer content of the second layer includes at least background content. The first blending mode is an image blending mode that retains both the drawing content and the target content when superimposing the currently drawn drawing content on the target content, and the first drawing content is a drawing content with transparency.
[0099] Android's image blending modes include CLEAR (clear image), DARKEN (darken, darker color covers lighter color, if the two are the same depth, they are blended), DST (only the target image is displayed), SRC (only the source image is displayed). The first blending mode of the embodiment of the present application is to preserve the image blending mode of the target content and the current drawing content when it is superimposed on the target content. For example, Figure 14a and Figure 14b The square in the image is the currently drawn content, and the circle is the target content. The drawn content is superimposed on the target content. If the image blending mode is DARKEN, that is, the first blending mode, both the drawn content and the target content are retained, and the image is displayed as follows: Figure 14a If the image blending mode is SRC, that is, the second blending mode, only the drawn content is retained and the target content is eliminated, resulting in the following Figure 14b It should be noted that Figure 14b The circle that is the target content is completely eliminated just to present the effect of eliminating the target content. In fact, the second blending mode only eliminates the area where the target content overlaps with the drawn content.
[0100] visible, Figure 13 The illustrated method is performed under the condition that the image blending mode of the first layer is the first blending mode. After the controller generates the first drawing content based on the touch trajectory, it overlays the first drawing content onto the first layer in real time for refresh display. Because the first layer is at a higher level than the second layer, this ensures that the display device 200 can respond to the user's touch trajectory in real time. Once the first drawing content is overlaid onto the first layer for refresh display, the first drawing content is displayed on the first layer. In other words, the first drawing content is the drawing content generated based on the touch trajectory and presented on the first layer. The first layer is the layer that displays the currently drawn content.
[0101] In an embodiment of the present application, the next layer below the first layer is the second layer, that is, the first layer is higher than the second layer, and the layer content of the first layer is displayed on the display first. In addition to displaying the drawing content being drawn (the first drawing content), the first layer also displays the original layer content of the second layer. The original layer content of the second layer includes at least background content. In an embodiment of the present application, the original layer content of the second layer may also include the second drawing content, and the second drawing content is the already drawn drawing content. This application does not limit whether the second layer has only background content or includes both background content and already drawn drawing content. The following schemes are all explained with the example that the original layer content of the second layer also includes the second drawing content.
[0102] For example, Figure 15In the multi-layer schematic diagram shown, the first layer is the acceleration layer, the second layer is the display layer, and the second layer includes a canvas background filled with a light gray lower diagonal line (background content) and a medium gray curve segment (second drawing content). The second drawing content is the drawing content that has been drawn. The first layer includes the original layer content of the first layer: background content and second drawing content. It should be noted that the background content of the first layer and the background content of the second layer are the same, that is, the content already presented on the second layer (background content and second drawing content) are completely copied to the first layer. At the same time, the first drawing content being drawn is also displayed on the first layer. The first drawing content is a drawing content with transparency, and the second drawing content can be a drawing content with transparency or a drawing content without transparency. If the second drawing content is also a drawing content with transparency, it can be presented on the first layer as follows Figure 15 Transparency overlay effect shown.
[0103] Step S603: If it is detected that the current touch track input is completed, the first drawing content is superimposed on the second layer for refresh display, wherein the image blending mode of the second layer is the first blending mode.
[0104] In an embodiment of the present application, it may be that the user's finger lifting action is detected, that is, it is determined that the current touch track input is completed. The touch component sends the sensed electrical signal to the controller 250, and the controller 250 determines that the user has input a touch screen pressing action based on the received electrical signal. In actual applications, a value threshold (such as a voltage threshold) of the electrical signal is set to determine that the user has input a touch screen pressing action. Only when an electrical signal exceeding the voltage threshold is received, it is determined that the user has input a touch screen pressing action. Therefore, in the process of the user inputting the touch track, the controller continues to receive electrical signals whose voltage values sent by the touch component exceed the voltage threshold. If the voltage value of the electrical signal sent by the touch component to the controller 250 is less than the voltage threshold, it is determined that the user's finger lifting action is detected, that is, it is determined that the current touch track input is completed.
[0105] When the current touch track input is detected, the first drawing content of the current first layer is refreshed to the second layer. The first layer can be controlled to submit the first drawing content to the second layer, and the second layer will refresh the display after the data is prepared.
[0106] For example, Figure 16 In the multi-layer diagram shown, after refreshing the first drawing content of the first layer to the second layer, the second layer not only includes the background content and the second drawing content, but also displays the first drawing content. The effect presented to the user at this time is Figure 17 The effect shown in Figure 17In the example, the background content of the first layer obscures the first drawing content on the second layer, so there is no effect of the transparency of the two first drawing contents overlapping.
[0107] Step S604 : After the second layer is refreshed and displayed according to the first drawing content, the first layer is removed, so that the second layer refreshed according to the first drawing content is displayed on the display.
[0108] After the second layer is refreshed and displayed according to the first drawing content, a completion signal can be generated. After receiving the completion signal, the controller removes the first layer, so that the second layer refreshed according to the first drawing content can be displayed on the display, and the first layer is no longer displayed.
[0109] For example, in Figure 16 In the process, after refreshing the first drawing content on the second layer, the first layer is removed, and finally only the content is displayed on the display. Figure 16 The second layer in .
[0110] As can be seen from the above technical solutions, the present application provides a display device and a content display method, in which the controller receives a touch track input by the user from the touch component, and generates a first drawing content based on the touch track. If the image blending mode of the first layer is the first blending mode, the first blending mode is an image blending mode that retains the drawing content and the target content while superimposing the currently drawn drawing content on the target content, the first drawing content is superimposed on the first layer for refresh display. The first layer is a layer for displaying the current drawing content, the next layer of the first layer is the second layer, and the layer content of the second layer is displayed on the first layer, and the layer content of the second layer includes at least background content. The first drawing content is a drawing content with transparency. If it is detected that the current touch track input is completed, the first drawing content is superimposed on the second layer for refresh display. After the refresh display of the second layer is completed, the first layer is removed so that the refreshed second layer is displayed on the display.
[0111] In this way, refreshing and displaying the first drawing content on the second layer and then removing the first layer can avoid screen flickering. Moreover, since the layer content of the second layer is displayed on the first layer, even if the first drawing content on the first and second layers coexists, the first layer can cover the second layer, thereby avoiding the transparency overlap of the two first drawing contents.
[0112] Since the first layer is removed after the second layer is refreshed to display the first drawing content, it will not appear Figure 15Before the second layer displays the first drawing content, the first layer is removed, and then the first drawing content is displayed on the second layer, thereby avoiding screen flickering. In addition, the first layer is removed after the second layer refreshes and displays the first drawing content, so the first layer and the second layer coexist, resulting in two first drawing contents being displayed on the display. If the first layer has a transparent background, it will be displayed as follows Figure 12 The transparency overlay effect of the two first drawn contents is shown. In this embodiment of the application, because the first layer includes background content, even if the second layer already displays the first drawn content, the background content of the first layer will completely obscure the second layer. Furthermore, the background content of the first layer is the background content of the second layer. The first layer also includes the already drawn second drawn content and the first drawn content being drawn. This not only solves the problem of transparency overlay between the two first drawn contents, but also makes the entire process seamless for the user.
[0113] It should be noted that the image blending mode of the first layer is the first blending mode, and the image blending mode of the second layer is also the first blending mode. When the first drawing content is superimposed on the second layer, the image blending is also performed in the form of retaining the drawing content and the target content. In this way, the display effect of superimposing the first drawing content on the first layer and the display effect of superimposing the first drawing content on the second layer are exactly the same, which can further ensure that the user experience of the entire layer switching process is seamless.
[0114] In order to improve the rendering speed of the drawing content, a line drawing is usually rendered in segments during the line drawing process. The first drawing content includes at least two segmented drawing contents, and two adjacent segmented lines are connected by overlapping their endpoints to form an overlapping area. Since the first drawing content and the second drawing content are both transparent, the overlapping area between the segmented lines will have a transparency overlay effect. Figure 18 The first drawing content shown includes two segmented lines: P1P2 and P2P3. P1P2 and P2P3 overlap at point P2 to form an overlay area. Because P1P2 and P2P3 are transparent, a transparency overlay effect is created in the overlay area, which affects the user's drawing experience.
[0115] In order to solve the above transparency overlay problem, in some embodiments, the image blending mode of the first layer can adopt the second blending mode. If the image blending mode of the first layer adopts the second blending mode, the first drawing content needs to be pre-processed before being superimposed on the first layer for refresh display. The specific pre-processing operation is to eliminate the endpoint of any segmented drawing line in the overlay area. In this way, the overlay area originally has two segmented drawing line endpoints. After pre-processing, the overlay area only retains one segmented drawing line endpoint, so as to eliminate the transparency overlay effect formed by the overlay area. For example, Figure 17 The first drawing content shown includes two segmented lines: P1P2 and P2P3. P1P2 and P2P3 are connected at point P2 to form an overlay area. The overlay area includes two P2 endpoints, thus forming a transparency overlay effect. You can eliminate any of the P2 endpoints to get Figure 19 The embodiment of the present application can perform the above preprocessing on each superposition area, and then superimpose the preprocessed first drawing content on the first layer for refresh display, thereby obtaining the first layer displaying the first drawing content.
[0116] The above pre-processing is actually the SRC (only source image display) mode or DST (only target image display) mode in the image mixing mode. Figure 19 As shown in the figure, P1P2 is the first segmented line, and P2P3 is the second segmented line. The first segmented line is drawn earlier than the second segmented line. If the image blending mode is SRC, this is equivalent to eliminating point P2 in P1P2 and retaining only point P2 in P2P3 (that is, eliminating the endpoint of the segmented line drawn first, while retaining the endpoint of the segmented line drawn later). If the image blending mode is DST, this is equivalent to eliminating point P2 in P2P3 and retaining only point P2 in P1P2 (that is, retaining the endpoint of the segmented line drawn first, while eliminating the endpoint of the segmented line drawn later).
[0117] exist Figure 13 In the method shown, when the first drawing content is superimposed on the first layer for display, if the image blending mode of the first layer is the second blending mode (SRC mode), when the first drawing content is refreshed and displayed on the first layer, the second drawing content and the background content in the display area of the first drawing content will be eliminated. In this case, the first layer is equivalent to being penetrated by the first drawing content, and the effect of the first layer being penetrated is as follows: Figure 20 As shown (in order to show the effect of the first layer being penetrated, Figure 20 The background content is darkened and Figure 20 The first drawing content is removed in , so Figure 20 The first drawing content is not presented in the actual drawing. Figure 20The first drawing content is presented in the image, but the area of the first drawing content is equivalent to a transparent background).
[0118] Then Figure 20 The first layer shown as being penetrated covers the second layer. At this time, the first drawing content on the second layer has been refreshed and displayed (the first drawing content on the first layer and the first drawing content on the second layer coexist). Since the first layer has been penetrated, the first layer cannot cover the first drawing content that has been refreshed and displayed on the second layer. Figure 12 The effect of the transparency superposition of the two first drawn contents is shown.
[0119] In order to solve the problem that the first layer is penetrated and cannot block the second layer, in some embodiments, such as Figure 21 In the multi-layer diagram shown, the first layer can be split into a background layer and an intermediate line drawing layer. The background layer displays the content of the second layer (which may include the already drawn second drawing content and the background content), while the intermediate line drawing layer refreshes and displays the drawing content being drawn. The background of the intermediate line drawing layer is transparent, and the layer below the intermediate line drawing layer is the background layer, that is, the intermediate line drawing layer has a higher level than the background layer. Therefore, the pre-processed first drawing content is superimposed on the first layer for refresh display, specifically including:
[0120] First, the pre-processed first drawing content is overlaid onto the intermediate line layer for refresh display. The pre-processing operation specifically removes the endpoints of the first segmented line in the segmented line overlay area. This means that while the overlay area originally had two segmented line endpoints, after pre-processing, the overlay area only has the endpoints of the second segmented line, eliminating the transparency overlay effect created by the overlay area. In other words, the image blending mode used during the drawing process of the intermediate line layer is SRC (source image only). This prevents the transparency overlay effect created between adjacent segmented lines in the overlay area during the segmented line drawing process.
[0121] Then, the intermediate line layer and the background layer of the first drawing content after refreshing and displaying the preprocessing are superimposed, and the first layer displaying the first drawing content is obtained. In the embodiment of the present application, the background layer displays the background content of the second layer and the second drawing content (the drawing content that has been drawn). It should be noted that the image blending mode when the intermediate line layer and the background layer are superimposed is the DARKEN image blending mode (the first blending mode), that is, simple superposition without eliminating the drawing content. Therefore, when the first drawing content and the layer content of the background layer are superimposed, the background content of the background layer and the second drawing content will not be eliminated, so there will be no Figure 20 The first layer is shown being penetrated.
[0122] In this way, it is equivalent to using the second blending mode (eliminating the target content and retaining the drawing content) for the first drawing content when drawing content, thereby avoiding the formation of a transparent overlay effect in the overlay area between two adjacent segments, and using the first blending mode (retaining both the drawing content and the target content) when overlaying the first drawing content on the first layer, thereby avoiding the background content of the first layer being penetrated by the first drawing content. Therefore, the above improved solution can achieve both the avoidance of the transparent overlay effect in the overlay area between two adjacent segmented lines and the avoidance of the background of the first layer being penetrated. The final first layer is still Figure 15 The layer shown has both the background content and the second drawing content intact. Because the first layer includes the complete background content and the second drawing content, even if the second layer already displays the first drawing content, the background content of the first layer will completely obscure the second layer. Furthermore, the background content of the first layer serves as the background content of the second layer. The first layer also includes the already drawn second drawing content and the first drawing content being drawn. This not only solves the problem of overlapping transparency between the two first drawing contents, but also makes the entire process seamless for the user. Furthermore, if the first drawing content is drawn in segments, there will be no overlapping transparency between the segments.
[0123] Based on the above embodiment, in order to improve the speed of refreshing and displaying the drawn content, regional superposition and regional refresh can be performed, that is, when refreshing a layer, the entire layer is not refreshed, but only the partial area of the content currently being drawn is refreshed. Specifically, at least two interception areas are generated based on at least two segmented lines, and then the background layer is intercepted according to the at least two interception areas to obtain the background layer content. At the same time, the intermediate line layer is intercepted according to the at least two interception areas to obtain the intermediate line layer content. The background layer content and the intermediate line layer content are then superimposed on the first layer for refresh display, thereby obtaining the first layer displaying the first drawn content. The coordinates of the two endpoints of the segmented line can be obtained, and then a interception rectangle is drawn according to the coordinates of the two endpoints of the segmented line, and the two endpoints of the segmented line fall on the interception rectangle. Finally, the interception rectangle is determined as the interception area.
[0124] For example, Figure 22The middle line layer shown includes the first drawing content being drawn. The first drawing content includes two segmented lines: P1P2 and P2P3. A cut-off rectangle Rect1 can be determined based on the coordinates of points P1 and P2 of segmented line P1P2. Points P1 and P2 can fall within cut-off rectangle Rect1, and the area of cut-off rectangle Rect1 is minimized when the range of cut-off rectangle Rect1 includes the entire segmented line P1P2. Similarly, a cut-off rectangle Rect2 is determined based on the coordinates of points P2 and P3 of segmented line P2P3. Points P2 and P3 can fall within cut-off rectangle Rect2, and the area of cut-off rectangle Rect2 is minimized when the range of cut-off rectangle Rect2 includes the entire segmented line P2P3.
[0125] Then use the interception rectangle Rect1 and the interception rectangle Rect2 to intercept the middle line layer, and get the following Figure 22 The middle line layer content is shown in the figure. And the background layer is intercepted by using the interception rectangle Rect1 and the interception rectangle Rect2 to obtain the following Figure 23 Then, after the background layer content and the middle line layer content are superimposed (first blending mode superposition), the following is obtained: Figure 24 The superimposed content shown (including the first drawing content, part of the background content and part of the second drawing content) is refreshed and displayed on the first layer, and the same result can be obtained. Figure 16 The display effect of the first layer shown in FIG. 1 can also be improved, and the refresh display speed of the first drawing content on the first layer and the second layer can be improved.
[0126] like Figure 5 In the whiteboard application interface diagram shown, the whiteboard application includes not only a drawing interface but also a menu area. The menu area includes at least one menu bar. To prevent users from drawing their first drawing content in the menu area, based on the above embodiment, in some embodiments, a further menu layer can be provided. The menu layer is used to display the menu area, and the layer below the menu layer is the intermediate drawing layer. In other words, the menu layer is at a higher level than the intermediate drawing layer. Alternatively, the menu area can be drawn directly on the background layer.
[0127] For example, Figure 25 In the multi-layer diagram shown, the first layer includes a menu layer, a middle drawing layer, and a background layer. The menu layer includes the menu area, and the menu layer background is transparent. Therefore, the menu layer background does not obscure the middle drawing layer, but the menu area does obscure the middle drawing layer. The menu area is displayed on the first layer, and users can draw around it, preventing their drawing from extending into the menu area.
[0128] Based on the above embodiment, if the first drawn content and the menu area do not overlap, that is, the user did not extend the drawn content into the menu area, the first drawn content can be directly overlaid onto the first image for refresh display. If the first drawn content and the menu area overlap, that is, the user still extended the drawn content into the menu area, the menu bitmap corresponding to the menu area can be obtained, and the first drawn content can be pre-processed based on the menu bitmap. The pre-processing process includes: eliminating the first drawn content that overlaps with the menu bitmap, and then overlaying the pre-processed first drawn content onto the first layer for refresh display.
[0129] For example, Figure 26 In the multi-layer diagram shown in FIG. 1 , if the first drawing content overlaps with the menu area, the overlapping area between the first drawing content and the menu area is eliminated, and the non-overlapping area with the menu area is retained. Figure 27 The effect shown (the first drawn content is cut into two segments).
[0130] In some embodiments, the specific process of obtaining the menu bitmap corresponding to the menu area may be: creating a first blank bitmap, and obtaining the view of the menu area. Mapping the view of the menu area to the first blank bitmap, obtaining the menu bitmap corresponding to the menu area. Wherein, if in response to the received instruction to update the menu area, a second blank bitmap is created, and the view of the updated menu area is obtained; then the updated view of the menu area is mapped to the second blank bitmap, and the menu bitmap corresponding to the updated menu area is obtained. In this way, if the menu view changes, the menu area on the first layer can also be updated in real time, thereby preventing the user from extending the first drawn content to the menu area.
[0131] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be repeated here.
[0132] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus a necessary general-purpose hardware platform. Based on this understanding, the technical solutions in the embodiments of the present invention, or the portion that contributes to the prior art, can be embodied in the form of a software product. The software product can be stored in a storage medium such as ROM / RAM, a magnetic disk, or an optical disk, and includes instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various embodiments of the present invention or certain portions of the embodiments.
[0133] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.
[0134] For ease of explanation, the above description has been made with reference to specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations are possible. The above embodiments are selected and described to better explain the principles and practical applications, so that those skilled in the art can better utilize the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. A display device, characterized in that: include: a display configured to display a user interface; A touch component configured to detect a touch track of a user input; The controller is configured as: receiving the touch track from the touch component, and generating first drawing content based on the touch track; If the image blending mode of the first layer is the first blending mode, the first drawing content is superimposed on the first layer for refresh display, wherein the layer below the first layer is the second layer, the first layer also displays the layer content of the second layer, and the layer content of the second layer includes at least background content. The first blending mode is an image blending mode that preserves both the drawing content and the target content when superimposing the currently drawn drawing content on the target content, and the first drawing content is drawing content with transparency. If it is detected that the current touch track input is completed, the first drawing content is superimposed on the second layer for refresh display, wherein the image blending mode of the second layer is the first blending mode; After the second layer finishes refreshing and displaying the first drawing content, the first layer is removed, so that the second layer after refreshing and displaying the first drawing content is displayed on the display.
2. The display device according to claim 1, wherein The first drawing content includes at least two segmented drawing lines, and two adjacent segmented drawing lines are connected by overlapping endpoints to form an overlay area. If the image blending mode of the first layer is a second blending mode, and the second blending mode is an image blending mode that eliminates the target content when the currently drawn drawing content is overlaid on the target content, the controller executes the overlay of the first drawing content on the first layer for refresh display, and is configured to: Preprocessing the first drawing content to eliminate endpoints of a first segmented drawing line in the overlay area and retain endpoints of a second segmented drawing line in the overlay area, wherein a drawing time of the first segmented drawing line is earlier than a drawing time of the second segmented drawing line; The pre-processed first drawing content is superimposed on the first layer for refresh display.
3. The display device according to claim 2, wherein The first layer includes a background layer and an intermediate line drawing layer, the layer content of the second layer is displayed on the background layer, the background of the intermediate line drawing layer is a transparent background, and the layer below the intermediate line drawing layer is the background layer. The controller executes superimposing the pre-processed first drawing content on the first layer for refresh display, and is configured to: Overlaying the pre-processed first drawing content on the intermediate line drawing layer for refreshing and displaying; The intermediate line drawing layer after refreshing and displaying the first drawing content and the background layer are superimposed in the first blending mode to obtain the first layer displaying the first drawing content.
4. The display device according to claim 3, wherein The controller executes superposition of the intermediate line drawing layer and the background layer after refreshing and displaying the first drawing content in the first blending mode to obtain the first layer displaying the first drawing content, and is configured to: generating at least two interception regions based on at least two of the segmented drawn lines; intercepting the background layer according to at least two of the intercepted areas to obtain background layer content; intercepting the intermediate line drawing layer according to at least two of the intercepted areas to obtain the content of the intermediate line drawing layer; The background layer content and the intermediate line drawing layer content are superimposed on the first layer in the first blending mode for refresh display, thereby obtaining the first layer displaying the first drawing content.
5. The display device according to claim 4, wherein: The controller generates at least two interception areas based on at least two segmented drawing lines, and is configured to: Obtaining the coordinates of the two endpoints of the segmented line; Draw a intercepting rectangle according to the coordinates of the two endpoints of the segmented drawing line, wherein the two endpoints of the segmented drawing line fall on the intercepting rectangle; The clipping rectangle is determined as the clipping area.
6. The display device according to claim 3, wherein The first layer further includes a menu layer, and the menu layer is used to display a menu area, which is an area including a menu bar. The next layer below the menu layer is the middle line drawing layer.
7. The display device according to claim 1, wherein The controller executes superimposing the first drawing content on the first layer for refreshing display, and is configured to: If there is no overlapping area between the first drawing content and the menu area, superimposing the first drawing content on the first layer for refresh display, wherein the menu area is an area including a menu bar; If the first drawing content and the menu area have an overlapping area, a menu bitmap corresponding to the menu area is obtained, and the first drawing content is preprocessed according to the menu bitmap to eliminate the first drawing content overlapping with the menu bitmap, and the preprocessed first drawing content is superimposed on the first layer for refresh display.
8. The display device according to claim 7, wherein: The controller executes acquiring a menu bitmap corresponding to the menu area, and is configured to: Create a first blank bitmap and obtain the view of the menu area; The view of the menu area is mapped to the first blank bitmap to obtain a menu bitmap corresponding to the menu area.
9. The display device according to claim 8, wherein The controller is further configured to: In response to the received instruction to update the menu area, creating a second blank bitmap, and acquiring a view of the updated menu area; The updated view of the menu area is mapped to the second blank bitmap to obtain a menu bitmap corresponding to the updated menu area.
10. A content display method, characterized in that: Applied to a display device, wherein the display of the display device is configured to display a user interface, and the touch component of the display device is configured to detect a touch track input by a user, the content display method includes: receiving the touch track from the touch component, and generating first drawing content based on the touch track; If the image blending mode of the first layer is the first blending mode, the first drawing content is superimposed on the first layer for refresh display, wherein the layer below the first layer is the second layer, the first layer also displays the layer content of the second layer, and the layer content of the second layer includes at least background content. The first blending mode is an image blending mode that preserves both the drawing content and the target content when superimposing the currently drawn drawing content on the target content, and the first drawing content is drawing content with transparency. If it is detected that the current touch track input is completed, the first drawing content is superimposed on the second layer for refresh display, wherein the image blending mode of the second layer is the first blending mode; After the second layer finishes refreshing and displaying the first drawing content, the first layer is removed, so that the second layer after refreshing and displaying the first drawing content is displayed on the display.