A display device and a display method for an acceleration layer

Abstract

This application provides a display device and a display method for an acceleration layer. The method responds to a user's input of a target touch trajectory based on a first application, refreshing the target touch trajectory to the acceleration layer and a first application layer for displaying the first application, and detecting touch units in the acceleration layer. The touch unit is the display unit acted upon by the target touch trajectory. The method reads the application display range identifier of the touch unit. When the application display range identifier of the touch unit is not a first identifier, it detects a second application associated with the touch unit. The method adjusts the transparency of the second application layer and sets the display level of the second application layer to be higher than that of the acceleration layer. By adjusting the transparency and display level of the application layer, this method allows the touch trajectory acting on the overlapping portion to be displayed in the user interface through the upper application layer, ensuring that the touch display effects between multiple applications do not affect each other, thereby improving the touch display effects between multiple applications.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a display method for an acceleration layer. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, communication terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0003] For touch-enabled display devices, users can use built-in writing applications to write and erase touch traces. The display device converts touch data into corresponding bitmap data through the application layer of the writing application and displays it on the screen. However, since the application layer takes time to process touch data, users cannot immediately feel the touch feedback while writing. Therefore, display devices also have a physical acceleration layer, which is higher than the application layer. The display device can then display the touch process in real time through the physical acceleration layer, and finally display the final touch effect through the application layer.

[0004] However, when multiple application windows are displayed simultaneously, since multiple applications share the same acceleration layer, when there is an overlap between the application windows of multiple applications, the touch trajectory input to the lower application of the overlapping part will be displayed in the upper application window through the acceleration layer, interfering with the display content of the upper application and resulting in poor touch display effect between multiple applications. Summary of the Invention

[0005] This application provides a display device and a display method for an acceleration layer to solve the problem of mutual interference between touch display processes of multiple applications.

[0006] In a first aspect, some embodiments of this application provide a display device, including a display and a controller. The display is configured to display a drawing interface, which includes a first application window and a second application window. The first application window is a window displayed based on a first application, and the second application window is a window displayed based on a second application. The first application window and the second application window are displayed through different application layers. The display is connected to a touch interaction module, which is used to detect touch trajectories input by a user. When displaying the drawing interface, the display also displays the touch trajectory through an acceleration layer. The initial display level of the acceleration layer is higher than the display level of the application layer, and the display unit of the acceleration layer is provided with an application display range identifier. The controller is configured to execute the following program steps:

[0007] In response to a target touch trajectory input by a user based on a first application, the target touch trajectory is refreshed to the acceleration layer and the first application layer, and the touch unit in the acceleration layer is detected; the first application layer is an application layer for displaying the first application, and the touch unit is a display unit acted upon by the target touch trajectory;

[0008] Read the application display range identifier of the touch unit;

[0009] When the application display range identifier of the touch unit is not the first identifier, the second application associated with the touch unit is detected, and the first identifier is the application display range identifier of the first application;

[0010] Adjust the transparency of the second application layer and set the display level of the second application layer to be higher than the display level of the acceleration layer. The second application layer is an application layer used to display the second application.

[0011] Secondly, some embodiments of this application also provide a method for displaying an acceleration layer, the method being applied to the display device provided in the first aspect, the method comprising:

[0012] In response to a target touch trajectory input by a user based on a first application, the target touch trajectory is refreshed to the acceleration layer and the first application layer, and the touch unit in the acceleration layer is detected; the first application layer is an application layer for displaying the first application, and the touch unit is a display unit acted upon by the target touch trajectory;

[0013] Read the application display range identifier of the touch unit;

[0014] When the application display range identifier of the touch unit is not the first identifier, the second application associated with the touch unit is detected, and the first identifier is the application display range identifier of the first application;

[0015] Adjust the transparency of the second application layer and set the display level of the second application layer to be higher than the display level of the acceleration layer. The second application layer is an application layer used to display the second application.

[0016] As can be seen from the above technical solutions, the display device and display method of the acceleration layer provided in some embodiments of this application can, in response to a user's target touch trajectory input based on a first application, refresh the target touch trajectory to the acceleration layer and a first application layer for displaying the first application, and detect touch units in the acceleration layer. Here, the touch unit is the display unit acted upon by the target touch trajectory. The application display range identifier of the touch unit is read. When the application display range identifier of the touch unit is not a first identifier, a second application associated with the touch unit is detected. The transparency of the second application layer is adjusted, and the display level of the second application layer is set to be higher than the display level of the acceleration layer. Here, the second application layer is the application layer used to display the second application. By adjusting the transparency and display level of the application layer, the method can display the touch trajectory acting on the overlapping part in the user interface through the upper application layer, so that the touch display effect between multiple applications does not affect each other, thereby improving the touch display effect between multiple applications. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0019] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0020] Figure 3 This is a schematic diagram of the hardware configuration of the control device provided in some embodiments of this application;

[0021] Figure 4 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0022] Figure 5 Display system structure diagrams provided for some embodiments of this application;

[0023] Figure 6 An example diagram of the display hierarchy provided for some embodiments of this application;

[0024] Figure 7 An architecture diagram of a display device performing an accelerated layer display method according to some embodiments of this application;

[0025] Figure 8 A flowchart illustrating the generation of dynamic events for a window provided in some embodiments of this application;

[0026] Figure 9 This application provides schematic diagrams illustrating the effect of updating the display range identifier in some embodiments.

[0027] Figure 10 This is a schematic diagram illustrating the effect of updating the display range identifier in another application provided by some embodiments of this application;

[0028] Figure 11 This is a schematic diagram illustrating the effect of updating the display range identifier in another application provided by some embodiments of this application;

[0029] Figure 12 This is a schematic diagram illustrating the effect of updating the display range identifier in another application provided by some embodiments of this application;

[0030] Figure 13 A schematic diagram illustrating the display effect of touch trajectory provided in some embodiments of this application;

[0031] Figure 14 A flowchart illustrating a method for displaying an acceleration layer according to some embodiments of this application;

[0032] Figure 15 A schematic diagram illustrating the effect of touch trajectory on touch unit provided in some embodiments of this application;

[0033] Figure 16 Example diagrams illustrating the touch trajectory interference display effect provided in some embodiments of this application;

[0034] Figure 17 This is a schematic diagram illustrating the display effect of touch trajectory when multiple applications are displayed in overlapping manner, as provided in some embodiments of this application.

[0035] Figure 18 This application provides schematic diagrams illustrating the effects of the input touch trajectory process in some embodiments.

[0036] Figure 19 A schematic diagram illustrating the process of adjusting the transparency of the second application layer provided in some embodiments of this application;

[0037] Figure 20 This is a schematic diagram illustrating the effect of an erasure event provided in some embodiments of this application;

[0038] Figure 21 This is a schematic diagram illustrating the display effect of touch trajectory when application windows overlap, as provided in some embodiments of this application.

[0039] Figure 22 A schematic diagram illustrating the display effect of touch trajectory when application windows are displayed side-by-side according to some embodiments of this application;

[0040] Figure 23 This is a schematic diagram illustrating the display effect of the erase event when application windows overlap, as provided in some embodiments of this application. Detailed Implementation

[0041] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0042] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0043] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0044] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0045] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0046] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0047] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 using their finger, mobile terminal 300, and control device 100. The control device 100 can be a remote control, stylus, etc. In some embodiments, the mobile terminal 300 can have software applications installed on it and connect to the display device 200 via a network communication protocol to achieve one-to-one control operation and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0048] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. In addition to providing broadcast television reception functionality, the display device 200 can also be equipped with intelligent network television functionality that provides computer support, including but not limited to internet television, smart television, and Internet Protocol television (IPTV).

[0049] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0050] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a communication device interface 280.

[0051] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0052] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving image display, a component for receiving image signals output from a controller, and a user control UI interface, etc.

[0053] In some embodiments, the communicator 220 is a component for communicating with external devices or the server 400 according to various communication protocol types.

[0054] In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0055] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0056] In some embodiments, the display device 200 includes a touch interaction module. This touch interaction module can be a built-in module or an external module. For example, the touch interaction module can be a touch display, which can receive touch traces input from fingers, touchpads, styluses, etc., to achieve touch operation functions.

[0057] In some embodiments, the touch interaction module detects the touch trajectory input by the user. Based on the interaction principle of the touch interaction module, it can detect relevant parameters of the touch trajectory. For example, when a user's finger touches any position on the touch display, the capacitance of the touch display at the touch position will change. At this time, the touch interaction module can record the position of the capacitance change and combine it with the timer in the controller to record the time of the capacitance change, thereby generating the touch trajectory.

[0058] The touch trajectory can include different operation parameters depending on the user's input method. For example, the touch trajectory can include the touch time, touch position, touch event type, and number of touch points. During a single touch interaction, the touch interaction module can detect touch event types including: touch down events, touch move events, and touch up events. Each touch event records its corresponding touch time and touch position.

[0059] In some embodiments, the device interface 240 can be an HDMI interface and a USB interface. The HDMI interface can connect to devices with video and audio input / output capabilities, and implement the corresponding audio and video output / input functions through the HDMI driver. The USB interface can connect to devices with signal and data transmission capabilities and interactive functions, and, based on the USB driver, access signals, transmit data, and perform specific interactive actions.

[0060] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0061] In some embodiments, the communication device interface 280 is an interface that can be used to receive control input.

[0062] Figure 3 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of the central control device. (Example) Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0063] The control device 100 is configured to control the display device 200, and to receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0064] In some embodiments, the control device 100 may be an intelligent device. For example, the control device 100 may be equipped with various applications for controlling the display device 200 according to user needs.

[0065] In some embodiments, such as Figure 1 As shown, the mobile terminal 300 or other smart electronic devices can perform similar functions to the control device 100 after installing the application of the control display device 200.

[0066] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0067] Under the control of the controller 110, the communication interface 130 enables communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of other near-field communication modules such as WiFi chip 131, Bluetooth module 132, and NFC module 133.

[0068] User input / output interface 140, wherein the input interface includes at least one of other input interfaces such as microphone 141, touchpad 142, sensor 143, and button 144.

[0069] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, which can encode user input commands via WiFi, Bluetooth, or NFC protocols and send them to the display device 200.

[0070] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can also store various control signal instructions input by the user.

[0071] The power supply 180 is used to provide operating power support for the various components of the control device 100 under the control of the controller.

[0072] like Figure 4 In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.

[0073] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0074] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0075] like Figure 4As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0076] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0077] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0078] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0079] Based on the aforementioned display device 200, during the execution of touch interaction responses, the display device 200 can classify touch trajectories corresponding to different touch times, touch positions, number of touch points, and touch event types. This allows it to detect the user's touch input gestures within the touch trajectory and execute different interaction responses for different gestures. For example, if the touch interaction module detects a touch trajectory with only one touch point, only down and up events, a time interval between the down and up events less than a single-click event time threshold, and a touch position change distance less than a jitter distance threshold, then the current user's touch input gesture can be determined to be a click gesture. Based on the click gesture, the display device 200 executes the operation of launching the application according to the icon in the area corresponding to the click gesture's touch position.

[0080] Similarly, based on the touch time, touch position, number of touch points, and touch event type corresponding to the touch trajectory, the display device 200 can also detect other touch interaction gestures input by the user, such as double-tap gestures, swipe gestures, long-press gestures, multi-finger click gestures, and multi-finger swipe gestures. Different interaction gestures can generate different touch parameters. For example, swipe gestures can also generate parameters such as swipe distance, swipe speed, swipe direction, and swipe trajectory shape. Different touch parameters can be used to execute different interactive controls.

[0081] The aforementioned touch trajectories can also be used in conjunction with specific applications to achieve specific functions. For example, when a user launches a touch display application used to render touch trajectories, the display 260 can present the application window of the touch display application; within the application window, the user can draw specific touch trajectories in the drawing area of ​​the application window using swipe gestures, and the controller 250 controls the display 260 to display the touch trajectories in real time through the touch interaction module to achieve the desired demonstration effect.

[0082] Touchscreen applications can be system applications or third-party applications developed based on specific display device types and user needs. Touchscreen applications can be installed on display device 200 and launched and run under user control. For example, a user can control display device 200 to run a whiteboard drawing application by clicking the "Whiteboard" application icon in the application interface of display device 200.

[0083] It should be noted that the whiteboard drawing application mentioned above can be a standalone application, an associated application, or a functional module within a touch application. Different forms of whiteboard drawing applications can have different launch methods. For example, users can launch a standalone whiteboard drawing application through the application interface of display device 200; users can also launch the whiteboard drawing application by performing a "whiteboard" operation on the meeting application; users can also control the meeting application to launch the whiteboard drawing functional module by clicking the "whiteboard" icon on the meeting application.

[0084] Once the whiteboard drawing application is running, it can switch the display device 200 to display the whiteboard interface. The whiteboard interface can include drawing tool controls for drawing operations, such as pen shapes, graphics, line styles, colors, eraser, clear screen, and selection controls. Users can click any control to draw graphics according to their specific needs.

[0085] like Figure 5 As shown, the display device 200 can render and display the drawn image in real time through the image producer module, the surface flinger module, the compositer module, the video processing unit hardware (VPU hardware) module, and the display.

[0086] During the display process, the media player, camera viewer, and OpenGL ES graphics interface of the image generation module generate image content and pass it to the image rendering module. The image rendering module includes a display unit, which controls the content displayed on the monitor. Specifically, the display unit renders the image content through either the user interface (UI) layer or the video layer. To achieve better display effects, the image content in the UI layer can be rendered using the GPU component, thus forming display frames in the compositing module. The compositing module stores these frames using frame buffers and video buffers, and then uses the video processing module to create the display content on the corresponding layers. The compositing module can create the display content using software or hardware; for example, it can be a hardware compositing (HWC) module. That is, image frames generated during video playback are used to create display content through the video plane, while image frames from other images (such as touch traces and graphics) are used to create display content through the OSD plane. Finally, the display device 200 forms the final image through the blending unit of the video process module and displays it on the monitor 260.

[0087] The OSD layer of the display device 200 is also known as the display layer, intermediate layer, menu layer, or application layer, and can be used to display application windows, application menus, toolbars, and other content.

[0088] In some embodiments, to achieve better image display, an external OSD plane can be additionally set in the video processing module of the display device 200, on top of the OSD layer and the video layer. This external OSD plane can be configured with different layer characteristics according to specific display requirements. For example, the bitmap refresh mode of the external OSD plane can be modified to allow it to refresh in real time by region, thereby improving the display speed of graphics. In this case, the external OSD plane can be used as an acceleration layer in scenarios with high dynamic range display effects.

[0089] Taking a whiteboard drawing application running on display device 200 as an example, to improve the responsiveness of the line drawing process, the touch trajectory can be drawn in real time on an extended display layer (acceleration layer) after detecting the user's touch operation. The acceleration layer can be displayed at a higher level than other layers, and when the user completes the touch input, the lines drawn by the acceleration layer are updated to other layers, thereby reducing input latency and improving the real-time display effect of the whiteboard drawing application. For example, as... Figure 6 As shown, the display layers of the display device 200, from high to low, can be the acceleration layer - OSD layer - video layer.

[0090] Understandable, Figure 6 The hierarchical relationship shown is merely an illustrative example; the display hierarchy between the acceleration layer, OSD layer, and video layer can be updated and adjusted in real time according to the application's configuration. This application does not impose any limitations on this.

[0091] In some embodiments, the extended display layer can also work in conjunction with other graphics to improve display quality. For example, the acceleration layer and the OSD layer can respond to user input touch trajectories simultaneously and draw graphics separately. However, since the acceleration layer is displayed above the OSD layer, the graphics drawn by the acceleration layer can obscure the graphics drawn by the OSD layer, maintaining real-time response speed. After the user completes the touch interaction, i.e., when the "up" event is detected, the content displayed by the acceleration layer can be directly released, and the OSD layer directly forms the drawn graphics, thus eliminating the need for the acceleration layer to refresh the drawn graphics to the OSD layer, reducing graphics blending time. This improves both the real-time display effect of the graphics drawing process and the final presentation quality of the graphics.

[0092] However, when multiple touch-enabled application windows are simultaneously displayed in the user interface of the display device 200, the touch display effects between the multiple applications can interfere with each other. Since the applications in the display device 200 share a single acceleration layer, when the application windows of multiple applications overlap, the touch trajectory input by the user to the lower-level application in the overlapping area will be displayed in the upper-level application window through the acceleration layer, causing problems such as obstruction and interference with the display content of the upper-level application window. For example, if application A and application B both have acceleration enabled through the acceleration layer, and the application windows of application A and application B overlap, and the display layer of application A is lower than that of application B, when the user performs an erase operation on application A in the overlapping area, they may accidentally erase or scratch the touch trajectory drawn in application B, resulting in poor touch display effects between multiple applications and a reduced user experience.

[0093] Based on the above application scenarios, in order to improve the problem of mutual interference in the touch display process between multiple applications, some embodiments of this application provide a display device 200, including a display 260, a user interface, and a controller 250. For example... Figure 7 As shown, the display 260 is configured to display a drawing interface, which includes a first application window and a second application window. The first application window is a window displayed based on the first application, and the second application window is a window displayed based on the second application. The first application window and the second application window are displayed through different application layers.

[0094] The display 260 is connected to the touch interaction module. When displaying the drawing interface, the display 260 also displays the touch trajectory through the acceleration layer. The initial display level of the acceleration layer is higher than the display level of the application layer. The display unit of the acceleration layer is set with the application display range indicator.

[0095] In some embodiments, the acceleration layer comprises multiple display units, each of which may include one or more pixels. The acceleration layer can cover the entire user interface displayed on the display 260 and can be used to display the touch process of a touch trajectory in real time or to display content located above the application layer. The display units in the acceleration layer are provided with application display range identifiers to characterize associated applications. The display unit with an application display range identifier is the application display area of ​​that application. For example, if the application display range identifier for application A is "1", the area comprised of display units in the acceleration layer with "1" is the application display area for application A.

[0096] In some embodiments, the application display scope identifier associated with the target application is obtained based on the application package name of the target application during registration. Since each application's application package name is different and unique, the application display scope identifier obtained by each application based on its application package name is also different, thus ensuring the uniqueness of the application display scope identifier.

[0097] To facilitate the setting of application display range identifiers for each display unit in the acceleration layer, in some embodiments, the display device 200 also detects the window change area of ​​the target application in response to window dynamic events of the target application. The target application can be any application in the display device 200; window dynamic events include window change events, window start events, and window close events. Window change events include window size change events and window position change events. That is, the zooming, shrinking, moving, opening, and closing operations performed by the display device 200 on the application window of the target application are all window dynamic events of the target application. The window change area includes the window display area of ​​the target application before the display device 200 executes the window dynamic event and the window display area of ​​the target application after the window dynamic event is executed. After detecting the window change area of ​​the target application, the display device 200 queries the target unit based on the window change area and updates the application display range identifier of the target unit based on the window display layer. The target unit includes the display unit located in the window change area of ​​the acceleration layer.

[0098] In other words, once the display device 200 detects that the window of the target application has any of the above-mentioned window dynamic events, it detects the window change area of ​​the target application, and sets the application display range identifier of the target application in the display unit at the corresponding position of the acceleration layer according to the detected change area, thereby completing the application display area division of the application.

[0099] In some embodiments, the view system of the display device 200 listens for window dynamic events. When a window dynamic event of the target application is detected, the view system sends the layout parameters of the target application before and after the window change to the controller 250. For example, when the application window of the target application changes, the view system sends a layoutchange message to the controller 250, and the controller 250 determines the window change area of ​​the target application based on the layout parameters contained in the layoutchange message. In some embodiments, the window dynamic event can be input by the user based on the control device 100; or, the window dynamic event can also be input by the user based on voice commands, touch operations, etc.; or, the window dynamic event can also be a dynamic event automatically generated by the display device 200 based on a specific program. For example, such as... Figure 8 As shown, Figure 8 The application window shown is the application window of application A on display device 200. The user drags the application window of application A via touch operation, and display device 200 generates dynamic events for the window of application A based on the touch operation. In some embodiments, when display device 200 detects a window change area of ​​the target application, it calls the target application's data file and extracts the window position information and window size information from the data file. The window position information may include the boundary coordinates and / or center coordinates of the application window, and the window size information may include the shape attributes of the application window, the length of the application window, or the width of the application window. After extracting the window position information and window size information, display device 200 calculates the window display area of ​​the target application based on the window position information and window size information to obtain the window change area according to the window display area.

[0100] It is understood that the aforementioned window display area includes the window display area before the target application executes the window dynamic event and the window display area after the window dynamic event is executed; that is, the union of the window display areas before and after the target application window changes constitutes the aforementioned window change area. To improve the accuracy of the application display range identifier in each display unit of the acceleration layer, when updating the application display range identifier of the target unit, the display device 200 can determine the application display range identifier to be set for the current target unit by considering the display layer of the application window.

[0101] Therefore, in some embodiments, when the display device 200 updates the ownership identifier of the target unit, it obtains the window display level of the application in the changed area. The application in the changed area is the application whose window is displayed in the changed window area. Then, it queries the identifier application of the target unit according to the window display level. The identifier application is the application in the changed area with the highest window display level for each target unit location. If an identifier application exists at the target unit location, the application display range identifier of the target unit is updated to the application display range identifier of the identifier application; if no identifier application exists at the target unit location, the application display range identifier of the target unit is updated to the initial identifier. The initial identifier is a preset application display range identifier in the display device 200, used to indicate that no application is currently set for the display unit.

[0102] Taking a drawing interface that includes an application as an example, the display device 200 is configured with application A, the initial identifier of the display device 200 is "NA", and the application display range identifier of application A is "1"; for example Figure 9 As shown, if there is no displayed application window in the drawing interface of display device 200, then all display units in the acceleration layer are set to their initial identifiers. At this time, the user launches application A in display device 200, and the application window of application A is displayed in full screen. Display device 200 responds to the window launch event of application A by detecting changes in the window area of ​​application A. After detecting that the display area of ​​application A after launch is full screen, it determines that the target units are all display units in the acceleration layer. Display device 200 then updates the initial identifier "NA" of all display units to the application display range identifier "1" of application A.

[0103] Taking a drawing interface comprising two applications as an example, display device 200 is configured with application A and application B. The initial identifier of display device 200 is "NA", the application display range identifier of application A is "1", and the application display range identifier of application B is "2". The application window of application A is displayed half-screen in the drawing interface. At this time, the user launches application B in display device 200, causing application B to float in the display. Figure 10 The display area is shown. The display device 200 responds to the window launch event of application B by detecting the window display area before and after the change in application B, in order to determine the changed window area. After detecting the changed window area of ​​application B, the display unit at the corresponding position is determined based on the changed window area of ​​application B, and used as the target unit. For example... Figure 10, before the application display range identifier of the target unit is updated, a part of the application display range identifier is the initial identifier "NA", and a part of the application display range identifier is the application display range identifier "1" of Application A. Since the display level of Application B is above the display level of Application A, the display device 200 updates both the application display range identifiers "NA" and "1" of the target unit to the application display range identifier "2" of Application B.

[0104] In the above two examples, there are identification applications at the target unit positions. Obviously, when there is no identification application at the target unit position, the application display range identifier needs to be updated to the initial identifier. Taking the drawing interface including one application as an example, Application A is set in the display device 200, the initial identifier of the display device 200 is "NA", and the application display range identifier of Application A is "1"; as Figure 11 shown, the application window of Application A is displayed full screen in the display device 200, and all the display units in the acceleration layer are set with the application display range identifier "1" of Application A. At this time, the user adjusts the application window of Application A to be displayed half screen through the remote control supporting the display device 200. The display device 200 responds to the window change event of Application A, detects the window display area before and after the change of Application A, and determines that the target unit is the display unit of the full screen, and the changed area application is Application A. As Figure 11 , the application with the highest display level displayed in the left half screen of the display device 200 is Application A, and the right half screen does not include the display content of any application window, so the display units in the right half screen area are updated to the initial identifier "NA", and the target units in the left half screen area still maintain the original application display range identifier "1".

[0105] Taking the drawing interface including two applications as an example, Application A and Application B are set in the display device 200, the initial identifier of the display device 200 is "NA", the application display range identifier of Application A is "1", and the application display range identifier of Application B is "2"; as Figure 12 shown, the application window of Application B is floating above the application window of Application A, and the application display range of the display units in the overlapping area of the windows of Application B and Application A is represented by the application display range identifier "2" of Application B. After the user drags the window of Application B to the lower right, the window change area as shown in Figure 12 is determined. The window change area includes Application A and Application B, so it is determined that the changed area applications are Application A and Application B. According to the display levels of Application A and Application B, the target units at the corresponding positions are respectively updated to the application display range identifier "1" of Application A and the application display range identifier "2" of Application B. At the same time, the display units without identification applications in the window change area are updated to the initial identifier "NA", as Figure 12 shown.

[0106] Understandable Figures 9-12 The application display range identifier shown is not displayed in the drawing interface. The application display range identifier shown in the above figures is only for the purpose of explaining the application display range identifier of the embodiment of this application. The application display range identifier is all data stored in the memory of the display device 200 and will not be displayed in the drawing interface of the display device 200.

[0107] To reduce system resource consumption, in some embodiments, the display device 200 also monitors the application type corresponding to the application window in the drawing interface. If the drawing interface does not include a touch display application, it means that the display device 200 does not need physical acceleration through the acceleration layer, and thus releases the data resources of the acceleration layer. Conversely, if the drawing interface includes a touch display application, the data resources of the acceleration layer are loaded to display the content of the acceleration layer through the data resources. In other words, when the drawing interface displayed by the display device 200 does not include any touch display application such as a whiteboard drawing application, the display device 200 can automatically release the data resources of the acceleration layer to save system resource consumption.

[0108] It should be noted that the drawing interface described in this application embodiment is the user interface displayed by the display device 200.

[0109] In some embodiments, the touch trajectory includes display units affected by drop, move, and lift actions. A touch trajectory must include display units affected by drop, move, and lift actions simultaneously. The display unit affected by the drop action constitutes the touch start point, the display unit affected by the move action is the touch trajectory point, and the display unit affected by the lift action is the touch end point. Touch trajectory points and touch end points are display units that act after the touch start point time and can be collectively referred to as touch driving points; that is, touch driving points include display units in the touch trajectory that act after the touch start point time.

[0110] For example, such as Figure 13 As shown, the user draws on the whiteboard of the display device, which is then applied to the acceleration layer. Figure 13 The touch trajectory shown is composed of multiple touch points, where touch point a is the touch start point, touch point b is the touch trajectory point, and touch point f is the touch end point.

[0111] To facilitate the display device 200's differentiation and identification of touch points, in some embodiments, the data information of each touch point in the touch trajectory includes coordinate information and action attributes, and the data information can be in different formats. For example, the data format of the touch start point can be [down;x,y], the data format of the touch trajectory point can be [move;x,y], and the data format of the touch end point can be [up;x,y], where x and y represent the horizontal and vertical coordinates of the touch point. The display device 200 can perform touch point identification processing by parsing the above data information.

[0112] like Figure 14 As shown, controller 250 is configured to execute the following program steps:

[0113] S1: In response to the target touch trajectory input by the user based on the first application, refresh the target touch trajectory to the acceleration layer and the first application layer, and detect the touch unit in the acceleration layer.

[0114] When the display device 200 detects a target touch trajectory input by a user based on a first application, it refreshes the target touch trajectory to the acceleration layer and the first application layer of the display device 200 in response to the target touch trajectory. The first application is a touch display application used to render the touch trajectory, such as a whiteboard drawing application or a writing application. The first application layer is the application layer used to display the first application. Figure 6 As shown, in order to achieve the acceleration effect of touch trajectory through the acceleration layer, the display level of the acceleration layer in the display device 200 is set to be higher than the application layer by default. At this time, the touch display effect of the acceleration layer will cover all the application layers of the display device 200.

[0115] In some embodiments, the display device 200 controls the display and hiding of the application layer and its layer order based on the WindowManagerService (WMS). For example, the application layer of the display device 200 has a Z-order property. The Z-order property is used to characterize the display layer of a window; the smaller the value of the Z-order property, the lower the display layer of the corresponding window; the larger the value, the higher the display layer of the corresponding window. The display device 200 can modify the value of the Z-order property based on the WindowManagerService to adjust the display layer of each window.

[0116] To facilitate the display device 200's recognition of touch trajectories, in some embodiments, the display device 200 also detects the target position of the touch start point in the target touch trajectory and obtains the application display range identifier of the target position. Based on the application display range identifier of the target position, the target touch trajectory is refreshed to the application layer of the first application. That is, the display device 200 determines the application layer to which the current touch trajectory applies based on the touch start point of each touch trajectory.

[0117] Taking the first application as a whiteboard drawing application as an example, the whiteboard drawing application is application A, and the application display range of application A is marked as "1"; for example Figure 15 As shown, after launching the whiteboard drawing application, the user draws in the application window of the whiteboard drawing application. Figure 15 The curve S shown represents the target touch trajectory, including the touch start point S1. The display device 200 responds to the touch trajectory of curve S, detects the position of the touch start point S1, and obtains the application display range identifier "1" set by the display unit at position S1. Thus, the display device 200 can determine that curve S is a touch trajectory acting on application A based on the application display range identifier "1," and refresh the target touch trajectory to the application layer of application A based on the application display range identifier "1."

[0118] To ensure the display effect of the target touch trajectory, the display device 200 refreshes the target touch trajectory to the acceleration layer and the first application layer, and also detects the touch units in the acceleration layer. The touch unit is the display unit affected by the target touch trajectory.

[0119] In some embodiments, when the display device 200 detects a touch unit in the acceleration layer, it obtains the touch point coordinates of the target touch trajectory and queries the display units in the acceleration layer based on the touch point coordinates to determine the touch unit of the target touch trajectory. That is, when the user interface of the display device 200 detects a touch trajectory, it reports the touch point coordinates of each touch point in the touch trajectory to the controller 250 in real time. The controller 250 then determines the display unit at that coordinate position in the acceleration layer based on the reported touch point coordinates, thus identifying the touch unit of the touch trajectory.

[0120] In order to display the touch trajectory in the user interface of the display device 200, in some embodiments, when the display device 200 refreshes the target touch trajectory to the acceleration layer, it also generates bitmap data of the target touch trajectory. The bitmap data is then copied to the touch unit, and the touch termination point of the target touch trajectory is monitored. When the touch termination point of the target touch trajectory is detected, the bitmap data is copied to the application layer of the first application.

[0121] In this way, the acceleration layer can display the touch effect of the target touch trajectory in real time, allowing users to perceive the interactive feedback of the touch trajectory in a timely manner. At the same time, when the touch termination point is detected, the complete touch trajectory is refreshed to the application layer, which facilitates the display device 200 to process the complete bitmap data of the target touch trajectory and reduces problems such as fragmented display content in the application layer. For example, when the touch start point in the target touch trajectory is [down;x,y], the touch trajectory point is [move;x,y], and the touch termination point is [up;x,y], the display device 200 refreshes the target touch trajectory to the application layer of the first application when it detects [up;x,y].

[0122] In some embodiments, when the display device 200 generates bitmap data of the target touch trajectory, it performs preprocessing on the target touch trajectory. This preprocessing includes noise removal and trajectory curve smoothing to ensure data accuracy and consistency. The target touch trajectory is then converted into a pixel sequence. After converting the pixel sequence of the target touch trajectory, the touch point coordinates in the target touch trajectory are mapped to the touch point coordinates of the user interface based on the pixel sequence, and specific color values ​​are set for the pixel sequence according to the configuration parameters of the target touch trajectory to generate bitmap data of the touch trajectory. The bitmap data is then refreshed to the application layer and the acceleration layer, allowing the touch trajectory to be displayed. For example, if the user selects black as the color of the target touch trajectory in the first application, the display device 200 sets the color value of the pixel sequence to black.

[0123] S2: Read the application display range identifier of the touch unit.

[0124] After detecting the touch unit in the acceleration layer, the display device 200 also reads the application display range identifier set in the touch unit to determine the position of the target touch trajectory. For example, the application display range identifier of application A is "1" and the application display range identifier of application B is "2". When the target touch trajectory acts on the application display area of ​​application A, the application display range identifier read by the display device 200 is "1"; when the target touch trajectory acts on the application display area of ​​application B, the application display range identifier read by the display device 200 is "2".

[0125] S3: When the application display range identifier of the touch unit is not the first identifier, detect the second application associated with the touch unit.

[0126] Wherein, the first identifier is the application display range identifier of the first application. When the display device 200 reads that the application display range identifier in the touch unit is not the first identifier, it means that the display content at the current touch unit position in the user interface is not the application window of the first application. At this time, the target touch trajectory refreshed to the acceleration layer will obstruct the display content at the current position. Therefore, the display device 200 needs to detect the associated second application based on the application display range identifier of the touch unit, and the second application is the display content of the user interface at this position.

[0127] For example, such as Figure 15 As shown, the application display range identifier for application A is "1", and the application display range identifier for application B is "2". The user inputs in the display device 200. Figure 15 The touch trajectory curve S is shown below. Figure 15 The application display range identifier at the touch start point S1 of curve S is "1", indicating that curve S is a touch trajectory acting on application A. When the user draws to the touch driving point S2, the display device 200 reads the application display range identifier at position S2 as "2". Since the application display range identifier of the current touch unit is not the application display range identifier "1" of application A, the display device 200 detects the application B associated with the current touch unit based on the application display range identifier "2".

[0128] S4: Adjust the transparency of the second application layer and set the display level of the second application layer to be higher than that of the acceleration layer.

[0129] To achieve accelerated touch trajectory through the acceleration layer, the acceleration layer is displayed at a higher level than the application layer by default. However, since the second application is displayed at a higher level than the first application, when a touch unit in the acceleration layer whose display area identifier is not the first identifier is touched, the touch trajectory of the first application may be applied to the application window of the second application.

[0130] For example, such as Figure 16 As shown, when the second application floats on top of the first application, the target touch trajectory input from the first application will be displayed on the second application's window when it passes through the overlapping area of ​​the first and second applications, interfering with the display effect of the second application. However, after the user inputs a complete touch trajectory, the content displayed in the acceleration layer is directly released. At this time, because the display layer of the second application is higher than that of the first application, the second application will obscure the first application, so the touch trajectory refreshed to the first application will not be displayed in the user interface. This causes the touch trajectory in the overlapping area to suddenly disappear from the user interface, thus reducing the user experience.

[0131] Therefore, to improve the above-mentioned problem, the display device 200 adjusts the transparency of the second application layer after detecting the second application. The second application layer is the application layer used to display the second application. Meanwhile, as... Figure 17 As shown, the display device 200 also sets the display level of the second application layer to be higher than that of the acceleration layer. Thus, when inputting a touch trajectory, the user can observe the displayed content of the target touch trajectory in the acceleration layer in real time through the second application layer above the acceleration layer, thereby perceiving the touch process of the target touch trajectory. After the display content of the acceleration layer is released, the user can still observe the displayed content of the target touch trajectory in the first application layer through the second application layer above the acceleration layer, thereby perceiving the touch result of the target touch trajectory. At this time, the display levels in the display device 200, from high to low, are: second application layer - acceleration layer - first application layer.

[0132] For example, such as Figure 18 As shown, the application display range of the first application is represented as "1", and the application display range of the second application is represented as "2". The second application floats on top of the first application, and the second application layer of the second application is completely opaque. The user draws a target curve G on the display device 200, with the touch start point of curve G being G1. The display device 200 reads the application display range identifier at position G1 as "1", thus determining that curve G is the touch trajectory acting on the first application. When the user draws to position G2, the application display range identifier read by the display device 200 changes to "2". The display device 200 then determines the corresponding second application based on the application display range identifier "2", adjusts the transparency of the second application layer, and sets the display level of the second application layer to be higher than that of the acceleration layer, presenting as shown below. Figure 18 The display effect shown.

[0133] To achieve transparency at the application layer, some embodiments include color values ​​in the application layer's window parameters. These color values ​​consist of four parts: red, green, blue, and alpha (transparency). For example, the color value in the window parameters could be #AARRGGBB, where AA represents transparency, RR represents red, GG represents green, and BB represents blue.

[0134] In some embodiments, taking hexadecimal as an example, the value range of Alpha is 0 to 255. Here, 0 represents complete transparency, and 255 represents complete opacity. To facilitate comparison of Alpha values, the display device 200 can map Alpha values ​​to the range [0,1], using decimal values ​​to indicate the magnitude of the Alpha value. For example, dividing the Alpha value by 255, when the Alpha value is 128, the mapped decimal value is 128 / 255 ≈ 0.502.

[0135] Understandably, the smaller the alpha value, the higher the corresponding transparency value, and the more transparent the color; conversely, the larger the alpha value, the lower the corresponding transparency value, and the less transparent the color.

[0136] Therefore, as Figure 19 As shown, in some embodiments, when displaying the transparency of the second application layer, the display device 200 reads the window parameters of the second application layer. These window parameters include color values. The transparency of the color values ​​is parsed to obtain the initial transparency value of the second application layer. Since the display device 200 sets the display level of the second application layer to be higher than that of the acceleration layer, in order to facilitate the user's observation of the display content of the acceleration layer and the first application layer through the second application layer, the display device 200 adjusts the transparency of the window parameters to a target value. This target value is higher than the initial transparency value.

[0137] For example, the initial transparency value of the second application layer is 0%, and the alpha value is 255, making the second application layer opaque. When adjusting the transparency of the second application layer, the display device 200 can adjust the transparency value of the second application layer to 50%, that is, adjust the alpha value in the window parameters of the second application layer to 127.

[0138] Furthermore, since the touch trajectory may have a transparent color when the user inputs it to the display device 200, in some embodiments, to ensure the display effect of the touch trajectory, the display device 200 also detects the trajectory color value of the target touch trajectory. The transparency of the trajectory color value is analyzed to obtain the target transparency value of the target touch trajectory. A target value higher than the target transparency value is then generated. In this way, adjusting the transparency of the second application layer to be lower than the transparency of the target touch trajectory allows the target touch trajectory to better show through the second application layer and be displayed in the user interface.

[0139] For example, the second application floats on top of the first application. The display level of the acceleration layer is higher than both the first and second application layers, and the display level of the second application layer is higher than that of the first application layer. The user inputs a target touch trajectory with a 50% transparency value to the display device 200 based on the first application. When the target touch trajectory passes through the overlapping area of ​​the first and second applications, the display device 200 generates a target value of 60% with a transparency value higher than 50%, adjusts the transparency value of the second application layer to 60%, and simultaneously sets the display level of the second application layer to be higher than that of the acceleration layer.

[0140] Since the touch trajectory input by the touch display application also includes touch events for erasing the touch trajectory, when the erase event is executed, the acceleration layer of the display device 200 needs to copy the bitmap background of the application window to the display area of ​​the touch trajectory to achieve the erase effect.

[0141] Therefore, in some embodiments, the display device 200 also detects the event type of the target touch trajectory. When the event type is an erase event, the bitmap background of the first application is obtained and copied to the touch unit. Since the touch unit is the display unit where the target touch trajectory in the acceleration layer is applied, setting the display level of the second application layer to be higher than that of the acceleration layer ensures that the display content in the acceleration layer will not obstruct the second application layer, thus guaranteeing the display effect of the second application. The user can also observe the obstruction of the first application layer by the bitmap background in the acceleration layer through the second application layer, which has a set transparency, achieving the erase effect.

[0142] For example, such as Figure 20 As shown, the second application floats on top of the first application. The display level of the acceleration layer is higher than both the first and second application layers, and the display level of the second application layer is higher than the first application layer. The user inputs the target touch trajectory of the erase event to the display device based on the first application. The touch trajectory of the erase event is as follows: Figure 20 As shown in the dashed line, the display device 200, in response to the erase event of the target touch trajectory, copies the bitmap background of the first application to the location of the target touch trajectory in the acceleration layer. When the touch point of the target touch trajectory is located in the application window area of ​​the second application, the display device 200 increases the transparency of the second application layer and sets the display level of the second application layer to be higher than that of the acceleration layer. Thus, because the display level of the acceleration layer is lower than that of the second application layer, the content displayed in the acceleration layer will not obscure the content displayed in the second application layer; simultaneously, through the second application layer with its transparency set, the user can still observe the obscuring effect of the acceleration layer on the first application, achieving the erase effect of the first application layer.

[0143] In some embodiments, the erase event is based on an erase control input, and the erase control is displayed in the acceleration layer based on specific bitmap data. When the display device 200 enters erase mode, the display device 200 generates bitmap data for the erase control and refreshes the bitmap data of the erase control to the acceleration layer according to the target touch trajectory, so that it is displayed in the drawing interface. When the user inputs an erase event, the erase control moves following the position of the touch point.

[0144] Because the display device 200 needs to copy the bitmap background to the corresponding position during the user's erase event input, in some embodiments, to ensure a good user experience, the display device 200 also responds to the erase event by continuously refreshing the bitmap data of the erase control to the acceleration layer according to the touch trajectory of the erase event. In other words, the bitmap data of the erase control is refreshed in real time to the position of the touch trajectory on the acceleration layer. Thus, after entering erase mode, the erase control can remain displayed in the user interface of the display device 200, allowing the user to perceive the erase operation process in real time, thereby improving the user's interactive experience.

[0145] Based on the aforementioned display device 200, some embodiments of this application also provide a method for displaying an acceleration layer, such as... Figure 14 As shown, the method includes the following procedural steps:

[0146] S1: In response to a target touch trajectory input by the user based on a first application, refresh the target touch trajectory to the acceleration layer and the first application layer, and detect the touch unit in the acceleration layer; the first application layer is an application layer for displaying the first application, and the touch unit is a display unit acted upon by the target touch trajectory;

[0147] S2: Read the application display range identifier of the touch unit;

[0148] S3: When the application display range identifier of the touch unit is not the first identifier, detect the second application associated with the touch unit, where the first identifier is the application display range identifier of the first application;

[0149] S4: Adjust the transparency of the second application layer and set the display level of the second application layer to be higher than the display level of the acceleration layer. The second application layer is an application layer used to display the second application.

[0150] As can be seen from the above technical solutions, the display device and display method of the acceleration layer provided in some embodiments of this application can, in response to a user's target touch trajectory input based on a first application, refresh the target touch trajectory to the acceleration layer and a first application layer for displaying the first application, and detect touch units in the acceleration layer. Here, the touch unit is the display unit acted upon by the target touch trajectory. The application display range identifier of the touch unit is read. When the application display range identifier of the touch unit is not a first identifier, a second application associated with the touch unit is detected. The transparency of the second application layer is adjusted, and the display level of the second application layer is set to be higher than the display level of the acceleration layer. Here, the second application layer is the application layer used to display the second application. By adjusting the transparency and display level of the application layer, the method can display the touch trajectory acting on the overlapping part in the user interface through the upper application layer, so that the touch display effect between multiple applications does not affect each other, thereby improving the touch display effect between multiple applications.

[0151] Furthermore, to ensure that the touch display effects of multiple applications do not interfere with each other, in some embodiments, the display device 200 can also respond to the target touch trajectory, detect the target position of the touch start point in the target touch trajectory, and obtain the target application display range identifier of the target position. The application display area of ​​the acceleration layer is then queried based on the target application display range identifier. The application display area is the display unit that has the application display range identifier of the first application set. For example, when the application display range associated with the first application is represented as "1", all display units in the acceleration layer that have the application display range identifier "1" constitute the application display area of ​​the first application.

[0152] After locating the application display area, the target touch trajectory is refreshed to the application display area, and also refreshed to the first application layer according to the application display range identifier. That is, when refreshing the target touch trajectory in the acceleration layer, the display device 200 can refresh the target touch trajectory only to the application display area corresponding to the first application, so as not to interfere with the display effect of other applications.

[0153] In some embodiments, when the display device 200 refreshes the target touch trajectory to the application display area, it detects the position of the touch driving point. When the position is within the application display area, the touch driving point is refreshed to the application display area of ​​the acceleration layer; when the position is not within the application display area, refreshing the touch driving point to the acceleration layer is stopped.

[0154] Clearly, when application windows overlap, the overlapping area essentially constitutes part of the application window's display area. Stopping the refresh of touch-driven points whose active positions are outside the application's display area to the acceleration layer ensures that touch trajectories are refreshed correctly at the application layer while preventing interference with the display of other applications. For example, ... Figure 21As shown, the application window of application B floats on top of the application window of application A. The user draws as follows... Figure 21 As shown in the diagram, curve C has a touch start point of C1. Based on the position of C1, the application display area affected by curve C is determined to be the application display area of ​​application A. The display device 200 then stops refreshing the touch drive points located in the application display area of ​​application B to the acceleration layer, while simultaneously refreshing the complete touch trajectory of curve C normally to the application layer of application A. Since the display layer of the acceleration layer is higher than the application layer, the user interface will not ultimately display overlapping touch trajectories, ensuring that curve C does not interfere with the display effect of application B. Furthermore, since the complete touch trajectory has already been refreshed in the application layer of application A, when the application window of application B moves away from the top layer of the application window of application A, as shown... Figure 21 As shown, the application window of application A can still display the complete touch trajectory of curve C normally.

[0155] However, when there is no overlap between application windows, the touch driver points acting outside the application display area have exceeded the display area of ​​the application window, so they cannot be refreshed to the application layer normally. As a result, the display device 200 cannot provide feedback on the touch driver points in this part, which degrades the user's interactive experience.

[0156] Therefore, to improve the user's interactive experience, in some embodiments, when the action position is not located within the application display area, the display device 200 also detects the window overlap state of the first application. When the window overlap state is non-overlapping, the touch point coordinates of the touch driving point are obtained, and the touch point coordinates are converted into registration coordinates according to a preset coordinate mapping relationship. The registration coordinates are the boundary coordinates of the application display area. Based on the registration coordinates, the touch driving point is refreshed to the application layer of the first application in the acceleration layer. In this way, the display device 200 can convert touch driving points located outside the application display area to the edge of the application display area through coordinate transformation, allowing them to be displayed normally in the acceleration layer and the application layer.

[0157] For example, such as Figure 22 As shown, the application windows of application A and application B are displayed in a split-screen manner on display device 200. The left half of the screen is the application display area for application A, and the right half of the screen is the application display area for application B. The user draws on display device 200. Figure 22 The curve G shown has its starting touch point as G1. The position of G1 determines that the application display area affected by curve G is the left half of the screen. Therefore, the coordinates of touch drive points extending beyond the left half of the screen are converted to coordinates located at the edge of the left half of the screen and refreshed in the acceleration layer and the application layer of application A, displaying the results. Figure 22 The display effect shown.

[0158] For erase events, in some embodiments, when the location of the event is not within the application display area, the display device 200 also detects the event type of the target touch trajectory. If the event type is an erase event, the touch driving point is converted into transparent bitmap data, and the transparent bitmap data is refreshed to the location of the acceleration layer.

[0159] For example, such as Figure 23 As shown, the application window of application B floats on top of the application window of application A. The user inputs an erase event with the touch start point in the display area of ​​application A into the display device 200. The touch trajectory corresponding to the erase event is as follows: Figure 23 As shown by the dotted lines in the diagram. For touch-driven points located in the display area of ​​application A, the display device 200 copies the bitmap background of application A to the corresponding position of the touch-driven point; for touch-driven points located in the display area of ​​application B, the display device 200 processes these touch-driven points into a transparent bitmap. After the transparent bitmap is refreshed to the acceleration layer, it will not affect the display content of the application window, so that the application window of application B is not affected by the erasure event and always maintains the original display effect.

[0160] Alternatively, in some embodiments, when the action location is not located within the application display area, the display device 200 detects the event type of the target touch trajectory. If the event type is an erase event, the application display range identifier of the action location in the acceleration layer is detected. Then, a second application is queried based on the application display range identifier of the action location. The second application is the application associated with the application display range identifier of the action location. The bitmap background of the second application is obtained and copied to the action location in the acceleration layer.

[0161] For example, application window B floats on top of application window A. The user inputs an erase event to display device 200 with the touch start point in the display area of ​​application A. The touch trajectory corresponding to the erase event is as follows: Figure 23 As shown by the dotted lines, for a touch-driven point located in the display area of ​​application A, the display device 200 copies the bitmap background of application A to the corresponding position of the touch-driven point; for a touch-driven point located in the display area of ​​application B, the display device 200 copies the bitmap background of application B to the corresponding position of the touch-driven point, and the application window of application B will not be affected by the erase event, and will always maintain the original display effect.

[0162] As can be seen from the above technical solutions, the display device 200 provided in some embodiments of this application can also respond to a user's input of a target touch trajectory based on a first application, detect the target position of the touch start point in the target touch trajectory, and obtain the application display range identifier of the target position. The application display area of ​​the acceleration layer is queried based on the application display range identifier of the target position. The target touch trajectory is then refreshed to the application display area of ​​the acceleration layer, and refreshed to the first application layer according to the application display range identifier. This method refreshes the acceleration layer based on the application display area of ​​each application and refreshes the touch trajectory to the application layer corresponding to the application according to the application display range identifier. This can accelerate the application touch display speed while ensuring that the touch display between different applications does not interfere with each other, thereby improving the touch display effect between multiple applications.

[0163] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0164] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The display is configured to display a drawing interface, which includes a first application window and a second application window. The first application window is a window displayed based on a first application, and the second application window is a window displayed based on a second application. The first application window and the second application window are displayed through different application layers. The display is connected to a touch interaction module, which is used to detect the touch trajectory input by the user. When displaying the drawing interface, the display also displays the touch trajectory through an acceleration layer. The initial display level of the acceleration layer is higher than the display level of the application layer, and the display unit of the acceleration layer is provided with an application display range indicator. The controller is configured as follows: In response to a target touch trajectory input by a user based on a first application, the target touch trajectory is refreshed to the acceleration layer and the first application layer, and the touch unit in the acceleration layer is detected; the first application layer is an application layer for displaying the first application, and the touch unit is a display unit acted upon by the target touch trajectory; Read the application display range identifier of the touch unit; When the application display range identifier of the touch unit is not the first identifier, the second application associated with the touch unit is detected, and the first identifier is the application display range identifier of the first application; Adjust the transparency of the second application layer and set the display level of the second application layer to be higher than the display level of the acceleration layer. The second application layer is an application layer used to display the second application.

2. The display device according to claim 1, characterized in that, The touch trajectory includes a touch termination point, and the touch termination point includes the display unit acted upon by the lift-off action; the controller is configured to refresh the target touch trajectory to the acceleration layer and the application layer of the first application. Generate bitmap data of the target touch trajectory; Copy the bitmap data to the touch unit and monitor the touch termination point of the target touch trajectory; When the touch termination point of the target touch trajectory is detected, the bitmap data is copied to the application layer of the first application.

3. The display device according to claim 1, characterized in that, The controller is configured to adjust the transparency of the second application layer as follows: Read the window parameters of the second application layer, the window parameters including color values; Analyze the transparency of the color value to obtain the initial transparency value of the second application layer; The transparency of the window parameter is adjusted to a target value, which is higher than the initial transparency value.

4. The display device according to claim 3, characterized in that, The controller is also configured to: Detect the trajectory color value of the target touch trajectory; Analyze the transparency of the trajectory color value to obtain the target transparency value of the target touch trajectory; Generate a target value that is higher than the target transparency value.

5. The display device according to claim 1, characterized in that, The controller is also configured to: Detect the event type of the target touch trajectory; When the event type is an erase event, obtain the bitmap background of the first application; Copy the bitmap background of the first application to the touch unit.

6. The display device according to claim 5, characterized in that, When the event type is an erase event, the controller is also configured to: Generate bitmap data for the erase control; According to the target touch trajectory, the bitmap data of the erase control is refreshed to the acceleration layer.

7. The display device according to claim 1, characterized in that, The controller is also configured to: In response to window dynamic events of the target application, the window change area of ​​the target application is detected, and the window dynamic events include window change events, window start events, and window close events; The target unit is queried according to the window change area, and the target unit includes the display unit located in the window change area in the acceleration layer; The application display range identifier of the target unit is updated based on the window display hierarchy.

8. The display device according to claim 7, characterized in that, The controller performs an update of the application display range identifier of the target unit based on the window display hierarchy, and is configured as follows: Obtain the window display hierarchy of the application in the changed area, wherein the application in the changed area is the application whose application window is displayed in the window changed area; The identification application of the target unit is queried according to the window display hierarchy. The identification application is the application of the highest change area in the window display hierarchy for each target unit location. If an application is identified at the target unit location, the application display range identifier of the target unit is updated to the application display range identifier of the identified application. If no application is identified at the target unit location, the application display range identifier of the target unit is updated to the initial identifier.

9. The display device according to claim 1, characterized in that, The controller is configured to: Monitor the application type corresponding to the application window in the drawing interface; If the drawing interface does not include a touch display application, release the data resources of the acceleration layer; If the drawing interface includes a touch display application, load the data resources of the acceleration layer to display the display content of the acceleration layer through the data resources.

10. A method for displaying an acceleration layer, characterized in that, Applied to the display device according to any one of claims 1-9, the method comprises: In response to a target touch trajectory input by a user based on a first application, the target touch trajectory is refreshed to the acceleration layer and the first application layer, and the touch unit in the acceleration layer is detected; the first application layer is an application layer for displaying the first application, and the touch unit is a display unit acted upon by the target touch trajectory; Read the application display range identifier of the touch unit; When the application display range identifier of the touch unit is not the first identifier, the second application associated with the touch unit is detected, and the first identifier is the application display range identifier of the first application; Adjust the transparency of the second application layer and set the display level of the second application layer to be higher than the display level of the acceleration layer. The second application layer is an application layer used to display the second application.

Images