Display device and display method
By introducing gesture task status into the display device, the prohibited range of touch screen events is judged in real time, and the conflict problem of touch screen operations in different scenarios is solved, improving the accuracy and user experience of operations.
Patent Information
- Application Number
- CN202510316342.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-17
- Publication Date
- 2025-07-29
AI Technical Summary
Due to the limitations of gestures, touch screen operations are prone to conflicts in different operating scenarios, affecting the accuracy and user experience of touch screen operations.
By introducing gesture task status into the display device, we can judge the prohibited range of touch screen events in real time, and determine whether to ignore or process touch screen events based on the gesture task status to avoid conflicts.
Improves the accuracy of touch screen operation and improves the user's touch screen operation experience.
Smart Images

Figure CN120386479A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of display devices, and in particular, to a display device and a display method. Background Art
[0002] Touch screen interaction technology is a technology that realizes human-computer interaction by touching the screen, and is widely used in display devices such as smart phones, tablet computers, and touch screens. Such display devices can complete interactions with users through touch screen operations of different gestures of users, including: switching applications and swiping interfaces through touch screen operations. However, due to the limitations of gestures, touch screen operations in different operation scenarios may conflict, thereby affecting the accuracy of touch screen operations and reducing the user experience. Summary of the Invention
[0003] This application provides a display device and a display method, which can improve the accuracy of touch screen operations.
[0004] In a first aspect, some embodiments of this application provide a display device, including a display screen and a controller. Among them,
[0005] The display screen supports the touch screen operation function and is configured to display a playback interface;
[0006] The controller is configured to:
[0007] In response to an input touch screen operation, trigger a touch screen event corresponding to the touch screen operation;
[0008] Determine whether the touch screen event is prohibited according to the gesture task state of the playback interface; wherein, the gesture task state is used to indicate the prohibited range of the touch screen event of the playback interface in real time;
[0009] In the case where the gesture task state indicates that the touch screen event is prohibited, ignore the touch screen event;
[0010] In the case where the gesture task state indicates that the touch screen event is not prohibited, process the touch screen event.
[0011] In the embodiments of this application, by responding to an input touch screen operation to trigger a corresponding touch screen event, and determining whether the above touch screen event is prohibited according to the gesture task state of the playback interface. Since the above gesture task state can indicate the prohibited range of the touch screen event of the playback interface in real time, the touch screen events prohibited by the current playback interface can be accurately judged through the above gesture task state. Therefore, in the case where it is determined through the above gesture task state that the touch screen event is prohibited, the touch screen event is ignored, and in the case where it is determined through the gesture task state that the touch screen event is not prohibited, the touch screen event is processed, improving the accuracy of the touch screen event and the user experience of the touch screen operation.
[0012] In a second aspect, some embodiments of the present application further provide a display method, which is applied to the display device provided in the first aspect. The method includes:
[0013] In response to a user's touch screen operation, triggering a touch screen event corresponding to the touch screen operation;
[0014] Determining whether the touch screen event is prohibited according to the gesture task state of the playback interface; wherein, the gesture task state is used to indicate in real time the prohibited range of the touch screen event of the playback interface;
[0015] When the gesture task state indicates that the touch screen event is prohibited, ignoring the touch screen event;
[0016] When the gesture task state indicates that the touch screen event is not prohibited, processing the touch screen event.
[0017] In a third aspect, a display device is provided, including units for executing the display method in the second aspect.
[0018] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and when the computer program is run by the display device, the display device is caused to execute the display method in the second aspect.
[0019] In a fifth aspect, a computer program product is provided. The computer program product includes: a computer program, and when the computer program is run by the display device, the display device is caused to execute the display method in the second aspect.
[0020] It can be understood that the beneficial effects of the above second aspect to fifth aspect can be referred to the relevant descriptions in the above first aspect, and will not be elaborated here. Description of the Drawings
[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0022] Figure 1 It is a schematic diagram of the operation scenario between the display device and the control device provided in some embodiments of the present application;
[0023] Figure 2 It is a schematic diagram of the hardware configuration of the display device provided in some embodiments of the present application;
[0024] Figure 3Schematic diagram of the hardware configuration of the control device provided by some embodiments of the present application;
[0025] Figure 4 Schematic diagram of the software configuration of the display device provided by some embodiments of the present application;
[0026] Figure 5 Block diagram of a display device provided by some embodiments of the present application;
[0027] Figure 6 Schematic flowchart of a display method provided by some embodiments of the present application;
[0028] Figure 7 Interaction diagram of the change of the gesture task state on the playback interface when the video application plays audio and video data provided by some embodiments of the present application;
[0029] Figure 8 Interaction diagram of the change of the gesture task state on the playback interface when the audio and video data is paused for playback provided by some embodiments of the present application;
[0030] Figure 9 Interaction schematic diagram of processing touch screen events in the first gesture task state provided by some embodiments of the present application;
[0031] Figure 10 Schematic diagram of the change of the gesture task state recorded by the system management application in different scenarios provided by some embodiments of the present application;
[0032] Figure 11 Schematic diagram of the structure of a display device provided by some embodiments of the present application. Detailed implementation manners
[0033] The embodiments will be described in detail below, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of the systems and methods consistent with some aspects of the present application detailed in the claims.
[0034] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the implementation manners described next, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.
[0035] Among them, in the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may mean A or B. The "and / or" herein is merely a relationship describing associated objects, indicating that there can be three relationships. For example, A and / or B may mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality of" means two or more than two.
[0036] In the present application, terms such as "first", "second", "third", etc. in the description, claims and the above-mentioned drawings are used to distinguish similar or same-kind objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.
[0037] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclude inclusion. For example, a product or device comprising a series of components does not necessarily have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.
[0038] The term "module" refers to any known or later-developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform functions related to the element.
[0039] In the embodiments of the present application, the display device 200 generally refers to a device with the ability to display images and process data. For example, the display device 200 includes but is not limited to in-vehicle screens, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.
[0040] Figure 1 It is a schematic diagram of the operation scenario between the display device and the control device provided for some embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote control, a stylus, a handle, etc.
[0041] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 and the display device 200 can install software applications and achieve connection communication through network communication protocols to achieve the purpose of one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.
[0042] As shown in Figure 1 Figure 1 , the display device 200 also communicates with the server 400 for data communication through various communication methods. The display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.
[0043] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart television, Internet Protocol Television (IPTV), etc.
[0044] Figure 2 For some embodiments of the present application Figure 1 is a block diagram of the hardware configuration of the display device 200 in
[0045] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.
[0046] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
[0047] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.
[0048] In some embodiments, the display 260 can be a liquid crystal display (LCD), an organic light-emitting diode display (OLED), a plasma display panel (PDP), a vacuum fluorescent display (VFD), a field emission display (FED), or a projection display, etc., and can also be a projection device or a projection screen.
[0049] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.
[0050] The communication device 220 can enable the display device 200 to communicate with an external device or server 400 through a wireless or wired connection. Among them, the wired connection can connect the display device 200 with an external device through components such as a data cable and an interface. The wireless connection can connect the display device 200 with an external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with an external device, or can indirectly establish a connection relationship through a gateway, a router, a connection device, etc.
[0051] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and the first interface to the nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.
[0052] In some embodiments, the controller 250 and the tuner demodulator 210 may be located in different split devices, that is, the tuner demodulator 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.
[0053] In some embodiments, the user can input a user command on the graphical user interface (GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).
[0054] In some embodiments, the audio output device 270 may be the built-in speaker of the display device 200, or may be an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.
[0055] In some embodiments, the user input interface 280 can be used to receive instructions from user input.
[0056] Figure 3 For some embodiments of the present application Figure 1 Hardware configuration block diagram of the control device in. As Figure 3 shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.
[0057] The control device 100 is configured to control the display device 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions recognizable and responsive by the display device 200, playing the role of an interaction intermediary between the user and the display device 200.
[0058] In some embodiments, the control device 100 may be an intelligent device. For example: the control device 100 can install various applications for controlling the display device 200 according to user needs.
[0059] In some embodiments, as Figure 1 shown, the mobile terminal 300 or other intelligent electronic devices, after installing the application for controlling the display device 200, can perform functions similar to those of the control device 100.
[0060] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the data processing functions inside and outside.
[0061] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, and other near-field communication modules.
[0062] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a button 144, and other input interfaces.
[0063] In some embodiments, the control device 100 includes at least one of the communication interface 130 and the input / output interface 140. The communication interface 130 is configured in the control device 100. For example: modules such as WiFi, Bluetooth, and NFC can encode the user input instructions through the WiFi protocol, or the Bluetooth protocol, or the NFC protocol, and send them to the display device 200.
[0064] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.
[0065] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.
[0066] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling the hardware and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.
[0067] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform. In the embodiment of the present application, the specific operating platform may be a mobile platform, and the operating system may be a mobile operating system based on the mobile platform, such as Android, iOS, HarmonyOS, or a third-party operating system customized and developed based on the Android system.
[0068] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the system library layer and the kernel layer.
[0069] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with users based on these applications. The application layer can host at least one application, which can include a system setup program or clock program included with the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.
[0070] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.
[0071] like Figure 4As shown in the figure, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc. Among them, the view system can design and implement the interface and interaction of the application. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The activity manager is used to interact with all the activities running in the system; the location manager is used to provide access to the system location service for system services or applications; the package manager is used to retrieve various information related to the application packages currently installed on the device; the notification manager is used to control the display and clearing of notification messages; the window manager is used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
[0072] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and backward of the application.
[0073] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library included in the system runtime layer, such as the C / C++ instruction library or the Android runtime library, to implement the functions that the framework layer needs to achieve.
[0074] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 4 shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers, etc.
[0075] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiment of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system can be in other forms.
[0076] In some related technologies, with the development of display technologies, more and more display devices support touch screen interaction. Users can perform interaction behaviors such as application switching and interface sliding in the display device through touch screen operations with different gestures. However, as the applications of display devices become more and more abundant, the corresponding operation scenarios are constantly expanding. Due to the limitations of gestures, the touch screen operations in each operation scenario may conflict, thus affecting the accuracy of touch screen operations. For example, the edge sliding operation during video application playback may conflict with the global application switching operation, resulting in the video application being switched to another application when the user wants to slide the video content, thus making the touch screen operation inaccurate and affecting the user's touch screen interaction experience.
[0077] To solve the problem of low touch screen operation accuracy, the embodiments of the present application provide a display device and a display method. After triggering a touch screen event corresponding to a touch screen operation in response to the input touch screen operation, the method determines whether the touch screen event is prohibited according to the gesture task state of the playback interface. Since the gesture task state can real-time indicate the prohibited range of touch screen events on the playback interface, the prohibited touch screen events on the current playback interface can be accurately judged through the gesture task state. Therefore, when it is determined through the gesture task state that the touch screen event is prohibited, the touch screen event is ignored; when it is determined through the gesture task state that the touch screen event is not prohibited, the touch screen event is processed, improving the accuracy of touch screen events and the user's touch screen operation experience.
[0078] To facilitate the further understanding of the technical solutions in some embodiments of the present application, the technical solutions of the display device and the display method, as well as how the technical solutions solve the above technical problems, will be described in detail below with reference to some specific embodiments and drawings. The embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments.
[0079] Figure 5 Shows a Figure 1 block diagram of the display device provided by some embodiments of the present application. For the convenience of description, only the parts related to the embodiments of the present application are shown.
[0080] Referring to Figure 5 , the display device includes a display 510 and a controller 520, and the controller 520 is connected to the display 510.
[0081] Among them,
[0082] The display 510 supports the touch screen operation function and is configured to display a playback interface.
[0083] It should be understood that the above playback interface refers to the interface currently displayed on the display screen, which can be an interface for displaying photos, videos, documents, applications, or various display interfaces of the system interface and applications in the display device, etc.
[0084] For example, the above playback interface can be the main interface of the displayed application; it can also be the video playback interface of the video application, the game interface of the game application, etc.
[0085] The controller 520 is configured to:
[0086] In response to the input touch screen operation, trigger the touch screen event corresponding to the touch screen operation;
[0087] Determine whether the touch screen event is prohibited according to the gesture task state of the playback interface; wherein, the gesture task state is used to indicate the prohibited range of the touch screen event of the playback interface in real time;
[0088] When the gesture task state indicates that the touch screen event is prohibited, ignore the touch screen event;
[0089] When the gesture task state indicates that the touch screen event is not prohibited, process the touch screen event.
[0090] Figure 6 The flowchart of a display method provided by some embodiments of the present application is shown as follows and will be described in detail below:
[0091] S610. In response to the input touch screen operation, trigger the touch screen event corresponding to the above touch screen operation.
[0092] It should be understood that the above touch screen operation refers to the operation input by the user through touching the display screen, including but not limited to: click operation, double click operation, long press operation, slide operation, pinch and spread operation, multi-touch operation, edge slide operation, rotation operation, and other custom gesture operations. The above touch screen event refers to the event pre-registered in the display device and corresponding to the touch screen operation, including but not limited to: click event (Click), double click event (Double Tap), long press event (LongPress), touch down event (Touch Down), touch move event (Touch Move), swipe event (Swipe), pinch event (Pinch), spread event (Spread), and other custom touch screen events.
[0093] Specifically, the display device will pre-register the touch screen events that can respond to the touch screen operation. When detecting the user's touch screen operation, the corresponding touch screen event is triggered. Of course, due to the complexity of the touch screen operation, one touch screen operation can correspond to multiple touch screen events, which is specifically set according to the actual situation and will not be limited here.
[0094] S620. Determine whether the touch event is prohibited according to the gesture task state of the above playback interface; wherein, the gesture task state is used to indicate in real time the prohibited range of the touch event of the above playback interface.
[0095] Specifically, when a touch event is detected, judge the detected touch event according to the above gesture task state, so as to determine that the touch event is the first type of touch event that needs to be prohibited, or the second type of touch event that does not need to be prohibited. It should be understood that the above first type of touch event and the second type of touch event are both touch events registered by the display device. Among them, the above first type of touch event refers to a touch event that has been registered but needs to be prohibited on the current playback interface; the above second type of touch event refers to a touch event that has been registered but does not need to be prohibited on the current playback interface.
[0096] In some embodiments, the controller can determine the gesture task state of the playback interface by recording the currently prohibited or allowed touch events of the playback interface. If the currently recorded touch events of the playback interface are prohibited, it means that the prohibited range of the current touch event of the playback interface is the recorded touch events; if the currently recorded touch events of the playback interface are allowed, it means that the prohibited range of the current touch event of the playback interface is the unrecorded touch events.
[0097] It should be understood that the gesture task state of the above playback interface can also be reflected by the event identifier corresponding to the touch event. For example, by the controller setting the first event identifier list, the first event identifier list includes the event identifiers of the touch events that need to be prohibited from processing. If the event identifier of the detected touch event matches the event identifier in the first event identifier list successfully, it is determined that the detected touch event is the first type of touch event, otherwise, it is the second type of touch event; or, the second event identifier list can also be set, the second event identifier list includes the event identifiers of the touch events that are allowed to be processed. If the event identifier of the detected touch event matches the event identifier in the second event identifier list successfully, it is determined that the detected touch event is the second type of touch event, otherwise, it is the first type of touch event.
[0098] In addition, the gesture task state of the above playback interface can also be reflected by combining the status identifier corresponding to the touch event. Among them, the status identifier being True means not being prohibited, and the status identifier being False means being prohibited. For example, if the gesture task state includes: "Touch event 1: True", "Touch event 2: True", "Touch event 3: True", "Touch event 4: False", then touch event 1, touch event 2, and touch event 3 are not prohibited, and touch event 4 is prohibited.
[0099] It should be noted that the prohibited scope of the above touch screen events can be set according to the actual situation and will not be limited here.
[0100] In the embodiment of the present application, whether the monitored touch screen event is prohibited can be accurately determined through the gesture task state of the playback interface, so as to avoid touch screen event conflicts.
[0101] S630. When the above gesture task state indicates that the above touch screen event is prohibited, ignore the above touch screen event.
[0102] It should be understood that when the gesture task state indicates that the above touch screen event is prohibited, it means that the touch screen event is a first type of touch screen event, that is, it is prohibited on the current playback interface. At this time, in order to avoid touch screen event conflicts, the above touch screen event can be ignored.
[0103] S640. When the above gesture task state indicates that the above touch screen event is not prohibited, process the above touch screen event.
[0104] It should be understood that when the gesture task state indicates that the above touch screen event is not prohibited, it means that the touch screen event is a second type of touch screen event, that is, it is not prohibited on the current playback interface. At this time, the above touch screen event can be continued to be processed.
[0105] In the embodiment of the present application, by responding to the input touch screen operation to trigger the corresponding touch screen event, and determining whether the above touch screen event is prohibited according to the gesture task state of the playback interface. Since the above gesture task state can indicate the prohibited scope of the touch screen event on the playback interface in real time, the touch screen events prohibited on the current playback interface can be accurately judged through the above gesture task state. Therefore, when it is determined through the above gesture task state that the touch screen event is prohibited, the touch screen event is ignored. When it is determined through the gesture task state that the touch screen event is not prohibited, the touch screen event is processed, improving the accuracy of the touch screen event and the user experience of the touch screen operation.
[0106] In another optional embodiment of the present application, when the above playback interface is the display interface of a video application, before the above controller executes to respond to the user's touch screen operation and trigger the touch screen event corresponding to the above touch screen operation, it is further configured to:
[0107] When playing audio and video data on the playback interface of the above video application, record the current gesture task state as the first gesture task state, where the above first gesture task state is used to indicate the prohibition of the multi-gesture application switching task on the above playback interface.
[0108] It should be understood that the above audio-visual data can be data obtained by the video application from the server based on the user's operation, or data downloaded to the local by the video application. Among them, the above server can be a cloud server, a remote server, etc. The above multi-gesture application switching task refers to the function of realizing application switching through touch screen operations corresponding to touch screen events.
[0109] Specifically, when playing audio-visual data on the playback interface of the above video application, the video application can send a first request for shielding the touch screen event corresponding to the multi-gesture application switching task. After receiving the above first request, the controller can record the current gesture task state as the first gesture task state according to the touch screen event corresponding to the shielded multi-gesture application switching task, that is, shield the touch screen event corresponding to the multi-gesture application switching task, so as to prohibit the multi-gesture application switching task on the current playback interface.
[0110] For example, after receiving the first request, the controller can use the touch screen event corresponding to the multi-gesture application switching task as the prohibited touch screen event; or add the event identifier of the touch screen event corresponding to the multi-gesture application switching task to the first event identifier list; or delete the event identifier of the touch screen event corresponding to the multi-gesture application switching task from the second event identifier list. Of course, the status identifier of the touch screen event corresponding to the multi-gesture application switching task can also be adjusted to "False".
[0111] Among them, the above first request can include at least one of the following parameters: request identifier, touch screen event to be shielded, event identifier, etc.
[0112] It should be noted that when determining that the current gesture task state is the first gesture task state, the touch screen operation triggered at this time can determine whether the touch screen event is prohibited according to the first gesture task state. The specific determination process can refer to the process of determining according to the gesture task state in the above embodiments, and will not be elaborated here.
[0113] To better illustrate the change of the gesture task state on the playback interface when the video application plays audio-visual data, refer to Figure 7 As shown, it includes:
[0114] Step a1: The video application plays audio-visual data on the playback interface; for example, the user selects a movie by moving the focus in the video application, and the video application plays the corresponding audio-visual data; or the video application can play the audio-visual data on the playback interface according to the user's resume play operation.
[0115] Step a2: Send a first request; the above first request is used to notify the controller to prohibit the multi-gesture application switching task on the playback interface, that is, to shield the touch screen event corresponding to the multi-gesture application switching task.
[0116] Step a3: Record the current gesture task status as the first gesture task status, and block the touch screen events corresponding to the multi-gesture application switching task;
[0117] Step a4: In response to the user's touch screen operation on the playback interface, trigger the corresponding touch screen event;
[0118] Step a5: Determine whether the triggered touch screen event is prohibited according to the first gesture task status.
[0119] In the embodiment of the present application, when playing audio and video data on the playback interface of the video application, it indicates that the current operation scenario is the video application. At this time, if the touch screen operation causes the current operation scenario to exit (i.e., switch to other applications), it will affect the user experience. Therefore, the video application sends a first request to notify the controller to block the touch screen events corresponding to the multi-gesture application switching task, so that the current playback interface prohibits the multi-gesture application switching task, thereby avoiding application switching caused by touch screen operations during the playback of audio and video data and improving the user experience.
[0120] In another optional embodiment of the present application, the above controller is further configured to:
[0121] In response to the pause playback operation of the above audio and video data, record the current gesture task status as the second gesture task status, where the above second gesture task status is used to indicate that the multi-gesture application switching task of the playback interface is allowed.
[0122] Specifically, when the user performs a pause playback operation on the audio and video data played on the playback interface, the video application can send a second request for allowing the touch screen events corresponding to the multi-gesture application switching task. After receiving the above second request, the controller records the current gesture task status as the second gesture task status according to the touch screen events corresponding to the allowed multi-gesture application switching task, that is, the current playback interface can allow the touch screen events corresponding to the multi-gesture application switching task, thereby allowing the multi-gesture application switching task on the current playback interface.
[0123] For example, after receiving the second request, the controller can use the touch screen events corresponding to the multi-gesture application switching task as the allowed touch screen events; or delete the event identifier of the touch screen events corresponding to the multi-gesture application switching task from the first event identifier list; or add the event identifier of the touch screen events corresponding to the multi-gesture application switching task to the second event identifier list. Of course, the status identifier of the touch screen events corresponding to the multi-gesture application switching task can also be adjusted to "True".
[0124] Wherein, the above second request may include at least one of the following parameters: request identifier, touch screen events to be allowed, event identifier, etc.
[0125] It should be noted that when determining that the current gesture task state is the second gesture task state, the triggered touch screen operation can determine whether the touch screen event is prohibited according to the second gesture task state. The specific determination process can refer to the process of determining according to the gesture task state in the above embodiments and will not be elaborated here.
[0126] To better illustrate the change of the gesture task state of the playback interface when the audio-visual data is paused, refer to Figure 8 as shown, including:
[0127] Step b1: The video application switches the audio-visual data played on the playback interface to the paused state according to the user's pause playback operation;
[0128] Step b2: Send a second request; the above first request is used to notify the controller to allow the multi-gesture application on the playback interface to switch tasks, that is, not to block the touch screen events corresponding to the multi-gesture application switching tasks;
[0129] Step b3: Record the current gesture task state as the second gesture task state, and allow the touch screen events corresponding to the multi-gesture application switching tasks;
[0130] Step b4: In response to the user's touch screen operation on the playback interface, trigger the corresponding touch screen event;
[0131] Step b5: Determine whether the triggered touch screen event is prohibited according to the second gesture task state.
[0132] In the embodiment of the present application, when the audio-visual data is paused, it indicates that although the current operation scenario is a video application, the operation scenario may change (that is, the application may change). At this time, if the touch screen operation causes the current operation scenario to not exit (that is, unable to switch to other applications), it will affect the user experience. Therefore, the video application sends a second request to notify the controller to allow the touch screen events corresponding to the multi-gesture application switching tasks, so that the current playback interface allows the multi-gesture application to switch tasks, so that the application can be switched through the touch screen operation when the audio-visual data is paused, improving the user experience.
[0133] In another optional embodiment of the present application, the above controller is further configured to:
[0134] In the case where the audio-visual data playback in the above playback interface is abnormal or completed, record the current gesture task state as the second gesture task state, where the second gesture task state is used to indicate that the multi-gesture application switching task on the above playback interface is allowed.
[0135] It should be understood that abnormal playback of audio - video data refers to the situation where audio - video data cannot be played normally, including but not limited to: unable to play (such as black screen, unresponsive, etc.), playback stuttering, crashing, decoding failure, unstable network, etc.
[0136] Specifically, when the audio - video data playback in the playback interface is abnormal or the playback is completed, the video application can also send a second request for allowing touch - screen events corresponding to multi - gesture application switching tasks. After receiving the above - mentioned second request, the controller records the current gesture task state as the second gesture task state, that is, the current playback interface allows touch - screen events corresponding to multi - gesture application switching tasks, thereby allowing multi - gesture application switching tasks on the current playback interface.
[0137] In the embodiments of the present application, when the audio - video data playback is abnormal or the playback is completed, although the current operation scenario is a video application, the user may have a need to switch applications, that is, the operation scenario may change. At this time, if the touch - screen operation causes the current operation scenario not to exit (that is, unable to switch to other applications), it will affect the user experience. Therefore, the video application sends a second request to notify the controller to allow touch - screen events corresponding to multi - gesture application switching tasks, so that the current playback interface allows multi - gesture application switching tasks, and thus application switching can be performed through touch - screen operations when the audio - video data playback is abnormal or the playback is completed, improving the user experience.
[0138] In some embodiments, the above - mentioned first gesture task state includes a shielding edge state, and the shielding edge state is used to indicate that application switching is prohibited through touch - screen operations in the touch - edge area of the display screen.
[0139] It should be understood that during the use of the video application, the user can perform touch - screen operations on the edge area. When sliding the edge area of the screen, in order to avoid accidentally triggering application switching, the gesture task state can be recorded as the shielding edge state, thereby prohibiting the current playback interface from switching to other applications. Among them, the above - mentioned touch - edge area can include the bottom edge area, the upper edge area, etc.
[0140] For example, the user adjusts the audio - video playback by sliding the progress bar at the bottom. However, since the display width of the progress bar may be small and when it is close to the bottom area, the user's touch - screen operation on the bottom edge area may be accidentally triggered as application switching. The above - mentioned shielding edge state can be used to indicate that application switching is prohibited through touch - screen operations in the bottom edge area of the display screen.
[0141] Specifically, when playing audio-visual data on the playback interface of a video application, the video application may send a request to block touch screen operations in the bottom edge area. After receiving the above request, the controller may record the current gesture task state as the edge-blocking state, that is, block the touch screen events corresponding to the multi-gesture application switching task, so as to prohibit the current playback interface from switching applications by swiping the bottom edge area.
[0142] Optionally, after receiving the request to block touch screen operations in the bottom edge area, when recording the gesture task state as the edge-blocking state, the controller may use the touch screen events corresponding to the multi-gesture application switching task as prohibited touch screen events; or add the event identifier of the touch screen events corresponding to the multi-gesture application switching task to the first event identifier list; or delete the event identifier of the touch screen events corresponding to the multi-gesture application switching task from the second event identifier list. Of course, the status identifier of the touch screen events corresponding to the multi-gesture application switching task may also be adjusted to "False".
[0143] When the first gesture task state includes the edge-blocking state, when the above controller executes to ignore the touch screen event when the gesture task state indicates that the touch screen event is prohibited, it is configured as:
[0144] When it is determined that the gesture task state is the edge-blocking state and the touch screen event is a multi-gesture application switching task performed by a touch screen operation on the touch edge area of the display screen, the touch screen event is ignored.
[0145] It should be understood that when the gesture task state is the edge-blocking state, it means that the current playback interface does not allow application switching by touch screen operations in the bottom edge area. If the monitored touch screen event is used for a multi-gesture application switching task by a touch screen operation on the touch edge area of the display screen, the monitored touch screen event is directly ignored, so as to avoid application switching by touch screen operations.
[0146] It should also be understood that the second gesture task state includes a non-edge-blocking state, that is, a state indicating that application switching is allowed by touch screen operations on the touch edge area of the display screen. In any of the cases where the audio-visual data in the playback interface is paused, has a playback anomaly, or has completed playback, the video application may also send a request to allow the touch screen events corresponding to the multi-gesture application switching task. After receiving the above request, the controller records the current gesture task state as the non-edge-blocking state, that is, the current playback interface allows the touch screen events corresponding to the multi-gesture application switching task, so as to allow the current playback interface to perform the multi-gesture application switching task. It should be noted that when the controller records the gesture task state as the non-edge-blocking state, it may refer to the process of the above embodiments and will not be elaborated here.
[0147] In some embodiments, the above-mentioned controller is further configured with a system management application for managing the switching of each application. When the controller processes the touch screen event in the case where the gesture task state indicates that the touch screen event is not prohibited, it is configured as follows:
[0148] When it is determined that the gesture task state is the first gesture task state and the touch screen event is not used for the multi-gesture application switching task, the above-mentioned video application or the system management application is called to process the touch screen event.
[0149] It should be understood that in an operating system such as the Android system, the above-mentioned system management application can be a home screen application or a launcher application. For example, the above-mentioned system management application can be a Launcher application.
[0150] Generally, as a system-level application in the Android system, the Launcher application is the entry for users to interact with the Android device. It is used to manage the device's home screen, application icons, widgets, and the user interface for interacting with the device. Users can start applications, manage the desktop layout, add widgets, switch applications, etc. through the touch screen events registered by the Launcher application.
[0151] Specifically, the gesture task state can be recorded through the above-mentioned system management application. When the gesture task state recorded by the system management application is the first gesture task state, the multi-gesture application switching task is prohibited on the playback interface at this time. If the touch screen event monitored by the event listening platform in the controller is determined not to be used for the multi-gesture application switching task according to the registration situation, the video application or the system management application registered corresponding to the touch screen event can be called for processing according to the registration situation of the touch screen event, so as to complete the interaction between the user and the display device through the touch screen event.
[0152] Refer to Figure 9 As shown, it is an interaction schematic diagram for processing touch screen events in the first gesture task state, including:
[0153] Step c1: The video application plays audio and video data on the playback interface;
[0154] Step c2: Send a request to block the multi-gesture application switching task through the touch screen operation in the bottom edge area, and notify the system management application to prohibit the multi-gesture application switching task;
[0155] Step c3: The system management application records the current gesture task state as the first gesture task state and prohibits the multi-gesture application switching task;
[0156] Step c4: In response to the user's touch screen operation on the playback interface, trigger the corresponding touch screen event;
[0157] Step c5: The event monitoring platform determines whether the monitored touch screen event is used for the multi-gesture application switching task;
[0158] Step c6: When the touch screen event is not used for the multi-gesture application switching task, the touch screen event is called back to the video application or the system management application for processing according to the registration situation.
[0159] In the embodiment of the present application, in the first gesture task state, for the touch screen event that is not used for the multi-gesture application switching task, that is, the touch screen event that is not used for application switching, by calling the corresponding video application or system management application for processing, other touch screen events that are not used for application switching can be continuously processed when the application switching is prohibited on the playback interface, improving the accuracy of touch screen event processing.
[0160] In some embodiments, in order to better illustrate the change of the gesture task state recorded by the system management application, the following is combined with Figure 10 for illustration. Referring to Figure 10 shown, the change of the gesture task state recorded by the system management application in different scenarios is included:
[0161] Scenario 1: Audio and video data is paused
[0162] Step d1: The video application plays audio and video data;
[0163] Step d2: The video application notifies the system management application to prohibit the multi-gesture application switching task;
[0164] Step d3: The system management application records the first gesture task state.
[0165] Scenario 2: Audio and video data is paused
[0166] Step d4: The video application pauses playing audio and video data;
[0167] Step d5: The video application notifies the system management application to allow the multi-gesture application switching task;
[0168] Step d6: The system management application records the second gesture task state.
[0169] Scenario 3: Abnormal playback of audio and video data
[0170] Step d7: The audio and video data in the video application has abnormal playback;
[0171] Step d8: The video application notifies the system management application to allow the multi-gesture application switching task;
[0172] Step d9: The system management application records the second gesture task state.
[0173] Scenario 4: The audio and video data playback is completed
[0174] Step d10: The audio and video data in the video application is played to completion;
[0175] Step d11: The video application notifies the system management application to allow multi-gesture application switching tasks;
[0176] Step d12: The system management application records the second gesture task status.
[0177] In the embodiments of the present application, by correspondingly adjusting the gesture task status in different playback scenarios of the video application, the flexibility and accuracy of recording the gesture task status can be improved, and then whether the touch screen event is prohibited can be determined according to the recorded gesture task status, improving the user experience.
[0178] In some embodiments, when the controller is further configured with a system management application for managing the switching of each application, when the above-mentioned controller executes and processes the above-mentioned touch screen event when the above-mentioned gesture task status indicates that the above-mentioned touch screen event is not prohibited, it is configured as:
[0179] When the above-mentioned gesture task status is the above-mentioned second gesture task status, and the above-mentioned touch screen event is used for multi-gesture application switching, call the above-mentioned system management application to process the above-mentioned touch screen event, so that the above-mentioned system management application switches the above-mentioned video application to the target application through the above-mentioned touch screen event, where the above-mentioned target application is the application used last time.
[0180] It should be understood that when the gesture task status recorded by the system management application is the second gesture task status, at this time, the playback interface allows multi-gesture application switching tasks. If the touch screen event monitored by the event monitoring platform in the controller is determined to be used for multi-gesture application switching tasks according to the registration situation, the system management application can be called for processing, so that the video application is switched to the most recently used application through the system management application.
[0181] In some embodiments, the above-mentioned audio and video data includes a follow-along video, the follow-along video includes multiple follow-along sub-videos, where one of the above-mentioned follow-along sub-videos corresponds to a group of fitness actions, and when the above-mentioned controller executes and calls the above-mentioned video application or the above-mentioned system management application for processing, it is configured as:
[0182] When it is determined through the above-mentioned video application or the above-mentioned system management application that the above-mentioned touch screen event is used for a video sliding task, adjust the progress of the above-mentioned follow-along sub-video through the above-mentioned touch screen event.
[0183] It should be understood that since the multiple follow - up sub - videos in the follow - up video are relatively independent of each other, and the progress of each follow - up sub - video is also relatively independent. Therefore, when it is determined through a video application or a system management application that a touch - screen event is used for a video sliding task, sliding parameters can be determined according to the touch - screen event, and whether to switch the current follow - up sub - video can be determined according to the sliding parameters. The above - mentioned sliding parameters include: parameters such as sliding distance, sliding time, and sliding posture.
[0184] For example, when it is determined according to the touch - screen event that the sliding distance is large, switch the current follow - up sub - video to another follow - up sub - video, otherwise do not switch; when it is determined according to the touch - screen event that the sliding time is long, switch the current follow - up sub - video to another follow - up sub - video, otherwise do not switch; when it is determined according to the touch - screen event that the sliding posture is a preset switching posture, switch the current follow - up sub - video to another follow - up sub - video, otherwise do not switch.
[0185] In the embodiments of the present application, in the follow - up scenario, the progress of the follow - up sub - video can be adjusted separately according to the sliding parameters corresponding to the touch - screen event, which can improve the accuracy of fitness action switching and enhance the user experience.
[0186] In some embodiments, when the above - mentioned controller executes to adjust the progress of the above - mentioned follow - up sub - video through the above - mentioned touch - screen event, it is configured to:
[0187] Calculate the sliding position difference corresponding to the touch - screen operation through the above - mentioned touch - screen event;
[0188] In the case where the above - mentioned sliding position difference is greater than a preset first distance threshold, switch the current follow - up sub - video to the next follow - up sub - video;
[0189] In the case where the above - mentioned sliding position difference is less than a preset second distance threshold, switch the current follow - up sub - video to the previous follow - up sub - video;
[0190] In the case where the above - mentioned sliding position difference is greater than or equal to the preset second distance threshold and less than or equal to the preset first distance threshold, adjust the progress of the current follow - up sub - video according to the above - mentioned sliding position difference.
[0191] It should be understood that the above - mentioned sliding position difference can reflect the sliding distance during the user's sliding operation. The above - mentioned first distance threshold can be a positive number for forward adjustment of the follow - up sub - video, and the above - mentioned second distance threshold can be a negative number for reverse adjustment of the follow - up sub - video. The absolute values of the above - mentioned first distance threshold and the second distance threshold can be the same or different, and no limitation is made here.
[0192] Specifically, taking the touch screen events of onTouchDown() and onTouchUp() as examples, when the video application registers the above touch screen events, when the video application receives the onTouchDown() event, it will determine the corresponding touch screen position point raw_x and mark the position as raw_x_start; when receiving the onTouchUp() event, it will mark the position as raw_x_end and calculate the sliding position difference move_diff, where move_diff = raw_x_end - raw_x_start; assuming that the absolute values of the first distance threshold and the second distance threshold are the same, the first distance threshold is threshold, and the second distance threshold is -threshold; when move_diff > threshold, switch the currently played follow-up sub-video to the next follow-up sub-video; when move_diff < -threshold, switch the currently played follow-up sub-video to the previous follow-up sub-video; when -threshold ≤ move_diff ≤ threshold, adjust the progress of the currently played follow-up sub-video according to the size of move_diff.
[0193] In the embodiments of the present application, through the sliding position difference, fast forward or rewind between follow-up sub-videos can be realized in the follow-up scenario, and the progress of the currently played follow-up sub-video can be adjusted, improving the user experience when adjusting the follow-up video progress.
[0194] Corresponding to the display method described in the above embodiments, Figure 11 The block diagram of the display device provided by the embodiments of the present application is shown. For the sake of convenience of description, only the parts related to the embodiments of the present application are shown.
[0195] Refer to Figure 11 , the device includes: a trigger module 1110, a judgment module 1120, and a processing module 1130. Among them,
[0196] The trigger module 1110 is used to trigger the touch screen event corresponding to the touch screen operation in response to the user's touch screen operation.
[0197] The judgment module 1120 is used to determine whether the touch screen event is prohibited according to the gesture task state of the playback interface; wherein, the gesture task state is used to indicate the prohibited range of the touch screen event of the playback interface in real time.
[0198] The processing module 1130 is used to ignore the touch screen event when the gesture task state indicates that the touch screen event is prohibited; and process the touch screen event when the gesture task state indicates that the touch screen event is not prohibited.
[0199] It should be noted that for the information interaction, execution process, etc. between the above-mentioned devices / units, since they are based on the same concept as the method embodiments of this application, for their specific functions and the technical effects brought about, reference can be specifically made to the method embodiment section, and details will not be repeated here.
[0200] An embodiment of this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a controller, the steps in each of the above method embodiments can be implemented.
[0201] An embodiment of this application provides a computer program product. When the computer program product runs on a display device, it enables the controller to execute the steps in the display method described in each of the above embodiments.
[0202] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, to implement all or part of the processes in the above embodiment methods of this application, a computer program can be used to instruct relevant hardware to complete. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps in each of the above method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file or some intermediate form, etc. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the photographing device / electronic device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memor y), electrical carrier signal, telecommunication signal, and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disc, etc. In some jurisdictions, according to legislation and patent practice, the computer-readable medium cannot be an electrical carrier signal and a telecommunication signal.
[0203] In the above embodiments, the descriptions of each embodiment have their own focuses. For the parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0204] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed in this article can be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.
[0205] In the embodiments provided in the present application, it should be understood that the disclosed device / network device and method can be implemented in other ways. For example, the device / network device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.
[0206] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0207] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A display device, characterized in that: Including: A display, supporting touch screen operation function and configured to display a playback interface; A controller, configured to: In response to an input touch screen operation, trigger a touch screen event corresponding to the touch screen operation; Determine whether the touch screen event is prohibited according to the gesture task state of the playback interface; wherein, the gesture task state is used to indicate the prohibited range of the touch screen event of the playback interface in real time; When the gesture task state indicates that the touch screen event is prohibited, ignore the touch screen event; When the gesture task state indicates that the touch screen event is not prohibited, process the touch screen event.
2. The display device according to claim 1, wherein The playback interface is a display interface of a video application. Before the controller executes in response to a user's touch screen operation and triggers a touch screen event corresponding to the touch screen operation, it is also configured to: When playing audio and video data on the playback interface of the video application, record the current gesture task state as the first gesture task state, wherein the first gesture task state is used to indicate prohibiting the multi-gesture application switching task of the playback interface.
3. The display device according to claim 2, wherein, The controller is also configured to: In response to a pause playback operation on the audio and video data, record the current gesture task state as the second gesture task state, wherein the second gesture task state is used to indicate allowing the multi-gesture application switching task of the playback interface.
4. The display device according to claim 2, characterized in that, The controller is also configured to: When the audio and video data playback on the playback interface is abnormal or completed, record the current gesture task state as the second gesture task state, wherein the second gesture task state is used to indicate allowing the multi-gesture application switching task of the playback interface.
5. The display device according to any one of claims 2-4, characterized in that, The first gesture task state includes a shielding edge state, and the shielding edge state is used to indicate prohibiting application switching through touch screen operations in the touch edge area of the display screen. When the controller executes and ignores the touch screen event when the gesture task state indicates that the touch screen event is prohibited, it is configured to: When determining that the gesture task state is the shielding edge state and the touch screen event is a multi-gesture application switching task through a touch screen operation in the touch edge area of the display screen, ignore the touch screen event.
6. The display device according to claim 3 or 4, characterized in that, The controller is also configured with a system management application for managing each application switching. When the controller executes and processes the touch screen event when the gesture task state indicates that the touch screen event is not prohibited, it is configured to: When determining that the gesture task state is the first gesture task state and the touch screen event is not used for a multi-gesture application switching task, call the video application or the system management application to process the touch screen event.
7. The display device according to claim 3 or 4, characterized in that, The controller is also configured with a system management application for managing each application switching. When the controller executes and processes the touch screen event when the gesture task state indicates that the touch screen event is not prohibited, it is configured to: When the gesture task state is the second gesture task state and the touch screen event is used to switch multiple gesture applications, the system management application is called to process the touch screen event so that the system management application switches the video application to the target application through the touch screen event, wherein the target application is the application used last time.
8. The display device according to claim 6, wherein, The audio and video data includes a follow-up training video, which includes multiple follow-up training sub-videos, wherein each follow-up training sub-video corresponds to a set of fitness movements. When the controller executes the call to the video application or the system management application, it is configured to: In a case where it is determined by the video application or the system management application that the touch screen event is used to perform a video sliding task, the progress of the practice sub-video is adjusted through the touch screen event.
9. The display device according to claim 8, characterized in that When the controller adjusts the progress of the practice sub-video through the touch screen event, the controller is configured to: Calculating the sliding position difference corresponding to the touch screen operation through the touch screen event; When the sliding position difference is greater than a preset first distance threshold, switching the current follow-up sub-video to the next follow-up sub-video; When the sliding position difference is less than a preset second distance threshold, switching the current follow-up sub-video to the previous follow-up sub-video; When the sliding position difference is greater than or equal to a preset second distance threshold and less than or equal to a preset first distance threshold, the progress of the current practice sub-video is adjusted according to the sliding position difference.
10. A display method, characterized in that, The display method includes: In response to a user's touch screen operation, triggering a touch screen event corresponding to the touch screen operation; Determining whether the touch screen event is prohibited according to the gesture task status of the playback interface; wherein the gesture task status is used to indicate the prohibited range of the touch screen event of the playback interface in real time; When the gesture task state indicates that the touch screen event is prohibited, ignoring the touch screen event; When the gesture task status indicates that the touch screen event is not prohibited, the touch screen event is processed.