Display device, control device and interaction method for simulating touch gesture

Abstract

The invention provides a display device, a control device and an interaction method for simulating a touch gesture, and the method comprises the steps: analyzing the key information of an interaction instruction in response to the interaction instruction generated by the control device when a plurality of keys connected and arranged by the control device are clicked, and displaying the key information of the interaction instruction in an interface scene of a user interface, and obtaining executable options used for representing operations corresponding to the touch actions, and matching a target execution option in the executable options according to the key track information to execute interaction operations corresponding to the target interaction option. According to the embodiment, the touch gesture is simulated through the track information of the continuously arranged keys in the control equipment, and the problem that a traditional remote controller cannot achieve complex gesture touch operation is solved. The continuous clicking of the physical key is mapped into the track direction, the operation habit of a traditional remote controller is reserved, the effect similar to gesture sliding touch is achieved, and the convenience of achieving touch operation through the key is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device, a control device, and an interaction method for simulating touch gestures. Background Art

[0002] Display devices can have multiple built-in applications to perform various functions, such as web browsing, music playback, and video playback. Users can input control commands to the display device to control the display device to perform corresponding functions.

[0003] With the popularity of touch functions, users can use gestures to click or slide on the display device screen to generate corresponding control instructions to control the display device to perform corresponding operations, thereby improving the simplicity of generating control instructions. However, users who are not familiar with touch functions are more accustomed to operating display devices through control devices such as remote controls.

[0004] The control device realizes interactive control with the display device through buttons. Since the number of buttons set on the control device is limited, a single button cannot correspond to all the functions of the display device. This requires pressing multiple buttons at the same time to trigger the functions of the display device. It cannot achieve the same flexibility as gesture touch and is not conducive to user operation. Summary of the Invention

[0005] The present application provides a display device, a control device, and an interactive method for simulating touch gestures to solve the problem that a display device cannot be interactively controlled by simulating touch gestures by a control device.

[0006] In a first aspect, some embodiments of the present application provide a display device comprising a display, a communication device, and a controller. The display is configured to display a user interface; the communication device is configured to establish a communication connection with a control device; and the controller is configured to:

[0007] In response to an interaction instruction sent by the control device through the communication connection, parsing key trajectory information of the interaction instruction, wherein the interaction instruction is a control instruction triggered when at least two keys arranged consecutively in the control device are clicked in sequence;

[0008] In the interface scene of the user interface, obtaining executable options, wherein the executable options are options for representing operations corresponding to each touch action in the interface scene;

[0009] Matching a target execution option in the executable options according to the key trajectory information;

[0010] When a target execution option is matched, an interactive operation corresponding to the target execution option is performed to display a target user interface after performing the interactive operation.

[0011] The above technical solution has the following beneficial effects or advantages: by simulating touch gestures through the trajectory information of continuously arranged buttons in the control device, the problem of traditional remote controls being unable to perform complex gesture operations is solved. After the controller analyzes the button trajectory, it dynamically matches the target execution option among the executable options in the interface scene, allowing users to complete gesture interaction without relying on a touch screen or image acquisition device. By mapping the continuous clicks of the physical buttons in the control device to the trajectory direction, the operating habits of the control device are retained, and the effect of sliding touch is achieved, which significantly reduces hardware costs and improves the convenience of touch operations for user groups who are not familiar with touch operations.

[0012] In some embodiments, the controller performs the step of matching a target execution option in the executable options according to the key trajectory information, and is specifically configured to:

[0013] When the key trace information corresponds to an execution option, reading the key trace direction of the key trace information;

[0014] generating pre-execution options according to the key trajectory direction;

[0015] The executable option corresponding to the pre-execution option is marked as a target execution option.

[0016] The above technical solution has the following beneficial effects or advantages: By mapping the key trajectory direction to pre-executed options, it improves operational certainty in single-choice scenarios. The controller directly generates pre-executed options based on the trajectory direction, converting continuous clicks of physical buttons into directional movement interactions. Compared to the traditional remote control's key-by-key movement method, this solution simulates a single-directional sliding touch operation through trajectory direction recognition, improving the efficiency of controlling interactive operations on the device.

[0017] In some embodiments, when the key trace information corresponds to two different execution options, the controller performs the step of matching a target execution option among the executable options according to the key trace information, which is specifically configured as follows:

[0018] Read the key trajectory direction and the triggering interval duration of the key from the key trajectory information;

[0019] When the trigger interval duration is less than or equal to a first duration threshold, generating a first pre-execution option according to the key trajectory direction;

[0020] The executable option corresponding to the first pre-execution option is marked as a first target execution option.

[0021] The above technical solution has the following beneficial effects or advantages: By introducing the trigger interval length as a judgment dimension, it is easier to distinguish between fast and slow continuous key presses. When the interval is less than a first threshold, the display device recognizes the continuous key presses as a single trajectory instruction, using a pattern gesture touch operation to prevent command ambiguity caused by accidental touches. For example, when a user quickly presses adjacent direction keys, it reduces the display device's error recognition of key click events as discrete operations, thereby improving operational efficiency and fault tolerance.

[0022] In some embodiments, when the trigger interval duration is greater than a first duration threshold and less than or equal to a second duration threshold, the controller is further configured to:

[0023] generating a second pre-execution option according to the key trajectory direction, wherein the second pre-execution option is different from the first pre-execution option;

[0024] The executable option corresponding to the second pre-execution option is marked as a second target execution option.

[0025] The above technical solution has the following beneficial effects or advantages: differentiated key recognition is achieved through hierarchical processing of the second duration threshold. When the key interval is between the two thresholds, the display device generates a second pre-execution option to distinguish it from the pre-execution option triggered by quickly clicking the key. For example, in a video playback scenario, a short right swipe can fast forward, and a medium to long right swipe can trigger the playlist to be called out. Avoiding the inability to realize multiple functions of the display device in the current interface scenario due to the single key gesture mapping, and improving the diversity of key mapping gestures.

[0026] In some embodiments, when the trigger interval duration is greater than a second duration threshold, the controller is further configured to:

[0027] generating a third pre-execution option based on a single keystroke;

[0028] marking the executable option corresponding to the third pre-execution option as a third target execution option;

[0029] According to the direction of the key trajectory, a key click sequence of each key is obtained;

[0030] According to the button clicking sequence, the interactive operations corresponding to the third target execution options of the buttons are executed in sequence.

[0031] The above technical solution has the following beneficial effects or advantages: It discretizes operations with long intervals, responding to interactive key operations sequentially according to the order in which they were clicked, improving the accuracy of complex operation sequences. When the interval exceeds a second threshold, the display device executes the sequence of independent key clicks, avoiding misinterpreting non-consecutive operations as combined key clicks and falsely triggering touch gesture simulation. This embodiment retains the precise control characteristics of traditional remote controls while being compatible with combined gesture functions. It improves the accuracy of key triggering and reduces interface anomalies caused by key operations.

[0032] In some embodiments, when no target execution option is matched, the controller is further configured to:

[0033] Generate interaction failure information according to the pre-execution option, wherein the interaction failure information is used to indicate that the interaction operation corresponding to the pre-execution option cannot be performed in the interface scenario of the user interface;

[0034] The display is controlled to display the interaction failure information on the user interface.

[0035] The above technical solution has the following beneficial effects or advantages: It solves user experience issues in invalid operation scenarios through active feedback of interaction failure information. When the pre-executed option does not match the current scenario, the display device will immediately display the interaction failure information, preventing the user from repeating the operation due to unresponsiveness. In this embodiment, the display device detects the interface scene, dynamically detects the changing state of the executable option set based on the changes in the interface scene, and helps the user quickly understand the operation boundaries by providing feedback on the interaction failure information, thereby improving the flexibility of interactive operations.

[0036] In some embodiments, the controller performs the step of matching a target execution option among the executable options according to the key trajectory information, and is further configured to:

[0037] Read the key trajectory direction of the key trajectory information and the number of keys of the key;

[0038] When the number of keys reaches a first key threshold, generating a first pre-execution option according to the key trajectory direction and the number of keys;

[0039] The executable option corresponding to the first pre-execution option is marked as a first target execution option.

[0040] The above technical solution has the following beneficial effects or advantages: Through dual parameter control of the number of keys and the direction of the key trajectory, the accuracy of determining the target execution option is improved. The setting of the first key threshold allows for the execution of a variety of different interactive operations based on the number of keys, such as two-key combinations or multi-key combinations, ensuring high recognition rates for simple operations. Furthermore, by deriving a variety of operation quantity and operation combinations, while ensuring simple key operations, more functional key simulation gestures can be triggered, thereby improving the convenience of key operations for users.

[0041] In some embodiments, the controller is further configured to:

[0042] When the number of keys is greater than a first key threshold and less than or equal to a second key threshold, generating a second pre-execution option according to the key trajectory direction and the number of keys;

[0043] The executable option corresponding to the second pre-execution option is marked as a second target execution option.

[0044] The above technical solution has the following beneficial effects or advantages: the combination operation of keys is judged by the first key threshold. When the number of keys exceeds the basic threshold, such as a combination of three or more keys, the display device enables the second pre-execution option in the current interface scenario. The display device increases the number of physical keys clicked, which is different from the interactive operation triggered by a small number of keys. It reduces the cost of peripherals while maintaining operation accuracy.

[0045] In a second aspect, some embodiments of the present application provide a control device, comprising a communication interface, a button, and a controller, wherein the communication interface is configured to establish a communication connection with a display device; the button is configured to trigger a control instruction when clicked; and the controller is configured to:

[0046] When at least two consecutively arranged keys are clicked, generating an interaction instruction according to key trajectory information of the keys;

[0047] The interaction instruction is sent to the display device through the communication connection, so that the display device responds to the interaction instruction, parses the key trajectory information, and, based on the key trajectory information, when a target execution option is matched in the executable options, executes the interaction operation corresponding to the target execution option to display the target user interface after executing the interaction operation; the executable option is an option that represents the operation corresponding to each touch action in the interface scene of the display device.

[0048] In a third aspect, some embodiments of the present application provide an interaction method for simulating touch gestures, which is applied to the display device described in the first aspect, and the method includes:

[0049] In response to an interaction instruction sent by the control device through the communication connection, parsing key trajectory information of the interaction instruction, wherein the interaction instruction is a control instruction triggered when at least two keys arranged consecutively in the control device are clicked in sequence;

[0050] In the interface scene of the user interface, obtaining executable options, wherein the executable options are options for representing operations corresponding to each touch action in the interface scene;

[0051] Matching a target execution option in the executable options according to the key trajectory information;

[0052] When a target execution option is matched, an interactive operation corresponding to the target execution option is performed to display a target user interface after performing the interactive operation.

[0053] As can be seen from the above technical solutions, the present application provides a display device, a control device, and an interactive method for simulating touch gestures. By responding to the interactive instructions generated by the control device when multiple buttons arranged in a continuous manner are clicked, the key information of the interactive instructions is parsed, and in the interface scenario of the user interface, executable options for representing the operations corresponding to each touch action are obtained, and according to the button trajectory information, the target execution options are matched in the executable options to execute the interactive operations corresponding to the target interactive options. This embodiment simulates touch gestures by controlling the trajectory information of the buttons arranged continuously in the device, thereby solving the problem that traditional remote controls cannot implement complex gesture touch operations. Continuous clicks of physical buttons are mapped to trajectory directions, which not only retains the operating habits of traditional remote controls, but also achieves an effect similar to gesture sliding touch, thereby improving the convenience of implementing touch operations through buttons. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0055] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0056] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0057] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0058] Figure 4A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0059] Figure 5 A flowchart of an interactive method for performing simulated touch gestures on a display device provided in some embodiments of the present application;

[0060] Figure 6 A timing diagram of an interactive method for executing simulated touch gestures on a display device provided in some embodiments of the present application;

[0061] Figure 7 A flowchart of generating interaction instructions for a control device provided in some embodiments of the present application;

[0062] Figure 8 A flowchart of display device update executable options provided in some embodiments of the present application;

[0063] Figure 9 A flowchart for generating different pre-execution options for a display device provided in some embodiments of the present application;

[0064] Figure 10 A flowchart of a display device sequentially executing different third target execution options provided in some embodiments of the present application;

[0065] Figure 11 A flowchart of a display device determining a pre-execution option according to the number of keys provided in some embodiments of the present application;

[0066] Figure 12 A flowchart of determining a second key threshold for a display device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0067] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0068] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0069] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0070] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0071] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0072] In the embodiments of the present application, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0073] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300, and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus pen, a handle, etc.

[0074] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0075] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0076] like Figure 1As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0077] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0078] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0079] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0080] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0081] In some embodiments, the display 260 includes a display component for presenting images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces.

[0082] In some embodiments, the communication device 220 is a component used to communicate with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.

[0083] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0084] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0085] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0086] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0087] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0088] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0089] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0090] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0091] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0092] In some embodiments, as Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0093] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and external and internal data processing functions.

[0094] Under the control of the controller 110, the communication interface 130 communicates control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0095] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 and other input interfaces.

[0096] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, to encode user input commands via the WiFi protocol, Bluetooth protocol, or NFC protocol and transmit them to the display device 200.

[0097] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0098] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0099] In some embodiments, when the button 144 is clicked, the control device 100 may generate a control instruction for controlling the display device 200 to interact. The controller 110 may send a control signal corresponding to the control instruction to the display device 200 via the communication interface 130 to instruct the display device 200 to perform the interactive operation corresponding to the control instruction.

[0100] In some embodiments, the control device 100 may be provided with a variety of buttons 144, each of which may correspond to different functions. For example, a user may adjust the volume of the display device 200 using the volume button on the control device 100, or adjust the channel currently displayed on the display device 200 using the direction buttons. The control device 100 may generate a control instruction in response to a triggering of a single button 144, or in response to a combination of multiple buttons 144. The control instruction generated by a single button and the control instruction generated by a combination of multiple buttons may correspond to different functions.

[0101] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device 200 to provide a user interface. For example, the operating system can directly control the display device 200 to provide a user interface, or it can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0102] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0103] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0104] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0105] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0106] like Figure 4 As shown, Figure 4 This is a software configuration diagram of a display device provided in some embodiments of the present application. In some embodiments, the system of the display device 200 can be divided into three layers, namely, an application layer, a middleware layer, and a hardware layer from top to bottom.

[0107] The application layer mainly includes applications on the TV and the application framework. Among them, applications are mainly applications developed based on the browser, such as HTML5 APPs; and native applications (Native APPs).

[0108] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0109] Native apps can support online or offline, message push or local resource access.

[0110] The middleware layer includes various TV protocols, multimedia protocols, and system components. Middleware uses the basic services (functions) provided by system software to connect various parts of the application system or different applications on the network, enabling resource and function sharing.

[0111] The hardware layer mainly includes the HAL interface, hardware, and drivers. The HAL interface is a unified interface for all TV chips, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WiFi driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0112] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0113] In some embodiments, the control device 100 can detect click events of each button 144. When a button 144 is clicked by a user, the control device 100 generates a control instruction corresponding to the button 144 in response to the triggering operation and transmits the control instruction to the display device 200. In response to the received control instruction, the display device 200 executes the preset interaction logic to implement the human-computer interaction function.

[0114] Different buttons 144 may include different functions. The buttons 144 in the control device 100 may include a confirmation function button, a cancel function button, a menu function button, a direction function button, and a power on / off function button. The buttons 144 with different functions may instruct the display device 200 to perform different interactive functions. For example, in the user interface of the display device 200, when the visual focus is positioned on a control corresponding to a specific function option or application in the user interface, in response to the triggering operation of the confirmation function button, the control device 100 generates a confirmation control instruction. In response to the confirmation control instruction, the display device 200 starts the running process of the corresponding function option or application. In response to the triggering operation of the cancel function button, the control device 100 generates a termination control instruction. In response to the termination control instruction, the display device 200 terminates the startup process of the function option or application.

[0115] To facilitate user operation, the display device 200 may also include a touch component within the display 260, allowing the user to perform touch actions on the screen of the display 260. The display device 200 can detect user gestures through the touch component and generate control instructions based on the gestures in the corresponding valid area of the user interface to control the display device 200 to perform the corresponding operations. This allows the user to perform complex key operations on the control device 100 through simple touch gestures. However, users who are not familiar with touch functions are more accustomed to operating the display device 200 through a remote control or other control device 100.

[0116] However, due to the limited number of buttons 144, a single button cannot correspond to all interactive functions of the display device 200. Therefore, the control device 100 can instruct the display device 200 to perform specific functions by triggering multiple buttons in combination. This multi-key triggering method is complicated to operate, as the user needs to press multiple buttons 144 at the same time. If one button 144 is not triggered, the control instruction of the corresponding function cannot be triggered, which is not conducive to user operation. Therefore, the control device 100 cannot achieve the same flexible interactive control as gesture touch.

[0117] Based on the above scenario, some embodiments of the present application provide a display device 200, comprising a communication device 220, a controller 250, and a display 260. The communication device 220 is configured to establish a communication connection with the control device 100 to receive control signals sent from the control device 100. The display 260 is configured to display a user interface. The controller 250 is configured to execute an interaction method that simulates touch gestures.

[0118] Figure 5 A flowchart of an interactive method for performing simulated touch gestures on a display device provided in some embodiments of the present application. Figure 6 A timing diagram of an interactive method for performing simulated touch gestures on a display device provided in some embodiments of the present application. Figure 5 and Figure 6 , the method includes the following contents:

[0119] S100: In response to an interaction instruction sent by a control device through the communication connection, parsing key trajectory information of the interaction instruction.

[0120] The user can generate a control instruction by clicking the button 144 in the control device 100, and send the control instruction to the display device 200 through the communication interface 130 to instruct the display device 200 to perform the corresponding interactive operation. In order to simulate the user's touch action, the control device 100 can detect in real time the click event triggered when the button 144 is clicked.

[0121] The control device 100 can also generate interactive instructions, such as Figure 7As shown, the interaction instruction is a control instruction triggered when at least two consecutively arranged buttons of the control device 100 are clicked. Continuously arranged refers to buttons 144 that are arranged adjacently in the same column or row of the control device 100. The interaction instruction contains button trajectory information, that is, the order in which the buttons 144 are clicked, the trigger interval duration, and the identifier of the clicked button 144. Exemplarily, taking the direction function button and the confirmation function button of the control device 100 as an example, the direction function buttons may include an up direction button, a down direction button, a left direction button, and a right direction button. In the horizontal direction, from left to right, they are the left direction button, the confirmation function button, and the right direction button, and in the vertical direction, from top to bottom, they are the up direction button, the confirmation function button, and the down direction button.

[0122] When the control device 100 detects a click event triggered by two consecutive buttons being clicked in sequence, it can generate an interaction instruction containing button trajectory information corresponding to the click event and send it to the display device 200. For example, when the user clicks the confirmation function button and the right function button in sequence, the control device 100 generates an interaction instruction containing button trajectory information from left to right.

[0123] S200: Obtaining executable options in the interface scenario of the user interface.

[0124] Based on different user interfaces, different executable options may be included. Executable options are options used to characterize the operations corresponding to each touch action in the interface scenario. For example, Figure 8 As shown, in a browser, when a user is browsing a web page, the display device 200 can support sliding up and down to adjust the position of the web page opening to browse web page information at different locations. When the interface scenario is that the browser is located in the middle of the web page, the display device 200 can support moving the web page upward to browse web page information located above the current interface, and the display device 200 can support moving the web page downward to browse web page information located below the current interface. That is, in the current interface scenario, the executable options are sliding up and sliding down.

[0125] Executable options can be updated in real time according to changes in the interface scene. Figure 8 When the browser is at the top of the web page, the web page cannot continue to move upward. Therefore, in this interface scenario, the display device 200 does not support sliding upward, and the only executable option is sliding downward.

[0126] It should be noted that this application only uses the executable options in the vertical direction for exemplary description, and does not limit the acquisition of executable options in the interface scenario. In other embodiments, the same method can also be used to obtain executable options in the horizontal direction.

[0127] In some embodiments, in some interface scenarios, conventional executable options may not be executed based on specific restrictions of the interface scenario. For example, when the display device 200 starts the lock interface function in the current interface and locks the current interface, the user interface cannot respond to interactive instructions such as sliding up and down to perform corresponding interactive actions, that is, sliding up and sliding down are non-executable options in the current interface scenario. The display device 200 can switch the executable option mark that cannot be executed due to restrictions to a non-executable option.

[0128] In some embodiments, the display device 200 can update the executable options according to the changes in the interface scene. For example, when the display device 200 switches from a first interface scene that only supports up and down sliding to a second interface scene that only supports left and right sliding, the executable options are updated from sliding up and down in the first interface scene to sliding left and right in the second interface scene.

[0129] S300: Matching a target execution option in the executable options according to the key trajectory information.

[0130] After obtaining the key trace information, the display device 200 may traverse the executable options to determine the executable option corresponding to the key trace information, and mark the executable option as a target execution option.

[0131] In some embodiments, before determining the target execution option, the display device 200 can read the key trajectory direction of the key trajectory information and generate a pre-execution option based on the key trajectory direction. The pre-execution option is an execution option for the interactive operation represented by the key trajectory direction.

[0132] The direction of the key trajectory represents the order in which the consecutively arranged keys 144 are clicked. For example, if the confirm function button of the control device 100 is clicked first and the right direction button is clicked later, then the key trajectory direction is from left to right according to the order of clicks, which means a slide to the right interaction instruction is generated. For another example, if the confirm function button of the control device 100 is clicked first and the left direction button is clicked later, then the key trajectory direction is from right to left according to the order of clicks, which means a slide to the left interaction instruction is generated.

[0133] It should be noted that the click in this embodiment is a single click, and does not mean clicking and holding the button 144. When clicking in sequence, the first button is clicked once, and after releasing the first button, the second button is clicked to complete the process of clicking the buttons 144 in sequence.

[0134] In some embodiments, the display device 200 is not limited to responding to interaction commands generated by the control device 100 confirming function keys and directional function keys. That is, the control device 100 can generate interaction commands with the same interaction effect based on any two consecutive non-directional keys. For example, the control device 100 is provided with digital function keys, and in order from left to right, the digital functions in the first row are "1," "2," and "3." When clicked individually, a digital control command can be generated based on the clicked digital function keys. When the control device 100 detects click events on the digital function keys "1," "2," and "3" in the same row, it can generate an interaction command corresponding to a left-to-right sliding operation based on the click order of the digital function keys "1," "2," and "3." Furthermore, based on the click order of the digital function keys "3," "2," and "1," the control device 100 can also generate an interaction command corresponding to a right-to-left sliding operation.

[0135] Although the button 144 clicked by the user is a digital function button, after receiving the interaction instruction, the display device 200 can determine that the direction of the button trajectory is from left to right by reading the button trajectory information, and then match the target execution option in the executable options according to the execution options from left to right, and perform the interactive operation according to the button function of the clicked button 144 itself.

[0136] It should be noted that this embodiment is merely illustrative of digital function keys. In actual applications, any key 144 provided on the control device 100 can be implemented using the implementation methods described in the above embodiment. The direction of the key trajectory designed in this embodiment is not limited to up, down, left, and right, and the corresponding trajectory is not limited to a straight line. This embodiment does not specifically limit the direction or shape of the key trajectory.

[0137] After generating a pre-executed option, the executable options can be searched for an executable option that matches the pre-executed option. If a match is successful, the pre-executed option is marked as the target executable option. For example, when the key trajectory direction is from left to right, it indicates that the key trajectory information represents a rightward sliding operation, that is, the rightward sliding operation is the pre-executed option corresponding to the key trajectory information. The display device 200 can match the pre-executed option that slides rightward in the executable options.

[0138] S400: When a target execution option is matched, an interactive operation corresponding to the target execution option is executed to display a target user interface after executing the interactive operation.

[0139] After matching the target execution option, the display device 200 can execute the interactive operation corresponding to the target execution option. After executing the interactive operation, the user interface will change based on the interactive operation. For example, when swiping right, the user interface will display the interface content after swiping right. Therefore, the display device 200 can generate a user interface after executing the interactive operation in response to the interactive operation and display it on the display 260.

[0140] As can be seen from the above technical solution, the display device 200 provided in this embodiment simulates touch gestures by analyzing the trajectory information of consecutively arranged keys on the control device 100, thereby resolving the problem that traditional control devices 100 cannot perform complex gesture operations through keystrokes. By mapping the continuous clicks of the physical keys on the control device 100 to the direction of the trajectory, the operating habits of the control device 100 are preserved while simulating the effect of sliding touch, thereby improving the convenience of interactive operations.

[0141] In some embodiments, key trace information may correspond to one or more execution options. For example, when the display device 200 is playing media data, a left-to-right swipe operation may correspond to returning from the media playback interface to the media data selection interface (i.e., a return operation), or may correspond to fast-forwarding the media data to adjust the playback progress (i.e., a fast-forward adjustment operation). In this scenario, the key trace information corresponds to two different execution options.

[0142] To this end, the controller 250 can read the key trajectory direction and the trigger interval duration of the key in the key trajectory information to distinguish different execution options through the trigger interval duration. The trigger interval duration can be based on the time interval between the control device 100 detecting the generation of click events before and after the consecutively arranged keys 144. For example, after the user clicks the confirmation function key, the right direction key located to the right of the confirmation function key is clicked at an interval of 0.3s. After detecting the click event of the confirmation function key, the control device 100 detects the click event of the right direction key at an interval of 0.3s, that is, the trigger interval duration is 0.3s. Based on different trigger interval durations, the display device 200 can generate different pre-execution options according to the key trajectory information. For example, when the interactive operation is a fast slide to the right, the display device 200 can perform an interface return operation, and when the interactive operation is a slow slide to the right, the display device 200 can perform a progress adjustment operation to the right.

[0143] In order to distinguish the different execution options corresponding to the key trace information, such as Figure 9As shown, the display device 200 can set a first duration threshold. When the trigger interval duration is less than or equal to the first duration threshold, it means that the user quickly clicks on the buttons 144 arranged continuously in the control device 100 in sequence. The display device 200 can generate a first pre-execution option according to the direction of the button trajectory, and match the target execution option in the executable options according to the first pre-execution option. If the match is successful, the first pre-execution option is marked as the first target execution option.

[0144] For example, when the first duration threshold is 0.5s and the trigger interval is 0.3s, the trigger interval is less than the first duration threshold, the execution option corresponding to the key trajectory information is quick sliding, and the display device 200 marks the interface return operation as the first pre-execution option.

[0145] In some embodiments, when the trigger interval is longer than the first duration threshold, the scenario may be that the user wants to control the display device 200 to perform two interactive operations corresponding to separate buttons, or to perform a slow sliding operation. To this end, the display device 200 can also set a second duration threshold greater than the first duration threshold to distinguish the above two different interactive operations. When the trigger interval is longer than the first duration threshold and less than or equal to the second duration threshold, the display device 200 can determine that the user is slowly clicking the buttons 144 arranged continuously in the control device 100 in sequence. The display device 200 can generate a second pre-execution option based on the direction of the button trajectory. For example, the first duration threshold is 0.5s and the second duration threshold is 1s. When the trigger interval is 0.8s, the trigger interval is less than the first duration threshold and greater than the second duration threshold. The execution option corresponding to the button trajectory information is slow sliding, and the display device 200 can mark the progress adjustment operation as the second pre-execution option.

[0146] The display device 200 may match the target execution option in the executable options according to the second pre-execution option, and if the match is successful, mark the second pre-execution option as a second target execution option, wherein the second target execution option is different from the first target execution option.

[0147] In some embodiments, when the trigger interval is longer than the second duration threshold, indicating that the user has clicked consecutive buttons 144 for a long time, the display device 200 does not determine the target execution option based on the button trajectory information, but instead executes the interactive operations of each individual button 144. To this end, the display device 200 may generate a third pre-execution option corresponding to each individual button, match the executable options based on the third pre-execution option, and mark the executable option corresponding to the third pre-execution option as the third target execution option.

[0148] Since the clicked keys 144 are at least two keys arranged consecutively, different click orders correspond to different interactive operations. Therefore, the display device 200 needs to determine the click order of each key 144 based on the direction of the key trajectory, and sequentially execute the interactive operations corresponding to the third target execution options of each key 144 according to the click order.

[0149] From the above technical solutions, it can be seen that the present application can realize multiple functions in the current scene interface through a unified key combination, and distinguish different interactive operations performed by the same key combination through different trigger interval lengths, thereby improving the diversity of key mapping touch actions.

[0150] In some embodiments, as Figure 10 As shown, taking the buttons A and B clicked on the control device 100 as an example, the button trajectory information includes the button identifiers of buttons A and B. When the trigger interval duration is greater than the second duration threshold, after the display device 200 responds to the interactive operation corresponding to button A in the order of button clicks, the interface scene will change. At the same time, in the changed interface scene, the executable options will also be updated according to the change in the interface scene, resulting in the third target execution option corresponding to button B being unable to be executed in the new interface scene. To this end, the display device 200 can first execute the third target execution option A corresponding to button A in the order of button clicks, and update the interface scene based on the interactive operation corresponding to the third target execution option A. After the scene interface is updated, the display device 200 obtains the executable options of the updated scene interface and matches the third target execution option B of button B in the updated executable options based on the third pre-execution option B of button B. If the match is successful, the display device 200 executes the interactive operation corresponding to the third target execution option B of button B based on the updated scene interface.

[0151] In some embodiments, if the display device 200 fails to match the target execution option in the executable options based on the pre-execution option, it means that the interactive operation corresponding to the pre-execution option is not supported in the current scenario. For example, when the web page is located at the top of the browser, the display device 200 cannot respond to the interactive operation of sliding up and continue to move the web page upward. To this end, the display device 200 can generate interaction failure information based on the pre-execution option, and the interaction failure information is used to indicate that the interactive operation corresponding to the pre-execution option cannot be executed in the interface scenario of the user interface. After generating the interaction failure information, the display device 200 can display the interaction failure information through the display 260 to prompt the user that the corresponding interactive operation cannot be performed in the current interface scenario, so as to avoid the user from repeatedly performing key operations due to no response to the interaction.

[0152] In some embodiments, in another implementation, the control device 100 may further distinguish different execution options by the number of keys clicked sequentially in the same row or column instead of the trigger interval duration. To this end, upon detecting a click event on key 144, the control device 100 may further traverse the number of keys clicked. When the key trajectory information corresponds to two execution options, the display device 200 may read the key trajectory direction and the number of keys in key 144 from the key trajectory information to distinguish the different execution options corresponding to the key trajectory information.

[0153] See also Figure 11 When the number of keys is less than or equal to the first key threshold, the display device 200 may generate a first pre-execution option based on the key trajectory direction and the number of keys, and mark the executable option identical to the first pre-execution option as the first target execution option through a matching process. When the number of keys is greater than the first key threshold and less than or equal to the second key threshold, a second pre-execution option is generated based on the key trajectory direction and the number of keys, and mark the executable option identical to the second pre-execution option as the second target execution option through a matching process.

[0154] It should be noted that, based on the layout of the buttons 144 in the control device 100, when at least two consecutive buttons 144 in the same row or column are clicked successively, button trajectory information for representing directional sliding can be generated. Therefore, the minimum number of buttons can be set to 2, and correspondingly, the first button threshold can be set to 3. When the number of buttons read by the display device 200 in the button trajectory information is greater than the first button threshold, a second button threshold can be set, which is the maximum number of buttons in the same row or column corresponding to the clicked buttons 144.

[0155] In some embodiments, the display device 200 may also determine the second key threshold value based on the number of keys remaining in the same row or column according to the last clicked key 144 and the key trajectory direction. Figure 12 As shown, when the control device 100 has five buttons 144 arranged in the same row from left to right, namely the first button, the second button, the third button, the fourth button, and the fifth button, when the user starts clicking from the first button, the second button threshold is 5, which is used to indicate that within this button row, five buttons can be clicked in sequence. When the user starts clicking from the second button, there are two ways of clicking. The first is to click the second button and then click the first button to the left, forming a key trajectory composed of two buttons with a leftward direction. The second is to click the remaining buttons in the same row to the right. In this case, the second button threshold is the sum of the maximum number of remaining buttons facing right and the number of second buttons, and the second button threshold is 4.

[0156] This embodiment uses the key trajectory direction from left to right as an example for explanation. The interactive operation corresponding to the key trajectory direction is swiping right. The display device 200 can determine the swiping speed indicated by the control device 100 based on the number of keys. For example, when the number of keys read from the key trajectory information is 2, it can be determined that the execution option corresponding to the key trajectory information is swiping right slowly. When the number of keys read from the trajectory information is greater than 2, it can be determined that the execution option corresponding to the key trajectory information is swiping right quickly.

[0157] It should be noted that, in order to avoid confusing the determination of the number of keys and the trigger interval duration of key 144, in this embodiment, the display device 200 can set the determination priority between the trigger interval duration and the number of keys. For example, the priority of setting the trigger interval duration is greater than the priority of the number of keys, that is, the pre-execution option is generated according to the trigger interval duration first, and when the trigger interval durations are the same, the determination is made according to the number of keys. Alternatively, the priority of setting the number of keys is greater than the priority of setting the trigger duration, that is, the pre-execution option is generated according to the number of keys first, and when the number of keys is the same, the determination is made according to the trigger interval duration. It is also possible to determine the pre-execution option of the key trajectory information according to only one of the conditions of the trigger interval duration and the number of keys. When the above-mentioned single condition is used for determination, the control device 100 controls the display device 200 to switch different determination conditions between the trigger interval duration and the number of keys by sending a switching instruction to the display device 200.

[0158] In the scenario where the display device 200 is running an application, the interactive operations corresponding to the key trajectory information need to be converted into the operation logic corresponding to the application. For example, in the menu interface of the display device 200, the right swipe operation switches to another menu interface to the right of the current menu interface. However, in the interactive logic of the application, the right swipe operation may correspond to different interactive functions. For example, in a music player, the right swipe operation may switch to the next song, while in a game program, the right swipe operation may control the character in the game interface to move right.

[0159] Based on the above scenario, in some embodiments, the display device 200 can further identify the interface scene of the display device 200 after parsing the key trajectory information. When the interface scene is a program execution scene, it indicates that the display device 200 is in the process of running a specific application. In this case, in order to enable the display device 200 to execute the interactive command sent by the control device 100 in the current scene, the display device 200 can send the target execution option obtained based on the key trajectory information to the application. The application will then convert the target execution option into an execution option executable by the application according to its own interactive processing logic and perform the interactive operation according to the converted execution option.

[0160] Based on the display device 200, some embodiments of the present application further provide a control device 100, comprising a communication interface 130, a button 144, and a controller 110, wherein the communication interface 130 is configured to establish a communication connection with the display device 200 to send control instructions to the display device 200 via the communication connection. The notification device 100 may be provided with multiple buttons 144. When a button 144 is clicked, the control device 100 may generate a control instruction for the button 144 in response to the triggering of the button 144. The controller 110 is configured to generate an interaction instruction based on the key trajectory information of the keys when at least two keys are clicked consecutively, and send the generated interaction instruction to the display device 200 through the communication interface 130 based on the communication connection between the control device 100 and the display device 200, so that the display device 200 responds to the interaction instruction, parses the key trajectory information in the interaction instruction, and based on the key trajectory information, when the target execution option is matched in the executable options in the current interface scene of the display device 200, executes the interaction operation corresponding to the target execution option to display the target user interface after executing the interaction operation, wherein the executable option is an option that represents the operation corresponding to each touch action in the interface scene of the display device 200.

[0161] In some embodiments, the control device 100 can detect click events for each key 144, generate different key trajectory information, and generate interaction instructions based on the key trajectory information. Corresponding to different executable operations of the display device 200, the control device 100 can set different key modes for the same key 144 combination. For example, after detecting a click event for a first key and a click event for a second key, the control device 100 can generate key trajectory information based on the key time interval and the key trajectory direction based on the key time interval and the key trajectory direction detected between the two click events and the sequence of clicks of the first and second keys.

[0162] In some embodiments, based on the various executable operations of the display device 200, the control device 100 can perform interactive operations with the display device 200 according to various key interaction methods such as the trigger interval duration and the number of keys. Please refer to the aforementioned interactive process in which the display device 200 determines the target execution option based on the key trajectory information, which will not be repeated in this embodiment.

[0163] Some embodiments of the present application also provide an interactive method for simulating touch gestures, which is applied to a display device 200. When executing the method, the display device 200 needs to execute the interactive instructions generated based on the key interaction of the control device 100. To facilitate the execution of the method, the display device 200 should include at least a display 260, a communication device 220, and a controller 250. The display is configured to display a user interface, and the communication device is configured to establish a communication connection with the control device. The method includes:

[0164] S100: In response to an interaction instruction sent by a control device through the communication connection, parsing key trajectory information of the interaction instruction, where the interaction instruction is a control instruction triggered when at least two consecutively arranged keys in the control device are clicked in sequence;

[0165] S200: Acquire executable options in the interface scene of the user interface, where the executable options are options for representing operations corresponding to various touch actions in the interface scene;

[0166] S300: Matching a target execution option in the executable options according to the key trajectory information;

[0167] S400: When a target execution option is matched, an interactive operation corresponding to the target execution option is executed to display a target user interface after executing the interactive operation.

[0168] As can be seen from the above technical solutions, the present application provides a display device, a control device, and an interactive method for simulating touch gestures. By responding to the interactive instructions generated by the control device when multiple buttons arranged in a continuous manner are clicked, the key information of the interactive instructions is parsed, and in the interface scenario of the user interface, executable options for representing the operations corresponding to each touch action are obtained, and according to the button trajectory information, the target execution options are matched in the executable options to execute the interactive operations corresponding to the target interactive options. This embodiment simulates touch gestures by controlling the trajectory information of the buttons arranged continuously in the device, thereby solving the problem that traditional remote controls cannot implement complex gesture touch operations. Continuous clicks of physical buttons are mapped to trajectory directions, which not only retains the operating habits of traditional remote controls, but also achieves an effect similar to gesture sliding touch, thereby improving the convenience of implementing touch operations through buttons.

[0169] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be repeated here.

[0170] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus a necessary general-purpose hardware platform. Based on this understanding, the technical solutions in the embodiments of the present invention, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various embodiments of the present invention or certain portions of the embodiments.

[0171] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

[0172] For ease of explanation, the above description has been made with reference to specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations are possible. The above embodiments are selected and described to better explain the principles and practical applications, so that those skilled in the art can better utilize the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; a communication device configured to establish a communication connection with the control device; The controller is configured as: In response to an interaction instruction sent by the control device through the communication connection, parsing key trajectory information of the interaction instruction, wherein the interaction instruction is a control instruction triggered when at least two keys arranged consecutively in the control device are clicked in sequence; In the interface scene of the user interface, obtaining executable options, wherein the executable options are options for representing operations corresponding to each touch action in the interface scene; Matching a target execution option in the executable options according to the key trajectory information; When a target execution option is matched, an interactive operation corresponding to the target execution option is performed to display a target user interface after performing the interactive operation.

2. The display device according to claim 1, wherein The controller performs the step of matching a target execution option in the executable options according to the key trajectory information, and is specifically configured to: When the key trace information corresponds to an execution option, reading the key trace direction of the key trace information; generating pre-execution options according to the key trajectory direction; The executable option corresponding to the pre-execution option is marked as a target execution option.

3. The display device according to claim 1, wherein When the keystroke trajectory information corresponds to two different execution options, the controller performs a step of matching a target execution option among the executable options according to the keystroke trajectory information, which is specifically configured as follows: Read the key trajectory direction and the triggering interval duration of the key from the key trajectory information; When the trigger interval duration is less than or equal to a first duration threshold, generating a first pre-execution option according to the key trajectory direction; The executable option corresponding to the first pre-execution option is marked as a first target execution option.

4. The display device according to claim 3, wherein When the trigger interval duration is greater than a first duration threshold and less than or equal to a second duration threshold, the controller is further configured to: generating a second pre-execution option according to the key trajectory direction, wherein the second pre-execution option is different from the first pre-execution option; The executable option corresponding to the second pre-execution option is marked as a second target execution option.

5. The display device according to claim 4, wherein: When the trigger interval duration is greater than a second duration threshold, the controller is further configured to: generating a third pre-execution option based on a single keystroke; marking the executable option corresponding to the third pre-execution option as a third target execution option; According to the direction of the key trajectory, a key click sequence of each key is obtained; According to the button clicking sequence, the interactive operations corresponding to the third target execution options of the buttons are executed in sequence.

6. The display device according to claim 1, wherein When no target execution option is matched, the controller is further configured to: Generate interaction failure information according to the pre-execution option, wherein the interaction failure information is used to indicate that the interaction operation corresponding to the pre-execution option cannot be performed in the interface scenario of the user interface; The display is controlled to display the interaction failure information on the user interface.

7. The display device according to claim 3, wherein: The controller performs the step of matching a target execution option in the executable options according to the key trajectory information, and is further configured to: Read the key trajectory direction of the key trajectory information and the number of keys of the key; When the number of keys reaches a first key threshold, generating a first pre-execution option according to the key trajectory direction and the number of keys; The executable option corresponding to the first pre-execution option is marked as a first target execution option.

8. The display device according to claim 7, wherein: The controller is further configured to: When the number of keys is greater than a first key threshold and less than or equal to a second key threshold, generating a second pre-execution option according to the key trajectory direction and the number of keys; The executable option corresponding to the second pre-execution option is marked as a second target execution option.

9. A control device, characterized in that: include: a communication interface configured to establish a communication connection with a display device; Buttons, configured to trigger control instructions when clicked; The controller is configured as: When at least two consecutively arranged keys are clicked, generating an interaction instruction according to key trajectory information of the keys; sending the interaction instruction to the display device through the communication connection, so that the display device responds to the interaction instruction, parses the key trajectory information, and, when a target execution option is matched among executable options based on the key trajectory information, executes the interaction operation corresponding to the target execution option, so as to display a target user interface after executing the interaction operation; The executable options are options that represent operations corresponding to each touch action in the interface scene of the display device.

10. An interactive method for simulating touch gestures, characterized in that: The method is applied to a display device, comprising a display, a communication device, and a controller, wherein the display is configured to display a user interface, and the communication device is configured to establish a communication connection with a control device. The method comprises: In response to an interaction instruction sent by the control device through the communication connection, parsing key trajectory information of the interaction instruction, wherein the interaction instruction is a control instruction triggered when at least two keys arranged consecutively in the control device are clicked in sequence; In the interface scene of the user interface, obtaining executable options, wherein the executable options are options for representing operations corresponding to each touch action in the interface scene; Matching a target execution option in the executable options according to the key trajectory information; When a target execution option is matched, an interactive operation corresponding to the target execution option is performed to display a target user interface after performing the interactive operation.

Images