Screen control method, touchpad device, man-machine interaction system and storage medium

Abstract

The invention discloses a screen control method, a touchpad device, a man-machine interaction system and a storage medium, and solves the problem that a cursor movement function and a page scrolling function cannot be clearly distinguished when a user holds the touchpad device for blind operation by one hand by integrating four steps of gesture recognition, state switching, feedback prompt and instruction execution. Specifically, the gesture recognition step avoids dependence on physical partition of the touchpad, the state switching step realizes function conversion through a single gesture, the feedback prompt step provides instant sensory confirmation, and the instruction execution step ensures strict matching of an operation instruction and a current mode. Therefore, a closed-loop control mechanism is formed, and the interaction reliability and the user experience under single-hand blind operation are remarkably improved.

Description

TECHNICAL FIELD

[0001] The present application relates to a screen control method, a touchpad device, a human-computer interaction system and a storage medium. BACKGROUND

[0002] With the popularization of large-screen display devices such as smart televisions and smart projectors, users' requirements for remote interaction experience are increasing. Handheld touchpad devices (such as smart remote controllers and mice) are widely used as a convenient interactive tool to control the cursor movement and interface browsing on a remote screen. The core requirement is how to enable users to efficiently and accurately distinguish and perform the two basic operations of cursor movement and page scrolling in a comfortable one-handed holding state.

[0003] Currently, existing handheld touchpad devices mainly use the following two schemes to realize function differentiation: First, the touchpad partition scheme. This scheme divides the physical or logical area of the touchpad into different functional areas. For example, the left half of the touchpad is used to control cursor movement, and the right half is used to control page scrolling. The advantage of this scheme is that the functional partition is intuitive. However, it has obvious defects: when the user performs "blind operation" (i.e., the line of sight is focused on the remote screen rather than the handheld device), it is difficult for the finger to accurately perceive and locate the specific area on the touchpad, and it is easy to cause misoperation. For example, the cursor is intended to be moved, but the page scrolling is triggered, resulting in operation failure and decreased user experience. Therefore, this scheme relies heavily on visual assistance, and cannot meet the needs of smooth one-handed blind operation.

[0004] Second, the operation gesture differentiation scheme. This scheme differentiates functions through different gestures, for example, single-finger sliding on the touchpad is used to move the cursor, and double-finger sliding is used to implement page scrolling. The advantage of this scheme is that it does not need to partition the touchpad, and the operation is relatively natural. However, its core defect is that it cannot achieve true one-handed operation.

[0005] In summary, there is an urgent need in the art for a new interactive method that can enable users to clearly and reliably distinguish between cursor movement and page scrolling functions when performing blind operation with one hand holding the touchpad device, and obtain immediate and effective operation feedback, thereby fundamentally improving the accuracy of interaction and user experience. SUMMARY

[0006] The technical problem to be solved by the present application is to overcome the defects in the prior art and provide a screen control method, a touchpad device, a human-computer interaction system and a storage medium.

[0007] The present application solves the above technical problems by the following technical solutions: A screen control method, the technical solutions are as follows: The method comprises the following steps: gesture recognition step: the touchpad device detects an operation gesture input by a user on the touchpad thereof; state switching step: when the operation gesture is recognized as a preset switching gesture, the touchpad device switches the current operation mode between a first mode and a second mode, wherein the first mode is a cursor moving mode, and the second mode is a page scrolling mode; feedback prompting step: while switching the operation mode, the touchpad device generates and outputs a feedback prompt signal corresponding to the switched operation mode; instruction execution step: the touchpad device sends the parsed control instruction to the remote screen device based on the switched operation mode, so that the remote screen device performs an operation corresponding to the control instruction.

[0008] Further, the application further proposes that the preset switching gesture is a double-click gesture.

[0009] Further, the application further proposes that the feedback prompting step comprises at least one of the following sub-steps: controlling a light module of the touchpad device to change a light emitting state; controlling a vibration module of the touchpad device to generate a haptic vibration; sending a prompt instruction to the remote screen device to make the remote screen device display a visual prompt of the current operation mode on the screen.

[0010] Further, the application further proposes that in the feedback prompting step, the control of the light module to change the light emitting state, the control of the vibration module to generate the haptic vibration, and the sending of the prompt instruction to the remote screen device to display the visual prompt are performed synchronously.

[0011] Further, the application further proposes a touchpad device comprising: a touchpad sensing module configured to detect an operation gesture of a user; a state control module connected with the touchpad sensing module and configured to switch a current operation mode and generate a control instruction when the operation gesture is recognized as a preset switching gesture; a feedback module connected with the state control module and configured to output a feedback prompt according to the control instruction; a communication module connected with the state control module and configured to send the control instruction to a remote screen device.

[0012] Further, the application further proposes that the feedback module comprises at least one of the following: a light module configured to perform visual prompting by light emitting change; a vibration module configured to perform haptic prompting by generating vibration.

[0013] Furthermore, this application also proposes a human-computer interaction system, which includes: Touchpad devices; A remote screen device that communicates with a touchpad device, is configured to receive control commands, perform cursor movement or page scrolling operations corresponding to the control commands, and display visual prompts of the current operating mode on the screen.

[0014] Furthermore, this application also proposes a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the above-described method.

[0015] As can be seen from the above, the screen control method, touchpad device, human-computer interaction system and computer-readable storage medium provided in this application achieve rapid switching of operation modes and provide multimodal feedback prompts by adopting preset switching gestures. This effectively solves the problems of difficulty in distinguishing functions and lack of feedback in one-handed blind operation scenarios. It has the advantages of enabling users to reliably distinguish cursor movement and page scrolling functions in one-handed blind operation scenarios, and providing operation confirmation through feedback prompts, reducing misoperation and improving user experience. Attached Figure Description

[0016] Fig. 1 This is a flowchart of a screen control method according to an embodiment of the present invention.

[0017] Fig. 2 This is a schematic diagram of the structure of a touchpad device according to an embodiment of the present invention.

[0018] Fig. 3 This is a logic diagram of the screen control method according to an embodiment of the present invention. Detailed Implementation

[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the present invention or its application or use. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0020] It should be noted that in the claims and specification of this patent, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.

[0021] like Figs. 1-3 As shown, this embodiment discloses a screen control method, which includes the following steps: Gesture recognition steps: The touchpad device detects the user's gestures input on its touchpad; State switching steps: When the operation gesture is recognized as a preset switching gesture, the touchpad device switches the current operation mode between the first mode and the second mode, where the first mode is the cursor movement mode and the second mode is the page scrolling mode; Feedback prompt steps: While switching operating modes, the touchpad device generates and outputs a feedback prompt signal corresponding to the switched operating mode; Command execution steps: Based on the switched operating mode, the touchpad device sends the parsed control commands to the remote screen device, so that the remote screen device can perform the operation corresponding to the control commands.

[0022] In practical applications, a touchpad device can be understood as a hardware device with touch sensing capabilities, capable of detecting gesture input through capacitive, resistive, or optical technologies. For example, a capacitive touchpad captures gesture trajectories by detecting changes in capacitance on the finger's contact surface, while an optical touchpad senses finger movement trajectories through an infrared sensor array. These technologies can all meet the needs of gesture recognition.

[0023] Furthermore, preset switching gestures can be implemented in various ways. For example, mode switching can be triggered by detecting whether the sliding trajectory of a finger on the touchpad conforms to a specific shape (such as a circle or a Z-shape), or by detecting whether the pressure value of a finger pressing the touchpad exceeds a certain threshold. These methods can all achieve mode switching functionality without relying on complex gestures.

[0024] Specifically, the generation and output of feedback signals can be achieved through various means. For example, touchpad devices can be configured with sound or vibration modules to alert the user to the current operating mode by emitting specific sound effects or vibrations. These implementations all provide immediate sensory feedback, ensuring that the user can confirm the current operating mode while their gaze is focused on the remote screen.

[0025] The innovation of this application lies in solving the problem of users being unable to clearly distinguish between cursor movement and page scrolling functions when blindly operating a touchpad device with one hand by integrating four steps: gesture recognition, state switching, feedback prompts, and command execution. Specifically, the gesture recognition step avoids reliance on physical touchpad partitions, the state switching step achieves function switching through a single gesture, the feedback prompt step provides immediate sensory confirmation, and the command execution step ensures strict matching between the operation command and the current mode. This forms a closed-loop control mechanism, significantly improving the reliability of interaction and user experience under one-handed blind operation.

[0026] The working principle of this application embodiment is as follows: A screen control method integrates four steps—gesture recognition, state switching, feedback prompts, and command execution—to achieve functional differentiation and real-time feedback when a user performs blind operation while holding a touchpad device with one hand. Specifically, firstly, in the gesture recognition step, the touchpad device detects the user's input gestures on its touchpad, providing basic input for subsequent state switching. This avoids dependence on physical partitions of the touchpad, allowing the user to trigger function switching without perceiving a specific area during blind operation. Further, in the state switching step, when the operation gesture is recognized as a preset switching gesture, the touchpad device switches the current operation mode between cursor movement mode and page scrolling mode. This single gesture achieves function conversion, simplifying the operation process and solving the problems of limited one-handed operation or high accidental touch rates in existing solutions. Simultaneously, in the feedback prompt step, the touchpad device generates and outputs a feedback prompt signal corresponding to the switched operation mode while switching operation modes, providing real-time sensory feedback. This allows the user to confirm the current mode in real time while focusing their gaze on the remote screen, effectively eliminating uncertainty in blind operation. Finally, in the instruction execution step, the touchpad device sends the parsed control instructions to the remote screen device based on the switched operating mode, ensuring that the instructions strictly match the current mode and guaranteeing the accuracy of operation execution. Thus, these steps work closely together: gesture recognition triggers state switching, state switching synchronously activates feedback prompts to provide mode confirmation, and instruction execution outputs the correct instructions based on the new state, forming a closed-loop control mechanism that together achieves reliable functional differentiation and immediate feedback under one-handed blind operation.

[0027] This application further proposes that the preset switching gesture be a double-tap gesture.

[0028] Specifically, a double-tap gesture refers to a user quickly tapping the touchpad twice in quick succession with a single finger. In practical applications, double-tap gestures can be implemented using capacitive touch sensors to detect finger taps and combining this with a time interval threshold to determine whether a double-tap operation has been performed. The aim is to simplify the complexity of mode switching, allowing users to naturally complete the switching action while holding the device with one hand, while avoiding the inconvenience of multi-finger operation.

[0029] In detail, in the screen control method described above, when a user needs to switch between cursor movement mode and page scrolling mode, they only need to double-tap with a single finger to trigger the state switching step. Because the double-tap gesture has distinct temporal and spatial characteristics, the touchpad sensing module can accurately identify this operation and distinguish it from a regular single-click operation, thus effectively avoiding accidental triggering.

[0030] This application further proposes that the feedback prompting step includes at least one of the following sub-steps: Control the lighting module of the touchpad device to change its illumination state; The vibration module of the touchpad device generates tactile vibrations. Send a prompt command to a remote screen device so that the remote screen device displays a visual prompt of the current operating mode on its screen.

[0031] Specifically, a lighting module refers to a device used to provide visual cues through changes in light emission. It can be implemented using LED beads, RGB light strips, or dimmable panels. In practical applications, the light emission status of the lighting module can be indicated by color switching, brightness adjustment, or changes in flashing frequency. Its purpose is to provide users with intuitive visual feedback, especially enhancing the user's perception in dark environments.

[0032] A vibration module is a device used to provide tactile cues through physical vibration. It can be implemented using an eccentric motor, a linear motor, or a piezoelectric ceramic vibrator. In practical applications, a vibration module can generate specific tactile signals by adjusting parameters such as vibration frequency, intensity, or duration, with the aim of allowing users to confirm changes in operating modes without relying on vision.

[0033] Furthermore, sending prompts to remote screen devices refers to generating and transmitting signals containing information about the current operating mode based on mode switching events. This can be achieved through wireless communication protocols (such as Bluetooth or Wi-Fi) or wired connections. In practical applications, the specific content of the prompts can include text labels, icon displays, or dynamic animations. The purpose is to embed feedback directly into the remote screen interface where the user's gaze is focused, ensuring that the user receives immediate confirmation without having to shift their attention during operation.

[0034] Specifically, the above technical solution addresses the issue of insufficient user perception of operation mode switching in blind operation scenarios. The touchpad device's light module triggers changes in its illumination state based on mode switching events. The light state is directly linked to the operation mode, allowing users to instantly distinguish between cursor movement and page scrolling modes through peripheral vision or differences in the brightness and color of the device's light. Simultaneously, the vibration module generates specific tactile feedback based on the switching signal, enabling users to clearly confirm mode switching simply by the physical vibration of the device in their hand, significantly improving the accuracy of one-handed blind operation. Furthermore, upon receiving a prompt command, the remote screen device displays a visual cue of the current operation mode on its screen, embedding the feedback directly into the interface where the user's gaze is focused, ensuring that the user receives instant confirmation without needing to shift their attention during operation.

[0035] This application further proposes that, in the feedback prompting step, the control light module changes the light emission state, the vibration module generates tactile vibration, and a prompting command is sent to a remote screen device to display a visual prompt.

[0036] In detail, this solution forms a complete prompting system by simultaneously executing multiple feedback mechanisms. First, when the touchpad device detects a change in operating mode, the light module immediately changes its illumination state, such as from solid to flashing or changing color. This visual cue quickly attracts the user's attention. Simultaneously, the vibration module generates tactile vibrations, enhancing the prompting effect through physical signals directly perceived by the hand, ensuring that the user can clearly perceive the switch even in visually limited environments. Furthermore, after sending a prompt command to a remote screen device, a visual cue of the current operating mode is instantly displayed on the screen. This combination of remote and local feedback makes the prompts more prominent and less likely to be missed. The overall solution significantly improves the reliability and immediacy of feedback through simultaneous feedback from multiple dimensions—visual, tactile, and screen display—allowing users to clearly confirm mode changes without relying on specific senses, fundamentally improving the accuracy of one-handed blind operation and the user experience.

[0037] Based on the above solution, in addressing the issue that users may not be able to perceive the switching of operation modes in time when blindly operating a touchpad device with one hand, the integrated design of multi-sensory prompts effectively reduces the possibility of misoperation and significantly improves the user's interactive experience.

[0038] In another embodiment, this application also discloses a touchpad device for implementing the aforementioned method, comprising: Touchpad sensing module, configured to detect user gestures; The status control module is connected to the touchpad sensing module and is configured to switch the current operation mode and generate control commands when the operation gesture is recognized as a preset switching gesture. The feedback module, connected to the status control module, is configured to output feedback prompts based on control commands. The communication module, connected to the status control module, is configured to send control commands to remote screen devices.

[0039] The core innovation of this application lies in combining the touchpad sensing module and the status control module in a functional linkage manner, and introducing a feedback module to provide instant sensory confirmation. This solves the problem that users have difficulty clearly distinguishing between cursor movement and page scrolling functions when blindly operating a touchpad device with one hand, thus significantly improving the accuracy of interaction and user experience.

[0040] In practical applications, the touchpad sensing module serves as the input foundation, capturing user gestures in real time to ensure the device accurately perceives user intentions. The status control module automatically switches operating modes upon recognizing preset switching gestures (such as double-clicking), eliminating the need for users to memorize or locate the physical touchpad area, allowing for single-handed operation without visual assistance to complete mode switching. The feedback module outputs a prompt signal the instant mode switching, allowing users to instantly perceive the current status through multi-sensory channels (such as light changes or vibrations), solving the pain point of not being able to confirm the function mode during blind operation. The communication module reliably transmits control commands to the remote screen, ensuring accurate execution of operation commands. These modules work closely together to form a complete chain from gesture input to status feedback to remote execution, enabling users to reliably distinguish between cursor movement and page scrolling functions even when their gaze is focused on the remote screen, and improving interaction accuracy through real-time feedback.

[0041] In summary, this application constructs a closed-loop control mechanism by integrating four steps: gesture recognition, state switching, feedback prompts, and command execution. This significantly improves the reliability of interaction and user experience under one-handed blind operation. As a preferred implementation method, this approach can significantly improve the accuracy and smoothness of user operation in long-distance interaction scenarios.

[0042] This application further proposes a feedback module that includes at least one of the following: Lighting module, configured to provide visual cues through changes in light emission; A vibration module configured to provide tactile cues by generating vibrations.

[0043] Specifically, the feedback module refers to a set of components used to provide users with information about operating mode switching. It can be implemented using prompts through multiple sensory channels, with the aim of ensuring that users can reliably perceive the mode switching status in different usage scenarios.

[0044] In practical applications, a lighting module refers to a device that provides visual cues to users through changes in light emission status. It can be implemented using LED beads, RGB light strips, etc. These light-emitting elements can change color, brightness, or flashing frequency according to preset rules, thereby forming visual signals corresponding to specific operating modes.

[0045] The vibration module refers to a device that provides tactile feedback to the user through mechanical vibration, which can be implemented using eccentric motors, linear motors, etc. These vibration elements can adjust the vibration intensity, frequency, or duration according to preset rules, thereby generating tactile signals corresponding to specific operating modes.

[0046] The above technical solutions significantly improve the accuracy of user operations in blind operation scenarios and optimize the overall interactive experience.

[0047] In another embodiment, this application also discloses a human-computer interaction system, which includes a touchpad device and a remote screen device. The remote screen device is communicatively connected to the touchpad device, configured to receive control commands, execute cursor movement or page scrolling operations corresponding to the control commands, and display visual prompts of the current operating mode on the screen.

[0048] The core innovation of this embodiment lies in combining the touchpad device and the remote screen device in a collaborative design manner, while introducing an operation mode switching mechanism based on preset switching gestures and an instant feedback prompt function. This solves the problem that users have difficulty clearly distinguishing between cursor movement and page scrolling functions when blindly operating the touchpad device with one hand, thus significantly improving the accuracy of interaction and user experience.

[0049] After establishing a communication connection with the touchpad device, the remote screen device receives control commands and executes corresponding cursor movement or page scrolling operations. Simultaneously, it displays a real-time visual cue of the current operating mode on the screen, allowing the user to instantly know whether the cursor is moving or scrolling while their gaze is focused on the remote screen, effectively eliminating the risk of accidental touches. These two technical features work closely together: the touchpad device focuses on input processing and mode switching, ensuring ease of operation; the remote screen device provides intuitive visual feedback and operation execution, presenting key information directly within the user's field of vision. This allows users to confirm the operating mode without looking down at the device while holding it with one hand, significantly improving the accuracy of interaction and the user experience.

[0050] In another embodiment, this application also discloses a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the screen control method described above.

Claims

1. A screen control method, characterized in that, Includes the following steps: Gesture recognition steps: The touchpad device detects the user's gestures input on its touchpad; State switching steps: When the operation gesture is recognized as a preset switching gesture, the touchpad device switches the current operation mode between a first mode and a second mode, wherein the first mode is a cursor movement mode and the second mode is a page scrolling mode; Feedback prompt steps: While switching operating modes, the touchpad device generates and outputs a feedback prompt signal corresponding to the switched operating mode; Instruction execution steps: Based on the switched operating mode, the touchpad device sends the parsed control instructions to the remote screen device, so that the remote screen device performs the operation corresponding to the control instructions.

2. The screen control method as described in claim 1, characterized in that, The preset switching gesture is a double-tap gesture.

3. The screen control method as described in claim 1, characterized in that, The feedback prompting step includes at least one of the following sub-steps: Control the lighting module of the touchpad device to change its illumination state; The vibration module of the touchpad device is controlled to generate tactile vibrations. Send a prompt command to the remote screen device so that the remote screen device displays a visual prompt of the current operating mode on its screen.

4. The screen control method as described in claim 3, characterized in that, In the feedback prompting step, the control of the light module to change the light emission state, the vibration module to generate tactile vibration, and the sending of prompting instructions to the remote screen device to display visual prompts are executed simultaneously.

5. A touchpad device for implementing the method as described in any one of claims 1 to 4, characterized in that, include: Touchpad sensing module, configured to detect user gestures; A status control module, connected to the touchpad sensing module, is configured to switch the current operation mode and generate control commands when the operation gesture is recognized as a preset switching gesture. A feedback module, connected to the status control module, is configured to output feedback prompts according to the control commands; A communication module, connected to the status control module, is configured to send the control commands to a remote screen device.

6. The touchpad device as claimed in claim 1, characterized in that, The feedback module includes at least one of the following: Lighting module, configured to provide visual cues through changes in light emission; A vibration module configured to provide tactile cues by generating vibrations.

7. A human-computer interaction system, characterized in that, include: The touchpad device as described in claim 5 or 6; A remote screen device is communicatively connected to the touchpad device, configured to receive the control commands, execute cursor movement or page scrolling operations corresponding to the control commands, and display visual prompts of the current operation mode on the screen.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the method as described in any one of claims 1 to 4.

Images