Gesture interaction method, smart ring, storage medium and computer program product

Abstract

The application discloses a gesture interaction method, an intelligent ring, a storage medium and a computer program product, relates to the technical fields of intelligent wearable devices and human-computer interaction, and is applied to the intelligent ring and comprises the following steps: monitoring pressing pressure received by the intelligent ring, collecting interaction data of a user and the intelligent ring in the case that the pressing pressure reaches a preset pressure threshold and the duration of the pressing pressure reaches a preset time threshold, wherein the interaction data comprises at least one of touch operation data and space movement data; identifying a target operation gesture of the user according to the interaction data, converting the target operation gesture into a control instruction, and executing the control instruction. The application solves the technical problem of high false touch rate.

Description

Technical Field

[0001] This application relates to the field of smart wearable devices and human-computer interaction technology, and in particular to a gesture interaction method, system, smart bracelet, storage medium and computer program product. Background Technology

[0002] In daily life, electronic devices are used more and more frequently. For example, users can use electronic devices to make calls and watch multimedia videos. Usually, users operate electronic devices directly with their fingers. However, if users use their fingers to operate electronic devices for too long, it may cause hand discomfort. Furthermore, when using electronic devices such as televisions and air conditioners, remote controls are required. When the remote control is missing or malfunctioning, it becomes difficult to operate the electronic devices. Therefore, to simplify user operation, human-computer interaction solutions based on smart rings have emerged.

[0003] Among existing smart ring interaction technologies, direct gesture recognition is widely used due to its contactless and highly flexible interaction characteristics. However, because it lacks a clear gesture enabling mechanism, everyday user actions (such as grasping objects or unconscious hand movements) are easily misinterpreted as valid commands, and accidental contact between the finger and the ring (such as adjusting its position while wearing it) can trigger erroneous operations. Therefore, current direct gesture recognition solutions suffer from a high rate of false touches.

[0004] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main purpose of this application is to provide a gesture interaction method, system, smart bracelet, storage medium and computer program product, which aims to solve the technical problem of high accidental touch rate.

[0006] To achieve the above objectives, this application proposes a gesture interaction method for use in a smart ring, the gesture interaction method comprising:

[0007] The system monitors the pressure applied to the smart ring. When the pressure reaches a preset pressure threshold and the duration of the pressure reaches a preset time threshold, it collects interaction data between the user and the smart ring. The interaction data includes at least one of touch operation data and spatial movement data.

[0008] The system identifies the user's target gesture based on the interaction data, converts the target gesture into a control command, and executes it.

[0009] In one embodiment, the smart ring includes a capacitive sensing layer and a spatial sensor module, and the step of collecting interaction data between the user and the smart ring includes:

[0010] When a change in the contact area on the smart ring is detected by the capacitive sensing layer, sliding operation data is generated based on the capacitance change signal of the contact area during a target time period, wherein the target time period is determined based on the duration of the pressing pressure.

[0011] When the spatial sensor module detects changes in the linear acceleration and angular velocity data of the smart ring in three-dimensional space, spatial movement data is generated based on the linear acceleration and angular velocity data of the smart ring during the target time period.

[0012] In one embodiment, the target operation gesture includes a target touch gesture, and the step of recognizing the user's target operation gesture based on the interaction data includes:

[0013] When the interactive data includes touch operation data, the pressure path, rate of change, and position combination of the contact area are extracted based on the capacitance change signal in the sliding operation data to construct a touch gesture;

[0014] The touch gesture is compared with each gesture template in the preset gesture mapping library to determine the matching target touch gesture.

[0015] In one embodiment, the target operation gesture further includes a target spatial gesture, and the step of recognizing the user's target operation gesture based on the interaction data further includes:

[0016] When the interactive data includes spatial movement data, the motion trajectory features of the smart ring are extracted based on the linear acceleration and angular velocity data in the spatial movement data to construct spatial gestures;

[0017] The spatial gesture is compared with each gesture template in the preset gesture mapping library to determine the matching target spatial gesture.

[0018] In one embodiment, the smart ring further includes a communication transmission module, and the step of converting the target operation gesture into a control command and executing it includes:

[0019] The control command corresponding to the target operation gesture and the target device corresponding to the control command are obtained based on a preset gesture mapping library.

[0020] The communication transmission module establishes a communication connection with the target device and sends the control command to the target device to execute the control command.

[0021] In one embodiment, the gesture interaction method further includes:

[0022] In custom mode, the user-input gesture chain data is recorded, and pressure changes, orientation, and timing data in the gesture chain data are collected.

[0023] Analyze the pressure changes, the orientation and posture, and the timing data to create corresponding gesture templates and store them in a preset gesture mapping library;

[0024] Receive a function mapping operation, determine the target function and target device corresponding to the function mapping operation, and associate the target function and target device with the gesture template.

[0025] In one embodiment, the step of analyzing the pressure change, the orientation, and the time-series data further includes:

[0026] Calculate the confidence levels corresponding to the pressure change, the orientation, and the time-series data, respectively.

[0027] When the confidence level reaches the corresponding threshold, the steps of parsing the pressure change, the orientation and attitude and the time series data are performed.

[0028] If the confidence level does not reach the corresponding threshold, the user-inputted gesture chain data is ignored.

[0029] Furthermore, to achieve the above objectives, this application also proposes a gesture interaction system for use in a smart ring, the gesture interaction system comprising:

[0030] A gesture receiving module is used to monitor the pressing pressure received by the smart ring. When the pressing pressure reaches a preset pressure threshold and the duration of the pressing pressure reaches a preset time threshold, the module collects the interaction data between the user and the smart ring. The interaction data includes at least one of touch operation data and spatial movement data.

[0031] The gesture interaction module is used to identify the user's target operation gesture based on the interaction data, convert the target operation gesture into a control command, and execute it.

[0032] In addition, to achieve the above objectives, this application also proposes a smart bracelet, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the gesture interaction method described above.

[0033] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the gesture interaction method described above.

[0034] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the gesture interaction method described above.

[0035] This application provides a gesture interaction method applied to a smart ring. The gesture interaction method includes: monitoring the pressing pressure on the smart ring; when the pressing pressure reaches a preset pressure threshold and the duration of the pressing pressure reaches a preset time threshold, collecting interaction data between the user and the smart ring, wherein the interaction data includes at least one of touch operation data and spatial movement data; identifying the user's target operation gesture based on the interaction data, converting the target operation gesture into a control command, and executing it.

[0036] This application uses pressure and duration as gesture enabling mechanisms. Only when the pressure reaches a preset threshold and the duration reaches a preset time threshold will the gesture be recognized and the corresponding command executed. This effectively filters out interference from user actions and accidental touches, significantly reducing false touch rates and improving the accuracy and reliability of gesture interaction, thereby enhancing the user experience. Compared to related solutions that lack clear gesture enabling mechanisms, leading to easy misoperations from user actions and accidental touches, this solution sets specific pressure activation conditions, effectively distinguishing between intentional and unintentional gestures. This avoids the false touch problems caused by the lack of enabling mechanisms in existing solutions, significantly improving the accuracy of gesture interaction, reducing the annoyance caused by false operations, and enabling users to perform gesture interactions more smoothly and accurately, thus improving user satisfaction and operating experience with the smart ring. Attached Figure Description

[0037] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0038] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0039] Figure 1This is a flowchart illustrating an embodiment of the gesture interaction method of this application.

[0040] Figure 2 A schematic diagram of the internal sensors of the smart ring provided for the gesture interaction method of this application;

[0041] Figure 3 A schematic diagram of the smart ring interaction scenario provided for the gesture interaction method of this application;

[0042] Figure 4 This is a flowchart illustrating Embodiment 2 of the gesture interaction method of this application;

[0043] Figure 5 A schematic diagram of the user-defined gesture configuration interface provided for the gesture interaction method of this application;

[0044] Figure 6 A flowchart of the overall gesture interaction method provided for the gesture interaction method of this application;

[0045] Figure 7 A structural diagram of the smart ring system provided for the gesture interaction method of this application;

[0046] Figure 8 This is a schematic diagram of the module structure of the gesture interaction system according to an embodiment of this application;

[0047] Figure 9 This is a schematic diagram of the device structure of the hardware operating environment involved in the gesture interaction method in the embodiments of this application.

[0048] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0049] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0050] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0051] This application embodiment is applied to a smart ring. The main solution is to monitor the pressing pressure on the smart ring, and when the pressing pressure reaches a preset pressure threshold and the duration of the pressing pressure reaches a preset time threshold, collect the interaction data between the user and the smart ring. The interaction data includes at least one of touch operation data and spatial movement data. Based on the interaction data, the user's target operation gesture is identified, and the target operation gesture is converted into a control command and executed.

[0052] In this embodiment, for ease of description, the following description uses a smart ring as the execution subject.

[0053] Because existing technologies lack a clear gesture enabling mechanism, users' daily actions and accidental touches can easily trigger misoperations. This application provides a solution that sets specific press-to-activate conditions, which can effectively distinguish between intentional and unintentional gestures by users. This avoids the accidental touch problem caused by the lack of an enabling mechanism in existing solutions, significantly improves the accuracy of gesture interaction, reduces the annoyance caused by misoperations, and enables users to perform gesture interactions more smoothly and accurately, thereby improving user satisfaction and operating experience with the smart ring.

[0054] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an electronic device or smart ring capable of performing the above functions. The following description uses a smart ring as an example to illustrate this embodiment and the subsequent embodiments.

[0055] Based on this, embodiments of this application provide a gesture interaction method, referring to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the gesture interaction method of this application.

[0056] In this embodiment, the gesture interaction method is applied to a smart ring, including steps S01 to S02:

[0057] Step S01: Monitor the pressing pressure on the smart ring. When the pressing pressure reaches a preset pressure threshold and the duration of the pressing pressure reaches a preset time threshold, collect the interaction data between the user and the smart ring. The interaction data includes at least one of touch operation data and spatial movement data.

[0058] It should be noted that a smart ring is a wearable device that integrates various sensors and control modules. It is usually worn on the finger to detect the user's actions and interact with external devices (such as smartphones, AR / VR headsets, etc.) via wireless communication technology (such as Bluetooth).

[0059] For example, to aid in understanding the technical concept or principles of this application, please refer to Figure 2 , Figure 2A schematic diagram of the internal sensors of the smart ring is provided. The smart ring consists of a skin sensing module, a pressure sensing layer, a capacitance sensing layer, a spatial sensor module, a control chip module, a communication transmission module, a motherboard layer, and a ring enclosure. The skin sensing module identifies changes in skin bioparameters and detects whether the inside of the ring is in contact with the skin, thus determining whether the user is wearing the ring. The pressure sensing layer senses the pressure applied by the user to the inside of the ring and can set pressure and time thresholds to trigger activation; it is key to implementing the "enabling mechanism" and "anti-accidental touch logic." The capacitance sensing layer detects capacitance changes in the area where the ring contacts the skin, determining the finger's swiping and contact states to identify actual finger contact actions, assisting in accidental touch prevention and the enabling mechanism. The spatial sensor module uses an IMU (Inertial Measurement Unit) module... The Inertial Measurement Unit (IMU) senses the ring's position and trajectory in three-dimensional space in real time, thereby determining the movement trajectory of the fingers / hands and enabling spatial gesture interaction (such as swiping, circling, rotating, etc.). The control chip module is equipped with an AI model, a gesture recognition algorithm unit, and a timing logic judgment unit, used to determine whether the current input meets the activation conditions, call the gesture chain recognition logic, and issue commands to external devices. The communication transmission module is used to achieve data interaction with external devices (such as AR glasses, mobile phones) based on wireless communication such as Bluetooth / WiFi, and transmits the control commands recognized by the gestures to the target device in real time, completing the end-to-end interactive closed loop. The motherboard layer is equipped with a multi-sensor signal collection and control circuit, used to integrate the acquisition and relay control of various sensor module signals, and is the core circuit board for system operation. The ring wrapper is used to encapsulate the various modules and circuits, usually made of soft rubber or plastic to ensure the user's comfort when wearing the ring.

[0060] Additionally, it should be noted that a multi-area pressure sensor array is integrated on the pressure sensing layer inside the smart ring. These sensors can monitor the user's finger (such as thumb) pressing behavior (i.e., pressing operation) on a specific area of ​​the ring in real time. When the user wears the smart ring and performs a pressing operation, the pressure sensor array captures the pressure signal generated by the pressing and converts these signals into processable electrical signals. By analyzing these electrical signals in real time, the pressing pressure and duration of the pressing operation can be determined. The pressing pressure refers to the magnitude of the pressure applied by the user's finger to a specific area of ​​the inner wall of the smart ring, usually quantified in Newtons (N), and the duration refers to the duration of the pressure applied by the user's finger to a specific area of ​​the inner wall of the smart ring, usually quantified in seconds (s).

[0061] Additionally, it should be noted that after receiving the press signal from the pressure sensor array, the system makes a judgment based on preset pressure and time thresholds. The preset pressure threshold refers to the minimum pressing pressure value required to trigger gesture recognition. This value is preset by the system and is used to distinguish between unintentional touches and intentional presses by the user. The preset time threshold refers to the minimum pressing duration required to trigger gesture recognition. This value is also preset by the system and is used to ensure the stability and effectiveness of the pressing operation. Only when the pressing pressure reaches or exceeds the preset pressure threshold (e.g., 0.5N) and the duration of the pressing operation reaches or exceeds the preset time threshold (e.g., 0.5 seconds) is it determined that the user intends to perform a gesture operation, and the gesture recognition module is activated to collect the user's interaction data with the smart ring. The interaction data includes at least one of touch operation data and spatial movement data. Touch operation data refers to data related to the user's touch, swipe, and other operations on the smart ring, such as swipe distance and duration. Spatial movement data refers to data related to the movement of the user's finger wearing the smart ring in three-dimensional space, such as linear velocity, angular velocity, and direction.

[0062] Additionally, it should be noted that the pressure sensor array can be replaced with a capacitive touch sensor array. By detecting changes in the capacitance area between the user's finger and the ring (e.g., contact area ≥ 50% of the inner wall of the ring) as the interaction enable signal (i.e., the ring activation signal), no pressure sensor hardware is required, reducing manufacturing costs. Alternatively, a miniature infrared / optical sensor can be embedded on the side of the ring to detect the distance or sliding path of the user's finger as the interaction enable signal. This can achieve a combination of "proximity + swipe" gesture recognition, enabling non-contact triggering and providing better adaptability for wearing gloves or even special scenarios (such as rugged scenarios).

[0063] Additionally, it should be noted that before recognizing the user's target gesture, the pressing pressure and duration are recorded in the historical operation data table. Statistical analysis is performed on the historical pressing pressure and duration in the historical operation data table to extract the distribution characteristics of pressing pressure and duration. The distribution characteristics are analyzed in combination with machine learning algorithms to generate pressure thresholds and time thresholds that match the user's operating habits, and then updated to preset pressure thresholds and preset time thresholds respectively.

[0064] Step S02: Identify the user's target operation gesture based on the interaction data, convert the target operation gesture into a control command, and execute it.

[0065] It should be noted that the target operation gesture is identified by combining the capacitive sensing layer or spatial sensor module. The target operation gesture refers to the gesture formed by the user's finger moving along a specific trajectory on the surface or in space after pressing. This can include touch gestures (such as swiping, tapping, double-tapping) and spatial gestures (such as waving, spinning, moving up and down). The target operation gesture is converted into a specific control command according to a preset gesture mapping library. The preset gesture mapping library is a collection of predefined gesture templates and their corresponding control commands stored inside the smart ring. The control command refers to the corresponding control signal converted by the smart ring according to the identified target operation gesture, which is used to control the target device (such as AR headset, smart speaker, etc.) to perform a specific operation. These control commands are sent to the target device through the communication transmission module to execute the corresponding operation.

[0066] Additionally, it should be noted that the user's target operation gesture can be a touch gesture (two-dimensional) or a spatial gesture (three-dimensional). Different touch gestures and spatial gestures can achieve different or the same functions, and can be configured according to the user's habits.

[0067] For example, please refer to Figure 3 , Figure 3 A schematic diagram of a smart ring interaction scenario is provided. Device A is the target device where the user needs to interact with gestures, and device B is the smart ring worn by the user, specifically on the user's index finger N2. N1 represents the user's thumb. First, smart ring B detects whether the user is wearing the smart ring. After detecting this, pressure-triggered verification is performed. The user's thumb N1 continuously presses on smart ring B. Once smart ring B detects that both the pressure and duration of the pressure meet the requirements, gesture recognition is performed. This includes touch gesture parsing and spatial gesture parsing. For example, if the user's thumb N1 slides in direction 'a' on smart ring B, touch gesture parsing is triggered. The gesture is recognized and matched, and the corresponding command is determined to be "increase volume." The command is then mapped and executed, increasing the volume of device A. In spatial gesture parsing, if the user's index finger N2 moves in direction 'b', spatial gesture parsing is triggered. The gesture is recognized and matched, and the corresponding command is determined to be "increase volume." The command is then mapped and executed, increasing the volume of device A.

[0068] Additionally, it should be noted that when the user releases the pressing area (i.e., the pressing pressure drops below the preset pressure threshold or the duration is too short), the control chip module detects the disappearance of the pressure signal, controls the smart ring to exit the enabled state, and all gesture recognition sub-modules (including the pressure sensing layer, capacitive sensing layer, spatial sensor module, etc.) automatically enter the sleep state, pausing data acquisition to reduce power consumption and extend the device's battery life.

[0069] Additionally, it should be noted that before recognizing the user's target gesture, the user's historical usage data is analyzed and the temporal correlation of the target gesture is extracted (e.g., "page turning" is often followed by a "pause" gesture). Based on the temporal correlation, the user's next gesture is predicted. The historical usage data records the user's frequently used gestures and the corresponding triggering scenarios (e.g., the "AR interface page turning" gesture is used more than 80% of the time during video playback and is usually used together with the "pause" gesture). The gesture templates corresponding to the gestures are preloaded into the cache. When recognizing the user's target gesture, the gesture templates in the cache are called for matching, thereby reducing the template matching time and improving the response speed.

[0070] In this embodiment, by receiving the user's pressing operation on the smart ring and determining the pressing pressure and the duration of the pressing pressure, combined with dual verification (pressing pressure and duration), the system will only determine that the user intentionally made a pressing operation when the pressing pressure and duration reach a preset threshold, and will recognize the user's target operation gesture, convert it into a control command and execute it. Compared with the direct gesture recognition scheme, this scheme adds interactive enable conditions of pressing pressure and duration, effectively filtering out interference from non-target operation gestures such as the user's daily actions and accidental contact, so that the system can more accurately judge the user's interaction intention, thereby significantly reducing the false touch rate.

[0071] In one feasible implementation, in step S01, the smart ring includes a capacitive sensing layer and a spatial sensor module, and the step of collecting interaction data between the user and the smart ring includes steps A01 to A02:

[0072] Step A01: When a change in the contact area on the smart ring is detected by the capacitive sensing layer, sliding operation data is generated based on the capacitance change signal of the contact area during the target time period, wherein the target time period is determined based on the duration of the pressing pressure.

[0073] It's important to note that the capacitive sensing layer is located on the surface of the smart ring. It senses changes in capacitance between the user's finger and the ring's surface, caused by alterations in the electric field distribution when the finger approaches or touches the ring's surface. When a user uses the smart ring to input gestures and control a target device, the user's finger needs to remain pressed on the ring for it to recognize the input. Therefore, the smart ring continuously monitors the pressure applied, determining the time between activating the gesture recognition module and the user completing the input (the target time period), and collects interaction data from the smart ring during this period, laying the foundation for subsequent gesture recognition.

[0074] Additionally, it should be noted that when the smart ring detects a change in the contact area of ​​its surface through the capacitive sensing layer, it captures the capacitance change of the contact area between the user's finger and the smart ring in real time, and converts the capacitance change into an electrical signal, namely the capacitance change signal. This signal reflects the specific operation behavior of the user's finger in the contact area. By analyzing the capacitance change signal within the target time period, information such as the trajectory, direction and speed of the finger sliding can be accurately obtained, and sliding operation data can be generated.

[0075] Step A02: When the spatial sensor module detects changes in the linear acceleration and angular velocity data of the smart ring in three-dimensional space, spatial movement data is generated based on the linear acceleration and angular velocity data of the smart ring during the target time period.

[0076] It should be noted that the spatial sensor module can be a six-axis inertial sensor, including a three-axis accelerometer and a three-axis gyroscope, used to collect the linear acceleration (X / Y / Z axes) and angular velocity (rotation rate around the X / Y / Z axes) of the smart ring in three-dimensional space in real time. When the smart ring detects changes in its linear acceleration and angular velocity data in three-dimensional space through the spatial sensor module, it analyzes the linear acceleration and angular velocity data during the target time period of the continuous pressing pressure to generate spatial movement data.

[0077] In this embodiment, by setting a target time period, it is ensured that the collected data is generated by the user's conscious finger swiping, rather than the result of unconscious contact. Data is collected during the target time period of continuous pressing pressure. Only after the user actively applies pressure and continues for a certain period of time will the monitoring of changes in the contact area begin to generate sliding operation data, avoiding misoperation caused by accidental contact and reducing the false touch rate. By collecting spatial movement data during the target time period of continuous pressing pressure, spatial movement data is only generated when the user actively applies pressure and produces meaningful movement, avoiding misoperation caused by daily actions, further reducing the false touch rate, and improving the accuracy and effectiveness of spatial movement data.

[0078] In one feasible implementation, in step S02, the target operation gesture includes a target touch gesture, and the step of identifying the user's target operation gesture based on the interaction data includes steps A11 to A12:

[0079] Step A11: When the interaction data includes touch operation data, extract the pressure path, change rate and position combination of the contact area based on the capacitance change signal in the sliding operation data to construct the touch gesture.

[0080] It should be noted that when the interaction data includes touch operation data, it indicates that the current user's gesture is a touch gesture. The capacitive sensing layer is divided into multiple detection units, each corresponding to a coordinate region. When the user's finger touches or slides, the initial contact point coordinates are determined based on the group of units with the largest capacitance change signal. A mapping relationship between the physical position of the capacitive sensing layer and a virtual coordinate system (such as a Cartesian coordinate system) is established, converting the discrete capacitance change signal into a continuous spatial coordinate sequence, thereby realizing the transformation of capacitance change signal into two-dimensional coordinate data. The capacitance change signal is analyzed in real time to extract: the sliding trajectory of the user's finger on the capacitive sensing layer (such as a straight line, curve, or broken line), i.e., the pressure path; the instantaneous speed of the capacitance value change, i.e., the rate of change, used to distinguish between fast sliding and slow dragging; and the relative positional relationship of multiple contact points (such as pinching or spreading two fingers), i.e., the position combination.

[0081] Specifically, the steps for extracting the pressure path, rate of change, and location combination of the contact area include:

[0082] Coordinate data of each contact point on the contact area are collected at fixed time intervals (e.g., 10ms) to form a discrete trajectory point sequence. Coordinate jitter is eliminated by interpolation algorithm (e.g., linear interpolation or Bézier curve fitting) to generate a smooth sliding trajectory (e.g., straight line, curve or polyline). Based on the points of sudden change in direction or change in rate, the continuous trajectory is divided into logical segments (e.g., from straight sliding to curved sliding) to generate a pressure path.

[0083] Based on the time difference and coordinate difference between adjacent trajectory points in the discrete trajectory point sequence, the instantaneous velocity is calculated, and a sliding window mean filter (e.g., window width of 5 frames) is used to eliminate short-term jitter interference and generate the rate of change.

[0084] The system identifies all contact areas existing simultaneously in the capacitive sensing layer, identifies the contact points in each contact area, assigns a unique identifier to each contact point, extracts the coordinates and relative distance of each contact point to determine the rate of change of the spacing between contact points, sets a threshold for the rate of change (e.g., 10 pixels / millisecond), filters out minor fluctuations caused by noise or jitter, and determines the movement direction of the contact points (e.g., pinch / spread two fingers) based on the rate of change of the spacing. The number of contact points (e.g., two fingers, three fingers) and the movement direction are encoded into structured parameters (e.g., "two fingers - pinch") to generate position combinations.

[0085] Additionally, it should be noted that after extracting the pressure path, rate of change, and position combination of the contact area, the pressure path is subjected to scaling and rotation invariance processing to ensure the comparability of gestures under different operating scales. The continuity of the timestamps of the trajectory points is checked based on the rate of change to eliminate abnormal jump points caused by signal interference. The pressure path, rate of change, and position combination are integrated into a structured trajectory description, including the path shape, speed distribution, and contact point topology, and finally, a touch gesture is generated.

[0086] Step A12: Compare the touch gesture with each gesture template in the preset gesture mapping library to determine the matching target touch gesture.

[0087] It should be noted that gesture templates are standardized models in a preset gesture mapping library used to describe specific gesture features. Each gesture template corresponds to a specific operation gesture, such as swiping, clicking, or double-tapping. Touch gestures are matched with each gesture template in the preset gesture mapping library. When a gesture template with a similarity exceeding a preset similarity threshold (e.g., 80%) is found, that gesture template is determined to be the target operation gesture.

[0088] Specifically, the matching logic includes:

[0089] The system searches a preset gesture mapping library based on the touchpoint topology to determine if a corresponding multi-finger collaborative gesture (such as three-finger spread, two-finger swipe, etc.) exists. It then uses a trajectory shape matching algorithm (such as Dynamic Time Warping (DTW)) to determine the path shape similarity between the user's gesture and the gesture template. Simultaneously, it checks if the speed distribution exceeds a preset speed range; if so, the operation is deemed invalid. If the path shape similarity reaches a preset similarity threshold and the speed distribution does not exceed the preset speed range, the matched gesture template is used as the target operation gesture.

[0090] Additionally, it should be noted that during the matching process, a large AI model can be used for similarity comparison. Based on the preset large AI model, a gesture template matching the touch gesture can be found in the preset gesture mapping library and used as the target operation gesture.

[0091] In this embodiment, by monitoring the capacitance changes in the contact area between the user and the smart ring in real time, it is possible to accurately determine whether the user's finger is actually in contact with the ring. Based on the capacitance change signal, the pressure path, rate of change, and position combination of the contact area are extracted to construct the user's touch gesture. This can more accurately identify the user's gesture and avoid misjudging instantaneous or accidental actions as valid gestures. The touch gesture is compared with each gesture template in the preset gesture mapping library to determine the matching target operation gesture, thereby accurately responding to the user's interaction intent and improving the accuracy and stability of the interaction.

[0092] In one feasible implementation, in step S02, the target operation gesture further includes a target spatial gesture, and the step of identifying the user's target operation gesture based on the interaction data further includes steps A21 to A22:

[0093] Step A21: When the interactive data includes spatial movement data, extract the motion trajectory features of the smart ring based on the linear acceleration and angular velocity data in the spatial movement data, and construct spatial gestures;

[0094] It should be noted that when the interaction data includes spatial movement data, it indicates that the current user's gesture is a spatial gesture. The spatial movement data is filtered (e.g., Kalman filtering) to eliminate noise interference and normalized to unify dimensions. The instantaneous direction of the hand movement (e.g., horizontal waving, vertical ascent / descent) is calculated using linear acceleration and angular velocity, and the acceleration integrals of linear acceleration and angular velocity are calculated. Based on the acceleration integrals, the displacement amplitude is calculated, distinguishing between small fine adjustments and large movements (e.g., slight shaking and rapid waving). Furthermore, the temporal characteristics of the movement need to be recorded, and the gesture duration needs to be analyzed to see if it conforms to a preset time range (e.g., drawing a circle must last ≥0.3 seconds). The instantaneous direction, displacement amplitude, and temporal characteristics are fused to generate a spatial gesture (e.g., spiral ascent, wavy line, etc.).

[0095] Step A22: Compare the spatial gesture with each gesture template in the preset gesture mapping library to determine the matching target spatial gesture.

[0096] It should be noted that the similarity between the spatial gesture and the gesture template in the preset gesture mapping library is calculated. The overlap of the spatial gesture is evaluated by dynamic time warping (DTW) or Euclidean distance, and it is determined whether the direction of the spatial gesture is consistent with the corresponding direction of the gesture template (e.g., distinguishing between clockwise and counterclockwise circles). A comprehensive score is generated based on the overlap of the trajectory and the temporal matching degree. If the score exceeds the preset score threshold (e.g., ≥80%), it is determined to be the matched target operation gesture.

[0097] Similarly, when performing matching, a large AI model can be used to compare similarity. Based on the preset large AI model, a gesture template that matches the spatial gesture can be found in the preset gesture mapping library as the target operation gesture.

[0098] In this embodiment, the linear acceleration and angular velocity of the smart ring in three-dimensional space are monitored in real time by a spatial sensor module to generate a precise inertial data sequence. Based on the inertial data sequence, the characteristics of the motion trajectory, such as direction, speed, and acceleration changes, are extracted to construct a precise spatial gesture. This avoids misjudging non-intended actions as valid gestures. The spatial gesture is compared with each gesture template in a preset gesture mapping library. By calculating the similarity or matching degree, the target operation gesture is determined, thereby accurately responding to the user's interactive intent in three-dimensional space, improving the accuracy and stability of the interaction, and reducing the occurrence of accidental touches.

[0099] In one feasible implementation, in step S02, the smart ring further includes a communication transmission module, and the step of converting the target operation gesture into a control command and executing it includes steps A31 to A32:

[0100] Step A31: Obtain the control command corresponding to the target operation gesture and the target device corresponding to the control command based on the preset gesture mapping library;

[0101] It should be noted that the preset gesture mapping library contains various gesture templates that users may perform (including but not limited to swiping, clicking, waving, spinning, and other two-dimensional and three-dimensional gestures), and each gesture template corresponds one-to-one with a specific control command. In addition to the mapping between gestures and control commands, the gesture mapping library also contains the target device corresponding to each control command. When the smart ring recognizes the target operation gesture, it can not only determine the control command corresponding to the gesture, but also know which device the command should be sent to for execution.

[0102] Step A32: Establish a communication connection with the target device through the communication transmission module, and send control commands to the target device to execute the control commands.

[0103] It should be noted that the communication transmission module is responsible for data transmission and communication between the smart ring and external devices (such as smartphones, smart home devices, AR / VR headsets, etc.). It can use wireless communication technologies such as Bluetooth, Wi-Fi, and Zigbee to ensure that the smart ring can exchange data with the target device stably and efficiently. The smart ring's communication transmission module attempts to pair with the target device based on the target device obtained in step A31 and conducts connection negotiation to ensure that both parties can correctly identify and establish a stable communication connection. Once the communication connection is successfully established, the smart ring's communication transmission module will send the control commands obtained in step A31 to the target device. After receiving the control commands, the target device will perform corresponding operations according to the command content, such as adjusting the volume or switching music playlists.

[0104] In this embodiment, based on a preset gesture mapping library, the user's target gesture is accurately mapped to the corresponding control command, ensuring that the executed command matches the user's intention. Figure 1 Furthermore, it determines which target device the control command should be sent to, avoiding the situation where the command is sent to the wrong device, thus improving the accuracy and efficiency of the interaction. By establishing a stable communication connection with the target device through the communication transmission module, it ensures that the control command can be transmitted accurately. Once the communication connection is established, the system can quickly send the control command to the target device and ensure that the command is executed in a timely manner, thereby improving the response speed and accuracy of the interaction.

[0105] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in the first embodiment described above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 4 The gesture interaction method also includes steps S11 to S13:

[0106] Step S11: In custom mode, record the user-input gesture chain data and collect pressure changes, orientation, and timing data from the gesture chain data.

[0107] It's important to note that when a user selects a custom gesture in the application associated with the smart ring (i.e., enters custom mode), the application interacts with the smart ring's control chip module via a communication transmission module. This transmission of the gesture template input operation is a command from the user to the smart ring, informing it that they wish to customize a specific gesture template so that the ring can subsequently trigger corresponding functions by recognizing that gesture. Upon receiving the gesture template input operation, the smart ring records the user's gesture chain data in real time. This data consists of a series of continuous gesture-related information recorded by the smart ring during the gesture template input operation, encompassing the complete process of the user's gesture, from start to finish, covering various details of the user's finger movements on the smart ring. The pressure sensing layer continuously monitors the change in pressure applied by the user's finger to the smart ring over time; the spatial sensor module tracks the smart ring's acceleration and angle data changes in three-dimensional space; and the system adds a timestamp to each data point, recording time-series data. This time-series data represents the temporal order of events within the gesture chain data.

[0108] Step S12: Analyze pressure changes, orientation, and timing data, establish corresponding gesture templates, and store them in a preset gesture mapping library;

[0109] It should be noted that the machine analyzes the collected pressure change, orientation, and timing data: extracting the pressure peak, duration, and trend (e.g., gradual or instantaneous pressure) to generate pressure features; calculating the displacement trajectory of the hand movement using acceleration data from the orientation data, and calculating the rotation angle (e.g., 180° rotation around the Z-axis) using angular velocity data, and combining the displacement trajectory and rotation angle to determine the orientation features; marking the start and end times of each sub-action based on timing data to construct the timing features of the action chain (e.g., "press → draw a circle" requires an interval of ≤0.2 seconds). The pressure features, orientation features, and timing features are integrated into a trajectory feature vector, and the standardized trajectory feature vector is stored in a preset gesture mapping library, associated with a unique identifier (e.g., "gesture ID-003").

[0110] Step S13: Receive function mapping operation, determine the target function and target device corresponding to the function mapping operation, and associate the target function and target device with the gesture template.

[0111] It should be noted that users select a target function (such as "light switch" or "volume adjustment") and a target device (such as a smart bulb or smart speaker) in the application software, and bind them to a stored gesture template. This process encapsulates the target function, target device, and corresponding gesture template into a function mapping operation, which is then sent to the smart ring via the communication transmission module. Upon receiving the function mapping operation, the smart ring parses it to obtain the target function, target device, and corresponding gesture template. It then adds a target function tag and a target device tag to the gesture template in the preset gesture mapping library to associate the target function and target device with the gesture template.

[0112] For example, to aid in understanding the technical concept or principles of this application, please refer to Figure 5 , Figure 5 A user-defined gesture configuration interface diagram is provided. The customization process includes three steps: pressure enable setting, gesture type selection, and gesture chain editing. In the pressure enable setting section, the pressure threshold and trigger duration can be set. In the gesture type selection section, gestures can be chosen from a gesture library, including touch gestures and spatial gestures, and custom gestures can also be created. Gestures can be applied simultaneously; for example, both spatial gestures (e.g., gesture 5) and custom gestures (e.g., gesture 9) can be selected at the same time. In the gesture chain editing section, the function name corresponding to each gesture can be set, and the corresponding function settings can be declared. The gesture chain can be customized in module C, such as adjusting the order of gestures 5 and 9, and adjusting the corresponding functions. After completing the custom gesture configuration, it can be saved and exported, and a reset function is also supported. After completion, the user can choose to return and exit the interface. In addition, the preset gesture library, import settings, and device connection module all support user customization, which will not be elaborated further here.

[0113] In this embodiment, users can customize gesture templates according to their own habits and needs, which improves the personalization of gesture recognition. By analyzing pressure changes, orientation, posture and timing data, accurate gesture templates are established to accurately reflect the user's gesture habits. The established gesture templates are stored in a preset gesture mapping library for easy subsequent gesture recognition and retrieval, which improves the management efficiency of gesture templates. Users can associate gesture templates with the required functions and target devices through intuitive function mapping operations, which improves the convenience and intuitiveness of operation. Associating target functions and target devices with gesture templates allows users to trigger specific functions or control specific devices by performing specific gestures, realizing flexible association between gestures and functions.

[0114] In one feasible implementation, steps B01 to B03 are included before the step of parsing pressure changes, orientation, and timing data in step S12:

[0115] Step B01: Calculate the confidence levels corresponding to pressure changes, orientation, and time series data, respectively.

[0116] It should be noted that confidence score is a quantitative score of the quality and reliability of pressure changes, orientation, and time series data in gesture chain data. It is used to determine whether user input has a clear intent and conforms to preset logic.

[0117] Additionally, it should be noted that when calculating the confidence level of pressure change, the input pressure is collected in real time, the fluctuation range of the input pressure is calculated, and the stability score is evaluated based on the fluctuation range; the duration of the input pressure is calculated, and the duration score is evaluated based on the duration; the pressure change trend of the input pressure is calculated, and the reasonableness score is evaluated based on the pressure change trend; the stability score, duration score, and reasonableness score are combined according to their weights to obtain the confidence level of pressure change.

[0118] Specifically, the steps for calculating the confidence level of pressure changes include: real-time acquisition of input pressure, calculation of the fluctuation range of input pressure; if the pressure fluctuation range does not exceed a preset threshold (e.g., 10% of the maximum pressure value), the stability score is increased; if the pressure fluctuation range exceeds the preset threshold (e.g., a sudden increase or decrease exceeding 20%), the stability score is decreased; determining whether the duration of the input pressure conforms to a preset time interval (e.g., 0.3 seconds to 2 seconds); if it conforms to the preset time interval, the duration score is increased; if it does not conform to the preset time interval, the duration score is decreased; analyzing whether the pressure change trend of the input pressure conforms to a preset pattern (e.g., continuous increase / decrease, remaining stable, etc.); if the pressure change trend does not conform to the preset pattern, it is judged as an irregular trend, and the rationality score is decreased; otherwise, the rationality score is increased; and combining the stability score, duration score, and rationality score according to the weight ratio of each score to generate the confidence level of the pressure change.

[0119] Additionally, it should be noted that when calculating the confidence level of directional attitude, the pressure direction is collected in real time, and residual analysis is performed on the filtered pressure direction to obtain the noise level corresponding to the pressure direction. The noise suppression score is evaluated based on the noise level. The abrupt change angle of the pressure direction is detected, and the trajectory coherence score is evaluated based on the abrupt change angle. When the user input is detected as a periodic action, the closure score is evaluated based on the spatial deviation between the start and end points in the input trajectory corresponding to the periodic action. The noise suppression score, trajectory coherence score, and closure score are combined according to weights to obtain the confidence level of pressure change.

[0120] Specifically, the steps for calculating the confidence level of orientation and attitude include: real-time acquisition of pressure direction; residual analysis after filtering algorithm to quantify the noise level corresponding to the pressure direction; if the noise level is lower than a preset noise threshold, increase the noise suppression score, otherwise decrease the noise suppression score; detect the abrupt change angle of the pressure direction; if the abrupt change angle is lower than a preset abrupt change threshold, increase the trajectory coherence score, otherwise decrease the trajectory coherence score; if the user input is detected as a periodic action (such as drawing a circle, spiraling, etc.), verify the spatial deviation between the start and end points in the input trajectory corresponding to the periodic action; if the spatial deviation is lower than a preset deviation threshold, increase the closure score, otherwise decrease the closure score; and combine the noise suppression score, trajectory coherence score, and closure score according to the weight ratio of each score to generate the confidence level of orientation and attitude.

[0121] Additionally, it should be noted that when calculating the confidence level of time-series data, the time series corresponding to user input sub-actions are collected in real time. The time difference between adjacent sub-actions is calculated based on the time series. If the time difference does not conform to the preset time difference (e.g., 0.1 seconds to 0.5 seconds), a standard time difference is calculated based on the deviation. The confidence level of the time-series data is then calculated based on the ratio of the standard time difference to the actual time difference. If the time difference conforms to the preset time difference, the confidence level of the time-series data is full. For example, if the time difference is 0.6 seconds and the deviation is 0.1 seconds, then the standard time difference is 0.6 - 0.1 = 0.5 seconds. The ratio of the standard time difference to the actual time difference is 5 / 6, which translates to a score of 83.3 out of 100. Therefore, the confidence level of the time-series data is 83.3.

[0122] Additionally, it should be noted that when calculating the confidence scores for pressure changes, orientation, and time series data, a pre-set AI model can be used to predict the normality scores for pressure changes, orientation, and time series data, and the corresponding confidence scores can be generated based on the normality scores.

[0123] Step B02 involves performing the steps of analyzing pressure changes, orientation, and time-series data when the confidence level reaches the corresponding threshold.

[0124] It should be noted that when the confidence level of pressure change reaches the corresponding threshold, the confidence level of orientation and attitude reaches the corresponding threshold, and the confidence level of time series data reaches the corresponding threshold, step S12, namely the step of parsing pressure change, orientation and attitude and time series data, is executed.

[0125] Step B03: Ignore the user-inputted gesture chain data if the confidence level does not reach the corresponding threshold.

[0126] It should be noted that if the confidence level of any one of the data points—pressure change, orientation, or time series data—does not reach the corresponding threshold, the smart ring will ignore the user's input gesture chain data and will not perform subsequent parsing or gesture template creation operations.

[0127] In this embodiment, the reliability of pressure changes, orientation, and time-series data is quantified by calculating confidence levels, providing an objective basis for subsequent data filtering and improving the targeting and accuracy of data filtering. Data is only parsed when its confidence level reaches a corresponding threshold, ensuring that the data used for gesture template creation is reliable and improving the accuracy of gesture recognition. By reasonably setting the confidence threshold, unnecessary calculations and data parsing are avoided, improving operational efficiency. By ignoring unreliable gesture chain data, the storage, processing, and transmission of invalid data are reduced, saving system resources and improving system operational efficiency. This effectively avoids accidental touch operations caused by processing unreliable data, improving the accuracy and stability of gesture interaction.

[0128] For example, to aid in understanding the technical concept or principles of this application, please refer to Figure 6 and Figure 7 , Figure 6 A flowchart of the overall gesture interaction method is provided. Figure 7 A framework diagram of the smart ring system is provided.

[0129] like Figure 6As shown, after the user wears the smart ring and presses the trigger area, the smart ring determines whether the pressing pressure and duration are met, thus filtering out accidental touches. If the pressing pressure and duration are met, the recognition module is activated to collect data. Multiple sensors sample in parallel. For the capacitive sensor (i.e., the capacitive sensing layer), the touch gesture recognition module is activated; for the spatial sensor module, the spatial gesture recognition module is activated. Feature extraction is performed on the recognition results of the touch gesture recognition module and the spatial gesture recognition module. The combination of trajectory / force / angle features is analyzed to identify touch gestures such as sliding, clicking, and double-clicking, as well as spatial gestures such as waving and drawing circles. Command parsing and mapping are performed based on the gestures to clarify the specific functions, execute preset / custom functions, and provide status feedback to the user on the task status. After completion, the status is reset.

[0130] like Figure 7 As shown, the smart ring system includes an information acquisition and sensing module, a gesture recognition and parsing module, an instruction mapping and execution module, and a communication and system support module. In the information acquisition and sensing module, the acquisition results from the pressure sensor and IMU inertial sensor are transmitted to the multi-channel data sampling and filtering unit for data integration and preprocessing. Combined with gesture trigger detection logic, it determines whether the user has initiated a valid press operation. In the gesture recognition and parsing module, the judgment result from the information acquisition and sensing module is received, and the duration of the press operation is verified according to the gesture enable judgment mechanism. If the condition is met, the gesture data is recognized through spatial trajectory modeling and the gesture action chain recognition engine, and multimodal fusion judgment is performed to determine the user's gesture. The command mapping and execution module receives the user's gesture determined in the gesture recognition and parsing module, determines the corresponding control command based on the action function mapping table, and associates the action function mapping table with the user-defined command configuration interface, supporting user-defined gestures and commands. The execution logic controller executes the control command, triggering peripheral control and feedback output. The communication and system support module sends the control command to external devices and the interaction platform for execution. Specifically, control commands can be sent through the Bluetooth Low Energy communication interface and the control command relay interface, ensuring system time synchronization and task scheduling. External devices and interaction platforms include, but are not limited to, smart terminals, visual debugging and configuration platforms, smart home devices, or IoT devices.

[0131] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the gesture interaction method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0132] This application also provides a gesture interaction system for use in a smart ring; please refer to [reference needed]. Figure 8 The gesture interaction system includes:

[0133] The gesture receiving module 10 is used to monitor the pressing pressure received by the smart ring. When the pressing pressure reaches a preset pressure threshold and the duration of the pressing pressure reaches a preset time threshold, it collects the interaction data between the user and the smart ring. The interaction data includes at least one of touch operation data and spatial movement data.

[0134] The gesture interaction module 20 is used to identify the user's target operation gesture based on the interaction data, convert the target operation gesture into control commands, and execute them.

[0135] Optionally, the smart ring includes a capacitive sensing layer and a spatial sensor module, and the gesture receiving module 10 is also used for:

[0136] When a change in the contact area on the smart ring is detected by the capacitive sensing layer, sliding operation data is generated based on the capacitance change signal of the contact area during the target time period, wherein the target time period is determined based on the duration of the pressing pressure.

[0137] When the spatial sensor module detects changes in the linear acceleration and angular velocity data of the smart ring in three-dimensional space, spatial movement data is generated based on the linear acceleration and angular velocity data of the smart ring during the target time period.

[0138] Optionally, the target operation gesture includes a target touch gesture, and the gesture interaction module 20 is also used for:

[0139] When the interactive data includes touch operation data, the pressure path, rate of change and position combination of the contact area are extracted based on the capacitance change signal in the sliding operation data to construct the touch gesture.

[0140] The touch gesture is compared with each gesture template in the preset gesture mapping library to determine the matching target touch gesture.

[0141] Optionally, the target operation gesture also includes a target space gesture, and the gesture interaction module 20 is further used for:

[0142] When the interactive data includes spatial movement data, the motion trajectory features of the smart ring are extracted based on the linear acceleration and angular velocity data in the spatial movement data to construct spatial gestures;

[0143] The spatial gesture is compared with each gesture template in the preset gesture mapping library to determine the matching target spatial gesture.

[0144] Optionally, the smart ring also includes a communication transmission module, and the gesture interaction module 20 is further used for:

[0145] Based on a preset gesture mapping library, obtain the control command corresponding to the target operation gesture and the target device corresponding to the control command;

[0146] A communication connection is established with the target device through the communication transmission module, and control commands are sent to the target device to execute the control commands.

[0147] Optionally, the gesture interaction system also includes a gesture input module 30, which is used for:

[0148] When a gesture template input operation is received in custom mode, the user's input gesture chain data is recorded, and the pressure change, orientation, and timing data in the gesture chain data are collected.

[0149] Analyze pressure changes, orientation and timing data, create corresponding gesture templates and store them in a preset gesture mapping library;

[0150] Receive function mapping operation, determine the target function and target device corresponding to the function mapping operation, and associate the target function and target device with the gesture template.

[0151] Optionally, the gesture input module 30 is also used for:

[0152] Calculate the confidence levels for pressure changes, orientation, and time-series data respectively;

[0153] When the confidence level reaches the corresponding threshold, the steps of analyzing pressure changes, orientation, and time series data are performed.

[0154] If the confidence level does not reach the corresponding threshold, ignore the user's input gesture chain data.

[0155] The gesture interaction system provided in this application, employing the gesture interaction method in the above embodiments, can solve the technical problem of high accidental touch rate. Compared with the prior art, the beneficial effects of the gesture interaction system provided in this application are the same as those of the gesture interaction method provided in the above embodiments, and other technical features of the gesture interaction system are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0156] This application provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the gesture interaction method in Embodiment 1 above.

[0157] The following is for reference. Figure 9The diagram illustrates a structural schematic of an electronic device suitable for implementing embodiments of this application. The electronic devices in these embodiments may include, but are not limited to, mobile terminals such as mobile phones, laptops, PADs (Portable Application Description: Tablet PCs), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 9 The electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0158] like Figure 9 As shown, the electronic device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory 1002 or a program loaded from a storage device 1003 into a random access memory 1004. The random access memory 1004 also stores various programs and data required for the operation of the electronic device. The processing unit 1001, the read-only memory 1002, and the random access memory 1004 are interconnected via a bus 1005. An input / output interface 1006 is also connected to the bus. Typically, the following systems can be connected to the input / output interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. The communication device 1009 allows the electronic device to exchange data via wireless or wired communication with other devices. Although the diagram shows electronic devices with various systems, it should be understood that it is not required to implement or have all of the systems shown. More or fewer systems may be implemented alternatively.

[0159] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from read-only memory 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0160] The electronic device provided in this application, employing the gesture interaction method in the above embodiments, can solve the technical problem of high accidental touch rate. Compared with the prior art, the beneficial effects of the electronic device provided in this application are the same as those of the gesture interaction method provided in the above embodiments, and other technical features of the electronic device are the same as those disclosed in the method of the previous embodiment, and will not be repeated here.

[0161] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0162] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0163] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the gesture interaction method in the above embodiments.

[0164] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0165] The aforementioned computer-readable storage medium may be included in an electronic device or may exist independently without being assembled into an electronic device.

[0166] The aforementioned computer-readable storage medium carries one or more programs. When the aforementioned one or more programs are executed by an electronic device, the gesture interaction device is applied to the smart ring, enabling it to monitor the pressing pressure received by the smart ring. When the pressing pressure reaches a preset pressure threshold and the duration of the pressing pressure reaches a preset time threshold, the device collects interaction data between the user and the smart ring. The interaction data includes at least one of touch operation data and spatial movement data. Based on the interaction data, the device identifies the user's target operation gesture, converts the target operation gesture into a control command, and executes it.

[0167] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0168] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0169] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0170] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., computer programs) for executing the above-described gesture interaction method, thereby solving the technical problem of high accidental touch rate. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the gesture interaction method provided in the above embodiments, and will not be repeated here.

[0171] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the gesture interaction method described above.

[0172] The computer program product provided in this application can solve the technical problem of high accidental touch rate. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the gesture interaction method provided in the above embodiments, and will not be repeated here.

[0173] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A gesture interaction method, characterized in that, Applied to smart rings, the gesture interaction method includes: The system monitors the pressure applied to the smart ring. When the pressure reaches a preset pressure threshold and the duration of the pressure reaches a preset time threshold, it collects interaction data between the user and the smart ring. The interaction data includes at least one of touch operation data and spatial movement data. The system identifies the user's target gesture based on the interaction data, converts the target gesture into a control command, and executes it. The target gesture includes target touch gestures and spatial gestures; different touch gestures and spatial gestures may perform different or the same functions. Before identifying the user's target gesture, the pressing pressure and duration are recorded in a historical operation data table. Statistical analysis is performed on the historical pressing pressure and duration in the historical operation data table to extract the distribution characteristics of pressing pressure and duration. This distribution characteristic is then analyzed using machine learning algorithms to generate pressure thresholds and time thresholds that match the user's operating habits, and these thresholds are updated to preset pressure thresholds and preset time thresholds, respectively. Before recognizing the user's target gesture, the user's next gesture is predicted based on the user's frequently used gestures and the triggering scenarios corresponding to the frequently used gestures. The gesture template corresponding to the gesture is preloaded into the cache. When recognizing the user's target gesture, the gesture template in the cache is called for matching. In custom mode, the user-input gesture chain data is recorded, and pressure changes, orientation, and timing data in the gesture chain data are collected. Calculate the confidence levels corresponding to the pressure change, the orientation, and the time-series data, respectively. When calculating the confidence level of the pressure change, the input pressure is collected in real time. A stability score is evaluated based on the fluctuation range of the input pressure, a duration score is evaluated based on the duration of the input pressure, and a reasonableness score is evaluated based on the pressure change trend of the input pressure. The stability score, the duration score, and the reasonableness score are then combined according to their weights to obtain the confidence level of the pressure change. When calculating the confidence level of the directional attitude, the pressure direction is acquired in real time. Residual analysis is performed on the filtered pressure direction to obtain the noise level corresponding to the pressure direction. A noise suppression score is evaluated based on the noise level. Abrupt angles in the pressure direction are detected, and trajectory coherence scores are evaluated based on these abrupt angles. If the user input is detected as a periodic action, a closure score is evaluated based on the spatial deviation between the start and end points of the input trajectory corresponding to the periodic action. The noise suppression score, trajectory coherence score, and closure score are then weighted and combined to obtain the confidence level of the pressure change. When calculating the confidence level of the time series data, the time series corresponding to the user input sub-actions are collected in real time. The time difference between adjacent sub-actions is calculated based on the time series. If the time difference does not meet the preset time difference, a standard time difference is calculated based on the deviation of the time difference. The confidence level of the time series data is calculated based on the ratio of the standard time difference to the time difference. If the time difference meets the preset time difference, the confidence level of the time series data is full. If the confidence level does not reach the corresponding threshold, the user-input gesture chain data is ignored; When the confidence level reaches the corresponding threshold, the pressure change, the orientation and posture and the time series data are analyzed, a corresponding gesture template is established and stored in a preset gesture mapping library; Receive a function mapping operation, determine the target function and target device corresponding to the function mapping operation, and associate the target function and target device with the gesture template.

2. The gesture interaction method as described in claim 1, characterized in that, The smart ring includes a capacitive sensing layer and a spatial sensor module. The step of collecting interaction data between the user and the smart ring includes: When a change in the contact area on the smart ring is detected by the capacitive sensing layer, sliding operation data is generated based on the capacitance change signal of the contact area during a target time period, wherein the target time period is determined based on the duration of the pressing pressure. When the spatial sensor module detects changes in the linear acceleration and angular velocity data of the smart ring in three-dimensional space, spatial movement data is generated based on the linear acceleration and angular velocity data of the smart ring during the target time period.

3. The gesture interaction method as described in claim 2, characterized in that, The step of recognizing the user's target gesture based on the interaction data includes: When the interactive data includes touch operation data, the pressure path, rate of change, and position combination of the contact area are extracted based on the capacitance change signal in the sliding operation data to construct a touch gesture; The touch gesture is compared with each gesture template in the preset gesture mapping library to determine the matching target touch gesture.

4. The gesture interaction method as described in claim 2, characterized in that, The step of recognizing the user's target gesture based on the interaction data further includes: When the interactive data includes spatial movement data, the motion trajectory features of the smart ring are extracted based on the linear acceleration and angular velocity data in the spatial movement data to construct spatial gestures; The spatial gesture is compared with each gesture template in the preset gesture mapping library to determine the matching target spatial gesture.

5. The gesture interaction method as described in claim 1, characterized in that, The smart ring also includes a communication transmission module, and the step of converting the target gesture into a control command and executing it includes: The control command corresponding to the target operation gesture and the target device corresponding to the control command are obtained based on a preset gesture mapping library. The communication transmission module establishes a communication connection with the target device and sends the control command to the target device to execute the control command.

6. A smart ring, characterized in that, The smart ring includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the gesture interaction method as described in any one of claims 1 to 5.

7. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the gesture interaction method as described in any one of claims 1 to 5.

8. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the gesture interaction method as described in any one of claims 1 to 5.

Images