Virtual-air action control method and system based on multi-finger cooperation

Abstract

The invention discloses a virtual and empty action control method based on multi-finger cooperation. The method comprises the steps that a user wears at least two intelligent rings on different fingers; acquiring sensor data of each intelligent ring in real time; on the basis of the sensor data, identifying a hand posture, finger actions and a multi-finger relative relationship of the user; mapping the identified posture, action and relation into a standard control instruction conforming to a human-machine interface device HID protocol; and wirelessly sending the standard control instruction to a target electronic device so as to realize non-contact virtual-air operation. The invention further discloses a system for controlling the virtual and empty actions based on multi-finger cooperation, the at least two intelligent finger ring units can work cooperatively, and the microcontroller is configured to execute the method.

Description

Technical Field

[0001] This invention belongs to the field of human-computer interaction and wearable device technology, specifically relating to a virtual motion control method and system based on multi-finger collaboration. Background Technology

[0002] Currently, in scenarios such as large-screen presentations, remote conferencing, and teaching demonstrations, users often need to be away from the device's operating interface. Traditional mice, touchpads, or remote controls are inconvenient to use and restrict the freedom of physical expression. Although there are camera-based gesture recognition solutions (such as Leap Motion and Kinect), they rely on external devices, are susceptible to lighting interference, and have poor portability.

[0003] Existing wearable ring products are mostly used for health monitoring or simple clicking, and cannot realize full mouse functions (such as cursor movement, clicking, scroll wheel, right-click menu, etc.), and lack support for multi-finger collaboration and dynamic switching of operation modes.

[0004] Currently, most mainstream touchscreen devices require physical contact with the screen for operation, making them unusable during presentations, remote collaborations, or when hands are unavailable. Existing air gesture solutions (such as VR bare-hand tracking) rely on vision systems and cannot reliably recognize subtle scaling movements when fingers are obstructed, in low light, or during high-speed movement, resulting in a fragmented experience.

[0005] Mainstream game consoles (such as PlayStation, Xbox, and Nintendo Switch) rely on physical controllers, which, while feature-rich, suffer from the following problems: The controls require fingers to be fixed on the buttons / joysticks, reducing immersion. The motion sensing function has low accuracy and is prone to drift. In current mainstream AR (Augmented Reality) and VR (Virtual Reality) devices, the interaction methods still have significant limitations: Most rely on handheld controllers (such as the Quest Touch controllers), which are bulky, require two hands to hold, and disrupt the immersive experience. A few support bare-hand tracking (such as Quest gesture recognition), but due to limitations in camera field of view, lighting conditions, and finger obstruction, the accuracy is low, the latency is high, and it cannot recognize subtle movements (such as tapping, pressing, and pinching). Existing technologies rely on physical controllers and cameras, which suffer from problems such as inconvenience in operation, low accuracy, and high environmental requirements. Summary of the Invention

[0006] The purpose of this invention is to provide a contactless operation control method based on a wearable ring to solve the problems of low interaction freedom, reliance on external devices, and poor accuracy in existing technologies.

[0007] A virtual motion control method based on multi-finger collaboration includes: Users wear at least two smart rings on different fingers; Real-time acquisition of sensor data from each of the smart rings; Based on the sensor data, the user's hand posture, finger movements, and relative relationships between multiple fingers are identified; The identified postures, actions, and relationships are mapped into standard control commands that conform to the HID protocol of human-machine interface devices; The standard control commands are wirelessly transmitted to the target electronic device to achieve contactless virtual operation.

[0008] Furthermore, the identification of the user's hand posture, finger movements, and relative relationships between multiple fingers includes: Based on specific actions of the ring worn on the thumb, the current operating mode is dynamically switched; in different operating modes, the same actions of the non-thumb ring are mapped to different control commands.

[0009] Furthermore, the operation mode includes at least one of mouse mode, scroll wheel mode, and writing mode.

[0010] Furthermore, in the mouse mode, the thumb ring is in a neutral position, the index finger ring is in a neutral position, and hand lateral movement is mapped to cursor movement; In the mouse mode, the thumb ring is in a neutral position, and a single bend of the index finger ring is mapped to a left mouse click; In the mouse mode, the thumb ring is in a neutral position, and the middle finger ring bends once, which is mapped to a right mouse click. In the mouse mode, the thumb ring is in a neutral position, the index finger ring is bent and held, and the hand moves up, down, left, and right, which is mapped to dragging the left mouse button. In the mouse mode, the thumb ring is in a neutral position, the middle finger ring is bent and held in place, and the hand moves up, down, left, and right, which is mapped to dragging the right mouse button. In the scroll wheel mode: when the thumb ring is in the raised position, the index finger ring moves upward and accelerates, and the hand moves upward and accelerates, which is mapped to the page scrolling upward; when the thumb ring is in the raised position, the index finger ring moves downward and accelerates, and the hand moves downward and accelerates, which is mapped to the page scrolling downward. In the writing mode, the thumb, index finger and middle finger wear the ring. When the thumb presses / bends inward, the index finger is lifted and moves along a trajectory. When the middle finger bends inward, the hand movement drives the fingertip of the index finger to point up, down and left and right to write. The movement trajectory of the fingertip of the index finger is mapped to handwriting input. In the writing mode, the thumb and index finger wear the rings, the thumb presses / bends inward, and the tips of the index finger and thumb are close together and kept still to form a pen-holding posture. The hand movement drives the thumb and index finger tips to twist the pen and write up, down, left and right. The movement trajectory of the thumb and index finger tips is mapped to handwriting input.

[0011] Furthermore, the method includes a contactless scaling control step: Real-time acquisition of posture data of the rings worn on the user's thumb and index finger respectively; Based on the posture data and pre-stored hand geometry parameters, calculate or estimate the real-time distance between the two fingertips; When the real-time distance continues to decrease within a preset first time window, and the decrease exceeds a first threshold, it is determined that the user has performed a pinch gesture. When the real-time distance continues to increase within a preset second time window, and the increase exceeds a second threshold, it is determined that the user has performed an open gesture. In response to the determination result, a corresponding image scaling instruction is generated and sent to the target electronic device.

[0012] Furthermore, the step of generating and sending the corresponding image scaling instruction is as follows: The action is executed only when the gesture is determined to be either a pinching or opening gesture, and the direction of the palm's displacement is detected to be towards the palm.

[0013] Furthermore, the image scaling command is a standard control command that conforms to the HID protocol of human-machine interface devices.

[0014] Furthermore, the step of generating image scaling instructions includes: The image scaling rate is dynamically determined based on the rate of change of the real-time distance. The image scaling rate is positively correlated with the rate of change of the real-time distance.

[0015] Furthermore, the target electronic device is an augmented reality (AR) device, a virtual reality (VR) device, a game console, a computer, or a mobile terminal; the standard control commands include mouse commands, keyboard commands, or gamepad commands.

[0016] The present invention also provides a control system for virtual motion based on multi-finger collaboration, comprising at least two smart ring units, each of the smart ring units comprising: The ring-shaped shell is designed for wearing on the finger. An inertial measurement unit is used to detect the spatial attitude and motion of the ring; A pressure or bending sensor is disposed inside the annular housing to detect finger movements; A microcontroller, connected to the inertial measurement unit and the pressure or bending sensor, is used to process sensor data and run a gesture recognition algorithm; Wireless communication module, used for communicating with external devices; The power module supplies power to all components; The at least two smart ring units can work together.

[0017] Furthermore, it also includes a physical induction switch disposed on the annular housing, used to identify the specific finger on which the ring is worn during system initialization and to determine the subordinate relationship between the rings.

[0018] Furthermore, different smart ring units are connected and synchronized via UWB, NFC, or Zigbee wireless communication.

[0019] Furthermore, the smart ring unit also includes a haptic feedback unit.

[0020] By adopting the above technical solution, the present invention has the following beneficial effects: The thumb ring is used as a "mode controller" to dynamically switch operation semantics; Supports two-finger pinch / release for high-precision non-contact image scaling; It is compatible with various scenarios such as office work, presentations, writing, gaming, and AR / VR. It enables truly portable virtual space interaction without the need for cameras or external base stations; Supports plug-and-play compatibility with AR / VR headsets, providing high-precision finger-level interaction capabilities; It achieves high degree of freedom, cross-platform compatibility, no need for external cameras, anti-interference, and high precision. Attached Figure Description

[0021] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0022] Figure 1 This is a schematic diagram of the virtual motion control method based on multi-finger collaboration of the present invention; Figure 2 This is a schematic diagram of the scaling function flow of the present invention; Figure 3 This is a schematic diagram of the virtual motion control system based on multi-finger collaboration of the present invention; Figure 4 A schematic diagram of the smart ring of this invention worn on each finger. Detailed Implementation

[0023] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0024] This invention provides a contactless operation control method based on a wearable ring to solve the problems of low interaction freedom, reliance on external devices, and poor accuracy in existing technologies.

[0025] See Figure 1 A virtual motion control method based on multi-finger collaboration includes: S11 allows users to wear at least two smart rings on different fingers; S12, acquire sensor data from each of the smart rings in real time; S13, Based on the sensor data, identify the user's hand posture, finger movements, and relative relationships between multiple fingers; S14 maps the identified postures, actions and relationships into standard control commands that conform to the HID protocol of human-machine interface devices; S15, the standard control command is wirelessly transmitted to the target electronic device to achieve contactless virtual operation.

[0026] It should be noted that: In S12, sensor data from each smart ring is acquired in real time, including IMU attitude data and pressure / bending sensor data.

[0027] In S13, the raw sensor data streams collected synchronously by each smart ring are then processed as follows: 1. Overall hand spatial pose calculation: Based on the fusion of multi-ring IMU data, the position, orientation and movement of the palm / wrist in three-dimensional space are calculated; 2. Individual finger movement recognition: Analyzes independent pressure / bending sensor data from each finger ring to recognize finger movements such as "index finger bending", "thumb pressing", and "middle finger double-clicking"; 3. Relative relationship analysis between fingers: Based on the spatial geometric relationship of IMU data of each finger ring, calculate and track such as "real-time Euclidean distance between the tips of the thumb and index finger", "plane or spatial angle formed by multiple fingers", and "relative motion trajectory between fingers".

[0028] In S14, an example of a mapping rule is shown below: The entire hand is moved horizontally, which is mapped to a mouse cursor movement event; A single bend of the index finger is mapped to a left mouse button click event; The distance between the tips of the thumb and index finger continues to decrease, which is mapped to an image shrinking instruction; Specific multi-finger gesture combinations are mapped to keyboard shortcuts.

[0029] The wireless protocols used in the S15 include, but are not limited to: Bluetooth 5.0 / BLE and 2.4GHz proprietary protocol.

[0030] The target electronic device receives and executes instructions to achieve contactless virtual operation; operation types include: cursor control, clicking, dragging, scrolling, zooming, page turning, etc.

[0031] In one embodiment, recognizing the user's hand posture, finger movements, and relative relationships between multiple fingers includes: Based on specific actions of the ring worn on the thumb, the current operating mode is dynamically switched; in different operating modes, the same actions of the non-thumb ring are mapped to different control commands.

[0032] In one embodiment, the operation mode includes at least one of mouse mode, scroll wheel mode, and writing mode.

[0033] In one embodiment, in the mouse mode, the thumb ring is in a neutral position, the index finger ring is in a neutral position, and hand translation is mapped to cursor movement; In the mouse mode, the thumb ring is in a neutral position, and a single bend of the index finger ring is mapped to a left mouse click; In the mouse mode, the thumb ring is in a neutral position, and the middle finger ring bends once, which is mapped to a right mouse click. In the mouse mode, the thumb ring is in a neutral position, the index finger ring is bent and held, and the hand moves up, down, left, and right, which is mapped to dragging the left mouse button. In the mouse mode, the thumb ring is in a neutral position, the middle finger ring is bent and held in place, and the hand moves up, down, left, and right, which is mapped to dragging the right mouse button. In the scroll wheel mode: when the thumb ring is in the raised position, the index finger ring moves upward and accelerates, and the hand moves upward and accelerates, which is mapped to the page scrolling upward; when the thumb ring is in the raised position, the index finger ring moves downward and accelerates, and the hand moves downward and accelerates, which is mapped to the page scrolling downward. In the writing mode, the thumb, index finger and middle finger wear the ring. When the thumb presses / bends inward, the index finger is lifted and moves along a trajectory. When the middle finger bends inward, the hand movement drives the fingertip of the index finger to point up, down and left and right to write. The movement trajectory of the fingertip of the index finger is mapped to handwriting input. In the writing mode, the thumb and index finger wear the rings, the thumb presses / bends inward, and the tips of the index finger and thumb are close together and kept still to form a pen-holding posture. The hand movement drives the thumb and index finger tips to twist the pen and write up, down, left and right. The movement trajectory of the thumb and index finger tips is mapped to handwriting input.

[0034] Of course, gestures can also be customized, such as waving three fingers upwards to return to the desktop. This invention supports the thumb, index finger, middle finger, ring finger, and little finger wearing the rings in coordination, preferably the thumb, index finger, and middle finger.

[0035] In one embodiment, see Figure 2 As shown, the method includes a contactless scaling control step: S21, real-time acquisition of the posture data of the rings worn on the user's thumb and index finger respectively; S22, calculate or estimate the real-time distance between the two fingertips based on the posture data and the pre-stored hand geometric parameters; S23, when the real-time distance continues to decrease within a preset first time window and the decrease exceeds a first threshold, it is determined that the user has performed a pinch gesture; S24, when the real-time distance continues to increase within a preset second time window and the increase exceeds a second threshold, it is determined that the user has performed an open gesture; S25, in response to the determination result, generate and send a corresponding image scaling instruction to the target electronic device.

[0036] The recognition and mapping relationship between thumb and non-thumb finger movements in each mode is shown in Table 1 below. In specific implementation, it can be fine-tuned according to user habits.

[0037] Table 1

[0038] It should be noted that: In S21, the posture data of the rings worn on the user's thumb and index finger are acquired in real time through the ring's built-in IMU. The data is in quaternion and Euler angle format. A spatial coordinate transformation method can be used. a. Based on the IMU attitude data of the thumb and index finger rings, determine the transformation matrix from the ring coordinate system to the world coordinate system.

[0039] b. Combining the pre-stored hand geometry model (including personalized parameters such as finger length and relative joint position), the "finger tip position offset" in the ring coordinate system is transformed to a unified world coordinate system.

[0040] c. Calculate the Euclidean distance D(t) between the two fingertips in the world coordinate system.

[0041] The posture data is a quaternion or Euler angles, and the real-time distance is the Euclidean distance D(t): when D(t) continuously decreases within a preset time window (e.g., 0.3 seconds) and the change amplitude is ≥25%, it is determined to be a "pinch" gesture. At the same time, when it is determined that the palm moves towards the center of the palm, i.e., when the downward action is performed, an image shrinking command is immediately generated. When D(t) continues to increase, it is determined to be an "open" gesture. At the same time, when it is determined that the palm is moving towards the center of the palm, that is, when the downward action is performed, an image magnification instruction is immediately generated.

[0042] Optionally, the finger spacing can be directly measured using a UWB or magnetic field sensor embedded in the ring, improving accuracy and anti-drift capability.

[0043] This feature requires no user contact with any screen or controller, works stably within a range of 1 to 10 meters, and is not limited by lighting, obstructions, or camera field of view.

[0044] In S22, the acquisition and initialization calibration of the pre-stored hand geometric parameters are described. To achieve high-precision gesture recognition, especially accurate fingertip distance estimation, the system requires a one-time initial calibration before first use to obtain the user's personalized hand geometry parameters. The calibration process is as follows: The system guides users to maintain a stable, preset hand posture, such as a natural fist.

[0045] The user is prompted to use their other hand to trigger the physical sensor switches of the rings worn on each finger in a predetermined order (e.g., from thumb to little finger).

[0046] At the moment each physical sensor switch is triggered, the system records the current spatial attitude data collected by the inertial measurement unit (IMU) of the corresponding ring.

[0047] Based on the triggering sequence, the recorded IMU attitude data, and the known or measured relative topological relationships between the rings (such as UWB or Bluetooth), the system calculates a set of personalized parameters characterizing the user's hand shape. This parameter set includes at least the relative spatial positions and relative angles between the rings on different fingers.

[0048] The parameter set is stored as the user's 'personalized geometric model of the hand' for spatial coordinate transformation and accurate calculation in all subsequent interaction processes.

[0049] The calibration process is simple and quick, usually completed in seconds, and requires no external equipment.

[0050] In one embodiment, the step of generating and sending the corresponding image scaling instruction is: The action is executed only when the gesture is determined to be either a pinching or opening gesture, and the direction of the palm's displacement is detected to be towards the palm.

[0051] In one embodiment, the image scaling command is a standard control command conforming to the HID protocol of human-machine interface devices.

[0052] In one embodiment, the step of generating image scaling instructions includes: The image scaling rate is dynamically determined based on the rate of change of the real-time distance. The image scaling rate is positively correlated with the rate of change of the real-time distance.

[0053] In one embodiment, the target electronic device is an augmented reality (AR) device, a virtual reality (VR) device, a game console, a computer, or a mobile terminal; the standard control commands include mouse commands, keyboard commands, or gamepad commands.

[0054] See Figure 3 As shown, the present invention also provides a control system for virtual motion based on multi-finger collaboration, comprising at least two smart ring units, each of the smart ring units comprising: The ring-shaped shell is designed for wearing on the finger. An inertial measurement unit is used to detect the spatial attitude and motion of the ring; A pressure or bending sensor is disposed inside the annular housing to detect finger movements; A microcontroller, connected to the inertial measurement unit and the pressure or bending sensor, is used to process sensor data and run a gesture recognition algorithm; The wireless communication module is used to communicate with external devices, supporting Bluetooth 5.0 / BLE or 2.4GHz proprietary protocols to communicate with target devices; The power module provides power to all electronic components; The at least two smart ring units can work collaboratively. Specifically, the wireless communication modules of the at least two smart ring units are interconnected to form a communication network; one of the smart ring units is designated as the master control unit, and its microcontroller is configured to: receive trigger flags and spatial attitude data from other subordinate ring units, and execute any of the above-mentioned virtual motion control methods based on multi-finger collaboration to realize multi-finger collaborative virtual motion.

[0055] It should be noted that the inertial measurement unit (IMU) integrates a three-axis gyroscope, a three-axis accelerometer, and a microcontroller to detect the hand's spatial posture and motion trajectory.

[0056] Pressure or bending sensors are placed inside the ring to detect the degree of finger bending or the pressure applied.

[0057] The finger-adapter is made of metal, lightweight engineering plastic, or silicone; the inertial measurement unit detects the spatial posture and movement of the finger ring, which is equivalent to detecting the spatial posture and movement trajectory of the hand.

[0058] In one embodiment, a physical induction switch disposed on the annular housing is further included for identifying the specific finger on which the ring is worn during system initialization and determining the subordinate relationship between the rings.

[0059] Upon first power-on, the user needs to clench their fist to trigger the physical sensor switch on up to five rings, from the thumb ring to the index, middle, ring, and finally the little finger, for initial ring positioning and spatial positioning. The physical sensor switch is located on the back of the hand to perform distance and fine angle geometric positioning for different hand shapes, as well as palm and back-of-hand positioning.

[0060] In one embodiment, different smart ring units are connected and synchronized via UWB, NFC, or Zigbee wireless communication.

[0061] Devices connected between different fingers can operate with low power via UWB, NFC, or Zigbee wireless communication.

[0062] In one embodiment, the smart ring unit further includes a haptic feedback unit.

[0063] Figure 4 A schematic diagram of the smart ring of this invention worn on each finger. The thumb is generally worn on the second segment near the palm, and the rings on other fingers should mainly be on the second segment to facilitate clear motion capture. However, the actual product design does not restrict the second and third segments to have materials worn at the same time. On the one hand, the second and third segments can be connected by some soft material to help fix the ring on the second segment and prevent it from loosening. On the other hand, more sensors can be installed on the third segment to accurately distinguish finger flexion and extension movements, or to make room for more micro batteries.

[0064] This system uses the standard HID protocol and is compatible with current mainstream AR / VR devices, game consoles, and personal computers. Devices such as the Meta Quest series and PICO series have been verified to function correctly. The system wirelessly transmits the generated standard HID control commands to the target electronic device, driving it to complete the corresponding contactless interactive operations.

[0065] It should be noted that the virtual motion ring of this invention does not rely on an external vision system and can directly establish a communication connection with mainstream AR / VR headsets on the market via standard Bluetooth or USB HID protocols. This system can be recognized as a hand input device conforming to the OpenXR standard or a general HID controller, thus achieving finger-level interaction without requiring device manufacturers to customize firmware or perform additional development. Commands are sent to the target device via standard HID protocols (such as Ctrl + "+ / -"), without the need for dedicated drivers.

[0066] Game console compatibility mode: The system is recognized as a standard game controller via HID device mode; Hand gestures are mapped to virtual joysticks, and finger movements are mapped to buttons (e.g., index finger = A, middle finger = B). Supports custom gesture bindings (such as "clenched fist = block", "wave = cast spell"); Low-latency transmission ensures real-time game operation; Compatible with PlayStation, Xbox, Nintendo Switch, PC and other platforms.

[0067] AR / VR device compatibility mode: The ring connects to the AR / VR host via Bluetooth or a USB dongle; Automatically identifies as an OpenXR compatible device or virtual controller; Each ring's data drives a virtual finger joint, and pressure sensors trigger grab / click events; It supports six degrees of freedom (6DoF) hand tracking, and can still work even when the hand moves out of the camera's field of view; End-to-end latency ≤15ms, meeting the requirements for smooth VR interaction.

[0068] The following are typical implementation scenarios of the present invention: Scenario Example 1: Meeting Presentation Scenario Users wear rings on their thumb, index finger, and middle finger. When standing and presenting a PowerPoint presentation, the hand moves horizontally to control the cursor, the index finger bends to turn pages, and the thumb lifts while the hand slides up and down to quickly scroll through long documents.

[0069] Scenario Example 2: Game Scene In The Legend of Zelda, players wear three rings. Pressing the right thumb enters "bow mode," while the index finger and thumb make a drawing motion, which the system recognizes as "charged shot." Releasing the thumb fires the arrow.

[0070] Scenario Example 3: VR Meeting Scenario Users enter Meta Horizon Workrooms wearing a three-finger ring. No controller is needed; simply tap the virtual whiteboard with your index finger, pinch with two fingers to zoom in on charts, and press with your thumb to switch between laser pointer mode. Even when turning to grab a water glass (hand out of the camera's view), the system maintains hand posture data via the ring.

[0071] Scenario Example 4: AR Remote Assistance Engineers wearing HoloLens 2 and the ring described in this invention can switch to "annotation mode" with their thumb in a noisy factory and circle faulty parts in the air with their index finger, transmitting the information to remote experts in real time—without touching any buttons.

[0072] Scenario Example 5: VR House Viewing Scenario Users wear rings to enter a virtual showroom and use their index finger and thumb to simulate "zooming in to view the tile texture" in the air, with the system zooming in on the 3D model details in real time.

[0073] The various embodiments in this specification are described in a related manner. The same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on describing the differences from other embodiments.

[0074] The above description is merely a preferred embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications and equivalent substitutions made within the spirit and principles of the present invention are included within the scope of protection of the present invention.

[0075] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A virtual motion control method based on multi-finger collaboration, characterized in that, include: S11 allows users to wear at least two smart rings on different fingers; S12, acquire sensor data from each of the smart rings in real time; S13, Based on the sensor data, identify the user's hand posture, finger movements, and relative relationships between multiple fingers; S14 maps the identified postures, actions and relationships into standard control commands that conform to the HID protocol of human-machine interface devices; S15, the standard control command is wirelessly transmitted to the target electronic device to achieve contactless virtual operation.

2. The method according to claim 1, characterized in that, The recognition of the user's hand posture, finger movements, and relative relationships of multiple fingers includes: The current operating mode is dynamically switched based on the specific movements of the ring worn on the thumb; In different operating modes, the same action of the non-thumb ring is mapped to different control commands.

3. The method according to claim 2, characterized in that, The operation mode includes at least one of mouse mode, scroll wheel mode, and writing mode.

4. The method according to claim 3, characterized in that: In the mouse mode, the thumb ring is in a neutral position, the index finger ring is in a neutral position, and hand lateral movement is mapped to cursor movement; In the mouse mode, the thumb ring is in a neutral position, and a single bend of the index finger ring is mapped to a left mouse click; In the mouse mode, the thumb ring is in a neutral position, and the middle finger ring bends once, which is mapped to a right mouse click. In the mouse mode, the thumb ring is in a neutral position, the index finger ring is bent and held, and the hand moves up, down, left, and right, which is mapped to dragging the left mouse button. In the mouse mode, the thumb ring is in a neutral position, the middle finger ring is bent and held in place, and the hand moves up, down, left, and right, which is mapped to dragging the right mouse button. In the scroll wheel mode: when the thumb ring is in the raised position, the index finger ring moves upward and accelerates, and the hand moves upward and accelerates, which is mapped to the page scrolling upward; when the thumb ring is in the raised position, the index finger ring moves downward and accelerates, and the hand moves downward and accelerates, which is mapped to the page scrolling downward. In the writing mode, the thumb, index finger and middle finger wear the ring. When the thumb presses / bends inward, the index finger is lifted and moves along a trajectory. When the middle finger bends inward, the hand movement drives the fingertip of the index finger to point up, down and left and right to write. The movement trajectory of the fingertip of the index finger is mapped to handwriting input. In the writing mode, the thumb and index finger wear the rings, the thumb presses / bends inward, and the tips of the index finger and thumb are close together and kept still to form a pen-holding posture. The hand movement drives the thumb and index finger tips to twist the pen and write up, down, left and right. The movement trajectory of the thumb and index finger tips is mapped to handwriting input.

5. The method according to claim 1, characterized in that, The method includes a contactless scaling control step: Real-time acquisition of posture data of the rings worn on the user's thumb and index finger respectively; Based on the posture data and pre-stored hand geometry parameters, calculate or estimate the real-time distance between the two fingertips; When the real-time distance continues to decrease within a preset first time window, and the decrease exceeds a first threshold, it is determined that the user has performed a pinch gesture. When the real-time distance continues to increase within a preset second time window, and the increase exceeds a second threshold, it is determined that the user has performed an open gesture. In response to the determination result, a corresponding image scaling instruction is generated and sent to the target electronic device.

6. The method according to claim 5, characterized in that, The step of generating and sending the corresponding image scaling command is as follows: The action is executed only when the gesture is determined to be either a pinching or opening gesture, and the direction of the palm's displacement is detected to be towards the palm.

7. The method according to claim 5 or 6, characterized in that, The image scaling command is a standard control command that conforms to the HID protocol of human-machine interface devices.

8. The method according to claim 5 or 6, characterized in that, The steps for generating image scaling instructions include: The image scaling rate is dynamically determined based on the rate of change of the real-time distance. The image scaling rate is positively correlated with the rate of change of the real-time distance.

9. The method according to claim 1, characterized in that, The target electronic device is an augmented reality (AR) device, a virtual reality (VR) device, a game console, a computer, or a mobile terminal; the standard control commands include mouse commands, keyboard commands, or game controller commands.

10. A control system for virtual motion based on multi-finger collaboration, characterized in that, It includes at least two smart ring units, each of which includes: The ring-shaped shell is designed for wearing on the finger. An inertial measurement unit is used to detect the spatial attitude and motion of the ring; A pressure or bending sensor is disposed inside the annular housing to detect finger movements; A microcontroller, connected to the inertial measurement unit and the pressure or bending sensor, is used to process sensor data and run a gesture recognition algorithm; Wireless communication module, used for communicating with external devices; The power module provides power to all electronic components; The at least two smart ring units can work together.

11. The system according to claim 10, characterized in that, It also includes a physical induction switch disposed on the annular housing, used to identify the specific finger on which the ring is worn during system initialization and to determine the subordinate relationship between the rings.

12. The system according to claim 10, characterized in that, Different smart ring units are connected and synchronized via UWB, NFC, or Zigbee wireless communication.

13. The system according to claim 10, characterized in that, The smart ring unit also includes a haptic feedback unit.

Images