Household equipment interaction method and system based on intelligent ring

Abstract

The invention discloses a household equipment interaction method and system based on an intelligent ring. The method comprises the following steps: acquiring sensing data in hand action proceeding of a user through the intelligent ring worn by the user; determining a pointing angle corresponding to the hand action according to the sensing data; determining target home equipment to be controlled according to the pointing angle and the signal data of the multiple pieces of candidate home equipment; and determining a control instruction corresponding to the hand action according to the sensing data and an action recognition algorithm, and sending the control instruction to the target home equipment for execution. Visibly, according to the invention, accurate touch-free home equipment control based on gesture pointing and action recognition can be realized, the naturalness and convenience of smart home interaction are improved, and the risk of control errors caused by mistaken touch or failure of voice recognition is reduced.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to a home device interaction method and system based on a smart ring. Background Technology

[0002] With the rapid increase in demand for natural interaction in smart homes, users are placing greater emphasis on precise device control through touchless methods. Existing technologies typically employ voice control, mobile apps, or infrared / camera solutions with fixed gesture areas to operate home devices, relying on single-modality or fixed spatial positioning to determine the user's control intent. These solutions lack real-time calculation of pointing angles from hand gesture sensor data, fusion analysis of signal strength from home devices, and accurate recognition of gesture types. Consequently, they struggle to accurately locate target devices and generate reliable control commands in complex multi-device scenarios. They are also susceptible to environmental noise, blind spots, or confusion caused by multiple devices, resulting in insufficient accuracy and convenience. Furthermore, accidental touches or recognition failures can lead to device malfunctions, limiting the naturalness and practical usability of smart home interaction. Clearly, existing technologies have shortcomings that urgently need to be addressed. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a home device interaction method and system based on a smart ring, which can realize precise touchless control of home devices based on gesture pointing and action recognition, improve the naturalness and convenience of smart home interaction, and reduce the risk of control errors caused by accidental touch or voice recognition failure.

[0004] To address the aforementioned technical problems, the first aspect of this invention discloses a home device interaction method based on a smart ring, the method comprising: The system acquires sensor data on the user's hand movements during the process by using a smart ring worn by the user. Based on the sensor data, determine the pointing angle corresponding to the hand movement; Based on the pointing angle and signal data from multiple candidate home devices, the target home device to be controlled is determined; Based on the sensor data and the motion recognition algorithm, the control command corresponding to the hand motion is determined and sent to the target home device for execution.

[0005] As an optional implementation, in the first aspect of the invention, the sensing data includes acceleration data, gyroscope data, and magnetometer data.

[0006] As an optional implementation, in the first aspect of the present invention, determining the pointing angle corresponding to the hand movement based on the sensing data includes: Based on the sensor data fusion algorithm, the pointing angle corresponding to the hand movement is determined according to the sensor data; the pointing angle includes the pointing azimuth angle and the pointing elevation angle.

[0007] As an optional implementation, in the first aspect of the invention, determining the target home appliance to be controlled based on the pointing angle and signal data from a plurality of candidate home appliances includes: Based on the pointing angle and the preset angle extension range, the angle range corresponding to the pointing angle is determined; Within the area where the user is located, determine the range corresponding to the angle range; Home appliances within the specified range are identified as candidate home appliances; Based on the signal data of multiple candidate home devices, the target home device to be controlled is determined.

[0008] As an optional implementation, in the first aspect of the invention, determining the target home appliance to be controlled based on signal data from a plurality of candidate home appliances includes: The smart ring scans and acquires signal data for each of the candidate home devices; Based on the signal data, the closest home appliance among all the candidate home appliances is identified to obtain the target home appliance.

[0009] As an optional implementation, in the first aspect of the present invention, the signal data is Bluetooth signal data; the target home device is the home device with the strongest Bluetooth signal strength among all the candidate home devices.

[0010] As an optional implementation, in the first aspect of the present invention, determining the control command corresponding to the hand movement based on the sensing data and the action recognition algorithm includes: The sensor data is input into the trained motion recognition algorithm model to obtain the motion type corresponding to the output hand motion; Based on the preset correspondence between action types and instructions, the control instructions corresponding to the action types are determined.

[0011] As an optional implementation, in the first aspect of the present invention, the method further includes: After the target home appliance executes the control command, the target home appliance generates a confirmation signal; The confirmation signal is sent to the smart ring to prompt the user; the prompt is a vibration, sound, or light operation.

[0012] A second aspect of this invention discloses a home device interaction system based on a smart ring, the system comprising: The acquisition module is used to acquire sensor data of the user's hand movements in progress through the smart ring worn by the user; The first determining module is used to determine the pointing angle corresponding to the hand movement based on the sensing data; The second determining module is used to determine the target home appliance to be controlled based on the pointing angle and signal data of multiple candidate home appliances; The control module is used to determine the control command corresponding to the hand movement based on the sensor data and the motion recognition algorithm, and send it to the target home device for execution.

[0013] As an optional implementation, in a second aspect of the invention, the sensing data includes acceleration data, gyroscope data, and magnetometer data.

[0014] As an optional implementation, in a second aspect of the invention, the first determining module determines the specific method by which it determines the pointing angle corresponding to the hand movement based on the sensing data, including: Based on the sensor data fusion algorithm, the pointing angle corresponding to the hand movement is determined according to the sensor data; the pointing angle includes the pointing azimuth angle and the pointing elevation angle.

[0015] As an optional implementation, in a second aspect of the invention, the second determining module determines the specific method of controlling the target home appliance based on the pointing angle and signal data from a plurality of candidate home appliances, including: Based on the pointing angle and the preset angle extension range, the angle range corresponding to the pointing angle is determined; Within the area where the user is located, determine the range corresponding to the angle range; Home appliances within the specified range are identified as candidate home appliances; Based on the signal data of multiple candidate home devices, the target home device to be controlled is determined.

[0016] As an optional implementation, in a second aspect of the invention, the second determining module determines the specific method of controlling the target home appliance based on signal data from a plurality of candidate home appliances, including: The smart ring scans and acquires signal data for each of the candidate home devices; Based on the signal data, the closest home appliance among all the candidate home appliances is identified to obtain the target home appliance.

[0017] As an optional implementation, in the second aspect of the invention, the signal data is Bluetooth signal data; the target home device is the home device with the strongest Bluetooth signal strength among all the candidate home devices.

[0018] As an optional implementation, in a second aspect of the invention, the control module determines the specific method of the control command corresponding to the hand movement based on the sensing data and the action recognition algorithm, including: The sensor data is input into the trained motion recognition algorithm model to obtain the motion type corresponding to the output hand motion; Based on the preset correspondence between action types and instructions, the control instructions corresponding to the action types are determined.

[0019] As an optional implementation, in a second aspect of the invention, the system is further configured to perform the following steps: After the target home appliance executes the control command, the target home appliance generates a confirmation signal; The confirmation signal is sent to the smart ring to prompt the user; the prompt is a vibration, sound, or light operation.

[0020] A third aspect of this invention discloses another home device interaction system based on a smart ring, the system comprising: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute some or all of the steps in the smart ring-based home device interaction method disclosed in the first aspect of the present invention.

[0021] The fourth aspect of the present invention discloses a computer storage medium storing computer instructions, which, when invoked, are used to execute some or all of the steps in the smart ring-based home device interaction method disclosed in the first aspect of the present invention.

[0022] Compared with the prior art, the embodiments of the present invention have the following beneficial effects: This invention uses a smart ring to acquire real-time user hand gesture sensing data and calculate the pointing angle. It combines the signal strength of candidate home devices to determine the target device and identify the action type to generate control commands for execution. This enables precise touchless control of home devices based on gesture pointing and action recognition, improving the naturalness and convenience of smart home interaction and reducing the risk of control errors caused by accidental touches or voice recognition failures. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This is a flowchart illustrating a home device interaction method based on a smart ring, as disclosed in an embodiment of the present invention.

[0025] Figure 2 This is a schematic diagram of the structure of a home device interaction system based on a smart ring, as disclosed in an embodiment of the present invention.

[0026] Figure 3 This is a schematic diagram of another home device interaction system based on a smart ring disclosed in an embodiment of the present invention. Detailed Implementation

[0027] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0028] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or devices.

[0029] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0030] This invention discloses a home appliance interaction method and system based on a smart ring. The smart ring acquires real-time user hand gesture sensing data and calculates the pointing angle. Combined with the signal strength of candidate home appliances, it determines the target device, identifies the action type, generates control commands, and sends them for execution. This enables precise, touchless control of home appliances based on gesture pointing and action recognition, improving the naturalness and convenience of smart home interaction and reducing the risk of control errors due to accidental touches or voice recognition failures. Detailed explanations follow.

[0031] Example 1 Please see Figure 1 , Figure 1 This is a flowchart illustrating a home device interaction method based on a smart ring, as disclosed in an embodiment of the present invention. Figure 1 The described smart ring-based home device interaction method can be applied to data processing systems / data processing devices / data processing servers (wherein, the server includes a local processing server or a cloud processing server). For example... Figure 1 As shown, the smart ring-based home device interaction method may include the following operations: 101. Acquire sensor data on the user's hand movements through the smart ring the user is wearing.

[0032] Optionally, the sensor data includes acceleration data, gyroscope data, and magnetometer data.

[0033] Specifically, the smart ring is also equipped with activation threshold rules to limit the user's hand movement sensor data to meet specific rules (such as raising the wrist to a specific angle) before the subsequent high-power pointing calculation and target selection process is initiated. During daily activities, it is in a low-power listening state to avoid accidental touches and power consumption.

[0034] In one specific implementation, a smart ring is provided to assist in realizing the technical solutions in the embodiments of the present invention. The smart ring terminal is equipped with: 9-Axis IMU Sensor: The core sensor, comprising a three-axis accelerometer, a three-axis gyroscope, and a three-axis magnetometer. The magnetometer provides an absolute orientation reference to correct for accumulated errors in the gyroscope's attitude calculations, which is crucial for achieving stable pointing.

[0035] Main control chip: Built-in sensor fusion algorithms (such as Kalman filtering and complementary filtering) and lightweight gesture recognition model.

[0036] Wireless communication module (BLE): Used to communicate with smart home devices or gateways.

[0037] Miniature linear motors: used to provide tactile feedback and confirm command execution.

[0038] 102. Based on the sensor data, determine the pointing angle corresponding to the hand movement.

[0039] 103. Based on the pointing angle and signal data from multiple candidate home appliances, determine the target home appliance to be controlled.

[0040] In this specific implementation, multiple smart home devices are also set up. These smart home devices have BLE communication capabilities and act as Bluetooth beacons, continuously or intermittently broadcasting their unique device ID and signal strength (RSSI).

[0041] 104. Based on sensor data and motion recognition algorithms, determine the control command corresponding to the hand movement and send it to the target home appliance for execution.

[0042] Specifically, the aforementioned angle determination and action recognition also incorporate a two-factor authentication mechanism, requiring both the user's hand gestures and pointing movements to be performed and maintained for a certain stable time (e.g., 0.5 seconds), further preventing accidental triggering caused by unintentional actions.

[0043] As can be seen, the above-mentioned embodiments of the invention acquire the user's hand motion sensing data in real time through the smart ring and calculate the pointing angle. Combined with the signal strength of candidate home devices, the target device is determined and the action type is identified to generate control commands for execution. This enables precise touchless control of home devices based on gesture pointing and action recognition, improves the naturalness and convenience of smart home interaction, and reduces the risk of control errors caused by accidental touches or voice recognition failures.

[0044] As an optional embodiment, the step of determining the pointing angle corresponding to the hand movement based on the sensor data in the above steps includes: Based on the sensor data fusion algorithm, the pointing angle corresponding to the hand movement is determined according to the sensor data; the pointing angle includes the pointing azimuth angle and the pointing elevation angle.

[0045] As can be seen, through the above optional embodiments, the pointing azimuth and elevation angles of hand movements are calculated by the sensor data fusion algorithm, achieving high-precision three-dimensional spatial pointing recognition. This provides accurate pointing data for subsequent angular range area division, improves the accuracy and reliability of target home device positioning, and reduces the risk of incorrect device selection due to pointing deviation.

[0046] As an optional embodiment, the step described above, determining the target home appliance to be controlled based on the pointing angle and signal data from multiple candidate home appliances, includes: Based on the pointing angle and the preset angle extension range, the angle range corresponding to the pointing angle is determined. Within the user's location area, determine the range corresponding to the angle range; Home appliances within the designated area are identified as candidate home appliances; Based on signal data from multiple candidate home appliances, the target home appliance to be controlled is determined.

[0047] As can be seen, through the above optional embodiments, by determining the angle range based on the pointing angle and the preset extension range and mapping it to the actual spatial area, the home devices in the area are listed as candidates, and then the target device is determined from the candidate devices using signal data, so as to achieve accurate implementation of pointing device selection, improve the robustness and speed of target recognition in multi-device scenarios, and reduce the risk of selecting the wrong device due to signal interference.

[0048] As an optional embodiment, the step described above, determining the target home appliance to be controlled based on signal data from multiple candidate home appliances, includes: The smart ring scans and acquires signal data from each candidate home device; Based on the signal data, the closest home appliance among all candidate home appliances is identified, and the target home appliance is obtained.

[0049] As can be seen, through the above optional embodiments, the smart ring scans the signal data of candidate home devices and determines the target device from the candidate devices based on the signal data, thereby achieving natural target locking based on physical distance, improving the intuitiveness and accuracy of gesture control, and reducing the risk of target misjudgment caused by the mixing of signals from multiple devices.

[0050] As an optional embodiment, in the above steps, the signal data is Bluetooth signal data; the target home device is the home device with the strongest Bluetooth signal strength among all candidate home devices.

[0051] As can be seen, by limiting the signal data to Bluetooth data and defining the relationship between signal strength and distance through the above optional embodiments, the device distance determination and filtering based on Bluetooth communication can be realized, thereby improving the intuitiveness and accuracy of gesture control and reducing the risk of target misjudgment caused by the mixing of signals from multiple devices.

[0052] As an optional embodiment, the step above, determining the control command corresponding to the hand movement based on sensor data and the motion recognition algorithm, includes: The sensor data is input into the trained motion recognition algorithm model to obtain the motion type corresponding to the output hand motion; Based on the preset correspondence between action types and instructions, the control instructions corresponding to the action types are determined.

[0053] As can be seen, through the above optional embodiments, by inputting sensor data into the trained action recognition algorithm model, directly outputting action types and mapping them to control commands, the accurate and real-time conversion of gestures to device commands is achieved, improving the response speed and recognition accuracy of gesture control, and reducing the risk of control failure caused by action recognition delays or errors.

[0054] As an optional embodiment, the method further includes the following steps: After the target home appliance executes the control command, the target home appliance generates an confirmation signal; A confirmation signal is sent to the smart ring to prompt the user to perform actions such as vibration, sound, or light.

[0055] As can be seen, through the above optional embodiments, after the target home device executes the instruction, it generates a confirmation signal to drive the smart ring to vibrate, sound or light to prompt, thereby realizing real-time user feedback in the control loop, improving the sense of confirmation and success rate of gesture control, and reducing the risk of repeated user operations or control uncertainty due to lack of feedback.

[0056] In one specific implementation scheme, a smart home interaction method is implemented based on the technical solution in the embodiments of the present invention. Its core lies in a mechanism of "relative pointing criterion + gesture triggering", and its process is as follows: S1: Pointing attitude calculation (“pointing”): The user raises their arm and points to the target device with the finger wearing the ring.

[0057] The sensor fusion algorithm inside the ring calculates the ring's absolute attitude (i.e., orientation vector) in space in real time, and calculates its azimuth and elevation angles.

[0058] S2: Target device selection ("which") The ring scans the surrounding environment for Bluetooth beacons of smart devices that are broadcasting, obtaining their signal strength (RSSI) and ID.

[0059] Specifically, the target device intended for user control is determined by combining the pointing azimuth angle and Bluetooth RSSI. The logic is as follows: i. Directional coarse screening: First, screen out all devices that are roughly located in the cone-shaped area pointing in the direction of the ring (e.g., within ±30° cone angle).

[0060] ii. Distance fine screening: In the results of directional coarse screening, select the device with the strongest RSSI (i.e. the closest physical distance) as the most likely target device.

[0061] This method cleverly combines the difficult-to-precise pointing angle with the relative distance information from Bluetooth RSSI, greatly improving the accuracy and robustness of target recognition.

[0062] S3: Gesture recognition and execution ("hitting"): While maintaining the pointing posture, the user makes a preset trigger gesture (such as pinching the thumb and forefinger together, drawing a "hook" in the air, or quickly rotating the wrist twice).

[0063] The ring locally recognizes the gesture and maps it to a specific control command (such as "pinch" being mapped to "switch").

[0064] The ring sends out the <target device ID, control command> pair of information via BLE.

[0065] S4: Feedback and Confirmation: The target device executes the operation after receiving the instruction (such as turning on the desk lamp).

[0066] Almost simultaneously, the target device sends back an acknowledgment signal via BLE. Upon receiving this signal, the ring drives the motor to generate a crisp, short vibration, forming an operational closed loop and informing the user that the command has been successfully received and executed by the target device.

[0067] Specifically, let's take user-controlled living room spotlights as an example: 1. The user sits on the sofa, raises his right hand, and points his finger at the spotlight in the corner.

[0068] 2. The algorithm inside the ring calculates the current azimuth angle and scans three devices within range: spotlight (RSSI=-50), air conditioner (RSSI=-70), and speaker (RSSI=-65).

[0069] 3. The system first determines that the spotlights and speakers are in the general direction based on their pointing angles, thus ruling out the air conditioner.

[0070] 4. Next, the system selects the device with the strongest RSSI (best signal, meaning closest distance) – the spotlight – and locks it as the target to be controlled.

[0071] 5. The user keeps pointing and makes a "pinch" gesture.

[0072] 6. The ring recognizes the gesture, maps it to a "switch" command, and sends a "toggle switch status" command to the ID of the "spotlight" via BLE.

[0073] 7. The spotlight turns off and simultaneously sends back a confirmation signal.

[0074] 8. The ring vibrates once, and the user receives feedback, knowing that the operation was successful, and naturally lowers their arm.

[0075] 9. The entire process is fast, precise, and elegant, requiring no voice commands or searching for switches.

[0076] In summary, the technical solutions disclosed in the embodiments of the present invention have the following advantages: 1. Completely decentralized and with high privacy: No external devices such as cameras or AR / VR are required. All perception and computation are completed locally on the ring or directly between the ring and the device, protecting user privacy.

[0077] 2. Intuitive and natural interaction: The "point-gesture" interaction mode conforms to human instincts, has a very low learning cost, and truly achieves "point and shoot".

[0078] 3. Accurate and reliable: It integrates the absolute pointing of IMU and magnetometer and the relative distance of Bluetooth RSSI as dual-factor criteria, overcoming the shortcomings of single technology and achieving high target recognition accuracy.

[0079] 4. Low power consumption and low cost: Utilizing the device's existing BLE beacon functionality, no new hardware needs to be added. The ring-side algorithm is optimized, resulting in low computational load and long battery life.

[0080] 5. Plug and play and cross-platform compatibility: As long as the smart device supports BLE and embeds our protocol, it can be recognized and controlled by the ring, naturally supporting cross-brand and cross-category device interconnection.

[0081] Example 2 Please see Figure 2 , Figure 2 This is a schematic diagram of a home device interaction system based on a smart ring, as disclosed in an embodiment of the present invention. Figure 2 The described smart ring-based home device interaction system can be applied to data processing systems / data processing devices / data processing servers (wherein, the server includes a local processing server or a cloud processing server). For example... Figure 2 As shown, the smart ring-based home device interaction system may include: The acquisition module 201 is used to acquire sensor data of the user's hand movements in progress through the smart ring worn by the user.

[0082] The first determining module 202 is used to determine the pointing angle corresponding to the hand movement based on the sensing data.

[0083] The second determining module 203 is used to determine the target home appliance to be controlled based on the pointing angle and signal data of multiple candidate home appliances.

[0084] The control module 204 is used to determine the control command corresponding to the hand movement based on the sensor data and the motion recognition algorithm, and send it to the target home device for execution.

[0085] As can be seen, the above-mentioned embodiments of the invention acquire the user's hand motion sensing data in real time through the smart ring and calculate the pointing angle. Combined with the signal strength of candidate home devices, the target device is determined and the action type is identified to generate control commands for execution. This enables precise touchless control of home devices based on gesture pointing and action recognition, improves the naturalness and convenience of smart home interaction, and reduces the risk of control errors caused by accidental touches or voice recognition failures.

[0086] As an optional embodiment, the sensing data includes acceleration data, gyroscope data, and magnetometer data.

[0087] As can be seen, the above optional embodiments limit the content of the sensing data, enabling the smart ring to accurately and comprehensively acquire the motion sensing characteristics related to the user's actions, assisting in the intelligent optimization of precise user comfort control, improving the adaptability of the smart home environment and user experience, and reducing the risk to user health and comfort caused by the failure to promptly improve unsuitable environments.

[0088] As an optional embodiment, the first determining module determines the specific method of the pointing angle corresponding to the hand movement based on the sensing data, including: Based on the sensor data fusion algorithm, the pointing angle corresponding to the hand movement is determined according to the sensor data; the pointing angle includes the pointing azimuth angle and the pointing elevation angle.

[0089] As can be seen, through the above optional embodiments, the pointing azimuth and elevation angles of hand movements are calculated by the sensor data fusion algorithm, achieving high-precision three-dimensional spatial pointing recognition. This provides accurate pointing data for subsequent angular range area division, improves the accuracy and reliability of target home device positioning, and reduces the risk of incorrect device selection due to pointing deviation.

[0090] As an optional embodiment, the second determining module determines the specific method of controlling the target home appliance based on the pointing angle and signal data from multiple candidate home appliances, including: Based on the pointing angle and the preset angle extension range, the angle range corresponding to the pointing angle is determined. Within the user's location area, determine the range corresponding to the angle range; Home appliances within the designated area are identified as candidate home appliances; Based on signal data from multiple candidate home appliances, the target home appliance to be controlled is determined.

[0091] As can be seen, through the above optional embodiments, by determining the angle range based on the pointing angle and the preset extension range and mapping it to the actual spatial area, the home devices in the area are listed as candidates, and then the target device is determined from the candidate devices using signal data, so as to achieve accurate implementation of pointing device selection, improve the robustness and speed of target recognition in multi-device scenarios, and reduce the risk of selecting the wrong device due to signal interference.

[0092] As an optional embodiment, the second determining module determines the specific method of controlling the target home appliance based on signal data from multiple candidate home appliances, including: The smart ring scans and acquires signal data from each candidate home device; Based on the signal data, the closest home appliance among all candidate home appliances is identified, and the target home appliance is obtained.

[0093] As can be seen, through the above optional embodiments, the smart ring scans the signal data of candidate home devices and determines the target device from the candidate devices based on the signal data, thereby achieving natural target locking based on physical distance, improving the intuitiveness and accuracy of gesture control, and reducing the risk of target misjudgment caused by the mixing of signals from multiple devices.

[0094] As an optional embodiment, the signal data is Bluetooth signal data; the target home device is the home device with the strongest Bluetooth signal strength among all candidate home devices.

[0095] As can be seen, by limiting the signal data to Bluetooth data and defining the relationship between signal strength and distance through the above optional embodiments, the device distance determination and filtering based on Bluetooth communication can be realized, thereby improving the intuitiveness and accuracy of gesture control and reducing the risk of target misjudgment caused by the mixing of signals from multiple devices.

[0096] As an optional embodiment, the control module determines the specific method of the control command corresponding to the hand movement based on sensor data and motion recognition algorithm, including: The sensor data is input into the trained motion recognition algorithm model to obtain the motion type corresponding to the output hand motion; Based on the preset correspondence between action types and instructions, the control instructions corresponding to the action types are determined.

[0097] As can be seen, through the above optional embodiments, by inputting sensor data into the trained action recognition algorithm model, directly outputting action types and mapping them to control commands, the accurate and real-time conversion of gestures to device commands is achieved, improving the response speed and recognition accuracy of gesture control, and reducing the risk of control failure caused by action recognition delays or errors.

[0098] As an optional embodiment, the system is also used to perform the following steps: After the target home appliance executes the control command, the target home appliance generates an confirmation signal; A confirmation signal is sent to the smart ring to prompt the user to perform actions such as vibration, sound, or light.

[0099] As can be seen, through the above optional embodiments, after the target home device executes the instruction, it generates a confirmation signal to drive the smart ring to vibrate, sound or light to prompt, thereby realizing real-time user feedback in the control loop, improving the sense of confirmation and success rate of gesture control, and reducing the risk of repeated user operations or control uncertainty due to lack of feedback.

[0100] Example 3 Please see Figure 3 , Figure 3 This is yet another home device interaction system based on a smart ring disclosed in the embodiments of the present invention. Figure 3 The described smart ring-based home device interaction system is applied in a data processing system / data processing device / data processing server (wherein, the server includes a local processing server or a cloud processing server). For example... Figure 3 As shown, the smart ring-based home device interaction system may include: Memory 301 storing executable program code; Processor 302 coupled to memory 301; The processor 302 calls the executable program code stored in the memory 301 to execute the steps of the smart ring-based home device interaction method described in Embodiment 1.

[0101] Example 4 This invention discloses a computer read storage medium that stores a computer program for electronic data interchange, wherein the computer program causes a computer to execute the steps of the smart ring-based home device interaction method described in Embodiment 1.

[0102] Example 5 This invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform the steps of the smart ring-based home device interaction method described in Embodiment 1.

[0103] The foregoing has described specific embodiments of this specification; other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims may be performed in a different order than those shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily have to follow the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0104] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.

[0105] For ease of description, the above devices are described in terms of function, divided into various units. Of course, in implementing this specification, the functions of each unit can be implemented in one or more software and / or hardware components.

[0106] Those skilled in the art will understand that the embodiments of this specification can be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the embodiments of this specification can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0107] This specification is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this specification. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0108] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0109] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0110] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0111] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0112] Computer-readable media include both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0113] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0114] This specification can be described in the general context of computer-executable instructions that are executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a specific task or implement a specific abstract data type. This specification can also be practiced in distributed computing environments, where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0115] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0116] Finally, it should be noted that the home device interaction method and system based on a smart ring disclosed in the embodiments of the present invention are merely preferred embodiments of the present invention, and are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features therein; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A home appliance interaction method based on a smart ring, characterized in that, The method includes: The system acquires sensor data on the user's hand movements during the process by using a smart ring worn by the user. Based on the sensor data, determine the pointing angle corresponding to the hand movement; Based on the pointing angle and signal data from multiple candidate home devices, the target home device to be controlled is determined; Based on the sensor data and the motion recognition algorithm, the control command corresponding to the hand motion is determined and sent to the target home device for execution.

2. The home device interaction method based on a smart ring according to claim 1, characterized in that, The sensor data includes acceleration data, gyroscope data, and magnetometer data.

3. The home device interaction method based on a smart ring according to claim 1, characterized in that, Determining the pointing angle corresponding to the hand movement based on the sensing data includes: Based on the sensor data fusion algorithm, the pointing angle corresponding to the hand movement is determined according to the sensor data; the pointing angle includes the pointing azimuth angle and the pointing elevation angle.

4. The home device interaction method based on a smart ring according to claim 1, characterized in that, The step of determining the target home appliance to be controlled based on the pointing angle and signal data from multiple candidate home appliances includes: Based on the pointing angle and the preset angle extension range, the angle range corresponding to the pointing angle is determined; Within the area where the user is located, determine the range corresponding to the angle range; Home appliances within the specified range are identified as candidate home appliances; Based on the signal data of multiple candidate home devices, the target home device to be controlled is determined.

5. The home device interaction method based on a smart ring according to claim 4, characterized in that, The step of determining the target home appliance to be controlled based on signal data from multiple candidate home appliances includes: The smart ring scans and acquires signal data for each of the candidate home devices; Based on the signal data, the closest home appliance among all the candidate home appliances is identified to obtain the target home appliance.

6. The home device interaction method based on a smart ring according to claim 5, characterized in that, The signal data is Bluetooth signal data; the target home device is the home device with the strongest Bluetooth signal strength among all the candidate home devices.

7. The home device interaction method based on a smart ring according to claim 1, characterized in that, The step of determining the control command corresponding to the hand movement based on the sensor data and the action recognition algorithm includes: The sensor data is input into the trained motion recognition algorithm model to obtain the motion type corresponding to the output hand motion; Based on the preset correspondence between action types and instructions, the control instructions corresponding to the action types are determined.

8. The home device interaction method based on a smart ring according to claim 1, characterized in that, The method further includes: After the target home appliance executes the control command, the target home appliance generates a confirmation signal; The confirmation signal is sent to the smart ring to prompt the user; the prompt is a vibration, sound, or light operation.

9. A home device interaction system based on a smart ring, characterized in that, The system includes: The acquisition module is used to acquire sensor data of the user's hand movements in progress through the smart ring worn by the user; The first determining module is used to determine the pointing angle corresponding to the hand movement based on the sensing data; The second determining module is used to determine the target home appliance to be controlled based on the pointing angle and signal data of multiple candidate home appliances; The control module is used to determine the control command corresponding to the hand movement based on the sensor data and the motion recognition algorithm, and send it to the target home device for execution.

10. A home device interaction system based on a smart ring, characterized in that, The system includes: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the home device interaction method based on a smart ring as described in any one of claims 1-8.

Images