Vehicle interaction system based on intelligent wristband

Abstract

The invention discloses a vehicle interaction system based on an intelligent wristband, and belongs to the field of vehicle control. The system specifically comprises an intelligent wrist strap device and a vehicle machine system. The intelligent wrist strap equipment comprises a sensor, a processor, an identity verification module and a customized gesture module; the vehicle machine system comprises a vehicle control module, a vehicle interior and exterior mode switching module, a multi-user support module and a gesture action interaction mapping module; when a user wears the intelligent wrist strap device, authorization is carried out through the identity verification module; then, a sensor is used for monitoring electromyographic signals of a user, a processor is used for converting the electromyographic signals into corresponding gestures, the gestures are transmitted to a vehicle control module through a wireless communication module, the vehicle control module converts gesture information into control instructions through a vehicle-mounted sensor, and therefore corresponding operation is executed on multimedia, an air conditioner / seat or a vehicle door; an operation result is fed back to the user through the intelligent wrist strap device or the vehicle display screen; according to the invention, highly safe, convenient and personalized vehicle control experience is provided.

Description

Technical Field

[0001] The invention belongs to the field of vehicle control, and in particular relates to a vehicle interaction system based on a smart wristband. Background Art

[0002] With the development of intelligent technology, vehicle control systems are gradually becoming more intelligent and convenient. Traditional vehicle control methods mainly rely on physical buttons, remote control keys or smartphone applications. Although this has improved the user experience to a certain extent, there are still some shortcomings:

[0003] 1) Operational complexity and inconvenience: Traditional physical buttons and remote control keys require the driver to operate near the vehicle, and are inconvenient to operate in certain situations (such as when carrying a lot of items or when both hands are not free). In addition, although the control through the mobile phone application provides remote control functions, it is necessary to open the mobile phone application, unlock the device, and find the corresponding functional module. The operation steps are cumbersome, and it may not be used in certain scenarios (such as when the phone is out of power or the signal is poor).

[0004] 2) Driving distraction: During driving, the driver needs to operate the multimedia system, air conditioning or wipers in the car through the touch screen or physical buttons, which forces the driver to take his eyes or attention away from the driving road, increasing the risk of driving distraction and possibly causing safety hazards. In addition, although the voice control system provides a certain convenience, it cannot accurately recognize commands in a noisy environment and may also disturb other passengers in the car.

[0005] 3) Vehicle security and confidentiality: Current vehicle unlocking and control methods usually rely on physical keys, remote controls or smartphone applications, which may reduce vehicle security when the device is lost or stolen. In addition, traditional control methods usually cannot effectively identify the user's identity, and there is a risk of unauthorized users operating the vehicle.

[0006] 4) Insufficient personalized control: Existing vehicle control systems are usually preset, and the operation methods and gesture mapping relationships are relatively fixed. They cannot be customized according to user needs and cannot meet the operating habits and preferences of different users.

[0007] In order to overcome the shortcomings of the above-mentioned traditional vehicle control methods, some emerging technical solutions have been applied to the field of vehicle control in recent years. Among them, gesture recognition technology has gradually become a hot spot for research and application due to its intuitiveness and potential contactless operation advantages. Gesture control allows drivers to operate the vehicle's multimedia system, air conditioning, navigation and other functions through simple hand movements, thereby reducing dependence on physical buttons and reducing the risk of distracted driving. Compared with voice control, gesture control may be quieter and more direct in some scenarios. Therefore, gesture recognition technology is considered to be a potential solution that is expected to improve the convenience and safety of vehicle control.

[0008] However, although gesture recognition technology can solve the limitations of traditional control methods to a certain extent, the existing visual gesture recognition solutions still have many problems, which leads to the fact that they have not yet achieved ideal results in practical applications.

[0009] Limitations of existing visual gesture recognition solutions: The camera has high requirements for lighting conditions. In low-light or strong-light environments, the recognition rate will drop significantly. Secondly, the camera needs to continuously monitor the user's hand movements, which may involve user privacy issues. The computational complexity of visual gesture recognition is large, which can easily lead to system delays and affect user experience. The visual solution has obvious field of view limitations. The user's gestures need to be performed within the camera's field of view. However, when driving, the user's hands are generally in complex car operating environments such as the steering wheel. There are a lot of obstructions, which reduces the recognition rate. If the user's hands are taken off the steering wheel and placed in the camera's field of view, it is easy to create safety hazards.

[0010] Therefore, the existing technology still has many deficiencies in terms of the convenience, safety, personalization and driver distraction of vehicle control. In order to solve these problems, a new technical means is urgently needed to provide a more convenient, safe and efficient vehicle control method, while reducing driver distraction, improving driving safety and supporting personalized customization. Summary of the invention

[0011] In view of the problems existing in the prior art, such as complicated operation, distracted driving, insufficient vehicle safety, and lack of personalized control, the present invention provides a vehicle interaction system based on a smart wristband, which enables users to remotely control and control the vehicle in the vehicle through a smart wristband device with an integrated electromyography (EMG) sensor. The system provides users with a highly safe, convenient, and personalized vehicle control experience through gesture recognition, user identity authentication, and automatic switching between in-vehicle and out-vehicle functions.

[0012] The vehicle interaction system includes: a smart wristband device and a vehicle system;

[0013] The smart wristband device includes sensors, processors, identity authentication modules, customized gesture modules and wireless communication modules; the vehicle system includes vehicle control modules, in-vehicle and out-vehicle mode switching modules, multi-user support modules and gesture action interaction mapping modules;

[0014] The process of the vehicle interaction system is as follows:

[0015] The user wears the smart wristband device and first authorizes through the identity authentication module; the smart wristband device has pre-stored the user's gestures set by the customized gesture module, and the smart wristband device starts and begins to monitor the user's electromyographic signals;

[0016] When the sensor detects the tiny electrical activity of the user's hand muscles, the processor converts it into a corresponding gesture, which is transmitted to the vehicle control module through the wireless communication module. After receiving the gesture information, the vehicle control module converts it into a control command through the on-board sensor, thereby performing corresponding operations on the multimedia, air conditioning / seat, or door; and feedbacks the operation results to the user through the smart wristband device or the vehicle display screen;

[0017] The user's gesture actions detected by the sensor include air gestures and surface tap gestures.

[0018] Air gestures are suitable for external vehicle control and control inside the vehicle when not driving. They capture the tiny electrical activities of the hand muscles through sensors, and recognize the user's gestures through the processor. After transmitting them to the vehicle control module, they are further mapped into control commands through the on-board processor: unlocking or locking the doors, starting the engine, etc.

[0019] The surface tap gestures are used for in-car control when the vehicle is in driving state. The sensor captures the tiny electrical activity of the hand muscles and recognizes the tapping actions of different fingers through the processor. After being transmitted to the vehicle control module, it is further mapped to instructions for controlling multimedia control, air conditioning / seat adjustment and other functions through the on-board processor.

[0020] The identity verification module captures the user's electromyographic signal through a sensor and compares it with the pre-stored authorized user data to ensure that only authenticated users can control the vehicle.

[0021] The customized gesture module allows users to set different gesture combinations to control vehicle functions according to their personal habits.

[0022] The vehicle control module is integrated in the vehicle and is responsible for receiving control instructions from the smart wristband device and performing related operations. The module is connected to the vehicle's multimedia system, air conditioning system, door locking system, and wiper system to ensure that all functions of the vehicle can be controlled.

[0023] The multi-user support module can simultaneously receive instructions from multiple smart wristband devices and perform corresponding operations according to the identity and location of the user.

[0024] The in-vehicle and out-of-vehicle mode switching module automatically detects the user's location and switches the control mode:

[0025] Outside vehicle mode: When the user is outside the vehicle, the remote control mode is entered, allowing the user to perform operations such as unlocking the door and starting the engine through air gestures.

[0026] In-car mode: When the user enters the vehicle and starts driving, it switches to in-car control mode, which mainly recognizes surface tap gestures to ensure that the driver can control vehicle functions by lightly touching the steering wheel.

[0027] The gesture action interaction mapping module obtains the corresponding category through the vehicle processor according to the user's gesture or action, and then maps the category into the corresponding instruction to complete the control of the vehicle function.

[0028] Gesture actions for users outside the vehicle include unlocking / locking doors, remotely starting the engine and opening the trunk.

[0029] The gestures that the user performs while in the car include:

[0030] Multimedia controls: Users can adjust the volume with a tap of their thumb on the steering wheel or switch music tracks with a tap of their index finger.

[0031] Air conditioning adjustment: Users can adjust the air conditioning temperature or wind speed by tapping, pressing or rubbing the steering wheel with specific fingers.

[0032] Wiper control: Users tap the steering wheel to start or adjust the wiper speed with specific gestures.

[0033] The advantages of the present invention are:

[0034] 1) The vehicle interaction system based on a smart wristband of the present invention can provide a convenient, safe and personalized vehicle control experience inside and outside the vehicle, and ensure the security and flexibility of vehicle control through multi-user support and identity authentication functions.

[0035] 2) The vehicle interaction system based on a smart wristband of the present invention captures the user's gestures through sensors when the user is outside the vehicle and connects to the vehicle through wireless communication, allowing the user to perform remote operations and control the vehicle without using physical keys or mobile phone applications, which greatly simplifies the operation process, especially when holding objects or it is inconvenient to use a mobile phone, providing higher convenience.

[0036] 3) The vehicle interaction system based on a smart wristband of the present invention can capture the user's micro-gestures in the air or on the steering wheel through sensors when the user is in the vehicle, allowing the user to control the vehicle system, thereby greatly reducing the driver's distraction, avoiding the complexity of physical button operations, and also avoiding the disturbance that voice control may cause to other passengers.

[0037] 4) The vehicle interaction system based on the smart wristband of the present invention can automatically detect whether the user is inside or outside the vehicle, and switch the operation mode according to the user's location. When the user is outside the vehicle, the system provides a remote control function; when the user is inside the vehicle, the system switches to the vehicle function control mode, ensuring that the user can get the best operation experience in different scenarios.

[0038] 5) The vehicle interaction system based on the smart wristband of the present invention supports users to customize the mapping relationship between gestures and vehicle functions according to their personal habits and needs. For example, users can define different gestures to perform specific vehicle control operations to meet personalized needs and enhance the user's highly personalized experience.

[0039] 6) The vehicle interaction system based on the smart wristband of the present invention can identify the user's identity through the electromyographic signal detected by the sensor, ensuring that only authorized users can control the vehicle. This function greatly improves the confidentiality and security of vehicle control and prevents unauthorized users from operating. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 It is a structural diagram of a vehicle interaction system based on a smart wristband of the present invention;

[0041] Figure 2 is a schematic diagram of a user's steering wheel contact gesture in a driving position in an embodiment of the present invention;

[0042] Figure 3 It is a schematic diagram of an aerial gesture of a user in a driving position leaving the steering wheel in an embodiment of the present invention. DETAILED DESCRIPTION

[0043] The high-speed LED device provided by the present invention will be further described in detail below with reference to the accompanying drawings and examples.

[0044] The present invention proposes a vehicle interaction system based on a smart wristband, which realizes remote control and in-vehicle control of the vehicle through a smart wristband device with an integrated electromyography (EMG) sensor, aiming to improve the convenience and safety of the driver and the confidentiality of vehicle control.

[0045] like Figure 1 As shown, the vehicle interaction system includes: a smart wristband device and a vehicle system;

[0046] The smart wristband device includes an EMG sensor, a processor, an identity authentication module, a customized gesture module and a wireless communication module (such as Bluetooth, Wi-Fi); the vehicle system includes a vehicle control module, an in-vehicle and out-of-vehicle mode switching module, a multi-user support module and a gesture action interaction mapping module;

[0047] The process of the vehicle interaction system is as follows:

[0048] The user wears the smart wristband device and first authorizes through the identity authentication module; the smart wristband device has pre-stored the user's gestures set by the customized gesture module, and the smart wristband device starts and begins to monitor the user's electromyographic signals;

[0049] When the sensor detects the tiny electrical activity of the user's hand muscles, the processor converts it into a corresponding gesture, which is transmitted to the vehicle control module through the wireless communication module. After receiving the gesture information, the vehicle control module converts it into a control command through the on-board sensor, thereby performing corresponding operations on the multimedia, air conditioning / seat, or door; and feedbacks the operation results to the user through the smart wristband device or the vehicle display screen;

[0050] The EMG sensor is a core component of the smart wristband device, which is used to capture the electrical activity signals of the user's hand muscles; the sensor can accurately identify the user's gestures, including air gestures and surface tap gestures.

[0051] Air gestures are gestures made by users in the air. They are suitable for external vehicle control and control inside the vehicle when the user is not driving. They capture the tiny electrical activities of the hand muscles through EMG sensors, and recognize the user's gestures through the processor. After being transmitted to the vehicle control module, they are further mapped into control instructions through the on-board processor. For example, users can unlock or lock the car doors, start the engine, etc. through air gestures such as clenching their fists, rotating their wrists, clicking, and tapping.

[0052] Surface tap gesture: The action of a user's finger tapping on the steering wheel or other surfaces, mainly used for in-car control when the vehicle is in driving state. The sensor captures the tiny electrical activity of the hand muscles and recognizes the tapping actions of different fingers through the processor. After being transmitted to the vehicle control module, it is further mapped to instructions for controlling multimedia control, air conditioning / seat adjustment and other functions through the on-board processor. For example, the user can adjust the volume by tapping the steering wheel with the thumb, or switch music tracks by tapping the index finger.

[0053] The identity verification module captures the user's electromyographic signal through the EMG sensor and compares it with the pre-stored authorized user data to ensure that only authenticated users can control the vehicle. This identification based on electromyographic signals is highly unique and secure, similar to biometric technology, ensuring that the vehicle's control authority will not be obtained by unauthorized users.

[0054] The customized gesture module allows users to customize the mapping relationship between gestures and vehicle functions through the supporting mobile phone application or other devices, supports personalized gesture settings and operations, and users can set different gesture combinations to control vehicle functions according to their personal habits and needs. The customized gesture module can be fine-tuned through the smart wristband device to achieve higher recognition accuracy and personalized control experience. For example, users can define complex air gesture combinations to unlock the door, or adjust the air conditioning temperature with simple finger taps.

[0055] 1. Gesture customization process:

[0056] The user connects to the corresponding mobile phone application through the smart wristband device. The application provides a series of preset gestures with icons and animations, and the user can practice the gestures according to the prompts.

[0057] During the gesture rehearsal, the EMG sensor of the smart wristband captures the user's electromyographic signals and transmits the data to the local device or the cloud for processing.

[0058] The system uses this data to fine-tune the customized gesture module to suit the user's unique EMG signal characteristics. This process can be done in real time on the local device or through cloud computing resources for more in-depth analysis and adjustments.

[0059] 2. Custom gestures:

[0060] The user designs and records new gestures. By repeating specific actions many times, the system captures and learns the user's electromyographic signal patterns.

[0061] Custom gestures are also collected through the EMG sensor of the smart wristband device, and are learned and optimized by fine-tuning the customized gesture module.

[0062] In addition to the preset gestures, users can assign specific vehicle function operations to each custom gesture in the mobile app, such as unlocking the door, controlling multimedia, etc.

[0063] 3. Identity and security:

[0064] In the process of fine-tuning the customized gesture module, the system further optimized its ability to recognize the user's electromyographic signals.

[0065] This not only improves the accuracy of gesture recognition, but also enhances the security of user authentication.

[0066] Users can choose to set certain gestures as authentication gestures, setting the gesture itself and the electromyographic characteristics as the user's double verification data, ensuring that only verified users can unlock or operate the vehicle.

[0067] 4. Local and cloud fine-tuning:

[0068] Local fine-tuning: Real-time data processing on the smart wristband device or user’s mobile phone, suitable for daily use scenarios.

[0069] Cloud fine-tuning: Using cloud computing resources for deep learning and data analysis, suitable for scenarios that require higher precision and complexity.

[0070] Users can choose to synchronize usage data locally or in the cloud to continuously improve device usage. At the same time, users can choose to turn on or off the cloud fine-tuning function in the settings to ensure a balance between data privacy and personalized needs.

[0071] The wireless communication module is used for data transmission between the smart wristband device and the vehicle control module. It supports Bluetooth, Wi-Fi and other communication methods to ensure that users can maintain communication with the vehicle system both inside and outside the vehicle. Vehicle control instructions are sent to the vehicle control module in real time through this module to ensure timely response of control operations.

[0072] The vehicle control module is integrated in the vehicle and is responsible for receiving control instructions from the smart wristband device and performing related operations. The module is connected to the vehicle's multimedia system, air conditioning system, door locking system, and wiper system to ensure that various functions of the vehicle can be controlled: such as door locking / unlocking, multimedia control, air conditioning adjustment, wiper start and stop, etc.

[0073] The multi-user support module can receive instructions from multiple smart wristband devices at the same time and perform corresponding operations according to the identity and location of the user. The system supports multiple users to use smart wristband devices for control at the same time. For example, the co-pilot and rear passengers can control the functions related to their seats (such as seat adjustment, multimedia control, etc.) through their respective smart wristband devices. The control rights of passengers can be managed by the owner through the mobile phone application or smart wristband device.

[0074] The in-vehicle and out-vehicle mode switching module automatically detects the user's location (inside or outside the vehicle) and switches the control mode:

[0075] Outside vehicle mode: When the user is outside the vehicle, the remote control mode is entered, allowing the user to perform operations such as unlocking the door and starting the engine through air gestures.

[0076] In-car mode: When the user enters the vehicle and starts driving, it switches to in-car control mode, which mainly recognizes surface tap gestures to ensure that the driver can control vehicle functions by lightly touching the steering wheel.

[0077] The in-car gestures are divided into two categories: steering wheel contact gestures and mid-air gestures that are off the steering wheel, such as Figure 2 and Figure 3 As shown:

[0078] 1. Steering wheel contact gesture safety restrictions:

[0079] Gesture recognition is limited to a specific safe area on the steering wheel: The system uses vehicle sensors and the steering wheel’s built-in pressure sensor to accurately locate the user’s finger position.

[0080] Gesture recognition conditions: a) The steering wheel must remain basically straight (within a deflection angle of ±10 degrees) b) Fingers can only touch lightly within the predefined safety control area c) The single gesture operation time must not exceed 1.5 seconds

[0081] If the steering wheel is in a turning or unstable state or the finger is in an unsafe area, the system will automatically block the gesture recognition function to prevent misoperation.

[0082] 2. Air gesture control without steering wheel:

[0083] Trigger conditions: a) Gesture recognition can only be activated when the driver's hand with the smart wristband is completely off the steering wheel and b) the hand must remain in the air for more than 0.5 seconds;

[0084] Gesture recognition methods: a) Pinch gesture: capture electromyographic signals through EMG sensors to identify finger pinching movements b) Drag up and down: use the wristband's built-in gyroscope to detect spatial movement trajectory;

[0085] Control function:

[0086] Volume adjustment: pinch and drag up and down to simulate volume increase / decrease;

[0087] Air conditioning wind speed: pinch and drag up and down to adjust the wind speed;

[0088] 3. Multiple security mechanisms:

[0089] Recognition time limit: A single air gesture recognition must not exceed 2 seconds;

[0090] Frequency limit: Only 2-3 air gesture operations are allowed every 30 seconds;

[0091] Emergency Shield: Immediately disable gesture recognition when an emergency driving situation (such as sudden lane change, emergency braking) is detected;

[0092] 4. User Configurability:

[0093] Users can adjust the sensitivity of gesture recognition in the mobile app;

[0094] Provide detailed safety guidelines and real-time feedback mechanism;

[0095] The gesture action interaction mapping module obtains the corresponding category through the vehicle processor according to the user's gesture or action, and then maps the category into the corresponding instruction to complete the control of the vehicle function.

[0096] When the user is outside the vehicle, the smart wristband device captures the user's mid-air gestures and sends them to the vehicle control module through the wireless communication module. Common off-vehicle control operations include:

[0097] Unlock / lock the doors: Users can unlock or lock the doors through a custom combination of air gestures (such as clenching a fist, rotating the wrist, etc.). Combined with the identity recognition function of the EMG sensor, the system can ensure that only authorized users can perform these operations.

[0098] Remote Engine Start: Users can start or shut down the engine with specific air gestures, making it easy to adjust the temperature in the car in advance in cold or hot weather.

[0099] Open the trunk: Users can remotely open the trunk with a simple mid-air gesture (such as an open palm) to facilitate carrying items.

[0100] While driving, users can control the vehicle's multimedia, air conditioning, wipers and other functions through surface tap gestures. Common in-car control operations include:

[0101] Multimedia controls: Users can adjust the volume with a tap of their thumb on the steering wheel or switch music tracks with a tap of their index finger.

[0102] Air conditioning adjustment: Users can adjust the air conditioning temperature or wind speed by tapping (index finger), pressing (index finger) or rubbing (thumb) the steering wheel with a specific finger.

[0103] Wiper control: Users tap the steering wheel with a specific gesture (middle finger) to start or adjust the wiper speed.

[0104] The workflow of the system of the present invention is as follows:

[0105] 1) Start the wristband device: The user wears the smart wristband device, the system starts and begins to monitor the electromyographic signal.

[0106] 2) Gesture recognition: The EMG sensor of the smart wristband device detects the user's gestures;

[0107] 3) Mode switching: The system automatically switches to in-vehicle or out-vehicle control mode based on the user's location.

[0108] 4) Command sending: The smart wristband device sends gesture actions to the vehicle control module through the wireless communication module.

[0109] 5) Execute operation: The vehicle control module processes the gesture action, converts it into corresponding instructions and executes the corresponding operation (such as unlocking the door, adjusting the volume, etc.).

[0110] 6) Feedback: The system provides feedback of operation results to the user through the smart wristband device or vehicle display.

[0111] Wherein, the remote control:

[0112] When the user is outside the vehicle, the smart wristband device captures the user's gestures through the EMG sensor and connects to the vehicle system through wireless communication (such as Bluetooth or Wi-Fi or intermediate forwarding devices such as mobile phones), allowing the user to perform remote operations such as unlocking or locking the door, starting or shutting down the engine and other basic functions. In this way, users can control the vehicle without using physical keys or mobile phone applications, which greatly improves convenience.

[0113] The in-car controls:

[0114] The smart wristband device captures the user's micro-gestures through EMG sensors, allowing the user to control simple functions of the vehicle system, such as multimedia playback, air conditioning adjustment, wiper activation, etc. In particular, users can achieve control through micro-gestures in the air or on the steering wheel, which greatly reduces the driver's distraction, avoids the complexity of physical button operations, and also avoids the disturbance that voice control may cause to other passengers.

[0115] The automatic switching function:

[0116] The system can automatically detect whether the user is inside or outside the car, and switch the operation mode according to the user's location. When outside the car, the system provides remote control functions; when inside the car, the system switches to the in-vehicle function control mode, ensuring that users can get the best operation experience in different scenarios.

[0117] Customization of the gesture mapping:

[0118] The system supports users to customize the mapping relationship between gestures and vehicle functions according to their personal habits and needs. For example, users can define different gestures to perform specific vehicle control operations to meet personalized needs and improve user experience.

[0119] The user identification:

[0120] The electromyographic signals detected by the EMG sensor can be used to identify the user, ensuring that only authorized users can control the vehicle. This function greatly improves the security of vehicle control and prevents unauthorized users from operating.

[0121] The present invention is based on the intelligent wristband system of EMG sensor, which provides remote control and in-vehicle control of the vehicle through gesture recognition and dual verification of electromyographic signals. The system can not only realize personalized control of vehicle functions through customized gesture mapping, but also identify the user's identity through electromyographic signals to ensure that only authorized users can operate the vehicle. In addition, the system can automatically distinguish whether the user is inside or outside the vehicle, and switch the corresponding control mode according to the scene. This EMG-based dual verification and gesture control technology is unique and innovative in the field of vehicle control.

[0122] In the gesture recognition and control based on EMG sensor of the present invention, 1): the smart wristband device detects the user's gesture movements through the EMG sensor and converts them into instructions for controlling the vehicle. Gesture recognition includes air gestures and surface tap gestures, which are used for remote control outside the vehicle and driving control inside the vehicle respectively. 2): the system supports user-defined gesture mapping relationships, allowing users to control various functions of the vehicle through air gestures or surface tap gestures, including but not limited to door unlocking / locking, engine starting, air conditioning adjustment, multimedia control, etc.

[0123] In user identification and authorization management, 3): The system can identify the user by detecting the user's electromyographic signal through the EMG sensor to ensure that only authorized users can control the vehicle. 4): The system supports the owner to manage the control rights of the passengers, allowing the owner to authorize the passengers to control certain functions of the vehicle through mobile phone applications or wristband devices. The control functions of the passengers are restricted according to their seat position. For example, the co-pilot can control the co-pilot seat and air conditioning, and the rear passengers can control the rear seats and air conditioning.

[0124] Automatic switching between in-vehicle and out-vehicle modes, 5): The system can automatically detect whether the user is in or out of the vehicle, and automatically switch the control mode according to the user's location. When outside the vehicle, the system enters remote control mode, allowing the user to control the vehicle through air gestures; when inside the vehicle, the system switches to in-vehicle function control mode, mainly recognizing surface tap gestures to ensure that the driver can control vehicle functions safely and conveniently.

[0125] Multi-user and multi-device support, 6): The system supports multiple smart wristband devices to control the vehicle at the same time, and the vehicle control module can perform corresponding operations according to the identity and location of the user. For example, the driver controls the functions on the steering wheel through surface tap gestures, and the co-pilot and rear passengers can control the functions related to their seats through their respective wristbands.

[0126] In wireless communication and system response, 7): The smart wristband device and the vehicle control module exchange data through the wireless communication module (such as Bluetooth, Wi-Fi) to ensure real-time and stable control operations both inside and outside the vehicle.

[0127] In order to balance the power consumption, computational effort and recognition accuracy of the system, a low-power unlocking mechanism based on position sensors and gyroscopes is used as a pre-trigger condition for EMG gesture recognition. This mechanism recognizes specific trigger actions through continuous monitoring by low-power sensors, thereby activating the EMG gesture recognition function on demand.

[0128] 1. Core components of the unlocking mechanism:

[0129] Low-power position sensor: Continuously monitors the wristband’s spatial position and posture;

[0130] Gyroscope: captures wrist rotation and acceleration changes in real time;

[0131] Lightweight recognition model: based on simple threshold judgment and state machine logic;

[0132] 2. External unlocking mechanism:

[0133] Trigger action options: a) Continuous wrist rotation (default 3 times): capture wrist rotation of a specific frequency and amplitude through the gyroscope b) "Watch-looking" posture: Identify the typical movement characteristics of raising the wrist and pausing;

[0134] Identification process:

[0135] a. The gyroscope continuously collects wrist motion data;

[0136] b. The lightweight model determines the effectiveness of the action by setting a threshold;

[0137] c. The state machine tracks the integrity of the action sequence;

[0138] d. Activate the EMG sensor and gesture recognition function after the conditions are met;

[0139] Timeout mechanism:

[0140] If there is no valid gesture within 5 seconds after unlocking, it will automatically return to low power consumption state; Automatically shut down the EMG recognition function after the gesture operation is completed;

[0141] 3. Unlocking mechanism inside the car:

[0142] Steering wheel contact trigger:

[0143] a. Use the gyroscope to identify the characteristic movements of the hands on the steering wheel;

[0144] b. Confirm the contact position in conjunction with the steering wheel pressure sensor;

[0145] c. Activate EMG gesture recognition only in safe areas;

[0146] Air gesture trigger:

[0147] a. Gyroscope detects hand lifting action;

[0148] b. The position sensor confirms that the hand stays in the preset space area;

[0149] c. Activate EMG recognition after the duration exceeds the threshold;

[0150] 4. Low power consumption design features:

[0151] Hierarchical activation strategy:

[0152] a. Normal state: only keep low-frequency sampling of position sensor and gyroscope; b. Pre-activation: Increase the sampling rate after the initial action is detected;

[0153] c. Fully activated: Turn on the EMG sensor after the trigger conditions are met;

[0154] Dynamic power regulation:

[0155] Adaptively adjust the sampling frequency according to the usage scenario;

[0156] Reduce the sensor operating frequency when the vehicle is stationary;

[0157] Intelligent sleep mechanism automatically manages the status of each sensor;

[0158] 5. Unlocking model features to ensure reliability (training negative samples):

[0159] Action parameter adaptation:

[0160] The system records the user's habitual action characteristics;

[0161] Dynamically adjust the recognition threshold and time window;

[0162] Accidental touch protection:

[0163] Set dual thresholds for motion amplitude and duration;

[0164] Eliminate interference from similar movements in daily activities;

[0165] Environmental adaptation:

[0166] Consider the impact of vehicle motion on sensor data;

[0167] Correct motion compensation values ​​in real time;

[0168] 6. User experience optimization:

[0169] Visual feedback:

[0170] The unlock status is indicated by wristband vibration or LED;

[0171] The in-vehicle screen displays the current gesture recognition mode;

[0172] Custom configuration:

[0173] Allow users to select their preferred unlocking action;

[0174] Provide unlock sensitivity adjustment options;

[0175] ·Retain the successfully unlocked parameter configuration and dynamically adjust the personalized model.

Claims

1. A vehicle interaction system based on a smart wristband, characterized in that: include: Smart wristband devices and car systems; The smart wristband device includes sensors, processors, identity authentication modules, customized gesture modules and wireless communication modules; the vehicle system includes vehicle control modules, in-vehicle and out-vehicle mode switching modules, multi-user support modules and gesture action interaction mapping modules; The process of the vehicle interaction system is as follows: The user wears the smart wristband device and first authorizes through the identity authentication module; the smart wristband device has pre-stored the user's gestures set by the customized gesture module, and the smart wristband device starts and begins to monitor the user's electromyographic signals; When the sensor detects the tiny electrical activity of the user's hand muscles, the processor converts it into corresponding gestures, which are transmitted to the vehicle control module through the wireless communication module. After receiving the gesture information, the vehicle control module converts it into control instructions through the on-board sensor, thereby performing corresponding operations on the multimedia, air conditioning / seats, or doors; and feedbacks the operation results to the user through the smart wristband device or the vehicle display.

2. The vehicle interaction system according to claim 1, characterized in that: The user's gesture actions detected by the sensor include air gestures and surface tap gestures; Air gestures are suitable for external vehicle control and control inside the vehicle when not in use. Sensors capture the tiny electrical activity of hand muscles, and the processor recognizes the user's gestures. After transmitting them to the vehicle control module, they are further mapped into control commands through the on-board processor: unlock or lock the door, start the engine; The surface tap gestures are used for in-car control when the vehicle is in driving state. The sensor captures the tiny electrical activity of the hand muscles and recognizes the tapping actions of different fingers through the processor. After being transmitted to the vehicle control module, it is further mapped to the instructions for controlling multimedia control and air conditioning / seat adjustment through the on-board processor.

3. The vehicle interaction system according to claim 1, characterized in that: The identity authentication module captures the user's electromyographic signal through a sensor and compares it with the pre-stored authorized user data to ensure that only authenticated users can control the vehicle.

4. The vehicle interaction system according to claim 1, characterized in that: The customized gesture module allows users to set different gesture combinations to control vehicle functions according to their personal habits.

5. The vehicle interaction system according to claim 1, characterized in that: The vehicle control module is integrated in the vehicle and is responsible for receiving control instructions from the smart wristband device and performing related operations; the module is connected to the vehicle's multimedia system, air conditioning system, door locking system and wiper system to ensure that various functions of the vehicle can be controlled.

6. The vehicle interaction system according to claim 1, characterized in that: The multi-user support module can simultaneously receive instructions from multiple smart wristband devices and perform corresponding operations according to the identity and location of the user.

7. The vehicle interaction system according to claim 1, characterized in that: The in-vehicle and out-of-vehicle mode switching module automatically detects the user's location and switches the control mode: Out-of-car mode: When the user is outside the vehicle, the remote control mode is entered, allowing the user to unlock the door and start the engine through air gestures; In-car mode: When the user enters the vehicle and starts driving, it switches to in-car control mode, which mainly recognizes surface tap gestures to ensure that the driver can control vehicle functions by lightly touching the steering wheel.

8. The vehicle interaction system as claimed in claim 1, characterized in that: The gesture action interaction mapping module obtains the corresponding category through the vehicle processor according to the user's gesture or action, and then maps the category into the corresponding instruction to complete the control of the vehicle function.

9. The vehicle interaction system as claimed in claim 8, characterized in that: Gesture actions for users outside the vehicle include unlocking / locking doors, remote engine start and opening the trunk; The gestures that the user performs while in the car include: Multimedia controls: Users can adjust the volume with a tap of their thumb on the steering wheel or switch music tracks with a tap of their index finger; Air conditioning adjustment: Users can adjust the air conditioning temperature or wind speed by tapping, pressing or rubbing the steering wheel with specific fingers; Wiper control: Users tap the steering wheel to start or adjust the wiper speed with specific gestures.

Images