Gesture interaction control method based on cockpit intelligent interaction system

Abstract

The invention discloses a gesture interaction control method based on a cabin intelligent interaction system, and the main design concept of the method is that a wearable interaction device in the cabin intelligent interaction system is associated and bound with a controlled target; after binding is completed, the wearable interaction device is worn, and an operation gesture is set for each controlled target; after the setting is completed, when the wearable interaction device is close to any controlled target, dynamically loading a corresponding gesture instruction set, and obtaining a corresponding control instruction according to a sensing result of an actual gesture action; and the controlled target in the cabin intelligent interaction system executes corresponding control based on the control instruction. According to the method, the wearable interaction device associated and bound with the equipment is combined, the equipment control of the vehicle cabin system is carried out through gesture actions, and the problems that traditional gesture control is inaccurate in target positioning, single in interaction dimension, lack of a state feedback mechanism and the like are effectively solved.

Description

Technical Field

[0001] This invention relates to the field of vehicle cockpit interaction technology, and in particular to a gesture interaction control method based on a cockpit intelligent interaction system. Background Technology

[0002] With the development of smart cockpit technology, vehicle control methods are evolving from physical buttons to touchscreens, voice, and gesture interaction. However, these conventional interaction methods all have obvious limitations: physical button operation requires precise positioning, which can easily distract the driver, and touchscreen interaction requires eye contact, posing a safety hazard; voice control has a low recognition rate in noisy environments; and existing gesture recognition systems (such as ToF cameras) are expensive and affected by light and obstructions.

[0003] Furthermore, analysis revealed that other interactive operations related to the vehicle cockpit also suffer from several problems, including a lack of target device positioning, difficulty in distinguishing controlled targets (such as the simultaneous presence of multiple air conditioners), a single interaction dimension (only recognizing two-dimensional planar operation actions), a lack of status feedback mechanisms (users cannot perceive the operation confirmation status), and a complex startup process (such as requiring manual switching of control modes). Summary of the Invention

[0004] In view of the above, the present invention aims to provide a gesture interaction control method based on a cockpit intelligent interaction system to solve the aforementioned technical problems.

[0005] The technical solution adopted in this invention is as follows:

[0006] This invention provides a gesture interaction control method based on a cockpit intelligent interaction system, including:

[0007] Associating and binding wearable interactive devices in the cockpit intelligent interaction system with the controlled target;

[0008] After binding is complete, wear the wearable interactive device and set operation gestures for each controlled target;

[0009] Once the settings are complete, when the wearable interactive device approaches any controlled target, the corresponding gesture instruction set is dynamically loaded, and the corresponding control instructions are obtained based on the sensing results of the actual gesture movements.

[0010] The controlled target in the cockpit intelligent interaction system performs corresponding control based on the control commands.

[0011] In at least one of the possible implementations, the setting of the operation gesture includes: fusing the sliding trajectory executed on the surface of the wearable interactive device with the spatial motion trajectory after wearing it into a five-dimensional gesture command, and forming a gesture command set.

[0012] In at least one of the possible implementations, the wearable interactive device includes: an NFC reading module, a nine-axis IMU sensor, a capacitive slider sensor, a linear vibration motor, an LED light, and a rechargeable battery.

[0013] In at least one of the possible implementations, the sensor, capacitive sliding sensor, linear vibration motor, LED light, and rechargeable battery are integrated into a ring-shaped interactive device.

[0014] In at least one possible implementation, the association binding includes:

[0015] After the wearable interactive device is triggered to enter the preset learning mode, it will automatically bind to the NFC tag placed near the controlled target.

[0016] During the binding process, the wearable interactive device provides feedback in a tactile and / or visual manner to indicate the binding status.

[0017] In at least one possible implementation, obtaining the corresponding control command based on the sensing result of the actual gesture action specifically includes:

[0018] Once activated, the wearable interactive device monitors NFC tag information in real time.

[0019] When NFC tag information is detected, the wearable interactive device provides tactile and / or visual feedback to indicate that the corresponding controlled target has been associated.

[0020] The actual hand gesture is detected and recognized, and the corresponding control command is obtained from the gesture command set.

[0021] In at least one of the possible implementations, the setting of the operation gesture further includes: setting an emergency instruction set, which is used to force the corresponding controlled target to perform a preset control operation directly based on the actual gesture action after the wearable interactive device is activated.

[0022] Compared with existing technologies, the main design concept of this invention lies in associating and binding a wearable interactive device in a cockpit intelligent interaction system with a controlled target. After binding, the wearable interactive device is worn, and operation gestures are set for each controlled target. After setting, when the wearable interactive device approaches any controlled target, the corresponding gesture command set is dynamically loaded, and the corresponding control command is obtained based on the sensing result of the actual gesture action. The controlled target in the cockpit intelligent interaction system executes corresponding control based on the control command. This invention, combined with a wearable interactive device associated with the device, uses gesture actions to control the device in the vehicle cockpit system, effectively solving the problems of inaccurate target positioning, single interaction dimension, and lack of status feedback mechanism in traditional gesture control. Attached Figure Description

[0023] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described below with reference to the accompanying drawings, wherein:

[0024] Figure 1 This is a schematic diagram of a gesture interaction control method based on a cockpit intelligent interaction system provided in an embodiment of the present invention. Detailed Implementation

[0025] Embodiments of the present invention are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0026] This invention proposes an embodiment of a gesture interaction control method based on a cockpit intelligent interaction system, specifically, as follows: Figure 1 As shown, it includes:

[0027] Step S1: Associate and bind the wearable interactive device in the cockpit intelligent interactive system with the controlled target;

[0028] The wearable interactive device in the cockpit intelligent interaction system includes: an NFC reading module, a nine-axis IMU sensor, a capacitive slider sensor, a linear vibration motor, an LED light (diameter ≤3mm), and a rechargeable battery. In some preferred embodiments, the above-mentioned device components can be integrated into a ring-shaped wearable interactive device using a coaxial package structure.

[0029] Controlled targets in the cockpit intelligent interaction system include at least seats equipped with NFC tags, air conditioning panels, etc.

[0030] In addition, the cockpit intelligent interaction system also includes at least: an on-board ECU (preferably via BLE 5.0 communication).

[0031] Continuing from the previous text, during the binding phase, based on the previous example, you can enter the learning mode by double-clicking the surface of the ring (at this time, in actual operation, the LED light can flash yellow to indicate this). Then, you can bring the ring close to the NFC tag of the target, triggering the ring to provide tactile feedback through the linear vibration motor, thereby indicating the binding status between the two.

[0032] Step S2: After binding is completed, set operation gestures for each controlled target;

[0033] This involves recording multi-dimensional spatial gesture commands specifically for each controlled target, which are then used for the recognition, sensing, and control of the wearable interactive device. This can support, but is not limited to, turning, pushing, and planar sliding actions. In a preferred embodiment of the invention, the sliding trajectory (two-dimensional vector) on the surface of the wearable interactive device and the spatial motion trajectory (three-dimensional vector) are fused into a five-dimensional gesture command. Furthermore, the same action can be set for different controlled targets, but the execution results will differ. For example, the same turning gesture can be used to control the volume of a multimedia device in the steering wheel area, while in the seat area it can control the angle of the backrest.

[0034] Step S3: After the settings are completed, when the wearable interactive device approaches any controlled target, the corresponding gesture command set is dynamically loaded (stored in the vehicle ECU after the settings are recorded first), and the corresponding control command is obtained according to the sensing results of the gesture action.

[0035] This section, using the previous example, introduces a complete active control method (taking air conditioning control as an example):

[0036] First, press and hold the ring for 3 seconds to activate it (LED lights up blue and motor vibrates once).

[0037] When the ring is brought close to the NFC tag of the air conditioner, it vibrates twice (that is, it confirms the switch of control over the air conditioner and loads the aforementioned gesture operation settings for the corresponding air conditioner).

[0038] Wearable interactive devices recognize the user's current gestures and obtain control commands, such as:

[0039] Rotate clockwise to increase the temperature (LED color changes gradually every 10°).

[0040] Push forward → Increase airflow (synchronous stepped vibration feedback);

[0041] Slide diagonally → Adjust the air outlet angle.

[0042] In practice, the processing algorithms pre-configured for wearable interactive devices in the background of the intelligent interaction system can be, but are not limited to, support vector machines (SVM), to classify the type of the current gesture in real time and match the corresponding gesture command from the gesture command set for target control.

[0043] Finally, in step S4, the controlled target executes the corresponding control based on the control command.

[0044] In some preferred embodiments of the present invention, when recording gesture operation commands, an emergency control mode can also be set. Specifically, when setting operation gestures for each controlled target, an emergency command set is also set. The emergency command set is used to skip the triggering step of proximity to the NFC tag, that is, to ignore whether the wearable interactive device is close to a controlled target, and instead directly perform forced control on the relevant components according to a specific preset gesture. For example, clenching a fist and then flicking it back will trigger the emergency closing of all car windows (and can provide feedback through strong vibration and trigger the output alarm signal); or, raising four fingers and sliding them back will force the sunroof of the vehicle to open fully, etc.

[0045] In summary, the main design concept of this invention lies in associating and binding a wearable interactive device in a cockpit intelligent interaction system with a controlled target. After binding, the wearable interactive device is worn, and operation gestures are set for each controlled target. After setting, when the wearable interactive device approaches any controlled target, the corresponding gesture command set is dynamically loaded, and the corresponding control command is obtained based on the sensing result of the actual gesture action. The controlled target in the cockpit intelligent interaction system executes corresponding control based on the control command. This invention, combined with a wearable interactive device associated with the device, uses gesture actions to control the device in the vehicle cockpit system, effectively solving the problems of inaccurate target positioning, single interaction dimension, and lack of state feedback mechanism in traditional gesture control.

[0046] In this invention, when directional terms are mentioned, they are relative concepts based on the embodiments. Furthermore, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, A and B simultaneously, or B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects have an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.

[0047] The above description of the structure, features, and effects of the present invention is based on the embodiments shown in the figures. However, the above are only preferred embodiments of the present invention. It should be noted that the technical features involved in the above embodiments and their preferred methods can be reasonably combined and matched by those skilled in the art to form a variety of equivalent solutions without departing from or changing the design concept and technical effects of the present invention. Therefore, the present invention is not limited to the scope of implementation shown in the figures. Any changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments, that do not exceed the spirit covered by the specification and figures, should be within the protection scope of the present invention.

Claims

1. A gesture interaction control method based on a cockpit intelligent interaction system, characterized in that, The application relates to a wearable interaction device and a controlled target in a cockpit intelligent interaction system. The wearable interaction device is associated with the controlled target; After the association is completed, an operation gesture is set for each controlled target; After the setting is completed, when the wearable interaction device is close to any controlled target, a corresponding gesture instruction set is dynamically loaded, and a corresponding control instruction is obtained according to the sensing result of an actual gesture action; The controlled target in the cockpit intelligent interaction system executes corresponding control based on the control instruction.

2. The gesture interaction control method based on the cockpit intelligent interaction system according to claim 1, characterized in that, The setting operation gesture includes: fusing a sliding track on the surface of the wearable interaction device and a spatial motion track after wearing into a five-dimensional gesture instruction, and forming a gesture instruction set. 3.The gesture interaction control method based on the cockpit intelligent interaction system according to claim 1, characterized in that, The wearable interaction device includes an NFC reading module, a nine-axis IMU sensor, a capacitive sliding sensor, a linear vibration motor, an LED lamp and a rechargeable battery.

4. The gesture interaction control method based on the cockpit intelligent interaction system according to claim 3, characterized in that, The sensor, the capacitive sliding sensor, the linear vibration motor, the LED lamp and the rechargeable battery are integrated in a ring-shaped interaction device.

5. The gesture interaction control method based on the cockpit intelligent interaction system according to claim 3, characterized in that, The association includes: After the wearable interaction device is triggered to enter a preset learning mode, the wearable interaction device is automatically associated with an NFC tag arranged at the controlled target; During the association, the wearable interaction device provides feedback in a tactile and / or visual manner to prompt the association state.

6. The gesture interaction control method based on the cockpit intelligent interaction system according to claim 5, characterized in that, The control instruction obtained according to the sensing result of the actual gesture action specifically includes: After the wearable interaction device is activated, the NFC tag information is monitored in real time; When the NFC tag information is monitored, the wearable interaction device provides tactile and / or visual feedback to prompt that the corresponding controlled target is associated; The actual gesture action is detected and recognized, and a corresponding control instruction is obtained from the gesture instruction set.

7. The gesture interaction control method based on the cockpit intelligent interaction system according to any one of claims 1-6, characterized in that, The setting operation gesture also includes: setting an emergency instruction set, which is used to directly execute a preset control operation on the corresponding controlled target according to the actual gesture action after the wearable interaction device is activated.

Images