Intelligent cockpit control system, method and device based on electromyographic signal

By using myoelectric bracelets in the smart cockpit control system to collect myoelectric signals and identify identity signals, combined with the cloud database verification of the in-vehicle infotainment system, the problem of insufficient security in the existing technology is solved and higher security is achieved. sex and user experience.

CN116880689BActive Publication Date: 2025-01-21VOYAH AUTOMOBILE TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202310838618.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-07-10
Publication Date
2025-01-21
Estimated Expiration
2043-07-10

AI Technical Summary

Technical Problem

The lack of identity identification of the wearer of the EMG bracelet in the existing smart cockpit control scheme based on EMG signals leads to insufficient security.

Method used

By collecting the wearer's electromyographic signals in real time in the myoelectric bracelet, the identity representation signals corresponding to basic gesture movements and the cockpit control instructions corresponding to the preset gesture movements are obtained, and these signals are sent to the in-vehicle infotainment system. The in-vehicle infotainment system detects whether the wearer is an authorized user based on the cloud database and identity representation signals, and only executes cockpit control instructions when the wearer is an authorized user.

Benefits of technology

By identifying each cockpit control command, it is ensured that all operations originate from the instructions of authorized users, which improves the security of the system. At the same time, the user is not required to perform additional identity authentication operations, which improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116880689B_ABST
    Figure CN116880689B_ABST
Patent Text Reader

Abstract

The present invention provides an intelligent cockpit control system, method and device based on electromyographic signals, the system comprising an electromyographic bracelet, an in-vehicle infotainment system and a cloud database. The electromyographic bracelet is used to collect the electromyographic signals of the wearer in real time, obtain the identity representation signals corresponding to the basic gesture actions and the cockpit control instructions corresponding to the preset gesture actions from the electromyographic signals, and send them to the in-vehicle infotainment system. The in-vehicle infotainment system is used to detect whether the wearer is an authorized user based on the cloud database and the identity representation signals. If the wearer is an authorized user, the cockpit device is controlled to perform corresponding operations according to the cockpit control instructions. The cloud database is used to store the identity representation signals in the electromyographic signals when the authorized user performs basic gesture actions. Through the present invention, it is ensured that all executed operations are derived from the instructions of the authorized user, which improves security. The user does not need to perform additional identity authentication operations during use, which improves the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle control technology, and in particular to an intelligent cockpit control system, device and equipment based on electromyographic signals. Background Art

[0002] The smart cockpit is mainly composed of electronic devices such as in-vehicle infotainment (IVI), streaming media rearview mirror, visual perception system, voice interaction system, smart seats and rear display screens. Among them, the in-vehicle infotainment system is an in-vehicle comprehensive information processing system formed by a dedicated on-board central processor, based on the body bus system and Internet services. In related technologies, users wear myoelectric bracelets and interact with the in-vehicle infotainment system through the myoelectric signals generated by preset gestures, so as to obtain a better driving experience. However, the current smart cockpit control scheme based on electromyographic signals lacks identity recognition of the wearer of the myoelectric bracelet, and the security is insufficient. Summary of the invention

[0003] The main purpose of the present invention is to provide an intelligent cockpit control system, device and equipment based on electromyographic signals, aiming to solve the technical problem of insufficient safety of intelligent cockpit control solutions based on electromyographic signals in related technologies.

[0004] In a first aspect, the present invention provides an intelligent cockpit control system based on electromyographic signals, the intelligent cockpit control system comprising an electromyographic bracelet, an in-vehicle infotainment system and a cloud database;

[0005] The myoelectric bracelet is used to collect the wearer's electromyographic signals in real time, obtain the identity representation signal corresponding to the basic gesture action and the cockpit control instruction corresponding to the preset gesture action from the electromyographic signal, and send the identity representation signal and the cockpit control instruction to the in-vehicle infotainment system, wherein the preset gesture action is configured as the basic gesture action or a combination thereof;

[0006] The in-vehicle infotainment system is used to detect whether the wearer is an authorized user according to the cloud database and the identity representation signal, and if the wearer is an authorized user, control the cockpit device to perform corresponding operations according to the cockpit control instruction;

[0007] The cloud database is used to store the identity representation signal in the electromyographic signal when the authorized user performs the basic gesture action.

[0008] Furthermore, in one embodiment, the in-vehicle infotainment system is also used to learn the electromyographic signals of the wearer when performing the basic gesture movements after obtaining authorization if the wearer is not an authorized user, and send the corresponding identity representation signal to the cloud database.

[0009] Furthermore, in one embodiment, the myoelectric bracelet is also used to collect the wearer's vital sign signals in real time, and when the wearer is a driver, monitor whether the driver is in a fatigue driving state based on the vital sign signals.

[0010] Furthermore, in one embodiment, the myoelectric bracelet is also used to vibrate to remind the driver when the driver is in a fatigue driving state.

[0011] Furthermore, in one embodiment, the in-vehicle infotainment system is also used to output an anti-mistouch confirmation reminder when the driver is in a fatigue driving state, and after receiving a voice confirmation or receiving the cockpit control command again, control the cockpit equipment to perform corresponding operations according to the cockpit control command.

[0012] Furthermore, in one embodiment, the in-vehicle infotainment system is also used to receive a feedback signal after the cockpit device completes a corresponding operation, and send the feedback signal to the myoelectric bracelet;

[0013] The myoelectric bracelet is also used to vibrate and prompt after receiving the feedback signal.

[0014] Furthermore, in one embodiment, the myoelectric bracelet is used to send the cockpit control command to the in-vehicle infotainment system in the form of a signal signal;

[0015] The in-vehicle infotainment system is used to convert the signal signal into a service signal, and call the service function module corresponding to the service signal to control the cockpit device to perform the operation corresponding to the cockpit control instruction.

[0016] In a second aspect, the present invention further provides an intelligent cockpit control method based on electromyographic signals, which is applied to an intelligent cockpit control system including an electromyographic bracelet, an in-vehicle infotainment system and a cloud database, and the intelligent cockpit control method includes:

[0017] The myoelectric bracelet collects the wearer's electromyographic signals in real time, obtains the identity representation signal corresponding to the basic gesture action and the cockpit control instruction corresponding to the preset gesture action from the electromyographic signal, and sends the identity representation signal and the cockpit control instruction to the in-vehicle infotainment system, wherein the preset gesture action is configured as the basic gesture action or a combination thereof;

[0018] The in-vehicle infotainment system detects whether the wearer is an authorized user based on the cloud database and the identity representation signal. If the wearer is an authorized user, the cockpit device is controlled to perform corresponding operations according to the cockpit control instruction, wherein the cloud database is used to store the identity representation signal in the electromyographic signal when the authorized user performs the basic gesture action.

[0019] Furthermore, in one embodiment, after the step of detecting whether the wearer is an authorized user according to the cloud database and the identity representation signal, the step further includes:

[0020] If the wearer is not an authorized user, the myoelectric signals of the wearer performing the basic gestures are learned after obtaining authorization, and the corresponding identity representation signals are sent to the cloud database.

[0021] In a third aspect, the present invention also provides an electromyographic signal-based intelligent cockpit control device, the intelligent cockpit control device comprising a processor, a memory, and an intelligent cockpit control program stored in the memory and executable by the processor, wherein when the intelligent cockpit control program is executed by the processor, the steps of the above-mentioned intelligent cockpit control method are implemented.

[0022] In the present invention, the cloud database stores the identity characterization signal in the electromyographic signal when the authorized user performs basic gestures. The electromyographic bracelet obtains the cockpit control command from the wearer's electromyographic signal and also obtains the identity characterization information. After receiving the cockpit control command and the identity characterization information, the in-vehicle infotainment system first detects whether the wearer is an authorized user based on the cloud database and the identity characterization signal. Only when the wearer is an authorized user will the cockpit device be controlled to perform the corresponding operation. Through the present invention, on the one hand, identity recognition will be performed for each cockpit control command to ensure that all executed operations are derived from the instructions of the authorized user, thereby improving security. On the other hand, the user does not need to perform additional identity authentication operations during use, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a schematic diagram of the structure of an intelligent cockpit control system in one embodiment of the present invention;

[0024] Figure 2 A schematic diagram of the working process of the in-vehicle infotainment system in one embodiment of the present invention;

[0025] Figure 3 It is a structural schematic diagram of an intelligent cockpit control system in another embodiment of the present invention;

[0026] Figure 4 It is a flowchart of a smart cockpit control method according to an embodiment of the present invention;

[0027] Figure 5 The figure is a schematic diagram of the hardware structure of an intelligent cockpit control device in one embodiment of the present invention.

[0028] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0029] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0030] In a first aspect, an embodiment of the present invention provides an intelligent cockpit control system based on electromyographic signals.

[0031] Figure 1 A schematic diagram of the structure of an intelligent cockpit control system in one embodiment of the present invention is shown.

[0032] Reference Figure 1 In one embodiment, the intelligent cockpit control system includes an electromyographic bracelet, an in-vehicle infotainment system and a cloud database. The electromyographic bracelet is used to collect the wearer's electromyographic signals in real time, obtain the identity representation signal A corresponding to the basic gesture action and the cockpit control instruction B corresponding to the preset gesture action from the electromyographic signal, and send the identity representation signal A and the cockpit control instruction B to the in-vehicle infotainment system, wherein the preset gesture action is configured as a basic gesture action or a combination thereof. The in-vehicle infotainment system is used to detect whether the wearer is an authorized user based on the cloud database and the identity representation signal A. If the wearer is an authorized user, the cockpit device is controlled to perform the corresponding operation according to the cockpit control instruction B. The cloud database is used to store the identity representation signal in the electromyographic signal when the authorized user performs a basic gesture action.

[0033] A circle of microelectrodes is installed on the strap of the myoelectric bracelet to sense the myoelectric signals at the wearer's wrist. After acquiring the myoelectric signals, the collected myoelectric signals are amplified and filtered to obtain the characteristic signals required for subsequent analysis. The characteristic signals are further analyzed and calculated to extract identity representation signals and cockpit control instructions. Due to individual differences, the myoelectric signals generated by each person when performing the same action will have slight differences. By detecting the target signals in the myoelectric signals when the individual completes certain specific actions, such as the amplitude of movement, the intensity / potential sequence of the muscle electrical signals, etc., it is possible to distinguish different individuals. Therefore, the above-mentioned target signals in the myoelectric signals can play a role in identity representation, and this embodiment defines it as an identity representation signal.

[0034] The identity characterization signal corresponds to the basic gesture action, and the preset gesture action representing the cockpit control command is the basic gesture action or a combination thereof, that is, the preset gesture action includes at least one basic gesture action. Therefore, when the wearer performs any preset gesture action, the myoelectric bracelet can obtain the identity characterization signal and the cockpit control command from the myoelectric signal. For example, the basic gesture actions may include clenching a fist, releasing it, waving left and right, moving the thumb, etc. The preset gesture actions can be configured to release the fist after clenching it, moving the thumb several times, etc., and the user can configure it according to their needs.

[0035] The in-vehicle infotainment system compares the received identity representation signal with the identity representation signals under the same basic gesture action in the cloud database. If there is a consistent identity representation signal, the wearer is determined to be the authorized user to which the identity representation signal belongs, and then the cockpit control command issued by the wearer is executed. If there is no consistent identity representation signal, it is determined that the wearer is not an authorized user and has no right to control the cockpit equipment, and the cockpit control command issued by the wearer will not be executed.

[0036] Therefore, in this embodiment, the cloud database stores the identity characterization signal in the electromyographic signal when the authorized user performs basic gestures. The electromyographic bracelet obtains the cockpit control command from the wearer's electromyographic signal and also obtains the identity characterization information. After receiving the cockpit control command and the identity characterization information, the in-vehicle infotainment system first detects whether the wearer is an authorized user based on the cloud database and the identity characterization signal. Only when the wearer is an authorized user will the cockpit device be controlled to perform the corresponding operation. Through the present invention, on the one hand, identity recognition will be performed for each cockpit control command to ensure that all executed operations are derived from the instructions of the authorized user, thereby improving security. On the other hand, the user does not need to perform additional identity authentication operations during use, thereby improving the user experience.

[0037] Figure 2 A schematic diagram of the working process of the in-vehicle infotainment system in one embodiment of the present invention is shown.

[0038] Reference Figure 2 ,Furthermore, in one embodiment, the in-vehicle infotainment system is also used to learn the electromyographic signals of the wearer when performing basic gestures after obtaining authorization permission if the wearer is not an authorized user, and send the corresponding identity representation signal to the cloud database.

[0039] In this embodiment, the in-vehicle infotainment system is also used to add the identity representation signal of a new authorized user to the cloud database. Specifically, if the wearer is not an authorized user, the in-vehicle infotainment system will request authorization permission. For example, when the display screen asks whether to add new user information, after selecting yes, security verification (face, fingerprint, voiceprint recognition, password input, etc.) is required to prove that the operator has sufficiently high usage permissions. For another example, the owner terminal asks whether to add new user information. After obtaining the authorization permission, the wearer is prompted by voice or display screen to start learning the operation, so that the wearer performs each basic gesture action, and each action is maintained for a period of time. During this period, the electromyographic bracelet will obtain the identity representation signal under each action and send it to the cloud database. After the learning is completed, the cloud database will save the identity of the authorized user and the identity representation signal corresponding to each basic gesture action. Subsequently, the wearer can control the various cockpit devices normally by performing the preset gesture action again.

[0040] Figure 3 A schematic structural diagram of an intelligent cockpit control system in another embodiment of the present invention is shown.

[0041] Reference Figure 3 In one embodiment, the myoelectric bracelet includes a first acquisition module, a processing module, a microcontroller and a communication module. The first acquisition module is used to collect the wearer's electromyographic signals, and the processing module is used to amplify and filter the collected electromyographic signals to obtain the characteristic signals required for subsequent analysis. The microcontroller is used to further analyze and calculate the characteristic signals to extract identity representation signals and cockpit control instructions from them. The communication module is used to generate a specific API interface, match the software interface in the vehicle infotainment system, and send the identity representation signal and the cockpit control signal to the vehicle infotainment system.

[0042] Furthermore, in one embodiment, the myoelectric bracelet is also used to collect the wearer's vital sign signals in real time. When the wearer is a driver, it is used to monitor whether the driver is in a fatigue driving state based on the vital sign signals.

[0043] In this embodiment, the vital signs signals include heart, blood oxygen, pressure and other signals, which can reflect the wearer's current physical condition. If the wearer is a driver, it is necessary to determine whether the driver is in a fatigue driving state, so as to take some countermeasures for the driver in a fatigue driving state to improve driving safety.

[0044] Specifically, refer to Figure 3 The myoelectric bracelet also includes a second acquisition module for collecting vital signs of the wearer, and the microcontroller is also used to analyze and calculate the vital signs to determine whether the driver is in a fatigue driving state. Optionally, the myoelectric bracelet can be improved on the basis of the current smart watch with heart, blood oxygen, pressure and other signal detection.

[0045] Furthermore, in one embodiment, the myoelectric bracelet is also used to vibrate when the driver is in a fatigue driving state, so as to remind the driver to take a proper rest to avoid driving accidents. Figure 3 ,The myoelectric bracelet also includes a vibration module. When the microcontroller determines that the driver is in a fatigue driving state, the vibration module is controlled to vibrate through the communication module.

[0046] Furthermore, in one embodiment, the in-vehicle infotainment system is also used to output an anti-false touch confirmation reminder when the driver is in a fatigue driving state, and after receiving a voice confirmation or receiving a cockpit control command again, the cockpit device is controlled to perform corresponding operations according to the cockpit control command.

[0047] In this embodiment, when the driver is in a fatigued driving state, he may unconsciously make a preset gesture to give a cockpit control command. At this time, after the identity verification is passed, it is necessary to output an anti-false touch confirmation reminder to ensure that the cockpit control command is given consciously by the driver, so as to avoid mistaking the driver's unconscious action for a cockpit control command and driving the cockpit equipment to cause the driver to panic, thereby improving driving safety.

[0048] Furthermore, in one embodiment, the in-vehicle infotainment system is further configured to receive a feedback signal after the cockpit device completes a corresponding operation, and send the feedback signal to the myoelectric bracelet. The myoelectric bracelet is further configured to vibrate to prompt after receiving the feedback signal.

[0049] In this embodiment, the myoelectric bracelet vibrates to remind the wearer that the cabin equipment has completed the corresponding operation, replacing the voice or display prompts, thereby improving the user experience. When the wearer is a driver, the vibration prompt can also prevent the driver from being distracted and improve driving safety. Figure 3 The in-vehicle infotainment system sends the feedback signal to the communication module of the electromyographic bracelet, which controls the vibration module to vibrate. In particular, for different situations, such as fatigue driving warning, operation completion feedback, etc., the vibration mode of the bracelet should be different, so as to distinguish the content of the vibration prompt.

[0050] Furthermore, in one embodiment, the myoelectric bracelet is used to send the cockpit control command to the in-vehicle infotainment system in the form of a signal signal. The in-vehicle infotainment system is used to convert the signal signal into a service signal, and call the service function module corresponding to the service signal to control the cockpit device to perform the operation corresponding to the cockpit control command.

[0051] The in-vehicle infotainment system adopts the SOA (Service-Oriented Architecture) architecture. Under the SOA architecture, in order to provide users with more personalized services, the processor converts the data-based signal transmitted by the ECU through CAN / LIN into a service-based service type signal that is more convenient for users to customize. Therefore, in this embodiment, the signal signal emitted by the electromyographic bracelet is converted into a service signal, so that the various control functions of the in-vehicle infotainment system for the cockpit equipment can be more conveniently called, realizing the integration of the myoelectric bracelet and the SOA architecture of the in-vehicle infotainment system.

[0052] Specifically, see Figure 3The in-vehicle infotainment system includes a basic software layer, a first framework layer, a second framework layer, and an application software layer. The communication module sends the identity characterization signal and the cockpit control command (in the form of a signal signal) to the basic software layer. The basic software layer is used to convert the signal signal into a service signal and transmit the identity characterization signal and the service signal to the first framework layer. The first framework layer is used to detect whether the wearer is an authorized user based on the cloud database and the identity characterization signal. If the wearer is an authorized user, the service signal continues to be transmitted to the second framework layer. If the wearer is not an authorized user, the service signal is prevented from being transmitted to the second framework layer. The second framework layer is used to transmit the service signal to the application software layer, call the service function module through the application software layer, generate a specific API interface, and communicate with the cockpit equipment to control the cockpit equipment to perform corresponding operations.

[0053] Furthermore, the second framework layer is also used to receive feedback signals from the cockpit equipment and send the feedback signals to the basic software layer. The basic software layer sends the feedback signals to the communication module, and controls the vibration module to vibrate through the communication module.

[0054] In a second aspect, an embodiment of the present invention further provides an intelligent cockpit control method based on electromyographic signals, which is applied to an intelligent cockpit control system including an electromyographic bracelet, an in-vehicle infotainment system and a cloud database.

[0055] Figure 4 A schematic flow chart of a smart cockpit control method in one embodiment of the present invention is shown.

[0056] Reference Figure 4 In one embodiment, the intelligent cockpit control method includes:

[0057] S11, the myoelectric bracelet collects the wearer's electromyographic signals in real time, obtains the identity representation signals corresponding to the basic gestures and the cockpit control instructions corresponding to the preset gestures from the electromyographic signals, and sends the identity representation signals and the cockpit control instructions to the in-vehicle infotainment system, wherein the preset gestures are configured as basic gestures or a combination thereof;

[0058] S12. The in-vehicle infotainment system detects whether the wearer is an authorized user based on the cloud database and the identity representation signal. If the wearer is an authorized user, the cockpit equipment is controlled to perform corresponding operations according to the cockpit control instructions, wherein the cloud database is used to store the identity representation signal in the electromyographic signal when the authorized user performs basic gestures.

[0059] Furthermore, in one embodiment, after the step of detecting whether the wearer is an authorized user according to the cloud database and the identity characterization signal, the step further includes:

[0060] If the wearer is not an authorized user, the wearer's electromyographic signals when performing basic gestures are learned after obtaining authorization, and the corresponding identity representation signals are sent to the cloud database.

[0061] Furthermore, in one embodiment, the intelligent cockpit control method further includes:

[0062] The myoelectric bracelet collects the wearer's vital signs signals in real time. When the wearer is a driver, it monitors whether the driver is in a fatigue driving state based on the vital signs signals.

[0063] Furthermore, in one embodiment, after the step of monitoring whether the driver is in a fatigue driving state according to the vital sign signal, the method further includes:

[0064] The myoelectric bracelet vibrates to remind the driver when he / she is driving fatigued.

[0065] Furthermore, in one embodiment, after the step of monitoring whether the driver is in a fatigue driving state according to the vital sign signal, the method further includes:

[0066] The in-vehicle infotainment system outputs an anti-false touch confirmation reminder when the driver is in a fatigued driving state. After receiving voice confirmation or receiving the cockpit control command again, it controls the cockpit equipment to perform corresponding operations according to the cockpit control command.

[0067] Furthermore, in one embodiment, after the step of controlling the cockpit device to perform a corresponding operation according to the cockpit control instruction, the method further includes:

[0068] The in-vehicle infotainment system receives feedback signals from the cockpit equipment after the corresponding operation is completed, and sends the feedback signals to the myoelectric bracelet;

[0069] The myoelectric bracelet vibrates to give a prompt after receiving the feedback signal.

[0070] Furthermore, in one embodiment, the myoelectric bracelet sends the cockpit control command to the in-vehicle infotainment system in the form of a signal;

[0071] The steps of controlling the cockpit equipment to perform corresponding operations according to the cockpit control instruction include:

[0072] The in-vehicle infotainment system converts the signal into a service signal and calls the service function module corresponding to the service signal to control the cockpit equipment to perform operations corresponding to the cockpit control instructions.

[0073] Among them, the analysis of each step in the above-mentioned intelligent cockpit control method corresponds to the function and implementation process of each component in the above-mentioned intelligent cockpit control system, and will not be repeated here one by one.

[0074] In a third aspect, an embodiment of the present invention provides an intelligent cockpit control device based on electromyographic signals, which may be a device with data processing function such as a personal computer (PC), a laptop computer, or a server.

[0075] Figure 5 A schematic diagram of the hardware structure of an intelligent cockpit control device in one embodiment of the present invention is shown.

[0076] Reference Figure 5 In an embodiment of the present invention, the intelligent cockpit control device may include a processor 1001 (e.g., a central processing unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components; the user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard); the network interface 1004 may optionally include a standard wired interface, a wireless interface (such as a wireless fidelity WIreless-FIdelity, WI-FI interface); the memory 1005 may be a high-speed random access memory (random access memory, RAM), or a stable memory (non-volatile memory), such as a disk storage. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001. Those skilled in the art will understand that Figure 5 The hardware structure shown in the figure does not constitute a limitation of the present invention, and may include more or less components than those shown in the figure, or combine certain components, or arrange the components differently.

[0077] Continue to refer to Figure 5 , Figure 5 The memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an intelligent cockpit control program. The processor 1001 may call the intelligent cockpit control program stored in the memory 1005 and execute the intelligent cockpit control method provided in the embodiment of the present invention.

[0078] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0079] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0080] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device to execute the methods described in each embodiment of the present invention.

[0081] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. An intelligent cockpit control system based on electromyographic signals, characterized in that: The intelligent cockpit control system includes an electromyographic bracelet, an in-vehicle infotainment system and a cloud database; The myoelectric bracelet is used to collect the wearer's electromyographic signals in real time, obtain the identity representation signal corresponding to the basic gesture action and the cockpit control instruction corresponding to the preset gesture action from the electromyographic signal, and send the identity representation signal and the cockpit control instruction to the in-vehicle infotainment system, wherein the preset gesture action is configured as the basic gesture action or a combination thereof; The myoelectric bracelet is also used to collect the wearer's vital sign signals in real time. When the wearer is a driver, the wearer is used to monitor whether the driver is in a fatigue driving state according to the vital sign signals. The in-vehicle infotainment system is used to detect whether the wearer is an authorized user according to the cloud database and the identity characterization signal; if the wearer is an authorized user and the wearer is not a driver in a fatigued state, the cockpit device is controlled to perform a corresponding operation according to the cockpit control instruction; if the wearer is an authorized user and the wearer is a driver in a fatigued state, an anti-mistouch confirmation reminder is output, and after receiving a voice confirmation or receiving a cockpit control instruction again, the cockpit device is controlled to perform a corresponding operation according to the cockpit control instruction; The cloud database is used to store the identity representation signal in the electromyographic signal when the authorized user performs the basic gesture action.

2. The intelligent cockpit control system according to claim 1, characterized in that: The in-vehicle infotainment system is also used to learn the electromyographic signals of the wearer when performing the basic gestures after obtaining authorization if the wearer is not an authorized user, and send the corresponding identity representation signals to the cloud database.

3. The intelligent cockpit control system according to claim 1, characterized in that: The myoelectric bracelet is also used to provide vibration prompts when the driver is in a fatigue driving state.

4. The intelligent cockpit control system according to claim 1, characterized in that: The in-vehicle infotainment system is also used to receive a feedback signal after the cockpit device completes a corresponding operation, and send the feedback signal to the myoelectric bracelet; The myoelectric bracelet is also used to vibrate and prompt after receiving the feedback signal.

5. The intelligent cockpit control system according to claim 1, characterized in that: The myoelectric bracelet is used to send the cockpit control command to the in-vehicle infotainment system in the form of a signal signal; The in-vehicle infotainment system is used to convert the signal signal into a service signal, and call the service function module corresponding to the service signal to control the cockpit device to perform the operation corresponding to the cockpit control instruction.

6. An intelligent cockpit control method based on electromyographic signals, characterized in that: Applied to an intelligent cockpit control system including an electromyographic bracelet, an in-vehicle infotainment system and a cloud database, the intelligent cockpit control method includes: The myoelectric bracelet collects the wearer's electromyographic signals in real time, obtains the identity representation signal corresponding to the basic gesture action and the cockpit control instruction corresponding to the preset gesture action from the electromyographic signal, and sends the identity representation signal and the cockpit control instruction to the in-vehicle infotainment system, wherein the preset gesture action is configured as the basic gesture action or a combination thereof; The myoelectric bracelet collects the wearer's vital sign signals in real time, and when the wearer is a driver, monitors whether the driver is in a fatigue driving state according to the vital sign signals; The in-vehicle infotainment system detects whether the wearer is an authorized user based on the cloud database and the identity representation signal. If the wearer is an authorized user and the wearer is not a driver in a fatigued state, the cockpit device is controlled to perform corresponding operations according to the cockpit control instruction. If the wearer is an authorized user and the wearer is a driver in a fatigued state, an anti-mistouch confirmation reminder is output. After receiving voice confirmation or receiving the cockpit control instruction again, the cockpit device is controlled to perform corresponding operations according to the cockpit control instruction, wherein the cloud database is used to store the identity representation signal in the electromyographic signal when the authorized user performs the basic gesture action.

7. The intelligent cockpit control method according to claim 6, characterized in that: After the step of detecting whether the wearer is an authorized user according to the cloud database and the identity characterization signal, the method further includes: If the wearer is not an authorized user, the myoelectric signals of the wearer performing the basic gestures are learned after obtaining authorization, and the corresponding identity representation signals are sent to the cloud database.

8. An intelligent cockpit control device based on electromyographic signals, characterized in that: The smart cockpit control device includes a processor, a memory, and a smart cockpit control program stored in the memory and executable by the processor, wherein when the smart cockpit control program is executed by the processor, the steps of the smart cockpit control method as described in claim 6 or 7 are implemented.

Citation Information

Patent Citations

  • Intelligent artificial limb system for identity verification and myoelectricity text conversion

    CN116077247A

  • Driver identity recognition method and device based on intelligent steering wheel

    CN116101297A

  • Gesture interaction control method, device and equipment and readable storage medium

    CN116360591A