Virtual key system for automobile steering wheel

Abstract

The invention relates to the technical field of automobiles, and discloses a virtual key system for an automobile steering wheel, which comprises an intelligent sensor module, a central control module, a display module, an intelligent voice module, a safe driving early warning module and a power supply module, virtual key operation information of a driver or voice information of the driver is collected in real time through a wireless network and transmitted to the central control module. And the safe driving early warning module sends a safe early warning prompt to a driver through the intelligent voice broadcast unit when judging that the driver makes an unsafe driving behavior and transmits an early warning signal to the display module. The accident potential caused by long-time stay operation of the driver on the virtual key is avoided, and the driving safety of the driver is improved.

Description

Technical Field

[0001] The invention relates to the technical field of automobiles, and in particular to a virtual key system for an automobile steering wheel. Background Art

[0002] A virtual button is an icon set on the screen to replace the function of a physical button. For drivers who are familiar with cars, operating the physical button can be completely blind, but too many physical buttons occupy a large three-dimensional space and the complex connecting lines bring difficulties to the manufacturing process. With the rapid development of high technology, more and more physical buttons are replaced by virtual buttons because of the space occupied. Many car steering wheels are equipped with virtual buttons. Virtual buttons enhance the sense of technological luxury in the car while reducing the manufacturing costs of manufacturers.

[0003] In the prior art, various functions are added to the virtual buttons. If the driver wants to operate a certain function, he needs to divert his eyes while driving for a long time. The driver may even need to click through the first-level menu and then complete the second-level menu. Some buttons have added a third-level menu to find a certain function. It is easy to get stuck and the operation is complicated. If the driver stays on the virtual buttons for a long time, it may easily cause accidents and reduce the driver's driving safety. Summary of the invention

[0004] Technical issues solved

[0005] In order to overcome the above-mentioned defects of the prior art, the present invention provides a virtual button system for a car steering wheel, which provides a variety of operation modes for the driver through the touch sensor unit or the sound sensor unit in the intelligent sensor module, avoiding the trouble caused by a single operation mode. Through the central control module, display module, intelligent voice module and safe driving warning module, it avoids the driver's long-term stay on the virtual button to operate, which may cause potential accidents, thereby improving the driver's driving safety, so as to solve the problems raised in the above-mentioned background technology.

[0006] Technical Solution

[0007] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a virtual button system for a car steering wheel, comprising an intelligent sensor module, a central control module, a display module, an intelligent voice module, a safe driving warning module and a power module. The intelligent sensor module is installed on the car steering wheel, and the driver's virtual button operation information or the driver's voice information is collected in real time through a wireless network and transmitted to the central control module. The central control module is used to control the core of the car steering wheel operation, send and receive instructions for operation and processing, and regulate the safe driving warning module or other modules. The safe driving warning module sends a safety warning prompt to the driver through an intelligent voice broadcast unit when it determines that the driver has made unsafe driving behavior and transmits the warning signal to the display module.

[0008] Preferably, the safe driving warning module includes a facial feature inspection unit, an alcohol detection unit, an operation time detection unit and a safety warning broadcast unit. The driver's information is recognized through image acquisition or fingerprint, and facial feature inspection and lane departure detection are used to determine whether the driver is driving fatigued. When the driver is detected to be driving fatigued, a safety reminder is given to the driver through the safety warning broadcast unit. The alcohol detection unit is used to detect whether the driver is driving under the influence of alcohol. If the driver has been drinking, the vehicle cannot be started. The operation time detection unit is used to detect whether the driver operates the virtual buttons in the driving state for a time period exceeding a preset value or the driver frequently performs voice operations, and the safety warning broadcast unit is used to make timely safety warning reminders to the driver.

[0009] Preferably, the display module is used to display image information on the car steering wheel. After the driver observes the program usage or program progress through the display module, the driver uses voice to transmit the command signal to the intelligent voice module. The intelligent voice module is used by the driver to voice control the program on the car steering wheel, and the commands are deployed and completed according to the driver's commands.

[0010] Preferably, the intelligent sensor module includes a touch sensor unit and a sound sensor unit. The touch sensor unit in the intelligent sensor module is a capacitive touch sensor, which is based on capacitive coupling and detects conductive media or dielectrics different from those in the air. When a finger is on the surface of the display module, the local electrostatic field is changed, and the image processing controller continuously monitors the electrostatic field to find the exact position where the finger touches the screen; the sound sensor in the intelligent sensor module refers to a sound wave that causes the electret film in the microphone to vibrate, resulting in a change in capacitance and a corresponding change in tiny voltage, which is received by the data collector through an A / D converter and transmitted to the central control module.

[0011] Preferably, the central control module includes a digital information processing unit, a data processing unit and a data storage unit. The digital information processing unit in the central control module converts the complex and changeable information into editable numbers and data, and then establishes a suitable digital model for these numbers or data, which are converted into a series of binary codes and introduced into the central control module for unified processing by the data processing unit; the data processing unit refers to the process of collecting, retrieving, processing and transmitting data on the intelligent sensor module, collecting the required information from the intelligent sensor module, converting the information into a form received by the car steering wheel system, and effectively grouping the relevant information according to the specified coding, and then finding useful information according to user needs; the data storage unit refers to storing the original data in the data storage unit according to each program type classification, and storing or calling out the data according to module requirements.

[0012] Preferably, the display module is an LED liquid crystal display, including a multimedia display unit, an air conditioning display unit and other program display units. The multimedia display unit combines music, broadcast, telephone or other displayable information in the form of text, images, animations and sounds, and is comprehensively processed and controlled by a central control module to complete a series of interactive operations and display them. The air conditioning display unit means that the driver controls the temperature and wind speed of the air conditioning through virtual buttons or voice to achieve a comfortable driving environment for the driver. Other program display units allow the driver to add or delete required applications.

[0013] Preferably, the intelligent voice module includes a voice recognition database unit, a voice recognition processing unit and an intelligent voice broadcast unit. The voice recognition database unit integrates voice synthesis, natural language understanding and machine translation technology to store voice data in a database; the voice recognition processing unit mainly analyzes or judges human language based on a dynamic time warping algorithm, a vector quantization method based on a non-parametric model, a hidden Markov model method based on a parametric model, and a voice recognition method based on an artificial neural network and a support vector machine. The intelligent voice broadcast unit refers to broadcasting the voice through a voice chip.

[0014] Preferably, the intelligent voice module initiates a natural conversation interaction request when detecting that the driver is speaking in the natural conversation state; ends the request when detecting that the driver finishes speaking and reports the duration of the natural conversation state and the duration of the driver's speaking to the central control module. When the intelligent voice module receives a response from the driver but the response does not include a natural conversation reception instruction, if the natural conversation state is currently in the natural conversation state, the natural conversation is exited. The natural conversation reception instruction includes the duration of the reception. If no sound is detected within this duration, the natural conversation is also exited. The intelligent voice module can quickly call out the unit interface in the display module and quickly perform operations according to the driver's instructions.

[0015] Preferably, an operating method of a virtual key system for a car steering wheel is as follows:

[0016] S1. First, the driver touches the display module with his finger, and the touch sensor unit in the intelligent sensor module connected to the display module receives the command, or the driver speaks a voice command, and the sound sensor unit receives the command and distributes the command information to the central control module;

[0017] S2, the digital information processing unit in the central control module then converts the received instructions into digital signals, and the data processing unit then collects, retrieves, transmits, and stores the original data in the data storage unit;

[0018] S3, the display module then extracts the processed digital signal to the corresponding interface, and the driver continues to touch the display module to adjust the interface to complete the command, or the intelligent voice module directly transmits the command to the central control module to execute the corresponding operation;

[0019] S4. The safe driving warning module monitors the driver's behavior through image acquisition or fingerprint recognition of driver information, and will issue a safety warning if the driver behaves in a manner that is not conducive to safe driving.

[0020] Technical effects and advantages of the present invention:

[0021] The present invention provides a virtual key system for a car steering wheel, which has the following beneficial effects:

[0022] The virtual key system for a car steering wheel provides a variety of operation modes for the driver through a touch sensor unit or a sound sensor unit in an intelligent sensor module, thereby avoiding the trouble caused by a single operation mode. Through a central control module, a display module and an intelligent voice module, the driver is prevented from staying on the virtual key for a long time to operate, which may easily cause an accident hazard, thereby improving the driver's driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is the overall system diagram of the present invention.

[0024] Figure 2 This is a diagram of the intelligent sensor module of the present invention.

[0025] Figure 3 This is a diagram of the central control module of the present invention.

[0026] Figure 4 This is a display module diagram of the present invention.

[0027] Figure 5 This is a diagram of the intelligent voice module of the present invention.

[0028] Figure 6 This is a diagram of the safe driving warning module of the present invention. DETAILED DESCRIPTION

[0029] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0030] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0031] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present application, its application, or uses.

[0032] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.

[0033] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0034] The embodiments of the present application can be applied to computer systems / servers, which can operate with many other general or special computing system environments or configurations. Examples of well-known computing systems, environments and / or configurations suitable for use with computer systems / servers include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, small computer systems, large computer systems, and distributed cloud computing technology environments including any of the above systems, etc.

[0035] Computer systems / servers may be described in the general context of computer system executable instructions (such as program modules) executed by a computer system. In general, program modules may include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer systems / servers may be implemented in a distributed cloud computing environment where tasks are performed by remote processing devices linked through a communication network. In a distributed cloud computing environment, program modules may be located on local or remote computing system storage media including storage devices.

[0036] The present invention provides a technical solution: a virtual key system for a car steering wheel, comprising an intelligent sensor module, a central control module, a display module, an intelligent voice module, a safe driving warning module, and a power module. The intelligent sensor module is installed on the car steering wheel, and collects the driver's virtual key operation information or the driver's voice information in real time through a wireless network and transmits it to the central control module; the central control module is used to control the core of the car steering wheel operation, send and receive instructions for operation and processing, and regulate the safe driving warning module or other modules. The safe driving warning module sends a safety warning prompt to the driver through an intelligent voice broadcast unit when it is judged that the driver makes an unsafe driving behavior and transmits the warning signal to the display module. The display module is used to display image information on the car steering wheel. After the driver observes the program usage or program progress through the display module, the driver uses voice to transmit the command signal to the intelligent voice module. The intelligent voice module is used for the driver to voice control the program on the car steering wheel, and deploy and complete the command according to the driver's command.

[0037] The difference between this embodiment and the prior art lies in the safe driving warning module. The safe driving warning module initiates a natural conversation interaction request when the driver is detected speaking in the natural conversation state; it ends the request when the driver finishes speaking and reports the duration of the natural conversation state and the driver's speaking time to the central control module. When the intelligent voice module receives the driver's response but the response does not include the natural conversation reception instruction, if the natural conversation state is currently in the natural conversation state, the natural conversation is exited. The natural conversation reception instruction includes the duration of the reception. If no sound is detected within this time, the natural conversation is also exited. The intelligent voice module can quickly call out the unit interface in the display module and quickly perform operations according to the driver's instructions.

[0038] An operating method of a virtual key system for a car steering wheel is as follows:

[0039] 101. First, the driver touches the display module with his finger, and the touch sensor unit in the intelligent sensor module connected to the display module receives the command, or the driver speaks a voice command, and the sound sensor unit receives the command and distributes the command information to the central control module;

[0040] What needs to be specifically explained in this embodiment is that the intelligent sensor module includes a touch sensor unit and a sound sensor unit. The touch sensor unit in the intelligent sensor module is a capacitive touch sensor, which is based on capacitive coupling and detects conductive media or dielectrics different from those in the air. When a finger is on the surface of the display module, the local electrostatic field is changed, and the image processing controller continuously monitors the electrostatic field to find the exact position where the finger touches the screen; the sound sensor in the intelligent sensor module refers to the sound wave vibration of the electret film in the microphone causing the change in capacitance and generating a corresponding change in small voltage, which is received by the data acquisition device through the A / D converter and transmitted to the central control module. The intelligent sensor module in this embodiment is a prior art and is not specifically limited here.

[0041] 102. Then the digital information processing unit in the central control module converts the received instructions into digital signals, and then the data processing unit collects, retrieves, transmits, and stores the original data in the data storage unit;

[0042] What needs to be specifically explained in this embodiment is that the central control module includes a digital information processing unit, a data processing unit and a data storage unit. The digital information processing unit in the central control module converts the complex and changeable information into editable numbers and data, and then establishes a suitable digital model for these numbers or data, which are converted into a series of binary codes and introduced into the central control module for unified processing by the data processing unit; the data processing unit refers to the process of collecting, retrieving, processing and transmitting data on the intelligent sensor module, collecting the required information from the intelligent sensor module, and effectively grouping the relevant information according to the specified coding after converting the information into a form received by the car steering wheel system, and then finding useful information according to user needs. The data storage unit refers to storing the original data in the data storage unit according to the classification of each program type, and storing or calling out the data according to the module requirements. The central control module in this embodiment is a prior art and is not specifically limited here.

[0043] 103. Then the display module extracts the processed digital signal to the corresponding interface, and the driver continues to touch the display module to adjust the interface to complete the command, or the intelligent voice module directly transmits the command to the central control module to execute the corresponding operation;

[0044] What needs to be specifically explained in this embodiment is that the display module is an LED liquid crystal display, including a multimedia display unit, an air-conditioning display unit and other program display units. The multimedia display unit combines music, broadcast, telephone or other displayable text, image, animation, and sound information together, and is comprehensively processed and controlled by the central control module to complete a series of interactive operations and display them. The air-conditioning display unit refers to the driver controlling the temperature and wind speed of the air-conditioning through virtual buttons or voice to achieve a comfortable driving environment for the driver. Other program display units are flexible in operation by the driver adding or deleting the required applications. The display module in this embodiment is a prior art and is not specifically limited here.

[0045] What needs to be specifically explained in this embodiment is that the intelligent voice module includes a voice recognition database unit, a voice recognition processing unit and an intelligent voice broadcast unit. The voice recognition database unit is a technology that combines voice synthesis, natural language understanding and machine translation, and stores voice data in a database; the voice recognition processing unit is mainly based on a dynamic time warping algorithm, a vector quantization method based on a non-parametric model, a hidden Markov model method based on a parametric model, and a voice recognition method based on an artificial neural network and a support vector machine to analyze or judge human language. The intelligent voice broadcast unit refers to broadcasting voice through a voice chip.

[0046] What needs to be specifically explained is that the intelligent voice module initiates a natural conversation interaction request when the driver is speaking in the natural conversation state; it ends the request when the driver finishes speaking and reports the duration of the natural conversation state and the driver's speaking time to the central control module. When the intelligent voice module receives a response from the driver but the response does not include a natural conversation reception instruction, if the current state is a natural conversation, the natural conversation is exited. The natural conversation reception instruction includes the duration of the reception. If no sound is detected within this duration, the natural conversation is also exited. The intelligent voice module can quickly call out the unit interface in the display module and quickly perform operations according to the driver's instructions. The intelligent voice module in this embodiment is a prior art and is not specifically limited here.

[0047] 104. The safe driving warning module monitors the driver's behavior through image acquisition or fingerprint recognition of driver information, and will issue a safety warning if the driver behaves in a manner that is not conducive to safe driving.

[0048] What needs to be specifically explained in this embodiment is that the safe driving warning module includes a facial feature inspection unit, an alcohol detection unit, an operation time detection unit and a safety warning broadcast unit. The driver's information is identified through image acquisition or fingerprint, and facial feature inspection and lane departure detection are used to determine whether the driver is driving fatigued. When the driver is detected to be driving fatigued, the safety warning broadcast unit uses a player to make a safety reminder to the driver; the alcohol detection unit is used to detect whether the driver is in a drunk driving state. If the driver is drunk, the vehicle cannot be started; the operation time detection unit is used to detect that the driver operates the virtual buttons in the driving state for a time that exceeds the preset value or the driver frequently performs voice operations, and the safety warning broadcast unit makes timely safety warning reminders to the driver to improve the driver's driving safety.

[0049] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A virtual key system for a car steering wheel, characterized in that: It includes an intelligent sensor module, a central control module, a display module, an intelligent voice module, a safe driving warning module and a power module. The intelligent sensor module is installed on the steering wheel of the car, and the driver's virtual button operation information or the driver's voice information is collected in real time through a wireless network and transmitted to the central control module. The central control module is used to control the core of the car steering wheel operation, send and receive instructions for operation and processing, and regulate the safe driving warning module or other modules. The safe driving warning module sends a safety warning prompt to the driver through the intelligent voice broadcast unit when it determines that the driver has made unsafe driving behavior and transmits the warning signal to the display module.

2. A virtual key system for a car steering wheel according to claim 1, characterized in that: The safe driving warning module includes a facial feature detection unit, an alcohol detection unit, an operation time detection unit and a safety warning broadcast unit. It uses image acquisition or fingerprint recognition to identify the driver's information, and uses facial feature detection and lane departure detection to determine whether the driver is driving fatigued. When the driver is detected to be driving fatigued, the safety warning broadcast unit will give the driver a safety reminder; Use the alcohol detection unit to detect whether the driver is in a drunk driving state. If the driver is drunk, the vehicle cannot be started; The operation duration detection unit is used to detect whether the driver operates the virtual buttons for a duration exceeding a preset value or the driver frequently performs voice operations while driving, and the safety warning broadcast unit is used to provide timely safety warning reminders to the driver.

3. The virtual key system for a car steering wheel according to claim 1, characterized in that: The display module is used to display image information on the car steering wheel. After the driver observes the program usage or program progress through the display module, the driver uses voice to transmit the command signal to the intelligent voice module. The intelligent voice module is used by the driver to voice control the program on the car steering wheel, and the commands are deployed and completed according to the driver's commands.

4. The virtual key system for a car steering wheel according to claim 1, characterized in that: The smart sensor module includes a touch sensor unit and a sound sensor unit. The touch sensor unit in the smart sensor module is a capacitive touch sensor, which is based on capacitive coupling and detects conductive media or dielectrics different from those in the air. When a finger is on the surface of the display module, the local electrostatic field is changed, and the image processing controller continuously monitors the electrostatic field to find the exact position where the finger touches the screen; the sound sensor in the smart sensor module refers to the sound wave that causes the electret film in the microphone to vibrate, causing the capacitance to change and generating a corresponding small voltage, which is received by the data collector through the A / D converter and transmitted to the central control module.

5. The virtual key system for a car steering wheel according to claim 1, characterized in that: The central control module includes a digital information processing unit, a data processing unit and a data storage unit. The digital information processing unit in the central control module converts the complex and changeable information into editable numbers and data, and then establishes a suitable digital model for these numbers or data, which are converted into a series of binary codes and introduced into the central control module for unified processing by the data processing unit; the data processing unit refers to the process of collecting, retrieving, processing and transmitting data on the intelligent sensor module, collecting the required information from the intelligent sensor module, and effectively grouping the relevant information according to the specified coding after converting the information into a form received by the car steering wheel system, and then finding useful information according to user needs. The data storage unit refers to storing the original data in the data storage unit according to the classification of each program type, and storing or calling out the data according to the module requirements.

6. The virtual key system for a car steering wheel according to claim 3, characterized in that: The display module is an LED liquid crystal display, including a multimedia display unit, an air conditioning display unit and other program display units. The multimedia display unit combines music, broadcast, telephone or other information that can be displayed in the form of text, images, animations, and sounds, and is comprehensively processed and controlled by the central control module to complete a series of interactive operations and display them. The air conditioning display unit means that the driver controls the temperature and wind speed of the air conditioning through virtual buttons or voice to achieve a comfortable driving environment for the driver. Other program display units allow the driver to add or delete required applications.

7. The virtual key system for a car steering wheel according to claim 3, characterized in that: The intelligent voice module includes a voice recognition database unit, a voice recognition processing unit and an intelligent voice broadcast unit. The voice recognition database unit integrates voice synthesis, natural language understanding and machine translation technology to store voice data in a database; the voice recognition processing unit is mainly based on a dynamic time warping algorithm, a vector quantization method based on a non-parametric model, a hidden Markov model method based on a parametric model, and a voice recognition method based on an artificial neural network and a support vector machine to analyze or judge human language. The intelligent voice broadcast unit refers to broadcasting voice through a voice chip.

8. The virtual key system for a car steering wheel according to claim 7, characterized in that: The intelligent voice module initiates a natural dialogue interaction request when the driver is speaking based on the driver's detection in the natural dialogue state; When it detects that the driver has finished speaking, it requests to end the conversation and reports the duration of the natural conversation state and the duration of the driver's speech to the central control module. When the intelligent voice module receives the driver's response but the response does not include the natural conversation reception instruction, if it is currently in the natural conversation state, it will exit the natural conversation. The natural conversation reception instruction includes the duration of the reception. If no sound is detected within this duration, the natural conversation will also be exited. The intelligent voice module can quickly call out the unit interface in the display module and quickly perform operations according to the driver's instructions.

9. A virtual key system for a car steering wheel according to any one of claims 1-3, characterized in that: Here’s how to run it: S1. First, the driver touches the display module with his finger, and the touch sensor unit in the intelligent sensor module connected to the display module receives the command, or the driver speaks a voice command, and the sound sensor unit receives the command and distributes the command information to the central control module; S2, the digital information processing unit in the central control module then converts the received instructions into digital signals, and the data processing unit then collects, retrieves, transmits, and stores the original data in the data storage unit; S3, the display module then extracts the processed digital signal to the corresponding interface, and the driver continues to touch the display module to adjust the interface to complete the command, or the intelligent voice module directly transmits the command to the central control module to execute the corresponding operation; S4. The safe driving warning module monitors the driver's behavior through image acquisition or fingerprint recognition of driver information, and will issue a safety warning if the driver behaves in a manner that is not conducive to safe driving.

Images