Intelligent cabin multi-mode perception interaction system based on big data

Abstract

The invention relates to the technical field of intelligent cabins, in particular to an intelligent cabin multi-mode perception interaction system based on big data, which comprises a signal processing unit, a real-time early warning unit, a central processing unit and a display processing unit, and is characterized in that the signal output end of the signal processing unit is in signal connection with the signal receiving end of the central processing unit; the signal output end of the real-time early warning unit is in signal connection with the signal receiving end of the central processing unit, and the signal output end of the central processing unit is in signal connection with the signal receiving end of the display processing unit. The information processing efficiency is improved when the image information is processed, so that the user experience is improved, the response rate of the cockpit sensing system to the user inquiry information is improved, the instant response is really realized, the visible-to-speak response effect is achieved, and the working efficiency of the interaction system is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of smart cockpits, and in particular to a big data-based smart cockpit multimodal perception interaction system. Background Art

[0002] With the development of smart cockpit technology, the cockpit is no longer just a car computer plus instruments, but can integrate various components to provide users with a multimodal interaction method, providing drivers and passengers with diversified services and a highly emotional car experience. Voice-operated cockpit equipment technology has richer and more intelligent applications in the field of new energy vehicles.

[0003] When the existing interactive system is in use, the efficiency of image information processing is low, which affects the user experience, and the response rate to user query information is too low, which reduces the working efficiency of the interactive system. Summary of the invention

[0004] The purpose of the present invention is to provide a smart cockpit multimodal perception interaction system based on big data to solve the problems raised in the above background technology.

[0005] To achieve the above-mentioned objectives, the present invention provides the following technical solutions: a smart cockpit multimodal perception and interaction system based on big data, comprising a signal processing unit, a real-time warning unit, a central processing unit and a display processing unit, wherein the signal output end of the signal processing unit is signal-connected to the signal receiving end of the central processing unit, the signal output end of the real-time warning unit is signal-connected to the signal receiving end of the central processing unit, and the signal output end of the central processing unit is signal-connected to the signal receiving end of the display processing unit.

[0006] Preferably, the signal processing unit includes a language wake-up module, a signal receiving module, an information extraction module, a language analysis module, and a sensing module, and the signal output end of the language wake-up module is signal-connected to the signal receiving end of the signal receiving module.

[0007] Preferably, the signal output end of the signal receiving module is signal-connected to the signal receiving end of the information extraction module, the signal output end of the information extraction module is signal-connected to the signal receiving end of the language analysis module, and the signal output end of the sensing module is signal-connected to the signal receiving end of the signal receiving module.

[0008] Preferably, the real-time warning unit includes a road surface monitoring module, a driver monitoring module, a vehicle monitoring module, an alarm module, and a signal output module, and the signal output end of the road surface monitoring module is signal-connected to the signal receiving end of the driver monitoring module.

[0009] Preferably, the signal output end of the driver monitoring module is signal-connected to the signal receiving end of the vehicle monitoring module, the signal output end of the vehicle monitoring module is signal-connected to the signal receiving end of the alarm module, and the signal output end of the alarm module is signal-connected to the signal receiving end of the signal output module.

[0010] Preferably, the central processing unit includes a data processing module, a judgment module, a central control module, and a memory storage module, and the signal output end of the data processing module is signal-connected to the signal receiving end of the judgment module.

[0011] Preferably, the signal output end of the judgment module is signal-connected to the signal receiving end of the central control module, and the signal output end of the central control module is signal-connected to the signal receiving end of the memory storage module.

[0012] Preferably, the display processing unit includes a signal receiving module, a display module, and a broadcasting module. The signal output end of the signal receiving module is signal-connected to the signal receiving end of the display module, and the signal output end of the display module is signal-connected to the signal receiving end of the broadcasting module.

[0013] Compared with the prior art, the present invention has the following beneficial effects: This intelligent cockpit multimodal perception and interaction system based on big data is conducive to improving information processing efficiency when processing image information, thereby improving the user experience, and increasing the response rate of the cockpit perception system to user inquiry information, truly realizing instant response and achieving a visible and audible response effect, thereby improving the working efficiency of the interactive system. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0015] Figure 1 It is a structural schematic diagram of the system of the present invention; Figure 2 It is a schematic diagram of the structure of the signal processing unit of the present invention; Figure 3 It is a structural schematic diagram of the real-time warning unit of the present invention; Figure 4 It is a schematic diagram of the structure of the central processing unit of the present invention; Figure 5 It is a schematic diagram of the structure of the display processing unit of the present invention.

[0016] In the figure: 1. Signal processing unit; 101. Language wake-up module; 102. Signal receiving module; 103. Information extraction module; 104. Language analysis module; 105. Sensor module; 2. Real-time warning unit; 201. Road monitoring module; 202. Driver monitoring module; 203. Vehicle monitoring module; 204. Alarm module; 205. Signal output module; 3. Central processing unit; 301. Data processing module; 302. Judgment module; 303. Central control module; 304. Memory storage module; 4. Display processing unit; 401. Signal receiving module; 402. Display module; 403. Broadcast module. DETAILED DESCRIPTION

[0017] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0018] See also Figure 1-Figure 5 The present invention provides a technical solution: a multimodal perception and interaction system for an intelligent cockpit based on big data, comprising a signal processing unit 1, a real-time warning unit 2, a central processing unit 3 and a display processing unit 4, wherein the signal output end of the signal processing unit 1 is connected to the signal receiving end of the central processing unit 3, the signal output end of the real-time warning unit 2 is connected to the signal receiving end of the central processing unit 3, and the signal output end of the central processing unit 3 is connected to the signal receiving end of the display processing unit 4. The signal processing unit 1 includes a language awakening module 101, a signal receiving module 102, an information extraction module 103, a language analysis module 104, and a sensor module 105. The signal output end of the language awakening module 101 is connected to the signal receiving end of the signal receiving module 102. The signal output end of the signal receiving module 102 is signal-connected to the signal receiving end of the information extraction module 103, the signal output end of the information extraction module 103 is signal-connected to the signal receiving end of the language analysis module 104, and the signal output end of the sensor module 105 is signal-connected to the signal receiving end of the signal receiving module 102. The real-time warning unit 2 includes a road monitoring module 201, a driver monitoring module 202, a vehicle monitoring module 203, an alarm module 204, and a signal output module 205. The signal output end of the road monitoring module 201 is connected to the signal receiving end of the driver monitoring module 202. The signal output end of the driver monitoring module 202 is signal-connected to the signal receiving end of the vehicle monitoring module 203, the signal output end of the vehicle monitoring module 203 is signal-connected to the signal receiving end of the alarm module 204, and the signal output end of the alarm module 204 is signal-connected to the signal receiving end of the signal output module 205. The central processing unit 3 includes a data processing module 301, a judgment module 302, a central control module 303, and a memory storage module 304. The signal output end of the data processing module 301 is connected to the signal receiving end of the judgment module 302. The signal output end of the judgment module 302 is connected to the signal receiving end of the central control module 303, and the signal output end of the central control module 303 is connected to the signal receiving end of the memory storage module 304. The display processing unit 4 includes a signal receiving module 401 , a display module 402 , and a broadcasting module 403 . The signal output end of the signal receiving module 401 is signal-connected to the signal receiving end of the display module 402 , and the signal output end of the display module 402 is signal-connected to the signal receiving end of the broadcasting module 403 .

[0019] During use, when it is needed, the language wake-up module 101 can monitor the user's voice in real time. When the user needs to use the interactive system, he only needs to speak out his needs to wake up the interactive system for use. The user's voice is received by the signal receiving module 102, and the key words in the information spoken by the user can be extracted by the information extraction module 103, and then the key words can be analyzed and processed by the language analysis module 104. The user can press the button inside the cockpit without speaking out his needs through the sensor module 105, and the sensor module 105 senses it. When the pressing is detected, the signal is transmitted to the signal receiving module 102, and the signal is transmitted to the information extraction module 103 and the language analysis module 104. The signal is collected and processed, and transmitted to the central processing unit 3 for processing. The received signal data is processed by the data processing module 301, and the signal data is analyzed and calculated, and the data is transmitted to the judgment module 302 for judgment. It is judged that it can be solved on the end through the central control module 303 to control the display module 402, and the broadcast module 403 to feed back the signal to the user. If the problem is solved, the whole system work is completed. If it is judged that the problem cannot be solved on the end, the user is asked whether to use traffic to solve the problem. If the user agrees, the problem is connected to the cloud, solved by cloud search, and processed by the data processing module 301. The display module 402 and the broadcast module 403 are controlled by the central control module 303 to feed back the information to the user. And the data processed each time can be recorded and stored through the memory storage module 304, the vehicle, road surface and driver can be monitored through the real-time warning unit 2, and the road surface monitoring module 201 can monitor the road surface on which the vehicle is traveling in real time. Then, when there are obstacles on the road surface or an object suddenly blocks the vehicle, the data can be transmitted to the central processing unit 3, and the data processing module 301 processes the data, and the judgment module 302 judges whether to forcibly control the vehicle for emergency avoidance. If emergency avoidance is required, the central control module 303 controls the vehicle to avoid it. If not, no control is required, and the information is fed back to the user through the display module 402 and the broadcast module 403, so that the user can be alerted. The driver's status can be monitored in real time through the driver monitoring module 202. When the driver monitoring module 202 detects that the driver is driving fatigued or distracted, the data can be transmitted to the central processing unit 3, and the data processing module 301 analyzes the data, and the alarm module 204 generates an alarm to remind the driver, thereby improving safety. The vehicle can be monitored in real time through the vehicle monitoring module 203. When the vehicle monitoring module 203 detects that there is a problem with the vehicle, the data can be transmitted to the central processing unit 3, and the data processing module 301 analyzes the data, and then the data can be displayed through the display module 402 and the broadcast module 403, and fed back to the user, so that it can be processed in time.The driving safety is improved, and the data monitored by the road monitoring module 201, the driver monitoring module 202, and the vehicle monitoring module 203 are transmitted to the central processing unit 3 through the signal output module 205 for judgment and analysis, which is ultimately beneficial to improve the information processing efficiency when processing image information, thereby improving the user experience, and improving the response rate of the cockpit perception system to user query information, truly realizing instant response, achieving a visible response effect, and thus improving the working efficiency of the interactive system.

[0020] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0021] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A big data-based intelligent cockpit multimodal perception and interaction system, comprising a signal processing unit (1), a real-time warning unit (2), a central processing unit (3) and a display processing unit (4), characterized in that: The signal output end of the signal processing unit (1) is signal-connected to the signal receiving end of the central processing unit (3), the signal output end of the real-time warning unit (2) is signal-connected to the signal receiving end of the central processing unit (3), and the signal output end of the central processing unit (3) is signal-connected to the signal receiving end of the display processing unit (4).

2. The big data-based intelligent cockpit multimodal perception and interaction system according to claim 1 is characterized by: The signal processing unit (1) comprises a language awakening module (101), a signal receiving module (102), an information extraction module (103), a language analysis module (104), and a sensing module (105); a signal output end of the language awakening module (101) is signal-connected to a signal receiving end of the signal receiving module (102).

3. The intelligent cockpit multimodal perception and interaction system based on big data according to claim 2 is characterized by: The signal output end of the signal receiving module (102) is signal-connected to the signal receiving end of the information extraction module (103), the signal output end of the information extraction module (103) is signal-connected to the signal receiving end of the language analysis module (104), and the signal output end of the sensing module (105) is signal-connected to the signal receiving end of the signal receiving module (102).

4. The intelligent cockpit multimodal perception and interaction system based on big data according to claim 1 is characterized by: The real-time warning unit (2) comprises a road surface monitoring module (201), a driver monitoring module (202), a vehicle monitoring module (203), an alarm module (204), and a signal output module (205); the signal output end of the road surface monitoring module (201) is signal-connected to the signal receiving end of the driver monitoring module (202).

5. The intelligent cockpit multimodal perception and interaction system based on big data according to claim 4 is characterized by: The signal output end of the driver monitoring module (202) is signal-connected to the signal receiving end of the vehicle monitoring module (203), the signal output end of the vehicle monitoring module (203) is signal-connected to the signal receiving end of the alarm module (204), and the signal output end of the alarm module (204) is signal-connected to the signal receiving end of the signal output module (205).

6. The intelligent cockpit multimodal perception and interaction system based on big data according to claim 1 is characterized by: The central processing unit (3) comprises a data processing module (301), a judgment module (302), a central control module (303), and a memory storage module (304); the signal output end of the data processing module (301) is signal-connected to the signal receiving end of the judgment module (302).

7. The big data-based intelligent cockpit multimodal perception and interaction system according to claim 6 is characterized by: The signal output end of the judgment module (302) is signal-connected to the signal receiving end of the central control module (303), and the signal output end of the central control module (303) is signal-connected to the signal receiving end of the memory storage module (304).

8. The intelligent cockpit multimodal perception and interaction system based on big data according to claim 1 is characterized by: The display processing unit (4) comprises a signal receiving module (401), a display module (402), and a broadcasting module (403); the signal output end of the signal receiving module (401) is signal-connected to the signal receiving end of the display module (402); and the signal output end of the display module (402) is signal-connected to the signal receiving end of the broadcasting module (403).

Images