Vehicle voice interaction system and interaction method, vehicle

Abstract

The present invention discloses a vehicle voice interaction system and interaction method, and a vehicle. Among them, the voice acquisition module in the system collects user voice commands and sends the user voice commands to the voice analysis module; the voice analysis module analyzes the user voice commands, and sends the corresponding control signal to the function control module according to the analysis result; the function control module executes the user voice command according to the control signal, and sends the execution feedback information to the AR display module; the AR display module displays the execution feedback information. It solves the problem in the prior art that human-vehicle voice interaction may distract the driver's attention and affect driving safety, improves the safety of human-vehicle interaction, and feeds back the execution results of the user voice commands, and uses the AR display module to display the feedback information, further enhancing the friendliness of the interactive system, improving the user experience, and improving the stickiness of the interactive system.

Description

Technical Field

[0001] The present invention relates to the field of voice interaction, and in particular to a vehicle voice interaction system and method, and a vehicle. Background Art

[0002] With the rapid development of intelligent connected vehicles, the application of intelligent voice interaction systems in automobiles has become more and more common. Drivers interact with cars through voice interaction systems to control vehicles to perform certain functions. Existing vehicle voice interaction systems mostly use screen-based interactive display systems to return information or simple anthropomorphic interaction methods to increase the frequency and stickiness of voice systems. However, screen-based interaction requires the driver's eyes to deviate from the driving direction, which can easily cause the driver to lose concentration and may cause driving accidents. Although simple anthropomorphic interaction can increase the frequency of voice system use, it still has a certain degree of impact on driving safety. Summary of the invention

[0003] The embodiments of the present invention provide a vehicle voice interaction system and interaction method, and a vehicle, so as to improve the safety and friendliness of human-vehicle interaction, enhance user stickiness, and enhance the technological sense of the entire vehicle.

[0004] In a first aspect, an embodiment of the present invention provides a vehicle voice interaction system, the system comprising: a voice acquisition module, a voice analysis module, a function control module and an AR display module;

[0005] The voice collection module is connected to the voice analysis module, and is used to collect user voice commands and send the user voice commands to the voice analysis module;

[0006] The voice analysis module is connected to the function control module, and is used to analyze the user's voice command and send a corresponding control signal to the function control module according to the analysis result;

[0007] The function control module is connected to the AR display module, and is used to execute the user voice command according to the control signal, and send execution feedback information to the AR display module; the AR display module displays the execution feedback information.

[0008] In a second aspect, an embodiment of the present invention provides a vehicle voice interaction method, which is applicable to a vehicle voice interaction system provided by any embodiment of the present invention, and the method includes:

[0009] The voice collection module collects user voice commands and sends the user voice commands to the voice analysis module;

[0010] The voice analysis module analyzes the user's voice command and sends a corresponding control signal to the function control module according to the analysis result;

[0011] The function control module executes the user voice command according to the control signal, and sends execution feedback information to the AR display module; the AR display module displays the execution feedback information.

[0012] In a third aspect, an embodiment of the present invention provides a vehicle, including the vehicle voice interaction system provided by any embodiment of the present invention.

[0013] In the embodiment of the present invention, the voice acquisition module collects the user's voice command and sends the user's voice command to the voice analysis module; the voice analysis module analyzes the user's voice command and sends the corresponding control signal to the function control module according to the analysis result; the function control module executes the user's voice command according to the control signal and sends the execution feedback information to the AR display module; the AR display module displays the execution feedback information. This solves the problem in the prior art that human-vehicle voice interaction may distract the driver and affect driving safety, improves the safety of human-vehicle interaction, and provides feedback on the execution results of the user's voice command, and uses the AR display module to display the feedback information, further enhancing the friendliness of the interactive system, improving the user experience, and improving the stickiness of the interactive system. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 A schematic diagram of the structure of a vehicle voice interaction system provided in Embodiment 1 of the present invention;

[0015] Figure 2 A schematic diagram of the structure of a vehicle voice interaction system provided in Embodiment 2 of the present invention;

[0016] Figure 3 A flow chart of a vehicle voice interaction method provided in Embodiment 3 of the present invention;

[0017] Figure 4 A flow chart of a vehicle voice interaction method provided in embodiment 4 of the present invention. DETAILED DESCRIPTION

[0018] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0019] Embodiment 1

[0020] Figure 1 This is a schematic diagram of the structure of a vehicle voice interaction system provided by the first embodiment of the present invention. The vehicle voice interaction system can be installed in an existing vehicle host control system to complete human-vehicle voice interaction. Figure 1As shown, the vehicle voice interaction system includes: a voice acquisition module 100, a voice analysis module 110, a function control module 120 and an AR display module 130;

[0021] The voice collection module 100 is connected to the voice analysis module 110 and is used to collect user voice commands and send the user voice commands to the voice analysis module 110;

[0022] The voice analysis module 110 is connected to the function control module 120 and is used to analyze the user's voice command and send a corresponding control signal to the function control module 120 according to the analysis result;

[0023] The function control module 120 is connected to the AR display module 130 and is used to execute the user's voice command according to the control signal and send the execution feedback information to the AR display module 130; the AR display module 130 displays the execution feedback information.

[0024] Among them, the voice collection module 100 is a sound source collection end. When the user wants to control the vehicle to complete certain functions, the user issues a voice command, and the voice collection module 100 collects sound and sends the collected user voice command to the voice analysis module 110. Optionally, the voice collection module 100 can collect sound by setting a microphone. It is understandable that the user voice command may include vehicle control, vehicle navigation, entertainment function, driving information display, and call making and other commands, and the present invention does not limit this.

[0025] Furthermore, after receiving the user's voice command, the voice analysis module 110 analyzes the user's voice command, and sends a control signal matching the user's voice command to the function control module 120 according to the analysis result. The specific implementation method of the voice analysis module 110 parsing the user's voice command and generating the corresponding control signal is not limited, and any existing technology can be used. For example, a neural network model can be established in the voice analysis module 110 in advance, and various voice commands and corresponding control signals can be input for training. In addition, optionally, recognizable sound information can be recorded in advance in the voice analysis module 110, such as the voice of the owner, the voice of the person who often drives and rides the vehicle. When the voice analysis module 110 determines that the received user voice command is issued by the user who pre-recorded the sound information, the voice command is analyzed and the corresponding control signal is sent according to the analysis result. The voice analysis module 110 performs sound recognition on the user's voice command, which can prevent property losses caused by strangers controlling the vehicle.

[0026] Furthermore, after receiving the control signal sent by the voice analysis module 110, the function control module 120 performs corresponding control according to the control signal, executes the user's voice command, and provides feedback on the execution result, and sends the execution feedback information to the AR display module 130, and the AR display module 130 displays the execution feedback information.

[0027] Optionally, the function control module 120 includes at least one of the following: a body control unit, a door control unit, a light control unit, an air conditioning control unit, a seat control unit and a navigation control unit.

[0028] Specifically, the function control module 120 may include corresponding control units for implementing any user voice command, such as a body control unit, a door control unit, a headlight control unit, an air conditioning control unit, a seat control unit, and a navigation control unit. When receiving a control signal corresponding to the user voice command, the corresponding control unit completes the user voice command. For example, when the user voice command is "turn on the front lights", the voice analysis module 110 analyzes the command and sends a headlight turn-on control signal. After the function control module 120 receives the control signal, the headlight control unit controls the vehicle headlights to turn on. After completing the control command, the function control module 120 sends the execution feedback information "the headlights are turned on" to the AR display module 130, and the AR display module 130 displays "the headlights are turned on", prompting the user voice command has been completed; for another example, when the user voice command is "go to a certain place, turn on navigation", the voice analysis module 110 analyzes the command and sends a navigation control signal. After the function control module 120 receives the control signal, the navigation control unit searches for the destination navigation route map and sends the navigation route map to the AR display module 130, and the AR display module 130 displays it.

[0029] It should be noted that the AR display module 130 can not only display text, but also display images or animations.

[0030] Optionally, the AR display module 130 may include at least an AR-HUD; the AR-HUD is used to project the execution feedback information onto the front windshield of the vehicle.

[0031] Optionally, the AR display module 130 can be implemented using any AR display technology. The embodiment of the present invention is preferably implemented through augmented reality head-up display (AR-HUD) technology. AR-HUD technology uses the vehicle windshield as a display screen and combines virtual images with real scenes to project them onto the windshield. In the embodiment of the present invention, AR-HUD can be used to project execution feedback information directly in front of the driver's field of vision to provide feedback on user voice commands. The driver does not need to look down at the display screen to observe the feedback information, which greatly improves the safety of human-vehicle interaction. In addition, when using AR-HUD for road navigation, it can provide the driver with more direct and vivid navigation information, enhance the technological sense of the entire vehicle, and enhance public recognition. The specific implementation method of AR-HUD technology can refer to any existing technology, and the embodiment of the present invention will not be repeated.

[0032] Optionally, the above modules can communicate with each other via CAN bus / Ethernet and other methods.

[0033] The technical solution provided in the first embodiment of the present invention collects user voice commands through the voice collection module and sends the user voice commands to the voice analysis module; the voice analysis module analyzes the user voice commands and sends the corresponding control signal to the function control module according to the analysis result; the function control module executes the user voice command according to the control signal and sends the execution feedback information to the AR display module; the AR display module displays the execution feedback information. This solves the problem in the prior art that human-vehicle voice interaction may distract the driver and affect driving safety, improves the safety of human-vehicle interaction, and provides feedback on the execution results of the user voice commands, and uses the AR display module to display the feedback information, further enhancing the friendliness of the interactive system, improving the user experience, and improving the stickiness of the interactive system.

[0034] Embodiment 2

[0035] Figure 2 FIG. 1 is a schematic diagram of a vehicle voice interaction system provided in Embodiment 2 of the present invention. The voice interaction system is further refined on the basis of the vehicle voice interaction system provided in the above embodiment. For details, see Figure 2 , the vehicle voice interaction system may also include:

[0036] The vehicle host 140; the voice analysis module 110 is integrated in the vehicle host 140; the function control module 120 is connected to the vehicle host 140, and is used to send a command completion message to the vehicle host 140 after executing the user's voice command; when the user's voice command fails to be executed, the first fault information is sent to the vehicle host 140 and the AR display module 130;

[0037] The vehicle-mounted host 140 records the first fault information; the AR display module 130 displays the first fault information.

[0038] Optionally, the voice analysis module 110 can be integrated into the vehicle's existing on-board host 140, and other related control modules can also be set in the on-board host 140. The embodiment of the present invention is not limited to this. For example, the on-board host 140 can also include: a voice control module 150; the voice control module 150 is connected to the voice collection module 100, and is used to control the opening and closing of the voice collection module 100.

[0039] Specifically, when the voice control module 150 detects a similar instruction such as "turn on the voice control function" from the user, it can send a start signal to the voice collection module 100. After receiving the start signal, the voice collection module 100 enters a working state, collects the user's voice instructions in real time and sends the instructions to the voice analysis module 110; when the voice control module 150 detects a similar instruction such as "turn off the voice control function" from the user, it can send a close signal to the voice collection module 100. After receiving the close signal, the voice collection module 100 exits the voice collection mode and no longer collects user voice.

[0040] Optionally, after completing a user's voice command, if the voice collection module 100 does not collect any voice command issued by the user within a certain set threshold time, the voice collection module 100 can shut down automatically and wait for the next start command. The specific value of this set threshold time can be set according to actual conditions, for example, it can be set to 5 minutes. After reaching the set threshold time, the voice collection module 100 exits the voice collection mode, and can automatically sleep after not collecting user voice information for a long time, saving system power.

[0041] Furthermore, in the technical solution provided by the embodiment of the present invention, the function control module 120 can send instruction completion information to the vehicle-mounted host 140 and the AR display module 130 at the same time after executing the user voice command. The vehicle-mounted host 140 can record the instruction completion information, and the AR display module 130 displays the instruction completion information. It can be understood that when the user voice command is an instruction such as "control a certain component of the vehicle to perform a certain operation" that does not require information feedback, the instruction completion information can be "XX operation has been executed"; when the user voice command is an instruction such as "open navigation" that requires information feedback, the instruction completion information can be the corresponding feedback information, such as opening the navigation route map, and the AR display module 130 displays the navigation route.

[0042] In addition, when the function control module 120 fails to execute the user's voice command, it can also send the first fault information to the vehicle host 140 and the AR display module 130 at the same time, and the vehicle host 140 records the first fault information; the AR display module displays the first fault information. It can be understood that the first fault information does not only refer to a certain fault information, but can also be the corresponding fault information when the function control module 120 cannot execute the user's voice command. For example, when the function control module 120 cannot complete the "turn on the air conditioner" command issued by the user, the function control module 120 sends the "unable to turn on the air conditioner" fault information to the vehicle host 140 and the AR display module 130, the vehicle host 140 records the "unable to turn on the air conditioner" fault information, and the AR display module 130 displays "unable to turn on the air conditioner".

[0043] In this embodiment, the function control module provides feedback on the execution result of the user's voice command. When the user's voice command can be completed, the command completion information is displayed, so that the user can get feedback in time, further enhancing the interaction between the user and the vehicle and improving the intelligence of the interactive system. In addition, when the user's voice command cannot be executed, timely fault feedback can also allow the user to find the cause of the fault and repair the corresponding fault in time, avoiding the user's disgust caused by the failure to solve the fault in time.

[0044] Optionally, the AR display module 130 may also be connected to the vehicle-mounted host 140 to display the second fault information when the execution feedback information cannot be displayed, and send the second fault information to the vehicle-mounted host 140; the vehicle-mounted host 140 records the second fault information.

[0045] According to the technical solution provided by the embodiment of the present invention, when the AR display module 130 fails and cannot display the execution feedback information corresponding to the user's voice command, the AR display module 130 may display a second fault message, and the second fault message may be "unable to display execution feedback information", prompting the user that the AR display module 130 may fail and need to be repaired in time. At the same time, the AR display module 130 sends the second fault message to the vehicle-mounted host 140, and the vehicle-mounted host 140 records the second fault information.

[0046] Optionally, the vehicle voice interaction system provided by the embodiment of the present invention may also include: a mobile terminal, which can communicate with the vehicle-mounted host 140 via a wireless network. The vehicle-mounted host 140 sends the recorded first fault information and / or second fault information to the mobile terminal. The user can query related faults through the mobile terminal and repair them in time.

[0047] Optionally, the vehicle voice interaction system may further include: a speaker 160;

[0048] The speaker 160 is connected to the vehicle host 140 and is used to send a command completion prompt message after detecting that the vehicle host 140 receives the command completion message;

[0049] After detecting that the vehicle-mounted host 140 receives the first fault information and / or the second fault information, a fault prompt message is issued.

[0050] Specifically, in the vehicle voice interaction system provided by an embodiment of the present invention, a speaker 160 may also be provided. The speaker 160 is a sound prompt terminal and is connected to the vehicle-mounted host 140. When the vehicle-mounted host 140 receives the instruction completion information, the instruction completion information may also be sent to the speaker 160. After the speaker 160 detects the instruction completion information, it issues an instruction completion prompt information. When the vehicle-mounted host 140 receives the first fault information and / or the second fault information, the first fault information and / or the second fault information may also be sent to the speaker 160. After the speaker 160 detects the first fault information and / or the second fault information, it issues a fault prompt information.

[0051] Optionally, the connection method between the speaker 160 and the vehicle-mounted host 140 is not limited, and it can be a hard-wired connection or a wireless network connection, etc. The embodiment of the present invention is preferably connected through a hard-wired connection. The hard-wired connection has strong tensile and corrosion resistance and low cost, and can reduce the cost of the entire system while ensuring functionality.

[0052] The speaker setting can complete the sound interaction between the user and the system with the microphone in a closed loop. The function control module, AR display module and speaker work together to complete the sound and light coordinated interaction between the user and the vehicle. The interaction method is friendly, comfortable and safe, further enhancing the user's operating experience.

[0053] Optionally, the vehicle voice interaction system may further include: an application upgrade module 170;

[0054] The application upgrade module 170 can be connected to the voice collection module 100 , the voice analysis module 110 , the function control module 120 and the AR display module 130 to perform functional upgrades on the voice collection module 100 , the voice analysis module 110 , the function control module 120 and the AR display module 130 .

[0055] The above-mentioned voice acquisition module 100, voice analysis module 110, function control module 120 and AR display module 130 can all be connected to the application upgrade module 170 via CAN bus / Ethernet. The application upgrade module 170 upgrades the above-mentioned modules to enable each module to complete the function update.

[0056] Optionally, the application upgrade module 170 can be set up using any software and / or hardware that can perform its functions. The embodiment of the present invention is not limited to this. In this embodiment, it is preferably implemented through Over-the-Air Technology (OTA). OTA refers to the technology of remotely managing mobile terminal devices and SIM card data through the air interface of mobile communications. The specific implementation method of OTA technology can refer to any existing technology and will not be repeated here. It can be understood that since the application upgrade module 170 set up in this embodiment is composed of software, Figure 2 Not all connection structures are given, and they are only described as examples.

[0057] It is worth mentioning that in the embodiment of the present invention, OTA technology is used to upgrade various modules of the system. Each upgrade can improve the system, fix vulnerabilities or obtain more functions. In addition, the AR display module is upgraded using OTA technology, which can make the AR display interface adapt to different vehicle interior styles and enhance the user's pleasure when using the voice interaction system.

[0058] According to the technical solution provided in the second embodiment of the present invention, the function control module sends the execution feedback information corresponding to the user voice command to the vehicle-mounted host and the AR display module. When the user voice command can be completed, the command completion information is displayed, so that the user can get feedback in time, enhance the interactivity between the user and the vehicle, and improve the intelligence of the interactive system; when the user voice command cannot be executed, timely fault feedback is provided, which can also enable the user to find the cause of the fault and repair the corresponding fault in time, avoiding the user's disgust caused by the failure to be solved in time.

[0059] In addition, the speaker setting realizes the sound and light coordinated interaction between the user and the vehicle, improves the technological sense of the entire vehicle, and enhances the user's operating experience; the setting of the application upgrade module can make the AR display interface adapt to different vehicle interior styles, further enhancing the user's sense of pleasure when using the voice interaction system.

[0060] Embodiment 3

[0061] Based on the same concept, the third embodiment of the present invention further provides a vehicle voice interaction method, which is applicable to the vehicle voice interaction system provided by any embodiment of the present invention. Figure 3 A vehicle voice interaction method flow chart provided in the third embodiment of the present invention, see Figure 3 , the method specifically comprises:

[0062] S310: The voice collection module collects user voice commands and sends the user voice commands to the voice analysis module.

[0063] Among them, the voice collection module is the sound source collection end, and the voice collection module is connected to the voice analysis module. When the user wants to control the vehicle to complete certain functions, the user issues a voice command, and the voice collection module collects sound and sends the collected user voice command to the voice analysis module. Optionally, the voice collection module can collect sound by setting a microphone. It is understandable that the user voice command may include vehicle control, vehicle navigation, entertainment function, driving information display, and call making and other commands, and the present invention does not limit this.

[0064] S320: The voice analysis module analyzes the user's voice command and sends a corresponding control signal to the function control module according to the analysis result.

[0065] Among them, the voice analysis module is connected to the function control module. After receiving the user's voice command, the voice analysis module analyzes the user's voice command and sends a control signal matching the user's voice command to the function control module according to the analysis result.

[0066] Optionally, the specific implementation method of the voice analysis module parsing the user's voice command and generating the corresponding control signal is not limited, and any existing technology can be used. For example, a neural network model can be pre-established in the voice analysis module, and various voice commands and corresponding control signals can be input for training. In addition, optionally, recognizable sound information can be pre-entered in the voice analysis module, such as the voice of the owner, the voice of people who often drive and ride the vehicle. When the voice analysis module determines that the received user voice command is issued by the user who pre-entered the sound information, the voice command is parsed and the corresponding control signal is sent according to the parsing result. The voice analysis module performs sound recognition on the user's voice command, which can avoid property losses caused by strangers controlling the vehicle.

[0067] S330. The function control module executes the user voice command according to the control signal, and sends the execution feedback information to the AR display module; the AR display module displays the execution feedback information.

[0068] Furthermore, after receiving the control signal sent by the voice analysis module, the function control module makes corresponding control according to the control signal, executes the user's voice command, and provides feedback on the execution result, and sends the execution feedback information to the AR display module, and the AR display module displays the execution feedback information.

[0069] Optionally, the functional control module may include at least one of the following: a body control unit, a door control unit, a light control unit, an air conditioning control unit, a seat control unit and a navigation control unit.

[0070] Specifically, the function control module may include corresponding control units for implementing any user voice commands, such as a body control unit, a door control unit, a light control unit, an air conditioning control unit, a seat control unit and a navigation control unit, etc. When a control signal corresponding to a user voice command is received, the corresponding control unit completes the user voice command.

[0071] Optionally, the AR display module may include at least an AR-HUD; the AR-HUD is used to project execution feedback information onto the front windshield of the vehicle.

[0072] Optionally, the AR display module can be implemented using any AR display technology. The embodiment of the present invention is preferably implemented through augmented reality head-up display (AR-HUD) technology. AR-HUD technology uses the front windshield of the vehicle as a display screen, and combines virtual images with real scenes and projects them onto the front windshield. In the embodiment of the present invention, AR-HUD can be used to project execution feedback information directly in front of the driver's field of vision to provide feedback on user voice commands. The driver does not need to look down at the display screen to observe the feedback information, which greatly improves the safety of human-vehicle interaction. In addition, when using AR-HUD for road navigation, it can provide the driver with more direct and vivid navigation information, enhance the technological sense of the entire vehicle, and enhance public recognition.

[0073] The technical solution provided in the third embodiment of the present invention collects user voice commands through the voice collection module and sends the user voice commands to the voice analysis module; the voice analysis module analyzes the user voice commands and sends the corresponding control signal to the function control module according to the analysis result; the function control module executes the user voice commands according to the control signal and sends the execution feedback information to the AR display module; the AR display module displays the execution feedback information. This solves the problem in the prior art that human-vehicle voice interaction may distract the driver and affect driving safety, improves the safety of human-vehicle interaction, and provides feedback on the execution results of the user voice commands, and uses the AR display module to display the feedback information, further enhancing the friendliness of the interactive system, improving the user experience, and improving the stickiness of the interactive system.

[0074] Embodiment 4

[0075] Figure 4 A flow chart of a vehicle voice interaction method provided in Embodiment 4 of the present invention is provided. The method is further refined on the basis of the above-mentioned embodiment and may specifically include:

[0076] S410: The voice control module controls the start of the voice collection module according to a user instruction.

[0077] Optionally, the voice analysis module can be integrated into the vehicle host; the function control module is connected to the vehicle host, and is used to send a command completion message to the vehicle host after executing the user voice command; when the user voice command fails to be executed, the first fault information is sent to the vehicle host and the AR display module;

[0078] The vehicle-mounted host records the first fault information; the AR display module displays the first fault information.

[0079] Optionally, the voice analysis module can be integrated into the vehicle's existing on-board host, and other related control modules can also be set in the on-board host. The embodiment of the present invention is not limited to this. For example, the on-board host can also include: a voice control module; the voice control module is connected to the voice collection module to control the opening and closing of the voice collection module.

[0080] Specifically, when the voice control module detects similar instructions such as "turn on the voice control function" from the user, it can send an on signal to the voice collection module. After receiving the on signal, the voice collection module enters the working state, collects the user's voice instructions in real time and sends the instructions to the voice analysis module; when the voice control module detects similar instructions such as "turn off the voice control function" from the user, it can send a off signal to the voice collection module. After receiving the off signal, the voice collection module exits the voice collection mode and no longer collects user voice.

[0081] Optionally, after completing a user's voice command, if the voice collection module does not collect any voice commands issued by the user within a certain set threshold time, the voice collection module can shut down automatically and wait for the next start command. The specific value of this set threshold time can be set according to actual conditions, for example, it can be set to 5 minutes. After reaching the set threshold time, the voice collection module exits the voice collection mode and can automatically sleep after not collecting user voice information for a long time, saving system power.

[0082] S420: The voice collection module collects user voice commands and sends the user voice commands to the voice analysis module.

[0083] S430: The voice analysis module analyzes the user's voice command and sends a corresponding control signal to the function control module according to the analysis result.

[0084] S440. The function control module executes the user voice command according to the control signal, and sends the execution feedback information to the AR display module; the AR display module displays the execution feedback information.

[0085] Optionally, the AR display module may also be connected to the vehicle-mounted host to display the second fault information when the execution feedback information cannot be displayed, and send the second fault information to the vehicle-mounted host; the vehicle-mounted host records the second fault information.

[0086] According to the technical solution provided by the embodiment of the present invention, when an AR display module fails and cannot display the execution feedback information corresponding to the user's voice command, the AR display module may display a second fault message. The second fault message may be "unable to display execution feedback information", prompting the user that the AR display module may fail and need to be repaired in time. At the same time, the AR display module sends the second fault information to the vehicle-mounted host, and the vehicle-mounted host records the second fault information.

[0087] Optionally, the mobile terminal can communicate with the vehicle-mounted host via a wireless network, and the vehicle-mounted host will send the recorded first fault information and / or second fault information to the mobile terminal. The user can query related faults through the mobile terminal and repair them in time.

[0088] Optionally, a speaker may be provided, the speaker being connected to the vehicle-mounted host, and configured to send out a prompt message indicating that the command is completed after detecting that the vehicle-mounted host has received the command completion message;

[0089] After detecting that the vehicle-mounted host receives the first fault information and / or the second fault information, a fault prompt message is issued.

[0090] Specifically, the speaker is a sound prompt terminal, which is connected to the vehicle-mounted host. When the vehicle-mounted host receives the instruction completion information, it can also send the instruction completion information to the speaker. After the speaker detects the instruction completion information, it issues an instruction completion prompt information; when the vehicle-mounted host receives the first fault information and / or the second fault information, it can also send the first fault information and / or the second fault information to the speaker. After the speaker detects the first fault information and / or the second fault information, it issues a fault prompt information.

[0091] Optionally, an application upgrade module may also be provided, wherein the application upgrade module is connected to the voice acquisition module, the voice analysis module, the function control module and the AR display module, and is used to perform function upgrades on the voice acquisition module, the voice analysis module, the function control module and the AR display module.

[0092] The above-mentioned voice acquisition module, voice analysis module, function control module and AR display module can all be connected to the application upgrade module via CAN bus / Ethernet. The application upgrade module upgrades the above-mentioned modules to enable each module to complete the function update.

[0093] Optionally, the setting of the application upgrade module can be implemented by any software and / or hardware that can perform its functions, and the embodiment of the present invention is not limited to this. In this embodiment, it is preferably implemented by Over-the-Air Technology (OTA), which refers to the technology of remotely managing mobile terminal devices and SIM card data through the air interface of mobile communications. The specific implementation method of OTA technology can refer to any existing technology and will not be repeated here.

[0094] According to the technical solution provided in the fourth embodiment of the present invention, the function control module sends the execution feedback information corresponding to the user voice command to the vehicle-mounted host and the AR display module. When the user voice command can be completed, the command completion information is displayed, so that the user can get feedback in time, enhance the interactivity between the user and the vehicle, and improve the intelligence of the interactive system; when the user voice command cannot be executed, timely fault feedback is provided, which can also enable the user to find the cause of the fault and repair the corresponding fault in time, avoiding the user's disgust caused by the failure to be solved in time.

[0095] In addition, the speaker setting realizes the sound and light coordinated interaction between the user and the vehicle, improves the technological sense of the entire vehicle, and enhances the user's operating experience; the setting of the application upgrade module can make the AR display interface adapt to different vehicle interior styles, further enhancing the user's sense of pleasure when using the voice interaction system.

[0096] Embodiment 5

[0097] An embodiment of the present invention also provides a vehicle, which includes the vehicle voice interaction system provided by any embodiment of the present invention, and includes the technical features of the vehicle voice interaction system provided by any embodiment of the present invention, and has the beneficial effects of the corresponding features, which will not be repeated here.

[0098] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A vehicle voice interaction system, characterized in that: include: Voice collection module, voice analysis module, function control module and AR display module; The voice collection module is connected to the voice analysis module, and is used to collect user voice commands and send the user voice commands to the voice analysis module; The voice analysis module is connected to the function control module, and is used to analyze the user's voice command and send a corresponding control signal to the function control module according to the analysis result; The function control module is connected to the AR display module, and is used to execute the user voice command according to the control signal, and send execution feedback information to the AR display module; the AR display module displays the execution feedback information; Also includes, vehicle host; The speech analysis module is integrated into the vehicle-mounted host; The function control module is connected to the vehicle-mounted host and is used to send command completion information to the vehicle-mounted host after executing the user voice command; When the user voice command fails to be executed, sending first fault information to the vehicle-mounted host and the AR display module; The vehicle-mounted host records the first fault information; The AR display module displays the first fault information; The AR display module is connected to the vehicle-mounted host, and is used to display the second fault information when the execution feedback information cannot be displayed, and send the second fault information to the vehicle-mounted host; The vehicle-mounted host records the second fault information; Also included: a mobile terminal; The mobile terminal can communicate with the vehicle-mounted host via a wireless network, and the vehicle-mounted host sends the recorded second fault information to the mobile terminal.

2. The vehicle voice interaction system according to claim 1, characterized in that: The AR display module includes at least an AR-HUD; The AR-HUD is used to project the execution feedback information onto the front windshield of the vehicle.

3. The vehicle voice interaction system according to claim 1, characterized in that: Also includes: speaker; The speaker is connected to the vehicle-mounted host and is used to send out a command completion prompt message after detecting that the vehicle-mounted host has received the command completion message; After detecting that the vehicle-mounted host receives the first fault information and / or the second fault information, a fault prompt message is issued.

4. The vehicle voice interaction system according to claim 1, characterized in that: Also includes, application upgrade module; The application upgrade module is connected to the voice acquisition module, the voice analysis module, the function control module and the AR display module, and is used to perform function upgrades on the voice acquisition module, the voice analysis module, the function control module and the AR display module.

5. The vehicle voice interaction system according to claim 1, characterized in that: The vehicle-mounted host also includes: a voice control module; The voice control module is connected to the voice collection module and is used to control the opening and closing of the voice collection module.

6. The vehicle voice interaction system according to claim 1, characterized in that: The function control module includes at least one of the following: Body control unit, door control unit, light control unit, air conditioning control unit, seat control unit and navigation control unit.

7. A vehicle voice interaction method, characterized in that: The vehicle voice interaction system applicable to any one of claims 1 to 6 above comprises: The voice collection module collects user voice commands and sends the user voice commands to the voice analysis module; The voice analysis module analyzes the user's voice command and sends a corresponding control signal to the function control module according to the analysis result; The function control module executes the user voice command according to the control signal, and sends execution feedback information to the AR display module; the AR display module displays the execution feedback information.

8. A vehicle, characterized in that: A vehicle voice interaction system comprising any one of claims 1-6.

Images