Vehicle voice display system and vehicle

Abstract

The utility model provides a vehicle voice display system and a vehicle, the system comprises a voice acquisition module, a control module and a voice display device, the voice acquisition module comprises at least one voice acquisition device used for acquiring voice information, and the voice acquisition device is arranged on the outer side of the vehicle. The control module is connected with the voice acquisition module; the voice display device is arranged on the vehicle and connected with the control module, and a display panel of the voice display device faces the outer side of the vehicle and is used for displaying voice information processed by the control module. The voice information outside the vehicle is collected through the voice collection module, the control module recognizes and processes the collected voice information, the vehicle can accurately receive the voice information, meanwhile, the voice display device can display the voice information processed by the control module, the processing result can be fed back to a user in a display mode, and the user experience is improved. And the user and the vehicle can better communicate with each other outside the vehicle.

Description

Technical Field

[0001] The utility model relates to the technical field of vehicles, in particular to a vehicle voice display system and a vehicle. Background Art

[0002] With the rapid development of vehicle technology, out-of-vehicle voice interaction has become a new form of interaction between users and vehicles. However, the out-of-vehicle environment is relatively noisy, which will affect the interaction between the vehicle and the user. For example, the vehicle cannot accurately recognize the instructions issued by the user, or after the vehicle executes the instructions and gives a voice prompt feedback, the user cannot accurately hear the execution result feedback by the vehicle. Summary of the Utility Model

[0003] In view of this, the purpose of the utility model is to provide a vehicle voice display system and a vehicle to solve the problem that the user and the vehicle cannot accurately interact in a noisy out-of-vehicle environment.

[0004] Based on the above purpose, the utility model provides a vehicle voice display system, including:

[0005] A voice collection module, including at least one voice collection device for collecting voice information, and the voice collection device is arranged outside the vehicle;

[0006] A control module, connected to the voice collection module;

[0007] A voice display device, arranged on the vehicle and connected to the control module, and the display panel of the voice display device faces the outside of the vehicle for displaying the voice information processed by the control module.

[0008] Optionally, the system further includes a sound module, which is arranged on the vehicle and connected to the control module for playing the voice information processed by the control module.

[0009] Optionally, the control module includes a main control sub-module, a vehicle-end control sub-module and a voice display device control sub-module connected in sequence. The main control sub-module is connected to the voice collection module, and the voice display device control sub-module is connected to the voice display device.

[0010] Optionally, the main control sub-module is further connected to a noise reduction sub-module.

[0011] Optionally, the main control sub-module and the vehicle-end control sub-module are connected through a CAN bus, where the CAN bus includes a first signal line and a second signal line, and the voltages of the first signal line and the second signal line are different.

[0012] Optionally, the main control sub-module and the voice collection module are connected through an A2B bus.

[0013] Optionally, the sound module and the main control sub-module are connected through an A2B bus.

[0014] Optionally, the vehicle-end control sub-module and the voice display device control sub-module are connected through a LIN bus.

[0015] Based on the same inventive concept, the present utility model further provides a vehicle, including the vehicle voice display system as described in any one of the above.

[0016] As can be seen from the above, the present utility model provides a vehicle voice display system and a vehicle. The system includes a voice collection module, a control module, and a voice display device. Among them, the voice collection module includes at least one voice collection device for collecting voice information. The voice collection device is outside the vehicle and is used to collect the voice outside the vehicle. The control module is connected to the voice collection module and is used to identify and process the voice collected by the voice collection module, so that the vehicle can accurately receive the user's voice information; after identifying the voice, perform corresponding operations according to the voice, and process the operation status and results into voice information for the voice display device to display the processed voice information. Further, the voice display device is arranged on the vehicle and is connected to the control module, and the display panel of the voice display device faces the outside of the vehicle to display the voice information processed by the control module. By displaying the voice information processed by the control module through the voice display device, the feedback result of the vehicle can be presented to the user more clearly. In this way, by collecting the voice information outside the vehicle through the voice collection module and the control module identifying and processing the collected voice information, the vehicle can accurately receive the voice information. At the same time, the voice display device can display the voice information processed by the control module and can feedback the processing result to the user in a display manner, enabling better vehicle-to-vehicle interaction between the user and the vehicle. Description of the Drawings

[0017] In order to more clearly illustrate the technical solutions in the present utility model or related technologies, the following will briefly introduce the drawings required for use in the embodiments or related technology descriptions. Obviously, the drawings in the following descriptions are only the embodiments of the present utility model. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0018] Figure 1 It is a schematic structural framework diagram of a vehicle voice display system according to an embodiment of the present utility model;

[0019] Figure 2 It is a schematic structural diagram of a vehicle according to an embodiment of the present utility model;

[0020] Figure 3 Schematic diagram of the pin connection structure of the vehicle voice display system according to an embodiment of the present invention.

[0021] In the attached drawings:

[0022] 1. Voice acquisition module; 2. Control module; 3. Voice display device; 5. Noise reduction module; 4. Sound module; 21. Main control sub-module; 22. Vehicle-end control sub-module; 23. Voice display device control sub-module. Specific embodiments

[0023] In order to make the objectives, technical solutions and advantages of the present invention more clear and understandable, the present invention will be further described in detail below with reference to specific embodiments and the attached drawings.

[0024] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present invention should be the general meanings understood by those with ordinary skills in the field to which the present invention belongs. The "first", "second" and similar terms used in the embodiments of the present invention do not indicate any order, quantity or importance, but are only used to distinguish different components. The terms such as "including" or "comprising" mean that the elements or objects appearing before this word cover the elements or objects listed after this word and their equivalents, without excluding other elements or objects. The terms such as "connected" or "coupled" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The terms such as "upper", "lower", "left" and "right" are only used to represent relative positional relationships, and when the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0025] Based on the background technology described above, in recent years, the emerging voice interaction, when used in the out-of-vehicle environment, mainly focuses on expanding leisure and entertainment functions (such as voice interaction with out-of-vehicle lights, playing out-of-vehicle music, etc.), expanding vehicle control scenarios (voice-controlled parking, out-of-vehicle voice control of the vehicle, etc.), expanding vehicle reminder services (out-of-vehicle voice queries, near & remote vehicle calls, etc.), and has gradually become a new type of human-vehicle communication and interaction. Considering the above-mentioned voice usage scenarios, the development of voice images is also changing rapidly; there are a wide variety of applications of voice images on the in-vehicle side, mainly including: pure software implementation, relying on hardware (such as customized screens, full-system projection, etc.). The final effect presented to the user is that through the combination of the image itself and the voice service scenario, sufficient feedback and interaction are carried out, so that the voice is no longer a cold machine during the interaction process. The existence of the voice image makes the entire interaction link full of warmth and the emotion more delicate and rich. However, the out-of-vehicle voice interaction is not in a quiet environment. Usually, the out-of-vehicle environmental noise is much greater than that inside the vehicle. Currently, the out-of-vehicle voice noise reduction ability is relatively mature and can well eliminate the environmental noise during the out-of-vehicle voice interaction process; but these noises can be cleared at the system end (i.e., the vehicle end), but the human ear cannot eliminate them; usually in this scenario, after the vehicle executes the instructions issued by the user, it gives a voice prompt, and the user simply cannot hear it in a noisy environment. Therefore, the vehicle cannot better display the execution results to the user.

[0026] Based on the above background, the present utility model combines the out-of-vehicle voice with the out-of-vehicle display screen, and the out-of-vehicle display screen displays the states of each stage of the vehicle's processing of the voice information collected from the out-of-vehicle user, so as to improve the out-of-vehicle voice interaction experience between the user and the vehicle.

[0027] To solve the above technical problems, as Figure 1 shown, the present utility model provides a vehicle voice display system, including:

[0028] A voice collection module 1, including at least one voice collection device for collecting voice information, and the voice collection device is arranged on the outside of the vehicle;

[0029] A control module 2, connected to the voice collection module 1;

[0030] A voice display device 3, arranged on the vehicle and connected to the control module 2, and the display panel of the voice display device 3 faces the outside of the vehicle, and is used for displaying the voice information processed by the control module 2.

[0031] Specifically, by way of example, the voice acquisition device may be a microphone, and the voice display device 3 may be a display screen. There may be multiple voice acquisition modules 1. The multiple voice acquisition modules 1 are arranged around the vehicle, which can make the acquired voice more accurate and reduce the processing flow during voice processing. For example, in a noisy environment, since it is closer to the microphone, the voice acquired by the voice acquisition module 1 can have less background noise, reducing the voice denoising process. The control module 2 is connected to the voice acquisition device. After receiving the acquired voice information, it recognizes and processes the voice acquired by the voice acquisition module 1, enabling the vehicle to accurately receive the user's voice information; after recognizing the voice, it performs corresponding operations according to the voice and processes the operation status and result into voice information for the voice display device 3 to display the processed voice information. Further, the voice display device 3 is arranged on the vehicle and connected to the control module 2, and the display panel of the voice display device 3 faces the outside of the vehicle, for displaying the voice information processed by the control module 2. By displaying the voice information processed by the control module 2 through the voice display device 3, the feedback result of the vehicle can be presented to the user more clearly. In this way, by collecting the external voice information through the voice acquisition module 1 and the control module 2 recognizing and processing the acquired voice information, the vehicle can accurately receive the voice information. At the same time, the voice display device 3 can display the voice information processed by the control module 2, and can feedback the processing result to the user in a display manner, enabling better interaction between the user and the vehicle.

[0032] In this embodiment, by way of example, the display screen is arranged on the rear windshield inside the vehicle, and the display panel of the display screen faces the outside of the vehicle, facilitating the user to view.

[0033] In some embodiments, arranging more voice acquisition modules 1 around the vehicle can acquire more accurate voice. Therefore, in this embodiment, as Figure 2 shown, by way of example, the voice acquisition module 1 includes four voice acquisition devices, which are respectively installed on the left rearview mirror, right rearview mirror, front bumper and rear bumper. The voice acquisition module 1 is used to acquire the voice outside the vehicle. By way of example, it can acquire the control instructions issued by the user to the vehicle. Since the four voice acquisition modules 1 are arranged around the vehicle, the vehicle can acquire more accurate voice and reduce the voice processing process.

[0034] In some embodiments, if the vehicle is in a quiet environment, the vehicle can prompt the control state of the vehicle in the form of voice broadcast, making the interaction between the user and the vehicle more convenient and avoiding the user from viewing the display screen. Therefore, the system further includes a sound module 4. The sound module 4 is arranged on the vehicle and connected to the control module 2, for playing the voice information processed by the control module 2.

[0035] Exemplarily, the sound module 4 can be a speaker, which is arranged outside the vehicle. For example, there can be multiple speakers, which are arranged around the vehicle. The multiple speakers can include four speakers, which are respectively installed on the left and right rearview mirrors, the front bumper, and the rear bumper. In this way, the user can clearly hear the voice broadcast of the vehicle and clearly know the stage of vehicle control. When the control module 2 sends the information to be displayed to the voice display device 3, it also sends it to the sound module 4. The sound module 4 broadcasts the information to be displayed in voice for the user to know.

[0036] In some embodiments, the control module 2 in the vehicle voice display system includes multiple control sub-modules. Through the multiple control sub-modules, the vehicle can be controlled to perform corresponding actions according to the voice information, and the voice display device 3 can be controlled to display the execution result of the action, so that the user can view the execution result of the vehicle through the voice display device 3 in a noisy environment. Specifically, the control module 2 includes a main control sub-module 21, a vehicle-end control sub-module 22, and a voice display device control sub-module 23 connected in sequence. The main control sub-module 21 is connected to the voice acquisition module 1, and the voice display device control sub-module 23 is connected to the voice display device 3.

[0037] Exemplarily, the main control sub-module 21 can adopt a system-on-a-chip (SoC) (such as Figure 3 the first control chip MCU1), and exemplarily, the model can be the Qualcomm Snapdragon 8295 chip. The vehicle-end control sub-module 22 can adopt an MCU control chip (such as Figure 3 the second control chip MCU2), and exemplarily, the model can be RH850 Renesas. The voice display device control sub-module 23 can adopt an MCU control chip (such as Figure 3 the third control chip MCU3), and exemplarily, the model can be NXP: S9KEAZ128AMLH LQFP64. Among them, the system-on-a-chip includes 1. A processor core CPU, which is responsible for executing computing tasks. 2. A graphics processing unit GPU, which is responsible for processing graphics-related tasks, such as rendering 3D graphics, video decoding, etc. 3. A communication interface: The communication interface is responsible for processing wireless and wired communication functions, such as Wi-Fi, Bluetooth, Ethernet, etc. In the system-on-a-chip, the communication interface can integrate multiple different communication standards and protocols. Through the CPU in the system-on-a-chip, relevant logical operations, data transmission, etc. can be realized; its built-in voice recognition system software can obtain the status of voice recognition through the system-on-a-chip, including: voice wake-up status, voice endpoint detection time status, voice recognition in progress status, semantic understanding status, voice feedback status, voice command processing exception status, etc.

[0038] Specifically, the main control sub-module 21 is used to perform speech recognition on the received speech, generate a control instruction after recognizing the speech, and send the control instruction to the vehicle control sub-module 22. The vehicle control sub-module 22 controls the vehicle according to the control instruction. The voice display device control sub-module 23 monitors the control state of the vehicle end. After the vehicle end control is completed, the state is displayed on the display screen for the user to view, which can help the user clearly know the running state of the vehicle and better realize the interaction between the vehicle and the user.

[0039] In some embodiments, since the external environment of the vehicle is relatively noisy, the speech collected by the speech acquisition module 1 will carry other noises. In this way, it will cause the control module 2 to recognize the speech incorrectly, resulting in inaccurate control of the vehicle. Therefore, the main control sub-module 21 is further connected to a noise reduction sub-module.

[0040] Exemplarily, the noise reduction sub-module can be a noise reduction software embedded in the system-on-chip, or a noise reduction chip connected to the system and the chip (such as Figure 3 the noise reduction chip DSP in). The noise reduction chip can adopt the iFlytek XF6010 series chip. The specific model can be selected according to actual use and is not specifically limited in the present invention. In this way, the speech collected by the speech acquisition module 1 is denoised by the noise reduction sub-module, and the denoised speech is clearer, making the vehicle control more accurate.

[0041] In some embodiments, the Controller Area Network (CAN network) in the Controller Area Network (CAN network) is a serial communication protocol bus designed specifically for real-time applications. In the present invention, as Figure 3 shown, the main control sub-module 21 and the vehicle control sub-module 22 are connected through a CAN bus. Among them, the CAN bus includes a first signal line and a second signal line, and the voltages of the first signal line and the second signal line are different.

[0042] Specifically, the complex wiring between the various electronic control units in the vehicle can be reduced through the CAN bus. All peripheral devices are connected through a single network bus, thereby realizing efficient data communication. The CAN bus includes two signal lines, namely the first signal line CAN_L and the second signal line CAN_H. The voltages between the first signal line CAN_L and the second signal line CAN_H are different. Therefore, differential voltage can be used to transmit data. This structure helps to maintain the stability of data in a noisy environment and prevent electromagnetic interference. By respectively setting CAN bus interfaces (such as Figure 3 the CAN bus in) on the main control sub-module 21 and the vehicle control sub-module 22 and connecting them through the CAN bus, the stability of data transmission between the main control sub-module 21 and the vehicle control sub-module 22 can be realized.

[0043] In some embodiments, the A2B bus is an automotive audio bus for transmitting audio signals within a vehicle. Therefore, as Figure 3 shown, in the present utility model, the main control sub-module 21 is connected to the voice acquisition module 1 through the A2B bus.

[0044] Specifically, by way of example, the A2B bus is used for connecting audio devices within a vehicle, including microphones, power amplifiers, multimedia hosts, and T-BOXes, etc. It performs long-distance audio data transmission, control signal transfer, clock synchronization, and power supply through low-cost unshielded twisted pair UTP. The voice acquisition module 1 in the present utility model uses a microphone (such as Figure 3 the microphone MIC in Figure 3 ) for acquisition, such that the voice acquisition module 1 and the main control sub-module 21 are respectively provided with A2B bus interfaces (such as

[0045] the A2B bus in Figure 3 ), and the voice acquisition module 1 is connected to the main control sub-module 21 through the A2B bus. Thereby, costs are saved, and audio data transmission becomes more stable.

[0046] In some embodiments, the A2B bus is an automotive audio bus for transmitting audio signals within a vehicle. Therefore, as Figure 3 shown, in the present utility model, the sound module 4 is connected to the main control sub-module 21 through the A2B bus. Figure 3 Specifically, by way of example, the A2B bus is used for connecting audio devices within a vehicle. The audio devices include microphones, power amplifiers, multimedia hosts, and T-BOXes, etc. It performs long-distance audio data transmission, control signal transfer, clock synchronization, and power supply through low-cost unshielded twisted pair UTP. The sound module 4 in the present utility model uses a speaker (such as

[0047] the speaker OTP in Figure 3 ) or a power amplifier for voice playback, such that the sound module 4 and the main control sub-module 21 are respectively provided with A2B bus interfaces (such as

[0048] the A2B bus in

[0047] ), and the sound module 4 is connected to the main control system module through the A2B bus. Thereby, costs are saved, and audio data transmission becomes more stable. Figure 3 shown, in the present utility model, the vehicle-end control sub-module 22 is connected to the voice display device control sub-module 23 through the LIN bus.

[0048] Specifically, in this embodiment, by connecting the vehicle-end control sub-module 22 and the voice display device control sub-module 23 through the LIN bus, cost can be saved.

[0049] In some embodiments, the serial bus can be connected to external devices, enabling the vehicle to be connected to more external devices. In this embodiment, the voice display device of the present utility model is connected to the voice display device control module through the serial bus SPI.

[0050] Specifically, in this embodiment, both the voice display device and the voice display device control module are provided with serial peripheral interfaces. Therefore, by connecting the voice display device and the voice display device control module through the serial bus, the plug-and-play function can be realized, and the connection is more convenient.

[0051] The specific usage method of the present utility model is as follows:

[0052] The voice acquisition module 1 acquires the control instruction "open the trunk" voice instruction issued by the user outside the vehicle. After the main control module 2 receives the voice instruction, it transmits the voice instruction to the noise reduction module 5. The noise reduction module 5 performs noise reduction processing on the voice to eliminate the background noise in the environment, improving the clarity and comprehensibility of the voice signal. After the main control sub-module 21 recognizes the noise-reduced voice, it generates a control instruction and sends it to the vehicle-end control module 2. The vehicle-end control module 2 controls the vehicle to open the trunk and at the same time sends the execution status information to the voice display device control sub-module 23 and feeds it back to the main control sub-module 21. The main control sub-module 21 sends the status information to the sound module 4, and the voice display device control sub-module 23 sends the status information to the voice display device 3 for display. At the same time, the sound module 4 broadcasts the status during the vehicle control process, so that the user can view it on the display device or directly hear the broadcast of the sound module 4. This improves the voice interaction function between the user and the vehicle.

[0053] Based on the same inventive concept, the present utility model also provides a vehicle, including the vehicle voice display system described in any one of the above.

[0054] The system includes a voice collection module 1, a control module 2, and a voice display device 3. Among them, the voice collection module 1 includes at least one voice collection device for collecting voice information. The voice collection device is outside the vehicle and is used to collect the voice outside the vehicle. The control module 2 is connected to the voice collection module 1 and is used to identify and process the voice collected by the voice collection module 1, so that the vehicle can accurately receive the user's voice information; after identifying the voice, corresponding operations are performed according to the voice, and the operation status and results are processed into voice information for the voice display device 3 to display the processed voice information. Further, the voice display device 3 is arranged on the vehicle and is connected to the control module 2, and the display panel of the voice display device 3 faces the outside of the vehicle and is used to display the voice information processed by the control module 2. By displaying the voice information processed by the control module 2 through the voice display device 3, the feedback result of the vehicle can be presented to the user more clearly. In this way, by collecting the external voice information through the voice collection module 1 and the control module 2 identifying and processing the collected voice information, the vehicle can accurately receive the voice information. At the same time, the voice display device 3 can display the voice information processed by the control module 2, and the processing result can be fed back to the user in a display manner, enabling better vehicle-to-vehicle interaction between the user and the vehicle.

[0055] It should be noted that some embodiments of the present invention are described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the above embodiments and still achieve the desired results. Additionally, the processes depicted in the figures do not necessarily require the particular order or sequential order shown to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0056] Those of ordinary skill in the art should understand that: the discussion of any of the above embodiments is exemplary only and is not intended to imply that the scope of the present invention (including the claims) is limited to these examples; under the concept of the present invention, the technical features between the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations in different aspects of the embodiments of the present invention as described above, which are not provided in detail for the sake of brevity.

[0057] In addition, for simplicity of explanation and discussion, and in order not to make the embodiments of the present utility model difficult to understand, the well-known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided drawings. Further, the devices may be shown in block diagram form in order to avoid making the embodiments of the present utility model difficult to understand, and this also takes into account the fact that details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present utility model are to be implemented (i.e., these details should be entirely within the understanding of those skilled in the art). In cases where specific details (such as circuits) are set forth to describe exemplary embodiments of the present utility model, it will be apparent to those skilled in the art that the embodiments of the present utility model may be practiced without these specific details or with variations of these specific details. Accordingly, these descriptions should be considered illustrative rather than restrictive.

[0058] Although the present utility model has been described in connection with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art in light of the foregoing description. For example, other memory architectures (such as dynamic RAM (DRAM)) may be used with the embodiments discussed.

[0059] Embodiments of the present utility model are intended to cover all such alternatives, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of the embodiments of the present utility model shall be included within the protection scope of the present utility model.

Claims

1. A vehicle voice display system, characterized in that: include: A voice collection module (1) comprises at least one voice collection device for collecting voice information, wherein the voice collection device is arranged outside the vehicle; A control module (2) connected to the voice collection module (1); A voice display device (3) is arranged on the vehicle and connected to the control module (2); the display panel of the voice display device (3) faces the outside of the vehicle and is used to display voice information processed by the control module (2).

2. A vehicle voice display system according to claim 1, characterized in that: The system also comprises a sound module (4), which is arranged on the vehicle and connected to the control module (2) and is used to play voice information processed by the control module (2).

3. A vehicle voice display system according to claim 2, characterized in that: The control module comprises a main control submodule (21), a vehicle-side control submodule (22) and a voice display device control submodule (23) which are connected in sequence, the main control submodule (21) being connected to the voice acquisition module (1), and the voice display device control submodule (23) being connected to the voice display device (3).

4. A vehicle voice display system according to claim 3, characterized in that: The main control submodule (21) is also connected to a noise reduction submodule (5).

5. A vehicle voice display system according to claim 3, characterized in that: The main control submodule (21) is connected to the vehicle-end control submodule (22) via a CAN bus.

6. A vehicle voice display system according to claim 5, characterized in that: The CAN bus includes a first signal line and a second signal line, and the voltages of the first signal line and the second signal line are different.

7. A vehicle voice display system according to claim 3, characterized in that: The main control submodule (21) is connected to the voice collection module (1) via an A2B bus.

8. A vehicle voice display system according to claim 3, characterized in that: The sound module (4) and the main control submodule (21) are connected via an A2B bus.

9. The vehicle voice display system according to claim 3, characterized in that: The vehicle-side control submodule (22) and the voice display device control submodule (23) are connected via a LIN bus.

10. A vehicle, characterized in that: A vehicle voice display system comprising the vehicle voice display system according to any one of claims 1 to 9.

Images