Voice interaction method, device and equipment for vehicle-mounted system and storage medium

Through the voice interaction technology of the on-board system, the speaker module is used to play audio, which solves the problem of poor human-vehicle interaction in the existing technology, improves the reminder ability in prohibited horn areas or complex environments, and reduces the occurrence of traffic accidents.

CN119218101APending Publication Date: 2024-12-31BEI DOU ZHI LIAN KE JI YOU XIAN GONG SI +1
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411285677.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-13
Publication Date
2024-12-31

AI Technical Summary

Technical Problem

The poor interaction between humans and vehicles in the prior art makes it difficult to effectively remind pedestrians in prohibited whistle areas or complex environments, which poses safety risks.

Method used

The control module of the on-board system detects voice interaction commands, obtains voice data, and judges whether the interaction conditions are met based on the vehicle driving status information, generates audio playback instructions, and sends them to the speaker module to play audio, improving the human-vehicle interaction performance.

Benefits of technology

It improves the vehicle's human-vehicle interaction performance and reduces the occurrence of traffic accidents, especially in prohibited areas or complex environments to effectively remind pedestrians, enhancing the safety of drivers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119218101A_ABST
    Figure CN119218101A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a voice interaction method, device and equipment for a vehicle-mounted system and a storage medium, the method is applied to a control module of the vehicle-mounted system, the vehicle-mounted system further comprises a loudspeaker module in communication connection with the control module, and the method comprises the following steps: if a voice interaction instruction is detected, the loudspeaker module is in communication connection with the control module; if yes, obtaining target voice data from a preset voice data packet according to the voice interaction instruction; judging whether a first voice interaction condition is met or not according to the acquired vehicle driving state information; if yes, generating a corresponding audio playing instruction according to a preset voice interaction strategy and the target voice data; and sending the audio playing instruction to the loudspeaker module, so that the loudspeaker module plays audio according to the audio playing instruction. According to the embodiment of the invention, the human-vehicle interaction performance of the vehicle can be improved, and traffic accidents are reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of in-vehicle intelligent voice technology, and in particular to a voice interaction method, device, equipment and storage medium for an in-vehicle system. Background Art

[0002] When a car is driving, the driver usually uses the horn to alert other vehicles or pedestrians; however, in some areas where honking is prohibited, the driver cannot use the horn to alert pedestrians, which can easily cause traffic accidents; and when the user is in an unfamiliar environment or a complex environment outside the car, the user needs to lower the window to communicate with the outside world, which poses certain safety hazards.

[0003] Therefore, the existing technology has the problem of poor human-vehicle interaction. Summary of the invention

[0004] The embodiments of the present invention provide a voice interaction method, device, equipment and storage medium for a vehicle-mounted system, aiming to solve the problem of poor human-vehicle interaction in the prior art.

[0005] In a first aspect, an embodiment of the present invention provides a voice interaction method for an in-vehicle system, the method being applied to a control module of the in-vehicle system, the in-vehicle system further comprising a speaker module communicatively connected to the control module, the method comprising:

[0006] If a voice interaction instruction is detected, obtaining target voice data from a preset voice data packet according to the voice interaction instruction;

[0007] Determining whether a first voice interaction condition is met according to the acquired vehicle driving state information;

[0008] If satisfied, then generate a corresponding audio playback instruction according to the preset voice interaction strategy and the target voice data;

[0009] The audio playing instruction is sent to the speaker module, so that the speaker module plays the audio according to the audio playing instruction.

[0010] In a second aspect, an embodiment of the present invention further provides a voice interaction device for an in-vehicle system, wherein the in-vehicle system further includes a display module that is communicatively connected to the control module, and if a voice content input instruction is detected, after determining an input mode according to the voice content input instruction, further includes:

[0011] If the input mode is a text input mode, obtaining the second text data collected by the display module;

[0012] Determine whether a dialect input instruction is detected, and obtain a second determination result;

[0013] If the second judgment result is yes, obtaining the dialect type according to the dialect input instruction;

[0014] Acquiring second voice data corresponding to the second text data from a preset dialect database according to the dialect type;

[0015] Establishing a second association relationship between the second voice data and the second text data;

[0016] The second voice data, the second text data and the second association relationship are stored in the voice data packet.

[0017] In a third aspect, an embodiment of the present invention further provides an electronic device, which includes a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method described in the first aspect is implemented.

[0018] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein the storage medium stores a computer program, wherein the computer program includes program instructions, and wherein the program instructions, when executed by a processor, can implement the method described in the first aspect above.

[0019] The embodiment of the present invention provides a voice interaction method, device, equipment and storage medium for an in-vehicle system, the method is applied to a control module of the in-vehicle system, the in-vehicle system also includes a speaker module that is communicatively connected to the control module, the method includes: if a voice interaction instruction is detected, then obtaining target voice data from a preset voice data packet according to the voice interaction instruction; judging whether a first voice interaction condition is met according to the acquired vehicle driving state information; if met, then generating a corresponding audio playback instruction according to a preset voice interaction strategy and the target voice data; sending the audio playback instruction to the speaker module so that the speaker module plays audio according to the audio playback instruction. The embodiment of the present invention can send the audio playback instruction to the speaker module so that the speaker module plays audio according to the audio playback instruction, thereby improving the vehicle's human-vehicle interaction performance and reducing the occurrence of traffic accidents. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0021] Figure 1A flow chart of a voice interaction method for an in-vehicle system provided by an embodiment of the present invention;

[0022] Figure 2 A schematic block diagram of a voice interaction device for an in-vehicle system provided by an embodiment of the present invention;

[0023] Figure 3 A schematic block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0025] It should be understood that when used in this specification and the appended claims, the terms "include" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0026] It should also be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0027] It should be further understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations. The embodiment of the present invention provides a voice interaction method, device, equipment and storage medium for an in-vehicle system. The voice interaction method for an in-vehicle system can be found in Figure 1 , Figure 1 A flow chart of a voice interaction method for an in-vehicle system provided in an embodiment of the present invention. The method is applied to a control module of the in-vehicle system, and the in-vehicle system also includes a speaker module that is communicatively connected to the control module; specifically, the in-vehicle system is a program system for managing and controlling in-vehicle software and hardware resources; the speaker module includes at least one speaker arranged on the outside of the vehicle body.

[0028] Figure 1 The following is a flow chart of a voice interaction method for an in-vehicle system provided by an embodiment of the present invention. Figure 1As shown, the method includes the following steps S110-S140.

[0029] S110: If a voice interaction instruction is detected, obtaining target voice data from a preset voice data packet according to the voice interaction instruction.

[0030] In this embodiment, the vehicle-mounted system also includes a display module that is communicatively connected to the control module, and the display module includes at least one display screen. A user can perform touch operations on the display screen to play specified voice content (i.e., voice data), thereby generating corresponding voice interaction instructions; the voice data packet includes multiple voice data, and the voice data can be a system default voice or a user-defined voice; specifically, a user can create, delete, and modify voice data through voice input or text input.

[0031] In one embodiment, the vehicle-mounted system also includes a navigation module that is communicatively connected to the control module. After step S110, it also includes: judging whether the second voice interaction condition is met based on the lane information collected by the navigation module; if so, executing the step of judging whether the first voice interaction condition is met based on the acquired vehicle driving status information; if not, prompting the user that the voice interaction fails.

[0032] In this embodiment, the navigation module includes at least one map application software, and the map application software can collect lane information of the area where the vehicle is located in real time. The control module can determine whether the second voice interaction condition is met based on the lane information collected by the navigation module; it can determine whether the voice interaction function can be executed in the area where the vehicle is located based on the second voice interaction condition; specifically, determine whether the current lane is an ordinary lane based on the lane information; if the current lane is a high-speed lane and not an ordinary lane, it is determined that the voice interaction condition is not met; if the current vehicle lane is an ordinary lane, it is determined that the voice interaction condition is met.

[0033] In one embodiment, the vehicle-mounted system also includes a sound receiving module that is communicatively connected to the control module, and before step S110, it also includes: if a voice content input instruction is detected, determining an input method according to the voice content input instruction; if the input method is a voice input method, starting the sound receiving module to obtain first voice data; converting the first voice data into first text data, and establishing a first association relationship between the first voice data and the first text data; storing the first voice data, the first text data and the first association relationship in the voice data packet.

[0034] In this embodiment, the vehicle-mounted system also includes a sound receiving module that is communicatively connected to the control module, the sound receiving module includes an in-vehicle sound receiving module and an out-vehicle sound receiving module, the in-vehicle sound receiving module includes at least one in-vehicle microphone, and the out-vehicle sound receiving module includes at least one out-vehicle microphone; if a voice content entry instruction is detected, the entry method is determined according to the voice content entry instruction; if the entry method is a voice entry method, the sound receiving module is started to obtain first voice data; wherein, voice can be recorded through the in-vehicle microphone; the first voice data is converted into first text data, and a first association relationship between the first voice data and the first text data is established; the first voice data, the first text data and the first association relationship are stored in the voice data packet, and the user can view the content of the first voice data through the first text data in the voice interaction interface.

[0035] In one embodiment, the vehicle-mounted system also includes a display module that is communicatively connected to the control module. If a voice content input instruction is detected, after determining the input mode according to the voice content input instruction, it also includes: if the input mode is a text input mode, obtaining the second text data collected by the display module; judging whether a dialect input instruction is detected to obtain a second judgment result; if the second judgment result is yes, obtaining the dialect type according to the dialect input instruction; obtaining the second voice data corresponding to the second text data from a preset dialect database according to the dialect type; establishing a second association relationship between the second voice data and the second text data; and storing the second voice data, the second text data and the second association relationship in the voice data packet.

[0036] In this embodiment, if the input method is a text input method, the second text data collected by the display module is obtained; specifically, the user can create voice data through the display module in a text input method; determine whether a dialect input instruction is detected to obtain a second judgment result; if the second judgment result is yes, obtain the dialect type according to the dialect input instruction; obtain the second voice data corresponding to the second text data from a preset dialect database according to the dialect type; establish a second association relationship between the second voice data and the second text data; store the second voice data, the second text data and the second association relationship in the voice data packet. The embodiment of the present invention can meet the demand for dialect playback through text input, reduce communication barriers, and improve the human-vehicle interaction performance of the vehicle.

[0037] Furthermore, the determining whether a dialect input instruction is detected, after obtaining a second determination result, further includes: if the second determination result is no, then assuming that the dialect type of the second text data is Mandarin.

[0038] Furthermore, the embodiment of the present invention also supports the playback of multiple audio sources such as boys or girls.

[0039] S120. Determine whether a first voice interaction condition is met based on the acquired vehicle driving state information.

[0040] In this embodiment, whether the first voice interaction condition is met is determined based on the acquired vehicle driving state information; the first voice interaction condition can be used to determine whether the vehicle meets the interaction scenario. For example, the voice interaction function cannot be executed when the vehicle is driving at high speed.

[0041] In one embodiment, step S120 includes: obtaining the current driving speed of the vehicle based on the vehicle driving status information; determining whether the current driving speed of the vehicle is less than the set value in the first voice interaction condition, and obtaining a speed judgment result; if the speed judgment result is yes, it is determined that the first voice interaction condition is met.

[0042] In this embodiment, the current driving speed of the vehicle is obtained according to the vehicle driving status information; it is determined whether the current driving speed of the vehicle is less than the set value in the first voice interaction condition to obtain a speed judgment result; the set value can be set according to demand, and the set value can be set to 7km / h; if the speed judgment result is yes, it is determined that the first voice interaction condition is met; if the speed judgment result is no, it is determined that the first voice interaction condition is not met.

[0043] S130: If satisfied, generate a corresponding audio playback instruction according to a preset voice interaction strategy and the target voice data.

[0044] In this embodiment, if the conditions are met, a corresponding audio playback instruction is generated according to a preset voice interaction strategy and the target voice data; specifically, the volume of the target voice data can be adaptively adjusted according to the voice interaction strategy.

[0045] In one embodiment, step S130 includes: determining whether the volume adaptation function is turned on to obtain a first determination result; if the first determination result is no, generating a corresponding audio playback instruction according to the set playback volume in the voice interaction strategy and the target voice data.

[0046] In this embodiment, it is determined whether the volume adaptation function is turned on to obtain a first judgment result; if the first judgment result is no, a corresponding audio playback instruction is generated according to the set playback volume in the voice interaction strategy and the target voice data; if the first judgment result is yes, the volume of playing the target voice data is adaptively adjusted according to the voice interaction strategy.

[0047] In one embodiment, the vehicle-mounted system also includes a sound receiving module and a camera module that are communicatively connected to the control module. The determination of whether the volume adaptation function is turned on, after obtaining a first judgment result, further includes: if the first judgment result is yes, obtaining the decibel value collected by the sound receiving module; obtaining the distance information from the target object based on the image data collected by the camera module; obtaining the playback volume associated with the decibel value and the distance information according to the volume adjustment indication table in the voice interaction strategy; and generating a corresponding audio playback instruction based on the playback volume and the target voice data.

[0048] In this embodiment, the vehicle-mounted system further includes a sound receiving module and a camera module which are communicatively connected with the control module, the sound receiving module includes an in-vehicle sound receiving module and an out-vehicle sound receiving module, the in-vehicle sound receiving module includes at least one in-vehicle microphone, the out-vehicle sound receiving module includes at least one out-vehicle microphone, and the camera module includes at least one camera, which is arranged on the outside of the vehicle body; if the first judgment result is yes, the decibel value collected by the sound receiving module is obtained, wherein the decibel value is collected by the out-vehicle microphone, and the decibel value is the decibel of the ambient noise on the outside of the vehicle body; the distance information with the target object is obtained according to the image data collected by the camera module; the target object may be a person closest to the vehicle; the playback volume associated with the decibel value and the distance information is obtained according to the volume adjustment indication table in the voice interaction strategy; for example, when the decibel value is 50 decibels and the distance information is within the range of 1 meter to 1.5 meters, the playback volume obtained according to the volume adjustment indication table is 60 decibels; wherein the volume adjustment indication table is customized by the developer on the system side; and the corresponding audio playback instruction is generated according to the playback volume and the target voice data.

[0049] The embodiment of the present invention can adaptively adjust the volume of playing the target voice data according to the voice interaction strategy, thereby avoiding the problem of being startled by too loud a volume and being unable to hear the sound accurately due to too low a volume.

[0050] S140: Send the audio playing instruction to the speaker module, so that the speaker module plays the audio according to the audio playing instruction.

[0051] In this embodiment, the audio playback instruction is sent to the speaker module, so that the speaker module plays audio according to the audio playback instruction; for example, when the user passes the zebra crossing, "Please cross first" is played outside the car, so that pedestrians can find the vehicle in time and quickly cross the zebra crossing; when arriving at the gas station, the user can input the voice data of "92 gasoline for 200 yuan" in real time and play it outside the car, so that the gas station staff can directly refuel; when passing through a downtown area, the voice data of "Please look up at the road and pay attention to safety" can be played outside the car to remind pedestrians around the car body.

[0052] In summary, the embodiment of the present invention can send the audio playback instruction to the speaker module, so that the speaker module plays the audio according to the audio playback instruction, thereby improving the human-vehicle interaction performance of the vehicle and reducing the occurrence of traffic accidents.

[0053] Figure 2 A schematic block diagram of a voice interaction device for a vehicle-mounted system provided by an embodiment of the present invention. Figure 2 As shown, corresponding to the above voice interaction method for a vehicle-mounted system, the present invention also provides a voice interaction device for a vehicle-mounted system, the device is configured in a control module of the vehicle-mounted system, and the vehicle-mounted system also includes a speaker module that is communicatively connected to the control module. Figure 2 , the voice interaction device 700 for the vehicle-mounted system includes:

[0054] The detection unit 701 is configured to obtain target voice data from a preset voice data packet according to the voice interaction instruction if a voice interaction instruction is detected;

[0055] A judgment unit 702 is used to judge whether a first voice interaction condition is met according to the acquired vehicle driving state information;

[0056] A generating unit 703 is used to generate a corresponding audio playback instruction according to a preset voice interaction strategy and the target voice data if the conditions are met;

[0057] The playing unit 704 is used to send the audio playing instruction to the speaker module, so that the speaker module plays the audio according to the audio playing instruction.

[0058] In some embodiments, the vehicle-mounted system further includes a navigation module that is in communication connection with the control module. After executing the step of acquiring target voice data from a preset voice data packet according to the voice interaction instruction, the detection unit 701 is further used to:

[0059] Determine whether the second voice interaction condition is met based on the lane information collected by the navigation module; if so, execute the step of determining whether the first voice interaction condition is met based on the acquired vehicle driving status information; if not, prompt the user that the voice interaction fails.

[0060] In some embodiments, when the judging unit 702 performs the step of judging whether the first voice interaction condition is met according to the acquired vehicle driving state information, it is specifically used to:

[0061] The current driving speed of the vehicle is obtained according to the vehicle driving status information; whether the current driving speed of the vehicle is less than the set value in the first voice interaction condition is determined to obtain a speed judgment result; if the speed judgment result is yes, it is determined that the first voice interaction condition is met.

[0062] In some embodiments, when the generation unit 703 executes the step of generating a corresponding audio playback instruction according to a preset voice interaction strategy and the target voice data, it is specifically used to:

[0063] Determine whether the volume adaptation function is turned on to obtain a first judgment result; if the first judgment result is no, generate a corresponding audio playback instruction according to the set playback volume in the voice interaction strategy and the target voice data.

[0064] In some embodiments, the vehicle-mounted system further includes a sound receiving module and a camera module that are in communication connection with the control module. After executing the step of determining whether the volume adaptation function is turned on and obtaining the first determination result, the generation unit 703 is further used to:

[0065] If the first judgment result is yes, the decibel value collected by the sound receiving module is obtained; the distance information from the target object is obtained according to the image data collected by the camera module; the playback volume associated with the decibel value and the distance information is obtained according to the volume adjustment instruction table in the voice interaction strategy; and a corresponding audio playback instruction is generated according to the playback volume and the target voice data.

[0066] In some embodiments, before executing the step of acquiring target voice data from a preset voice data packet according to the voice interaction instruction if a voice interaction instruction is detected, the detection unit 701 is further used to:

[0067] If a voice content entry instruction is detected, the entry method is determined according to the voice content entry instruction; if the entry method is a voice entry method, the sound receiving module is started to obtain first voice data; the first voice data is converted into first text data, and a first association relationship between the first voice data and the first text data is established; the first voice data, the first text data and the first association relationship are stored in the voice data packet.

[0068] In some embodiments, the vehicle-mounted system further includes a display module that is communicatively connected to the control module. After executing the step of determining an input mode according to the voice content input instruction if a voice content input instruction is detected, the detection unit 701 is further configured to:

[0069] If the input method is a text input method, then obtain the second text data collected by the display module; determine whether a dialect input instruction is detected to obtain a second judgment result; if the second judgment result is yes, obtain the dialect type according to the dialect input instruction; obtain the second voice data corresponding to the second text data from a preset dialect database according to the dialect type; establish a second association relationship between the second voice data and the second text data; store the second voice data, the second text data and the second association relationship in the voice data packet.

[0070] It should be noted that technical personnel in the relevant field can clearly understand that the specific implementation process of the above-mentioned voice interaction device and each unit for the vehicle-mounted system can refer to the corresponding description in the aforementioned method embodiment, and for the convenience and conciseness of the description, it will not be repeated here.

[0071] The above-mentioned voice interaction device for the vehicle-mounted system can be implemented in the form of a computer program. The computer program can be used in Figure 3 Runs on the computer device shown.

[0072] See also Figure 3 , Figure 3 800 is a schematic block diagram of an electronic device provided by an embodiment of the present invention. The computer device 800 may be a terminal or a server, wherein the terminal may be an electronic device with a communication function. The server may be an independent server or a server cluster composed of multiple servers.

[0073] See also Figure 3 The electronic device 800 includes a processor 802 , a memory and a network interface 805 connected via a system bus 801 , wherein the memory may include a non-volatile storage medium 803 and an internal memory 804 .

[0074] The non-volatile storage medium 803 can store an operating system 8031 ​​and a computer program 8032. The computer program 8032 includes program instructions, and when the program instructions are executed, the processor 802 can execute a voice interaction method for a vehicle-mounted system.

[0075] The processor 802 is used to provide computing and control capabilities to support the operation of the entire electronic device 800 .

[0076] The internal memory 804 provides an environment for the operation of the computer program 8032 in the non-volatile storage medium 803. When the computer program 8032 is executed by the processor 802, the processor 802 can execute a voice interaction method for a vehicle-mounted system.

[0077] The network interface 805 is used to communicate with other devices over the network. Figure 3 The structure shown in the figure is merely a block diagram of a partial structure related to the solution of the present invention, and does not constitute a limitation on the electronic device 800 to which the solution of the present invention is applied. The specific electronic device 800 may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0078] The processor 802 is used to run the computer program 8032 stored in the memory to implement the following steps:

[0079] If a voice interaction instruction is detected, target voice data is obtained from a preset voice data packet according to the voice interaction instruction; whether a first voice interaction condition is met is determined based on the acquired vehicle driving status information; if met, a corresponding audio playback instruction is generated based on a preset voice interaction strategy and the target voice data; the audio playback instruction is sent to the speaker module so that the speaker module plays audio according to the audio playback instruction.

[0080] In some embodiments, the vehicle-mounted system further includes a navigation module that is in communication connection with the control module. After the processor 802 implements the step of acquiring target voice data from a preset voice data packet according to the voice interaction instruction, the processor 802 further implements the following steps:

[0081] Determine whether the second voice interaction condition is met based on the lane information collected by the navigation module; if so, execute the step of determining whether the first voice interaction condition is met based on the acquired vehicle driving status information; if not, prompt the user that the voice interaction fails.

[0082] In some embodiments, when the processor 802 implements the step of determining whether the first voice interaction condition is met according to the acquired vehicle driving state information, the processor 802 specifically implements the following steps:

[0083] The current driving speed of the vehicle is obtained according to the vehicle driving status information; whether the current driving speed of the vehicle is less than the set value in the first voice interaction condition is determined to obtain a speed judgment result; if the speed judgment result is yes, it is determined that the first voice interaction condition is met.

[0084] In some embodiments, when the processor 802 implements the step of generating a corresponding audio playback instruction according to a preset voice interaction strategy and the target voice data, the processor 802 specifically implements the following steps:

[0085] Determine whether the volume adaptation function is turned on to obtain a first judgment result; if the first judgment result is no, generate a corresponding audio playback instruction according to the set playback volume in the voice interaction strategy and the target voice data.

[0086] In some embodiments, the vehicle-mounted system further includes a sound receiving module and a camera module that are in communication connection with the control module. After the processor 802 determines whether the volume adaptation function is turned on and obtains the first determination result, it further implements the following steps:

[0087] If the first judgment result is yes, the decibel value collected by the sound receiving module is obtained; the distance information from the target object is obtained according to the image data collected by the camera module; the playback volume associated with the decibel value and the distance information is obtained according to the volume adjustment instruction table in the voice interaction strategy; and a corresponding audio playback instruction is generated according to the playback volume and the target voice data.

[0088] In some embodiments, before implementing the step of acquiring target voice data from a preset voice data packet according to the voice interaction instruction if a voice interaction instruction is detected, the processor 802 further implements the following steps:

[0089] If a voice content entry instruction is detected, the entry method is determined according to the voice content entry instruction; if the entry method is a voice entry method, the sound receiving module is started to obtain first voice data; the first voice data is converted into first text data, and a first association relationship between the first voice data and the first text data is established; the first voice data, the first text data and the first association relationship are stored in the voice data packet.

[0090] In some embodiments, the vehicle-mounted system further includes a display module that is communicatively connected to the control module. After the processor 802 implements the step of determining the input mode according to the voice content input instruction if a voice content input instruction is detected, the processor 802 further implements the following steps:

[0091] If the input method is a text input method, then obtain the second text data collected by the display module; determine whether a dialect input instruction is detected to obtain a second judgment result; if the second judgment result is yes, obtain the dialect type according to the dialect input instruction; obtain the second voice data corresponding to the second text data from a preset dialect database according to the dialect type; establish a second association relationship between the second voice data and the second text data; store the second voice data, the second text data and the second association relationship in the voice data packet.

[0092] It should be understood that in the embodiment of the present invention, the processor 802 may be a central processing unit (CPU), and the processor 802 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0093] It can be understood by those skilled in the art that all or part of the processes in the method for implementing the above embodiment can be completed by instructing the relevant hardware through a computer program. The computer program includes program instructions, and the computer program can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the process steps of the embodiment of the above method.

[0094] Therefore, the present invention also provides a storage medium. The storage medium may be a computer-readable storage medium. The storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed by a processor, the processor executes the following steps:

[0095] If a voice interaction instruction is detected, target voice data is obtained from a preset voice data packet according to the voice interaction instruction; whether a first voice interaction condition is met is determined based on the acquired vehicle driving status information; if met, a corresponding audio playback instruction is generated based on a preset voice interaction strategy and the target voice data; the audio playback instruction is sent to the speaker module so that the speaker module plays audio according to the audio playback instruction.

[0096] In one embodiment, the vehicle-mounted system further includes a navigation module that is communicatively connected to the control module, and after the processor executes the program instructions to implement the step of acquiring target voice data from a preset voice data packet according to the voice interaction instruction, the processor further implements the following steps:

[0097] Determine whether the second voice interaction condition is met based on the lane information collected by the navigation module; if so, execute the step of determining whether the first voice interaction condition is met based on the acquired vehicle driving status information; if not, prompt the user that the voice interaction fails.

[0098] In one embodiment, when the processor executes the program instructions to implement the step of determining whether the first voice interaction condition is met according to the acquired vehicle driving state information, the processor specifically implements the following steps:

[0099] The current driving speed of the vehicle is obtained according to the vehicle driving status information; whether the current driving speed of the vehicle is less than the set value in the first voice interaction condition is determined to obtain a speed judgment result; if the speed judgment result is yes, it is determined that the first voice interaction condition is met.

[0100] In one embodiment, when the processor executes the program instructions to implement the step of generating a corresponding audio playback instruction according to a preset voice interaction strategy and the target voice data, the processor specifically implements the following steps:

[0101] Determine whether the volume adaptation function is turned on to obtain a first judgment result; if the first judgment result is no, generate a corresponding audio playback instruction according to the set playback volume in the voice interaction strategy and the target voice data.

[0102] In one embodiment, the vehicle-mounted system further includes a sound receiving module and a camera module that are communicatively connected to the control module. After the processor executes the program instructions to determine whether the volume adaptation function is turned on and obtains the first determination result step, the processor further implements the following steps:

[0103] If the first judgment result is yes, the decibel value collected by the sound receiving module is obtained; the distance information from the target object is obtained according to the image data collected by the camera module; the playback volume associated with the decibel value and the distance information is obtained according to the volume adjustment instruction table in the voice interaction strategy; and a corresponding audio playback instruction is generated according to the playback volume and the target voice data.

[0104] In one embodiment, before the processor executes the program instructions to implement the step of acquiring target voice data from a preset voice data packet according to the voice interaction instruction if a voice interaction instruction is detected, the processor further implements the following steps:

[0105] If a voice content entry instruction is detected, the entry method is determined according to the voice content entry instruction; if the entry method is a voice entry method, the sound receiving module is started to obtain first voice data; the first voice data is converted into first text data, and a first association relationship between the first voice data and the first text data is established; the first voice data, the first text data and the first association relationship are stored in the voice data packet.

[0106] In one embodiment, the vehicle-mounted system further includes a display module that is communicatively connected to the control module. After the processor executes the program instructions to implement the step of determining an input mode according to the voice content input instruction if a voice content input instruction is detected, the processor further implements the following steps:

[0107] If the input method is a text input method, then obtain the second text data collected by the display module; determine whether a dialect input instruction is detected to obtain a second judgment result; if the second judgment result is yes, obtain the dialect type according to the dialect input instruction; obtain the second voice data corresponding to the second text data from a preset dialect database according to the dialect type; establish a second association relationship between the second voice data and the second text data; store the second voice data, the second text data and the second association relationship in the voice data packet.

[0108] The storage medium may be a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk, etc., which are computer-readable storage media that can store program codes.

[0109] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0110] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of each unit is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0111] The steps in the method of the embodiment of the present invention can be adjusted in order, combined and deleted according to actual needs. The units in the device of the embodiment of the present invention can be combined, divided and deleted according to actual needs. In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0112] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, terminal, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention.

[0113] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A voice interaction method for a vehicle-mounted system, characterized in that: The method is applied to a control module of a vehicle-mounted system, wherein the vehicle-mounted system further comprises a speaker module in communication connection with the control module, and the method comprises: If a voice interaction instruction is detected, obtaining target voice data from a preset voice data packet according to the voice interaction instruction; Determining whether a first voice interaction condition is met according to the acquired vehicle driving state information; If satisfied, then generate a corresponding audio playback instruction according to the preset voice interaction strategy and the target voice data; The audio playing instruction is sent to the speaker module, so that the speaker module plays the audio according to the audio playing instruction.

2. The voice interaction method for an in-vehicle system according to claim 1, characterized in that: The vehicle-mounted system further includes a navigation module that is in communication connection with the control module. After acquiring the target voice data from the preset voice data packet according to the voice interaction instruction, the system further includes: determining whether a second voice interaction condition is met according to the lane information collected by the navigation module; If so, executing the step of determining whether the first voice interaction condition is met according to the acquired vehicle driving state information; If not satisfied, the user will be prompted that the voice interaction has failed.

3. The voice interaction method for an in-vehicle system according to claim 1 or 2, characterized in that: The determining whether the first voice interaction condition is met according to the acquired vehicle driving state information includes: Acquiring the current driving speed of the vehicle according to the vehicle driving state information; Determine whether the current driving speed of the vehicle is less than a set value in the first voice interaction condition, and obtain a speed determination result; If the speed judgment result is yes, it is determined that the first voice interaction condition is met.

4. The voice interaction method for an in-vehicle system according to claim 1, characterized in that: The generating a corresponding audio playback instruction according to the preset voice interaction strategy and the target voice data includes: Determine whether the volume adaptive function is turned on, and obtain a first determination result; If the first judgment result is no, a corresponding audio playback instruction is generated according to the set playback volume in the voice interaction strategy and the target voice data.

5. The voice interaction method for an in-vehicle system according to claim 4, characterized in that: The vehicle-mounted system further includes a sound receiving module and a camera module which are in communication connection with the control module. After determining whether the volume self-adaptation function is turned on and obtaining a first determination result, the system further includes: If the first judgment result is yes, obtaining the decibel value collected by the sound receiving module; Acquire distance information to a target object based on image data collected by the camera module; Acquire a playback volume associated with the decibel value and the distance information according to a volume adjustment indication table in the voice interaction strategy; Generate a corresponding audio playback instruction according to the playback volume and the target voice data.

6. The voice interaction method for an in-vehicle system according to claim 5, characterized in that: If a voice interaction instruction is detected, before obtaining target voice data from a preset voice data packet according to the voice interaction instruction, the method further includes: If a voice content input instruction is detected, determining an input mode according to the voice content input instruction; If the recording mode is a voice recording mode, starting the sound receiving module to obtain the first voice data; Converting the first voice data into first text data, and establishing a first association relationship between the first voice data and the first text data; The first voice data, the first text data and the first association relationship are stored in the voice data packet.

7. The voice interaction method for an in-vehicle system according to claim 6, characterized in that: The vehicle-mounted system further includes a display module that is in communication connection with the control module. If a voice content input instruction is detected, after determining the input mode according to the voice content input instruction, the system further includes: If the input mode is a text input mode, obtaining the second text data collected by the display module; Determine whether a dialect input instruction is detected, and obtain a second determination result; If the second judgment result is yes, obtaining the dialect type according to the dialect input instruction; Acquiring second voice data corresponding to the second text data from a preset dialect database according to the dialect type; Establishing a second association relationship between the second voice data and the second text data; The second voice data, the second text data and the second association relationship are stored in the voice data packet.

8. A voice interaction device for a vehicle-mounted system, characterized in that: The device is configured in a control module of a vehicle-mounted system, and the vehicle-mounted system further comprises a speaker module that is communicatively connected to the control module. The device comprises: A detection unit, configured to obtain target voice data from a preset voice data packet according to the voice interaction instruction if a voice interaction instruction is detected; A judgment unit, configured to judge whether a first voice interaction condition is met according to the acquired vehicle driving state information; A generating unit, configured to generate a corresponding audio playback instruction according to a preset voice interaction strategy and the target voice data if the conditions are met; The playing unit is used to send the audio playing instruction to the speaker module so that the speaker module plays the audio according to the audio playing instruction.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the voice interaction method for a vehicle-mounted system as described in any one of claims 1-7 is implemented.

10. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, which includes program instructions. When the program instructions are executed by a processor, the processor executes the voice interaction method for an in-vehicle system as described in any one of claims 1 to 7.

Citation Information

Cited By

  • In-vehicle voice interaction method, system and device, storage medium and program product

    CN121708893A