Voice interaction method and system of vehicle, electronic device and storage medium
By automatically activating the voice interaction function and generating prompts based on the vehicle's status, the problem of users finding it difficult to accept vehicle voice operation is solved, thus improving user experience and convenience.
Patent Information
- Application Number
- CN202110342718.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-30
- Publication Date
- 2026-02-13
- Estimated Expiration
- 2041-03-30
AI Technical Summary
The voice operation function in vehicles in the current technology is difficult for users to accept and is inconvenient for users to use.
By acquiring the current vehicle status, the voice interaction function is automatically activated, and prompts are generated to remind the user to issue voice operation commands. These prompts include vehicle status such as the distance between the user and the device, location, environmental status, device operating status, and driving status. The system uses sensors to detect the vehicle status and generate corresponding voice or image prompts.
Without requiring users to activate the voice interaction function, the system automatically prompts users to use voice operations based on the vehicle's status, improving user experience and ease of interaction, and increasing user acceptance of the voice function.
Smart Images

Figure CN115148200B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of artificial intelligence, in particular to a voice interaction method and system for a vehicle, an electronic device and a storage medium. BACKGROUND
[0002] With the popularization of AI (artificial intelligence), more and more functions can be completed using voice, but most users do not know how to use voice, so it is necessary to guide users to use.
[0003] However, the existing way of guiding users is often too rigid, and the voice interaction function generally needs to be started through a passive way, such as after the voice interaction function is awakened by a preset voice command, the voice function can be used, such as in a specific scenario, the user needs to issue a "Hi, Xiaodu" instruction through voice, and the corresponding voice interaction function can be used.
[0004] In addition, most users are conservative and are more accustomed to traditional operations with hands than voice, so even if there is a voice interaction function in the prior art, such a function is still difficult for users to accept and is not convenient for users to use. SUMMARY
[0005] The technical problem to be solved by the embodiments of the present disclosure is to overcome the defects that the voice operation function in the vehicle in the prior art is difficult for users to accept and is not convenient for users to use, and to provide a voice interaction method and system for a vehicle, an electronic device and a storage medium which are easy for users to accept and convenient for users to use and can actively start the voice interaction function of the vehicle.
[0006] The embodiments of the present disclosure solve the above technical problems by the following technical solutions:
[0007] The first aspect of the present disclosure provides a voice interaction method for a vehicle, the voice interaction method comprising:
[0008] obtaining a current vehicle state;
[0009] starting a voice interaction function of the vehicle according to the current vehicle state, and generating corresponding prompt information, the prompt information being used to remind a user to issue a voice operation instruction.
[0010] The second aspect of the present disclosure provides a voice interaction system for a vehicle, the voice interaction system comprising: a vehicle state obtaining module, a voice interaction starting module and a prompt information generating module;
[0011] The vehicle state obtaining module is configured to obtain a current vehicle state;
[0012] The voice interaction starting module is configured to start a voice interaction function of the vehicle according to the current vehicle state;
[0013] The prompt information generation module is configured to generate corresponding prompt information for reminding the user to issue a voice operation instruction for operating the vehicle device.
[0014] The third aspect of the present disclosure provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the voice interaction method of the vehicle.
[0015] The fourth aspect of the present disclosure provides a computer readable storage medium, which stores a computer program, wherein the computer program is executed by a processor to implement the steps of the voice interaction method of the vehicle.
[0016] The positive progress effect of the embodiment of the present disclosure is that the voice interaction function of the vehicle is automatically started according to the current vehicle state, so that corresponding prompt information can be generated to remind the user to use the voice interaction function in the vehicle. The voice interaction function of the vehicle does not need to be woken up by the user, and can be actively started. The user is automatically reminded to use the voice operation function according to the current vehicle state, which can recommend and guide the user to use the voice at a good opportunity, increase the interaction degree between the user and the voice system in the vehicle, and further improve the user experience. BRIEF DESCRIPTION OF DRAWINGS
[0017] Figure 1 The flowchart of the voice interaction method of the vehicle of the first embodiment of the present disclosure.
[0018] Figure 2 The module schematic diagram of the voice interaction system of the vehicle of the second embodiment of the present disclosure.
[0019] Figure 3 The module schematic diagram of the electronic device of the third embodiment of the present disclosure. DETAILED DESCRIPTION
[0020] The present disclosure will be further described by way of examples, but the present disclosure is not limited in the scope of the examples.
[0021] Embodiment 1
[0022] The present embodiment provides a voice interaction method of a vehicle, as shown in the figure, the voice interaction method comprises: Figure 1 The voice interaction method comprises:
[0023] Step 101, obtaining the current vehicle state.
[0024] Step 102, starting the voice interaction function of the vehicle according to the current vehicle state, and generating corresponding prompt information.
[0025] The prompts are used to remind users to issue voice commands.
[0026] In this embodiment, the prompts can be either voice prompts or image prompts. The prompts can remind the user of the specific vehicle equipment that needs to be operated; they can also directly remind the user to issue voice control commands to operate the corresponding vehicle equipment; or they can serve as an intuitive prompt of the current vehicle status, that is, to inform the user that the vehicle has voice interaction capabilities through intuitive prompts. The user can recall the vehicle's voice interaction capabilities through intuitive prompts and thus use the vehicle's functions through voice commands.
[0027] The vehicle status includes at least one of the following: distance between the user and the target vehicle device, user location, vehicle environmental status, vehicle device operating status, and vehicle driving status.
[0028] Specifically, step 102 may include:
[0029] If the distance between the user and the target vehicle device is less than a preset distance, or if the user's location is at a preset location, a prompt message is generated to remind the user that the vehicle has voice interaction capabilities.
[0030] In one specific scenario, the prompt message used to remind the user that the vehicle has voice interaction capabilities can be a voice guidance prompt. When the user approaches the target vehicle device or is in a preset location, it indicates that the user is highly likely to want to use the vehicle. Therefore, a voice guidance prompt can be used to remind the user that the vehicle has voice interaction capabilities. The prompt content can include commonly used vehicle functions such as navigation, music, radio, air conditioning, and applications, as well as some functions or applications that are not displayed or announced. For example, it can also include "other" functions, which the user can view or listen to using voice commands.
[0031] The target vehicle equipment can be selected according to actual needs, such as an in-vehicle display screen, steering wheel, windows, etc. Specifically, a position sensor can be installed on the target vehicle equipment to determine whether the distance between the user and the device is less than a preset distance. Different preset distances can be set according to different vehicle models. It should be understood that in order to avoid users accidentally triggering the voice interaction function, the preset distance cannot be set too large. In a specific scenario, the preset distance is less than or equal to 20cm.
[0032] Similarly, preset locations can be set according to actual needs, such as the driver's seat, the front passenger seat, etc. Specifically, the in-vehicle camera can be used to identify whether a passenger is present at the preset location. If so, the user's location is considered to be at the preset location.
[0033] In this embodiment, when the distance between the user and the target vehicle device is less than the preset distance or the user position is located at the preset position, the voice interaction function of the vehicle can be automatically started, and prompt information reminding the user that the vehicle has a voice interaction function is generated. In this way, the user does not need to manually send or send a preset wake-up instruction to wake up the voice interaction function, and the voice interaction function can be automatically started, improving the convenience of using the voice interaction function and improving the user experience.
[0034] Step 102 can also include:
[0035] If the vehicle environment state is consistent with the first preset environment, prompt information for reminding the user to send the operation corresponding to the vehicle device is generated.
[0036] The vehicle environment and the corresponding first preset environment can be selected according to actual needs, such as vehicle temperature, vehicle humidity, vehicle illumination, sunlight intensity, etc. Specifically, the detection of the vehicle environment can be completed by corresponding sensors, such as detecting the sunlight intensity by a photosensitive sensor, detecting the vehicle temperature by a temperature sensor, and detecting the vehicle humidity by a humidity sensor.
[0037] In a specific case, when the vehicle temperature is lower than the low temperature threshold, the prompt information is generated, which is used to remind the user to issue a control instruction to open the heating device through voice interaction;
[0038] When the vehicle temperature is higher than the high temperature threshold, the prompt information is generated, which is used to remind the user to issue a control instruction to open the cooling device through voice interaction;
[0039] When the vehicle humidity is less than the preset humidity, the prompt information is generated, which is used to remind the user to issue a control instruction to open the humidifying device through voice interaction;
[0040] When the vehicle illumination is less than the preset illumination, the prompt information is generated, which is used to remind the user to issue a control instruction to open the lighting device through voice interaction; when the photosensitive sensor near the vehicle display screen or the vehicle window detects that the current light intensity exceeds the light threshold, the prompt information is generated, which is used to remind the user to issue a control instruction to open the light shielding device through voice interaction.
[0041] Step 102 can also include:
[0042] If the vehicle device running state is consistent with the preset device state, the prompt information for reminding the user to issue a voice operation instruction to operate the vehicle device is generated.
[0043] The vehicle device and the corresponding vehicle device running state can be selected according to actual conditions. In a specific embodiment, the vehicle device running state includes a vehicle audio device running state. When the vehicle audio device running state is a "singing" state, a prompt that a song is being listened to is given. The prompt information can be used as a prompt for prompting the user that the vehicle has a voice interaction function. The user can be more interested in voice interaction operations, such as issuing a song cutting, song searching, volume adjusting, and the like.
[0044] Step 102 can also include generating prompt information for reminding the user to issue a voice operation instruction for operating the vehicle device if the vehicle running state is consistent with the preset running state.
[0045] In a specific embodiment, the vehicle running state includes a change rate of acceleration. If the vehicle running state is consistent with the preset running state, the step of generating prompt information for reminding the user to issue a voice operation instruction for operating the corresponding vehicle device includes:
[0046] If the change rate of acceleration is higher than a first change threshold, prompt information for reminding the user to issue a voice operation instruction for deceleration driving is generated. If the change rate of acceleration is higher than a second change threshold, prompt information for reminding the user to issue a voice operation instruction for alarming is generated. If the change rate of acceleration is higher than a third change threshold, the terminal device is triggered to automatically alarm and notification information for reminding the user that the alarm state is generated.
[0047] The change rate of acceleration can reflect whether the current road of the vehicle is bumpy. Specifically, the acceleration of the X, Y, and Z axes of the vehicle controller installed on the vehicle by default can be recorded. The default vehicle controller is horizontally placed, the X axis is the vertical direction, the Y axis is the horizontal direction, and the Z axis is the front-back direction (it should be understood that when the vehicle controller is in a vertical screen, the X axis is the horizontal direction, the Y axis is the vertical direction, and the Z axis is the front-back direction). The acceleration is updated once every 60 m / s.
[0048] In a specific scenario: if the acceleration in the vertical direction changes by more than 2 m / s 2 is considered to be moving, and the acceleration is greater than 5 m / s 2 is considered to be a high degree of bumpy, and the user is prompted to issue a control instruction for deceleration driving. The acceleration is greater than or equal to 9.8 m / s 2 is considered to be a weightless state, and the user is prompted to issue a control instruction for alarming. If the weightlessness lasts for 5 consecutive frequencies, an emergency rescue / automatic alarm mode is started, that is, the terminal device is triggered to automatically alarm and notification information for reminding the user that the alarm state is generated.
[0049] Similarly, in another specific scenario: if the acceleration change in the front-rear direction is greater than a first change threshold, it is considered that the user's current driving speed is too fast, and a control instruction for prompting the user to issue a deceleration driving is generated; when the acceleration change in the front-rear direction is greater than a second change threshold, it indicates that the current vehicle may lose control to some extent, and a control instruction for prompting the user to issue an alarm is generated; when the acceleration change in the front-rear direction is greater than a third change threshold, it indicates that the current vehicle has lost control, and the terminal device automatically alarms and generates notification information for reminding the user that the vehicle has been alarmed.
[0050] Further, in another specific scenario: if the acceleration change in the horizontal direction is not located in a preset interval, it indicates that the vehicle has a risk of overturning, and therefore, the terminal device can also generate prompt information for prompting the user that the vehicle has a risk of overturning.
[0051] In the embodiments of the present disclosure, unlike the way of rigidly guiding the user to use the vehicle voice interaction function in the prior art, the embodiments can generate prompt information for prompting the user to issue a voice operation instruction according to the current vehicle state, and in this prompt manner, it is more convenient for the user to change from being accustomed to manual operation to being accustomed to voice operation.
[0052] In a specific embodiment, the voice interaction method in the embodiments further includes:
[0053] Step 103, generating a prompt identifier for representing the prompt information.
[0054] The prompt identifier has different display states, and different display states correspond to different prompt information.
[0055] Step 104, displaying the display state of the prompt identifier corresponding to the prompt information.
[0056] In a specific embodiment, the prompt identifier is a preset cartoon image, so that some emotional exchanges can be established between the preset cartoon image and the user.
[0057] Specifically, when the user approaches the target vehicle device or the user is located at a preset position, the cartoon image enters a "cute" state; when the user is driving, the sunlight is good, and the window or the vehicle display screen is irradiated by strong sunlight, the cartoon image enters a "wearing sunglasses" state; when the temperature in the vehicle is too high, the cartoon image enters a "sweating" state, if the air conditioner is turned on for cooling at this time, the cartoon image enters a "cooling" state; if the user is listening to songs, the cartoon image enters a "listening to songs" state; when the road is bumpy, the cartoon image will enter a "left / right / up / down bumpy" state synchronously with the degree of bumpy; when the user is driving, vertical motion occurs, and the amplitude is small (for example, the downhill speed is too fast, the vehicle is off the ground for a short time, and the road is severely bumpy), the vehicle is off the ground, and the cartoon image enters a "flying up and scared" state, and the cartoon image enters a "butt landing" state when the vehicle lands.
[0058] In the embodiment, the prompt identifier representing the prompt information is displayed, and the prompt identifier in different display states is displayed according to different prompt information, so that the voice interaction function of the vehicle is more humanized, the user is more easy to receive and use the voice interaction function, and the convenience of use of the user is further improved.
[0059] In order to better understand the embodiment, the embodiment is described below through three specific scenes:
[0060] Scene one: when the position sensor detects that the user approaches the screen, the voice interaction function of the vehicle is started, and prompt information for reminding the user that the vehicle has a voice interaction function is generated, this scene shows that the user is more likely to use the vehicle, the cartoon image enters a "cute" state, and the user is prompted that some abilities can be controlled by voice, mainly including commonly used (navigation, music, radio, air conditioner, etc., and some applications not displayed on the screen, the screen display is limited, and the user can be further prompted which functions can be used.
[0061] Scene two: when the user is driving, the sunlight is good, when the light sensor detects that the light reaches a preset value, it indicates that the screen is irradiated by strong sunlight, the cartoon image enters a "wearing sunglasses" state, when the temperature sensor detects that the temperature in the vehicle is too high, the cartoon image enters a "sweating" state, if the air conditioner is turned on for cooling at this time, the cartoon image enters a "cooling" state, if the user is listening to songs, the cartoon image enters a "listening to songs" state, when the direction sensor detects that the road is bumpy, the cartoon image will enter a "left / right / up / down bumpy" state synchronously with the degree of bumpy, and the user is prompted to drive carefully.
[0062] Scene three: when the user is driving, if the vertical motion is detected by the acceleration sensor, if the amplitude is small (such as downhill speed is too fast, short time car off the ground, and the road is bumpy), the car leaves the ground, the cartoon image enters a "fly up and scared" state, the car falls to the ground, the cartoon image enters a "butt falls to the ground" state, and the voice broadcast reminds the user to drive at a slow speed. If the gravity sensor is severely abnormal (falling) and the direction sensor is reversed by more than 45 degrees, the user will be reminded three times whether to call the police and dial the emergency number, and if there is no answer after three inquiries, the police and emergency number will be automatically dialed (the voice intelligence will automatically say the location of the accident).
[0063] Embodiment 2
[0064] The embodiment provides a voice interaction system of a vehicle, as shown in the figure, the voice interaction system comprises a vehicle state acquisition module 201, a voice interaction starting module 202 and a prompt information generation module 203. Figure 2
[0065] The vehicle state acquisition module 201 is used for acquiring a current vehicle state;
[0066] The voice interaction starting module 202 is used for starting a voice interaction function of the vehicle according to the current vehicle state;
[0067] The prompt information generation module 203 is used for generating corresponding prompt information, and the prompt information is used for reminding a user to send a voice operation instruction for operating a vehicle device.
[0068] The prompt information is used for reminding the user to send the voice operation instruction.
[0069] The prompt information in the embodiment can be voice prompt information or image prompt information, and the prompt information can remind the user of a specific vehicle device to be operated, directly remind the user to send a voice control instruction for operating a corresponding vehicle device, or directly remind the user of a current vehicle state, that is, remind the user of the voice interaction function of the vehicle through an intuitive prompt mode, so that the user can use the function of the vehicle through the voice instruction mode.
[0070] The vehicle state at least comprises at least one of a distance between the user and a target vehicle device, a user position, a vehicle environment state, a vehicle device running state and a vehicle driving state.
[0071] Specifically, the prompt information generation module 203 can be used for:
[0072] If the distance between the user and the target vehicle device is less than a preset distance, or the user position is located at a preset position, prompt information for reminding the user that the vehicle has a voice interaction function is generated.
[0073] In a specific case, the prompt information for reminding the user that the vehicle has a voice interaction function can be a voice guidance prompt. When the user approaches the target vehicle device or the user is located at the preset position, it is indicated that the user is likely to use the vehicle, and therefore, the user can be reminded that the vehicle has a voice interaction function through the voice guidance prompt. The content of the prompt can include commonly used functions of the vehicle, such as navigation, music, radio, air conditioning, applications, etc., and can also include some functions or applications that are not displayed or broadcast, such as "other" functions. The user can continue to view or listen to the specific content of the "other" functions through voice instructions.
[0074] The target vehicle device can be selected according to actual needs, such as a vehicle display screen, a steering wheel, a vehicle window, etc. Specifically, a position sensor can be installed on the target vehicle device to determine whether the distance between the user and the target vehicle device is less than a preset distance. Different preset distances can be set according to different vehicle models. It should be understood that, in order to avoid the user triggering the voice interaction function by mistake, the preset distance cannot be set too large. In a specific scenario, the preset distance is less than or equal to 20 cm.
[0075] Similarly, the preset position can also be set according to actual needs, such as the driver's seat, the front passenger seat, etc. Specifically, a camera in the vehicle can be used to identify whether a passenger is present at the preset position. If so, it is considered that the user position is located at the preset position.
[0076] In the embodiment, the voice interaction starting module 202 can automatically start the voice interaction function of the vehicle when it is detected that the distance between the user and the target vehicle device is less than a preset distance or the user position is located at a preset position. The prompt information generation module 203 is configured to generate prompt information for reminding the user that the vehicle has a voice interaction function. In this way, the user does not need to manually send or send a preset wake-up instruction to wake up the voice interaction function. The voice interaction function can be automatically started, which improves the convenience of using the voice interaction function and improves the user experience.
[0077] The prompt information generation module 203 can also be configured to generate prompt information for reminding the vehicle device corresponding to the sending operation if the vehicle environment state is consistent with a first preset environment.
[0078] The vehicle environment and the corresponding first preset environment can be selected according to actual needs. For example, the vehicle environment can include the temperature in the vehicle, the humidity in the vehicle, the illumination in the vehicle, the sunlight intensity, and the like. Specifically, the detection of the vehicle environment can be completed by corresponding sensors. For example, the sunlight intensity can be detected by a photosensitive sensor, the temperature in the vehicle can be detected by a temperature sensor, and the humidity in the vehicle can be detected by a humidity sensor.
[0079] In a specific case, when the temperature in the vehicle is lower than the low-temperature threshold, a prompt information is generated, which is used to remind the user to issue a control instruction for turning on the heating device through voice interaction.
[0080] When the temperature in the vehicle is higher than the high-temperature threshold, a prompt information is generated, which is used to remind the user to issue a control instruction for turning on the cooling device through voice interaction.
[0081] When the humidity in the vehicle is less than the preset humidity, a prompt information is generated, which is used to remind the user to issue a control instruction for turning on the humidifying device through voice interaction.
[0082] When the illumination in the vehicle is less than the preset illumination, a prompt information is generated, which is used to remind the user to issue a control instruction for turning on the lighting device through voice interaction. When the photosensitive sensor near the vehicle display screen or the vehicle window detects that the current light intensity exceeds the light threshold, a prompt information is generated, which is used to remind the user to issue a control instruction for turning on the light-shielding device through voice interaction.
[0083] The prompt information generation module 203 can also be used to generate a prompt information for reminding the user to issue a voice operation instruction for operating the vehicle device if the vehicle device running state is consistent with the preset device state.
[0084] The vehicle device and the corresponding vehicle device running state can be selected according to actual conditions. In a specific embodiment, the vehicle device running state includes the vehicle audio device running state. When the vehicle audio device running state is in the “listening to songs” state, a prompt information is generated, which is used to remind the user that the songs are being listened to. The prompt information can be used as a prompt for reminding the user that the vehicle has a voice interaction function, so that the user can be more interested in voice interaction operations, such as issuing a control instruction for cutting songs, searching songs, adjusting the volume, and the like.
[0085] The prompt information generation module 203 can also be used to
[0086] If the vehicle running state is consistent with the preset running state, a prompt information is generated, which is used to remind the user to issue a voice operation instruction for operating the vehicle device.
[0087] In a specific embodiment, the vehicle driving state includes a rate of change of acceleration, and the vehicle driving state is consistent with the preset driving state, and the step of generating prompt information for prompting the vehicle device corresponding to the reminding sending operation includes:
[0088] If the rate of change of acceleration is higher than the first change threshold, the prompt information for prompting the user to issue a voice operation instruction for deceleration driving is generated; and / or, if the rate of change of acceleration is higher than the second change threshold, the prompt information for prompting the user to issue a voice operation instruction for alarm is generated; and / or, if the rate of change of acceleration is higher than the third change threshold, the terminal device is triggered to automatically alarm and the notification information for reminding the user of the state of having been alarmed is generated.
[0089] The rate of change of acceleration can reflect whether the current road of the vehicle is bumpy, and specifically, the acceleration of the default X, Y and Z axes of the vehicle controller installed on the vehicle can be recorded. The default vehicle controller is horizontally placed, the X axis is the vertical direction, the Y axis is the horizontal direction, and the Z axis is the front-back direction (it should be understood that when the vehicle controller is in a vertical screen, the X axis is the horizontal direction, the Y axis is the vertical direction, and the Z axis is the front-back direction). The acceleration is updated once every 60 m / s.
[0090] In a specific scenario: if the acceleration change in the vertical direction is greater than 2 m / s 2 It is considered to be moving, and the acceleration is greater than 5 m / s 2 It is considered that the degree of bumpy is high, and the user is prompted to issue a control instruction for deceleration driving; the acceleration is greater than or equal to 9.8 m / s 2 It is considered to be a weightless state, and the user is prompted to send a control instruction for alarm; if the weightlessness is continuous for 5 times, an emergency rescue / automatic alarm mode is started, that is, the terminal device is triggered to automatically alarm and the notification information for reminding the user of the state of having been alarmed is generated.
[0091] Similarly, in another specific scenario: if the acceleration change in the front-back direction is greater than the first change threshold, it is considered that the current driving speed of the user is too fast, and a control instruction for prompting the user to issue a control instruction for deceleration driving is generated; when the acceleration change in the front-back direction is greater than the second change threshold, it is considered that the current vehicle may lose control to a certain extent, and a control instruction for prompting the user to issue an alarm is generated; when the acceleration change in the front-back direction is greater than the third change threshold, it is considered that the current vehicle has lost control, and the terminal device is triggered to automatically alarm and the notification information for reminding the user of the state of having been alarmed is generated.
[0092] Further, in another specific scenario: if the acceleration change in the horizontal direction is not in a preset interval, it is considered that the vehicle has a risk of overturning, and therefore, the user can be prompted with prompt information that the vehicle has a risk of overturning.
[0093] Unlike the way of stiffly guiding the user to use the vehicle voice interaction function in the prior art, the embodiment can automatically generate prompt information for reminding the user to send a voice operation instruction according to a current vehicle state, which is more convenient for the user to change from being used to manual operation to being used to voice operation.
[0094] In a specific implementation, the voice interaction system further includes an identification generation module 204 configured to generate a prompt identification for representing the prompt information, and the identification corresponds to different display states, and the different display states correspond to different prompt information.
[0095] The voice interaction system can further include a display module 205 configured to display a display state of the prompt identification corresponding to the prompt information.
[0096] In a specific implementation, the prompt identification is a preset cartoon image, so that some emotional communication can be established between the user and the preset cartoon image.
[0097] Specifically, when the user approaches the target vehicle device or the user is located at a preset position, the cartoon image enters a "cute" state; when the user is driving, the sunlight is good, and the vehicle window or the vehicle display screen is irradiated by strong sunlight, the cartoon image enters a "wearing sunglasses" state; when the temperature in the vehicle is too high, the cartoon image enters a "sweating" state, if the air conditioner is turned on for cooling at this time, the cartoon image enters a "cool" state; if the user is listening to songs, the cartoon image enters a "listening to songs" state; when the road is bumpy, the cartoon image enters a "left / right / up / down bumpy" state according to the degree of the bumpy; when the user is driving, vertical motion occurs, and the amplitude is small (for example, the speed of downhill is too fast, the vehicle is off the ground for a short time, and the road is severely bumpy), the vehicle is off the ground, and the cartoon image enters a "flying up and scared" state, and the cartoon image enters a "butt landing" state when the vehicle lands.
[0098] In the embodiment, the prompt identification representing the prompt information is displayed, and the prompt identification in different display states is displayed according to different prompt information, so that the voice interaction function of the vehicle is more humanized, the user is more likely to receive and use the voice interaction function, and the convenience of the user is further improved.
[0099] In order to better understand the embodiment, the embodiment is described below through three specific scenes:
[0100] Scene one: when the position sensor detects that the user is close to the screen, the voice interaction function of the vehicle is started, and prompt information for reminding the user that the vehicle has a voice interaction function is generated, this scene illustrates that the user is most likely to use the vehicle, the cartoon character enters a "cute" state, and prompts the user of some capabilities that can be controlled by voice, mainly including commonly used (navigation, music, radio, air conditioner, etc., and some applications that are not displayed on the screen, the screen display is limited, the user can be further prompted about which functions can be used.
[0101] Scene two: the user is driving, the sun is good, when the light sensor detects that the light reaches the preset value, it means that the screen is strongly illuminated by sunlight, the cartoon character enters a "wearing sunglasses" state, when the temperature sensor detects that the temperature in the car is too high, the cartoon character enters a "sweating" state, if the air conditioner is on at this time, the cartoon character enters a "cool" state, if the user is listening to music, the cartoon character enters a "listening to music" state, when the direction sensor detects that the road is bumpy, the cartoon character will enter a "left and right / up and down bumpy" state according to the degree of bumpy, and prompt the user to drive carefully.
[0102] Scene three: when the user is driving, if the acceleration sensor detects vertical motion, if the amplitude is small (such as downhill speed too fast, short time car off the ground, and road bumpy seriously), the car off the ground, the cartoon character enters a "flying up and scared" state, when the car lands, the cartoon character enters a "butt landing" state, and the voice broadcast reminds the user to drive at a slow speed. If the gravity sensor is seriously abnormal (falling) and the direction sensor is reversed by more than 45 degrees, the user will be prompted three times whether to call the police and dial the emergency number, and if there is no answer after three inquiries, the police and emergency number will be automatically dialed (the accident location will be automatically spoken by the voice intelligence).
[0103] Embodiment 3
[0104] The embodiment provides an electronic device which can be in the form of a computing device (for example, can be a server device) including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor can implement the voice interaction method in embodiment 1 when executing the computer program.
[0105] Figure 3 The hardware structure schematic diagram of the embodiment is shown in the figure, Figure 3 As shown in the figure, the electronic device 9 specifically includes:
[0106] At least one processor 91, at least one memory 92, and a bus 93 for connecting different system components (including the processor 91 and the memory 92), wherein:
[0107] Bus 93 includes a data bus, an address bus, and a control bus.
[0108] Memory 92 includes a volatile memory, such as random access memory (RAM) 921 and / or cache memory 922, and can further include a non-volatile memory, such as read-only memory (ROM) 923.
[0109] Memory 92 also includes a program / utility 925 having a set (at least one) of program modules 924, including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which can include implementations of networks environments, as described above, or some combination thereof.
[0110] Processor 91 executes the program modules 924 stored in memory 92, as well as one or more data storage programs to accomplish various functions, such as the voice interaction method of embodiment 1.
[0111] Electronic device 9 can further communicate with one or more external devices 94 such as a keyboard or a pointing device, among others. Such communication can occur through Input / Output (I / O) interface 95. Still yet, electronic device 9 can communicate with one or more networks, such as a local area network (LAN), a wide area network (WAN), and / or the Internet, through network adapter 96. Network adapter 96 can communicate with the other modules of electronic device 9 through bus 93. It should be appreciated that the network adapter 96 and / or the I / O interface 95 can be implemented by using other hardware and / or software modules. For example, the network adapter 96 can be implemented by using a wireless communication device, a modem, a network interface card, etc. As another example, the I / O interface 95 can be implemented by using a serial port, a parallel port, a game port, a keyboard port, etc.
[0112] It should be noted that although several units / modules or sub-units / modules of the electronic device are mentioned in the foregoing detailed description, such division is merely exemplary and not mandatory. Indeed, according to the embodiments of the present application, the features and functions of two or more units / modules described above can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided into a plurality of units / modules.
[0113] Embodiment 4
[0114] The embodiment provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to implement the steps of the voice interaction method of embodiment 1.
[0115] More specifically, the readable storage medium can include, but is not limited to, a portable disc, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0116] In a possible implementation, the application can also be implemented in the form of a program product, which includes program codes for causing the terminal device to perform the steps of the voice interaction method in embodiment 1 when the program product is run on the terminal device.
[0117] The program codes for executing the application can be written in any combination of one or more programming languages, and can be executed entirely on the user device, partly on the user device and partly on a remote device, as a stand-alone software package, partly on the user device and partly on a remote device, or entirely on a remote device.
[0118] Although the above describes specific implementations of the application, those skilled in the art should understand that this is only an example, and the protection scope of the application is defined by the appended claims. Those skilled in the art can make various changes or modifications to these implementations without departing from the principles and essence of the application, and such changes and modifications fall within the protection scope of the application.
Claims
1. A voice interaction method for a vehicle, characterized in that, The voice interaction method includes: Obtain the current vehicle status; the vehicle status includes the vehicle equipment operating status; the vehicle equipment operating status includes the in-vehicle audio equipment operating status; The vehicle's voice interaction function is activated based on the current vehicle status, and corresponding prompt information is generated. The prompt information is used to remind the user to issue voice operation commands. The content of the prompt information includes functions or applications that are not displayed or broadcast. Generate a preset cartoon character to represent the prompt information and establish emotional communication with the user. The preset cartoon character has different display states, and different display states correspond to different prompt information. Displays a preset cartoon character corresponding to the prompt message.
2. The voice interaction method for a vehicle as described in claim 1, wherein the vehicle state includes at least one of the following: the distance between the user and the target vehicle device, the user's location, the vehicle's environmental state, and the vehicle's driving state; The steps for generating the corresponding prompt information include: If the distance between the user and the target vehicle device is less than a preset distance, or the user's location is at a preset location, a prompt message is generated to remind the user that the vehicle has a voice interaction function; And / or, if the vehicle environment state is consistent with the preset environment, or the vehicle equipment operating state is consistent with the preset equipment state, or the vehicle driving state is consistent with the preset driving state, then a prompt message is generated to remind the user to issue a voice operation command to operate the corresponding vehicle equipment.
3. The vehicle voice interaction method as described in claim 2, wherein the vehicle driving state includes the rate of change of acceleration, and the vehicle driving state is consistent with a preset driving state, then the step of generating prompt information for reminding the vehicle device to send the operation includes: If the rate of change of the acceleration is higher than the first change threshold, a prompt message is generated to remind the user to issue a voice operation command to decelerate the driving. And / or, if the rate of change of the acceleration is higher than a second change threshold, a prompt message is generated to remind the user to issue an alarm via voice operation; and / or, if the rate of change of the acceleration is higher than a third change threshold, the terminal device is triggered to automatically alarm and a notification message is generated to remind the user that an alarm has been triggered.
4. A voice interaction system for a vehicle, characterized in that, The voice interaction system includes: a vehicle status acquisition module, a voice interaction activation module, and a prompt information generation module; The vehicle status acquisition module is used to acquire the current vehicle status; the vehicle status includes the vehicle equipment operating status; the vehicle equipment operating status includes the in-vehicle audio equipment operating status; The voice interaction activation module is used to activate the vehicle's voice interaction function according to the current vehicle status. The prompt information generation module is used to generate corresponding prompt information, which is used to remind the user to issue voice operation commands; the content of the prompt information includes functions or applications that are not displayed or broadcast. The voice interaction system also includes an identifier generation module, which generates a preset cartoon image that represents the prompt information and establishes emotional communication with the user. The preset cartoon image has different display states, and different display states correspond to different prompt information. The voice interaction system also includes a display module for displaying a preset cartoon image corresponding to the prompt information.
5. The vehicle voice interaction system as described in claim 4, wherein the vehicle status includes at least one of the following: the distance between the user and the target vehicle device, the user's location, the vehicle's environmental status, and the vehicle's driving status; The prompt message generation module is used for: If the distance between the user and the target vehicle device is less than a preset distance, or the user's location is at a preset location, a prompt message is generated to remind the user that the vehicle has a voice interaction function; And / or, if the vehicle environment state is consistent with the preset environment, or the vehicle equipment operating state is consistent with the preset equipment state, or the vehicle driving state is consistent with the preset driving state, then a prompt message is generated to remind the user to issue a voice operation command to operate the corresponding vehicle equipment.
6. The vehicle voice interaction system as described in claim 5, wherein the vehicle driving state includes the rate of change of acceleration, and the prompt information generation module is specifically used for: If the rate of change of acceleration is higher than a first change threshold, a prompt message is generated to remind the user to issue a voice operation command to decelerate the vehicle; and / or, if the rate of change of acceleration is higher than a second change threshold, a prompt message is generated to remind the user to issue an alarm command; and / or, if the rate of change of acceleration is higher than a third change threshold, the terminal device is triggered to automatically alarm and generate a notification message to remind the user that an alarm has been triggered.
7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the voice interaction method for the vehicle according to any one of claims 1 to 3.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the voice interaction method for the vehicle according to any one of claims 1 to 3.
Citation Information
Patent Citations
Voice wake-up method, device and system
CN109285547A
Driving behavior and vehicle driving posture identification system
CN109910904A