Intelligent voice interaction method, device, equipment and storage medium

Abstract

The present invention discloses an intelligent voice interaction method, device, equipment and storage medium, wherein the method comprises: determining the target working mode of the vehicle according to the sensor data detected by the sensor in the vehicle; determining the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant according to the target working mode and / or target scene; generating a dynamic intelligent image according to the target image parameters, the target action parameters and the target voice parameters; and interacting with the user based on the dynamic intelligent image. Through the above scheme, the interactivity between the user and the vehicle can be improved, the personalized needs of the user for the voice intelligent interaction mode can be met, and the user's vehicle use experience can be improved.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of intelligent vehicles, and in particular to an intelligent voice interaction method, device, equipment and storage medium. Background Art

[0002] With the development of artificial intelligence, voice intelligence is gradually applied to all aspects of life. At present, the voice intelligent interaction mode used in autonomous driving vehicles on the market is too single and cannot meet the personalized needs of users. Therefore, how to meet the personalized needs of users for voice intelligent interaction mode and improve the user's vehicle experience is a problem that needs to be solved. Summary of the invention

[0003] The present invention provides an intelligent voice interaction method, device, equipment and storage medium, which can improve the interactivity between users and vehicles, meet the user's personalized needs for voice intelligent interaction methods, and improve the user's vehicle use experience.

[0004] According to one aspect of the present invention, there is provided an intelligent voice interaction method, comprising:

[0005] Determine target image parameters, target action parameters, and target voice parameters of the intelligent voice assistant according to the target working mode and / or target scenario;

[0006] generating a dynamic intelligent image according to the target image parameter, the target action parameter and the target voice parameter;

[0007] Based on the dynamic intelligent image, interaction is performed with the user.

[0008] According to another aspect of the present invention, there is provided an intelligent voice interaction device, the device comprising:

[0009] A target operating mode determination module, used to determine a target operating mode of the vehicle according to sensor data detected by a sensor in the vehicle;

[0010] A parameter determination module, used to determine the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant according to the target working mode and / or target scene;

[0011] A dynamic intelligent image generation module, used to generate a dynamic intelligent image according to the target image parameters, the target action parameters and the target voice parameters;

[0012] The interaction module is used to interact with the user based on the dynamic intelligent image.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the intelligent voice interaction method described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the intelligent voice interaction method described in any embodiment of the present invention when executed.

[0018] The technical solution of the embodiment of the present invention determines the target working mode of the vehicle based on the sensor data detected by the sensors in the vehicle; determines the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant based on the target working mode and / or target scene; generates a dynamic intelligent image based on the target image parameters, target action parameters and target voice parameters; and interacts with the user based on the dynamic intelligent image. The above scheme can provide users with a personalized dynamic intelligent image of the intelligent voice assistant based on the target scene and the working mode of the vehicle, improves the intelligent performance of the vehicle, and provides more convenience for users in the process of using the vehicle. At the same time, users can understand the current working mode and target scene of the vehicle in real time based on the dynamic intelligent image, which improves the user's vehicle use experience.

[0019] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 A flowchart of an intelligent voice interaction method provided in Embodiment 1 of the present invention;

[0022] Figure 2 A flowchart of an intelligent voice interaction method provided in Embodiment 2 of the present invention;

[0023] Figure 3 A flowchart of an intelligent voice interaction method provided in Embodiment 3 of the present invention;

[0024] Figure 4 A schematic diagram of the structure of an intelligent voice interaction device provided in Embodiment 4 of the present invention;

[0025] Figure 5 This is a schematic diagram of the structure of an electronic device provided in Embodiment 5 of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "current", "target", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "etc." and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] Embodiment 1

[0029] Figure 1 A flowchart of an intelligent voice interaction method is provided for Embodiment 1 of the present invention. This embodiment is applicable to the case where an intelligent voice interaction is performed with a user through an intelligent voice assistant. The method can be performed by an intelligent voice interaction device, which can be implemented in the form of hardware and / or software, and the intelligent voice interaction device can be configured in an electronic device, such as an intelligent voice service system of an electronic device. The intelligent voice service system includes: a sensor, an image acquisition device, and an intelligent voice assistant. The intelligent voice assistant can help users solve problems through intelligent interaction of intelligent dialogue and instant question and answer.

[0030] like Figure 1 As shown, the method includes:

[0031] S110: Determine a target operating mode of the vehicle according to sensing data detected by sensors in the vehicle.

[0032] Among them, the sensor in the vehicle is the input device of the car computer system. It converts various working condition information of the car, such as vehicle speed, temperature of various media, engine operating conditions, etc., into electrical signals and transmits them to the computer. The target working mode refers to the current working mode of the vehicle determined by the vehicle based on the sensor data. The working modes of the vehicle include welcome mode, chat mode, automatic driving mode, target scene mode and health monitoring mode.

[0033] The welcoming mode refers to the mode of welcoming passengers or driving the vehicle when the sensor detects that a passenger has entered the vehicle cabin. The chatting mode is a mode in which the intelligent voice assistant installed on the vehicle can communicate with the user on the vehicle by voice. The autonomous driving mode is the mode in which the vehicle turns on the autonomous driving function. The target scene mode refers to the mode that determines the destination scene of the vehicle or the scene where the user is located according to the user's choice. The scene where the user is located can be a virtual scene or a real scene. The health monitoring mode refers to the mode used to perform health checks on users so that users can understand their own health conditions. Different working modes of different vehicles correspond to different dynamic intelligent images.

[0034] Specifically, sensor data transmitted by vehicle sensors is acquired in real time, and data analysis is performed on the sensor data, and the usage of the vehicle cabin and the command information issued by the user are determined according to the data analysis results, and the target working mode of the vehicle is determined according to the usage of the vehicle cabin and / or the command information issued by the user. The command information issued by the user may be one or more of voice information, text information, click information, and gesture information.

[0035] Exemplarily, the target operating mode of the vehicle can be determined according to the seat usage, the face detection result and the indication information. Specifically, it can be achieved through the following sub-steps:

[0036] S1101. If it is determined based on the sensing data of the seat sensor in the vehicle that the seat is in use, a facial detection is performed on the user in the seat.

[0037] Among them, the seat sensor can obtain the signal changes of the seat in the vehicle to determine whether there is a user in the vehicle cabin.

[0038] Specifically, according to the sensing data transmitted by the seat sensor, the signal change of the seat is determined, and according to the signal change of the seat, it is determined whether a user has entered the vehicle cabin. If it is determined that the user has entered the vehicle cabin, it is determined that the vehicle cabin is in use, and further the image information of the user is collected by the image acquisition device in the vehicle, so as to perform face detection on the user according to the image information of the user.

[0039] S1102: Determine a target operating mode of the vehicle according to the facial detection result and the instruction information issued by the user.

[0040] The face detection result includes the identity information and age information of the user. Different optional working modes can be provided for users of different age groups, and the target working mode can be determined from the optional working modes.

[0041] For example, if the user's age information is determined to be a minor based on the facial detection results, the optional working modes are welcome mode and health detection mode, and the automatic driving mode cannot be provided for underage users.

[0042] Specifically, the user's identity information is obtained according to the face detection result, the optional working mode corresponding to the identity information is determined according to the user's identity information, and then the target working mode of the vehicle is determined from the optional working modes according to the instruction information sent by the user.

[0043] Preferably, the method for determining the target working mode of the vehicle may specifically be: verifying the user's identity information based on the face detection result; obtaining instruction information issued by the user when the identity information is verified; and determining the target working mode from the set working modes based on the instruction information.

[0044] The set working mode refers to a pre-set working mode of the vehicle that can be provided to the user. The set working mode may include: welcoming mode, chatting mode, automatic driving mode, target scene mode and health monitoring mode.

[0045] Specifically, the identity information of the user with the permission to use the vehicle can be stored in the intelligent voice service system in advance, and the identity information includes the facial feature information of the user with the permission to use the vehicle. After obtaining the face detection result of the user in the current vehicle cabin, the face detection result is compared with the facial feature information of the user with the permission to use the vehicle, and it is verified whether the user in the current vehicle cabin is a user with the permission to use the vehicle according to the comparison result. If so, the verification of the user in the previous vehicle cabin is passed.

[0046] When the user's identity information is authenticated, the instruction information sent by the user is obtained, and the target operating mode that the user expects to obtain is determined according to the instruction information sent by the user, and the target operating mode of the vehicle is determined from the optional operating modes.

[0047] Optionally, if the user in the current vehicle cabin does not have permission to use the vehicle, a warning message is issued.

[0048] It is understandable that by determining the target working mode of the vehicle through the above steps, the target working mode corresponding to the identity information can be provided to the user according to the user's identity information. Alternatively, it can be determined whether the user has the right to obtain the target working mode according to the user's identity information. This avoids information leakage and ensures the safety of the vehicle.

[0049] S120. Determine target image parameters, target action parameters, and target voice parameters of the intelligent voice assistant according to the target working mode and / or target scene.

[0050] Among them, the target scene refers to the scene of the vehicle's destination or the metaverse scene. The metaverse scene is a virtual scene constructed through virtual reality technology. The target image parameter refers to the parameter information used to construct the external image of the intelligent voice assistant, such as color information, size information, and expression information; the target action parameter refers to the parameter information used to construct the action to be performed by the intelligent voice assistant; the target voice parameter refers to the parameter information used to generate the voice information to be issued by the intelligent voice assistant.

[0051] Specifically, the target image parameters, target action parameters, target voice parameters and target working modes are stored in the intelligent voice service system in correspondence; at the same time, the target image parameters, target action parameters and target voice parameters and target scenes are stored in the intelligent voice service system in correspondence. The external images of the intelligent voice assistant constructed by the target image parameters include: doctor image, diving image, pilot image, astronaut image and default image.

[0052] The actions of the intelligent voice assistant constructed by the target action parameters include: display actions for displaying information on the display screen or displaying its own image, listening actions when listening to the user's chat, watching actions when the user operates the vehicle, questioning actions when the user's voice information is not recognized, welcoming actions to welcome the user, scene-adaptive actions corresponding to the target scene, and standby actions in standby mode. Furthermore, scene-adaptive actions include playing musical instruments, etc.; standby actions include reading actions, dancing actions, and weightless floating actions.

[0053] Exemplarily, if the target working mode is the welcoming mode, the target image parameters are default image parameters, the target action parameters include welcoming action parameters and display action parameters, and the target voice parameters include welcoming voice parameters and vehicle start prompting voice parameters.

[0054] Specifically, if the target working mode is determined to be the welcoming mode, the target image parameters are determined to be the default image parameters, and the external image of the intelligent voice assistant constructed according to the target image parameters is the default image. The target action parameters are the welcoming appearance parameters and the display parameters. The welcoming appearance parameters can construct the appearance action and appearance time of the intelligent voice assistant. For example, the appearance action can be a waving gesture, and the appearance time can be three seconds. The display parameters can construct the display action made by the intelligent voice assistant when introducing itself, and the display action can be a circling action and / or an action with both arms open. The welcoming voice parameters in the target voice parameters can generate the welcoming voice issued by the intelligent voice assistant when welcoming the user, and can also generate the prompt voice of the intelligent voice assistant prompting the user to start the vehicle according to the prompt vehicle start voice parameters.

[0055] For example, the welcoming voice can be: "The flower path has never been swept for guests, and the door is now open for you. Hello, passenger, I am your intelligent voice assistant, my name is Xiaoqi, and I am very happy to serve you in the rest of your journey." The prompt voice can be: "Now you click the start option and we can set off."

[0056] If the target working mode is the health detection mode, the target image parameters are doctor image parameters, the target action parameters include detection process prompt action parameters, and the target voice parameters include detection process prompt voice parameters.

[0057] Specifically, if the target working mode is determined to be the health detection mode, the target image parameter is determined to be the doctor image parameter, and the external image of the intelligent voice assistant constructed according to the target image parameter is the doctor image. The target action parameter is the detection process prompt action parameter, and the detection process prompt action parameter can construct the detection prompt action of the intelligent voice assistant during the detection process. For example, the detection prompt action can be the action of taking off and hanging up a stethoscope. The detection process prompt voice parameter in the target voice parameter can generate a health monitoring prompt voice issued by the intelligent voice assistant to the user when performing a health check on the user.

[0058] For example, the health check reminder voice may be: "Please look at the camera in front of you. I will perform a daily health check for you." At the end of the health check, the health check reminder voice may be: "The results of the physical examination will be sent to you at the end." Optionally, if the user does not look at the camera during the health check, the health check reminder voice may be: "Health check in progress, please look at the camera."

[0059] It can be understood that by determining the various parameters of the intelligent voice assistant according to the target working mode and / or target scene, the acquired parameters corresponding to the intelligent voice assistant can be made consistent with the current working mode and target scene of the vehicle, thereby constructing a dynamic intelligent image that meets user needs and is easy for users to understand.

[0060] S130, generating a dynamic intelligent image according to target image parameters, target action parameters and target voice parameters.

[0061] Among them, a dynamic intelligent image refers to an intelligent model image of an intelligent voice assistant that can make actions and speak.

[0062] Specifically, the target external image of the intelligent voice assistant is determined according to the target image parameters; the target action to be displayed by the intelligent voice assistant is determined according to the target action parameters; and the target voice information to be sent by the intelligent voice assistant is determined according to the target voice parameters. A dynamic intelligent image is generated according to the target external image of the intelligent voice assistant, the target action to be displayed, and the target voice information to be sent.

[0063] S140. Interact with the user based on the dynamic intelligent image.

[0064] Specifically, after obtaining a dynamic intelligent image corresponding to the target working mode and / or target scene, information interaction with the user can be carried out through an intelligent voice assistant based on the dynamic intelligent image.

[0065] Optionally, an Easter egg link can be set in the process of user interaction, that is, in the process of interaction with the user, if the user triggers the condition of sending the Easter egg, the intelligent voice assistant will send an Easter egg voice through the dynamic intelligent image and send an electronic greeting card to the user. The Easter egg voice can be: "I send you a sky postcard, please accept it quickly."

[0066] For example, when the user exits the intelligent voice service system or turns off the intelligent voice assistant, the dynamic intelligent image will make a disappearing action and send out an offline prompt voice. The offline prompt voice can be: "See you next time."

[0067] The above scheme determines the parameter information for constructing a dynamic intelligent image according to the target working mode and / or target scenario of the vehicle, and can dynamically adjust the dynamic intelligent image in real time according to the actual situation of the vehicle, thereby solving the problem that the voice intelligent interaction mode in autonomous driving vehicles is too single and cannot meet the personalized needs of users.

[0068] The technical solution provided in this embodiment determines the target working mode of the vehicle based on the sensor data detected by the sensors in the vehicle; determines the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant based on the target working mode and / or target scene; generates a dynamic intelligent image based on the target image parameters, target action parameters and target voice parameters; and interacts with the user based on the dynamic intelligent image. The above scheme can provide users with a personalized dynamic intelligent image of the intelligent voice assistant based on the target scene and the working mode of the vehicle, improves the intelligent performance of the vehicle, and provides more convenience for users in the process of using the vehicle. At the same time, users can understand the current working mode and target scene of the vehicle in real time based on the dynamic intelligent image, which improves the user's vehicle use experience.

[0069] Embodiment 2

[0070] Figure 2 This is a flow chart of an intelligent voice interaction method provided in Example 2 of the present invention. This example is optimized on the basis of the above example and provides a preferred implementation scheme for generating a dynamic intelligent image according to target image parameters, target action parameters and target voice parameters. Specifically, Figure 2 As shown, the method includes:

[0071] S210: Determine a target operating mode of the vehicle according to sensing data detected by sensors in the vehicle.

[0072] S220. Determine the target image parameters, target action parameters, and target voice parameters of the intelligent voice assistant according to the target working mode and / or target scene.

[0073] S230: Generate an initial intelligent image according to the target image parameters, target action parameters, and target voice parameters.

[0074] The initial intelligent image refers to an intelligent image that is generated based on various parameters corresponding to the working mode and / or target scene and needs to be further adjusted.

[0075] S240: Adjust the initial intelligent image according to the target scene to obtain a dynamic intelligent image.

[0076] Specifically, adjustment parameters for dynamic intelligent image adjustment can be allocated to each target scene according to the characteristics of the target scene, and the target scene and the adjustment parameters can be stored in the intelligent voice service system accordingly. After the target scene is determined, the adjustment parameters are determined according to the target scene, and then the initial intelligent image is adjusted based on the adjustment parameters, and the adjusted initial intelligent image is used as the dynamic intelligent image.

[0077] Exemplarily, the dynamic intelligent image can be obtained according to the following sub-steps:

[0078] S2401. Determine color information and / or emotion information according to the target scene.

[0079] The color information refers to the color composition of the appearance of the constructed dynamic intelligent image. The emotional information refers to the external emotions of the dynamic intelligent image. The emotional information may include: happy, sad, active, shy, etc.

[0080] Specifically, different color parameters and emotional parameters can be set for dynamic intelligent images corresponding to different target scenes according to the scene characteristics of the target scene. After obtaining the target scene of the current vehicle, the color parameters and emotional parameters corresponding to the target scene are determined according to the target scene, and the color information of the dynamic intelligent image is determined according to the color parameters; the emotional information of the dynamic intelligent image is determined according to the emotional parameters.

[0081] S2402: Adjust the initial intelligent image according to the color information and / or the emotion information to obtain a dynamic intelligent image.

[0082] Specifically, the initial intelligent image is adjusted according to the color information, and after adjusting the color of the initial intelligent image, the expression of the dynamic intelligent image is adjusted according to the emotional information to obtain a dynamic intelligent image that meets the scene characteristics of the target scene.

[0083] S250, interacts with users based on dynamic intelligent images.

[0084] The technical solution of this embodiment determines the target working mode of the vehicle based on the sensor data detected by the sensors in the vehicle; determines the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant based on the target working mode and / or target scene; generates an initial intelligent image based on the target image parameters, target action parameters and target voice parameters; adjusts the initial intelligent image according to the target scene to obtain a dynamic intelligent image; and interacts with the user based on the dynamic intelligent image. The above scheme can provide the user with the initial intelligent image of the intelligent voice assistant according to the target working mode of the vehicle, and adjusts the initial intelligent image in real time according to the target scene to obtain a dynamic intelligent image; so that the user can obtain the scene information of the target scene of the vehicle in real time based on the distinguishing features of the dynamic intelligent image and the initial intelligent image, thereby meeting the user's need to grasp the vehicle driving scene in real time.

[0085] Embodiment 3

[0086] Figure 3 This is a flowchart of an intelligent voice interaction method provided in Example 3 of the present invention. This embodiment is optimized on the basis of the above embodiment, and provides a preferred implementation method for determining the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant according to the target scene. Specifically, Figure 3 As shown, the method includes:

[0087] S310: Determine a target operating mode of the vehicle according to sensing data detected by sensors in the vehicle.

[0088] S320: Determine a target scene from the optional scenes according to the user's selection operation.

[0089] Among them, the optional scene refers to the scene that is pre-stored in the intelligent voice service system and can be selected. The optional scene can be a virtual scene or a real scene. The virtual scene can be a metaverse scene; the real scene includes the ocean scene corresponding to the oceanarium, the sky scene corresponding to the aerospace museum, and the forest scene corresponding to the natural scenic spot. It is understandable that the real scene can be set according to the actual situation and is not limited to the scenes listed above.

[0090] Specifically, the information selected by the user's selection operation may be the destination of the vehicle, or may be a scene pre-stored in the intelligent voice service system. If the user's selection operation selects the destination of the vehicle, the target scene is determined according to the destination scene. If the information selected by the user's selection operation is a scene pre-stored in the intelligent voice service system, the scene selected by the user is used as the target scene.

[0091] S330. If the target scene is a metaverse scene, the target image parameters are metaverse image parameters, the target action parameters are action parameters associated with the metaverse scene, and the target voice parameters are voice parameters associated with the metaverse scene.

[0092] The metaverse image parameters refer to the parameters that can construct the metaverse image of the intelligent voice assistant. The metaverse image can be the image of the intelligent voice assistant constructed by the user according to actual needs, or it can be the image of the intelligent voice assistant selected by the user through the optional images pre-stored in the intelligent voice service system.

[0093] Specifically, if the target scene is a metaverse scene, the metaverse image parameters corresponding to the metaverse scene, the action parameters associated with the metaverse scene, and the voice parameters associated with the metaverse scene are obtained.

[0094] S340: Generate a dynamic intelligent image according to the target image parameters, target action parameters and target voice parameters.

[0095] Specifically, a dynamic intelligent image corresponding to the metaverse scene is constructed based on the metaverse image parameters, the action parameters associated with the metaverse scene, and the voice parameters associated with the metaverse scene.

[0096] S350: When it is determined that the user is in a metaverse scene, determine that the working mode of the dynamic intelligent image is a follow mode.

[0097] The working modes of the dynamic intelligent image may include a fixed mode and a follow mode. The dynamic intelligent image in the fixed mode can only move within the display that displays the dynamic intelligent image; the dynamic intelligent image in the follow mode can always follow the user when the user is in the metaverse scene.

[0098] Specifically, when it is determined that the user has entered the metaverse scene, the working mode of the dynamic intelligent image is determined to be the follow mode.

[0099] S360. Control the dynamic intelligent image in follow mode to interact with the user through voice and / or action.

[0100] Specifically, when a user enters a metaverse scene through a virtual reality device, the intelligent voice assistant can accompany the user in a follow-up mode with a dynamic intelligent image, and accompany the user to experience the game in the metaverse scene. For example, the intelligent voice assistant can use a dynamic intelligent image to serve as a sparring partner for the user in a virtual gym in the metaverse scene; the intelligent voice assistant can also use a dynamic intelligent image to compete with users in the metaverse scene. When the user chooses to turn off the virtual device, the intelligent voice assistant can send a farewell voice message through the dynamic intelligent image, and the farewell voice message can be "Take off your VR glasses now and look outside." After the user turns off the virtual device, the external image of the intelligent voice assistant switches from the metaverse image to the default image.

[0101] The technical solution of this embodiment determines the target working mode of the vehicle according to the sensor data detected by the sensors in the vehicle; determines the target scene from the optional scenes according to the user's selection operation; if the target scene is a metaverse scene, the target image parameters are the metaverse image parameters, the target action parameters are the action parameters associated with the metaverse scene, and the target voice parameters are the voice parameters associated with the metaverse scene; when it is determined that the user is in the metaverse scene, the working mode of the dynamic intelligent image is determined to be the follow mode; the dynamic intelligent image is controlled to interact with the user by voice and / or action in the follow mode. Through the above scheme, non-driving users riding in the vehicle can enter the virtual scene through virtual reality technology, and interact with the intelligent voice assistant by voice and action in the virtual scene, which better meets the personalized needs of users for the vehicle intelligent voice assistant and improves the comfort and fun of users riding in the vehicle.

[0102] For example, based on this embodiment, if the target scene is an ocean scene corresponding to an oceanarium, the target external image corresponding to the target scene is a diving image; if the target scene is a sky scene corresponding to an aerospace museum, the target external image corresponding to the target scene is an astronaut image; if the target scene is a forest scene corresponding to a natural scenic spot, the target external image corresponding to the target scene is a default image, and piano keys will appear on the display screen, and the user can play the piano keys on the display screen. At this time, the voice message sent by the intelligent voice assistant can be "You can play the piano on the smart surface and feel the charm of the sound of the elements". Among them, the display screen can be a display screen of a user terminal or a display screen of a vehicle.

[0103] Embodiment 4

[0104] Figure 4 This is a schematic diagram of the structure of an intelligent voice interaction device provided in Embodiment 4 of the present invention. This embodiment is applicable to the case where an intelligent voice assistant and a user perform intelligent voice interaction. Figure 4 As shown, the intelligent voice interaction device includes: a target working mode determination module 410, a parameter determination module 420, a dynamic intelligent image generation module 430 and an interaction module 440.

[0105] Wherein, the target working mode determination module 410 is used to determine the target working mode of the vehicle according to the sensor data detected by the sensor in the vehicle;

[0106] A parameter determination module 420, for determining target image parameters, target action parameters, and target voice parameters of the intelligent voice assistant according to a target working mode and / or a target scene;

[0107] A dynamic intelligent image generation module 430 is used to generate a dynamic intelligent image according to target image parameters, target action parameters and target voice parameters;

[0108] The interaction module 440 is used to interact with the user based on the dynamic intelligent image.

[0109] The technical solution provided in this embodiment determines the target working mode of the vehicle based on the sensor data detected by the sensors in the vehicle; determines the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant based on the target working mode and / or target scene; generates a dynamic intelligent image based on the target image parameters, target action parameters and target voice parameters; and interacts with the user based on the dynamic intelligent image. The above scheme can provide users with a personalized dynamic intelligent image of the intelligent voice assistant based on the target scene and the working mode of the vehicle, improves the intelligent performance of the vehicle, and provides more convenience for users in the process of using the vehicle. At the same time, users can understand the current working mode and target scene of the vehicle in real time based on the dynamic intelligent image, which improves the user's vehicle use experience.

[0110] The target working mode determination module 410 includes:

[0111] A facial detection unit, configured to detect the face of a user on the seat if it is determined that the seat is in use based on sensing data of a seat sensor in the vehicle;

[0112] The working mode determination unit is used to determine the target working mode of the vehicle according to the face detection result and the instruction information issued by the user.

[0113] Exemplarily, the working mode determination unit is specifically used for:

[0114] Verify the user's identity information based on the face detection results;

[0115] When the identity information is verified, obtaining instruction information issued by the user;

[0116] According to the instruction information, determine the target working mode from the set working modes.

[0117] Exemplarily, the parameter determination module 420 is specifically used for:

[0118] If the target working mode is the welcoming mode, the target image parameters are the default image parameters, the target action parameters include the welcoming action parameters and the display action parameters, and the target voice parameters include the welcoming voice parameters and the vehicle start prompt voice parameters;

[0119] If the target working mode is the health detection mode, the target image parameters are doctor image parameters, the target action parameters include detection process prompt action parameters, and the target voice parameters include detection process prompt voice parameters.

[0120] Exemplarily, the dynamic intelligent image generation module 430 includes:

[0121] An initial intelligent image generating unit, used to generate an initial intelligent image according to target image parameters, target action parameters, and target voice parameters;

[0122] The dynamic intelligent image determination unit is used to adjust the initial intelligent image according to the target scene to obtain a dynamic intelligent image.

[0123] Exemplarily, the dynamic intelligent image determination unit is specifically used for:

[0124] Determine color information and / or emotional information based on the target scene;

[0125] According to the color information and / or the emotion information, the initial intelligent image is adjusted to obtain a dynamic intelligent image.

[0126] Exemplarily, the parameter determination module 420 is further specifically configured to:

[0127] According to the user's selection operation, determine the target scene from the optional scenes;

[0128] If the target scene is a metaverse scene, the target image parameters are the metaverse image parameters, the target action parameters are the action parameters associated with the metaverse scene, and the target voice parameters are the voice parameters associated with the metaverse scene;

[0129] Accordingly, the interaction module 440 is specifically used for:

[0130] When it is determined that the user is in a metaverse scene, the working mode of the dynamic intelligent image is determined to be a follow mode;

[0131] Control the dynamic intelligent character in follow mode to interact with the user through voice and / or motion.

[0132] The intelligent voice interaction device provided in this embodiment can be applied to the intelligent voice interaction method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0133] Embodiment 5

[0134] Figure 5 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0135] like Figure 5 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0136] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0137] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the intelligent voice interaction method.

[0138] In some embodiments, the intelligent voice interaction method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the intelligent voice interaction method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the intelligent voice interaction method in any other appropriate manner (e.g., by means of firmware).

[0139] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0140] The computer program for implementing the method of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable intelligent voice interaction device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program can be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0141] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0142] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0143] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0144] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0145] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0146] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An intelligent voice interaction method, characterized in that: include: Determining a target operating mode of the vehicle based on sensor data detected by a sensor in the vehicle; Determine target image parameters, target action parameters, and target voice parameters of the intelligent voice assistant according to the target working mode and / or target scenario; generating a dynamic intelligent image according to the target image parameter, the target action parameter and the target voice parameter; Interacting with the user based on the dynamic intelligent image; The step of generating a dynamic intelligent image according to the target image parameter, the target action parameter and the target voice parameter comprises: generating an initial intelligent image according to the target image parameter, the target action parameter and the target voice parameter; Determine color information and emotional information based on the target scene; Adjusting the initial intelligent image according to the color information, and further adjusting the expression of the initial intelligent image according to the emotion information to obtain a dynamic intelligent image; The color information refers to the appearance color of the generated dynamic intelligent image; the emotion information refers to the external emotion of the generated dynamic intelligent image; Wherein, determining the target operating mode of the vehicle according to the sensing data detected by the sensor in the vehicle includes: If it is determined according to the sensing data of the seat sensor in the vehicle that the seat is in use, performing facial detection on the user on the seat; Determining a target operating mode of the vehicle according to a facial detection result and instruction information issued by the user; Wherein, determining the target operating mode of the vehicle according to the facial detection result and the instruction information issued by the user includes: Determine an optional working mode of the vehicle according to the face detection result, and then determine a target working mode from the optional working modes according to the instruction information issued by the user; Wherein, the face detection result includes the user's identity information and age information; If the user's age information is a minor, the optional working mode does not include the automatic driving mode; Wherein, determining the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant according to the target working mode includes: If the target working mode is the health detection mode, the target image parameter is the doctor image parameter, the target action parameter includes the detection process prompt action parameter, and the target voice parameter includes the detection process prompt voice parameter; Among them, the detection process prompt action includes the action of taking off and hanging up the stethoscope; the detection process prompt voice parameters include a voice prompting the user to conduct daily health checks by looking at the camera, and a voice prompting the user that the physical examination results will be sent to the user at the end.

2. The method according to claim 1, characterized in that: Determining the target operating mode of the vehicle according to the facial detection result and the instruction information issued by the user includes: Verifying the identity information of the user according to the facial detection result; When the identity information is verified, obtaining instruction information sent by the user; According to the indication information, a target working mode is determined from the set working modes.

3. The method according to claim 1, characterized in that: Determining the target image parameters, target action parameters, and target voice parameters of the intelligent voice assistant according to the target working mode includes: If the target working mode is the welcoming mode, the target image parameters are the default image parameters, the target action parameters include the welcoming action parameters and the display action parameters, and the target voice parameters include the welcoming voice parameters and the vehicle start prompt voice parameters.

4. The method according to claim 1, characterized in that: Determining the target image parameters, target action parameters, and target voice parameters of the intelligent voice assistant according to the target scenario includes: According to the user's selection operation, determine the target scene from the optional scenes; If the target scene is a metaverse scene, the target image parameter is a metaverse image parameter, the target action parameter is an action parameter associated with the metaverse scene, and the target voice parameter is a voice parameter associated with the metaverse scene; Accordingly, based on the dynamic intelligent image, interacting with the user includes: When it is determined that the user is in a metaverse scene, determining that the working mode of the dynamic intelligent image is a follow mode; The dynamic intelligent image is controlled to interact with the user through voice and / or action in a follow mode.

5. An intelligent voice interaction device, characterized in that: include: A target operating mode determination module, used to determine a target operating mode of the vehicle according to sensor data detected by a sensor in the vehicle; A parameter determination module, used to determine the target image parameters, target action parameters and target voice parameters of the intelligent voice assistant according to the target working mode and / or target scene; A dynamic intelligent image generation module, used to generate a dynamic intelligent image according to the target image parameters, the target action parameters and the target voice parameters; An interaction module, used for interacting with a user based on the dynamic intelligent image; Among them, the dynamic intelligent image generation module includes an initial intelligent image generation unit and a dynamic intelligent image determination unit; The initial intelligent image generation unit is used to generate an initial intelligent image according to target image parameters, target action parameters and target voice parameters; The dynamic intelligent image determination unit is used to determine color information and emotion information according to the target scene; adjust the initial intelligent image according to the color information, and adjust the expression of the initial intelligent image according to the emotion information to obtain the dynamic intelligent image; Wherein, the target working mode determination module includes a face detection unit and a working mode determination unit; The facial detection unit is used to perform facial detection on a user on the seat if it is determined that the seat is in use based on the sensing data of the seat sensor in the vehicle; The working mode determination unit is used to perform facial detection on a user on the seat if it is determined that the seat is in use according to the sensing data of the seat sensor in the vehicle; and determine the target working mode of the vehicle according to the facial detection result and the instruction information issued by the user; The working mode determination unit is specifically used to: determine the optional working mode of the vehicle according to the face detection result, and then determine the target working mode from the optional working modes according to the instruction information issued by the user; if the age information of the user is a minor, the optional working mode does not include the automatic driving mode; wherein the face detection result includes the identity information and age information of the user; Wherein, the parameter determination module is specifically used for: If the target working mode is the health check mode, the target image parameters are doctor image parameters, the target action parameters include detection process prompt action parameters, and the target voice parameters include detection process prompt voice parameters; wherein the detection process prompt action includes the action of taking off and hanging up the stethoscope; the detection process prompt voice parameters include the voice prompting the user to conduct daily health checks by looking at the camera, and the voice prompting the user that the physical examination results will be sent to the user at the end.

6. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the intelligent voice interaction method described in any one of claims 1-4.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the intelligent voice interaction method according to any one of claims 1 to 4 when executed.

Images