Vehicle exterior voice interaction method, electronic device, storage medium and program product

Abstract

The invention provides an out-of-vehicle voice interaction method, electronic equipment, a storage medium and a program product, and relates to the field of intelligent vehicles. The method comprises the steps of obtaining position information of a vehicle in response to a detected interaction instruction of a user acting on the vehicle; identifying a user intention of a place corresponding to the position information according to the position information; and outputting the scenarized out-of-vehicle voice corresponding to the user intention. According to the invention, after the position information of the vehicle is acquired, the user intention of the place corresponding to the position information is determined according to the position information, and the scene-based outside-vehicle voice corresponding to the user intention is output according to the user intention, so that the effects of satisfying the scene-based outside-vehicle voice demand and improving the intelligent degree of the outside-vehicle voice can be achieved.

Description

Technical Field

[0001] The present application relates to the field of smart cars, and in particular to an off-vehicle voice interaction method, electronic equipment, storage medium and program product. Background Art

[0002] The rapid development of Internet of Vehicles technology has greatly promoted the process of automobile intelligence. In the future, the experience of automobile intelligence will become the main focus of the automotive industry, among which intelligent voice function is particularly important. With the mass production and application of out-of-car voice technology, improving the user experience of out-of-car voice has become increasingly critical.

[0003] In the related art, when the vehicle's external voice technology is triggered, the vehicle outputs a fixed external voice. The external voice output by this method is relatively stiff, which limits the degree of intelligence of the external voice. Summary of the invention

[0004] The present application provides an out-of-vehicle voice interaction method, electronic device, storage medium and program product, which are used to meet the scenario-based out-of-vehicle voice needs and improve the intelligence level of the out-of-vehicle voice.

[0005] In a first aspect, the present application provides an off-vehicle voice interaction method, comprising:

[0006] In response to detecting an interactive instruction from a user acting on the vehicle, obtaining location information of the vehicle;

[0007] Based on the location information, identify the user's intention of the location corresponding to the location information;

[0008] Output scenario-based out-of-car speech corresponding to the user's intention.

[0009] In a possible implementation, identifying, based on the location information, the user intention of the location corresponding to the location information includes:

[0010] The auxiliary information is determined based on the location information and the user intention to identify the user intention at the location corresponding to the location information. The auxiliary information for determining the user intention includes at least one of environmental information, time information, and the number of times the vehicle arrives at the location.

[0011] In a possible implementation, the auxiliary information is determined based on the location information and the user intention, and the user intention of the location corresponding to the location information is identified, including:

[0012] Perform data preprocessing on the location information and scene judgment auxiliary information to obtain input information for the application intention determination model;

[0013] The input information is input into the intent determination model to determine the intent and determine the user intent of the location corresponding to the location information.

[0014] In a possible implementation, data preprocessing is performed on the location information and the scene judgment auxiliary information to obtain input information of the application intention determination model, including:

[0015] Perform data cleaning on location information and scene judgment auxiliary information;

[0016] The location information and scene judgment auxiliary information after data cleaning are encoded to obtain the input information of the application intention determination model.

[0017] In a possible implementation, outputting a scenario-based out-of-vehicle voice corresponding to the user's intention includes:

[0018] Based on the user intention of the location corresponding to the location information, text generation technology is applied to generate scenario-based text content;

[0019] Conduct data review on scenario-based text content to determine the scenario-based text content that corresponds to the user's intent;

[0020] Output the scenario-based text content of the user's intention.

[0021] In a possible implementation, when the user intends to determine that the auxiliary information includes the number of times the vehicle arrives at a location, different numbers of times correspond to different scenario-based text contents.

[0022] In a possible implementation, the position information of the vehicle is determined by:

[0023] Activate the GNSS receiver inside the IoV module; decode the received satellite signal through the GNSS receiver; determine the location information of the vehicle based on the received satellite signal based on the positioning algorithm;

[0024] And / or, obtaining the vehicle's location information from a navigation map module.

[0025] In a second aspect, the present application provides an off-vehicle voice interaction device, comprising:

[0026] An acquisition module, used for acquiring the location information of the vehicle in response to detecting an interaction instruction of a user acting on the vehicle;

[0027] An identification module, used to identify the user's intention to find the location corresponding to the location information based on the location information;

[0028] The processing module is used to output scenario-based off-vehicle speech corresponding to the user's intention.

[0029] In a possible implementation, the identification module is specifically used for:

[0030] The auxiliary information is determined based on the location information and the user intention to identify the user intention at the location corresponding to the location information. The auxiliary information for determining the user intention includes at least one of environmental information, time information, and the number of times the vehicle arrives at the location.

[0031] In a possible implementation, the identification module is used to:

[0032] Perform data preprocessing on the location information and scene judgment auxiliary information to obtain input information for the application intention determination model;

[0033] The input information is input into the intent determination model to determine the intent and determine the user intent of the location corresponding to the location information.

[0034] In a possible implementation manner, the processing module is specifically used for:

[0035] Perform data cleaning on location information and scene judgment auxiliary information;

[0036] The location information and scene judgment auxiliary information after data cleaning are encoded to obtain the input information of the application intention determination model.

[0037] In a possible implementation manner, the processing module is specifically used for:

[0038] Based on the user intention of the location corresponding to the location information, text generation technology is applied to generate scenario-based text content;

[0039] Conduct data review on scenario-based text content to determine the scenario-based text content that corresponds to the user's intent;

[0040] Output the scenario-based text content of the user's intention.

[0041] In a possible implementation, when the user intends to determine that the auxiliary information includes the number of times the vehicle arrives at a location, different numbers of times correspond to different scenario-based text contents.

[0042] In a possible implementation, the acquisition module is specifically used to:

[0043] Activate the GNSS receiver inside the IoV module; decode the received satellite signal through the GNSS receiver; determine the location information of the vehicle based on the received satellite signal based on the positioning algorithm;

[0044] And / or, obtaining the vehicle's location information from a navigation map module.

[0045] In a third aspect, the present application provides an electronic device, including: a memory, a processor;

[0046] Memory stores computer-executable instructions;

[0047] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the above first aspect and / or various possible implementations of the first aspect.

[0048] In a fourth aspect, the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed, they are used to implement the above first aspect and / or various possible implementations of the first aspect.

[0049] In a fifth aspect, the present application provides a computer program product, including a computer program, which, when executed, implements the above first aspect and / or various possible implementations of the first aspect.

[0050] The present application provides an out-of-vehicle voice interaction method, electronic device, storage medium, and program product. The method includes: in response to detecting an interaction instruction of a user acting on a vehicle, obtaining the location information of the vehicle; identifying the user's intention at the location corresponding to the location information based on the location information; and outputting a scenario-based out-of-vehicle voice corresponding to the user's intention. After obtaining the location information of the vehicle, the present application determines the user's intention at the location corresponding to the location information based on the location information, and outputs a scenario-based out-of-vehicle voice corresponding to the user's intention based on the user's intention, which can meet the needs of scenario-based out-of-vehicle voice and improve the intelligence of the out-of-vehicle voice. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0052] Figure 1 Schematic diagram of the process of the vehicle-external voice interaction method provided in the embodiment of the present application Figure 1 ;

[0053] Figure 2 A schematic diagram of the structure of the vehicle-external voice interaction method provided in an embodiment of the present application;

[0054] Figure 3 Schematic diagram of the process of the vehicle-external voice interaction method provided in the embodiment of the present application Figure 2 ;

[0055] Figure 4 A schematic diagram of the overall process of the vehicle-external voice interaction method provided in an embodiment of the present application;

[0056] Figure 5 A schematic diagram of the structure of an off-vehicle voice interaction device provided in this application;

[0057] Figure 6 A detailed structural diagram of an off-vehicle voice interaction device provided in an embodiment of the present application;

[0058] Figure 7 A schematic diagram of the structure of an electronic device provided in one embodiment of the present application.

[0059] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0060] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0061] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0062] In addition, this application involves big data analysis of user information (including but not limited to personal biometrics, identity data, consumption data, asset data, electronic terminal operation data, etc.), and the use of artificial intelligence technology for automated decision-making, and a technical solution for making decisions that have a significant impact on personal rights and interests based on the results of automated decision-making. The application provides users with corresponding operation entrances for them to choose to agree or reject the results of automated decision-making; if the user chooses to reject, the expert decision-making process will be entered.

[0063] After the vehicle is locked, the voice prompts outside the vehicle are relatively rigid and cannot adapt to most actual vehicle use scenarios, and therefore cannot meet the needs of most users. Each user has his or her own unique life and work characteristics, and existing solutions often use fixed interactive voices. However, fixed interactive voices lack flexibility, cannot adapt to changing usage environments, and cannot fully cover the needs of different users in different scenarios.

[0064] In order to address the above problems, this application adopts a set of innovative algorithm solutions, which identifies the driver's intention or provides prompt functions based on the location and big data of vehicle use, as well as time and mobile phone setting information, and broadcasts scenario-appropriate speech and voice when the driver is about to use the car and lock the car to leave, thereby improving the intelligence of the vehicle.

[0065] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0066] Figure 1 Schematic diagram of the process of the vehicle-external voice interaction method provided in the embodiment of the present application Figure 1 ,like Figure 1 As shown, the method includes:

[0067] S101. In response to detecting an interaction instruction from a user on a vehicle, obtaining location information of the vehicle.

[0068] In this step, it can be understood that after detecting the user's interactive command on the vehicle, it is necessary to respond to the interactive command and obtain the vehicle's location information. The interactive command refers to the operation command issued by the user to the vehicle through different input methods, and these operation commands can control the vehicle's functions.

[0069] Optionally, the vehicle's interactive instructions include unlocking doors and closing doors.

[0070] Furthermore, the vehicle's location information refers to detailed data about the vehicle's current location, including geographic coordinates, address information, altitude information, and the like.

[0071] In one example, in response to detecting a user's command to unlock a vehicle door, the location information of the vehicle is obtained.

[0072] In another example, in response to detecting a user's command to close a door of the vehicle, the location information of the vehicle is obtained.

[0073] S102: Identify, based on the location information, the user's intention at the location corresponding to the location information.

[0074] After the location information is acquired in S101, the user intention of the location corresponding to the location information is identified according to the location information. It can be understood that different locations corresponding to different location information have different user intentions.

[0075] In one implementation, the location information is a vegetable market, and the user intention at the corresponding location is to buy vegetables.

[0076] In another implementation, the location information is an office building, and the user's intention at the corresponding location is to go to work.

[0077] S103: Output scenario-based out-of-vehicle voice corresponding to the user's intention.

[0078] After determining the user intention of the location corresponding to the location information in S102, outputting the scenario-based vehicle-external voice corresponding to the user intention. The specific implementation method of outputting the scenario-based vehicle-external voice corresponding to the user intention can be set according to user needs.

[0079] Optionally, the vehicle's audio module (Audio, abbreviated as AUD) is used to output scenario-based out-of-vehicle voice corresponding to the user's intention.

[0080] After obtaining the vehicle's location information, the embodiment of the present application determines the user's intention at the location corresponding to the location information based on the location information, and outputs a scenario-based out-of-vehicle voice corresponding to the user's intention based on the user's intention, thereby meeting the scenario-based out-of-vehicle voice needs and improving the intelligence level of the out-of-vehicle voice.

[0081] On the basis of the above embodiment, the user intention of the location corresponding to the location information is identified according to the location information, including: judging auxiliary information based on the location information and the user intention, and identifying the user intention of the location corresponding to the location information, the auxiliary information for judging the user intention includes at least one of environmental information, time information, and the number of times the vehicle has arrived at the location.

[0082] In this embodiment, it can be understood that the user intention of the location corresponding to the location information can be determined based on the location information and the user intention determination auxiliary information. The user intention determination auxiliary information includes at least one of environmental information, time information, and the number of times the vehicle arrives at the location.

[0083] Among them, environmental information refers to data about the environment around the vehicle. The specific implementation method of determining the environmental information can be set according to actual conditions. For example, the external environmental information of the vehicle can be obtained through a 360-degree camera outside the vehicle.

[0084] Time information refers to time data related to vehicle use, such as the time the vehicle is used, the time the vehicle is parked, etc. The specific implementation method of the time information can be set according to actual conditions.

[0085] In one implementation, the vehicle parking time is obtained from a display and head unit (DHU), which may also be called a vehicle module.

[0086] In another implementation, the mobile phone is paired with the vehicle's on-board module via Bluetooth. After the pairing is successful, the on-board module obtains time information from the mobile phone via the Bluetooth protocol.

[0087] The number of times a vehicle arrives at a location refers to the number of times a vehicle arrives at the same location. Different numbers of times a vehicle arrives at the same location correspond to different user intentions at the location. For example, if a vehicle arrives at a supermarket 5 times, the user intention at the corresponding location is shopping; if a vehicle arrives at a supermarket 1999 times, the user intention at the corresponding location is going to work.

[0088] In one example, the user intention judgment auxiliary information includes environmental information, the user intention judgment auxiliary information includes time information, or the user intention judgment auxiliary information includes the number of times the vehicle arrives at the location, or the user intention judgment auxiliary information includes time information and the number of times the vehicle arrives at the location, or the user intention judgment auxiliary information includes environmental information and time information, or the user intention judgment auxiliary information includes environmental information, time information and the number of times the vehicle arrives at the location, and so on.

[0089] Optionally, when the auxiliary information for determining the user's intention includes environmental information, for example, when the vehicle is near a vegetable market, and the vehicle's external camera collects environmental information about the vehicle's surroundings showing that there are many vehicles and people, it is recognized that the user's intention at this location is to buy vegetables. The vehicle being near a vegetable market corresponds to location information.

[0090] When the auxiliary information for determining the user's intention includes time information, for example, at about 8:30 a.m. on a Monday, the user parks near an office building. At this time, according to the above information, it is identified that the user's intention at the office building is to go to work. Among them, the vicinity of the office building corresponds to the location information, and about 8:30 a.m. on Monday corresponds to the time information.

[0091] When the user intention determination auxiliary information includes the number of times the vehicle has arrived at a location, for example, the user parks near an office building and has parked at this location 1,000 times, then the user's intention at the office building location is identified as going to work based on the above information. The vicinity of the office building corresponds to the location information, and the 1,000 times of parking at this location corresponds to the number of times the vehicle has arrived at the location.

[0092] The auxiliary information for judging the user's intention includes time information and the number of times the vehicle has arrived at the location. For example, on a Saturday morning, the user parks near the vegetable market, and this is the 15th time the user has parked at this location. At this time, it is recognized that the user's intention at this location is to buy vegetables. Among them, the vicinity of the office building corresponds to the location information, the 15 times of parking at this location corresponds to the number of times the vehicle has arrived at the location, and Saturday morning corresponds to the time information.

[0093] The auxiliary information for judging the user's intention includes environmental information, time information, and the number of times the vehicle has arrived at the location. For example, on a Monday morning, the user parks at the underground floor of an office building, and this is the 500th time the user has parked at this location. At this time, it is recognized that the user's intention corresponding to the underground floor of the office building is to go to work. Among them, Saturday morning corresponds to time information, the office building corresponds to location information, the underground floor corresponds to environmental information, and the 500th time of parking at this location corresponds to the number of times the vehicle has arrived at the location.

[0094] The embodiment of the present application determines auxiliary information based on location information and user intent, identifies the user intent at the location corresponding to the location information, improves the accuracy of user intent determination, and thus lays the foundation for outputting scenario-based text content of the user intent.

[0095] Furthermore, based on the location information and user intention judgment auxiliary information, the user intention of the location corresponding to the location information is identified, including: performing data preprocessing on the location information and scene judgment auxiliary information to obtain input information of the application intention determination model; inputting the input information into the intention determination model to perform intent determination, and determining the user intention of the location corresponding to the location information.

[0096] In this embodiment, it can be understood that in order to identify the user intention at the location corresponding to the location information based on the location information and the user intention judgment auxiliary information, it is necessary to first perform data preprocessing on the location information and the scene judgment auxiliary information to obtain input information for the application intention determination model. The reason is that there is location information and scene judgment auxiliary information that do not meet the requirements. If the data information that does not meet the requirements is not preprocessed, the accuracy of the intention determination model in determining the intention will be reduced.

[0097] After determining the input information of the application intention determination model, the input information is input into the intention determination model for intention determination to determine the user intention at the location corresponding to the location information. The intention determination module can be set according to specific needs, and the embodiment of the present application does not limit this.

[0098] The embodiment of the present application obtains input information of the application intention determination model by performing data preprocessing on the location information and scene judgment auxiliary information, and determines the user intention of the location corresponding to the location information based on the input information, so as to accurately determine the user intention of the location corresponding to the location information.

[0099] Furthermore, data preprocessing is performed on the location information and scene judgment auxiliary information to obtain input information of the application intent determination model, including: data cleaning of the location information and scene judgment auxiliary information; information encoding of the cleaned location information and scene judgment auxiliary information to obtain input information of the application intent determination model. This means that when data preprocessing is performed on the location information and scene judgment auxiliary information, the location information and scene judgment auxiliary information need to be first cleaned to filter out location information and scene judgment auxiliary information that do not meet the requirements. The location information and scene judgment auxiliary information that meet the requirements are encoded to obtain input information of the application intent determination model.

[0100] The embodiment of the present application performs data preprocessing on location information and scene judgment auxiliary information to obtain input information for an application intention determination model, thereby improving the accuracy of the intention determination model in determining the intention.

[0101] At present, the existing mass production cases of vehicle external voice are: each time after locking the car, the external voice interaction is usually fixed, such as: See you next time. This type of external voice interaction gives the user a relatively ordinary experience, and cannot make the user feel the intelligence and warmth of the vehicle. Therefore, in order to let the user feel the intelligence and warmth of the vehicle, the embodiment of the present application proposes a new external voice interaction method. When performing external voice interaction, this method will output a scenario-based external language corresponding to the user's intention.

[0102] Furthermore, outputting scenario-based out-of-vehicle voice corresponding to the user's intention includes: applying text generation technology to generate scenario-based text content based on the user's intention at the location corresponding to the location information; performing data review on the scenario-based text content to determine the scenario-based text content corresponding to the user's intention; and outputting the scenario-based text content of the user's intention.

[0103] In this embodiment, it can be understood that in order to output the scenario-based off-vehicle voice corresponding to the user's intention, it is necessary to apply text generation technology to the user's intention at the location corresponding to the location information identified by S102 to generate scenario-based text content. After the scenario-based text content is generated, the scenario-based text content is subjected to data review to determine the scenario-based text content corresponding to the user's intention. Among them, data review is an important process for determining the security, integrity and availability of scenario-based text content. Data review includes reviewing data security issues, data authenticity issues, etc. of the scenario-based text content. The specific content of the data review can be set according to the actual situation, and the embodiment of the present application does not limit this.

[0104] The scenario-based text content that has passed the data review is determined as the scenario-based text content corresponding to the user's intention. After the scenario-based text content of the user's intention is determined, the scenario-based text content of the user's intention is output. For example, the scenario-based text content of the user's intention is output using the vehicle's audio module.

[0105] The embodiment of the present application can improve the flexibility of the off-vehicle voice interaction method by outputting scenario-based text content of the user's intention, so as to better adapt to the needs of different scenarios.

[0106] Furthermore, when the user's intention judgment auxiliary information includes the number of times the vehicle has arrived at a location, different times correspond to different scene-based text contents, which means that the corresponding scene-based text content is closely related to the number of times the vehicle has arrived at the location.

[0107] In one implementation, on a Saturday morning, the user parks near the vegetable market, and this is the 15th time the user has parked at this location. The vehicle-external voice interaction method is used to determine that the user goes to the vegetable market to buy vegetables on the weekend. After the user locks the car, the vehicle-external voice can output: I wish you a happy shopping and enjoy the wonderful weekend brought by delicious food. On a Saturday morning, the user parks near the vegetable market, and this is the 5th time the user has parked at this location. The vehicle-external voice interaction method is used to determine that the user goes to the vegetable market to buy vegetables on the weekend. After the user locks the car, the vehicle-external voice can output: I wish you a happy shopping.

[0108] In another implementation, late at night on a certain weekday, a user parks in an underground garage in a certain community, and this is the 1991th time for this user. The vehicle's external voice interaction method is used to determine that the user is working overtime and coming home late. After locking the vehicle, the vehicle's external voice output can be: You have worked hard all day, life is more than just the hard work in front of you, you must believe that poetry and the distance are not far away; late at night on a certain weekday, a user parks in an underground garage in a certain community, and this is the 1000th time for this user. The vehicle's external voice interaction method is used to determine that the user is working overtime and coming home late. After locking the vehicle, the vehicle's external voice output can also be: You must have gained a lot today, life is endless, struggle is endless, come on, young man.

[0109] The embodiment of the present application can greatly enhance the intelligence of the vehicle and provide users with a more considerate car-using experience by outputting scenario-based text content of the user's intention based on the number of times the vehicle has arrived at a location.

[0110] Furthermore, the location information of the vehicle is determined by: starting a global navigation satellite system receiver inside a telematics connectivity antenna module (TCAM); decoding received satellite signals through the global navigation satellite system receiver; determining the location information of the vehicle based on the received satellite signals based on a positioning algorithm; and / or obtaining the location information of the vehicle from a navigation map module.

[0111] In this embodiment, it can be understood that the specific implementation method of determining the vehicle's location information can be set according to actual conditions, and the embodiment of the present application does not limit this.

[0112] In one example, a global navigation satellite system receiver inside a connected vehicle module is activated; a received satellite signal is decoded by the global navigation satellite system receiver; and based on a positioning algorithm, the location information of the vehicle is determined according to the received satellite signal.

[0113] In yet another example, the location information of the vehicle is obtained from a navigation map module.

[0114] The embodiments of the present application provide different methods for obtaining the vehicle's location information, thereby improving the flexibility of the method for determining the vehicle's location information, and laying a foundation for improving the flexibility of the method for external voice interaction.

[0115] Next, taking the case where navigation is not turned on as an example, how to use the vehicle-external language interaction method provided by the embodiment of the present application is explained. The method includes the following steps:

[0116] 1. Responding to a vehicle unlocking or locking signal, obtaining the vehicle's location information and user intention determination auxiliary information, where the user intention determination auxiliary information includes at least one of environmental information, time information, and the number of times the vehicle has arrived at the location;

[0117] 2. Perform data preprocessing on the location information and scene judgment auxiliary information to obtain input information of the application intention determination model; input the input information into the intention determination model to determine the intention and determine the user intention of the location corresponding to the location information.

[0118] 3. Based on the user intention of the location corresponding to the location information, apply text generation technology to generate scenario-based text content; conduct data review on the scenario-based text content to determine the scenario-based text content corresponding to the user intention; and output the scenario-based text content of the user intention through the vehicle audio module using text-to-speech (TTS) broadcasting method.

[0119] It can be understood that the vehicle-external voice interaction method can be divided into the following three modules. The specific structural diagram can be referred to Figure 2 , Figure 2 A schematic diagram of the structure of the vehicle-external voice interaction method provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the method includes the following modules:

[0120] Vehicle positioning and mobile phone module: Comprehensively determine the vehicle's location information through the navigation destination or satellite positioning of the car networking module, the vehicle's external camera, and the mobile phone schedule settings;

[0121] Algorithm analysis module: combines the vehicle's location information, environmental information of the specific location where the vehicle is used, time information and mobile phone schedule information, and extracts features from the combined data information through a data preprocessing module, where the data information may be in the form of, but not limited to, pictures, videos, Bluetooth, and text; inputs the preprocessed data information into a pre-trained intent determination model, such as a pre-trained Prompt model, for processing and analysis, and predicts and analyzes the user's intent at the location corresponding to the location information; after determining the user's intent, generates a text content function for prompt greetings and closing remarks.

[0122] The modeling algorithm of the intention determination model is: L(s) = △p&△n&△t, where △p represents the location information of the vehicle, and the specific information of △p includes: workplace, scenic spot, other urban areas, countryside, etc.; △n represents the number of parking times of the vehicle, and the specific information of △n includes: 1 time, 2 times, 3 times, etc.; △t represents time information, and the specific information of △t includes: working days, holidays, special days, such as birthdays and anniversaries. This means that scenario-based voice interaction is related to the location information, time information and the number of parking times of the vehicle, among which the location information of the vehicle is an important basis for judging scenario-based voice interaction.

[0123] Execution module: Use the audio module to output the scenario-based text content of the user's intention.

[0124] Furthermore, in the scenario where navigation is not enabled, the flow chart of the method for voice interaction outside the vehicle can be referred to Figure 3 , Figure 3 Schematic diagram of the process of the vehicle-external voice interaction method provided in the embodiment of the present application Figure 2 , Figure 3 The active interaction engine in Figure 2 The car machine module in.

[0125] Furthermore, the overall flow chart of the vehicle-external voice interaction method can be referred to Figure 4 , Figure 4 A schematic diagram of the overall process of the off-vehicle voice interaction method provided in an embodiment of the present application.

[0126] In summary, the off-vehicle voice interaction method provided in the embodiment of the present application adopts real-time dynamic intelligent interaction based on the vehicle's location information, combined with time information and algorithm analysis of mobile phone schedule settings.

[0127] Furthermore, the off-vehicle voice interaction method provided in the embodiment of the present application can improve the intelligence of the car based on existing mass production technology without adding additional hardware equipment, thereby providing users with a more considerate car-using experience.

[0128] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0129] Figure 5 A schematic diagram of the structure of an off-vehicle voice interaction device provided in this application, such as Figure 5 As shown, the vehicle-external voice interaction device 500 provided in this embodiment includes:

[0130] An acquisition module 501 is used to acquire the location information of the vehicle in response to detecting an interaction instruction of a user acting on the vehicle;

[0131] Identification module 502, used to identify the user's intention to find the location corresponding to the location information according to the location information;

[0132] The processing module 503 is used to output scenario-based off-vehicle speech corresponding to the user's intention.

[0133] In a possible implementation, the identification module 502 is specifically configured to:

[0134] The auxiliary information is determined based on the location information and the user intention to identify the user intention at the location corresponding to the location information. The auxiliary information for determining the user intention includes at least one of environmental information, time information, and the number of times the vehicle arrives at the location.

[0135] In a possible implementation, the identification module 502 is used to:

[0136] Perform data preprocessing on the location information and scene judgment auxiliary information to obtain input information for the application intention determination model;

[0137] The input information is input into the intent determination model to determine the intent and determine the user intent of the location corresponding to the location information.

[0138] In a possible implementation manner, the processing module 503 is specifically configured to:

[0139] Perform data cleaning on location information and scene judgment auxiliary information;

[0140] The location information and scene judgment auxiliary information after data cleaning are encoded to obtain the input information of the application intention determination model.

[0141] In a possible implementation manner, the processing module 503 is specifically configured to:

[0142] Based on the user intention of the location corresponding to the location information, text generation technology is applied to generate scenario-based text content;

[0143] Conduct data review on scenario-based text content to determine the scenario-based text content that corresponds to the user's intent;

[0144] Output the scenario-based text content of the user's intention.

[0145] In a possible implementation, when the user intends to determine that the auxiliary information includes the number of times the vehicle arrives at a location, different numbers of times correspond to different scenario-based text contents.

[0146] In a possible implementation, the acquisition module 501 is specifically used to:

[0147] Activate the GNSS receiver inside the IoV module; decode the received satellite signal through the GNSS receiver; determine the location information of the vehicle based on the received satellite signal based on the positioning algorithm;

[0148] And / or, obtaining the vehicle's location information from a navigation map module.

[0149] Further, the detailed structural diagram of the vehicle-external voice interaction device can be referred to Figure 6 , Figure 6 A detailed structural diagram of the off-vehicle voice interaction device provided in an embodiment of the present application. Figure 6 The input module in is equivalent to Figure 5 The acquisition module in Figure 6 The data processing module and data training module in are equivalent to Figure 5 The recognition module, text content generation module, data review module and output module in are equivalent to Figure 5 The processing module in .

[0150] The off-vehicle voice interaction device provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effects are similar, and will not be described in detail in this embodiment.

[0151] It should be noted that it should be understood that the division of the various modules of the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the processing module can be a separately established processing element, or it can be integrated in a chip of the above device. In addition, it can also be stored in the memory of the above device in the form of program code, and called and executed by a processing element of the above device. The implementation of other modules is similar. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.

[0152] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more microprocessors (DSP), or one or more field programmable gate arrays (FPGA). For another example, when a module is implemented in the form of a processing element to allocate program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processors that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0153] Figure 7 This is a schematic diagram of the structure of an electronic device provided by an embodiment of the present application. Figure 7 As shown, the electronic device 700 provided in the embodiment of the present application may include: a processor 701, and a memory 702 connected to the processor in communication, wherein:

[0154] Memory stores computer-executable instructions;

[0155] The processor executes the computer-executable instructions stored in the memory to implement the method described in the foregoing method embodiment.

[0156] It should be understood that the processor 701 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor can be a microprocessor or the processor can be any conventional processor, etc. The steps of the method disclosed in the application can be directly embodied as being executed by a hardware processor, or executed by a combination of hardware and software modules in the processor. The memory 702 may include a high-speed random access memory (RAM), and may also include non-volatile storage NVM (non-volatile memory), such as at least one disk storage, and can also be a USB flash drive, a mobile hard disk, a read-only memory, a disk or an optical disk, etc.

[0157] Optionally, the electronic device 700 may further include a communication interface 703. In a specific implementation, if the communication interface 703, the memory 702 and the processor 701 are implemented independently, the communication interface 703, the memory 702 and the processor 701 may be interconnected through a bus and communicate with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0158] Optionally, in a specific implementation, if the communication interface 703, the memory 702 and the processor 701 are integrated on a chip, the communication interface 703, the memory 702 and the processor 701 can communicate through an internal interface.

[0159] An embodiment of the present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed, they are used to implement the method described in any of the aforementioned embodiments.

[0160] It is understood that the computer readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special computer.

[0161] An exemplary computer-readable storage medium is coupled to a processor so that the processor can read information from the computer-readable storage medium and write information to the computer-readable storage medium. Of course, the computer-readable storage medium can also be an integral part of the processor. The processor and the computer-readable storage medium can be located in an ASIC. Of course, the processor and the computer-readable storage medium can also exist in an electronic device as discrete components.

[0162] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a computer-readable storage medium, including a number of instructions for enabling an electronic device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the method described in each embodiment of the present application.

[0163] An embodiment of the present application also provides a computer program product, including a computer program, which implements the method described in any of the above embodiments when executed.

[0164] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application.

[0165] It should be further noted that, although the various steps in the flowchart are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowchart may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0166] In the above embodiments, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0167] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0168] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A method for voice interaction outside a vehicle, characterized in that: include: In response to detecting an interaction instruction from a user acting on a vehicle, obtaining location information of the vehicle; According to the location information, identifying the user's intention to locate the location corresponding to the location information; Output the scenario-based out-of-vehicle voice corresponding to the user's intention.

2. The method for external voice interaction according to claim 1, characterized in that: The step of identifying the user intention of the location corresponding to the location information according to the location information includes: The user intention to determine the location corresponding to the location information is identified based on the location information and the user intention determination auxiliary information, wherein the user intention determination auxiliary information includes at least one of environmental information, time information, and the number of times the vehicle arrives at the location.

3. The method for external voice interaction according to claim 2, characterized in that: The step of determining the auxiliary information based on the location information and the user intention to identify the user intention of the location corresponding to the location information includes: Performing data preprocessing on the location information and the scene judgment auxiliary information to obtain input information of an application intention determination model; The input information is input into an intention determination model to perform intention determination, and determine the user intention of the location corresponding to the location information.

4. The method for external voice interaction according to claim 3, characterized in that: The location information and the scene judgment auxiliary information are subjected to data preprocessing to obtain input information of an application intention determination model, including: Performing data cleaning on the location information and the scene determination auxiliary information; The cleaned location information and scene judgment auxiliary information are encoded to obtain input information of the application intention determination model.

5. The vehicle-external voice interaction method according to any one of claims 1 to 4, characterized in that: The outputting the scenario-based out-of-vehicle speech corresponding to the user's intention includes: Based on the user intention of the location corresponding to the location information, applying text generation technology to generate scenario-based text content; Performing data review on the scenario-based text content to determine the scenario-based text content corresponding to the user's intention; Output the contextualized text content of the user's intention.

6. The method for external voice interaction according to claim 5, characterized in that: When the user intends to judge that the auxiliary information includes the number of times the vehicle arrives at a location, different number of times correspond to different scenario-based text contents.

7. An off-vehicle voice interaction device, characterized in that: include: An acquisition module, configured to acquire the position information of the vehicle in response to detecting an interaction instruction of a user acting on the vehicle; An identification module, used to identify the user's intention to find the location corresponding to the location information according to the location information; A processing module is used to output scenario-based out-of-vehicle speech corresponding to the user's intention.

8. An electronic device, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed.

10. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 7 when being executed.

Images