In-vehicle voice remote interaction method and system

Abstract

An embodiment of the present invention provides an in-vehicle voice remote interaction method and system, including: after establishing a communication connection with a smart device, receiving activation request information sent by the smart device; responding to the activation request information of the smart device and generating prompt information; sending the prompt information to the smart device and receiving input information sent by the smart device; using a preset semantic processing algorithm to process the input information to obtain instruction information corresponding to the input information; performing corresponding operations according to the instruction information and generating execution result data; sending the execution result data to the smart device; wherein the activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information; the vehicle can be controlled to perform corresponding operations through the interaction between the smart device and the in-vehicle voice assistant, thereby improving the user experience.

Description

Technical Field

[0001] The present invention relates to the field of vehicle control technology, and in particular to a vehicle-mounted voice remote interaction method and system. Background Art

[0002] With the development of automobile intelligence, cars are not only used as a means of transportation, but also have other functions. The car is equipped with not only remote monitoring cameras, large screens like TVs and audio equipment, but also a comprehensive in-car voice assistant.

[0003] When the driver has to go out for something, the elderly, children or pets sitting in the back seat can listen to music, watch TV, rest or play in the car. Although the driver can observe the situation inside the car through the remote monitoring camera, there are great obstacles for the elderly, children or pets to use smart cars, and the remote control of the driver's smart device has very limited control operations on the vehicle equipment, resulting in a poor user experience. Summary of the invention

[0004] In view of this, the purpose of the present invention is to provide an in-vehicle voice remote interaction method and system, which can control the vehicle to perform corresponding operations through the interaction between the smart device and the in-vehicle voice assistant, thereby improving the user experience.

[0005] In a first aspect, an embodiment of the present invention provides a vehicle-mounted voice remote interaction method, which is applied to a vehicle-mounted voice assistant, and the method includes:

[0006] After establishing a communication connection with the smart device, receiving activation request information sent by the smart device;

[0007] In response to the activation request information of the smart device, generating prompt information;

[0008] Sending the prompt information to the smart device, and receiving input information sent by the smart device;

[0009] Using a preset semantic processing algorithm to process the input information to obtain instruction information corresponding to the input information;

[0010] Execute corresponding operations according to the instruction information and generate execution result data;

[0011] Sending the execution result data to the smart device;

[0012] The activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information.

[0013] Furthermore, a communication connection is established with the smart device in the following manner:

[0014] Receiving remote connection request information sent by the smart device, wherein the remote connection request information includes account information and vehicle information;

[0015] comparing the account information with pre-stored account information, and the vehicle information with pre-stored vehicle information;

[0016] If they are consistent, a communication connection is established with the smart device;

[0017] If they are inconsistent, no communication connection is established with the smart device.

[0018] Furthermore, before establishing a communication connection with the smart device, the method further includes:

[0019] Get the operation instructions input by the user;

[0020] The remote mode is turned on according to the operation instruction.

[0021] Furthermore, the method further comprises:

[0022] Determining the type of the execution result data;

[0023] If the execution result data is audio data, playing the audio data by voice;

[0024] If the execution result data is text data, the text data is displayed.

[0025] In a second aspect, an embodiment of the present invention provides a vehicle-mounted voice remote interaction method, which is applied to a smart device, and the method includes:

[0026] After establishing a communication connection with the in-vehicle voice assistant, sending activation request information to the in-vehicle voice assistant, so that the in-vehicle voice assistant responds to the activation request information and generates prompt information;

[0027] Receiving the prompt information sent by the in-vehicle voice assistant;

[0028] Sending the input information to the in-vehicle voice assistant so that the in-vehicle voice assistant uses a preset semantic processing algorithm to process the input information and obtain instruction information corresponding to the input information; performing corresponding operations according to the instruction information and generating execution result data;

[0029] Receiving the execution result data sent by the in-vehicle voice assistant;

[0030] The activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information.

[0031] Furthermore, the method further comprises:

[0032] Determining the type of the execution result data;

[0033] If the execution result data is audio data, playing the audio data by voice;

[0034] If the execution result data is text data, the text data is displayed.

[0035] In a third aspect, an embodiment of the present invention provides an in-vehicle voice remote interaction system, which is applied to an in-vehicle voice assistant, and the system includes: a remote communication module, a remote input data processing module, and a result data generation module;

[0036] The remote communication module is used to receive activation request information sent by the smart device after establishing a communication connection with the smart device; generate prompt information in response to the activation request information of the smart device; send the prompt information to the smart device, and receive input information sent by the smart device;

[0037] The remote input data processing module is used to process the input information using a preset semantic processing algorithm to obtain instruction information corresponding to the input information; the result data generation module is used to perform corresponding operations according to the instruction information and generate execution result data; and send the execution result data to the smart device;

[0038] The activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information.

[0039] Furthermore, a communication connection is established with the smart device in the following manner:

[0040] Receiving remote connection request information sent by the smart device, wherein the remote connection request information includes account information and vehicle information;

[0041] comparing the account information with pre-stored account information, and the vehicle information with pre-stored vehicle information;

[0042] If they are consistent, a communication connection is established with the smart device;

[0043] If they are inconsistent, no communication connection is established with the smart device.

[0044] Furthermore, the system also includes a dialogue mode management module;

[0045] The dialogue mode management module is used to obtain an operation instruction input by a user before establishing a communication connection with the smart device; and to start the remote mode according to the operation instruction.

[0046] Furthermore, the system also includes a result data local processing module, a first broadcasting module and a first display module;

[0047] The result data local processing module is used to determine the type of the execution result data;

[0048] The first broadcasting module is used for playing the audio data by voice when the execution result data is audio data;

[0049] The first display module is used to display the text data when the execution result data is text data.

[0050] In a fourth aspect, an embodiment of the present invention provides a vehicle-mounted voice remote interaction system, which is applied to a smart device, wherein the system includes a wireless communication module, and the wireless communication module includes a sending unit and a receiving unit;

[0051] The sending unit is used to send activation request information to the in-vehicle voice assistant after establishing a communication connection with the in-vehicle voice assistant, so that the in-vehicle voice assistant responds to the activation request information and generates prompt information;

[0052] The receiving unit is used to receive the prompt information sent by the in-vehicle voice assistant; send the input information to the in-vehicle voice assistant so that the in-vehicle voice assistant uses a preset semantic processing algorithm to process the input information and obtain instruction information corresponding to the input information; perform corresponding operations according to the instruction information and generate execution result data; receive the execution result data sent by the in-vehicle voice assistant;

[0053] The activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information.

[0054] In a fifth aspect, an embodiment of the present invention provides an electronic device, including a memory and a processor, wherein the memory stores a computer program executable on the processor, and the processor implements the method described above when executing the computer program.

[0055] An embodiment of the present invention provides an in-vehicle voice remote interaction method and system, including: after establishing a communication connection with a smart device, receiving activation request information sent by the smart device; responding to the activation request information of the smart device and generating prompt information; sending the prompt information to the smart device and receiving input information sent by the smart device; using a preset semantic processing algorithm to process the input information to obtain instruction information corresponding to the input information; performing corresponding operations according to the instruction information and generating execution result data; sending the execution result data to the smart device; wherein the activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information; the vehicle can be controlled to perform corresponding operations through the interaction between the smart device and the in-vehicle voice assistant, thereby improving the user experience.

[0056] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0057] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0059] Figure 1 A flow chart of the vehicle-mounted voice remote interaction method provided in the first embodiment of the present invention;

[0060] Figure 2 A flow chart of another in-vehicle voice remote interaction method provided in Embodiment 2 of the present invention;

[0061] Figure 3 A schematic diagram of a vehicle-mounted voice remote interaction system provided in Embodiment 3 of the present invention;

[0062] Figure 4 A schematic diagram of another vehicle-mounted voice remote interaction system provided in Embodiment 4 of the present invention;

[0063] Figure 5 Schematic diagram of the interactive system between the smart device and the in-vehicle voice assistant in the vehicle provided in the fifth embodiment of the present invention. DETAILED DESCRIPTION

[0064] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0065] To facilitate understanding of this embodiment, the embodiment of the present invention is described in detail below.

[0066] Embodiment 1:

[0067] Figure 1 This is a flow chart of the in-vehicle voice remote interaction method provided in Example 1 of the present invention.

[0068] Reference Figure 1 , the execution subject is a vehicle voice assistant, and the method includes the following steps:

[0069] Step S101, after establishing a communication connection with a smart device, receiving activation request information sent by the smart device;

[0070] Step S102, generating prompt information in response to the activation request information of the smart device;

[0071] Step S103, sending the prompt information to the smart device, and receiving the input information sent by the smart device;

[0072] Step S104, using a preset semantic processing algorithm to process the input information to obtain instruction information corresponding to the input information;

[0073] Specifically, the preset semantic processing algorithm includes a natural semantic recognition algorithm and a natural semantic processing algorithm, that is, the input information is passed through the natural semantic recognition algorithm to obtain the intention information; wherein the intention information is a structured string; the intention information is passed through the natural semantic processing algorithm to obtain the instruction information;

[0074] Step S105, executing corresponding operations according to the instruction information and generating execution result data;

[0075] Step S106, sending the execution result data to the smart device;

[0076] The activation request information is the voice conversation information initiated by the user, and the prompt information is the activated response information. When the in-vehicle voice assistant establishes a communication connection with the smart device, in order to ensure that the in-vehicle voice assistant and the smart device can establish a normal conversation, the in-vehicle voice assistant receives the activation request information sent by the smart device. The activation request information is the voice conversation information initiated by the user, which means that the in-vehicle voice assistant can hear the voice conversation information initiated by the user and can communicate with the user through the smart device; after the in-vehicle voice assistant responds, it generates a prompt information and sends the prompt information to the smart device. At this time, the in-vehicle voice assistant and the smart device can communicate normally.

[0077] In this embodiment, after the vehicle-mounted voice assistant establishes a communication connection with the smart device, it receives the activation request information sent by the smart device; the vehicle-mounted voice assistant responds to the activation request information of the smart device and generates prompt information; the prompt information is sent to the smart device, and the input information sent by the smart device is received; the input information is processed using a preset semantic processing algorithm to obtain the instruction information corresponding to the input information; the corresponding operation is performed according to the instruction information, and execution result data is generated; the execution result data is sent to the smart device, so that the vehicle-mounted voice assistant and the smart device can realize information interaction and control the vehicle to perform the corresponding operation, thereby improving the user experience. Among them, the present application processes the input information through the vehicle-mounted voice assistant, because the vehicle-mounted voice assistant has high processing power and strong compatibility with data. At this time, there is no need to develop a system on the smart device to process the input information; when the vehicle-mounted voice assistant completes the processing of the input information, the execution result data is directly sent to the smart device.

[0078] Furthermore, a communication connection is established with the smart device in the following ways:

[0079] Receiving remote connection request information sent by the smart device, the remote connection request information includes account information and vehicle information;

[0080] comparing the account information with the pre-stored account information and the vehicle information with the pre-stored vehicle information;

[0081] If they are consistent, a communication connection is established with the smart device;

[0082] If they are inconsistent, no communication connection is established with the smart device.

[0083] The account information includes the user name and password, and the vehicle information includes the VIN (Vehicle Identification Number) and the SN (Serial Number) of the ECU (Electronic Control Unit).

[0084] Specifically, in the process of establishing a connection between the smart device and the in-vehicle voice assistant, the smart device needs to send remote connection request information to the in-vehicle voice assistant. After the in-vehicle voice assistant authenticates the remote connection request information, it compares the account information with the pre-stored account information, and the vehicle information with the pre-stored vehicle information. If they are consistent, the in-vehicle voice assistant and the smart device establish a communication connection; if they are inconsistent, the in-vehicle voice assistant and the smart device cannot establish a communication connection.

[0085] Furthermore, before establishing a communication connection with the smart device, the method further includes the following steps:

[0086] Step S201, obtaining an operation instruction input by a user;

[0087] Step S202: start the remote mode according to the operation instruction.

[0088] Here, when the driver has to go out for something temporarily, the elderly, children or pets sitting in the back seat can listen to music, watch TV, rest or play in the car. The driver can click a button or click the indicator light on the screen. At this time, the in-vehicle voice assistant obtains the operation instruction input by the user (driver) and turns on the remote mode according to the operation instruction. After the in-vehicle voice assistant establishes a connection with the smart device, the in-vehicle voice assistant and the smart device realize information exchange. This application can be applied to ROX01.

[0089] Furthermore, the method further comprises the following steps:

[0090] Step S301, determine the type of the execution result data; if the execution result data is audio data, execute step S302; if the execution result data is text data, execute step S303;

[0091] Step S302, playing audio data by voice;

[0092] Step S303: display text data.

[0093] Here, when the in-vehicle voice assistant performs the corresponding operation according to the instruction information and generates the execution result data, it can be displayed locally or played by voice. At this time, it is necessary to determine the type of the execution result data. If it is audio data, the audio data is played by voice; if it is text data entered by the user, the text data is displayed on the screen.

[0094] An embodiment of the present invention provides an in-vehicle voice remote interaction method, comprising: after establishing a communication connection with a smart device, receiving activation request information sent by the smart device; responding to the activation request information of the smart device and generating prompt information; sending the prompt information to the smart device, and receiving input information sent by the smart device; using a preset semantic processing algorithm to process the input information to obtain instruction information corresponding to the input information; performing corresponding operations according to the instruction information and generating execution result data; sending the execution result data to the smart device; wherein the activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information; the vehicle can be controlled to perform corresponding operations through the interaction between the smart device and the in-vehicle voice assistant, thereby improving the user experience.

[0095] Embodiment 2:

[0096] Figure 2 This is a flow chart of another in-vehicle voice remote interaction method provided in Embodiment 2 of the present invention.

[0097] Reference Figure 2 The execution subject is a smart device, and an APP (Application Program) is installed on the smart device. The method includes the following steps:

[0098] Step S401, after establishing a communication connection with the in-vehicle voice assistant, sending activation request information to the in-vehicle voice assistant, so that the in-vehicle voice assistant responds to the activation request information and generates prompt information;

[0099] Step S402, receiving a prompt message sent by the in-vehicle voice assistant;

[0100] Step S403, sending the input information to the in-vehicle voice assistant, so that the in-vehicle voice assistant uses a preset semantic processing algorithm to process the input information and obtain instruction information corresponding to the input information; performing corresponding operations according to the instruction information and generating execution result data;

[0101] Step S404, receiving the execution result data sent by the in-vehicle voice assistant;

[0102] The activation request information is the voice dialogue information initiated by the user, and the prompt information is the activated response information.

[0103] In this embodiment, after the in-vehicle voice assistant establishes a communication connection with the smart device, an activation request message is sent to the in-vehicle voice assistant, so that the in-vehicle voice assistant responds to the activation request message and generates prompt information; the smart device receives the prompt information sent by the in-vehicle voice assistant; the smart device sends input information to the in-vehicle voice assistant, and the in-vehicle voice assistant processes the input information through a natural semantic recognition algorithm and a natural semantic processing algorithm to obtain instruction information; performs corresponding operations according to the instruction information and generates execution result data; sends the execution result data to the smart device, so that the in-vehicle voice assistant and the smart device can realize information interaction and control the vehicle to perform corresponding operations, thereby improving the user experience.

[0104] Furthermore, the method further comprises the following steps:

[0105] Step S501, determine the type of the execution result data; if the execution result data is audio data, execute step S502; if the execution result data is text data, execute step S503;

[0106] Step S502, playing audio data by voice;

[0107] Step S503: display text data.

[0108] Here, when the in-vehicle voice assistant performs the corresponding operation according to the instruction information and generates the execution result data, the execution result data is sent to the smart device, and the smart device can display or play the data locally. At this time, it is necessary to determine the type of the execution result data. If it is audio data, the audio data is played through voice; if it is text data entered by the user, the text data is displayed on the screen.

[0109] An embodiment of the present invention provides a vehicle-mounted voice remote interaction method, including: after establishing a communication connection with a vehicle-mounted voice assistant, sending activation request information to the vehicle-mounted voice assistant, so that the vehicle-mounted voice assistant responds to the activation request information and generates prompt information; receiving the prompt information sent by the vehicle-mounted voice assistant; sending input information to the vehicle-mounted voice assistant, so that the vehicle-mounted voice assistant uses a preset semantic processing algorithm to process the input information and obtain instruction information corresponding to the input information; performing corresponding operations according to the instruction information and generating execution result data; receiving the execution result data sent by the vehicle-mounted voice assistant; wherein the activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information; the vehicle can be controlled to perform corresponding operations through the interaction between the smart device and the vehicle-mounted voice assistant, thereby improving the user experience.

[0110] Embodiment three:

[0111] Figure 3This is a schematic diagram of the in-vehicle voice remote interaction system provided in Example 3 of the present invention.

[0112] Reference Figure 3 , applied to an in-vehicle voice assistant, the system includes: a remote communication module, a remote input data processing module and a result data generation module;

[0113] The remote communication module is used to receive activation request information sent by the smart device after establishing a communication connection with the smart device; respond to the activation request information of the smart device and generate prompt information; send the prompt information to the smart device and receive input information sent by the smart device;

[0114] The remote input data processing module is used to process the input information using a preset semantic processing algorithm to obtain instruction information corresponding to the input information;

[0115] The result data generation module is used to perform corresponding operations according to the instruction information and generate execution result data; and send the execution result data to the smart device; wherein the activation request information is the voice dialogue information initiated by the user, and the prompt information is the activated response information.

[0116] Furthermore, a communication connection is established with the smart device in the following ways:

[0117] Receiving remote connection request information sent by the smart device, the remote connection request information includes account information and vehicle information;

[0118] comparing the account information with the pre-stored account information and the vehicle information with the pre-stored vehicle information;

[0119] If they are consistent, a communication connection is established with the smart device;

[0120] If they are inconsistent, no communication connection is established with the smart device.

[0121] Furthermore, the account information includes a user name and a password, and the vehicle information includes a VIN and an SN code of the ECU.

[0122] Furthermore, the system also includes a dialogue mode management module;

[0123] The dialogue mode management module is used to obtain the operation instructions input by the user before establishing a communication connection with the smart device; and to start the remote mode according to the operation instructions.

[0124] Furthermore, the system also includes a result data local processing module, a first broadcasting module and a first display module;

[0125] A result data local processing module, used to determine the type of execution result data;

[0126] A first broadcasting module, used for playing the audio data by voice when the execution result data is audio data;

[0127] The first display module is used to display text data when the execution result data is text data.

[0128] Specifically, the system also includes a first sound receiving module, a first input module, a local input data processing module and a dialogue module;

[0129] A first sound receiving module, used to obtain audio data input by the user on the in-vehicle voice assistant;

[0130] A first input module, used to obtain text data input by a user on the in-vehicle voice assistant;

[0131] The local input data processing module is used to process the audio data or text data through the natural semantic recognition algorithm and the natural semantic processing algorithm to obtain the instruction information. The processing process is the same as that of the remote input data processing module and will not be described in detail here. The audio data or text data input by the user on the in-vehicle voice assistant is used as the local data, and the input information received by the in-vehicle voice assistant from the smart device is used as the remote data.

[0132] The dialogue module is used to determine whether the remote data or local data is a single-round dialogue or a multi-round dialogue, and to track the status according to the dialogue;

[0133] The dialogue mode management module is also used to determine whether the instruction information is remote data or local data.

[0134] An embodiment of the present invention provides an in-vehicle voice remote interaction system, including: after establishing a communication connection with a smart device, receiving activation request information sent by the smart device; responding to the activation request information of the smart device and generating prompt information; sending the prompt information to the smart device and receiving input information sent by the smart device; using a preset semantic processing algorithm to process the input information to obtain instruction information corresponding to the input information; performing corresponding operations according to the instruction information and generating execution result data; sending the execution result data to the smart device; wherein the activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information; the vehicle can be controlled to perform corresponding operations through the interaction between the smart device and the in-vehicle voice assistant, thereby improving the user experience.

[0135] Embodiment 4:

[0136] Figure 4 A schematic diagram of another in-vehicle voice remote interaction system provided in Embodiment 4 of the present invention.

[0137] Reference Figure 4, applied to smart devices, the system includes a wireless communication module, the wireless communication module includes a sending unit and a receiving unit;

[0138] A sending unit, configured to send activation request information to the in-vehicle voice assistant after establishing a communication connection with the in-vehicle voice assistant, so that the in-vehicle voice assistant responds to the activation request information and generates prompt information;

[0139] A receiving unit is used to receive the prompt information sent by the vehicle-mounted voice assistant; send the input information to the vehicle-mounted voice assistant so that the vehicle-mounted voice assistant uses a preset semantic processing algorithm to process the input information and obtain instruction information corresponding to the input information; perform corresponding operations according to the instruction information and generate execution result data; receive the execution result data sent by the vehicle-mounted voice assistant;

[0140] The activation request information is the voice dialogue information initiated by the user, and the prompt information is the activated response information.

[0141] Furthermore, the system also includes a data processing module, a second broadcasting module and a second display module;

[0142] A data processing module, used to determine the type of execution result data;

[0143] A second broadcasting module, used for playing the audio data by voice when the execution result data is audio data;

[0144] The second display module is used to display text data when the execution result data is text data.

[0145] Specifically, the system also includes a second sound receiving module and a second input module;

[0146] The second sound receiving module is used to obtain audio data input by the user on the smart device; wherein the second sound receiving module can be a microphone.

[0147] The first input module is used to obtain text data input by the user on the smart device.

[0148] An embodiment of the present invention provides an in-vehicle voice remote interaction system, including: after establishing a communication connection with an in-vehicle voice assistant, sending activation request information to the in-vehicle voice assistant, so that the in-vehicle voice assistant responds to the activation request information and generates prompt information; receiving the prompt information sent by the in-vehicle voice assistant; sending input information to the in-vehicle voice assistant, so that the in-vehicle voice assistant uses a preset semantic processing algorithm to process the input information and obtain instruction information corresponding to the input information; performing corresponding operations according to the instruction information and generating execution result data; receiving the execution result data sent by the in-vehicle voice assistant; wherein the activation request information is voice dialogue information initiated by the user, and the prompt information is activated response information; the vehicle can be controlled to perform corresponding operations through the interaction between the smart device and the in-vehicle voice assistant, thereby improving the user experience.

[0149] Embodiment five:

[0150] Figure 5 Schematic diagram of the interactive system between the smart device and the in-vehicle voice assistant in the vehicle provided in the fifth embodiment of the present invention.

[0151] Reference Figure 5 The system includes a smart device, a vehicle and a remote server, wherein the vehicle includes a vehicle control unit, an on-board communication unit, an on-board voice assistant, vehicle sensors and actuators, and the actuators include equipment such as air conditioning, audio and display screens.

[0152] The vehicle sensor is used to collect internal parameters of the vehicle, where the internal parameters include but are not limited to temperature and humidity.

[0153] The vehicle control unit is used to control the actuator to perform corresponding operations according to the command information.

[0154] When the smart device sends demand information to the in-vehicle voice assistant, the in-vehicle voice assistant sends the demand information to the remote server. The remote server obtains feedback result information based on the demand information and sends it to the in-vehicle voice assistant. The in-vehicle voice assistant then sends the feedback result information to the smart device.

[0155] After the smart device establishes a connection with the on-board voice assistant through the on-board communication unit, it receives the activation request information sent by the smart device; the on-board voice assistant responds to the activation request information of the smart device, generates prompt information, and sends the prompt information to the smart device; the on-board voice assistant receives the input information sent by the smart device; after processing the input information, it obtains the command information, and the on-board voice assistant performs the corresponding operation according to the command information and generates execution result data; the on-board voice assistant sends the execution result data to the smart device; the smart device interacts with the on-board voice assistant to realize functions such as on-demand audio and video content and vehicle control in the car, so as to facilitate outgoing car owners to adjust the air conditioner or on-demand movies for the elderly, children or pets stranded in the car, thereby improving the experience of the elderly, children and pets.

[0156] An embodiment of the present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the in-vehicle voice remote interaction method provided in the above embodiment are implemented.

[0157] An embodiment of the present invention also provides a computer-readable medium having a non-volatile program code executable by a processor, wherein a computer program is stored on the computer-readable medium, and when the computer program is executed by the processor, the steps of the in-vehicle voice remote interaction method of the above embodiment are executed.

[0158] The computer program product provided in the embodiment of the present invention includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the method described in the previous method embodiment. The specific implementation can be found in the method embodiment and will not be repeated here.

[0159] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0160] In addition, in the description of the embodiments of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0161] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0162] In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0163] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A vehicle-mounted voice remote interaction method, characterized in that: Applied to an in-vehicle voice assistant, the method includes: After establishing a communication connection with the smart device, receiving activation request information sent by the smart device; In response to the activation request information of the smart device, generating prompt information; Sending the prompt information to the smart device, and receiving input information sent by the smart device; Using a preset semantic processing algorithm to process the input information to obtain instruction information corresponding to the input information; Execute corresponding operations according to the instruction information and generate execution result data; Sending the execution result data to the smart device; Wherein, the activation request information is the voice dialogue information initiated by the user, and the prompt information is the activated response information; Establish a communication connection with the smart device in the following ways: Receiving remote connection request information sent by the smart device, wherein the remote connection request information includes account information and vehicle information; comparing the account information with pre-stored account information, and the vehicle information with pre-stored vehicle information; If they are consistent, a communication connection is established with the smart device; If they are inconsistent, no communication connection is established with the smart device; The method further comprises: Determining the type of the execution result data; If the execution result data is audio data, playing the audio data by voice; If the execution result data is text data, the text data is displayed.

2. The vehicle-mounted voice remote interaction method according to claim 1, characterized in that: Before establishing a communication connection with the smart device, the method further includes: Get the operation instructions input by the user; The remote mode is turned on according to the operation instruction.

3. A vehicle-mounted voice remote interaction system, characterized in that: Applied to an in-vehicle voice assistant, the system comprises: a remote communication module, a remote input data processing module and a result data generation module; The remote communication module is used to receive activation request information sent by the smart device after establishing a communication connection with the smart device; generate prompt information in response to the activation request information of the smart device; send the prompt information to the smart device, and receive input information sent by the smart device; The remote input data processing module is used to process the input information using a preset semantic processing algorithm to obtain instruction information corresponding to the input information; the result data generation module is used to perform corresponding operations according to the instruction information and generate execution result data; and send the execution result data to the smart device; Wherein, the activation request information is the voice dialogue information initiated by the user, and the prompt information is the activated response information; Establish a communication connection with the smart device in the following ways: Receiving remote connection request information sent by the smart device, wherein the remote connection request information includes account information and vehicle information; comparing the account information with pre-stored account information, and the vehicle information with pre-stored vehicle information; If they are consistent, a communication connection is established with the smart device; If they are inconsistent, no communication connection is established with the smart device; The system also includes a result data local processing module, a first broadcasting module and a first display module; The result data local processing module is used to determine the type of the execution result data; The first broadcasting module is used for playing the audio data by voice when the execution result data is audio data; The first display module is used to display the text data when the execution result data is text data.

4. The vehicle-mounted voice remote interaction system according to claim 3, characterized in that: The system also includes a dialogue mode management module; The dialogue mode management module is used to obtain an operation instruction input by a user before establishing a communication connection with the smart device; and to start the remote mode according to the operation instruction.

5. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, wherein: When the processor executes the computer program, the in-vehicle voice remote interaction method described in claim 1 or 2 is implemented.

Images