Voice communication method and device

Abstract

The invention discloses a voice communication method and device, and the method comprises the steps: obtaining a first voice intention of first voice information based on the first voice information under the condition that the first voice information is obtained; the first voice information and the first voice intention are sent to the second device, and the first voice intention is used for being executed by the second device under the condition that the first voice intention is consistent with a second voice intention obtained by recognizing the first voice information by the second device. According to the method, on one hand, the privacy data required for executing the first voice intention cannot be acquired by the first equipment, so that privacy information leakage can be avoided, and on the other hand, the interface of the second equipment can be prevented from being maliciously called, so that the security of voice communication can be improved.

Description

Technical Field

[0001] The present application relates to the field of voice communication technology, and in particular to a voice communication method and device. Background Art

[0002] Car computers usually have a classic Bluetooth pairing function. After the mobile phone and the car computer are connected via Bluetooth, when a voice command is given to the car computer, the car computer requests the mobile phone to obtain access rights to private messages such as contacts and short messages. When the car computer itself has cellular Internet access and is equipped with some malicious third-party applications, it is easy to cause private information on the mobile phone to be leaked, resulting in low security of voice communication.

[0003] That is, the security of voice communication in the prior art is not high. Summary of the invention

[0004] The embodiments of the present application provide a voice communication method and device, which can improve the security of voice communication.

[0005] In a first aspect, the voice communication method provided by the present application is applied to a first device, including:

[0006] When the first voice information is acquired, obtaining a first voice intention of the first voice information based on the first voice information;

[0007] The first voice information and the first voice intention are sent to the second device, wherein the first voice intention is compared with the second voice intention obtained by the second device recognizing the first voice information. Figure 1 When the above happens, the second device is used for execution.

[0008] In a second aspect, the voice communication method provided by the present application is applied to a second device, including:

[0009] When receiving a first voice message and a first voice intent sent by a first device, identifying the first voice message to obtain a second voice intent, wherein the first voice message is obtained by the first device, and the first voice intent is obtained by the first device by identifying the first voice message;

[0010] In the first voice intention and the second voice intention Figure 1 If the above situation occurs, execute the first voice intention.

[0011] In a third aspect, the present application provides a voice communication device, including:

[0012] A parsing module, configured to obtain a first voice intention of the first voice information based on the first voice information when the first voice information is acquired;

[0013] The sending module is used to send the first voice information and the first voice intention to the second device, wherein the first voice intention is compared with the second voice intention obtained by the second device recognizing the first voice information. Figure 1 When the above happens, the second device is used for execution.

[0014] In a fourth aspect, the present application provides a voice communication device, including:

[0015] an intention determination module, configured to, upon receiving first voice information and a first voice intention sent by a first device, identify the first voice information to obtain a second voice intention, wherein the first voice information is obtained by the first device, and the first voice intention is obtained by the first device identifying the first voice information;

[0016] The intention execution module is used to execute the first voice intention and the second voice intention. Figure 1 If the above situation occurs, execute the first voice intention.

[0017] In the fifth aspect, the electronic device provided in the present application includes a memory and a processor, the memory stores a computer program, and the processor is used to run the computer program in the memory to implement the steps in the voice communication method of the first aspect or the steps in the voice communication method of the second aspect provided in the present application.

[0018] In a sixth aspect, the computer-readable storage medium provided in the present application stores a plurality of instructions, which are suitable for loading by a processor to implement the steps in the voice communication method of the first aspect or the steps in the voice communication method of the second aspect provided in the present application.

[0019] In the seventh aspect, the computer program product provided in the present application includes a computer program or instructions, which, when executed by a processor, implements the steps in the voice communication method of the first aspect or the steps in the voice communication method of the second aspect provided in the present application.

[0020] In the present application, compared with the related art, the first voice information collected by the first device is parsed to obtain the first voice intention of the first voice information; the first voice information and the first voice intention are sent to the second device, wherein the first voice intention is compared with the second voice intention obtained by the second device recognizing the first voice information. Figure 1On the one hand, since the first device is responsible for parsing the collected voice information to obtain the first voice intent, and the execution of the first voice intent is the responsibility of the second device, the privacy data required to execute the first voice intent will not be obtained by the first device, thereby avoiding the leakage of privacy information. On the other hand, after obtaining the first voice information and the first voice intent sent by the first device, the second device needs to identify the first voice information to obtain the second voice intent, and perform the first voice intent and the second voice intent on the first voice intent. Figure 1 By executing the first voice intention in a timely manner, the interface of the second device can be prevented from being maliciously called, thereby improving the security of voice communication. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 is a scenario diagram of a voice communication system provided in an embodiment of the present application;

[0023] Figure 2 It is a flowchart of a first embodiment of the voice communication method provided by the embodiment of the present application;

[0024] Figure 3 It is a flowchart of a second embodiment of the voice communication method provided in the embodiment of the present application;

[0025] Figure 4 It is a flowchart of a third embodiment of the voice communication method provided in the embodiment of the present application;

[0026] Figure 5 It is a flowchart of a fourth embodiment of the voice communication method provided in the embodiments of the present application;

[0027] Figure 6 It is a schematic diagram of the structure of an embodiment of a voice communication device provided in an embodiment of the present application;

[0028] Figure 7 is a schematic diagram of the structure of another embodiment of the voice communication device provided in an embodiment of the present application;

[0029] Figure 8 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] It should be noted that the principles of the present application are illustrated by implementing them in an appropriate computing environment. The following description is based on the illustrated specific embodiments of the present application and should not be considered as limiting other specific embodiments of the present application that are not described in detail herein.

[0031] In the following description of the present application, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it can be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0032] In the following description of the present application, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0034] In order to improve the effect of voice communication, the embodiments of the present application provide a voice communication method, a voice communication device, an electronic device, a computer-readable storage medium, and a computer program product. The voice communication method can be executed by the voice communication device, or by an electronic device integrated with the voice communication device.

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0036] Please refer to Figure 1 , the present application also provides a voice communication system, such as Figure 1 As shown, the voice communication system includes a first electronic device 100 and a second electronic device 200. The first electronic device 100 is integrated with the voice communication device provided in the present application, and the second electronic device 200 is integrated with the voice communication device provided in the present application.

[0037] Among them, the first electronic device 100 can be any device equipped with a processor and has processing capabilities, such as mobile electronic devices with processors such as smart phones, tablet computers, PDAs, laptops, smart speakers, or fixed electronic devices with processors such as desktop computers, televisions, servers, industrial equipment, etc.

[0038] Among them, the second electronic device 200 can be any device equipped with a processor and has processing capabilities, such as mobile electronic devices with processors such as smart phones, tablet computers, PDAs, laptops, smart speakers, or fixed electronic devices with processors such as desktop computers, televisions, servers, industrial equipment, etc.

[0039] In a specific embodiment, the first electronic device 100 is a vehicle-mounted terminal, and the second electronic device 200 is a mobile terminal. In another specific embodiment, the first electronic device 100 is a desktop computer, and the second electronic device 200 is a mobile terminal. In yet another specific embodiment, the first electronic device 100 is a television, and the second electronic device 200 is a mobile terminal.

[0040] In addition, the voice communication system may further include a memory for storing original data, intermediate data and result data.

[0041] In the embodiment of the present application, the memory may be a cloud memory. Cloud storage is a new concept extended and developed from the concept of cloud computing. A distributed cloud storage system (hereinafter referred to as the storage system) refers to a storage system that uses cluster applications, grid technology, and distributed storage file systems to bring together a large number of storage devices of various types (storage devices are also called storage nodes) in the network through application software or application interfaces to work together and provide external data storage and business access functions.

[0042] At present, the storage method of the storage system is: create a logical volume, and when creating a logical volume, allocate physical storage space for each logical volume. The physical storage space may be composed of disks of a storage device or several storage devices. The client stores data on a logical volume, that is, stores the data on the file system. The file system divides the data into many parts, each of which is an object. The object contains not only data but also additional information such as data identification (ID, ID entity). The file system writes each object into the physical storage space of the logical volume, and the file system records the storage location information of each object, so that when the client requests to access the data, the file system can allow the client to access the data according to the storage location information of each object.

[0043] The process of the storage system allocating physical storage space to a logical volume is as follows: based on the estimated capacity of the objects stored in the logical volume (this estimate often has a large margin relative to the actual capacity of the objects to be stored) and the grouping of independent redundant disk arrays (RAID, Redundant Array of Independent Disks), the physical storage space is pre-divided into stripes. A logical volume can be understood as a stripe, thereby allocating physical storage space to the logical volume.

[0044] It should be noted that Figure 1 The scenario diagram of the voice communication system shown is only an example. The voice communication system and scenario described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided in the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the voice communication system and the emergence of new business scenarios, the technical solution provided in the embodiment of the present application is also applicable to similar technical problems.

[0045] It should be noted that the serial numbers of the following embodiments are not intended to limit the preferred order of the embodiments.

[0046] Please refer to Figure 2 , Figure 2 : is a flow chart of a first embodiment of the voice communication method provided in the embodiment of the present application. Figure 2 As shown, the process of the voice communication method provided by this application is as follows:

[0047] 201. When first voice information is acquired, obtain a first voice intent of the first voice information based on the first voice information.

[0048] In the embodiment of the present application, the first device may be integrated with the first audio collection device, or may be externally connected to the first audio collection device. The first audio collection device may be a microphone, etc. The first device collects the first voice information through the first audio collection device. When the user speaks, the first device receives the sound through the first audio collection device to obtain the first voice information. The first voice information may be a paragraph spoken by the user, for example, the first voice information is "Call XX", "Play song AA", "Play video BB", etc.

[0049] In a specific embodiment, based on the first voice information, obtaining the first voice intention of the first voice information includes: performing voice recognition on the first voice information to obtain text information of the first voice information; inputting the text information of the first voice information into a pre-trained intention detection model to obtain the first voice intention of the first voice information. Among them, the intention detection model can be various trained natural language processing models. Automatic speech recognition technology (Automatic Speech Recognition, ASR) is a technology that converts human speech into text. Speech recognition is a multidisciplinary field, which is closely related to many disciplines such as acoustics, phonetics, linguistics, digital signal processing theory, information theory, computer science, etc. Natural language processing (Natural Language Processing, NLP) is a subfield of artificial intelligence (AI). Natural language is the crystallization of human wisdom, natural language processing is one of the most difficult problems in artificial intelligence, and the research on natural language processing is also full of charm and challenges. By recognizing the intention of the first voice information through a pre-trained intention detection model, the accuracy of intention recognition can be improved.

[0050] Among them, the intent detection model can be a BERT model and an XLNet model. BERT stands for Bidirectional Encoder Representation from Transformers, which is a pre-trained language representation model. It emphasizes that it is no longer the traditional unidirectional language model or the shallow concatenation of two unidirectional language models for pre-training as in the past, but can generate deep bidirectional language representation.

[0051] The first voice intention may be various control instructions. The first voice intention may be a call instruction, a play instruction, etc. For example, the first voice intention may be "call XX", "play song AA", "play video BB", etc.

[0052] 202. Sending a first voice message and a first voice intention to a second device, wherein the first voice intention is compared with a second voice intention obtained by the second device recognizing the first voice message. Figure 1 If the same occurs, it is used for execution by the second device.

[0053] In a specific embodiment, a screen projection connection is established between the first device and the second device based on a preset vehicle connection protocol. After the first device and the second device establish the screen projection connection, the current connection status may be the following: screen projection is based on Bluetooth connection and WIFI connection, and data is transmitted through Bluetooth connection and WIFI connection, wherein the Bluetooth connection is used for the transmission of audio information; screen projection is based on wired connection and Bluetooth connection, and data is transmitted through wired connection and Bluetooth connection, wherein the Bluetooth connection is used for the transmission of audio information; screen projection is based on WIFI connection, and data is transmitted through WIFI connection; screen projection is based on wired connection, and data is transmitted through wired connection. The first device sends the first voice information and the first voice intention to the second device through the screen projection connection based on the preset vehicle connection protocol.

[0054] Among them, the preset car connection protocol is the carlink car connection protocol. Of course, in other embodiments, the preset car connection protocol can also be the CarPlay car connection protocol, the HiCar car connection protocol, etc., which can be set according to the specific situation and is not limited here.

[0055] Further, the information to be displayed is received when the second device executes the first voice intention and returns the information to be displayed. When the information to be displayed is received when the second device executes the first voice intention and returns the information to be displayed, the information to be displayed is displayed.

[0056] The information to be displayed may be call audio, call video, various videos, and the like.

[0057] In an embodiment of the present application, the first device sends a first voice message and a first voice intent to the second device, and the second device executes the first voice intent and returns the information to be displayed. After receiving the information to be displayed returned by the second device after executing the first voice intent, the first device displays the information to be displayed. Since the first voice message is collected by the first device, it indicates that the user who sent the first voice message is near the first device. The first device displays the information to be displayed, so that the user who sent the voice message can receive the information to be displayed as soon as possible.

[0058] In a specific embodiment, the first device is provided with a first audio playback device, which may be a speaker. The information to be displayed is the call audio of the called party, and the first device plays the call audio through the first audio playback device.

[0059] In another specific embodiment, the first device is provided with a display interface. Among them, the first device is a vehicle-mounted terminal, and the display interface of the first device can be the display interface of the central control display screen of the vehicle, and the display interface of the first device can also be the display interface of the head-up display. Head-up display, referred to as HUD, is also called a head-up display system, which refers to a blind-operated, multi-functional instrument panel centered on the vehicle driver. Its function is to project important driving information such as speed and navigation onto the windshield in front of the driver, so that the driver can see important driving information such as speed and navigation without lowering his head or turning his head as much as possible. The information to be displayed is a call video or other types of videos of the called party, and the first device plays the call video or other types of videos through the display screen.

[0060] Furthermore, if the second device executes the first voice intent and returns the information to be displayed, the second voice information is collected and sent to the second device. The first device collects the second voice information through the first audio collection device and sends the second voice information to the second device. Specifically, the first voice intent is a call instruction, the information to be displayed is the call audio, and the second voice information is the user voice collected by the first device. The user voice collected by the first device is sent to the second device, and the second device sends it to the called party, thereby completing the call.

[0061] Furthermore, if the second device executes the first voice intent and returns the information to be displayed, the camera of the first device is turned on to collect image information and send the image information to the second device, which then sends it to the called party to complete the call.

[0062] Please refer to Figure 3 , Figure 3 is a flow chart of a second embodiment of the voice communication method provided in the embodiment of the present application, such as Figure 3 As shown, the process of the voice communication method provided by this application is as follows:

[0063] 301. When first voice information collected by a first device is acquired, obtain a first voice intent of the first voice information based on the first voice information.

[0064] 302. Determine whether the first voice intention belongs to a control instruction in a preset instruction set.

[0065] Among them, a preset instruction set is pre-set, and the preset instruction set includes multiple control instructions. For example, the multiple control instructions in the preset instruction set are: "Call XX", "Play song AA", and "Play video BB".

[0066] In the embodiment of the present application, it is determined whether the first voice intention belongs to the control instructions in the preset instruction set. If the first voice intention belongs to the control instructions in the preset instruction set, 303 is executed; if the first voice intention does not belong to the control instructions in the preset instruction set, the first voice information is re-collected.

[0067] 303. Detect a current connection state between the first device and the second device.

[0068] Generally, the first device and the second device will establish a screen projection connection. The current connection status between the first device and the second device may be in the following states: the first device and the second device establish a screen projection connection, and transmit data through Bluetooth connection and WIFI connection, where the Bluetooth connection is used to transmit audio information; the first device and the second device establish a screen projection connection, and transmit data through wired connection and Bluetooth connection; the first device and the second device establish a screen projection connection, and transmit data through WIFI connection; the first device and the second device establish a screen projection connection, and transmit data through a wired connection.

[0069] 304. If the current connection status is Bluetooth connection and screen projection connection, a selection prompt message is issued, and the selection prompt message is used to prompt the user to select a connection for data transmission.

[0070] If the current connection status is Bluetooth connection and screen projection connection, it means that data can be transmitted directly via Bluetooth or via screen projection connection, which may cause private data to be leaked via Bluetooth. A selection prompt message is sent to prompt the user to select a connection for data transmission. Specifically, a selection pop-up window is popped up on the display interface of the first device, and the selection pop-up window provides screen projection connection and Bluetooth connection for the user to choose. By sending a prompt message to the user, the user can choose the data transmission method to avoid direct data transmission that may cause private data to be leaked via Bluetooth.

[0071] 305. If an operation of selecting a screen projection connection to send is detected, the Bluetooth connection is closed and the first voice information and the first voice intention are sent to the second device through the screen projection connection based on a preset vehicle connection protocol.

[0072] If the operation of selecting the screen projection connection to send is detected, it means that the user wants to send through the screen projection connection. Since traditional Bluetooth will obtain the user's private information such as the address book, if the default Bluetooth directly obtains the user's address book and other private information, it will lead to privacy leakage. If the user operates the first device or the second device refuses to provide address book access rights, it can only be triggered manually, which will increase the user's driving risk and reduce the call scene experience. Therefore, it is necessary to turn off Bluetooth at this time to avoid turning on Bluetooth to obtain private data on the second device. Therefore, after turning off Bluetooth, the first voice message and the first voice intention are sent to the second device through the screen projection connection based on the preset car connection protocol.

[0073] If an operation of selecting to send via Bluetooth connection is detected, it indicates that the user wants to send via Bluetooth connection. At this time, the first voice message and the first voice intention are sent to the second device via Bluetooth connection.

[0074] 306. If the current connection status is that Bluetooth is not connected and the screen projection is connected, the first voice information and the first voice intention are sent to the second device through the screen projection connection based on the preset vehicle connection protocol.

[0075] If the current connection status is Bluetooth not connected and screen projection connected, it means that Bluetooth has been turned off and there is no need to worry about privacy leakage. Based on the preset car connection protocol, the first voice information and the first voice intention are sent to the second device through the screen projection connection to avoid privacy leakage.

[0076] 307. When the information to be displayed is obtained and returned by the second device after executing the first voice intention, the information to be displayed is displayed.

[0077] Further, the information to be displayed returned by the second device after executing the first voice intent is received. If the information to be displayed returned by the second device after executing the first voice intent is obtained, the second voice information is collected and sent to the second device. If the information to be displayed returned by the second device after executing the first voice intent is obtained, indicating that the two devices have established a secure connection channel and can communicate by voice, the second voice information is collected and sent to the second device to complete the voice communication.

[0078] Please refer to Figure 4 , Figure 4 is a flow chart of a third embodiment of the voice communication method provided in the present application, such as Figure 4 As shown, the voice communication method provided in this embodiment is applied to the second device, and the process of the voice communication method provided in this application is as follows:

[0079] 401. Upon receiving a first voice message and a first voice intent sent by a first device, identify the first voice message to obtain a second voice intent, wherein the first voice message is obtained by the first device, and the first voice intent is obtained by the first device by identifying the first voice message.

[0080] Among them, when the first device obtains the first voice information collected by the first device, based on the first voice information, obtains the first voice intention of the first voice information, and sends the first voice information and the first voice intention to the second device.

[0081] In the embodiment of the present application, the first voice intent may be "Call XX", "Play song AA", "Play video BB", etc. The information to be displayed may be call audio, call video, various videos, etc. For example, the first voice intent may be "Call XX", and the first voice intent is executed, that is, the operation of dialing the called party XX is executed. When the call is connected, the call audio of the called party is obtained, and the call audio of the called party is used as the information to be displayed.

[0082] In a specific implementation, recognizing a first voice message and obtaining a second voice intent of the first voice message includes: performing voice recognition on the first voice message to obtain text information of the first voice message; and inputting the text information of the first voice message into a pre-trained intent detection model to obtain the second voice intent of the first voice message.

[0083] 402. First Voice Intention and Second Voice Intention Figure 1 If the first voice intention is correct, execute the first voice intention.

[0084] Since the first voice intent is parsed by the first device, and the second voice intent is parsed by the second device, Figure 1 If the first voice intention is executed, indicating that the interface on the second device has not been called maliciously, the information to be displayed corresponding to the first voice intention can be obtained, which can prevent the interface on the second device from being called maliciously and improve the security of voice communication.

[0085] Furthermore, the information to be displayed obtained by executing the first voice intention is returned to the first device.

[0086] Specifically, the information to be displayed may be call voice audio, call video, various videos, etc. The information to be displayed is returned to the first device through a screen projection connection based on a preset vehicle connection protocol.

[0087] Please refer to Figure 5 , Figure 5 1 is a flow chart of the fourth embodiment of the voice communication method provided in the embodiment of the present application. The embodiment of the present application takes the voice dialing scenario as an example. Figure 5 As shown, the process of the voice communication method provided by this application is as follows:

[0088] 501. When first voice information collected by a first device is acquired, a first voice intent of the first voice information is obtained based on the first voice information.

[0089] Specifically, the first device and the second device will establish a screen projection connection. After the first device and the second device establish the screen projection connection, the current connection status may be the following: screen projection is based on Bluetooth connection and WIFI connection, and data is transmitted through Bluetooth connection and WIFI connection, wherein the Bluetooth connection is used to transmit audio information; screen projection is based on wired connection and Bluetooth connection, and data is transmitted through wired connection and Bluetooth connection, wherein the Bluetooth connection is used to transmit audio information; screen projection is based on WIFI connection, and data is transmitted through WIFI connection; screen projection is based on wired connection, and data is transmitted through wired connection.

[0090] The first device collects the first voice information, and when the first voice information collected by the first device is acquired, the first voice intent of the first voice information is obtained based on the first voice information.

[0091] 502. Determine whether the first voice intention is a dialing instruction.

[0092] In the embodiment of the present application, the first device determines whether the first voice intention is a dialing instruction. If the first voice intention is a dialing instruction, 503 is executed; if the first voice intention is not a dialing instruction, the first voice information is re-collected.

[0093] 503. Detect a current connection state between the first device and the second device.

[0094] 504. If the current connection status is Bluetooth connection and screen projection connection, a selection prompt message is issued.

[0095] The selection prompt information is used to prompt the user to select a connection for data transmission.

[0096] If the current connection status is Bluetooth connection and screen projection connection, indicating that data can be transmitted directly via Bluetooth or via screen projection connection, a selection prompt message is issued, and the selection prompt message is used to prompt the user to select a connection for data transmission. Specifically, a selection pop-up window is displayed on the display interface of the first device, and the screen projection connection and selection are provided on the selection pop-up window for the user to select.

[0097] 505. If an operation of selecting a screen projection connection to send is detected, the Bluetooth connection is closed and the first voice information and the first voice intention are sent to the second device through the screen projection connection based on a preset vehicle connection protocol.

[0098] If the operation of selecting the screen projection connection to send is detected, it means that the user wants to send through the screen projection connection. Since traditional Bluetooth will obtain the user's private information such as the address book, if the default Bluetooth directly obtains the user's address book and other private information, it will lead to privacy leakage. If the user operates the first device or the second device refuses to provide address book access rights, it can only be triggered manually, which will increase the user's driving risk and reduce the call scene experience. Therefore, it is necessary to turn off Bluetooth at this time to avoid turning on Bluetooth to obtain private data on the second device. Therefore, after turning off Bluetooth, the first voice message and the first voice intention are sent to the second device through the screen projection connection based on the preset car connection protocol.

[0099] If an operation of selecting to send via Bluetooth connection is detected, it indicates that the user wants to send via Bluetooth connection. At this time, the first voice message and the first voice intention are sent to the second device via Bluetooth connection.

[0100] 506. If the current connection status is that Bluetooth is not connected and the screen projection is connected, the first voice information and the first voice intention are sent to the second device through the screen projection connection based on the preset vehicle connection protocol.

[0101] If the current connection status is Bluetooth not connected and screen projection connected, it means that Bluetooth has been turned off and there is no need to worry about privacy leakage. Then the first voice message and the first voice intention are sent to the second device through the screen projection connection based on the preset car connection protocol.

[0102] 507. Determine a first voice intention of the first voice information.

[0103] 508. Determine whether the first voice intention is a dialing instruction.

[0104] If the first voice intention is a dialing instruction, execute 509.

[0105] 509. Disable the sound collection function and the sound playback function of the first device.

[0106] In an embodiment of the present application, in order to prevent the sound of the first device from being collected and leaked, and to prevent the collection function and the playback function of the first device and the second device from sending interference, the sound collection function and the sound playback function of the first device are disabled, the first voice intention is executed, and the information to be displayed corresponding to the first voice intention is obtained. This can prevent the sound of the first device from being collected and leaked, and can also prevent the collection function and the playback function of the first device and the second device from sending interference, thereby improving the security of voice communication. Specifically, the second device can have a second audio collection device integrated in it, or can have an external second audio collection device. The second audio collection device can be a microphone, etc. The second device is provided with a second audio playback device, and the second audio playback device can be a speaker. The second audio collection device and the second audio playback device of the second device are turned off.

[0107] In a specific embodiment, if the first voice intention is a dialing instruction, the sound collection function and the sound playback function of the first device are disabled.

[0108] In a specific embodiment, before disabling the sound collection function and the sound playback function of the first device, the method includes:

[0109] (1) Obtaining first voice information.

[0110] Specifically, a call request is initiated to the first device to obtain the first voice information. Of course, the first voice information can also be sent to the second device together with the first prompt information sent by the first device.

[0111] (2) Analyze the first voice information to obtain the second voice intention of the first voice information.

[0112] Specifically, parsing the first voice information to obtain the second voice intention of the first voice information includes: performing voice recognition on the first voice information to obtain text information of the first voice information; inputting the text information of the first voice information into a pre-trained intention detection model to obtain the second voice intention of the first voice information.

[0113] (3) If the first speech intention and the second speech intention Figure 1 If the first voice intent is reached, the first voice intent is executed to obtain the information to be displayed corresponding to the first voice intent.

[0114] Since the first voice intent is parsed by the first device, and the second voice intent is parsed by the second device, Figure 1 If the first voice intent is executed, indicating that the interface on the second device has not been maliciously called, the sound collection function and the sound playback function of the first device are disabled, and the first voice intent is executed to obtain the information to be displayed corresponding to the first voice intent.

[0115] 510. Execute the dialing instruction to obtain the call voice audio.

[0116] In a specific embodiment, after determining that the first voice is intended to be a dialing instruction, the dialing instruction is directly executed to obtain the call voice audio. After the dialing instruction is executed, the call is connected, and the call voice audio of the called party is obtained.

[0117] 511. Return the call voice audio to the first device.

[0118] Specifically, the second device returns the information to be displayed to the first device through the screen projection connection based on the preset vehicle connection protocol.

[0119] 512. Play the call audio.

[0120] Specifically, after the first device obtains the call voice audio, it plays the call voice audio.

[0121] 513. Collect the second voice information.

[0122] Specifically, the first device collects the second voice information.

[0123] 514. Send a second voice message.

[0124] Specifically, the first device sends the collected second voice information to the second device.

[0125] 515. Send the second voice message to the called party.

[0126] Specifically, the first device sends the collected second voice information to the second device, and the second device sends the second voice information to the called party to complete the call.

[0127] Furthermore, when the call is detected to be over, the sound collection function and the sound playback function of the second device are restored. Specifically, when the first device detects that a call is over or a call is started, the vehicle phone status message, the vehicle microphone status change message, and the vehicle audio player status change message are sent to the first device to control the initialization and release of the vehicle call status, and to control the initialization and release of the vehicle player and microphone resources. Among them, the vehicle phone status message is represented by NotifyPhoneState, and the vehicle phone status message includes the call status, whether the mobile phone is locked, whether it is an Internet call, whether the voice assistant is awake, and the low power of the mobile phone; the call status is represented by call_state; whether the mobile phone is locked is represented by screen_locked; whether it is an Internet call is represented by wechat_or_qq; whether the voice assistant is awake is represented by voice_assistant_active; and the low power of the mobile phone is represented by low_power.

[0128] The vehicle microphone state change message is represented by NotifyMicrophoneState, and the vehicle microphone state change message includes the vehicle microphone enable state, vehicle microphone sampling rate, vehicle microphone channel, and vehicle microphone encoding format. The call state is represented by call_state; the microphone enable state is represented by enable; the vehicle microphone sampling rate is represented by sample_rate; the vehicle microphone channel is represented by channel_mask; and the vehicle microphone encoding format is represented by encoding_format.

[0129] Among them, the car audio player state change message is represented by NotifyAudioPlayerState, and the car audio player state change message includes audio type, player state, player sampling rate, player channel, and player encoding format. The audio type is represented by audio_type, the player state is represented by player_state; the player sampling rate is represented by sample_rate; the player channel is represented by channel_mask; the player encoding format is represented by encoding_format, the player sampling rate, the player channel, and the player encoding format.

[0130] Furthermore, the first device and the second device of the present application perform voice transmission in voice communication through a preset content carrier, wherein the preset content carrier includes a message header + a message body of a fixed length.

[0131] It should be noted that the meaning of the above-mentioned fields of the present application is an optional form of protocol agreement. In other protocols for vehicle-computer interaction, other characters, graphics and other elements may be used to express the same meaning as the examples provided in the embodiments of the present application. For example, expressing the various fields of the present application in other expressions such as German and French is also within the scope of protection of the present application.

[0132] In order to better implement the voice communication method provided in the embodiment of the present application, the embodiment of the present application also provides a voice communication device based on the above voice communication method. The meanings of the nouns are the same as those in the above voice communication method. For specific implementation details, please refer to the description in the above method embodiment.

[0133] Please refer to Figure 6 , Figure 6 The structure diagram of the voice communication device provided in the embodiment of the present application is as follows. The voice communication device may include a parsing module 701 and a sending module 702, wherein:

[0134] The parsing module 701 is used to obtain the first voice information based on the first voice information when the first voice information is obtained;

[0135] The sending module 702 is used to send the first voice information and the first voice intention to the second device, wherein the first voice intention is compared with the second voice intention obtained by the second device recognizing the first voice information. Figure 1 If the same occurs, it is used for execution by the second device.

[0136] In order to better implement the voice communication method provided in the embodiment of the present application, the embodiment of the present application also provides a voice communication device based on the above voice communication method. The meanings of the nouns are the same as those in the above voice communication method. For specific implementation details, please refer to the description in the above method embodiment.

[0137] Please refer to Figure 7 , Figure 7 The structure diagram of the voice communication device provided in the embodiment of the present application is as follows. The voice communication device may include an intention determination module 801, an intention execution module 802, and a return module 803, wherein:

[0138] The intention determination module 801 is used to identify the first voice information to obtain a second voice intention when receiving the first voice information and the first voice intention sent by the first device, wherein the first voice information is obtained by the first device, and the first voice intention is obtained by the first device by identifying the first voice information;

[0139] The intention execution module 802 is used to execute the first voice intention and the second voice intention. Figure 1 If the first voice intention is correct, execute the first voice intention.

[0140] An embodiment of the present application also provides an electronic device, including a memory and a processor, wherein the processor is used to execute the steps in the voice communication method provided in this embodiment by calling a computer program stored in the memory.

[0141] Please refer to Figure 8 , Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 8 The electronic device may be a first device or a second device.

[0142] The electronic device may include components such as a processor 101 with one or more processing cores, a memory 102 with one or more computer-readable storage media, a power supply 103, and an input unit 104. Those skilled in the art will appreciate that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. Among them:

[0143] The processor 101 is the control center of the electronic device, which uses various interfaces and lines to connect various parts of the entire electronic device, and executes various functions of the electronic device and processes data by running or executing software programs and / or modules stored in the memory 102, and calling data stored in the memory 102. Optionally, the processor 101 may include one or more processing cores; optionally, the processor 101 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 101.

[0144] The memory 102 can be used to store software programs and modules. The processor 101 executes various functional applications and data processing by running the software programs and modules stored in the memory 102. The memory 102 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 102 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 102 may also include a memory controller to provide the processor 101 with access to the memory 102.

[0145] The electronic device also includes a power supply 103 for supplying power to each component. Optionally, the power supply 103 can be logically connected to the processor 101 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. The power supply 103 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0146] The electronic device may further include an input unit 104, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0147] Although not shown, the electronic device may also include a display unit, an image acquisition component, etc., which will not be described in detail here. Specifically in this embodiment, the processor 101 in the electronic device will load the executable code corresponding to one or more computer programs into the memory 102 according to the following instructions, and the processor 101 will execute the steps in the voice communication method provided in this application, such as:

[0148] When the first voice information is acquired, based on the first voice information, obtaining a first voice intention of the first voice information;

[0149] The first voice information and the first voice intention are sent to the second device, wherein the first voice intention is compared with the second voice intention obtained by the second device recognizing the first voice information. Figure 1 When the same occurs, the second device is used for execution;

[0150] or,

[0151] When receiving a first voice message and a first voice intent sent by a first device, recognizing the first voice message to obtain a second voice intent, wherein the first voice message is obtained by the first device, and the first voice intent is obtained by the first device recognizing the first voice message;

[0152] In the first voice intention and the second voice intention Figure 1 If the first voice intention is correct, execute the first voice intention.

[0153] It should be noted that the electronic device provided in the embodiment of the present application and the voice communication method in the above embodiment belong to the same concept, and its specific implementation process is detailed in the above related embodiments and will not be repeated here.

[0154] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program stored therein is executed on a processor of an electronic device provided in an embodiment of the present application, the processor of the electronic device executes the steps in the voice communication method provided in the present application. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0155] The present application also provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes various optional implementations of the above-mentioned voice communication method.

[0156] The above is a detailed introduction to a voice communication method and device provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

[0157] It should be noted that when the above embodiments of the present application are applied to specific products or technologies, the relevant data of the user is involved, and the user's permission or consent is required, and the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

Claims

1. A voice communication method, characterized in that: Applied to a first device, comprising: When the first voice information is acquired, obtaining a first voice intention of the first voice information based on the first voice information; The first voice information and the first voice intention are sent to a second device, wherein the first voice intention is used for execution by the second device when the first voice intention is consistent with the second voice intention obtained by the second device recognizing the first voice information.

2. The voice communication method according to claim 1, characterized in that: The voice communication method comprises: When receiving the information to be displayed returned by the second device after executing the first voice intention, the information to be displayed is displayed.

3. The voice communication method according to claim 1, characterized in that: The obtaining, based on the first voice information, a first voice intention of the first voice information includes: Performing voice recognition on the first voice information to obtain text information of the first voice information; The text information of the first voice information is input into a pre-trained intention detection model to obtain a first voice intention of the first voice information.

4. The voice communication method according to claim 1, characterized in that: The sending the first voice information and the first voice intention to the second device includes: Detecting a current connection state between the first device and the second device; If the current connection status is that Bluetooth is not connected and screen projection is connected, the first voice information and the first voice intention are sent to the second device through the screen projection connection based on the preset vehicle connection protocol.

5. The voice communication method according to claim 4, characterized in that: The voice communication method comprises: If the current connection status is a Bluetooth connection and a screen projection connection, a selection prompt message is issued, and the selection prompt message is used to prompt the user to select a connection for data transmission; If an operation of selecting a screen projection connection to send is detected, the Bluetooth connection is closed and the first voice information and the first voice intention are sent to the second device through the screen projection connection based on the preset vehicle connection protocol.

6. The voice communication method according to claim 1, characterized in that: The voice communication method further comprises: When receiving the information to be displayed returned by the second device after executing the first voice intention, second voice information is collected and sent to the second device.

7. A voice communication method, characterized in that: Applied to the second device, comprising: When receiving a first voice message and a first voice intent sent by a first device, identifying the first voice message to obtain a second voice intent, wherein the first voice message is obtained by the first device, and the first voice intent is obtained by the first device by identifying the first voice message; When the first voice intention and the second voice intention are consistent, the first voice intention is executed.

8. The voice communication method according to claim 7, characterized in that: The voice communication method comprises: The information to be displayed obtained by executing the first voice intention is returned to the first device.

9. The voice communication method according to claim 7, characterized in that: The executing the first voice intention when the first voice intention and the second voice intention are consistent includes: When the first voice intention and the second voice intention are consistent, disabling a sound collection function and a sound playback function of the first device; Execute the first voice intention.

10. A voice communication device, characterized in that: include: A parsing module, configured to obtain a first voice intention of the first voice information based on the first voice information when the first voice information is acquired; A sending module is used to send the first voice information and the first voice intention to a second device, wherein the first voice intention is used for execution by the second device when it is consistent with the second voice intention obtained by the second device recognizing the first voice information.

11. A voice communication device, characterized in that: include: an intention determination module, configured to, upon receiving first voice information and a first voice intention sent by a first device, identify the first voice information to obtain a second voice intention, wherein the first voice information is obtained by the first device, and the first voice intention is obtained by the first device identifying the first voice information; An intention execution module is used to execute the first voice intention when the first voice intention is consistent with the second voice intention.

12. An electronic device, characterized in that: It includes a memory and a processor, the memory stores a computer program, and the processor is used to run the computer program in the memory to execute the steps in the voice communication method described in any one of claims 1 to 6 or the steps in the voice communication method described in any one of claims 7 to 9.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the voice communication method according to any one of claims 1 to 6 or the steps in the voice communication method according to any one of claims 7 to 9.

14. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the voice communication method according to any one of claims 1 to 6 or the steps of the voice communication method according to any one of claims 7 to 9 are implemented.

Images