Audio translation method and system
Connecting to the smart terminal through Bluetooth, the translator receives and translates audio data, generates and outputs audio in the target language, solving the problem of audio translation in scenarios such as the translator being unable to use multimedia APP on the smart terminal, expanding the usage scenario of the translator and Implemented audio translation function.
Patent Information
- Application Number
- CN202411469003.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-21
- Publication Date
- 2025-01-10
AI Technical Summary
Existing translation machines cannot effectively utilize multimedia APPs, social APPs or online conference APPs, and cannot meet users' needs to translate audio on smart terminals, and their usage scenarios are limited.
Connecting to the smart terminal through Bluetooth, the translator receives the original audio data for translation, generates the translated text of the target language, and synthesizes the audio data output, supporting channel separation and splicing to realize audio translation and output.
The use scenario of the translation machine has been expanded, and the audio translation function on the smart terminal has been realized, which meets the user's automatic translation and output needs and improves the user experience.
Smart Images

Figure CN119294412A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of audio processing technology, and more specifically, to an audio translation method and system. Background Art
[0002] Existing translation machines are more focused on the function of translation, such as using translation machines to achieve simultaneous interpretation functions, as a device for face-to-face communication, etc.
[0003] Although some translation machines are equipped with some application APPs, such as taking photos, they cannot install more abundant application APPs like computers and mobile phones, such as multimedia APPs, social APPs, online conference APPs, etc. In some usage scenarios, users may need to use multimedia APPs, social APPs or online conference APPs installed on computers, mobile phones and other terminals. At this time, users may have the need to translate audio, such as in online conference scenarios, they need to translate the speeches of other participants. Since the above APPs are installed on computers, mobile phones and other terminals, the translation function of the translation machine cannot be effectively utilized, resulting in limited usage scenarios of the translation machine and failure to meet the translation needs of users. Summary of the invention
[0004] In view of the above problems, this application is proposed to provide an audio translation method and system to solve the problem that mobile phones, computers and other terminals need to translate voice and expand the use scenarios of translation machines. The specific solution is as follows:
[0005] In a first aspect, an audio translation method is provided, which is applied to a translation machine, wherein the translation machine is connected to a smart terminal via Bluetooth, and the audio translation method comprises:
[0006] Receiving original audio data transmitted by the smart terminal via Bluetooth;
[0007] When the translation machine is in a first state, translating the original audio data to obtain a translated text in a target language, the first state being a state in which the translation function is turned on;
[0008] synthesizing the translated text in the target language into first translated audio data;
[0009] First target audio data to be output is obtained based on the first translated audio data, and the first target audio data is output and played.
[0010] In a possible design, in another implementation of the second aspect of the embodiment of the present application, a process of obtaining first target audio data to be output based on the first translated audio data includes:
[0011] using the first translated audio data as the first target audio data;
[0012] or,
[0013] The first translated audio data and the original audio data are spliced together to obtain spliced first target audio data.
[0014] In a possible design, in another implementation of the second aspect of the embodiment of the present application, the translation machine is also connected to the headset via Bluetooth;
[0015] The process of translating the original audio data to obtain a translated text in a target language includes:
[0016] Separating the original audio data into channels to obtain original audio data of at least one channel, and translating the original audio data of each channel to obtain translated text of the target language of at least one channel;
[0017] The process of synthesizing the translated text in the target language into first translated audio data comprises:
[0018] synthesizing the translated text of the target language of each channel into first translated audio data respectively, to obtain first translated audio data of at least one channel;
[0019] The process of obtaining first target audio data to be output based on the first translated audio data, and outputting and playing the first target audio data includes:
[0020] Based on the first translated audio data of each channel, first target audio data of each channel to be output is obtained;
[0021] The first target audio data of different channels are respectively transmitted to the left and right ear channels of the headset via Bluetooth, so as to output the first target audio data of different channels via the left and right ear channels of the headset.
[0022] In a possible design, in another implementation manner of the second aspect of the embodiments of the present application, the original audio data carries channel information, and the process of performing channel separation on the original audio data includes:
[0023] Channel separation is performed on the original audio data according to the channel information.
[0024] In a possible design, in another implementation manner of the second aspect of the embodiment of the present application, if the original audio data of the at least one channel is the original audio data of one channel; correspondingly, the process of transmitting the first target audio data of different channels to the left and right ear channels of the headset through Bluetooth respectively includes:
[0025] Transmitting first target audio data of a channel to a target ear channel of the headset via Bluetooth, wherein the target ear channel is one of the left and right ear channels specified by a user, or the target ear channel is one of the left and right ear channels selected by default or randomly selected;
[0026] If the original audio data of the at least one channel is the original audio data of two channels; correspondingly, the process of transmitting the first target audio data of different channels to the left and right ear channels of the headset via Bluetooth respectively includes:
[0027] The first target audio data of the two channels are respectively transmitted to the left and right ear channels of the headset via Bluetooth, wherein any ear channel of the headset corresponds to the first target audio data of one channel.
[0028] In one possible design, in another implementation of the second aspect of the embodiment of the present application, the process of obtaining the first target audio data of each channel to be output based on the first translated audio data of each channel includes:
[0029] Using the first translated audio data of each channel as the first target audio data, respectively, to obtain the first target audio data of each channel;
[0030] or,
[0031] For each channel, the first translated audio data of the current channel and the original audio data of the current channel are concatenated to obtain the first target audio data of the current channel.
[0032] In a possible design, in another implementation of the second aspect of the embodiment of the present application, before translating the original audio data, the method further includes:
[0033] The original audio data is preprocessed, and the preprocessing includes at least one of the following: noise reduction processing, echo cancellation processing, and adaptive gain processing.
[0034] In a possible design, in another implementation of the second aspect of the embodiment of the present application, the method further includes:
[0035] Acquire ambient audio data sent by the headset via Bluetooth, where the ambient audio data is audio data collected by a microphone of the headset;
[0036] When the translation machine is in the first state, translating the environmental audio data to obtain a translated text in the source language;
[0037] synthesizing the translated text in the source language into second translated audio data;
[0038] Second target audio data is obtained based on the second translated audio data, and the second target audio data is output to the smart terminal via Bluetooth.
[0039] In one possible design, in another implementation of the second aspect of the embodiment of the present application, a process of obtaining second target audio data based on the second translated audio data includes:
[0040] using the second translated audio data as the second target audio data;
[0041] or,
[0042] The second translated audio data and the environmental audio data are spliced to obtain spliced second target audio data.
[0043] In a possible design, in another implementation of the second aspect of the embodiment of the present application, before translating the environmental audio data, the method further includes:
[0044] The environmental audio data is preprocessed, and the preprocessing includes at least one of the following: noise reduction processing, echo cancellation processing, and adaptive gain processing.
[0045] In a second aspect, an audio translation system is provided, comprising:
[0046] Smart terminals and translation machines;
[0047] The smart terminal is connected to the translation machine via Bluetooth;
[0048] The intelligent terminal is used to transmit the original audio data to the translation machine via Bluetooth connection;
[0049] The translation machine is used to implement the audio translation method described in any one of the first aspects of the present application.
[0050] In one possible design, in another implementation of the second aspect of the embodiment of the present application, the translation machine is a Bluetooth master-slave integrated device. Accordingly, the translation machine is connected to the smart terminal via Bluetooth as a slave device, and is also connected to the headset via Bluetooth as a master device.
[0051] In a third aspect, an audio translation device is provided, which is applied to a translation machine, wherein the translation machine is connected to a smart terminal via Bluetooth, and the audio translation device comprises:
[0052] An original data receiving module, used to receive original audio data transmitted by the smart terminal via Bluetooth;
[0053] A translation module, used for translating the original audio data to obtain a translated text in a target language when the translation machine is in a first state, wherein the first state is a state in which a translation function is enabled;
[0054] a speech synthesis module, configured to synthesize the translated text in the target language into first translated audio data;
[0055] The audio output module is used to obtain first target audio data to be output based on the first translated audio data, and output and play the first target audio data.
[0056] In a fourth aspect, a readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the audio translation method described in any one of the first aspects of the present application is implemented.
[0057] In a fifth aspect, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the audio translation method described in any one of the first aspects of the present application.
[0058] By means of the above technical scheme, the present application proposes a design scheme that connects the translation machine to other smart terminals via Bluetooth as an external device, that is, the translation machine is connected to other smart terminals via Bluetooth. On this basis, when there is a translation demand, the smart terminal can send the original audio data to be translated to the translation machine via Bluetooth. When the translation function of the translation machine is turned on, the original audio data is translated to obtain the translated text in the target language, and synthesize it into the first translated audio data, and obtain the first target audio data to be output based on the first translated audio data, and output and play the first target audio data. Obviously, by adopting the scheme of the present application, when there is a demand for audio translation in the smart terminal, the functions of automatic translation, audio synthesis and output playback can be realized with the help of the external translation machine, so as to meet the audio translation needs of users on the smart terminal and expand the use scenarios of the translation machine. BRIEF DESCRIPTION OF THE DRAWINGS
[0059] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:
[0060] Figure 1 A framework diagram of an audio translation system provided in an embodiment of the present application;
[0061] Figure 2 A flowchart of an audio translation method provided in an embodiment of the present application;
[0062] Figure 3 Another audio translation system framework diagram provided in an embodiment of the present application;
[0063] Figure 4 A flowchart of another audio translation method provided in an embodiment of the present application;
[0064] Figure 5 A framework diagram of another audio translation system provided in an embodiment of the present application;
[0065] Figure 6 A framework diagram of another audio translation system provided in an embodiment of the present application;
[0066] Figure 7 A schematic diagram of the structure of an audio translation device provided in an embodiment of the present application;
[0067] Figure 8 A schematic diagram of the structure of a translation machine provided in an embodiment of the present application. DETAILED DESCRIPTION
[0068] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0069] Existing translation machines focus more on translation functions. Even if they are equipped with some apps, such as camera functions, they cannot be equipped with some multimedia apps, social apps, online conference apps, etc. like computers, mobile phones and other smart terminals. When users use multimedia apps, social apps or online conference apps through smart terminals, they sometimes face the need to translate audio, such as translating the audio of foreign language movies played by video players, translating the audio of other participants in online meetings, etc. Traditional solutions cannot use translation machines quickly and directly, and users need to perform tedious operations such as recording, exporting, and importing the audio of smart terminals into translation machines, which is extremely inconvenient to use.
[0070] In this regard, the present application proposes a design scheme in which a translation machine uses Bluetooth to connect to other smart terminal devices as a peripheral, which solves the problem that smart terminals such as mobile phones and computers need to translate audio, expands the use scenarios of the translation machine, and facilitates user use.
[0071] Combination Figure 1 , Figure 1 A framework diagram of an audio translation system is provided, which includes an intelligent terminal 100 and a translation machine 200.
[0072] The intelligent terminal 100 is connected to the translation machine 200 via Bluetooth.
[0073] The intelligent terminal 100 can be a terminal device such as a mobile phone, a PC, a tablet computer, an IPAD, etc., on which various types of application APPs can be installed, such as social APPs, online conference APPs, etc. When using these APPs, users may have the need to translate the audio. For example, when using a chat APP to chat with foreigners, the audio sent by the other party needs to be translated into a language that the user can understand. Or, when using an online conference APP, the audio sent by other participants needs to be translated into a language that the user can understand, etc.
[0074] The smart terminal 100 can transmit the original audio data to be translated to the translation machine 200 via a Bluetooth connection.
[0075] The translation machine 200 is connected as a peripheral device of the intelligent terminal 100 via Bluetooth to implement each step of the audio translation method.
[0076] The smart terminal 100 uses the Bluetooth function to connect to the translator 200. The smart terminal 100 sends a request to the translator 200 through the Bluetooth protocol to obtain relevant information of the translator 200, such as device status, function support information (such as audio codec support, microphone support), audio transmission parameters (such as sampling rate, bit rate, number of channels), etc. The translator 200 returns relevant information to the smart terminal 100, and the smart terminal 100 sets the audio input and output parameters according to the returned relevant information. Afterwards, when the smart terminal 100 needs to use the headphone function, the translator 200 can be identified as a headphone, and then the original audio data can be sent to the translator 200 via the Bluetooth connection. The data can be used as uplink data and processed on the uplink. After processing, the playback unit of the translator 200 is driven to play.
[0077] Further optionally, the sound receiving unit of the translation machine 200 can also collect environmental audio data, which is used as downlink data, processed via the downlink link, and sent to the smart terminal 100 via the Bluetooth connection after processing.
[0078] The present application embodiment provides an audio translation method, which is applied to a translation machine 200, and is combined with Figure 2 , the audio translation method may include the following steps:
[0079] Step S100: receiving original audio data transmitted by the smart terminal via Bluetooth.
[0080] Specifically, when the smart terminal faces the need for audio translation, it establishes a Bluetooth connection with the translation machine, and the smart terminal identifies the translation machine as a headset, and then transmits the original audio data to be translated to the translation machine via Bluetooth.
[0081] The original audio data can be the audio stream data that needs to be translated provided by the application APP installed on the smart terminal, such as the audio data of a movie played by a video player, the audio data sent by the chat partner received by a social APP, and the audio data received by an online conference APP.
[0082] In some possible implementations, the intelligent terminal can first decode the audio to be translated, obtain the decoded original audio data, and transmit it to the translator. At this time, the translator receives the decoded original audio data, which can be processed later.
[0083] In some other possible implementations, the smart terminal may not decode the audio that needs to be translated, and directly transmit the undecoded original audio data to the translator. Since the amount of undecoded original audio data is smaller than the decoded audio data, the delay of transmission via Bluetooth is lower. At this time, the translator receives the undecoded original audio data. At this time, the translator can offload the original audio data to the digital signal processing unit DSP, and hard-decode the original audio data through the DSP to obtain the decoded original audio data for subsequent processing.
[0084] By calling DSP for hard decoding, the decoding speed can be further accelerated and the decoding time can be reduced compared to decoding through the intelligent terminal software layer. In addition, the DSP itself consumes relatively low power when processing audio formats, which can further reduce the overall power consumption.
[0085] Further optionally, after obtaining the original audio data, the original audio data may be preprocessed, including but not limited to: noise reduction processing, echo cancellation processing, adaptive gain processing, etc. It is understandable that if the original audio data received by the translator is decoded audio stream data, the original audio data may be directly preprocessed here. If the translator receives undecoded audio stream data, it may further perform preprocessing operations on the original audio data after completing the decoding process.
[0086] Step S110: When the translation machine is in the first state, the original audio data is translated to obtain a translated text in the target language.
[0087] The first state is a state in which the translation function is turned on. The translation machine can turn on or off the translation function, for example, by providing a control on the human-computer interaction interface to indicate whether the translation function is turned on, and the user can turn on or off the translation function by triggering the control.
[0088] When the translation function of the translation machine is turned on, the received original audio data is automatically translated, and the original audio data in the source language is translated into the translated text in the target language.
[0089] The target language may be a default language, or a language manually set by the user or automatically set according to the user's daily usage habits.
[0090] In the process of translating the original audio data, you can choose online translation or offline translation. Online translation means that the original audio data can be sent to the translation server for translation, and the translated text can be sent to the translation machine. Offline translation means calling the local translation engine of the translation machine to translate the original audio data offline and obtain the translated text.
[0091] Whether to select online translation or offline translation can be based on the system default settings, such as automatically selecting online translation when connected to the Internet and selecting offline translation when disconnected from the Internet. In addition, the user can also manually set online translation or offline translation.
[0092] Step S120: synthesize the translated text in the target language into first translated audio data.
[0093] After obtaining the translated text in the target language, a speech synthesis algorithm may be further called to synthesize the translated text into audio data, which is defined herein as first translated audio data.
[0094] Step S130: obtaining first target audio data to be output based on the first translated audio data, and outputting and playing the first target audio data.
[0095] Specifically, in this step, the first target audio data to be output can be obtained based on the first translated audio data, and the first target audio data can be output and played.
[0096] According to the needs of the business scenario, the first translated audio data can be directly used as the first target audio data in this step. In some other possible implementations, the first translated audio data and the original audio data can also be spliced in this step to obtain the spliced first target audio data.
[0097] In an exemplary scenario, a user attends a meeting through an online conference APP on a smart terminal, and the smart terminal receives original audio data from other participants. The original audio data is not in a language familiar to the user, so the original audio data can be translated through a translation machine connected to Bluetooth to obtain first translated audio data. At the same time, the user only wants to hear the translated audio, not the original audio, so the first translated audio data can be directly output and played as the first target audio data.
[0098] Another exemplary scenario is that a user attends a meeting through an online conference APP on a smart terminal, and the smart terminal receives original audio data from other participants. The original audio data is not in a language familiar to the user, so the original audio data can be translated through a translation machine connected to Bluetooth to obtain first translated audio data. The user wants to hear both the original audio and the translated audio, so the first translated audio data and the original audio data can be spliced and output as the first target audio data for playback.
[0099] When the first translated audio data and the original audio data are spliced, the splicing order of the two can be freely set, for example, the original audio data is placed first and the first translated audio data is placed later, so that the user can first hear the original audio data and then the first translated audio data. Of course, the splicing order of the two can also be reversed.
[0100] When the first target audio data is output and played, the first target audio data may be played through a speaker of the translation machine.
[0101] In another optional case, the translation machine can also be connected to an external headset, such as a wired headset or a Bluetooth headset. In this case, the first target audio data can be output to the headset and played through the headset.
[0102] The audio translation method provided by the embodiment of the present application is that when there is a translation demand, the smart terminal can send the original audio data to be translated to the translation machine via Bluetooth, and when the translation machine turns on the translation function, the original audio data is translated to obtain the translated text in the target language, and synthesize it into the first translated audio data, and obtain the first target audio data to be output based on the first translated audio data, and output and play the first target audio data. Obviously, by adopting the method of the present application, when there is a demand for audio translation in the smart terminal, the functions of automatic translation, audio synthesis and output playback can be realized with the help of the external translation machine, so as to meet the audio translation needs of users on the smart terminal and expand the use scenarios of the translation machine.
[0103] In some usage scenarios, the translation machine can be connected to the headset via Bluetooth. In this case, the translation machine acts as a Bluetooth master-slave device, that is, the translation machine is connected to the smart terminal via Bluetooth as a slave device, and is also connected to the headset via Bluetooth as a master device.
[0104] like Figure 3 , provides another optional architecture of the audio translation system, which includes a smart terminal 100, a translator 200 and a Bluetooth headset 300. The smart terminal 100 is used as a master device, the translator 200 is used as a master-slave integrated device, and the Bluetooth headset 300 is used as a slave device. The translator 200 forms a dual Bluetooth connection, which can be connected to the smart terminal as a cluster device, and can also be connected to the Bluetooth headset as a master device.
[0105] The process of establishing a Bluetooth connection between the master device and the slave device is as follows:
[0106] The master device sends a connection request to the slave device: When the master device finds that it needs to establish a connection with another slave device, it will first send a connection request to the slave device. The request contains information such as the master device's address and UUID (Universally Unique Identifier).
[0107] The slave device accepts the connection request: After receiving the connection request from the master device, the slave device checks whether the address and UUID information in the request are correct. If correct, the slave device sends a response message indicating that it is ready to establish a connection.
[0108] The master device establishes a connection with the slave device: After both the master device and the slave device confirm that each other's address and UUID information are correct, they can start to establish a connection. At this point, they will exchange some keys and other necessary information to ensure the security and reliability of communication.
[0109] When a Bluetooth master-slave device is connected to another slave device as a slave device and attempts to connect to other slave devices as a master device, the master-slave device needs to handle two different roles at the same time.
[0110] In this embodiment, the translation machine is used as a Bluetooth master-slave integrated device, and the process of connecting it with the smart terminal and the Bluetooth headset is as follows:
[0111] In the default scenario, the translator acts as a slave device to receive scans from the smart terminal. The connection process between the translator and the smart terminal can refer to the process of establishing a Bluetooth connection between the master device and the slave device, which will not be repeated here.
[0112] When the translation machine needs to connect to a Bluetooth headset, it can turn on the master device mode to scan the existing slave devices and select the Bluetooth headset to be connected. At this time, the translation machine acts as the master device and initiates a connection request to the Bluetooth headset. The Bluetooth headset acts as a slave device and responds to the connection request, and the two establish a Bluetooth connection.
[0113] It should be noted that the Bluetooth protocol between the translation machine and the smart terminal, and the Bluetooth protocol between the translation machine and the headset can be the same or different.
[0114] In the case where the translator is connected to the headset via Bluetooth, this embodiment provides another optional implementation of the audio translation method, combining Figure 4 As shown, it may include the following steps:
[0115] Step S200: receiving original audio data transmitted by the smart terminal via Bluetooth.
[0116] Specifically, when the smart terminal faces the need for audio translation, it establishes a Bluetooth connection with the translation machine, and the smart terminal identifies the translation machine as a headset, and then transmits the original audio data to be translated to the translation machine via Bluetooth.
[0117] The original audio data may be audio data received by a social APP, an online conference APP, etc. installed on a smart terminal.
[0118] Further optionally, after obtaining the original audio data, the original audio data may be preprocessed, including but not limited to: noise reduction processing, echo cancellation processing, adaptive gain processing, etc.
[0119] Step S210: When the translation machine is in the first state, the original audio data is channel-separated to obtain original audio data of at least one channel, and the original audio data of each channel is translated to obtain translated text of the target language of at least one channel.
[0120] The first state is a state in which the translation function is enabled.
[0121] In the scenario where users communicate with multiple people through smart terminals, the original audio data sent by the smart terminal to the translator may contain original audio data of one or more channels. Taking the scenario where users use smart terminals to hold multi-person online meetings as an example, the smart terminal may receive audio from different participants at the same time or at different times, and the audio from different participants corresponds to different channels. In this embodiment, it is expected that the audio of different participants is output through the left and right ear channels of the Bluetooth headset separately, that is, the original audio data from different channels is translated and processed, and then output through different channels of the left and right ears, such as translating the speeches of two people alternately and outputting them through different headphones, which is not easy to confuse.
[0122] To this end, in this step, the original audio data is firstly channel-separated to obtain the original audio data of one or more channels contained therein.
[0123] It can be understood that if the original audio data currently received contains audio data of multiple channels at the same time (such as in an online meeting scenario, two participants speak at the same time, and the smart terminal receives original audio data of two channels), then the original audio data of multiple channels can be obtained through channel separation; if the original audio data currently received contains only audio data of one channel (such as in an online meeting scenario, only one participant speaks within a period of time, and the smart terminal receives original audio data of one channel), then the original audio data of one channel can be obtained through channel separation.
[0124] In some possible implementations, the original audio data sent by the smart terminal to the translator may carry channel information (such as channel identification, etc.), so that the original audio data can be channel separated based on the channel information, and this separation method is more accurate.
[0125] In other possible implementations, if the original audio data sent by the smart terminal to the translator does not carry channel information, the translator can use a channel separation algorithm to perform channel separation on the original audio data, where the channel separation algorithm can be specifically implemented using a pre-trained neural network model for audio channel separation. The channel separation algorithm will not be described in detail in this embodiment.
[0126] After the channels are separated to obtain the original audio data of at least one channel, the original audio data of each channel may be translated to obtain the translated text of the target language of each channel.
[0127] The target language may be a default language, or a language manually set by the user or automatically set according to the user's daily usage habits.
[0128] Step S220: synthesize the translated text of the target language of each channel into first translated audio data to obtain first translated audio data of at least one channel.
[0129] Specifically, an audio synthesis algorithm may be called to synthesize the translated text of the target language of each channel into audio data, which is defined as first translated audio data herein, so that the first translated audio data of each channel may be obtained.
[0130] Step S230: Obtain first target audio data of each channel to be output based on the first translated audio data of each channel.
[0131] According to the needs of the business scenario, for the first translated audio data of each channel, in this step, the first translated audio data of the current channel can be directly used as the first target audio data of the current channel.
[0132] In some other possible implementations, in this step, the first translated audio data of the current channel and the original audio data of the current channel may be spliced to obtain the spliced first target audio data of the current channel.
[0133] Step S240: Transmit the first target audio data of different channels to the left and right ear channels of the headset respectively through Bluetooth, so as to output the first target audio data of different channels through the left and right ear channels of the headset.
[0134] Specifically, in the above steps, the channel separation, translation and speech synthesis of the audio are completed, and the first target audio data of one or more channels are obtained. On this basis, in this step, the first target audio data of different channels can be separated and output through the left and right ear channels of the earphone.
[0135] It is understandable that there are several situations in actual scenarios:
[0136] Case 1:
[0137] If the channel separation only obtains the original audio data of one channel, the first target audio data of one channel to be output is finally obtained. At this time, the first target audio data of the one channel can be output through the target ear channel of the headset. Among them, the target ear channel is the left ear channel or the right ear channel, and the target ear channel can be the default setting or one of the left and right ear channels randomly selected. In addition, the user can also specify the target ear channel through the interactive interface.
[0138] Case 2:
[0139] The channels are separated to obtain the original audio data of the two channels, and finally the first target audio data of the two channels to be output are obtained. At this time, the first target audio data of the two channels can be transmitted to the left and right ear channels of the headset respectively via Bluetooth, wherein any ear channel of the headset corresponds to the first target audio data of one channel.
[0140] For ease of understanding, the first target audio data of the two channels are defined as the first target audio data of channel A and the first target audio data of channel B, respectively. Then, the first target audio data of channel A can be transmitted to the left ear channel of the headset for output and playback, and the first target audio data of channel B can be transmitted to the right ear channel of the headset for output and playback; alternatively, the first target audio data of channel A can be transmitted to the right ear channel of the headset for output and playback, and the first target audio data of channel B can be transmitted to the left ear channel of the headset for output and playback.
[0141] The correspondence between the first target audio data of different channels and the left and right ear channels of the earphone may be a random match or may be specified by the user.
[0142] Case 3: Channel separation obtains original audio data of more than three channels, and finally obtains first target audio data of more than three channels to be output. In this case, there may be multiple output modes, such as:
[0143] The first target audio data of two channels are selected from the first target audio data of each channel, and are outputted in the manner of the above-mentioned situation 2. After the output of any one ear channel is completed, the first target audio data of another channel is selected from the first target audio data of each channel that has not been outputted yet to be outputted and played, until the first target audio data of all channels are completely outputted and played.
[0144] Alternatively, the user may specify the output channel (left ear channel or right ear channel) and output order corresponding to the first target audio data of each channel to be output through the interactive interface, and then output and play the first target audio data of each channel according to the user's settings.
[0145] The above examples only illustrate several possible output modes, which will not be listed one by one in this embodiment.
[0146] In the audio translation method provided in this embodiment, the translation machine is connected to the smart terminal and the Bluetooth headset at the same time as a master-slave integrated device. On this basis, the translation machine can enable the channel separation function to separate the channels of the original audio data sent by the smart terminal, and then can output the translated audio of different channels through the left and right ear channels of the headset, which makes it difficult to confuse the audio of different channels.
[0147] The above embodiment introduces the process of uploading the original audio data from the intelligent terminal to the translation machine for translation processing and outputting for playback, that is, the processing process of the data uplink. On this basis, the audio translation method of the present application can further include the processing process of the data downlink, which specifically includes the following steps:
[0148] S1. Obtaining environmental audio data collected by a sound receiving unit.
[0149] Specifically, when the translation machine is connected to a Bluetooth headset, the ambient audio data sent by the headset via Bluetooth can be obtained, and the ambient audio data is the ambient audio data collected by the microphone of the headset. When the translation machine is not connected to the headset, the ambient audio data collected by the sound receiving unit of the translation machine itself can be obtained.
[0150] Taking the scenario where a user chats with other users through a chat software on a smart terminal as an example, the smart terminal can transmit the audio sent by the other party to the translation machine for translation and speech synthesis, and output the synthesized audio in the target language for the user to listen to. On this basis, the translation machine can also collect the voice emitted by the user as the environmental audio data in this step.
[0151] Further optionally, after obtaining the ambient audio data, the ambient audio data may be pre-processed, including but not limited to: noise reduction processing, echo cancellation processing, adaptive gain processing, etc.
[0152] S2. When the translation machine is in the first state, the environmental audio data is translated to obtain a translated text in the source language.
[0153] Specifically, when the translation function is turned on, the translation machine can translate the collected ambient audio data, that is, translate the ambient audio data in the target language into the translated text in the source language. The source language can be understood as the language used by the original audio data sent by the smart terminal in the aforementioned step S100.
[0154] Of course, the source language can also be set by the user, such as setting the translated source language through the human-computer interaction interface of the translator.
[0155] S3. Synthesize the translated text of the source language into second translated audio data.
[0156] Specifically, a speech synthesis algorithm is called to synthesize the translated text of the source language into audio data, which is defined as second translated audio data in this step.
[0157] S4. Obtain second target audio data based on the second translated audio data, and output the second target audio data to the smart terminal via a Bluetooth connection.
[0158] According to the needs of the business scenario, the second translated audio data can be directly used as the second target audio data in this step. In some other possible implementations, the second translated audio data and the ambient audio data can also be spliced in this step to obtain the spliced second target audio data.
[0159] When the second translated audio data and the ambient audio data are spliced, the splicing order of the two can be freely set, for example, the ambient audio data is placed first and the second translated audio data is placed later, so that the user can hear the ambient audio data first and then the second translated audio data. Of course, the splicing order of the two can also be reversed.
[0160] The audio translation method provided in this embodiment further adds a data downlink processing process, that is, the environmental audio data is collected by the translation machine, and translation and speech synthesis are performed, and the obtained second target audio data is sent to the smart terminal via Bluetooth. In this way, the smart terminal can obtain the audio data after the environmental audio data is translated, thereby meeting the smart terminal's needs for translating local environmental audio data.
[0161] Reference Figure 5 , another audio translation system framework diagram is provided.
[0162] The Bluetooth module of the smart terminal 100 establishes a Bluetooth connection with the Bluetooth module of the translation machine 200 (as an uplink and downlink data interface), and then BT (Bluetooth) transmission can be performed.
[0163] The translator 200 may include a main control unit (main control chip), in which a hardware abstraction layer (HAL) is provided. The HAL is a programming layer that allows a computer operating system to interact with hardware devices at a logical layer rather than a hardware layer. It abstracts the specific implementation details of the hardware from the operating system and application software by providing a set of standard interfaces and functions.
[0164] The translator 200 may also include a digital signal processing unit DSP, which may be used as a separate digital signal processing chip or integrated into a main control chip. The digital signal processing unit operates under the control of the main control unit. The digital signal processing unit may include a data selection unit, an audio algorithm processing unit, and a channel separation unit. Among them, the data selection unit is used to realize the splicing and fusion of two audio data, such as splicing the original audio data sent by the intelligent terminal and the first translated audio data; or, splicing the environmental audio data collected by the translator and the second translated audio data. The audio algorithm processing unit is used to perform relevant algorithm processing on the audio, for example, performing pre-processing such as noise reduction, echo cancellation, adaptive gain, etc. on the audio, and performing speech synthesis and other processing on the translated text. The channel separation unit is used to perform channel separation on the original audio data to obtain the original audio data of at least one channel after separation.
[0165] The translator 200 may also include an interactive unit, a translation engine, and a communication unit. The translation engine provides a local translation function. The interactive unit may provide a user interaction portal for the user to select online translation or offline translation. When offline translation is selected, the translation engine may be used to perform local translation on the audio. When online translation is selected, the audio to be translated may be sent to a remote translation server through the communication unit, and the translated text returned by the remote translation server may be received.
[0166] The translator 200 may further include a playback unit and a sound receiving unit. The first target audio data may be output and played through the playback unit, or may be output and played through an external Bluetooth headset 300.
[0167] The sound receiving unit can collect the ambient audio data, or collect the ambient audio data through an external Bluetooth headset 300.
[0168] The original audio data sent by the smart terminal 100 to the translation machine 200 is defined as uplink data, which is processed through the uplink data link and finally output and played through the Bluetooth headset 300 as the first target audio data.
[0169] The Bluetooth headset 300 collects ambient audio data, sends it to the translator 200 for translation and other processing to obtain second target audio data, and sends the second target audio data to the smart terminal 100 via Bluetooth. This process is defined as a downlink data link processing process.
[0170] For uplink data link processing:
[0171] After the translator obtains the uplink data (original audio data), it can directly enter the channel separation unit of the digital signal processing unit. The main control unit controls whether to separate the channels according to the left and right ears, and then translate different audios in both ears. In other words, the main control unit controls whether to turn on the channel separation function. When the channel separation function is turned on, the channel separation unit separates the uplink data and obtains the uplink data of each channel after separation. And then it is sent to the audio algorithm processing unit.
[0172] The audio algorithm processing unit pre-processes the uplink data and then sends it to the hardware abstraction layer of the main control unit. At the same time, the main control unit can set whether to enable the translation function and select online translation or offline translation through the interactive unit.
[0173] If the translation function is turned on after the uplink data passes through the hardware abstraction layer, it is sent to the translation engine for translation, and the translated text is output. The translated text is sent to the audio algorithm processing unit again for speech synthesis to generate the first translated audio data.
[0174] The first translated audio data can be used as the first target audio data to be output, and transmitted to the Bluetooth headset for output and playback.
[0175] In another case, the first translated audio data can also be sent to a data selection unit, where the first translated audio data and the original audio data are spliced to obtain the spliced first target audio data, which is then transmitted to the Bluetooth headset for output and playback.
[0176] For downlink data link processing:
[0177] The microphone of the Bluetooth headset collects the downlink data (ambient audio data) and sends it to the audio algorithm processing unit of the translator for preprocessing. The preprocessed downlink data is sent to the hardware abstraction layer. At the same time, the main control unit sets whether to enable the translation function and selects online translation or offline translation through the interactive unit.
[0178] If the translation function is turned on after the downlink data passes through the hardware abstraction layer, it is sent to the translation engine for translation, and the translated text is output. The translated text is sent to the audio algorithm processing unit again for speech synthesis to generate second translated audio data.
[0179] The second translated audio data can be used as second target audio data to be output and sent to the smart terminal via a Bluetooth connection.
[0180] In another case, the second translated audio data can also be sent to a data selection unit, where the second translated audio data and the ambient audio data are spliced to obtain spliced second target audio data, which are sent to the smart terminal via a Bluetooth connection.
[0181] Reference Figure 6 , providing another audio translation system framework diagram.
[0182] The smart terminal 100 and the translator 200 are connected via Bluetooth, and the Bluetooth connection between the two can adopt two optional protocols: first, the Bluetooth connection between the smart terminal 100 and the translator 200 uses the SOC protocol. Through the SOC (System on Chip) protocol, the smart terminal 100 can directly send the uplink data (original audio data) to the digital signal processing unit in the translator 200; second, the Bluetooth connection between the smart terminal 100 and the translator 200 uses the HCI protocol. Through the HCI (Host Controller Interface) protocol, the smart terminal 100 can send the uplink data (original audio data) to the main control unit in the translator 200, and the hardware abstraction layer in the main control unit controls the sending of the uplink and downlink data to the digital signal processing unit for processing. Furthermore, through the HCI protocol, the translator can also obtain other information of the smart terminal 100, and perform simple control of the smart terminal 100 through the translator 200, such as controlling the opening of certain applications in the smart terminal 100 on the translator 200, etc., which is convenient for users to use.
[0183] Furthermore, the translation machine 200 can also broadcast audio information to multiple Bluetooth slave devices at the same time through the Bluetooth CSB (Connectionless Slave Broadcast) protocol, which is suitable for multi-person scenarios.
[0184] The audio translation device provided in an embodiment of the present application is described below. The audio translation device described below and the audio translation method described above can refer to each other.
[0185] Audio translation devices are used in translation machines, see Figure 7 , Figure 7 A schematic diagram of the structure of an audio translation device disclosed in an embodiment of the present application.
[0186] like Figure 7 As shown, the device may include:
[0187] The original data receiving module 11 is used to receive the original audio data transmitted by the smart terminal via Bluetooth;
[0188] A translation module 12, configured to translate the original audio data to obtain a translated text in a target language when the translation machine is in a first state, wherein the first state is a state in which the translation function is enabled;
[0189] A speech synthesis module 13, used for synthesizing the translated text in the target language into first translated audio data;
[0190] The audio output module 14 is used to obtain first target audio data to be output based on the first translated audio data, and output and play the first target audio data.
[0191] In a possible implementation, the process of the audio output module obtaining the first target audio data to be output based on the first translated audio data includes:
[0192] using the first translated audio data as the first target audio data;
[0193] or,
[0194] The first translated audio data and the original audio data are spliced together to obtain spliced first target audio data.
[0195] In a possible implementation, the translation machine is also connected to the headset via Bluetooth. On this basis, the device of the present application may further include:
[0196] A channel separation module, used to perform channel separation on the original audio data to obtain original audio data of at least one channel;
[0197] The process in which the translation module translates the original audio data to obtain a translated text in the target language includes:
[0198] Translating the original audio data of each channel respectively to obtain a translated text in a target language of at least one channel;
[0199] The process of synthesizing the translated text in the target language into the first translated audio data by the speech synthesis module includes:
[0200] synthesizing the translated text of the target language of each channel into first translated audio data respectively, to obtain first translated audio data of at least one channel;
[0201] The process in which the audio output module obtains the first target audio data to be output based on the first translated audio data, and outputs and plays the first target audio data includes:
[0202] Based on the first translated audio data of each channel, first target audio data of each channel to be output is obtained;
[0203] The first target audio data of different channels are respectively transmitted to the left and right ear channels of the headset via Bluetooth, so as to output the first target audio data of different channels via the left and right ear channels of the headset.
[0204] In a possible implementation, the original audio data carries channel information, and the process of the channel separation module performing channel separation on the original audio data includes:
[0205] Channel separation is performed on the original audio data according to the channel information.
[0206] In a possible implementation, if the original audio data of the at least one channel is the original audio data of one channel; correspondingly, the process in which the audio output module transmits the first target audio data of different channels to the left and right ear channels of the headset via Bluetooth respectively includes:
[0207] Transmitting first target audio data of a channel to a target ear channel of the headset via Bluetooth, wherein the target ear channel is one of the left and right ear channels specified by a user, or the target ear channel is one of the left and right ear channels selected by default or randomly selected;
[0208] If the original audio data of the at least one channel is the original audio data of two channels; correspondingly, the process in which the audio output module transmits the first target audio data of different channels to the left and right ear channels of the headset via Bluetooth respectively includes:
[0209] The first target audio data of the two channels are respectively transmitted to the left and right ear channels of the headset via Bluetooth, wherein any ear channel of the headset corresponds to the first target audio data of one channel.
[0210] In a possible implementation, the process of obtaining the first target audio data of each channel to be output by the audio output module based on the first translated audio data of each channel includes:
[0211] Using the first translated audio data of each channel as the first target audio data, respectively, to obtain the first target audio data of each channel;
[0212] or,
[0213] For each channel, the first translated audio data of the current channel and the original audio data of the current channel are concatenated to obtain the first target audio data of the current channel.
[0214] In a possible implementation, the device of the present application may further include:
[0215] The audio preprocessing module is used to preprocess the original audio data before translating the original audio data, and the preprocessing includes at least one of the following: noise reduction processing, echo cancellation processing, and adaptive gain processing.
[0216] In a possible implementation, the device of the present application may further include: an environment data acquisition module and an audio sending module;
[0217] The environment data acquisition unit is used to acquire the environment audio data sent by the headset via Bluetooth, and the environment audio data is the audio data collected by the microphone of the headset; on this basis, the translation module is also used to translate the environment audio data when the translation machine is in the first state to obtain the translated text in the source language; the speech synthesis module is also used to synthesize the translated text in the source language into the second translated audio data;
[0218] The audio sending module is used to obtain second target audio data based on the second translated audio data, and output the second target audio data to the smart terminal through a Bluetooth connection.
[0219] In a possible implementation, the process of the audio sending module obtaining the second target audio data based on the second translated audio data includes:
[0220] using the second translated audio data as the second target audio data;
[0221] or,
[0222] The second translated audio data and the environmental audio data are spliced to obtain spliced second target audio data.
[0223] In a possible implementation, the audio preprocessing module is further used to preprocess the environmental audio data, and the preprocessing includes at least one of the following: noise reduction processing, echo cancellation processing, and adaptive gain processing.
[0224] The present application also provides a translation machine. Figure 8 As shown, it shows a structural schematic diagram of a translation machine suitable for implementing the embodiment of the present application. Figure 8 The translation machine shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0225] like Figure 8 As shown, the translator may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 to a random access memory (RAM) 603 to implement the audio translation method of the aforementioned embodiment of the present application. When the translator is powered on, various programs and data required for the operation of the translator are also stored in the RAM 603. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0226] Typically, the following devices may be connected to the I / O interface 605: input devices 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 608 including, for example, a memory card, a hard disk, etc.; and communication devices 609. The communication device 609 may allow the translator to communicate with other devices wirelessly or by wire to exchange data. Figure 8 The translator with various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0227] An embodiment of the present application also provides a computer program product, including computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements any audio translation method provided in the embodiment of the present application.
[0228] A computer-readable storage medium is also provided in an embodiment of the present application. The storage medium carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any audio translation method provided in the embodiment of the present application.
[0229] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.
[0230] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0231] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.
[0232] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.
[0233] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The various embodiments can be combined as needed, and the same or similar parts can refer to each other.
Claims
1. An audio translation method, characterized in that: Applied to a translation machine, the translation machine is connected to a smart terminal via Bluetooth, and the audio translation method includes: Receiving original audio data transmitted by the smart terminal via Bluetooth; When the translation machine is in a first state, translating the original audio data to obtain a translated text in a target language, the first state being a state in which the translation function is turned on; synthesizing the translated text in the target language into first translated audio data; First target audio data to be output is obtained based on the first translated audio data, and the first target audio data is output and played.
2. The method according to claim 1, characterized in that The process of obtaining first target audio data to be output based on the first translated audio data includes: using the first translated audio data as the first target audio data; or, The first translated audio data and the original audio data are spliced together to obtain spliced first target audio data.
3. The method according to claim 1, characterized in that: The translation machine is also connected to the headset via Bluetooth; The process of translating the original audio data to obtain a translated text in a target language includes: Separating the original audio data into channels to obtain original audio data of at least one channel, and translating the original audio data of each channel to obtain translated text in a target language of at least one channel; The process of synthesizing the translated text in the target language into first translated audio data comprises: synthesizing the translated text of the target language of each channel into first translated audio data respectively, to obtain first translated audio data of at least one channel; The process of obtaining first target audio data to be output based on the first translated audio data, and outputting and playing the first target audio data includes: Based on the first translated audio data of each channel, first target audio data of each channel to be output is obtained; The first target audio data of different channels are respectively transmitted to the left and right ear channels of the headset via Bluetooth, so as to output the first target audio data of different channels via the left and right ear channels of the headset.
4. The method according to claim 3, characterized in that: The original audio data carries channel information, and the process of performing channel separation on the original audio data includes: Channel separation is performed on the original audio data according to the channel information.
5. The method according to claim 3, characterized in that: If the original audio data of the at least one channel is the original audio data of one channel; correspondingly, the process of transmitting the first target audio data of different channels to the left and right ear channels of the headset through Bluetooth respectively includes: Transmitting first target audio data of a channel to a target ear channel of the headset via Bluetooth, wherein the target ear channel is one of the left and right ear channels specified by a user, or the target ear channel is one of the left and right ear channels selected by default or randomly selected; If the original audio data of the at least one channel is the original audio data of two channels; correspondingly, the process of transmitting the first target audio data of different channels to the left and right ear channels of the headset via Bluetooth respectively includes: The first target audio data of the two channels are respectively transmitted to the left and right ear channels of the headset via Bluetooth, wherein any ear channel of the headset corresponds to the first target audio data of one channel.
6. The method according to claim 3, characterized in that The process of obtaining first target audio data of each channel to be output based on first translated audio data of each channel includes: Using the first translated audio data of each channel as the first target audio data, respectively, to obtain the first target audio data of each channel; or, For each channel, the first translated audio data of the current channel and the original audio data of the current channel are concatenated to obtain the first target audio data of the current channel.
7. The method according to claim 1, characterized in that Before translating the original audio data, the method further includes: The original audio data is preprocessed, and the preprocessing includes at least one of the following: noise reduction processing, echo cancellation processing, and adaptive gain processing.
8. The method according to claim 3, characterized in that Also includes: Acquire ambient audio data sent by the headset via Bluetooth, where the ambient audio data is audio data collected by a microphone of the headset; When the translation machine is in the first state, translating the environmental audio data to obtain a translated text in the source language; synthesizing the translated text in the source language into second translated audio data; Second target audio data is obtained based on the second translated audio data, and the second target audio data is output to the smart terminal via Bluetooth.
9. The method according to claim 8, characterized in that The process of obtaining the second target audio data based on the second translated audio data includes: using the second translated audio data as the second target audio data; or, The second translated audio data and the environmental audio data are spliced to obtain spliced second target audio data.
10. The method according to claim 8, characterized in that Before translating the environmental audio data, the method further includes: The environmental audio data is preprocessed, and the preprocessing includes at least one of the following: noise reduction processing, echo cancellation processing, and adaptive gain processing.
11. An audio translation system, characterized in that: include: Smart terminals and translation machines; The smart terminal is connected to the translation machine via Bluetooth; The intelligent terminal is used to transmit the original audio data to the translation machine via Bluetooth connection; The translation machine is used to implement each step of the audio translation method according to any one of claims 1 to 10.
12. The system according to claim 11, characterized in that The translation machine is a Bluetooth master-slave integrated device. Accordingly, the translation machine is connected to the smart terminal via Bluetooth as a slave device and is also connected to the headset via Bluetooth as a master device.