Simultaneous interpretation method and device based on Bluetooth transmission, equipment and medium

Abstract

The invention discloses a simultaneous interpretation method, device and equipment based on Bluetooth transmission and a medium, and the method comprises the steps: starting a simultaneous interpretation service according to a starting instruction, creating a virtual microphone, and carrying out the connection configuration of the virtual microphone and a current active application, receiving a first voice collected by the Bluetooth playing device, translating the first voice into a second voice through the simultaneous interpretation service, feeding back the second voice to the Bluetooth playing device, obtaining a mirror image voice synchronously collected by the second voice played by the Bluetooth playing device, collecting the mirror image voice through the virtual microphone, and forwarding the mirror image voice to the current activity application; and the current activity application outputs the mirror image voice to the docking terminal. According to the method, the simultaneous interpretation service is started and the corresponding virtual microphone is created, so that the method is not limited by application programs and application scenes, simultaneous interpretation can be realized through Bluetooth transmission connection, the method can be applied to scenes of real-time conferences or real-time calls, the application scenes are greatly expanded, and the user experience is improved. And the application range of the simultaneous interpretation method for Bluetooth transmission connection is widened.

Description

Technical Field

[0001] The present invention relates to the field of speech processing technology, and in particular to a simultaneous interpretation method, device, equipment and medium based on Bluetooth transmission. Background Art

[0002] When using a terminal for a real-time conference or a real-time call, simultaneous interpretation is required between the two or more parties of the call. However, the existing simultaneous interpretation technology has great limitations in its application after the terminal is connected to the Bluetooth device by Bluetooth. For example, the technical method used in the patent with application number CN201910513900.9 requires the use of two Bluetooth headsets to simultaneously connect to a terminal by Bluetooth, and can only be used when two users use a Bluetooth headset respectively for face-to-face communication. Therefore, the simultaneous interpretation method applied to Bluetooth transmission connection in the prior art cannot be used in the scenario of real-time conference or real-time voice call, resulting in poor flexibility in its application. Therefore, the simultaneous interpretation method used for Bluetooth transmission connection in the prior art method has the problem of narrow scope of application. Summary of the invention

[0003] The embodiments of the present invention provide a simultaneous interpretation method, device, equipment and medium based on Bluetooth transmission, aiming to solve the problem of narrow application scope of the simultaneous interpretation method for Bluetooth transmission connection in the prior art method.

[0004] In a first aspect, an embodiment of the present invention provides a simultaneous interpretation method based on Bluetooth transmission, wherein the method is applied to a terminal device, a Bluetooth communication connection is established between the terminal device and a Bluetooth playback device, and a network connection is established between the terminal device and a docking terminal, and the method includes:

[0005] If the input start instruction is received, start the simultaneous interpretation service according to the start instruction and create a corresponding virtual microphone;

[0006] Connecting and configuring the virtual microphone to the currently active application;

[0007] Receiving a first voice collected from the Bluetooth playback device, translating the first voice through the simultaneous interpretation service to obtain a corresponding second voice and feeding it back to the Bluetooth playback device;

[0008] Receiving a mirrored voice from the Bluetooth playback device; the mirrored voice is voice information obtained by synchronously collecting the second voice played by the Bluetooth device;

[0009] Synchronously forwarding the mirrored voice via the virtual microphone to a currently active application configured to be connected to the virtual microphone;

[0010] The mirrored voice is output to the docking terminal through the currently active application.

[0011] In a second aspect, an embodiment of the present invention further provides a simultaneous interpretation device based on Bluetooth transmission, wherein the device is configured in a terminal device, a Bluetooth communication connection is established between the terminal device and a Bluetooth playback device, and a network connection is established between the terminal device and a docking terminal. The device is used to perform the simultaneous interpretation method based on Bluetooth transmission as described in the first aspect above, and the device includes:

[0012] A starting unit, configured to start the simultaneous interpretation service and create a corresponding virtual microphone according to the starting instruction if the starting instruction is received;

[0013] A connection configuration unit, used to configure the connection between the virtual microphone and the currently active application;

[0014] A first translation unit, configured to receive a first voice collected from the Bluetooth playback device, translate the first voice through the simultaneous interpretation service to obtain a corresponding second voice and feed it back to the Bluetooth playback device;

[0015] A mirror voice receiving unit, used for receiving the mirror voice from the Bluetooth playback device; the mirror voice is the voice information obtained by synchronously collecting the second voice played by the Bluetooth device;

[0016] A synchronous forwarding unit, configured to synchronously forward the mirrored voice through the virtual microphone to a currently active application that is connected and configured with the virtual microphone;

[0017] An output unit is used to output the mirrored voice to the docking terminal through the currently active application.

[0018] In a third aspect, an embodiment of the present invention further provides a computer device, wherein the device includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0019] Memory, used to store computer programs;

[0020] The processor is used to implement the steps of the simultaneous interpretation method based on Bluetooth transmission described in the first aspect when executing the program stored in the memory.

[0021] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the simultaneous interpretation method based on Bluetooth transmission as described in the first aspect above are implemented.

[0022] The embodiment of the present invention provides a method, device, equipment and medium for simultaneous interpretation based on Bluetooth transmission, the method comprising: starting the simultaneous interpretation service and creating a virtual microphone according to the startup instruction, connecting and configuring the virtual microphone with the current active application, receiving the first voice collected by the Bluetooth playback device and translating it into the second voice through the simultaneous interpretation service and feeding it back to the Bluetooth playback device, obtaining the mirror voice collected synchronously by the Bluetooth playback device playing the second voice and forwarding it to the current active application after being collected through the virtual microphone, and the current active application outputs the mirror voice to the docking terminal. The above method, by starting the simultaneous interpretation service and creating the corresponding virtual microphone, is not subject to the limitations of the application program and the limitations of the application scenario, can realize simultaneous interpretation through the Bluetooth transmission connection and be applied to the scenarios of real-time conferences or real-time calls, greatly expanding the application scenarios and broadening the scope of application of the simultaneous interpretation method for Bluetooth transmission connection. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0024] Figure 1 A method flow chart of a simultaneous interpretation method based on Bluetooth transmission provided by an embodiment of the present invention;

[0025] Figure 2 A schematic diagram of an application scenario of a simultaneous interpretation method based on Bluetooth transmission provided by an embodiment of the present invention;

[0026] Figure 3 A schematic diagram of information transmission of a simultaneous interpretation method based on Bluetooth transmission provided by an embodiment of the present invention;

[0027] Figure 4 A schematic block diagram of a simultaneous interpretation device based on Bluetooth transmission provided by an embodiment of the present invention;

[0028] Figure 5 It is a schematic block diagram of a computer device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In this application, the Bluetooth playback device 20 is a terminal device that supports the Bluetooth communication protocol, such as a Bluetooth headset, a Bluetooth watch, etc. Among them, the Bluetooth communication protocol can be an ER traditional Bluetooth protocol, a BDR traditional Bluetooth protocol, or a BLE low-power Bluetooth protocol. Of course, it can also be other new Bluetooth protocol types launched in the future. From the perspective of the Bluetooth protocol version, the Bluetooth communication protocol version can be any of the following: 5.0 series version, based on other series versions launched in the future.

[0030] The Bluetooth playback device 20 includes at least one audio collection component and at least one audio playback component. For example, for a Bluetooth headset, it may include one or two headsets, each headset is individually provided with an audio playback component, wherein at least one headset is provided with an audio collection component, or an audio collection component is provided on a Bluetooth headset box. For a Bluetooth watch, an audio collection component and at least one audio playback component may be provided on the watch body.

[0031] The Bluetooth headset in this application can be one or more of the following applications: HSP (Headset Profile) application, HFP (Hands-free Profile) application, A2DP (Advanced Audio Distribution Profile) application, AVRCP (Audio / Video Remote Control Profile) application.

[0032] Among them, HSP application stands for headset application, which provides the basic functions required for communication between the terminal and the headset. The Bluetooth headset can be used as the audio input and output interface of the terminal.

[0033] HFP application stands for hands-free application. HFP application adds some extended functions based on HSP application. Bluetooth headset can control the call process of the terminal, such as answering, hanging up, rejecting, voice dialing, etc.

[0034] A2DP is an advanced audio transmission application. A2DP can use the chip in the headset to stack data to achieve high-definition sound.

[0035] The AVRCP application is an audio and video remote control application that defines how to control the characteristics of streaming media, including: pause, stop, start playback, volume control, and other types of remote control operations.

[0036] An application (APP) is an application installed on a terminal device and running based on the system program in the terminal device. The application can run on the terminal device and realize corresponding functions, such as live broadcast, conference or voice conversation.

[0037] In the present application, the terminal device 10 can be any device with computing processing capabilities. Of course, the terminal device can also have audio and video playback and interface display functions. For example, the terminal device can be a mobile phone, a computer, a smart TV, a vehicle-mounted device, a wearable device, an industrial device, etc. The terminal device 100 supports the Bluetooth communication protocol.

[0038] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0039] It should be understood that when used in this specification and the appended claims, the terms "include" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0040] It should also be understood that the terms used in the present specification are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the present specification and the appended claims, the singular forms "a", "an" and "the" are intended to include plural forms unless the context clearly indicates otherwise.

[0041] It should be further understood that the term "and / or" used in the present description and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0042] See also Figure 1 As shown in the figure, the embodiment of the present invention provides a simultaneous interpretation method based on Bluetooth transmission, which is applied to a terminal device and is executed by an application software installed in the terminal device. Figure 2As shown, a Bluetooth communication connection is established between the terminal device 10 and the Bluetooth playback device 20, and a network connection is established between the terminal device 10 and the docking terminal 30. The terminal device 10 is a device for running applications and starting simultaneous interpretation services. The terminal device 10 can be a terminal device such as a laptop computer, a desktop computer, a tablet computer or a mobile phone; the Bluetooth playback terminal 20 is a terminal device with Bluetooth connection function and voice playback and voice collection functions, such as a Bluetooth headset, a Bluetooth watch, a Bluetooth remote control, etc. The docking terminal 30 is a terminal device that establishes a network connection with the terminal device 10 through a wired LAN or a wireless LAN. The docking terminal 30 can be a terminal device such as a laptop computer, a desktop computer, a tablet computer or a mobile phone, or a terminal device with voice playback and voice collection functions such as a smart speaker and a smart voice recorder; the near-end user is the user of the terminal device 10, and the far-end user is the user of the docking terminal 30. The transmission of voice signals during specific applications is as shown in FIG. Figure 3 As shown. Figure 1 As shown, the method includes steps S110 to S160.

[0043] S110: If the input start instruction is received, start the simultaneous interpretation service according to the start instruction and create a corresponding virtual microphone.

[0044] If the input start instruction is received, the simultaneous interpretation service is started according to the start instruction and a corresponding virtual microphone is created. The near-end user can input the start instruction in the terminal device, and the terminal device can start the simultaneous interpretation service according to the start instruction and create a virtual microphone inside the terminal device. Among them, the simultaneous interpretation service is also an application imaging service, which provides the simultaneous interpretation service by running the program code inside the terminal device. The virtual microphone is also a functional module virtualized inside the terminal device, and the virtual microphone can realize virtual collection of voice.

[0045] In a specific embodiment, step S110 includes sub-steps: creating an independent first process and a second process and allocating corresponding system resources to each of them; starting a simultaneous interpretation service that matches the startup instruction in the first process; obtaining the system configuration language of the terminal device and the target translation language in the startup instruction to configure the language parameters of the simultaneous interpretation service; and creating a virtual microphone corresponding to the simultaneous interpretation service in the second process.

[0046] Specifically, a first process and a second process that are independent of each other can be created in the terminal device, and corresponding system resources can be allocated to the first process and the second process respectively, and each process can run an application service separately. Specifically, a simultaneous interpretation service that matches the start instruction can be started in the first process, and the start instruction contains pointing information pointing to the corresponding interpretation program code. Then, according to the pointing information in the start instruction, the corresponding interpretation program code can be obtained to run and start the simultaneous interpretation service.

[0047] Furthermore, the system configuration language of the terminal device can be obtained, for example, the system configuration language of the terminal device is "Simplified Chinese". The startup instruction also includes a target translation language, which is the language type corresponding to the other language that needs to be translated from the language of user A. The target translation language is obtained from the startup instruction and the language parameters of the simultaneous interpretation service are configured together with the system configuration language. The simultaneous interpretation service can perform simultaneous interpretation between the two language types according to the language parameter configuration. Furthermore, the transmission interface parameters in the simultaneous interpretation service can also be configured, and the transmission interface parameters of the simultaneous interpretation service can be configured as Bluetooth connection parameters corresponding to the Bluetooth playback device. The simultaneous interpretation service can directly transmit data information through the Bluetooth connection with the Bluetooth playback device based on the configured transmission interface parameters.

[0048] Furthermore, a virtual microphone can be created in the second process, and the virtual microphone is a virtual component associated with the simultaneous interpretation service. The transmission interface parameters of the virtual microphone can be configured to inherit the transmission interface parameters configured in the simultaneous interpretation service, so that the virtual microphone can share the Bluetooth connection corresponding to the Bluetooth playback device, and the virtual microphone can monitor the voice signal received in the Bluetooth connection by configuring the transmission interface parameters of the virtual microphone.

[0049] S120: Connect and configure the virtual microphone to the currently active application.

[0050] The virtual microphone is connected and configured with the current active application. Further, the virtual microphone can be connected and configured with the current active application, wherein the current active application can be a live broadcast application, a conference application, a telephone application, etc., and the virtual microphone can be connected and configured with one or more current active applications.

[0051] In a specific embodiment, step S120 includes sub-steps: configuring the application transmission interface of the virtual microphone according to the interface information of the currently active application; and establishing a corresponding connection channel according to the configured application transmission interface to achieve connection configuration with the currently active application.

[0052] Specifically, the interface information of each currently active application in the system background can be obtained, and the application transmission interface of the virtual microphone can be configured with parameters through the interface information of each currently active application, so that the virtual microphone can clearly obtain the output object of the voice information through the application transmission interface. According to the configured application transmission interface, a connection channel is established from the virtual microphone to the corresponding currently active application, and the virtual microphone may have one or more connection channels, and each connection channel corresponds to a currently active application.

[0053] S130: receiving a first voice collected by the Bluetooth playback device, translating the first voice through the simultaneous interpretation service to obtain a corresponding second voice and feeding the second voice back to the Bluetooth playback device.

[0054] Receive the first voice collected from the Bluetooth playback device, translate the first voice through the simultaneous interpretation service to obtain the corresponding second voice and feed it back to the Bluetooth playback device. If the first voice collected from the Bluetooth playback device is received, input the first voice into the simultaneous interpretation service for translation to obtain the second voice corresponding to the first voice, and feed the second voice back to the Bluetooth playback device through the Bluetooth connection. Figure 3 As shown, the Bluetooth playback device can transmit the first voice to the simultaneous interpretation service through the #1 transmission path, and the simultaneous interpretation service can transmit the second voice to the Bluetooth playback device through the #2 transmission path for playback. The simultaneous interpretation service is configured with a first language type (corresponding to user A) and a second language type (corresponding to user B). The simultaneous interpretation service can parse the first voice through the first language type, obtain semantic parsing information, and then generate the second voice according to the second language type.

[0055] The above example only describes the simultaneous interpretation application scenario of conference applications. In the live broadcast application scenario, the virtual microphone can be used to collect voice from the Bluetooth playback device and push it to the live broadcast application to generate a multimedia live stream for live presentation. At this time, the simultaneous interpretation service can provide a synchronous voice translation service for the live broadcast application, and translate the voice of the near-end user into another language type and add it to the multimedia live stream. In the telephone application scenario, the virtual microphone can be used to collect voice from the Bluetooth playback device and push it to the telephone application to realize the transmission of telephone voice information. At this time, the simultaneous interpretation service can provide a synchronous voice response service for the telephone application.

[0056] S140: Receive the mirrored voice from the Bluetooth playback device.

[0057] Receive the mirror voice from the Bluetooth playback device; the mirror voice is the voice information obtained by synchronously collecting the second voice played by the Bluetooth device. The Bluetooth playback device plays the second voice and synchronously collects the audio of the played second voice information to obtain the mirror voice. The Bluetooth playback device synchronously sends the played mirror voice to the terminal device, and the terminal device can receive the mirror voice.

[0058] S150. Synchronously forwarding the mirrored voice through the virtual microphone to a currently active application that is connected and configured with the virtual microphone.

[0059] The mirrored voice is synchronously forwarded through the virtual microphone to the currently active application that is connected to the virtual microphone. The mirrored voice is synchronously forwarded through the connection channel established between the virtual microphone and the currently active application, so that one or more currently active applications that are connected to the virtual microphone can receive the mirrored voice. Specifically, Figure 3 As shown, the virtual microphone can receive the mirrored voice through the #3 transmission path and push the mirrored voice to the corresponding currently active application through the #4 transmission path.

[0060] S160: Output the mirrored voice to the docking terminal through the currently active application.

[0061] Output the mirrored voice to the docking terminal through the currently active application. Output the obtained mirrored voice to the docking terminal through the currently active application, so that the remote user of the docking terminal can obtain the translated voice corresponding to the first voice. Specifically, Figure 3 As shown, the currently active application #5 transmission path pushes the mirrored voice to the docking terminal.

[0062] In a specific embodiment, the above method also includes the steps of: if a third voice is received from the docking terminal, synchronously forwarding the third voice to the simultaneous interpretation service through the currently active application, so as to obtain a fourth voice corresponding to the third voice through the simultaneous interpretation service; and sending the fourth voice to the Bluetooth playback device for playback.

[0063] At the same time, the docking terminal can send the third voice generated by the remote user to the terminal device, and the terminal device can forward the third voice to the simultaneous interpretation service through the current active application that is connected to the docking terminal for communication, and the simultaneous interpretation service translates the received third voice to obtain the fourth voice. Among them, the docking terminal used by the remote user can send the third voice to the terminal device through the #5 transmission path, and the current active application forwards the received third voice to the simultaneous interpretation service through the #6 transmission path. Specifically, the simultaneous interpretation service can parse the third voice through the second language type (corresponding to the remote user), obtain the semantic analysis information, and then generate the fourth voice according to the first language type (corresponding to the near-end user).

[0064] After the terminal device acquires the fourth voice, it can send it to the Bluetooth playback device, and the Bluetooth playback device plays the fourth voice after receiving it. The terminal device can send the fourth voice to the Bluetooth playback device through the #2 transmission path.

[0065] In another specific embodiment, the above method also includes the steps of: if a third voice is received from the docking terminal, forwarding the third voice to the Bluetooth playback device through the currently active application; receiving synchronous voice from the Bluetooth playback device; the synchronous voice is voice information obtained by synchronously collecting the third voice played by the Bluetooth device; translating the synchronous voice through the simultaneous interpretation service to obtain a fourth voice corresponding to the third voice; and sending the fourth voice to the Bluetooth playback device for playback.

[0066] Alternatively, when a third voice is received from the docking terminal, the currently active application forwards the third voice to the Bluetooth playback device. Specifically, the currently active application can send the third voice to the Bluetooth playback device via the #7 transmission path. The Bluetooth playback device plays the third voice and synchronously collects and obtains a synchronized voice corresponding to the third voice. The Bluetooth playback device feeds back the synchronized voice to the terminal device, and the Bluetooth playback device sends the synchronized voice to the simultaneous interpretation service via the #7 transmission path; the terminal device translates the synchronized voice via the simultaneous interpretation service to obtain a fourth voice corresponding to the third voice. The terminal device then sends the obtained fourth voice to the Bluetooth playback device for playback. The simultaneous interpretation server in the terminal device can send the fourth voice to the Bluetooth playback device via the #2 transmission path.

[0067] In the simultaneous interpretation method based on Bluetooth transmission disclosed in the above embodiment, the method includes: starting the simultaneous interpretation service and creating a virtual microphone according to the startup instruction, connecting and configuring the virtual microphone with the current active application, receiving the first voice collected by the Bluetooth playback device and translating it into the second voice through the simultaneous interpretation service and feeding it back to the Bluetooth playback device, obtaining the mirror voice collected synchronously by the Bluetooth playback device playing the second voice and forwarding it to the current active application after being collected through the virtual microphone, and the current active application outputs the mirror voice to the docking terminal. The above method, by starting the simultaneous interpretation service and creating the corresponding virtual microphone, is not subject to the limitations of the application program and the limitations of the application scenario, and can realize simultaneous interpretation through the Bluetooth transmission connection and be applied to the scenarios of real-time meetings or real-time calls, which greatly expands the application scenarios and broadens the scope of application of the simultaneous interpretation method for Bluetooth transmission connection.

[0068] The embodiment of the present invention also provides a simultaneous interpretation device based on Bluetooth transmission, which can be configured in a terminal device and is used to execute any embodiment of the aforementioned simultaneous interpretation method based on Bluetooth transmission. Figure 4 , Figure 4 A schematic block diagram of a simultaneous interpretation device based on Bluetooth transmission provided in an embodiment of the present invention.

[0069] like Figure 4 As shown, the simultaneous interpretation device 100 based on Bluetooth transmission includes a starting unit 110 , a connection configuration unit 120 , a first translation unit 130 , a mirror voice receiving unit 140 , a synchronous forwarding unit 150 and an output unit 160 .

[0070] The starting unit 110 is configured to start the simultaneous interpretation service and create a corresponding virtual microphone according to the starting instruction if the starting instruction is received.

[0071] In a specific embodiment, the startup unit 110 includes: a process creation unit, which is used to create an independent first process and a second process and allocate corresponding system resources to each of them; a service startup unit, which is used to start a simultaneous interpretation service matching the startup instruction in the first process; a language parameter configuration unit, which is used to obtain the system configuration language of the terminal device and the target translation language in the startup instruction to configure the language parameters of the simultaneous interpretation service; and a creation unit, which is used to create a virtual microphone corresponding to the simultaneous interpretation service in the second process.

[0072] The connection configuration unit 120 is used to configure the connection between the virtual microphone and the currently active application.

[0073] The first translation unit 130 is used to receive the first speech collected from the Bluetooth playback device, translate the first speech through the simultaneous interpretation service to obtain a corresponding second speech and feed it back to the Bluetooth playback device.

[0074] The mirror voice receiving unit 140 is used to receive the mirror voice from the Bluetooth playback device; the mirror voice is the voice information obtained by the Bluetooth device playing the second voice for synchronous collection.

[0075] The synchronous forwarding unit 150 is used to synchronously forward the mirrored voice through the virtual microphone to the currently active application connected and configured with the virtual microphone.

[0076] The output unit 160 is configured to output the mirrored voice to the docking terminal through the currently active application.

[0077] In a specific embodiment, the simultaneous interpretation device 100 based on Bluetooth transmission also includes: a second translation unit, which is used to synchronously forward the third voice to the simultaneous interpretation service through the currently active application if a third voice is received from the docking terminal, so as to obtain a fourth voice corresponding to the third voice through the simultaneous interpretation service; and a voice sending unit, which is used to send the fourth voice to the Bluetooth playback device for playback.

[0078] The simultaneous interpretation device based on Bluetooth transmission provided in the embodiment of the present invention applies the above-mentioned simultaneous interpretation method based on Bluetooth transmission, starts the simultaneous interpretation service and creates a virtual microphone according to the startup instruction, connects and configures the virtual microphone with the current active application, receives the first voice collected by the Bluetooth playback device and translates it into the second voice through the simultaneous interpretation service and feeds it back to the Bluetooth playback device, obtains the mirror voice collected synchronously by the Bluetooth playback device playing the second voice and forwards it to the current active application after being collected through the virtual microphone, and the current active application outputs the mirror voice to the docking terminal. The above-mentioned method, by starting the simultaneous interpretation service and creating the corresponding virtual microphone, is not subject to the limitations of the application program and the limitations of the application scenario, can realize simultaneous interpretation through the Bluetooth transmission connection and be applied to the scenarios of real-time meetings or real-time calls, greatly expanding the application scenarios and broadening the scope of application of the simultaneous interpretation method for Bluetooth transmission connection.

[0079] The above-mentioned simultaneous interpretation device based on Bluetooth transmission can be implemented in the form of a computer program, and the computer program can be used in Figure 5 Runs on the computer device shown.

[0080] See also Figure 5 , Figure 5The computer device provided in the embodiment of the present invention is a schematic block diagram. The computer device may be a terminal device for executing the simultaneous interpretation method based on Bluetooth transmission to realize simultaneous interpretation processing based on Bluetooth transmission.

[0081] See also Figure 5 The computer device 500 includes a processor 502 , a memory and a communication interface 505 connected via a communication bus 501 , wherein the memory may include a storage medium 503 and an internal memory 504 .

[0082] The storage medium 503 can store an operating system 5031 and a computer program 5032. When the computer program 5032 is executed, the processor 502 can execute a simultaneous interpretation method based on Bluetooth transmission, wherein the storage medium 503 can be a volatile storage medium or a non-volatile storage medium.

[0083] The processor 502 is used to provide computing and control capabilities to support the operation of the entire computer device 500 .

[0084] The internal memory 504 provides an environment for the operation of the computer program 5032 in the storage medium 503. When the computer program 5032 is executed by the processor 502, the processor 502 can execute the simultaneous interpretation method based on Bluetooth transmission.

[0085] The communication interface 505 is used for network communication, such as providing data information transmission, etc. Those skilled in the art will appreciate that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation on the computer device 500 to which the solution of the present invention is applied. The specific computer device 500 may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0086] The processor 502 is used to run the computer program 5032 stored in the memory to implement the corresponding functions in the above-mentioned simultaneous interpretation method based on Bluetooth transmission.

[0087] Those skilled in the art will understand that Figure 5 The embodiments of the computer device shown in the figure do not constitute a limitation on the specific composition of the computer device. In other embodiments, the computer device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. For example, in some embodiments, the computer device may only include a memory and a processor. In such embodiments, the structure and function of the memory and the processor are the same as those of the embodiment of the present invention. Figure 5 The embodiments shown are consistent and will not be described again here.

[0088] It should be understood that in the embodiment of the present invention, the processor 502 may be a central processing unit (CPU), and the processor 502 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0089] In another embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium may be a volatile or non-volatile computer-readable storage medium. The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps included in the above-mentioned simultaneous interpretation method based on Bluetooth transmission are implemented.

[0090] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the above-described equipment, devices and units can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. Those of ordinary skill in the art can appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, computer software or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0091] In the several embodiments provided by the present invention, it should be understood that the disclosed equipment, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. Units with the same function may also be combined into one unit. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or units, or may be an electrical, mechanical or other form of connection.

[0092] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present invention.

[0093] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0094] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a computer-readable storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned computer-readable storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a magnetic disk or an optical disk.

[0095] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A simultaneous interpretation method based on Bluetooth transmission, characterized in that: The method is applied to a terminal device, wherein a Bluetooth communication connection is established between the terminal device and a Bluetooth playback device, and a network connection is established between the terminal device and a docking terminal. The method includes: If the input start instruction is received, start the simultaneous interpretation service according to the start instruction and create a corresponding virtual microphone; Connecting and configuring the virtual microphone to the currently active application; Receiving a first voice collected from the Bluetooth playback device, translating the first voice through the simultaneous interpretation service to obtain a corresponding second voice and feeding it back to the Bluetooth playback device; Receiving a mirrored voice from the Bluetooth playback device; the mirrored voice is voice information obtained by synchronously collecting the second voice played by the Bluetooth device; Synchronously forwarding the mirrored voice via the virtual microphone to a currently active application configured to be connected to the virtual microphone; The mirrored voice is output to the docking terminal through the currently active application.

2. The simultaneous interpretation method based on Bluetooth transmission according to claim 1, characterized in that: The method further comprises: If a third voice is received from the docking terminal, the third voice is synchronously forwarded to the simultaneous interpretation service through the currently active application, so as to obtain a fourth voice corresponding to the third voice through the simultaneous interpretation service; The fourth voice is sent to the Bluetooth playback device for playback.

3. The simultaneous interpretation method based on Bluetooth transmission according to claim 1 or 2, characterized in that: The method of starting the simultaneous interpretation service according to the start instruction and creating a corresponding virtual microphone includes: Create an independent first process and a second process and allocate corresponding system resources to each process; Initiating a simultaneous interpretation service matching the initiation instruction in the first process; Acquiring the system configuration language of the terminal device and the target translation language in the startup instruction to configure language parameters for the simultaneous interpretation service; A virtual microphone corresponding to the simultaneous interpretation service is created in the second process.

4. The simultaneous interpretation method based on Bluetooth transmission according to claim 1 or 2, characterized in that: The configuring the connection between the virtual microphone and the currently active application includes: Configuring the application transmission interface of the virtual microphone according to the interface information of the currently active application; A corresponding connection channel is established according to the configured application transmission interface to achieve connection configuration with the currently active application.

5. The simultaneous interpretation method based on Bluetooth transmission according to claim 1, characterized in that: The method further comprises: If a third voice is received from the docking terminal, forwarding the third voice to the Bluetooth playback device through the currently active application; Receiving synchronous voice from the Bluetooth playback device; the synchronous voice is voice information obtained by synchronously collecting the third voice played by the Bluetooth device; translating the synchronized speech by the simultaneous interpretation service to obtain a fourth speech corresponding to the third speech; The fourth voice is sent to the Bluetooth playback device for playback.

6. A simultaneous interpretation device based on Bluetooth transmission, characterized in that: The device is configured in a terminal device, a Bluetooth communication connection is established between the terminal device and a Bluetooth playback device, a network connection is established between the terminal device and a docking terminal, and the simultaneous interpretation device based on Bluetooth transmission is used to execute the simultaneous interpretation method based on Bluetooth transmission according to any one of claims 1 to 5, and the device includes: A starting unit, configured to start the simultaneous interpretation service and create a corresponding virtual microphone according to the starting instruction if the starting instruction is received; A connection configuration unit, used to configure the connection between the virtual microphone and the currently active application; A first translation unit, configured to receive a first voice collected from the Bluetooth playback device, translate the first voice through the simultaneous interpretation service to obtain a corresponding second voice and feed it back to the Bluetooth playback device; A mirror voice receiving unit, used for receiving the mirror voice from the Bluetooth playback device; the mirror voice is the voice information obtained by synchronously collecting the second voice played by the Bluetooth device; A synchronous forwarding unit, configured to synchronously forward the mirrored voice through the virtual microphone to a currently active application that is connected and configured with the virtual microphone; An output unit is used to output the mirrored voice to the docking terminal through the currently active application.

7. The simultaneous interpretation device based on Bluetooth transmission according to claim 6, characterized in that: The device further comprises: a second translation unit, configured to, if receiving a third voice from the docking terminal, synchronously forward the third voice to the simultaneous interpretation service through the currently active application, so as to obtain a fourth voice corresponding to the third voice through the simultaneous interpretation service; The voice sending unit is used to send the fourth voice to the Bluetooth playback device for playback.

8. The simultaneous interpretation device based on Bluetooth transmission according to claim 6 or 7, characterized in that: The startup unit comprises: A process creation unit, used to create an independent first process and a second process and allocate corresponding system resources to each process; A service starting unit, configured to start a simultaneous interpretation service matching the starting instruction in the first process; A language parameter configuration unit, configured to obtain the system configuration language of the terminal device and the target translation language in the startup instruction to configure the language parameters of the simultaneous interpretation service; A creating unit is used to create a virtual microphone corresponding to the simultaneous interpretation service in the second process.

9. A computer device, characterized in that: The device includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory, used to store computer programs; The processor is used to implement the steps of the simultaneous interpretation method based on Bluetooth transmission described in any one of claims 1 to 5 when executing the program stored in the memory.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the simultaneous interpretation method based on Bluetooth transmission as described in any one of claims 1 to 5 are implemented.

Images