Simultaneous interpretation method and apparatus based on bluetooth transmission, and device and medium

Abstract

Disclosed in the present application are a simultaneous interpretation method and apparatus based on Bluetooth transmission, and a device and a medium. The method comprises: on the basis of a starting instruction, starting a simultaneous interpretation service and creating a virtual microphone; performing connection configuration on the virtual microphone and a current active application; receiving first speech collected by a Bluetooth playback device, interpreting the first speech into second speech by means of the simultaneous interpretation service, and feeding the second speech back to the Bluetooth playback device; acquiring mirrored speech, which is synchronously collected when the Bluetooth playback device plays the second speech; by means of the virtual microphone, collecting the mirrored speech and then forwarding same to the current active application; and the current active application outputting the mirrored speech to a peer terminal. By means of starting a simultaneous interpretation service and creating a corresponding virtual microphone, the method can be not limited by application programs and application scenarios, can realize simultaneous interpretation by means of Bluetooth transmission connection, and is applied to real-time conferences or scenarios where real-time calls are performed, thereby greatly expanding application scenarios, and expanding the range of application of a simultaneous interpretation method for Bluetooth transmission connection.

Description

Simultaneous interpretation method, device and equipment based on Bluetooth transmission and medium

[0001] The present application claims priority to the Chinese patent application No. 202411256774.0, filed on September 9, 2024, and entitled "Simultaneous interpretation method, device and equipment based on Bluetooth transmission and medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of voice processing, in particular to a simultaneous interpretation method, device and equipment based on Bluetooth transmission and medium. BACKGROUND

[0003] When using a terminal to conduct a real-time conference or a real-time call, simultaneous interpretation needs to be conducted between two or more parties of the call. However, the existing simultaneous interpretation technology has great limitations in application after the terminal is connected with the Bluetooth device. For example, the technical method applied in the patent with the application number CN201910513900.9 needs to use two Bluetooth earphones to simultaneously connect with a terminal, and can only be used in the case that two users use one Bluetooth earphone respectively to conduct face-to-face communication. Therefore, the simultaneous interpretation method applied in the Bluetooth transmission connection in the existing technology cannot be used in the real-time conference or real-time voice call scenario, resulting in poor flexibility of application. Therefore, the simultaneous interpretation method applied in the Bluetooth transmission connection in the existing technology has the problem of narrow application range. SUMMARY

[0004] The embodiments of the present application provide a simultaneous interpretation method, device and equipment based on Bluetooth transmission and medium, aiming at solving the problem of narrow application range of the simultaneous interpretation method applied in the Bluetooth transmission connection in the existing technology.

[0005] In a first aspect, the embodiments of the present application provide a simultaneous interpretation method based on Bluetooth transmission, wherein the method is applied in a terminal device, a Bluetooth communication connection is established between the terminal device and a Bluetooth playback device, a network connection is established between the terminal device and a docking terminal, and the method comprises the following steps:

[0006] If the input start instruction is received, starting a simultaneous interpretation service according to the start instruction and creating a corresponding virtual microphone;

[0007] Connecting and configuring the virtual microphone and a current active application;

[0008] Receiving a first voice collected from the Bluetooth playback device, translating the first voice through the simultaneous interpretation service to obtain a corresponding second voice and feeding back to the Bluetooth playback device;

[0009] receive the mirror voice from the Bluetooth playing device; the mirror voice is voice information collected synchronously by the Bluetooth device playing the second voice;

[0010] forward the mirror voice to a current active application connected with the virtual microphone synchronously through the virtual microphone;

[0011] output the mirror voice to the docking terminal through the current active application.

[0012] In a second aspect, the embodiments of the present application further provide a simultaneous interpretation device based on Bluetooth transmission, wherein the device is configured in a terminal device, Bluetooth communication connection is established between the terminal device and a Bluetooth playing device, network connection is established between the terminal device and a docking terminal, the device is used to execute the simultaneous interpretation method based on Bluetooth transmission as described in the first aspect, and the device comprises:

[0013] a starting unit, configured to start the simultaneous interpretation service and create a corresponding virtual microphone according to the input starting instruction if the starting instruction is received;

[0014] a connection configuration unit, configured to configure connection between the virtual microphone and a current active application;

[0015] a first translation unit, configured to receive the first voice collected from the Bluetooth playing device, translate the first voice through the simultaneous interpretation service to obtain the corresponding second voice and feed back to the Bluetooth playing device;

[0016] a mirror voice receiving unit, configured to receive the mirror voice from the Bluetooth playing device; the mirror voice is voice information collected synchronously by the Bluetooth device playing the second voice;

[0017] a synchronous forwarding unit, configured to forward the mirror voice to the current active application connected with the virtual microphone synchronously through the virtual microphone;

[0018] an output unit, configured to output the mirror voice to the docking terminal through the current active application.

[0019] In a third aspect, the embodiments of the present application further provide a computer device, wherein the device comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus;

[0020] the memory is used to store a computer program;

[0021] A processor is configured to execute a program stored in a memory to implement the steps of the simultaneous interpretation method based on Bluetooth transmission.

[0022] In a fourth aspect, the embodiments of the present application further provide a computer readable storage medium, which stores a computer program, and the computer program is configured to implement the steps of the simultaneous interpretation method based on Bluetooth transmission when executed by a processor.

[0023] The embodiments of the present application provide a simultaneous interpretation method, device, equipment and medium based on Bluetooth transmission. The method comprises the following steps: starting a simultaneous interpretation service and creating a virtual microphone according to a starting instruction, connecting and configuring the virtual microphone and a current active application, receiving first voice collected by a Bluetooth playback device, and translating the first voice into second voice through the simultaneous interpretation service and feeding back the second voice to the Bluetooth playback device, obtaining mirror voice collected by the Bluetooth playback device when playing the second voice, and forwarding the mirror voice to the current active application through the virtual microphone, and outputting the mirror voice to a docking terminal by the current active application. The above method can be applied to the scene of real-time conference or real-time call by starting the simultaneous interpretation service and creating the corresponding virtual microphone, and is not limited by the application program and the application scene, thereby greatly expanding the application scene and widening the application range of the simultaneous interpretation method based on Bluetooth transmission. BRIEF DESCRIPTION OF DRAWINGS

[0024] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0025] FIG. 1 is a method flowchart of the simultaneous interpretation method based on Bluetooth transmission provided by the embodiments of the present application;

[0026] FIG. 2 is a schematic diagram of the application scene of the simultaneous interpretation method based on Bluetooth transmission provided by the embodiments of the present application;

[0027] FIG. 3 is a schematic diagram of information transmission of the simultaneous interpretation method based on Bluetooth transmission provided by the embodiments of the present application;

[0028] FIG. 4 is a schematic block diagram of the simultaneous interpretation device based on Bluetooth transmission provided by the embodiments of the present application;

[0029] FIG. 5 is a schematic block diagram of a computer device provided by the embodiments of the present application. DETAILED DESCRIPTION

[0030] In the present application, the Bluetooth playback device 20 is a terminal device supporting a Bluetooth communication protocol, such as a Bluetooth headset, a Bluetooth watch, etc. The Bluetooth communication protocol can be an ER traditional Bluetooth protocol, a BDR traditional Bluetooth protocol, or a BLE low-power Bluetooth protocol. Of course, it can also be other new Bluetooth protocol types to be launched in the future. From the version of the Bluetooth protocol, the version of the Bluetooth communication protocol can be any one of the following: a 5.0 series version, a series version based on other series versions to be launched in the future.

[0031] The Bluetooth playback device 20 includes at least one audio acquisition component and at least one audio playback component. For example, for a Bluetooth headset, it can contain one or two earphones, and each earphone is separately provided with an audio playback component, and at least one earphone is provided with an audio acquisition component, or an audio acquisition component is provided on a Bluetooth headset box. For a Bluetooth watch, the watch body can be provided with an audio acquisition component and at least one audio playback component.

[0032] The Bluetooth headset in the present application can be one or more of the following applications: an HSP (Headset Profile) application, an HFP (Hands-free Profile) application, an A2DP (Advanced Audio Distribution Profile) application, and an AVRCP (Audio / Video Remote Control Profile) application.

[0033] The HSP application represents a headset application and provides basic functions required for communication between a terminal and a headset. The Bluetooth headset can serve as an audio input and output interface of the terminal.

[0034] The HFP application represents a hands-free application, and the HFP application adds some extended functions on the basis of the HSP application. The Bluetooth headset can control the call process of the terminal, such as answering, hanging up, rejecting, voice dialing, etc.

[0035] The A2DP application is an advanced audio transmission application, and the A2DP can use a chip in the headset to stack data to achieve high-definition sound.

[0036] The AVRCP application is an audio / video remote control application, and the AVRCP application defines how to control the features of streaming media, including pausing, stopping, starting playback, volume control, and other types of remote control operations.

[0037] An application (Application, APP) is an application program installed on a terminal device and running relying on a system program in the terminal device. The application program can run on the terminal device and realize corresponding use functions, such as live broadcast, conference, or voice conversation.

[0038] In the present application, the terminal device 10 can be any device with computing processing capability. Of course, the terminal device can also have audio and video playing and interface display functions. For example, the terminal device can be a mobile phone, a computer, a smart television, a vehicle-mounted device, a wearable device, an industrial device, etc. The terminal device supports Bluetooth communication protocol.

[0039] The technical solutions in the embodiments of the present application will be described clearly and completely below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0040] It should be understood that when used in the specification and the appended claims, the terms "comprise" and "include" indicate the presence of the described features, integers, steps, operations, elements, and / or components, but do not exclude one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0041] It should also be understood that the terms used in the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the present application specification and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms, unless the context clearly indicates otherwise.

[0042] It should be further understood that the term "and / or" used in the present application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

[0043] Please refer to FIG. 1, as shown in the figure, the embodiment of the present application provides a simultaneous interpretation method based on Bluetooth transmission, which is applied to a terminal device and is executed by application software installed in the terminal device. As shown in FIG. 2, a Bluetooth communication connection is established between the terminal device 10 and the Bluetooth playback device 20, and a network connection is established between the terminal device 10 and the docking terminal 30. The terminal device 10 is a device for running an application program and starting a simultaneous interpretation service. The terminal device 10 can be a notebook computer, a desktop computer, a tablet computer, or a mobile phone. The Bluetooth playback device 20 is a terminal device with Bluetooth connection function and voice playback and voice collection function, such as Bluetooth headset, Bluetooth watch, Bluetooth remote controller, etc. The docking terminal 30 is a terminal device that establishes a network connection with the terminal device 10 through a wired local area network or a wireless local area network. The docking terminal 30 can be a notebook computer, a desktop computer, a tablet computer, or a mobile phone, or a smart speaker, a smart recording pen, etc. The near-end user is the user of the terminal device 10, and the far-end user is the user of the docking terminal 30. The transmission of voice signals in the specific application process is shown in FIG. 3. As shown in FIG. 1, the method comprises steps S110-S160.

[0044] S110, if the input start instruction is received, starting the simultaneous interpretation service according to the start instruction and creating a corresponding virtual microphone.

[0045] If the input start instruction is received, the simultaneous interpretation service is started according to the start instruction and a corresponding virtual microphone is created. The near-end user can input the start instruction in the terminal device, and the terminal device can start the simultaneous interpretation service according to the start instruction and create a virtual microphone inside the terminal device. The simultaneous interpretation service is an application imaging service that provides simultaneous interpretation service by running program code inside the terminal device. The virtual microphone is a functional module obtained virtually inside the terminal device, which can virtually collect voice.

[0046] In specific embodiments, step S110 comprises the following sub-steps: creating independent first and second processes and allocating corresponding system resources; starting a simultaneous interpretation service matched with the start instruction in the first process; configuring language parameters for the simultaneous interpretation service according to the system configuration language of the terminal device and the target translation language in the start instruction; and creating a virtual microphone corresponding to the simultaneous interpretation service in the second process.

[0047] Specifically, the first process and the second process independent of each other can be created in the terminal device, and corresponding system resources are allocated to the first process and the second process respectively, and each process runs an application service independently. Specifically, the simultaneous interpretation service matched with the starting instruction can be started in the first process, and the starting instruction contains pointing information pointing to the corresponding interpretation program code, and then the interpretation program code is run and the simultaneous interpretation service is started according to the pointing information in the starting instruction.

[0048] Further, the system configuration language of the terminal device can be obtained, for example, the system configuration language of the terminal device is "simplified Chinese". The target translation language is also included in the starting instruction, that is, the language type corresponding to another language obtained by translating the language of the A user. The target translation language is obtained from the starting instruction and is used together with the system configuration language to configure the language parameters of the simultaneous interpretation service, so that the simultaneous interpretation service can perform simultaneous interpretation between two language types according to the language parameter configuration. Further, the transmission interface parameters in the simultaneous interpretation service can also be configured, and the transmission interface parameters of the simultaneous interpretation service are configured as the Bluetooth connection parameters corresponding to the Bluetooth playback device, so that the simultaneous interpretation service can directly transmit data information between the Bluetooth playback device through the Bluetooth connection based on the configured transmission interface parameters.

[0049] Further, a virtual microphone can be created in the second process, and the virtual microphone is a virtual component associated with the simultaneous interpretation service. The transmission interface parameters of the virtual microphone can be configured to inherit the transmission interface parameters configured in the simultaneous interpretation service, so that the virtual microphone can share the Bluetooth connection corresponding to the Bluetooth playback device, and the virtual microphone can monitor the voice signal received in the Bluetooth connection by configuring the transmission interface parameters of the virtual microphone.

[0050] S120, the virtual microphone is connected to the current active application.

[0051] The virtual microphone is connected to the current active application. Further, the virtual microphone can be connected to the current active application, and the current active application can be a live application, a conference application, a telephone application, etc., and the virtual microphone can be connected to one or more current active applications.

[0052] In specific embodiments, step S120 includes the following sub-steps: configuring the application transmission interface of the virtual microphone according to the interface information of the current active application; and establishing a corresponding connection channel according to the configured application transmission interface to realize connection configuration with the current active application.

[0053] Specifically, interface information of each current active application in the system background can be acquired, and the application transmission interface of the virtual microphone is configured with parameters through the interface information of each current active application, so that the virtual microphone can obtain the output object of the voice information through the application transmission interface. According to the configured application transmission interface, a connection channel from the virtual microphone to the corresponding current active application is established, and the connection channel corresponding to the virtual microphone can have one or more, and each connection channel corresponds to one current active application.

[0054] S130, receiving the first voice collected from the Bluetooth playback device, and translating the first voice through the simultaneous interpretation service to obtain the corresponding second voice and feeding back to the Bluetooth playback device.

[0055] Receiving the first voice collected from the Bluetooth playback device, and translating the first voice through the simultaneous interpretation service to obtain the corresponding second voice and feeding back to the Bluetooth playback device. If the first voice collected from the Bluetooth playback device is received, the first voice is input to the simultaneous interpretation service for translation to obtain the second voice corresponding to the first voice, and the second voice is fed back to the Bluetooth playback device through the Bluetooth connection. As shown in FIG. 3, the Bluetooth playback device can transmit the first voice to the simultaneous interpretation service through the #1 transmission path, and the simultaneous interpretation service transmits the second voice to the Bluetooth playback device through the #2 transmission path for playing. The simultaneous interpretation service is configured with a first language type (corresponding to the A user) and a second language type (corresponding to the B user), so that the simultaneous interpretation service can analyze the first voice through the first language type, obtain semantic analysis information, and then generate the second voice according to the second language type.

[0056] The above examples only describe the simultaneous interpretation application scenario of the conference application. In the live application scenario, the voice from the Bluetooth playback device can be collected by the virtual microphone and pushed to the live application to generate a multimedia live stream for live presentation, so that the simultaneous interpretation service can provide synchronous voice translation service for the live application, and the voice of the near-end user is translated into another language type and added to the multimedia live stream. In the telephone application scenario, the voice from the Bluetooth playback device can be collected by the virtual microphone and pushed to the telephone application to realize telephone voice information transmission, and the simultaneous interpretation service can provide synchronous voice reaction service for the telephone application.

[0057] S140, receiving the mirror voice from the Bluetooth playback device.

[0058] receiving the mirror voice from the Bluetooth playing device; the mirror voice is voice information obtained by synchronously collecting the second voice played by the Bluetooth device. The Bluetooth playing device plays the second voice and synchronously collects the second voice information played by the Bluetooth playing device to obtain the mirror voice, and the Bluetooth playing device synchronously sends the played mirror voice to the terminal device, so that the terminal device can receive the mirror voice.

[0059] S150, synchronously forwarding the mirror voice to a current active application connected to the virtual microphone through the virtual microphone.

[0060] Synchronously forwarding the mirror voice to a current active application connected to the virtual microphone through the virtual microphone. The mirror voice is synchronously forwarded through the connection channel established between the virtual microphone and the current active application, so that one or more current active applications connected to the virtual microphone can receive the mirror voice. Specifically, as shown in FIG. 3, the virtual microphone can receive the mirror voice through the #3 transmission path, and push the mirror voice to the corresponding current active application through the #4 transmission path.

[0061] S160, outputting the mirror voice to the docking terminal through the current active application.

[0062] Outputting the mirror voice to the docking terminal through the current active application. The obtained mirror voice is output to the docking terminal through the current active application, so that the remote user of the docking terminal can obtain the translated voice corresponding to the first voice. Specifically, as shown in FIG. 3, the current active application #5 transmission path pushes the mirror voice to the docking terminal.

[0063] In specific embodiments, the above method further includes the steps of: if a third voice is received from the docking terminal, synchronously forwarding the third voice to the simultaneous interpretation service through the current active application to obtain a fourth voice corresponding to the third voice through the simultaneous interpretation service; and sending the fourth voice to the Bluetooth playing device for playing.

[0064] Meanwhile, the docking terminal can send third voice generated by the remote user to the terminal device, and the terminal device can forward the third voice to the simultaneous interpretation service through a current active application in communication connection with the docking terminal, and the simultaneous interpretation service translates the received third voice to obtain fourth voice. The docking terminal used by the remote user can send the third voice to the terminal device through a #5 transmission path, and the current active application forwards the received third voice to the simultaneous interpretation service through a #6 transmission path. Specifically, the simultaneous interpretation service can analyze the third voice through a second language type (corresponding to the remote user) to obtain semantic analysis information, and then generate the fourth voice according to a first language type (corresponding to the near-end user).

[0065] After the terminal device obtains the fourth voice, the terminal device can send the fourth voice to the Bluetooth playback device, and the Bluetooth playback device receives the fourth voice and plays the fourth voice. The terminal device can send the fourth voice to the Bluetooth playback device through a #2 transmission path.

[0066] In another specific embodiment, the above method further includes the steps of: if third voice from the docking terminal is received, forwarding the third voice to the Bluetooth playback device through the current active application; receiving synchronous voice from the Bluetooth playback device; the synchronous voice is voice information obtained by the Bluetooth device playing the third voice for synchronous collection; translating the synchronous voice through the simultaneous interpretation service to obtain fourth voice corresponding to the third voice; and sending the fourth voice to the Bluetooth playback device for playing.

[0067] In addition, if third voice from the docking terminal is received, the current active application forwards the third voice to the Bluetooth playback device. Specifically, the current active application can send the third voice to the Bluetooth playback device through a #7 transmission path. The Bluetooth playback device plays the third voice and synchronously collects synchronous voice corresponding to the third voice, and the Bluetooth playback device feeds back the synchronous voice to the terminal device. The Bluetooth playback device sends the synchronous voice to the simultaneous interpretation service through a #7 transmission path. The terminal device translates the synchronous voice through the simultaneous interpretation service to obtain fourth voice corresponding to the third voice. The terminal device sends the obtained fourth voice to the Bluetooth playback device for playing. The simultaneous interpretation server in the terminal device can send the fourth voice to the Bluetooth playback device through a #2 transmission path.

[0068] In the simultaneous interpretation method based on Bluetooth transmission disclosed in the above embodiments, the method comprises: starting a simultaneous interpretation service and creating a virtual microphone according to a starting instruction, performing connection configuration on the virtual microphone and a currently active application, receiving first voice collected by a Bluetooth playback device, and translating the first voice into second voice through the simultaneous interpretation service and feeding back the second voice to the Bluetooth playback device, obtaining mirror voice collected by the Bluetooth playback device when playing the second voice, and forwarding the mirror voice to the currently active application through the virtual microphone, and outputting the mirror voice to a docking terminal by the currently active application. The above method can be applied to real-time conference or real-time call scenarios through Bluetooth transmission connection to realize simultaneous interpretation, greatly expand the application scenarios, and broaden the application range of the simultaneous interpretation method based on Bluetooth transmission connection.

[0069] The embodiments of the present application also provide a simultaneous interpretation device based on Bluetooth transmission, which can be configured in a terminal device, and is used to execute any of the above-mentioned embodiments of the simultaneous interpretation method based on Bluetooth transmission. Specifically, please refer to FIG. 4, which is a schematic block diagram of the simultaneous interpretation device based on Bluetooth transmission provided by the embodiments of the present application.

[0070] As shown in FIG. 4, the simultaneous interpretation device based on Bluetooth transmission 100 comprises a starting unit 110, a connection configuration unit 120, a first translation unit 130, a mirror voice receiving unit 140, a synchronous forwarding unit 150, and an output unit 160.

[0071] The starting unit 110 is configured to start a simultaneous interpretation service and create a corresponding virtual microphone according to a starting instruction if the starting instruction is received.

[0072] In specific embodiments, the starting unit 110 comprises: a process creating unit configured to create independent first and second processes and respectively allocate corresponding system resources; a service starting unit configured to start a simultaneous interpretation service matched with the starting instruction in the first process; a language parameter configuration unit configured to perform language parameter configuration on the simultaneous interpretation service by obtaining a system configuration language of the terminal device and a target translation language in the starting instruction; and a creating unit configured to create a virtual microphone corresponding to the simultaneous interpretation service in the second process.

[0073] The connection configuration unit 120 is configured to perform connection configuration on the virtual microphone and a currently active application.

[0074] The first translation unit 130 is configured to receive the first voice collected by the Bluetooth playing device, and translate the first voice by the simultaneous interpretation service to obtain a corresponding second voice and feed back to the Bluetooth playing device.

[0075] The mirror voice receiving unit 140 is configured to receive a mirror voice from the Bluetooth playing device. The mirror voice is voice information collected synchronously by the Bluetooth device playing the second voice.

[0076] The synchronous forwarding unit 150 is configured to synchronously forward the mirror voice to a current active application connected to the virtual microphone by the virtual microphone.

[0077] The output unit 160 is configured to output the mirror voice to the docking terminal by the current active application.

[0078] In specific embodiments, the Bluetooth transmission-based simultaneous interpretation device 100 further comprises a second translation unit configured to, if receiving a third voice from the docking terminal, synchronously forward the third voice to the simultaneous interpretation service by the current active application, to obtain a fourth voice corresponding to the third voice by translation of the simultaneous interpretation service; and a voice sending unit configured to send the fourth voice to the Bluetooth playing device for playing.

[0079] The Bluetooth transmission-based simultaneous interpretation device provided in the embodiments of the present application applies the above-described Bluetooth transmission-based simultaneous interpretation method. According to a start instruction, the simultaneous interpretation service is started and a virtual microphone is created. The virtual microphone is connected to a current active application. The first voice collected by the Bluetooth playing device is translated into the second voice by the simultaneous interpretation service and fed back to the Bluetooth playing device. The mirror voice synchronously collected by the Bluetooth playing device playing the second voice is obtained and then forwarded to the current active application by the virtual microphone. The current active application outputs the mirror voice to the docking terminal. The above-described method can be applied to the real-time conference or real-time call scene by starting the simultaneous interpretation service and creating the corresponding virtual microphone, without being limited by the application program and the application scene. The application scope of the simultaneous interpretation method based on the Bluetooth transmission connection is expanded.

[0080] The Bluetooth transmission-based simultaneous interpretation device described above can be implemented in the form of a computer program, which can run on a computer device as shown in FIG. 5.

[0081] Please refer to FIG. 5, which is a schematic block diagram of a computer device provided in the embodiments of the present application. The computer device can be a terminal device configured to execute the Bluetooth transmission-based simultaneous interpretation method to implement the Bluetooth transmission-based simultaneous interpretation processing.

[0082] Referring to FIG. 5, the computer device 500 includes a processor 502, a memory, and a communication interface 505 connected through a communication bus 501, wherein the memory can include a storage medium 503 and an internal memory 504.

[0083] The storage medium 503 can store an operating system 5031 and a computer program 5032. The computer program 5032, when executed, can cause the processor 502 to perform the simultaneous interpretation method based on Bluetooth transmission, wherein the storage medium 503 can be a volatile storage medium or a non-volatile storage medium.

[0084] The processor 502 is configured to provide computing and control capabilities to support the operation of the entire computer device 500.

[0085] The internal memory 504 provides an environment for the execution of the computer program 5032 in the storage medium 503, and the computer program 5032, when executed by the processor 502, can cause the processor 502 to perform the simultaneous interpretation method based on Bluetooth transmission.

[0086] The communication interface 505 is configured to perform network communication, such as providing transmission of data information, etc. Those skilled in the art can understand that the structure shown in FIG. 5 is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device 500 to which the scheme of the present application is applied. The specific computer device 500 can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0087] The processor 502 is configured to run the computer program 5032 stored in the memory to implement the corresponding functions in the simultaneous interpretation method based on Bluetooth transmission described above.

[0088] Those skilled in the art can understand that the embodiment of the computer device shown in FIG. 5 does not constitute a limitation on the specific structure of the computer device. In other embodiments, the computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement. For example, in some embodiments, the computer device can only include a memory and a processor, and in such embodiments, the structure and functions of the memory and the processor are consistent with the embodiment shown in FIG. 5, which will not be described here.

[0089] It should be understood that, in the embodiments of the present application, the processor 502 can be a central processing unit (CPU), and the processor 502 can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0090] In another embodiment of the present application, a computer readable storage medium is provided. The computer readable storage medium can be a volatile or non-volatile computer readable storage medium. The computer readable storage medium stores a computer program, wherein the computer program is executed by a processor to implement the steps included in the above-mentioned simultaneous interpretation method based on Bluetooth transmission.

[0091] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-mentioned devices, apparatuses and units can refer to the corresponding processes in the foregoing method embodiments, which will not be described here. Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized in electronic hardware, computer software or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been described in the foregoing description in a general manner. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0092] In several embodiments provided in the present application, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the apparatus embodiments described above are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, or units with the same function can be combined into one unit, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can also be electrical, mechanical or other forms of connection.

[0093] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, i.e., may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0094] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0095] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part of the prior art that contributes to the technical solutions, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a computer readable storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned computer readable storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a magnetic disk or an optical disk, and various program code storage media.

[0096] The above is only a specific embodiment of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A simultaneous interpretation method based on Bluetooth transmission, characterized in that, The method is applied to a terminal device, a Bluetooth communication connection is established between the terminal device and a Bluetooth playback device, a network connection is established between the terminal device and a docking terminal, and the method comprises: If the input start instruction is received, a simultaneous interpretation service is started according to the start instruction, and a corresponding virtual microphone is created; The virtual microphone is connected to a current active application; First voice collected by the Bluetooth playback device is received, the first voice is translated by the simultaneous interpretation service to obtain corresponding second voice, and the second voice is fed back to the Bluetooth playback device; Mirror voice from the Bluetooth playback device is received; the mirror voice is voice information collected synchronously by the Bluetooth device playing the second voice; The mirror voice is synchronously forwarded to the current active application connected to the virtual microphone through the virtual microphone; The mirror voice is output to the docking terminal through the current active application.

2. The Bluetooth transmission based simultaneous interpretation method according to claim 1, characterized in that, The method further comprises: If third voice from the docking terminal is received, the third voice is synchronously forwarded to the simultaneous interpretation service through the current active application, so that fourth voice corresponding to the third voice is obtained by translation of the simultaneous interpretation service; The fourth voice is sent to the Bluetooth playback device for playing.

3. The Bluetooth transmission based simultaneous interpretation method according to claim 1, characterized in that, The method of starting the simultaneous interpretation service according to the start instruction and creating the corresponding virtual microphone comprises: Independent first and second processes are created and corresponding system resources are allocated respectively; A simultaneous interpretation service matched with the start instruction is started in the first process; System configuration language of the terminal device and target translation language in the start instruction are obtained to configure language parameters of the simultaneous interpretation service; A virtual microphone corresponding to the simultaneous interpretation service is created in the second process.

4. The simultaneous interpretation method based on Bluetooth transmission according to claim 2, characterized in that, The method of starting the simultaneous interpretation service according to the start instruction and creating the corresponding virtual microphone comprises: Independent first and second processes are created and corresponding system resources are allocated respectively; A simultaneous interpretation service matched with the start instruction is started in the first process; System configuration language of the terminal device and target translation language in the start instruction are obtained to configure language parameters of the simultaneous interpretation service; A virtual microphone corresponding to the simultaneous interpretation service is created in the second process.

5. The Bluetooth transmission based simultaneous interpretation method according to claim 1, characterized in that, The method of connecting the virtual microphone to the current active application comprises: An application transmission interface of the virtual microphone is configured according to interface information of the current active application; A corresponding connection channel is established according to the configured application transmission interface to realize connection configuration with the current active application.

6. The Bluetooth transmission based simultaneous interpretation method according to claim 2, wherein, The method of connecting the virtual microphone to the current active application comprises: An application transmission interface of the virtual microphone is configured according to interface information of the current active application; A corresponding connection channel is established according to the configured application transmission interface to realize connection configuration with the current active application.

7. The Bluetooth transmission based simultaneous interpretation method according to claim 1, wherein, The method further comprises: If receiving a third voice from the docking terminal, forwarding the third voice to the Bluetooth playback device through the current active application; Receiving a synchronous voice from the Bluetooth playback device; the synchronous voice is voice information collected synchronously by the Bluetooth device playing the third voice; Translating the synchronous voice through the simultaneous interpretation service to obtain a fourth voice corresponding to the third voice; Sending the fourth voice to the Bluetooth playback device for playing.

8. A simultaneous interpretation device based on Bluetooth transmission, characterized in that, The device is configured in a terminal device, a Bluetooth communication connection is established between the terminal device and a Bluetooth playback device, a network connection is established between the terminal device and a docking terminal, and the device comprises: A starting unit configured to start a simultaneous interpretation service and create a corresponding virtual microphone according to a starting instruction inputted if the starting instruction is received; A connection configuration unit configured to perform connection configuration on the virtual microphone and a current active application; A first translation unit configured to receive a first voice collected by the Bluetooth playback device, translate the first voice through the simultaneous interpretation service to obtain a corresponding second voice, and feed back the second voice to the Bluetooth playback device; A mirror voice receiving unit configured to receive a mirror voice from the Bluetooth playback device; the mirror voice is voice information collected synchronously by the Bluetooth device playing the second voice; A synchronous forwarding unit configured to synchronously forward the mirror voice to the current active application connected to the virtual microphone through the virtual microphone; An output unit configured to output the mirror voice to the docking terminal through the current active application.

9. The Bluetooth transmission based simultaneous interpretation device according to claim 8, characterized in that, The device further comprises: A second translation unit configured to synchronously forward a third voice from the docking terminal to the simultaneous interpretation service through the current active application to obtain a fourth voice corresponding to the third voice through the simultaneous interpretation service translation; A voice sending unit configured to send the fourth voice to the Bluetooth playback device for playing.

10. The Bluetooth transmission based simultaneous interpretation device according to claim 8, characterized in that, The starting unit comprises: A process creation unit configured to create independent first and second processes and respectively allocate corresponding system resources; A service starting unit configured to start a simultaneous interpretation service matched with the starting instruction in the first process; A language parameter configuration unit configured to perform language parameter configuration on the simultaneous interpretation service by taking the system configuration language of the terminal device and the target translation language in the starting instruction as parameters; A creation unit configured to create a virtual microphone corresponding to the simultaneous interpretation service in the second process.

11. The Bluetooth transmission based simultaneous interpretation device according to claim 9, characterized in that, The starting unit comprises: A process creation unit configured to create independent first and second processes and respectively allocate corresponding system resources; A service starting unit configured to start a simultaneous interpretation service matched with the starting instruction in the first process; A language parameter configuration unit configured to perform language parameter configuration on the simultaneous interpretation service by taking the system configuration language of the terminal device and the target translation language in the starting instruction as parameters; A creating unit is configured to create a virtual microphone corresponding to the simultaneous interpretation service in the second process.

12. A computer device, characterized by The device comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; The memory is configured to store a computer program; The processor is configured to execute the program stored in the memory to implement the following steps: If the input start instruction is received, the simultaneous interpretation service is started according to the start instruction, and a corresponding virtual microphone is created; The virtual microphone is connected to a current active application; The first voice collected by the Bluetooth playback device is received, and the first voice is translated by the simultaneous interpretation service to obtain a corresponding second voice and fed back to the Bluetooth playback device; The mirror voice from the Bluetooth playback device is received; the mirror voice is voice information collected synchronously when the Bluetooth device plays the second voice; The mirror voice is synchronously forwarded to the current active application connected to the virtual microphone through the virtual microphone; The mirror voice is output to the docking terminal through the current active application.

13. The computer device of claim 12, wherein, The processor executes the program stored in the memory to implement the following steps: If the third voice from the docking terminal is received, the third voice is synchronously forwarded to the simultaneous interpretation service through the current active application, so that the fourth voice corresponding to the third voice is obtained by translation through the simultaneous interpretation service; The fourth voice is sent to the Bluetooth playback device for playing.

14. The computer device of claim 12, wherein, The processor executes the program stored in the memory to implement the following steps: An independent first process and a second process are created, and corresponding system resources are allocated respectively; A simultaneous interpretation service matched with the start instruction is started in the first process; The system configuration language of the terminal device and the target translation language in the start instruction are obtained to configure language parameters for the simultaneous interpretation service; A virtual microphone corresponding to the simultaneous interpretation service is created in the second process.

15. The computer device of claim 13, wherein, The processor executes the program stored in the memory to implement the following steps: An independent first process and a second process are created, and corresponding system resources are allocated respectively; A simultaneous interpretation service matched with the start instruction is started in the first process; The system configuration language of the terminal device and the target translation language in the start instruction are obtained to configure language parameters for the simultaneous interpretation service; A virtual microphone corresponding to the simultaneous interpretation service is created in the second process.

16. A computer-readable storage medium having stored thereon a computer program, characterized in that, The processor executes the program stored in the memory to implement the following steps: If the input start instruction is received, the simultaneous interpretation service is started according to the start instruction, and a corresponding virtual microphone is created; The virtual microphone is connected to a current active application; The first voice collected by the Bluetooth playback device is received, and the first voice is translated by the simultaneous interpretation service to obtain a corresponding second voice and fed back to the Bluetooth playback device; receive mirroring voice from the Bluetooth playing device; the mirroring voice is voice information collected by the Bluetooth device playing the second voice for synchronization; forward the mirroring voice to a current active application connected to the virtual microphone through the virtual microphone for synchronization; output the mirroring voice to the docking terminal through the current active application.

17. The computer-readable storage medium of claim 16, wherein, The computer program, when executed by a processor, further implements the following steps: if receiving a third voice from the docking terminal, forward the third voice to the simultaneous interpretation service through the current active application, so as to obtain a fourth voice corresponding to the third voice by translation of the simultaneous interpretation service; send the fourth voice to the Bluetooth playing device for playing.

18. The computer-readable storage medium of claim 16, wherein, The steps of starting the simultaneous interpretation service and creating the corresponding virtual microphone according to the starting instruction, comprising: creating independent first and second processes and allocating corresponding system resources; starting a simultaneous translation service matched with the starting instruction in the first process; configuring language parameters of the simultaneous interpretation service according to a system configuration language of the terminal device and a target translation language in the starting instruction; creating a virtual microphone corresponding to the simultaneous translation service in the second process.

19. The computer-readable storage medium of claim 17, wherein, The steps of starting the simultaneous interpretation service and creating the corresponding virtual microphone according to the starting instruction, comprising: creating independent first and second processes and allocating corresponding system resources; starting a simultaneous translation service matched with the starting instruction in the first process; configuring language parameters of the simultaneous interpretation service according to a system configuration language of the terminal device and a target translation language in the starting instruction; creating a virtual microphone corresponding to the simultaneous translation service in the second process.

20. The computer-readable storage medium of claim 16, wherein, The steps of connecting the virtual microphone to the current active application, comprising: configuring an application transmission interface of the virtual microphone according to interface information of the current active application; establishing a corresponding connection channel according to the configured application transmission interface to realize connection configuration with the current active application.

Images