Voice communication method and device, equipment and medium

Abstract

The invention provides a voice communication method and device, equipment and a medium, and is applied to the technical field of voice processing. The voice communication method is applied to a first electronic device and comprises the following steps: acquiring a first instant voice and a first translated voice; playing the first translated voice in the process of playing the first instant voice; wherein the first instant voice is the original voice acquired by the voice acquisition device, and the first translation voice is the translation voice obtained by translating the original voice acquired by the voice acquisition device.

Description

Technical Field

[0001] The present disclosure relates to the field of voice processing technology, and in particular to a voice call method, device, equipment and medium. Background Art

[0002] In a call scenario, the users at both ends of the call use the same language, such as Chinese or English. However, in some call scenarios, if the users at both ends of the call use different languages, real-time translation of the voice during the call is required. Therefore, the current instant messaging voice translation user experience is poor and the efficiency is low. Summary of the invention

[0003] In view of this, the present disclosure provides a voice call method, apparatus, device and medium.

[0004] According to a first aspect of the present disclosure, a voice call method is provided, which is applied to a first electronic device, including: obtaining a first instant voice and a first translated voice; playing the first instant voice and the first translated voice during the process of playing the first instant voice; wherein the first instant voice is the original voice collected by a voice collection device, and the first translated voice is the translated voice obtained by translating the original voice collected by the voice collection device.

[0005] According to an embodiment of the present disclosure, the first translated voice represents the voice obtained by receiving the first instant voice by the first electronic device and translating the first instant voice, wherein the voice collection device of the second electronic device collects the first instant voice and sends the first instant voice to the first electronic device in real time, and the first electronic device is communicatively connected with the second electronic device.

[0006] According to an embodiment of the present disclosure, the first translated voice represents the voice sent to the first electronic device after the second electronic device translates the first instant voice, wherein the voice collection device of the second electronic device collects the first instant voice and sends the first instant voice to the first electronic device instantly, and the first electronic device is communicatively connected with the second electronic device.

[0007] According to an embodiment of the present disclosure, the first translated speech is a translated speech corresponding to the first instant speech; or the first translated speech is a translated speech corresponding to the second instant speech, and the collection time of the second instant speech is earlier than the collection time of the first instant speech.

[0008] According to an embodiment of the present disclosure, the playback volume of the first translated voice is greater than the playback volume of the first instant voice.

[0009] According to an embodiment of the present disclosure, it also includes: obtaining a second translated voice; if the second translated voice is a translated voice corresponding to a third instant language, sending the second translated voice to a second electronic device, so that when the first electronic device plays the second translated voice, the second electronic device plays the second translated voice; wherein the playing time of the second translated voice is later than the playing time of the third instant voice, and the third instant voice is the ending instant voice.

[0010] According to an embodiment of the present disclosure, the first translated voice is the translated voice corresponding to the second instant voice; further comprising: if the first instant voice is the starting instant voice, playing the first instant voice at a first volume; if the first instant voice is the non-starting instant voice, playing the first instant voice at a second volume; the first volume is greater than the second volume.

[0011] The second aspect of the present disclosure provides a voice call device, including: an acquisition module, used to acquire a first instant voice and a first translated voice; a playback module, used to play the first instant voice and the first translated voice during playback; wherein the first instant voice is the original voice collected by a voice acquisition device, and the first translated voice is the translated voice obtained by translating the original voice collected by the voice acquisition device.

[0012] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors execute the above-mentioned voice call method.

[0013] The fourth aspect of the present disclosure also provides a computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, causes the processor to execute the above-mentioned voice call method.

[0014] The fifth aspect of the present disclosure also provides a computer program product, including a computer program, which implements the above-mentioned voice call method when executed by a processor.

[0015] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0017] Figure 1 A schematic diagram of voice call translation in the related art is schematically shown;

[0018] Figure 2 The application scenario diagram of the voice call according to the embodiment of the present disclosure is schematically shown;

[0019] Figure 3 The flowchart of the voice call method according to the embodiment of the present disclosure is schematically shown;

[0020] Figure 4A A schematic diagram schematically shows a voice call method according to an embodiment of the present disclosure;

[0021] Figure 4B A schematic diagram schematically shows a voice call method according to another embodiment of the present disclosure;

[0022] Figure 4C A schematic diagram schematically shows a voice call method according to another embodiment of the present disclosure;

[0023] Figure 4D A schematic diagram schematically shows a voice call method according to another embodiment of the present disclosure;

[0024] Figure 5 The following schematically shows a flow chart of a judgment method for a voice call according to another embodiment of the present disclosure;

[0025] Figure 6 A structural block diagram of a voice communication device according to an embodiment of the present disclosure is schematically shown; and

[0026] Figure 7 A block diagram of an electronic device suitable for implementing a voice call method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0027] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0028] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0029] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0030] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0031] The embodiments of the present disclosure provide a voice call method, apparatus, device and medium. Before introducing the technical solutions provided by the embodiments of the present disclosure, the related technologies involved in the present disclosure are first described.

[0032] In a call scenario, the users at both ends of the call use the same language, such as Chinese or English. However, in some call scenarios, if the users at both ends of the call use different languages, real-time translation of the voice during the call is required. Therefore, the current instant messaging voice translation user experience is poor and the efficiency is low. Figure 1 , the first user and the second user talk through the mobile phone, the first user (the local user) speaks Chinese, and the second user (the other party) speaks English. The first user's mobile phone provides a call translation function. For example, when the second user speaks English, the local end (the first user's mobile phone) translates the English spoken by the second user. And the translation is when the second user finishes a sentence in English, the device will recognize and translate this sentence in English. For example, when the second user speaks English, the local end (the first user's mobile phone) translates the English spoken by the second user. And the translation is when the second user finishes a complete sentence, the machine will recognize and translate this complete sentence. If each English sentence spoken by the second user takes ten seconds. Whether the second user speaks English one sentence at a time or speaks English three sentences in a row, it takes about 6*10 = 60 seconds for the first user on the local end to hear the complete Chinese translation. This translation process is serial. Therefore, it takes a long time for the local party to hear the translation content of the other party, resulting in low efficiency of voice call translation.

[0033] The embodiment of the present disclosure provides a voice call method, which is applied to a first electronic device, including: obtaining a first instant voice and a first translated voice; playing the first translated voice during the first instant voice; wherein the first instant voice is the original voice collected by a voice collection device, and the first translated voice is the translated voice obtained by translating the original voice collected by the voice collection device. The embodiment of the present disclosure can play the translated voice while playing the original voice, and the original voice and the translated voice can be played overlappingly, thereby realizing real-time translation of the voice during the call and improving the efficiency of communication.

[0034] Figure 2 The application scenario diagram of a voice call according to an embodiment of the present disclosure is schematically shown.

[0035] The technical solution provided by the embodiment of the present application can be used in call scenarios, such as mobile phone dial-up call scenarios, voice call scenarios in instant messaging software, or video call scenarios in instant messaging software. Taking the mobile phone dial-up call scenario as an example, during the call, if the users at both ends of the call use different languages ​​to communicate, in order to solve the language barrier, real-time translation of the voice during the call is required.

[0036] For example, see Figure 2 As shown, there is a scenario where two users are making a phone call via mobile phone. The users at both ends of the call are user A and user B, respectively. User A speaks in Chinese, and user B speaks in English. To solve the communication barrier between user A and user B, user 1 and user 2, who have different language backgrounds, can perform real-time translation of the voice during the call, i.e., for user A, the voice of user B is obtained in Chinese; and for user B, the voice of user A is obtained in English.

[0037] Before the method provided by the embodiment of the present disclosure is introduced in detail, the execution subject involved in the embodiment of the present disclosure is introduced. As an example but not limitation, the method provided by the embodiment of the present disclosure can be executed by an electronic device. In one example, the electronic device is installed with a translation application, and the translation application is used to enable the voice translation function. Exemplarily, the translation application is a collaborative translation application. That is, if the user wants to perform a voice translation operation through the electronic device, the voice translation function can be enabled through the translation application. In addition, the electronic device is configured with at least one microphone, and exemplarily, a microphone array is configured. In an embodiment of the present disclosure, at least one microphone is used to collect voice data to be translated. In another example, the electronic device can automatically identify whether the second user and the local user (i.e., the first user) have the same common language. When the electronic device recognizes that the language in the voice of the second user is different from the common language of the local user, the voice of the second user is automatically translated.

[0038] The following will be based on Figure 2 The scene described by Figure 3~Figure 5 The voice call method of the disclosed embodiment is described in detail.

[0039] The voice call method of the embodiment of the present disclosure is applied to a first electronic device.

[0040] The first electronic device may be an electronic device with a voice call function, or an electronic device with a voice call function application, and a user may make a voice call through the voice call function application on the electronic device. The first electronic device includes but is not limited to a smart phone, a smart watch, a tablet computer, a laptop computer, and the like.

[0041] For example, the first electronic device may be Figure 2 The first electronic device may also be a mobile phone of user A. Figure 2 The mobile phone of user B.

[0042] Figure 3 The flowchart of the voice call method according to the embodiment of the present disclosure is schematically shown.

[0043] like Figure 3 As shown, the voice call method of this embodiment includes operations S210 to S220.

[0044] In operation S210, a first instant speech and a first translated speech are acquired.

[0045] The first instant voice is the original voice collected by the voice collection device, and the first translated voice is the translated voice obtained by translating the original voice collected by the voice collection device.

[0046] Exemplarily, the first instant voice may be the original voice collected by the voice collection device of the first electronic device, for example, the voice of user A collected by the translator. The first instant voice may also be the original voice collected by the voice collection device of the second electronic device, and then the second electronic device sends the original voice to the first electronic device. For example, the first instant voice may be the voice of user A during a call, or the voice of user B during a call, which may be set according to actual needs.

[0047] The first translated voice may be a voice obtained by translating the original voice collected by the voice collection device of the first electronic device. The first translated voice may be a voice obtained by translating the original voice collected by the voice collection device of the second electronic device. For example, the first translated voice may be a voice obtained by translating the voice of user B during a call, or may be a voice obtained by translating the voice of user A during a call, and may be set according to actual needs.

[0048] If the first instant speech is the speech of user A collected by the speech collection device, the first translated speech is the speech obtained by translating the speech of user A. If the second instant speech is the speech of user B collected by the speech collection device, the first translated speech is the speech obtained by translating the speech of user B. That is, the first instant speech and the first translated speech are for the same target object.

[0049] The speech collection device collects N original speech, and the first instant speech can be any one of the N original speech acquired at the current moment. The first translated speech can be obtained by translating the first instant speech, or by translating the Nth original speech, where N is a positive integer greater than 1.

[0050] For example, user A uses a first electronic device to talk with user B using a second electronic device. The first instant voice can be the English voice of user B, such as "hello", collected by the voice collection device (e.g., microphone, Bluetooth headset) of the second electronic device during the conversation between user A and user B. The second electronic device sends the collected first instant voice to the first electronic device. The first translated voice can be the voice (e.g., hello) translated from the first instant voice (e.g., hello) received by the first electronic device.

[0051] In operation S220, the first translated voice is played during the playing of the first instant voice.

[0052] Exemplarily, the first translated voice is played synchronously during the playing of the first instant voice. For example, the first translated voice can be played synchronously with its corresponding instant voice, which can be understood as simultaneous interpretation, translating while collecting the instant voice.

[0053] For example, the first translated voice may also be played synchronously with other instant voices. The voice collection device collects N instant voices, and the first instant voice may be any one of the N instant voices collected by the voice collection device. The first translated voice corresponding to the first instant voice may be played synchronously during the playback of the second instant voice. The first translated voice corresponding to the first instant voice may also be played synchronously during the playback of the third instant voice. The translated voice (i.e., the first translated voice) of the third original voice may be played during the playback of the third original voice (i.e., the first instant voice). The translated voice (i.e., the first translated voice) of the second original voice may also be played during the playback of the third original voice (i.e., the first instant voice). It should be noted that the first instant voice and the first translated voice are not necessarily in a one-to-one correspondence in terms of content.

[0054] It is understandable that by playing the translated voice during the original voice playback, that is, using a parallel playback method, overlapping the translated voice and the original voice, the serial translation playback method can be avoided, thereby achieving real-time translation of the voice during the call, improving the efficiency of translation and communication. The first instant voice and the first translated voice are played in parallel, and the translated voice can be heard without changing the state of the electronic device, and there is no need to pay attention to the content of the electronic device translation at all times.

[0055] For the subject of speech translation, in some embodiments, the first translated speech represents the speech obtained by receiving the first instant speech by the first electronic device and translating the first instant speech, wherein the speech collection device of the second electronic device collects the first instant speech and sends the first instant speech to the first electronic device in real time, and the first electronic device is communicatively connected with the second electronic device.

[0056] Exemplarily, the voice collection device is arranged on the second electronic device, and the first electronic device is different from the second electronic device, that is, the first electronic device and the second electronic device are two relatively independent devices. The first electronic device is connected to the second electronic device for communication, for example, two mobile phones in a call.

[0057] Continue to use the example of user A using the first electronic device to talk with user B using the second electronic device. The voice collection device of the second electronic device can collect the voice of user B, and then send the collected voice of user B to the first electronic device. User A of the first electronic device receives the voice of user B, and the first electronic device translates the voice of user B to obtain a first translated voice. That is, the execution subject of the first instant voice collection and the first translated voice translation is different. The first instant voice collection is the second electronic device, and the translation of the first translated voice is the first electronic device.

[0058] Combination Figure 2 In the scenario shown, user B's mobile phone sends the collected voice "Hello" of user B to user A's mobile phone, and user A's mobile phone translates "Hello" into "hello" and plays it. Here, user B's mobile phone does not have a translation function, while user A's mobile phone has a translation function.

[0059] For the subject of speech translation, in other embodiments, the first translated speech represents the speech sent to the first electronic device after the second electronic device translates the first instant speech, wherein the speech collection device of the second electronic device collects the first instant speech and sends the first instant speech to the first electronic device instantly, and the first electronic device is communicatively connected with the second electronic device.

[0060] Exemplarily, the voice collection device is arranged on the second electronic device, and the first electronic device is different from the second electronic device, that is, the first electronic device and the second electronic device are two relatively independent devices. The first electronic device is connected to the second electronic device for communication, for example, two mobile phones in a call.

[0061] Let's continue to use the example of user A using the first electronic device to talk with user B using the second electronic device. The voice collection device of the second electronic device can collect the voice of user B, the second electronic device translates the voice of user B to obtain the first translated voice, and the second electronic device sends the translated first translated voice to the first electronic device. That is, the execution subject of the first instant voice collection and the translation of the first translated voice are both the second electronic device. The first instant voice collection is the second electronic device, and the translation of the first translated voice is also the second electronic device.

[0062] Combination Figure 2 In the scenario shown, user B's mobile phone sends the collected voice "hello" of user B to user A's mobile phone. At the same time, user B's mobile phone translates the collected "hello" to get "hello", and sends "hello" to user A's mobile phone, which plays it on user A's mobile phone. Here, user B's mobile phone has a translation function, while user A's mobile phone does not.

[0063] Figure 4A The figure schematically shows a voice call method according to an embodiment of the present disclosure.

[0064] In some embodiments, the first translated speech is a translated speech corresponding to the first instant speech.

[0065] Exemplarily, the first translated speech may be the translation content of the first instant speech. The content of the first instant speech is consistent with the content of the first translated speech. It can be understood as simultaneous interpretation, which is performed while collecting instant speech.

[0066] Reference Figure 4A , continue to use the example of user A using the first electronic device to talk with user B using the second electronic device. User B says three English sentences, and there is a time interval between the three English sentences. When the first electronic device plays, English 1 is played, and Chinese 1 translated from English 1 is played during the playing of English 1. After Chinese 1 is played, English 2 is played, and Chinese 2 translated from English 2 is played during the playing of English 2. After Chinese 2 is played, English 3 is played, and Chinese 3 translated from English 3 is played during the playing of English 3.

[0067] For example, user B says the first instant speech "My name is xiaoB", and the first translated speech is "My name is XiaoB". User A first hears user B say "My name is xiaoB", and then hears "My name is XiaoB", and "My name is XiaoB" can be heard when "My name is xiaoB" is played on the first electronic device of user A. That is, "My name is xiaoB" and "My name is XiaoB" overlap when they are played. It should be noted here that the translated speech has a short delay compared to the playback time of the instant speech.

[0068] Figure 4B A schematic diagram schematically shows a voice call method according to another embodiment of the present disclosure.

[0069] In other embodiments, reference Figure 4B The first translated voice may also be played after the first electronic device receives the first instant voice of the second electronic device, and then played synchronously with the first instant voice after the first electronic device obtains the first translated voice. Here, the translated voice may not be delayed compared to the instant voice.

[0070] Figure 4C A schematic diagram schematically shows a voice call method according to another embodiment of the present disclosure. Figure 4D The following is a schematic diagram schematically showing a voice call method according to another embodiment of the present disclosure.

[0071] In other embodiments, the first translated voice is the translated voice corresponding to the second instant voice, and the second instant voice is collected earlier than the first instant voice. Exemplarily, here, the first electronic device can play the instant voice after receiving it, and the first electronic device can play the translated voice after obtaining it, so the instant voice and the translated voice can be played at different times.

[0072] The first translated speech is inconsistent with the first instant speech, and the first translated speech may be the translated content of the second instant speech collected before the first instant speech. The second instant speech may be the original speech collected continuously with the first instant speech on the time axis, or the second instant speech may be the original speech collected at intervals with the first instant speech on the time axis, but the collection time of the second instant speech is earlier than that of the first instant speech.

[0073] The first translated voice may be played synchronously with other instant voices. The voice collection device collects N instant voices, and the first instant voice may be any one of the N instant voices collected by the voice collection device. The first translated voice corresponding to the first instant voice may be played synchronously during the playback of the second instant voice. The first translated voice corresponding to the second instant voice may also be played synchronously during the playback of the third instant voice. Figure 4C , continue to use the example of user A using the first electronic device to talk with user B using the second electronic device. User B speaks three sentences in English continuously, and if the three sentences are spoken at the same time. When the first electronic device plays, English 1 is played, and the translation is not played during the playback of English 1. English 2 is played, and Chinese 1 obtained by translating English 1 is played during the playback of English 2. English 3 is played, and Chinese 2 obtained by translating English 2 is played during the playback of English 3. Then, after Chinese 2 is played, Chinese 3 obtained by translating English 3 is played. In a conversation spoken by user B, the three sentences spoken by user B are played continuously on the first electronic device, and the three translated sentences are also played continuously on the first electronic device, but the playback time of the three translated sentences and the three sentences spoken by user B overlaps. The three translated sentences are played in parallel with the three sentences spoken by user B.

[0074] For example, user B says "hell (English 1, first moment), My name is xiaoB (English 2, second moment), How are you (English 3, third moment)" within a period of time. At the third moment, the second electronic device collects the first instant voice: How are you (English 3), and the second instant voice can be: hell (English 1), then the first translated voice is: Hello, and "Hello" is played during the playback of "How are you". The second instant voice can also be: My name is xiaoB (English 2). Then the first translated voice is: My name is XiaoB, and "My name is XiaoB" is played during the playback of "How are you".

[0075] In some embodiments, the playback volume of the first translated voice is greater than the playback volume of the first instant voice.

[0076] Exemplarily, when the instant speech and the translated speech are played on the first electronic device, the playback volume of the translated speech is greater than the playback volume of the instant speech.

[0077] Let's continue to use the example of user A using the first electronic device to talk with user B using the second electronic device. For example, user B says "hell (English 1), My name is xiaoB (English 2), How are you (English 3)" within a period of time. The corresponding translated voice is: Hello, I am XiaoB, how are you. When playing the English and translated Chinese on the first electronic device, the playback volume of the Chinese translation (Hello, I am XiaoB, how are you) is greater than the playback volume of the English (hell, My name is xiaoB, How are you).

[0078] It is understandable that when the voice and translation are played in parallel, different sounds are played at different volumes. The translation that is more valuable to the user is played at a louder volume, and the original text with lower value is played at a lower volume, so that the information that is more valuable to the user is highlighted, so that the user can better hear and understand the translation.

[0079] In some embodiments, the voice call method as described above may also include the following operations.

[0080] Acquire a second translated voice; if the second translated voice is a translated voice corresponding to the third instant language, send the second translated voice to the second electronic device, so that the second electronic device plays the second translated voice at the same time as the first electronic device plays the second translated voice. The playing time of the second translated voice is later than the playing time of the third instant voice, and the third instant voice is the ending instant voice.

[0081] Exemplarily, the end of the instant speech can be the last sentence in a complete speech. For example, if a complete speech includes multiple sentences, the end of the instant speech is the last sentence. User B said: hell, My name is xiaoB, How are you. Then How are you is the end of the instant speech. The end of the instant speech can also be the last sentence in a complete speech. For example, if a speech includes multiple sentences, the end of the instant speech is the last sentence. User B said: hell, My name is xiaoB, How are you…, byebye, I miss you. Then I miss you is the end of the instant speech.

[0082] According to an embodiment of the present disclosure, in response to the completion of the reception of the third instant language at the first moment, if the first electronic device does not receive the fourth instant voice at the second moment, it is determined that the reception of the instant voice is completed, wherein the second moment is later than the first moment, and the difference between the second moment and the first moment is greater than the first threshold, and the voice information of the second translated voice corresponding to the third instant language from the second moment is sent to the second electronic device and played on the second electronic device.

[0083] For example, the first threshold may be 3 seconds. If the other party starts talking again within 3 seconds after finishing a sentence, it is considered that the user is talking continuously with only a short pause. If the other party does not talk again within 3 seconds, it can be considered that the other party has stopped speaking English.

[0084] Reference Figure 4C , when it is determined that the other party stops outputting English (i.e. the pause time exceeds 3 seconds), because the first electronic device must have a lag in playing Chinese, the Chinese content that is still playing on the local end can be synchronously input into the second electronic device at a low volume. In this way, the other party can hear a "tail sound of Chinese" after stopping speaking English, so that the user can know that his voice is being translated into Chinese on the other party's device and the playback has not yet been completed. The other party also has a psychological expectation that it will not be a blank waiting time, and the other party can know when the translation is fully transmitted. Afterwards, if the other party speaks again and the other party outputs English again, the low-volume Chinese translation output to the other party can be stopped to avoid the interference of the Chinese translation to the other party.

[0085] It should be noted that the embodiment of the present disclosure does not impose any specific limitation on the setting of the first threshold, and the size of the first threshold can be set according to the actual application scenario.

[0086] Reference Figure 4D For user A who uses the first electronic device, user A speaks three sentences in Chinese, which are translated into three sentences in English. When the first English translation is generated, the English translation is broadcasted and outputted at a normal volume and played on the second electronic device, that is, user B can continuously hear the corresponding English spoken by user A after a short lag time after user A speaks Chinese. And it is English at a normal volume. At the same time, the volume of the Chinese played in the second electronic device is lowered as background sound, so that user B knows that user A is still speaking.

[0087] When user A finishes speaking Chinese, if the time it takes to finish the last sentence of user A in Chinese exceeds a first threshold (e.g., 3 seconds), the English translation of the last sentence of Chinese currently being played on the second electronic device is then synchronously played on the local end (the first electronic device) at a low volume, so that user A can know when the English translation is finished.

[0088] Figure 5 The following schematically shows a flow chart of a judgment method for a voice call according to another embodiment of the present disclosure.

[0089] As described above, in the case where the first translated speech is the translated speech corresponding to the second instant speech. In one possible implementation, Figure 5 As shown, the voice call method may include operations S310 to S340.

[0090] In operation S310, a first instant voice is acquired.

[0091] In operation S320, it is determined whether the first instant speech is an initial instant speech.

[0092] In operation S330, if the first instant voice is the initial instant voice, the first instant voice is played at a first volume.

[0093] In operation S340, if the first instant voice is a non-initial instant voice, the first instant voice is played at a second volume.

[0094] The first volume is greater than the second volume.

[0095] Exemplarily, in the case where the first translated speech is the translated speech corresponding to the second instant speech, the content of the first translated speech is inconsistent with that of the first instant speech, and the first translated speech may be the translated content of the second instant speech collected before the first instant speech. The second instant speech may be the original speech collected continuously with the first instant speech on the time axis, or the second instant speech may be the original speech collected at intervals with the first instant speech on the time axis, but the collection time of the second instant speech is earlier than that of the first instant speech.

[0096] The first translated voice may be played synchronously with other instant voices. The voice collection device collects N instant voices, and the first instant voice may be any one of the N instant voices collected by the voice collection device. The first translated voice corresponding to the first instant voice may be played synchronously during the playback of the second instant voice. The first translated voice corresponding to the second instant voice may also be played synchronously during the playback of the third instant voice.

[0097] Reference Figure 4B, continue to use the example of user A using the first electronic device to talk with user B using the second electronic device. User B speaks three English sentences in a row, assuming that the three English sentences are spoken for the same amount of time. When the first electronic device plays, English 1 is played at a normal volume, and the translation is not played during the playback of English 1. English 2 is played at a low volume, and Chinese 1 obtained by translating English 1 is played at a normal volume during the playback of English 2. English 3 is played at a low volume, and Chinese 2 obtained by translating English 2 is played at a normal volume during the playback of English 3. Then, after the playback of Chinese 2 is completed, Chinese 3 obtained by translating English 3 is played at a normal volume.

[0098] It is understandable that the initial instant voice is played at a normal volume to remind the user that the other party is speaking, and the non-initial instant voice is played at a lower volume to highlight the information that is more valuable to the user and facilitate the user to better hear the translated text.

[0099] In some embodiments, as described above, the voice call method may further include the following operations: determining the voice attribute of the target user according to the fifth instant voice; translating the fifth instant voice, fusing the third translated voice and the voice attribute to obtain a third translated voice.

[0100] Exemplarily, the fifth instant voice may be the initial instant voice, or may be the instant voice recorded in advance before the voice call.

[0101] The third translated speech may be a translated speech that conforms to the sound attribute of the target object. The third translated speech and the fifth instant speech are speech for the same target object. That is, the sound attribute of the fifth instant speech and the third translated speech are the same as the sound attribute of the target object.

[0102] For example, after user B speaks the first sentence in English, the voice attributes of user B in the first sentence are extracted. When translating the first sentence in English into the first sentence in Chinese, the first sentence in Chinese is merged with the voice attributes of user B to obtain the translated Chinese that conforms to user B.

[0103] It can be understood that by integrating the translated speech with the sound attributes of the target object, the translated speech result can be made more humanized.

[0104] In some embodiments, a voice call method is applied to a second electronic device, and the second electronic device is communicatively connected to a first electronic device, including: obtaining a first instant voice collected from voice collection, where the first instant voice is the original voice collected by a voice collection device of the second electronic device; translating the first instant voice to obtain a first translated voice; and synchronously sending the first instant voice and the first translated voice to the first electronic device.

[0105] Exemplarily, the voice collection device of the second electronic device collects the first instant voice. At the same time, the second electronic device translates the collected first instant voice to obtain a first translated voice, and sends the first translated voice and the first instant voice synchronously to. It should be noted that the second electronic device has a translation function, and the first electronic device does not have a translation function.

[0106] Combination Figure 2 In the scenario shown, user B's mobile phone sends the collected voice "Hello" of user B to user A's mobile phone. At the same time, user B's mobile phone translates the collected "Hello" to get "hello", and sends "hello" to user A's mobile phone, which is played on user A's mobile phone. "Hello" and "hello" can be played synchronously on user A's mobile phone, or they can be played at different times on user A's mobile phone.

[0107] Based on the above-mentioned voice call method, the present disclosure also provides a voice call device. Figure 6 The device is described in detail.

[0108] Figure 6 The structural block diagram of the voice communication device according to the embodiment of the present disclosure is schematically shown.

[0109] like Figure 6 As shown, the voice communication device 400 of this embodiment includes an acquisition module 410 and a playback module 420 .

[0110] The acquisition module 410 is used to acquire the first instant speech and the first translated speech. In one embodiment, the acquisition module 410 can be used to perform the operation S210 described above, which will not be described in detail here.

[0111] The playing module 420 is used for playing the first instant speech and playing the first translated speech. In one embodiment, the playing module 420 can be used to perform the operation S220 described above, which will not be described in detail here.

[0112] The first instant voice is the original voice collected by the voice collection device, and the first translated voice is the translated voice obtained by translating the original voice collected by the voice collection device.

[0113] According to an embodiment of the present disclosure, any multiple modules in the acquisition module 410 and the playback module 420 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the acquisition module 410 and the playback module 420 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in any appropriate combination of any of them. Alternatively, at least one of the acquisition module 410 and the playback module 420 can be at least partially implemented as a computer program module, and when the computer program module is run, the corresponding function can be executed.

[0114] Figure 7 A block diagram of an electronic device suitable for implementing a voice call method according to an embodiment of the present disclosure is schematically shown.

[0115] like Figure 7 As shown, the electronic device 500 according to an embodiment of the present disclosure includes a processor 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage part 508 to a random access memory (RAM) 503. The processor 501 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 501 may also include an onboard memory for caching purposes. The processor 501 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0116] In RAM 503, various programs and data required for the operation of electronic device 500 are stored. Processor 501, ROM 502 and RAM 503 are connected to each other via bus 504. Processor 501 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 502 and / or RAM 503. It should be noted that the program can also be stored in one or more memories other than ROM 502 and RAM 503. Processor 501 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in one or more memories.

[0117] According to an embodiment of the present disclosure, the electronic device 500 may further include an input / output (I / O) interface 505, which is also connected to the bus 504. The electronic device 500 may further include one or more of the following components connected to the I / O interface 505: an input portion 506 including a keyboard, a mouse, etc.; an output portion 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 508 including a hard disk, etc.; and a communication portion 509 including a network interface card such as a LAN card, a modem, etc. The communication portion 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I / O interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed, so that a computer program read therefrom is installed into the storage portion 508 as needed.

[0118] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0119] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 502 and / or RAM 503 described above and / or one or more memories other than ROM 502 and RAM 503.

[0120] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the voice call method provided by the embodiment of the present disclosure.

[0121] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 501. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0122] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 509, and / or installed from the removable medium 511. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0123] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 509, and / or installed from the removable medium 511. When the computer program is executed by the processor 501, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0124] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0125] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0126] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways without departing from the spirit and teachings of the present disclosure. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0127] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

[0128] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways without departing from the spirit and teachings of the present disclosure. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0129] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A voice call method, applied to a first electronic device, comprising: Obtaining a first instant voice and a first translated voice; During the playing of the first instant voice and the playing of the first translated voice; The first instant voice is the original voice collected by the voice collection device, and the first translated voice is the translated voice obtained by translating the original voice collected by the voice collection device.

2. The method according to claim 1, The first translated speech represents a speech obtained by receiving the first instant speech by the first electronic device and translating the first instant speech, wherein: The voice collection device of the second electronic device collects the first instant voice and sends the first instant voice to the first electronic device instantly. The first electronic device is connected to the second electronic device for communication.

3. The method according to claim 1, The first translated speech represents the speech sent to the first electronic device after the second electronic device translates the first instant speech, wherein: The voice collection device of the second electronic device collects the first instant voice and instantly sends the first instant voice to the first electronic device, and the first electronic device is communicatively connected with the second electronic device.

4. The method according to claim 1, wherein the first translated speech is a translated speech corresponding to the first instant speech; or The first translated speech is a translated speech corresponding to the second real-time speech, and the collection time of the second real-time speech is earlier than the collection time of the first real-time speech. 5 . The method according to claim 1 , wherein the playback volume of the first translated speech is greater than the playback volume of the first instant speech.

6. The method according to claim 2, further comprising: Obtaining the second translation voice; If the second translated voice is a translated voice corresponding to the third instant language, sending the second translated voice to the second electronic device, so that the second electronic device plays the second translated voice while the first electronic device plays the second translated voice; The playing time of the second translated voice is later than the playing time of the third instant voice, and the third instant voice is the ending instant voice.

7. The method according to claim 4, wherein the first translated speech is the translated speech corresponding to the second instant speech; Also includes: If the first instant speech is the initial instant speech, playing the first instant speech at a first volume; If the first instant speech is a non-initial instant speech, playing the first instant speech at a second volume; The first volume is greater than the second volume.

8. A voice communication device, comprising: An acquisition module, used for acquiring the first instant speech and the first translated speech; A playing module, used for playing the first instant voice and the first translated voice; The first instant voice is the original voice collected by the voice collection device, and the first translated voice is the translated voice obtained by translating the original voice collected by the voice collection device.

9. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, causes the processor to execute the method according to any one of claims 1 to 7.

Images