Data processing method, device, electronic device and storage medium

Abstract

A data processing method, device, electronic device and storage medium, wherein the method comprises: obtaining first voice data (201); dividing the first voice data into at least two segments of second voice data (202); obtaining third voice data (203) corresponding to each segment of the at least two segments of the second voice data; the third voice data is obtained by translating the corresponding second voice data; inserting the corresponding third voice data at each first set position in the first voice data to obtain fourth voice data (204) corresponding to the first voice data; wherein each first set position corresponds to the end position of each segment of the at least two segments of the second voice data.

Description

Technical Field

[0001] The present application relates to simultaneous interpretation technology, and in particular to a data processing method, device, electronic device and storage medium. Background Art

[0002] In a simultaneous interpretation scenario, when the conference is played back live, the speaker's original voice and the translated synthesized voice interfere with each other, hindering the audience's understanding of the speech content and affecting the efficiency of information transmission. Summary of the invention

[0003] To solve related technical problems, the embodiments of the present application provide a data processing method, device, electronic device and storage medium.

[0004] The present application provides a data processing method, including:

[0005] Acquire first voice data;

[0006] Dividing the first voice data into at least two segments of second voice data;

[0007] Acquire third voice data corresponding to each of the at least two segments of second voice data; the third voice data is obtained by translating the corresponding second voice data;

[0008] Insert the corresponding third voice data at each first set position in the first voice data to obtain fourth voice data corresponding to the first voice data; wherein,

[0009] Each first set position corresponds to an end position of each of the at least two segments of second voice data.

[0010] Wherein, in the above solution, the dividing the first voice data into at least two segments of second voice data further includes:

[0011] Inserting a segment of fifth voice data at each first set position in the first voice data to obtain sixth voice data corresponding to the first voice data; the fifth voice data is composed of voice frames of a set waveform;

[0012] The inserting corresponding third voice data at each first set position in the first voice data comprises:

[0013] According to the set waveform, fifth voice data corresponding to each segment of second voice data is located in the sixth voice data;

[0014] The fifth voice data corresponding to each located second voice data segment is replaced with the corresponding third voice data.

[0015] In the above solution, the step of inserting a segment of fifth voice data at each first set position in the first voice data includes:

[0016] Generate fifth voice data of a set duration;

[0017] The fifth voice data of the set duration is inserted into each first set position in the first voice data.

[0018] In the above solution, the step of inserting a segment of fifth voice data at each first set position in the first voice data includes:

[0019] Determine the duration of each of the at least two segments of second voice data;

[0020] Generate corresponding fifth voice data for each of the at least two segments of second voice data; the duration of each generated fifth voice data is the same as the duration of the corresponding second voice data;

[0021] The corresponding fifth voice data is inserted into each first set position in the first voice data.

[0022] In the above solution, the voice frames constituting the set waveform of the fifth voice data include any one of the following:

[0023] Silent frames;

[0024] White noise frame.

[0025] In the above scheme, the method further includes:

[0026] Acquire first image data matching the first voice data;

[0027] Dividing the first image data into at least two segments of second image data; each segment of the second image data corresponds one-to-one to each segment of the second voice data in the at least two segments of the second voice data;

[0028] Insert the corresponding third image data at each second set position in the first image data to obtain fourth image data corresponding to the first image data; wherein,

[0029] Each second set position corresponds to the end position of each of the at least two segments of second image data; the fourth image data is used for synchronous playback with the fourth voice data.

[0030] In the above solution, the step of inserting corresponding third image data at each second set position in the first image data includes:

[0031] Determining the duration of each of the at least two segments of second image data;

[0032] Generating corresponding third image data for each of the at least two segments of second image data; the duration of each generated segment of third image data is the same as the duration of the corresponding second image data;

[0033] The corresponding third image data is inserted into each second set position in the first image data.

[0034] In the above solution, the step of inserting corresponding third image data at each second set position in the first image data includes:

[0035] Copying each segment of the at least two segments of the second image data to obtain third image data corresponding to each segment of the second image data;

[0036] The corresponding third image data is inserted into each second set position in the first image data.

[0037] The present application also provides a data processing device, including:

[0038] A first acquiring unit, configured to acquire first voice data;

[0039] a dividing unit, configured to divide the first voice data into at least two segments of second voice data;

[0040] A second acquisition unit is configured to acquire third voice data corresponding to each of the at least two segments of second voice data; the third voice data is obtained by translating the corresponding second voice data;

[0041] an inserting unit, configured to insert corresponding third voice data at each first set position in the first voice data to obtain fourth voice data corresponding to the first voice data; wherein,

[0042] Each first set position corresponds to an end position of each of the at least two segments of second voice data.

[0043] An embodiment of the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of any of the above-mentioned data processing methods are implemented.

[0044] An embodiment of the present application further provides a storage medium on which computer instructions are stored. When the computer instructions are executed by a processor, the steps of any of the above-mentioned data processing methods are implemented.

[0045] The data processing method, device, electronic device and storage medium provided in the embodiments of the present application, after collecting the first voice data corresponding to the original sound, insert the second voice data corresponding to the translated synthesized sound into the first voice data at intervals, and the obtained fourth voice data can achieve the effect of alternating the original sound and the translated synthesized sound when playing, thereby realizing consecutive interpretation, avoiding the auditory interference caused to the audience when the original sound and the translated synthesized sound are played at the same time, and in the scenario of playing back the live meeting, it helps the audience to understand the speaker's speech content more quickly and accurately, thereby improving the efficiency of information transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 A schematic diagram of a system architecture for application of a data processing method in a related technology;

[0047] Figure 2 A schematic diagram of a flow chart of a data processing method according to an embodiment of the present application;

[0048] Figure 3 Another schematic diagram of a data processing method according to an embodiment of the present application;

[0049] Figure 4 A flowchart of a data processing method according to an embodiment of the present application;

[0050] Figure 5 A schematic diagram of the structure of a data processing device according to an embodiment of the present application;

[0051] Figure 6 A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0052] Before describing the technical solution of the embodiment of the present application in detail, a system to which the subtitle display method in the related art is applied is briefly described first.

[0053] Figure 1 Schematic diagram of the system architecture for the application of data processing methods in related technologies. Figure 1 As shown, the system may include: a machine simultaneous interpretation server, a speech recognition server, a translation server, a mobile terminal sending server, an audience mobile terminal, a computer (PC, Personal Computer) client, and a display screen.

[0054] In actual applications, speakers can make conference speeches through PC clients, and project the displayed documents, such as documents of presentation software (PPT, PowerPoint), onto the display screen, and display them to users through the display screen. During the conference speech, the PC client collects the speaker's audio and sends the collected audio to the machine simultaneous interpretation server. The machine simultaneous interpretation server recognizes the audio data through the speech recognition server to obtain the recognized text, and then translates the recognized text through the translation server to obtain the translation result; the machine simultaneous interpretation server generates a translation synthesis sound based on the translation result and sends it to the PC client, and sends the translation synthesis sound to the audience's mobile terminal through the mobile terminal sending server, and displays the translation result to the user, thereby translating the speaker's speech content into the language required by the user and displaying it, realizing simultaneous interpretation in the meeting.

[0055] In the scheme of related technology, after the conference speech is over, the audience's mobile terminal plays back the live conference. The played back audio is recorded with the speaker's original voice played outward, and contains two audio tracks, corresponding to the speaker's voice and the translated synthesized sound. Therefore, during playback, the speaker's voice and the translated synthesized sound are played synchronously. The two overlap and interfere with each other. On the one hand, the audience unconsciously listens to audio in two languages ​​at the same time, causing auditory discomfort to the audience. On the other hand, the mixture of the two languages ​​also hinders the audience from understanding the content of the speech, affecting the efficiency of information transmission.

[0056] Based on this, in various embodiments of the present application, data processing is performed on the replayed audio, the voice data corresponding to the speaker's voice is divided into multiple voice data segments, and corresponding translated synthetic sounds are inserted between the multiple voice data segments. On this basis, the effect of consecutive interpretation is achieved when replaying the live conference, which helps the audience to better understand the speaker's speech content and improve the efficiency of information transmission.

[0057] The present application is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0058] The present application embodiment provides a data processing method, Figure 2 Schematic diagram of a data processing method according to an embodiment of the present application. Figure 2 As shown, the method includes:

[0059] Step 201: Acquire first voice data.

[0060] Here, the first voice data is the voice data of the original language, that is, the voice data that has not been translated. In practical applications, when a speaker speaks, the voice of the speaker can be collected by a voice collection module, such as a microphone, to obtain the first voice data.

[0061] Step 202: Divide the first voice data into at least two segments of second voice data.

[0062] Usually, when a speaker finishes a sentence, there will be a short pause, which corresponds to the waveform of the first voice data as a silent band with a duration greater than the set duration threshold. Therefore, by detecting the waveform of the first voice data, the silent band in the first voice data is determined, and any position in the silent band is used as a separation position to divide the first voice data into at least two segments of second voice data.

[0063] Considering that there will be a certain amount of noise at the conference site, here, the silent band can be understood as a band where the amplitude mean of the waveform is less than the set mean threshold. In practical applications, after obtaining the first voice data, the first voice data can be preprocessed, including filtering noise reduction, gain amplification and other preprocessing, and then the preprocessed first voice data is divided.

[0064] Step 203: Acquire third voice data corresponding to each of the at least two segments of second voice data.

[0065] Here, the third voice data is obtained by translating the corresponding second voice data. For each segment of the second voice data divided from the first voice data, the second voice data is converted into text using voice recognition technology, and then the text is processed using machine translation technology to translate the text in the original language into the text in the target language, and finally speech synthesis is performed based on the text in the target language to obtain the third voice data corresponding to the segment of the second voice data.

[0066] In actual application, machine translation technology can be used to translate from the original language to the target language. The machine translation technologies that can be used include: rule-based machine translation technology or corpus-based machine translation technology.

[0067] Step 204: insert corresponding third voice data into each first set position in the first voice data to obtain fourth voice data corresponding to the first voice data.

[0068] Each first set position corresponds to the end position of each second voice data segment in the at least two second voice data segments.

[0069] For example, the first voice data is divided into second voice data 1, second voice data 2 and second voice data 3 in sequence, corresponding to third voice data 1, third voice data 2 and third voice data 3 respectively. Then after completing the insertion operation, the fourth voice data corresponding to the first voice data is obtained, and the composition of the fourth voice data is second voice data 1, third voice data 1, second voice data 2, third voice data 2, second voice data 3 and third voice data 3 in sequence.

[0070] In this way, when the conference live broadcast is played back, the fourth voice data can be played to achieve the effect of consecutive interpretation.

[0071] In one embodiment, dividing the first voice data into at least two segments of second voice data further includes:

[0072] A segment of fifth voice data is inserted into each first set position in the first voice data to obtain sixth voice data corresponding to the first voice data; the fifth voice data is composed of voice frames of set waveforms.

[0073] Here, after the first voice data is divided into at least two segments of the second voice data, a segment of the fifth voice data is first inserted into each of the first positions in the first voice data to obtain the sixth voice data corresponding to the first voice data. For example, the first voice data is sequentially divided into the second voice data 1, the second voice data 2, and the second voice data 3, then the components of the obtained sixth voice data are respectively the second voice data 1, the fifth voice data 1, the second voice data 2, the fifth voice data 2, the second voice data 3, and the fifth voice data 3.

[0074] The speech frames constituting the set waveform of the fifth speech data include any one of the following:

[0075] Silent frames;

[0076] White noise frame.

[0077] The waveform of the silence frame is a straight line, and the waveform of the white noise frame satisfies that: within a wide frequency range, the noise energy contained in each frequency band of equal bandwidth is equal. The waveforms of the above two speech frames can be clearly distinguished from the speech frames collected when the speaker is speaking.

[0078] Here, the duration of the fifth voice data can be significantly longer than the duration of any silent band or white noise band in the second voice data. In actual applications, a duration threshold that is significantly longer than the duration of any silent band or white noise band in the second voice data can be set, and the duration of the fifth voice data can be any duration greater than the duration threshold.

[0079] Here, the fifth voice data is inserted into the first voice data for the purpose of locating the insertion position, i.e., the first set position, when the third voice data is subsequently inserted into the first voice data, i.e., for the purpose of marking the first set position. Based on this, the inserting of the corresponding third voice data into each first set position in the first voice data includes:

[0080] According to the set waveform, fifth voice data corresponding to each segment of second voice data is located in the sixth voice data;

[0081] The fifth voice data corresponding to each located second voice data segment is replaced with the corresponding third voice data.

[0082] Here, when inserting the third voice data, a voice data segment with a set waveform is located in the first voice data, and the corresponding third voice data is determined based on the second voice data adjacent to the voice data segment with the set waveform and located before the voice data segment with the set waveform. The determined third voice data is then used to replace the voice data segment with the set waveform, thereby completing the insertion of the third voice data.

[0083] In one embodiment, inserting a segment of fifth voice data at each first set position in the first voice data includes:

[0084] Generate fifth voice data of a set duration;

[0085] The fifth voice data of the set duration is inserted into each first set position in the first voice data.

[0086] Here, the duration of all fifth voice data inserted in the first voice data is a set duration. As mentioned above, a duration threshold that is significantly greater than the length of any silent band or white noise band in the second voice data can be set, and the set duration of the fifth voice data can be any duration greater than the duration threshold.

[0087] In one embodiment, inserting a segment of fifth voice data at each first set position in the first voice data includes:

[0088] Determine the duration of each of the at least two segments of second voice data;

[0089] Generate corresponding fifth voice data for each of the at least two segments of second voice data; the duration of each generated fifth voice data is the same as the duration of the corresponding second voice data;

[0090] The corresponding fifth voice data is inserted into each first set position in the first voice data.

[0091] Here, the corresponding fifth voice data is inserted at the end position of any second voice data of the first voice data, and the duration of the fifth voice data is the same as that of the second voice data. In practical applications, the second voice data is translated to obtain the third voice data, and the duration of the third voice data is usually close to that of the second voice data. Therefore, the duration of the corresponding fifth voice data is determined according to the duration of the second voice data. In this way, when the fifth voice data is replaced by the third voice data, the fifth voice data with similar duration can be quickly located in the first voice data according to the duration of the third voice data, and the fifth voice data is replaced with the third voice data with similar duration.

[0092] In one embodiment, Figure 3 Said method further comprises:

[0093] Step 301: Acquire first image data matching the first voice data.

[0094] In actual applications, in a conference setting, the first image data may be image data collected synchronously with the first voice data, for example, an image of the conference site recorded synchronously while the speaker is speaking; or, the first image data may be image data output synchronously when the first voice data is collected, for example, a PPT played synchronously on a large screen at the conference while the speaker is speaking.

[0095] Step 302: Divide the first image data into at least two segments of second image data; each segment of second image data corresponds one-to-one to each segment of second voice data in the at least two segments of second voice data.

[0096] As described above, the first image data is collected or output synchronously with the first voice data, and therefore, the first image data can be divided into at least two segments of second image data based on the same time axis as the first voice data.

[0097] Step 303: inserting corresponding third image data into each second set position in the first image data to obtain fourth image data corresponding to the first image data; wherein,

[0098] Each second set position corresponds to the end position of each of the at least two segments of second image data; the fourth image data is used for synchronous playback with the fourth voice data.

[0099] For example, the first image data is divided into second image data 1, second image data 2 and second image data 3 in sequence, which correspond to third image data 1, third image data 2 and third image data 3 respectively. Then, after completing the insertion operation, the fourth image data corresponding to the first image data is obtained, and the fourth image data is composed of second image data 1, third image data 1, second image data 2, third image data 2, second image data 3 and third image data 3 in sequence.

[0100] In this way, when the conference live broadcast is played back, the fourth voice data and the fourth image data can be played synchronously. Since the synthesis of voice data and image data forms video data, the above scheme can achieve the effect of consecutive interpretation through video streaming.

[0101] In one embodiment, inserting corresponding third image data at each second set position in the first image data comprises:

[0102] Determining the duration of each of the at least two segments of second image data;

[0103] Generating corresponding third image data for each of the at least two segments of second image data; the duration of each generated segment of third image data is the same as the duration of the corresponding second image data;

[0104] The corresponding third image data is inserted into each second set position in the first image data.

[0105] Here, the corresponding third image data is inserted at the end position of any second image data of the first image data, and the duration of the third image data is the same as that of the second image data. In practical applications, the third voice data is translated from the second voice data, and the duration of the third voice data is usually close to that of the second voice data, and the second voice data is played synchronously with the second image data, so the duration of the third image data used for synchronous playback with the third voice data is also close to that of the second image data.

[0106] In practical applications, the content of the third image data may be an interpreter animation matching the third voice data.

[0107] In one embodiment, inserting corresponding third image data at each second set position in the first image data comprises:

[0108] Copying each segment of the at least two segments of the second image data to obtain third image data corresponding to each segment of the second image data;

[0109] The corresponding third image data is inserted into each second set position in the first image data.

[0110] Here, by copying, the third image data has the same data content as the corresponding second image data.

[0111] Thus, when the fourth voice data is played, when the third voice data is played, the image data matching the corresponding second voice data will be displayed. In practical applications, it is equivalent to using the video clip corresponding to the original sound as the video clip corresponding to the translated sound.

[0112] The data processing method provided in the embodiment of the present application, after collecting the first voice data corresponding to the original sound, inserts the second voice data corresponding to the translated synthesized sound into the first voice data at intervals, and the obtained fourth voice data can achieve the effect of alternating the original sound and the translated synthesized sound when playing, thereby realizing consecutive interpretation, avoiding the auditory interference caused to the audience when the original sound and the translated synthesized sound are played at the same time, and in the scenario of playing back the live meeting, it helps the audience to understand the speaker's speech content more quickly and accurately, thereby improving the efficiency of information transmission.

[0113] Figure 4 The present invention provides a data processing method according to an embodiment of the present invention. The present embodiment of the present invention is applied to a conference scene of simultaneous interpretation and is used to implement consecutive interpretation when replaying the conference live. Figure 4 As shown:

[0114] Step 401: A microphone collects the original voice of a speaker to obtain first voice data.

[0115] Step 402: pre-process the first speech data, including filtering, noise reduction, gain amplification, etc.

[0116] Step 403: Divide the first voice data into at least two segments of second voice data according to the sentence pause interval in the first voice data, and add a silence frame of a certain length between every two segments of the second voice data.

[0117] Step 404: Perform speech recognition on each segment of the second speech data to obtain corresponding recognition texts. For example, the first segment of the second speech data is recognized as "Good morning, everyone", and the second segment of the second speech data is recognized as "Nice to meet you all".

[0118] Step 405: pre-process the recognized text to eliminate problems in the recognized text that may result from some recognition errors, colloquial expressions, too many modal particles, repeated expressions of some contents, etc., which may lead to incoherent sentences in the recognized text.

[0119] Step 406: Perform machine translation on the recognized text. Here, through machine translation technology, "Good morning, everyone" is translated into "Good morning, everyone!", and "Nice to meet you all" is translated into "Nice to meet you".

[0120] Step 407: Generate a corresponding translated synthetic voice based on the translation obtained after machine translation.

[0121] Step 408: inserting the translated synthesized sound correspondence into the interval of the first voice data processed in step 403 to obtain fourth voice data.

[0122] Step 409: Generate fourth image data matching the fourth voice data. Play the fourth voice data and the fourth image data synchronously, and you can get the effect of consecutive interpretation when you play back the conference live.

[0123] In order to implement the data processing method of the embodiment of the present application, the embodiment of the present application also provides a data processing device, which can be arranged in an electronic device as Figure 1 The machine simultaneous interpretation server in . Figure 5 Schematic diagram of the structure of the data processing device of the embodiment of the present application. Figure 5 As shown, the data processing device includes:

[0124] A first acquiring unit 51 is configured to acquire first voice data;

[0125] A first dividing unit 52, configured to divide the first voice data into at least two segments of second voice data;

[0126] A second acquisition unit 53 is configured to acquire third voice data corresponding to each of the at least two segments of second voice data; the third voice data is obtained by translating the corresponding second voice data;

[0127] The first insertion unit 54 is configured to insert the corresponding third voice data at each first set position in the first voice data to obtain fourth voice data corresponding to the first voice data; wherein each first set position corresponds to the end position of each second voice data in the at least two segments of the second voice data.

[0128] In one embodiment, the first dividing unit 52 is further configured to:

[0129] Inserting a segment of fifth voice data at each first set position in the first voice data to obtain sixth voice data corresponding to the first voice data; the fifth voice data is composed of voice frames of a set waveform;

[0130] The inserting corresponding third voice data at each first set position in the first voice data comprises:

[0131] According to the set waveform, fifth voice data corresponding to each segment of second voice data is located in the sixth voice data;

[0132] The fifth voice data corresponding to each located second voice data segment is replaced with the corresponding third voice data.

[0133] In one embodiment, the first division unit 52 inserts a segment of fifth voice data at each first set position in the first voice data, including:

[0134] Generate fifth voice data of a set duration;

[0135] The fifth voice data of the set duration is inserted into each first set position in the first voice data.

[0136] In one embodiment, the first division unit 52 inserts a segment of fifth voice data at each first set position in the first voice data, including:

[0137] Determine the duration of each of the at least two segments of second voice data;

[0138] Generate corresponding fifth voice data for each of the at least two segments of second voice data; the duration of each generated fifth voice data is the same as the duration of the corresponding second voice data;

[0139] The corresponding fifth voice data is inserted into each first set position in the first voice data.

[0140] In one embodiment, the voice frames constituting the set waveform of the fifth voice data include any one of the following:

[0141] Silent frames;

[0142] White noise frame.

[0143] In one embodiment, the device further comprises:

[0144] a third acquiring unit, configured to acquire first image data matching the first voice data;

[0145] A second dividing unit is configured to divide the first image data into at least two segments of second image data; each segment of the second image data corresponds one-to-one to each segment of the second voice data in the at least two segments of the second voice data;

[0146] The second inserting unit is configured to insert the corresponding third image data at each second set position in the first image data to obtain fourth image data corresponding to the first image data; wherein,

[0147] Each second set position corresponds to the end position of each of the at least two segments of second image data; the fourth image data is used for synchronous playback with the fourth voice data.

[0148] In one embodiment, the second inserting unit inserts the corresponding third image data at each second set position in the first image data, including:

[0149] Determining the duration of each of the at least two segments of second image data;

[0150] Generating corresponding third image data for each of the at least two segments of second image data; the duration of each generated segment of third image data is the same as the duration of the corresponding second image data;

[0151] The corresponding third image data is inserted into each second set position in the first image data.

[0152] In one embodiment, the second inserting unit inserts the corresponding third image data at each second set position in the first image data, including:

[0153] Copying each segment of the at least two segments of the second image data to obtain third image data corresponding to each segment of the second image data;

[0154] The corresponding third image data is inserted into each second set position in the first image data.

[0155] In actual application, the first acquisition unit 51, the first division unit 52, the second acquisition unit 53, the first insertion unit 54, the second acquisition unit, the second division unit, and the second insertion unit can be implemented by a processor in an electronic device, such as a central processing unit (CPU), a digital signal processor (DSP), a microcontroller unit (MCU) or a programmable gate array (FPGA).

[0156] It should be noted that: when the data processing device provided in the above embodiment performs data processing, only the division of the above program modules is used as an example. In actual applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the electronic device is divided into different program modules to complete all or part of the processing described above. In addition, the device provided in the above embodiment and the data processing method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0157] The data processing device in the above embodiment can be correspondingly arranged at Figure 1 In the data processing system shown in FIG. Figure 1 On the machine simultaneous interpretation server of the data processing system, the data processing method of the implementation example of the present application is applied in the translation system.

[0158] Based on the hardware implementation of the above-mentioned device, an embodiment of the present application also provides an electronic device. Figure 6 Schematic diagram of the hardware structure of the electronic device of the embodiment of the present application. Figure 6 As shown, the electronic device 60 includes a memory 63, a processor 62, and a computer program stored in the memory 63 and executable on the processor 62; when the processor 62 executes the program, the method provided by one or more of the above technical solutions is implemented.

[0159] Specifically, when the processor 62 in the electronic device 60 executes the program, it achieves: obtaining first voice data; dividing the first voice data into at least two segments of second voice data; obtaining third voice data corresponding to each segment of the at least two segments of second voice data; the third voice data is obtained by translating the corresponding second voice data; inserting the corresponding third voice data at each first set position in the first voice data to obtain fourth voice data corresponding to the first voice data; wherein each first set position corresponds to the end position of each segment of the at least two segments of second voice data.

[0160] It should be noted that the specific steps implemented when the processor 62 executes the program have been described in detail in the above embodiment and will not be repeated here.

[0161] It is understood that the electronic device 60 also includes a communication interface 61; the various components in the electronic device 60 are coupled together via a bus system 64. It is understood that the bus system 64 is configured to achieve connection and communication between these components. In addition to the data bus, the bus system 64 also includes a power bus, a control bus, and a status signal bus.

[0162] Understandably, the above Figure 6The memory in the embodiment may be a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a ferromagnetic random access memory, a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory may be a disk memory or a tape memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM, SyncLink Dynamic Random Access Memory), and direct RAM bus random access memory (DRRAM, Direct Rambus Random Access Memory).The memories described in the embodiments of the present application are intended to include, but are not limited to, these and any other suitable types of memories.

[0163] The method disclosed in the above embodiment of the present application can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor may be a general-purpose processor, a DSP, or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0164] The present application also provides a storage medium, specifically a computer storage medium, more specifically a computer readable storage medium, on which computer instructions, namely a computer program, are stored, and when the computer instructions are executed by a processor, the method provided by one or more of the above technical solutions is implemented.

[0165] In the several embodiments provided in the present application, it should be understood that the disclosed methods and intelligent devices can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0166] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0167] In addition, all functional units in the embodiments of the present application may be integrated into a second processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0168] A person of ordinary skill in the art can understand that: all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium, which, when executed, executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, RAM, disks or optical disks.

[0169] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, RAM, magnetic disks or optical disks.

[0170] It should be noted that: "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0171] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0172] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be covered by the protection scope of the present application.

Claims

1. A data processing method, comprising: Acquire first voice data; Dividing the first voice data into at least two segments of second voice data; Acquire third voice data corresponding to each of the at least two segments of second voice data; the third voice data is obtained by translating the corresponding second voice data; Inserting corresponding third voice data at each first set position in the first voice data to obtain fourth voice data corresponding to the first voice data; wherein each first set position corresponds to the end position of each second voice data in the at least two second voice data segments; Acquire first image data matching the first voice data; Dividing the first image data into at least two segments of second image data; each segment of the second image data corresponds one-to-one to each segment of the second voice data in the at least two segments of the second voice data; Insert corresponding third image data into each second set position in the first image data to obtain fourth image data corresponding to the first image data; wherein each second set position corresponds to the end position of each of the at least two segments of second image data; and the fourth image data is used to be played synchronously with the fourth voice data.

2. The method according to claim 1, wherein: The step of dividing the first voice data into at least two segments of second voice data further includes: Inserting a segment of fifth voice data at each first set position in the first voice data to obtain sixth voice data corresponding to the first voice data; the fifth voice data is composed of voice frames of a set waveform; The inserting corresponding third voice data at each first set position in the first voice data comprises: According to the set waveform, fifth voice data corresponding to each segment of second voice data is located in the sixth voice data; The fifth voice data corresponding to each located second voice data segment is replaced with the corresponding third voice data.

3. The method according to claim 2, wherein: The inserting a segment of fifth voice data at each first set position in the first voice data comprises: generating fifth voice data of a set duration; The fifth voice data of the set duration is inserted into each first set position in the first voice data.

4. The method according to claim 2, wherein: The inserting a segment of fifth voice data at each first set position in the first voice data comprises: Determining the duration of each of the at least two segments of second voice data; Generate corresponding fifth voice data for each of the at least two segments of second voice data; the duration of each generated fifth voice data is the same as the duration of the corresponding second voice data; The corresponding fifth voice data is inserted into each first set position in the first voice data.

5. The method according to any one of claims 2 to 4, wherein: The speech frames constituting the set waveform of the fifth speech data include any one of the following: Silent frames; White noise frame.

6. The method according to claim 1, wherein: The inserting corresponding third image data at each second set position in the first image data comprises: Determining the duration of each of the at least two segments of second image data; Generating corresponding third image data for each of the at least two segments of second image data; the duration of each generated segment of third image data is the same as the duration of the corresponding second image data; The corresponding third image data is inserted into each second set position in the first image data.

7. The method according to claim 1, wherein: The inserting corresponding third image data at each second set position in the first image data comprises: Copying each segment of the at least two segments of the second image data to obtain third image data corresponding to each segment of the second image data; The corresponding third image data is inserted into each second set position in the first image data.

8. A data processing device, comprising: A first acquiring unit, configured to acquire first voice data; A first dividing unit, configured to divide the first voice data into at least two segments of second voice data; A second acquisition unit is configured to acquire third voice data corresponding to each of the at least two segments of second voice data; the third voice data is obtained by translating the corresponding second voice data; A first inserting unit is configured to insert corresponding third voice data at each first set position in the first voice data to obtain fourth voice data corresponding to the first voice data; wherein each first set position corresponds to an end position of each second voice data in the at least two second voice data segments; a third acquiring unit, configured to acquire first image data matching the first voice data; A second dividing unit is configured to divide the first image data into at least two segments of second image data; each segment of the second image data corresponds one-to-one to each segment of the second voice data in the at least two segments of the second voice data; A second insertion unit is configured to insert corresponding third image data at each second set position in the first image data to obtain fourth image data corresponding to the first image data; wherein each second set position corresponds to the end position of each second image data in the at least two segments of second image data; and the fourth image data is used to be played synchronously with the fourth voice data.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A storage medium having computer instructions stored thereon, wherein the computer instructions, when executed by a processor, implement the steps of the method according to any one of claims 1 to 7.

Images