Video translation method and device, computer equipment and storage medium

Abstract

The invention discloses a video translation method and apparatus, a computer device and a storage medium. The method comprises the steps of extracting an original audio in a video and a key frame in the video; according to the original audio and the key frame, judging whether a translated target translation audio is stored in the cloud in advance; if it is judged that the translated target translation audio is not stored in advance, converting the original audio into a target translation text; the original audio features are extracted, a target translation audio is synthesized according to the target translation text and the extracted original audio features, and the extracted original audio features include extraction of mood features of the original audio; and replacing the original audio with the target translated audio. By judging whether the target translated audio stored in the cloud exists or not and performing segmented translation, the loading duration after video translation is shortened to the maximum extent, so that the video watching fluency of a user is improved.

Description

Technical Field

[0001] The present invention relates to the field of video translation, and in particular to a video translation method, device, computer equipment and storage medium. Background Art

[0002] As people's living standards improve, people have more and more opportunities to watch foreign language videos. However, most of the existing foreign language videos are foreign language audio, with Chinese subtitles for viewing, otherwise it will affect people's viewing of foreign language videos. Therefore, a method is urgently needed to solve the problem of language conversion when people watch foreign language videos. Summary of the invention

[0003] The embodiments of the present invention provide a video translation method, apparatus, computer equipment and storage medium to solve the problem of video translation.

[0004] The first aspect of the present application provides a video translation method, comprising: Extract the original audio and key frames from the video; According to the original audio and the key frame, determining whether the translated target audio has been stored in advance in the cloud; If it is determined that the translated target translation audio is not stored in advance, converting the original audio segment into the target translation text; The original audio features are extracted to synthesize a target translation audio according to the target translation text and the extracted original audio features, wherein the extracted original audio features include extracting tone features of the original audio.

[0005] Optionally, converting the original audio segment into a target translated text comprises: According to the content of the original audio and the target translation language, the content of the original audio is converted into target translation text in segments, and semantic calibration is performed on the target translation text.

[0006] Optionally, converting the original audio segment into a target translated text comprises: Segmenting the original audio to form a plurality of original audio segments; According to the playing time of the original audio segment, obtaining the estimated playing time of each audio segment in turn; According to the estimated playing time of each audio segment, the original audio segments are converted into target translation texts in sequence.

[0007] Optionally, extracting features of the original audio to synthesize a target translated audio according to the target translated text and the extracted audio features comprises: Extracting audio features of the original audio, and analyzing the audio features of the original audio; The target translated audio having the same features as the original audio is generated according to the audio feature analysis result and the target translated text.

[0008] Optionally, according to the estimated playing time of each audio segment, the original audio segments are converted into target translation texts in sequence, which includes: Checking the translation progress of the original audio to determine whether there is any original audio that has not been translated; If there is untranslated audio, calculate the target translated audio generation time based on the estimated playback time of the audio clip; The original audio segments are converted into target translated texts in sequence according to the target translated audio generation time.

[0009] Optionally, synthesizing the target translated audio, then comprising: replacing the original audio with the target translated audio; The target translation audio and video animation are merged to form the translated target video.

[0010] A second aspect of the present application provides a video translation device, comprising: Audio extraction module, used to extract original audio and key frames in the video; A judgment module, based on the original audio and the key frame, determines whether the translated target audio has been stored in advance in the cloud; A first audio processing module, configured to convert the original audio into a target translation text if it is determined that the translated target translation audio is not stored in advance; A second audio processing module extracts the original audio features to synthesize a target translation audio according to the target translation text and the extracted original audio features, wherein the extracted original audio features include extracting tone features of the original audio; The audio output module replaces the original audio with the target translated audio.

[0011] Optionally, the second audio processing module includes: Extracting audio features of the original audio, and analyzing the audio features of the original audio; The target translated audio having the same features as the original audio is generated according to the audio feature analysis result and the target translated text.

[0012] A third aspect of the present application provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned video translation method when executing the computer program.

[0013] A fourth aspect of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned video translation method is implemented.

[0014] The above-mentioned video translation method, device, computer equipment and storage medium extract the original audio and key frames in the video; determine whether the translated target translation audio has been stored in advance in the cloud based on the original audio and the key frames; if it is determined that the translated target translation audio has not been stored in advance, convert the original audio into a target translation text; extract the original audio features to synthesize the target translation audio based on the target translation text and the extracted original audio features, wherein the extracted original audio features include extracting the tone features of the original audio; and replace the original audio with the target translation audio. This application maximizes the shortening of the loading time after video translation by determining whether the target translation audio is stored in the cloud and translating it in segments, so as to improve the fluency of user video viewing. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0016] Figure 1 is a schematic diagram of an application environment of a video translation method in one embodiment of the present invention; Figure 2 is a flow chart of a video translation method in one embodiment of the present invention; Figure 3 is a schematic diagram of a video translation device in one embodiment of the present invention; Figure 4 is a schematic diagram of a computer device in one embodiment of the present invention. DETAILED DESCRIPTION

[0017] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0018] The video translation method provided by the embodiment of the present invention can be applied as follows: Figure 1 Specifically, the video translation method is applied in a video translation system, which includes: Figure 1 The client and cloud shown in the figure communicate with each other through the network to replace the original audio with the target translated audio. The client is also called the user end, which refers to the program corresponding to the cloud and providing local services to the customer. The client can be installed on but not limited to various personal computers, laptops, smart phones, tablet computers and portable wearable devices. The cloud can be implemented with an independent cloud or a cloud cluster composed of multiple clouds.

[0019] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0020] It should also be understood that the term "and / or" used in the present description and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0021] As used in the present specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]", depending on the context.

[0022] In addition, in the description of the present specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0023] References to "one embodiment" or "some embodiments" etc. described in the present specification mean that one or more embodiments of the present invention include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0024] It should be understood that the order of execution of the steps in the following embodiments does not imply a precedence of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0025] In order to illustrate the technical solution of the present invention, specific embodiments are provided below for illustration.

[0026] In one embodiment, if Figure 2 As shown, a video translation method is provided, and the method is applied in Figure 1 The following steps are used as an example to illustrate the cloud in the example: S10: extracting the original audio and key frames in the video.

[0027] S20: Determine, based on the original audio and the key frame, whether the translated target audio has been stored in advance in the cloud.

[0028] S30: If it is determined that the translated target translation audio is not stored in advance, the original audio segment is converted into a target translation text.

[0029] Specifically, the present application provides a video player, which extracts the original audio and part of the video key frame content in the video when the user plays the video, determines whether the content of the original audio has been translated in advance, and if it is determined that the translated target translation audio has not been stored in advance, converts the original audio segments into target translation text.

[0030] For example, a user uses the video player in this video to play an English version of a video. The video player will extract the original audio and some key frame content in the video in advance, determine whether the original audio has been translated into the target translation text in advance, and store the original audio in the cloud of the video player. If the original audio and some key frame content extracted in advance by the video player determine that the original audio has not been translated in advance, the original audio is segmented and converted into the target translation text. The target translation text is determined according to the target translation language, which is the language required by the user, such as Chinese, Japanese, Korean, French, etc.

[0031] In one embodiment, converting the original audio segments into target translation texts includes: converting the content segments of the original audio into target translation texts according to the content of the original audio and the target translation language, and performing semantic calibration on the target translation texts.

[0032] Specifically, it takes time to translate the audio in a video. If you have to wait for the translation to be completed before playing it, the loading time of the video will be too long, affecting the user's video viewing experience. Therefore, in this application, the original audio in the playing video and the target language to be translated are first obtained, and then the content of the original audio is segmented and converted into the target translation text, and the target translation text is semantically calibrated to ensure the accuracy of the translation content.

[0033] In this embodiment, by extracting the original audio and key frames in the video, it is determined whether the translated target translation audio has been stored in advance in the cloud based on the original audio and the key frames. If it is determined that the translated target translation audio has not been stored in advance, the original audio is segmented and converted into target translation text, and the translation text is semantically calibrated. While ensuring the accuracy of the translation, the video loading time is also reduced, thereby improving the user's viewing experience.

[0034] S40: Extracting the original audio features to synthesize a target translation audio according to the target translation text and the extracted original audio features.

[0035] Specifically, after obtaining the target translation text translated from the original audio, the audio features of the original audio are extracted, and the target translation audio is generated using audio synthesis technology according to the content of the target translation text and the extracted audio features, and the original audio is replaced with the generated target translation audio, wherein the extracted original audio features include extracting the tone features of the original audio.

[0036] In this embodiment, the original audio features are extracted to synthesize the target translated audio according to the target translated text and the audio features, and the original audio is replaced with the target translated audio. Thus, when playing the video, the audio of the target translated language is played directly, and the speech content of the characters in the video can be understood without adding subtitles.

[0037] In this embodiment, the original audio and key frames in the video are extracted; based on the original audio and the key frames, it is determined whether the translated target translated audio has been stored in advance in the cloud; if it is determined that the translated target translated audio has not been stored in advance, the original audio is converted into a target translated text; the original audio features are extracted to synthesize the target translated audio according to the target translated text and the extracted original audio features, wherein the extracted original audio features include extracting the tone features of the original audio; and the original audio is replaced with the target translated audio. The embodiment determines whether the target translated audio is stored in the cloud and translates it in segments, thereby maximizing the shortening of the loading time after the video is translated, so as to improve the fluency of the user's video viewing.

[0038] In one embodiment, a video translation method is provided. In step S30, the original audio segment is converted into a target translation text, which specifically includes the following steps: S31: Segmenting the original audio to form a number of original audio segments; S32: acquiring the estimated playing time of each audio segment in turn according to the playing time of the original audio segment; S33: Converting the original audio segments into target translation texts in sequence according to the estimated playing time of each audio segment.

[0039] Specifically, it takes time for a user to play a video and translate the original audio in the video into a target audio. If the user has to wait until the original audio is translated, the waiting time will be increased. Therefore, the present application divides the original audio into several original audio segments, obtains the estimated playback time of each audio segment in turn according to the playback time of the original audio segment, and converts the original audio segments into target translated texts in turn according to the estimated playback time of each audio segment.

[0040] For example, when playing an English movie, it needs to be translated into Chinese audio output, obtain all the original audio in the video, divide the audio to be translated into several original audio segments to be translated, obtain the estimated playback time of each audio segment, and before this estimated playback time, the audio segment needs to be translated into a target translation text, generate the target translation audio through audio synthesis technology, store it in the cloud of the video player, and then translate it in advance according to the playback time of the audio segments.

[0041] In this embodiment, the original audio is divided into several original audio segments, and the estimated playing time of each audio segment is obtained in turn according to the playing time of the original audio segment. According to the estimated playing time of each audio segment, the original audio segments are converted into target translation texts in turn to ensure that when the audio segment is played, it can be played directly without waiting.

[0042] In one embodiment, a video translation method is provided. In step S40, the features of the original audio are extracted to synthesize a target translation audio according to the target translation text and the extracted audio features. Specifically, the method includes the following steps.

[0043] S41: extracting audio features of the original audio, and analyzing the audio features of the original audio.

[0044] S42: Generate the target translation audio with the same features as the original audio according to the audio feature analysis result and the target translation text.

[0045] Specifically, in order to ensure the consistency of the target translation audio and the original audio sound, when generating the target translation audio, it is necessary to extract the sound features of the original audio and analyze the sound features of the original audio, including analyzing the sound timbre, sound frequency and other features of the original audio, and generate the target translation audio with the same features as the original audio based on the analysis results and the target translation text.

[0046] In this embodiment, the audio features of the original audio are extracted and analyzed, and the target translated audio with the same features as the original audio is generated according to the audio feature analysis results and the target translated text, thereby ensuring the consistency of the target translated audio and the original audio sound, so that the user has a better video viewing experience.

[0047] In one embodiment, in step S33, the original audio segments are sequentially converted into target translation texts according to the estimated playing time of each audio segment, which specifically includes the following steps: S331: Check the translation progress of the original audio to determine whether there is any original audio that has not been translated.

[0048] S332: If there is untranslated audio, calculate the target translated audio generation time according to the estimated playback time of the audio segment.

[0049] S333: Convert the original audio segments into target translation texts in sequence according to the target translation audio generation time.

[0050] Specifically, in the process of translating the original audio in the video, the video player will check the translation progress of the original audio to determine whether there are any original audio segments that have not been translated. If there are any untranslated audios, the target translation audio generation time will be calculated based on the estimated playback time of the audio segment, and the original audio segments will be converted into target translation texts in sequence based on the target translation audio generation time.

[0051] Exemplarily, the video is divided into several original audio segments, and the audio is translated according to the playback time of the audio, wherein the target translated audio generation time is the time required for translating the next original audio segment, that is, the video player divides the original audio into several original audio segments according to the time required for translating each audio segment, and the playback time of the original audio segment is the time for translating the next original audio segment, and each original audio segment is translated in turn according to the playback time of the target translated audio.

[0052] In this embodiment, by checking the translation progress of the original audio, it is determined whether there are any original audio segments that have not been translated. If there are any untranslated audios, the target translation audio generation time is calculated according to the estimated playback time of the audio segment. According to the target translation audio generation time, the original audio segments are converted into target translation texts in sequence, ensuring that each audio segment has sufficient time for translation and ensuring the smoothness of video playback.

[0053] In one embodiment, in step S50, i.e., after synthesizing the target translated audio, the original audio is replaced with the target translated audio for the video translation, and then the target translated audio and the video animation are merged to form the translated target video, ensuring that the user can watch it directly next time without having to translate it again.

[0054] The above-mentioned video translation method, device, computer equipment and storage medium extract the original audio and key frames in the video; determine whether the translated target translation audio has been stored in advance in the cloud based on the original audio and the key frames; if it is determined that the translated target translation audio has not been stored in advance, convert the original audio into a target translation text; extract the original audio features to synthesize the target translation audio based on the target translation text and the extracted original audio features, wherein the extracted original audio features include extracting the tone features of the original audio; and replace the original audio with the target translation audio. This application maximizes the shortening of the loading time after video translation by determining whether the target translation audio is stored in the cloud and translating it in segments, so as to improve the fluency of user video viewing.

[0055] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0056] In one embodiment, a video translation device is provided, which corresponds one-to-one to the video translation method in the above embodiment. Figure 3 As shown, the video translation device includes an audio extraction module, a judgment module, a first audio processing module, a second audio processing module and an audio output module. The functional modules are described in detail as follows: Audio extraction module, used to extract original audio and key frames in the video; A judgment module, based on the original audio and the key frame, determines whether the translated target audio has been stored in advance in the cloud; A first audio processing module, configured to convert the original audio into a target translation text if it is determined that the translated target translation audio is not stored in advance; Specifically, the present application provides a video player that extracts the original audio and part of the video key frame content in the video when the user plays the video, determines whether the content of the original audio has been translated in advance, and if it is determined that the translated target translation audio has not been stored in advance, converts the original audio segments into target translation text.

[0057] For example, a user uses the video player in this video to play an English version of a video. The video player will extract the original audio and some key frame content in the video in advance, determine whether the original audio has been translated into the target translation text in advance, and store the original audio in the cloud of the video player. If the original audio and some key frame content extracted in advance by the video player determine that the original audio has not been translated in advance, the original audio is segmented and converted into the target translation text. The target translation text is determined according to the target translation language, which is the language required by the user, such as Chinese, Japanese, Korean, French, etc.

[0058] In one embodiment, converting the original audio segments into target translation texts includes: converting the content segments of the original audio into target translation texts according to the content of the original audio and the target translation language, and performing semantic calibration on the target translation texts.

[0059] Specifically, it takes time to translate the audio in a video. If you have to wait for the translation to be completed before playing it, the loading time of the video will be too long, affecting the user's video viewing experience. Therefore, in this application, the original audio in the playing video and the target language to be translated are first obtained, and then the content of the original audio is segmented and converted into the target translation text, and the target translation text is semantically calibrated to ensure the accuracy of the translation content.

[0060] In this embodiment, by extracting the original audio and key frames in the video, it is determined whether the translated target translation audio has been stored in advance in the cloud based on the original audio and the key frames. If it is determined that the translated target translation audio has not been stored in advance, the original audio is segmented and converted into target translation text, and the translation text is semantically calibrated. While ensuring the accuracy of the translation, the video loading time is also reduced, thereby improving the user's viewing experience.

[0061] A second audio processing module extracts the original audio features to synthesize a target translation audio according to the target translation text and the extracted original audio features, wherein the extracted original audio features include extracting tone features of the original audio; The audio output module replaces the original audio with the target translated audio.

[0062] Specifically, after obtaining the target translation text translated from the original audio, the audio features of the original audio are extracted, and the target translation audio is generated using audio synthesis technology according to the content of the target translation text and the extracted audio features, and the original audio is replaced with the generated target translation audio.

[0063] In this embodiment, the original audio features are extracted to synthesize the target translated audio according to the target translated text and the audio features, and the original audio is replaced with the target translated audio. Thus, when playing the video, the audio of the target translated language is played directly, and the speech content of the characters in the video can be understood without adding subtitles.

[0064] Optionally, the second audio processing module includes: Extracting audio features of the original audio, and analyzing the audio features of the original audio; The target translated audio having the same features as the original audio is generated according to the audio feature analysis result and the target translated text.

[0065] Specifically, in order to ensure the consistency of the target translation audio and the original audio sound, when generating the target translation audio, it is necessary to extract the sound features of the original audio and analyze the sound features of the original audio, including analyzing the sound timbre, sound frequency and other features of the original audio, and generate the target translation audio with the same features as the original audio based on the analysis results and the target translation text.

[0066] The specific definition of the video translation device can be found in the definition of the video translation method above, which will not be repeated here. The various modules in the above-mentioned video translation device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0067] In one embodiment, a computer device is provided. The computer device may be a cloud device, and its internal structure diagram may be as follows: Figure 4 As shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store the target translation audio replaced by the original audio. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a video translation method is implemented.

[0068] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the video translation method in the above embodiment is implemented, for example Figure 1 A schematic diagram of an application environment of the video translation method shown, or Figures 2 to 3 As shown in , to avoid repetition, it will not be described here. Alternatively, when the processor executes the computer program, the functions of each module / unit in this embodiment of the video translation device are realized, such as Figure 3 The functions of the video translation shown are not described here in detail to avoid repetition.

[0069] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the video translation method in the above embodiment is implemented. For example, Figure 1 A schematic diagram of an application environment of the video translation method shown, or Figures 2 to 3 Alternatively, when the computer program is executed by a processor, the functions of each module / unit in the above-mentioned video translation device are realized, for example, Figure 3 The functions of the video translation shown are not described here in detail to avoid repetition.

[0070] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0071] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0072] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. A video translation method, characterized in that: include: Extract the original audio and key frames from the video; According to the original audio and the key frame, determining whether the translated target audio has been stored in advance in the cloud; If it is determined that the translated target translation audio is not stored in advance, converting the original audio segment into the target translation text; The original audio features are extracted to synthesize a target translation audio according to the target translation text and the extracted original audio features, wherein the extracted original audio features include extracting tone features of the original audio.

2. The video translation method according to claim 1, characterized in that: Converting the original audio segment into a target translated text, comprising: Get the target translation language; According to the content of the original audio and the target translation language, the content of the original audio is converted into target translation text in segments, and semantic calibration is performed on the target translation text.

3. The video translation method according to claim 1, characterized in that: Converting the original audio segment into a target translated text, comprising: Segmenting the original audio to form a plurality of original audio segments; According to the playing time of the original audio segment, obtaining the estimated playing time of each audio segment in turn; According to the estimated playing time of each audio segment, the original audio segments are converted into target translation texts in sequence.

4. The video translation method according to claim 1, characterized in that: Extracting features of the original audio to synthesize a target translated audio according to the target translated text and the extracted audio features, comprising: Extracting audio features of the original audio, and analyzing the audio features of the original audio; The target translated audio having the same features as the original audio is generated according to the audio feature analysis result and the target translated text.

5. The video translation method according to claim 3, characterized in that: According to the estimated playing time of each audio segment, the original audio segments are converted into target translation texts in sequence, which includes: Checking the translation progress of the original audio to determine whether there is any original audio that has not been translated; If there is untranslated audio, calculate the target translated audio generation time based on the estimated playback time of the audio clip; The original audio segments are converted into target translated texts in sequence according to the target translated audio generation time.

6. The video translation method according to claim 1, characterized in that: Synthesize the target translated audio, then include: replacing the original audio with the target translated audio; The target translation audio and video animation are merged to form the translated target video.

7. A video translation device, characterized in that: Extracting features of the original audio, including: Audio extraction module, used to extract original audio and key frames in the video; A judgment module, based on the original audio and the key frame, determines whether the translated target audio has been stored in advance in the cloud; A first audio processing module, configured to convert the original audio into a target translation text if it is determined that the translated target translation audio is not stored in advance; A second audio processing module extracts the original audio features to synthesize a target translation audio according to the target translation text and the extracted original audio features, wherein the extracted original audio features include extracting tone features of the original audio; The audio output module replaces the original audio with the target translated audio.

8. The video translation device according to claim 7, characterized in that: The second audio processing module includes: Extracting audio features of the original audio, and analyzing the audio features of the original audio; The target translated audio having the same features as the original audio is generated according to the audio feature analysis result and the target translated text.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the video translation method according to any one of claims 1 to 6 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the video translation method according to any one of claims 1 to 6 is implemented.

Images