Data processing method and device, electronic equipment and storage medium

A data processing and audio data technology, applied in the field of simultaneous interpretation, can solve problems such as out-of-sync image and interpretation audio, inconsistent eyes and ears, poor experience, etc.

Active Publication Date: 2020-04-21
GUANGDONG OPPO MOBILE TELECOMM CORP LTD
View PDF13 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the related machine simultaneous interpretation system, when it is applied to the live video scene, the speech must be translated after the speaker finishes speaking, resulting in asynchronous image and interpretation audio. For users, the audio and video are not synchronized The rendering effect will give people a feeling of inconsistency between eyes and ears, and the experience is not good

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

[0045] figure 1 It is a schematic diagram of the system architecture applied to the simultaneous interpretation method in the related art; for example figure 1 As shown, the system may include: a machine simultaneous interpretation server, a terminal, an operating terminal, and a display screen. The terminal can be a mobile phone, a tablet computer, etc., and the terminal is held by the user; the operating terminal can be a personal computer (PC, Personal Computer), etc., and the PC can be a desktop computer, a notebook computer, a tablet computer, etc.

[0046] In practical application, when the speaker is giving a conference speech, the operator collects the video stream of the speaker, and sends the collected video stream to the machine simultaneous interpretation server, and the machine simultaneous interpretation server processe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data processing method and device, electronic equipment and a storage medium. The method comprises the following steps: collecting a video stream, and extracting audio data and video data from the video stream; segmenting the audio data to obtain an audio segmentation result; performing voice processing on each voice segment in the audio segmentation result to obtain a recognition result segment corresponding to the corresponding voice segment; adding a recognition result fragment corresponding to each voice fragment in the at least one voice fragment to a video fragment corresponding to the corresponding voice fragment determined from the video data; combining the at least one video clip added with the voice with the video clip corresponding tothe at least one mute clip to obtain a target video stream; wherein the video clip corresponding to the voice clip is used for presenting when the recognition result clip corresponding to the voice clip is played, and the video clip corresponding to the mute clip is used for presenting when the mute clip is played.

Description

technical field [0001] The invention relates to the field of simultaneous interpretation, in particular to a data processing method, device, electronic equipment and storage medium. Background technique [0002] With the continuous development and maturity of artificial intelligence (AI, Artificial Intelligence) technology, products that use artificial intelligence technology to solve common problems in life are emerging. Among them, machine simultaneous interpretation (also known as machine simultaneous interpretation, AI simultaneous interpretation, AI simultaneous interpretation) combines speech recognition (ASR, Automatic Speech Recognition), machine translation (MT, Machine Translation), speech synthesis (TTS, Text-To-Speech) and other technologies are widely used in conferences, talk shows and other scenarios, replacing or partially replacing manual labor to achieve simultaneous interpretation (SI, Simultaneous Interpretation). [0003] In the related machine simultan...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/43H04N21/439H04N21/44G10L15/00G10L15/04G10L15/26G06F40/58
CPCH04N21/4307H04N21/4394H04N21/44008G10L15/005G10L15/04G10L15/26
Inventor 宋阳
Owner GUANGDONG OPPO MOBILE TELECOMM CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap