Method for generating caption file through URL of an av platform

Pending Publication Date: 2022-02-10
NATIONAL CHIAO TUNG UNIVERSITY
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The present invention provides a method for generating caption files through the URL of an audio-video platform, which allows for effective captioning of video files in real-time. The method involves extracting a relevant audio-video file from the URL, downloading it, and abstracting the audio track to obtain an audio sample. This sample is then sent to a speech recognition system for processing to generate a caption file. The speech recognition system uses artificial neural networks for both phoneme recognition and sentence decoding. The technical effects of this invention include improved efficiency and accuracy in real-time captioning for audio-video files.

Problems solved by technology

This artificial method is not efficient and cannot form caption files in real time.
For users of audio-video platforms, it cannot achieve the effect of real-time assistance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for generating caption file through URL of an av platform
  • Method for generating caption file through URL of an av platform
  • Method for generating caption file through URL of an av platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015]FIG. 1 shows schematically a diagram for describing the whole system according to the present invention. A user 1 uses various websites (such as YouTube, Instagram, Facebook, Twitter) to input the URL of a desired AV website for downloading a desired AV file and then inputing to an ASR server 2 according to the present invention. A speech recognition system 3 in the ASR server 2 abstracts an audio file from the AV file for a system operation to obtain a desired caption file 4.

[0016]FIG. 2 show schematically the steps of the ASR server 2 for requesting and downloading an AV streaming according to the present invention. The ASR server 2 sends an HTTP request 7 to a web server 6 of an audio-video platform 5 to obtain an HTTP reply 8 of the web server 6. Then the ASR server 2 requests a media server 9 of the audio-video platform 5 for downloading an audio-video streaming 10.

[0017]FIG. 3 further describes the flow chart of the ASR server 2 according to the present invention. Descri...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a method for generating caption file through URL of an AV platform. By using various websites (such as YouTube, Instagram, Facebook, Twitter) for being inputted with the URL of a desired AV Platform and downloading a required AV file and inputting to an ASR (Automatic Speech Recognition) server according to the present invention. A speech recognition system in the ASR server can abstract an audio file from the AV file for a system operation to get a required caption file. Artificial Neural Networks are used in the present invention.

Description

FIELD OF THE INVENTION[0001]The present invention relates to a method for generating caption file, and more particularly to a method for generating caption file through URL of an AV platform.BACKGROUND OF THE INVENTION[0002]The current method of audio-video (AV) platform for generating caption file is to listen to its audio directly in an artificial way, and then record it verbatim to form a caption file and play it with the video film.[0003]This artificial method is not efficient and cannot form caption files in real time. For users of audio-video platforms, it cannot achieve the effect of real-time assistance.[0004]Today AI (Artificial Intelligence) is commonly used. It is very convenient for users of the audio-video platform to apply AI methods (such as artificial neural networks) to the current audio-video platform to generate audio caption files.SUMMARY OF THE INVENTION[0005]The object of the present invention is to provide a method for generating caption file through URL of an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/187H04L29/08H04L29/06G10L15/02G10L25/18G10L15/16G10L15/30G10L15/22G10L15/18
CPCG10L15/187H04L67/02H04L65/60G10L15/02G10L2015/025G10L15/16G10L15/30G10L15/22G10L15/1822G10L25/18H04L65/1089H04L65/612G10L15/26G10L15/04G10L15/18
Inventor CHEN, SIN HORNGLIAO, YUAN FUWANG, YIH RUHWANG, SHAW HWAYAO, BING CHIHYEH, CHENG YUCHEN, YOU SHUOCHUNG, YAO HSINGHUANG, YEN CHUNHUANG, CHI JUNGSHEN, LI TEKU, NING YUN
Owner NATIONAL CHIAO TUNG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products