Method for generating caption file through URL of an av platform

Pending Publication Date: 2022-02-10
NATIONAL CHIAO TUNG UNIVERSITY
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The present invention provides a method for generating caption files through the URL of an audio-video platform, which allows for effective captioning of video files in real-time. The method involves extracting a relevant audio-video file from the URL, downloading it, and abstracting the audio track to obtain an audio sample. This sample is then sent to a speech recognition system for processing to generate a caption file. The speech recognition system uses artificial neural networks for both phoneme recognition and sentence decoding. The technical effects of this invention include improved efficiency and accuracy in real-time captioning for audio-video files.

Problems solved by technology

This artificial method is not efficient and cannot form caption files in real time.
For users of audio-video platforms, it cannot achieve the effect of real-time assistance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for generating caption file through URL of an av platform
  • Method for generating caption file through URL of an av platform
  • Method for generating caption file through URL of an av platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015]FIG. 1 shows schematically a diagram for describing the whole system according to the present invention. A user 1 uses various websites (such as YouTube, Instagram, Facebook, Twitter) to input the URL of a desired AV website for downloading a desired AV file and then inputing to an ASR server 2 according to the present invention. A speech recognition system 3 in the ASR server 2 abstracts an audio file from the AV file for a system operation to obtain a desired caption file 4.

[0016]FIG. 2 show schematically the steps of the ASR server 2 for requesting and downloading an AV streaming according to the present invention. The ASR server 2 sends an HTTP request 7 to a web server 6 of an audio-video platform 5 to obtain an HTTP reply 8 of the web server 6. Then the ASR server 2 requests a media server 9 of the audio-video platform 5 for downloading an audio-video streaming 10.

[0017]FIG. 3 further describes the flow chart of the ASR server 2 according to the present invention. Descri...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method for generating caption file through URL of an AV platform. By using various websites (such as YouTube, Instagram, Facebook, Twitter) for being inputted with the URL of a desired AV Platform and downloading a required AV file and inputting to an ASR (Automatic Speech Recognition) server according to the present invention. A speech recognition system in the ASR server can abstract an audio file from the AV file for a system operation to get a required caption file. Artificial Neural Networks are used in the present invention.

Description

FIELD OF THE INVENTION[0001]The present invention relates to a method for generating caption file, and more particularly to a method for generating caption file through URL of an AV platform.BACKGROUND OF THE INVENTION[0002]The current method of audio-video (AV) platform for generating caption file is to listen to its audio directly in an artificial way, and then record it verbatim to form a caption file and play it with the video film.[0003]This artificial method is not efficient and cannot form caption files in real time. For users of audio-video platforms, it cannot achieve the effect of real-time assistance.[0004]Today AI (Artificial Intelligence) is commonly used. It is very convenient for users of the audio-video platform to apply AI methods (such as artificial neural networks) to the current audio-video platform to generate audio caption files.SUMMARY OF THE INVENTION[0005]The object of the present invention is to provide a method for generating caption file through URL of an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10L15/187H04L29/08H04L29/06G10L15/02G10L25/18G10L15/16G10L15/30G10L15/22G10L15/18
CPCG10L15/187H04L67/02H04L65/60G10L15/02G10L2015/025G10L15/16G10L15/30G10L15/22G10L15/1822G10L25/18H04L65/1089H04L65/612G10L15/26G10L15/04G10L15/18
InventorCHEN, SIN HORNGLIAO, YUAN FUWANG, YIH RUHWANG, SHAW HWAYAO, BING CHIHYEH, CHENG YUCHEN, YOU SHUOCHUNG, YAO HSINGHUANG, YEN CHUNHUANG, CHI JUNGSHEN, LI TEKU, NING YUN
OwnerNATIONAL CHIAO TUNG UNIVERSITY