Unlock instant, AI-driven research and patent intelligence for your innovation.

Voice recognition technology based on audio media analysis

A speech recognition and audio technology, applied in speech recognition, speech analysis, instruments, etc., can solve problems such as difficulty in expressing advanced semantic concepts

Pending Publication Date: 2022-03-04
SICHUAN UNIV
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the early studies focused on visual information, but these lower features are difficult to express high-level semantic concepts

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Voice recognition technology based on audio media analysis
  • Voice recognition technology based on audio media analysis
  • Voice recognition technology based on audio media analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The present invention will be further described in detail below in conjunction with examples, so that those skilled in the art can implement it with reference to the description.

[0045] It should be understood that terms such as "having", "comprising" and "including" as used herein do not exclude the presence or addition of one or more other networks or combinations thereof.

[0046] A method for recognizing voice in audio and video in this example, comprising the following steps:

[0047] 1) Extract audio data from video stream.

[0048] 2) Extract 13th-order MFCC, 13th-order first-order differential MFCC, zero-crossing rate, short-term energy and sub-band energy ratio:

[0049] Mel Frequency Cepstral Coefficients (MFCC):

[0050]

[0051] Zero-crossing rate (ZCR):

[0052]

[0053] Short-Term Energy (STE):

[0054] Subband Energy Ratio:

[0055] 3) Classify by SVM classifier:

[0056]

[0057] 4) Discrimination of silence by the double threshold d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a voice recognition technology based on audio media analysis, which is used for classifying and recognizing current audio and video information streams through audio feature extraction, heuristic rules and a voice recognition system. Audio features are extracted through 13-order MFCC, and classification is realized through SVM rules according to classification rules. And finally, performing recognition and output through a specific voice recognition engine.

Description

technical field [0001] The invention relates to the field of computer speech recognition, in particular to a method for recognizing speech in audio and video. Background technique [0002] Nowadays, with the rapid development of computer network and multimedia technology, there are more and more multimedia information. As the main multimedia, video plays an important role in our daily life. Content-based video retrieval has attracted more and more researchers' attention. Most of the early studies focused on visual information, but these lower features are difficult to express high-level semantic concepts. Therefore, multimodal-based video content analysis is a challenging research area. As an important part of video, audio can provide useful information for video content analysis. Audio can also provide important clues in certain areas such as news videos and sports videos. [0003] This invention introduces our audio content analysis framework to analyze video content ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10L15/22G10L15/02G10L25/21G10L25/24
CPCG10L15/22G10L15/02G10L25/24G10L25/21
Inventor 余城诚彭德中王骞刘杰张利君银大伟蒋瑞付俊英
Owner SICHUAN UNIV