Formant-frequency-based Mandarin single final vioce visualizing method

A formant and Mandarin technology, applied in the visualization of Mandarin Chinese single-final speech, based on formant frequency in the field of Chinese Mandarin single-final speech visualization, can solve problems such as difficult to achieve ideal effects, difficult to perceive speech, and single visual effect

Inactive Publication Date: 2011-09-07
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in terms of its speech intelligibility, it is still difficult to achieve the ideal effect. Except for a very small number of experts, it is difficult for people to perceive the speech accurately and effectively by directly observing the movement of the vocal organs.
In addition, the visual effect is relatively simple and the expressive power is not strong

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Formant-frequency-based Mandarin single final vioce visualizing method
  • Formant-frequency-based Mandarin single final vioce visualizing method
  • Formant-frequency-based Mandarin single final vioce visualizing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The technical solutions of the present invention will be further described below in conjunction with the drawings and embodiments.

[0047] Such as figure 1 As shown, it is a block diagram of the single vowel pronunciation visualization system in Mandarin Chinese, which is mainly divided into three blocks: feature extraction module, color generation module and visualization effect graphics generation module.

[0048] 1. Feature extraction module:

[0049] First, the speech signal is preprocessed by framing and windowing. Then directly extract the short-term energy, the first three formant frequencies, and the pitch frequency of each frame of speech signal, and then perform corresponding smoothing processing.

[0050] 1). Short-term energy of speech signal:

[0051] E m = Σ n = m m + N - ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a formant-frequency-based Mandarin single final voice visualizing method. The method comprises the following steps: framing and windowing an original voice signal; extracting short-time energy, formant frequency and fundamental tone frequency of each frame of signal; correcting errors of specific values of the formant frequency and the fundamental tone frequency by adopting a median smoothing method; mapping different pronunciations into different color aspects by utilizing the formant frequency, and correcting; reflecting variation tendency of pronunciation time, energy and fundamental tone frequency in an image; and differentiating different Mandarin single final pronunciations by colors. The method is easy to implement by only extracting acoustic phonetic parameters of short-time energy, formant frequency and fundamental tone frequency of a voice signal; soft decision is introduced, each pronunciation is not subject to hard decision, but represented by different colors, and visualizing effect of different speakers on the same pronunciation is based on the principle of seeking common grounds while reserving differences, so that the decision on pronunciation more accords with subjective perception of people.

Description

technical field [0001] The invention relates to a method for visualizing the speech of a single final in Mandarin Chinese, in particular to a method for visualizing the speech of a single final in Mandarin Chinese based on formant frequency, and belongs to the field of speech visualization. Background technique [0002] Speech is the sound that people make when they speak, and it is indispensable in people's daily life. But for the hearing-impaired, they cannot perceive speech through hearing, causing pain that normal people cannot understand. Studies have shown that in the process of people's perception of the outside world, the most information is acquired by vision, followed by hearing, and the combination of vision and hearing is more than any single sense of perception. In addition, experience tells us that charts are the most convenient and intuitive way for people to express their thoughts and understand things, so people also try to perceive speech visually, or use ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/06G10L21/14
Inventor 赵胜辉董欣玮王晶匡镜明
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap