Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Speech enhancement method and system fusing ultrasonic signal features

A speech enhancement and signal feature technology, applied in speech analysis, baseband systems, transmission systems, etc., to achieve reliable prediction results, accurate prediction results, and improve the effect of speech enhancement

Pending Publication Date: 2022-02-18
XI AN JIAOTONG UNIV
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, speech enhancement based on multimodality mainly utilizes two modalities, sound and vision, and visual information will be affected by lighting conditions, and requires the support of visual sensors, which will also bring privacy issues.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech enhancement method and system fusing ultrasonic signal features
  • Speech enhancement method and system fusing ultrasonic signal features
  • Speech enhancement method and system fusing ultrasonic signal features

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0054] In the description of the present invention, it should be understood that the terms "comprising" and "comprising" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or more other features, Presence or addition of wholes, steps, operations, elements, components and / or collections thereof.

[0055] It should also be understood that the terminology used in the descriptio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a speech enhancement method and system fusing ultrasonic signal features. The method comprises the steps: firstly predefining an ultrasonic signal, and then actively transmitting and receiving the ultrasonic signal through a loudspeaker and a microphone of a device; and performing channel estimation to obtain a channel impact response, and inputting the channel impact response to a neural network to realize speech enhancement, wherein the channel impact response reflects motion features of facial vocal organs when a user speaks, and the motion features serve as supplementary modal information of speech. According to the invention, the speech enhancement task is assisted by making full use of the user voice action characteristics, the speech enhancement effect is improved, and the method has wide application prospects.

Description

technical field [0001] The invention belongs to the technical field of sound processing, and in particular relates to a method and system for enhancing speech by fusing ultrasonic signal features. Background technique [0002] Speech will inevitably be interfered by the surrounding environment during transmission, which will seriously affect the quality of voice reception, resulting in the received signal is no longer the original pure voice signal, but with various interference noises Speech signal, which will reduce the quality and intelligibility of speech, affect the hearing of speech listeners and the accuracy of speech recognition, so it is necessary to reduce the impact of the environment through speech enhancement technology, and improve speech quality and intelligibility. [0003] Among various speech enhancement methods, speech enhancement based on deep neural network has attracted extensive attention of researchers because of its excellent effect. On the basis of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/0208G10L21/0264G10L21/0216G10L25/30H04L25/02
CPCG10L21/0208G10L21/0264G10L21/0216G10L25/30H04L25/0212H04L25/0224H04L25/0226
Inventor 丁菡王一展李昊赵衰王鸽惠维赵鲲赵季中王鹏董博
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com