Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multifunctional auxiliary audio-visual method and system

A multi-functional, audio-visual technology, used in speech analysis, speech recognition, instruments, etc., to solve problems such as the inability of hearing-impaired people to determine the direction of danger

Pending Publication Date: 2020-10-13
NAVAL AERONAUTICAL UNIV
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method and system for multifunctional audio-visual assistance, which solves the problem that the hearing-impaired person cannot judge the dangerous direction or hear the other party's conversation clearly

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multifunctional auxiliary audio-visual method and system
  • Multifunctional auxiliary audio-visual method and system
  • Multifunctional auxiliary audio-visual method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] Such as figure 1 As shown, a method for multifunctional audio-visual assistance disclosed by the present invention includes the following steps:

[0030] The first step is to obtain the first voice signal collected by the voice acquisition module in at least three audio-visual acquisition systems, and obtain the video signals collected by the video acquisition module of at least three audio-visual acquisition systems; the preferred high-sensitivity microphone of the voice acquisition module.

[0031] The second step is to obtain the second voice signal collected by the voice collection module in the audio-visual AR system;

[0032] The third step is to analyze the first voice signal and the second voice signal, and compare the proportion of the high-frequency components of the first voice signal with the preset threshold, which can be set by the user, generally 10% to 20%, to be analyzed result;

[0033] The fourth step is to process the first speech signal and the se...

Embodiment 2

[0042] Such as image 3 and Figure 4As shown, the present invention disclosed in the present invention also discloses a multifunctional auxiliary audio-visual system, including a central processing module, a power supply module, at least three audio-visual acquisition systems and an audio-visual AR system, and the audio-visual acquisition system includes a voice acquisition module and a video acquisition module The audio-visual AR system includes a voice acquisition module and an AR display module, the voice acquisition module and the AR display module are connected in communication with the central processing module, the battery module is connected to the central processing module, and at least three The audio-visual acquisition system and the audio-visual AR system are electrically connected respectively.

[0043] Among them, the central processing module can use STM32 series single-chip microcomputer, the voice collection module can use a microphone with high sensitivity,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multifunctional auxiliary audio-visual method which comprises the following steps: acquiring first voice signals acquired by voice acquisition modules in at least three audio-visual acquisition systems, and acquiring video signals acquired by video acquisition modules of the at least three audio-visual acquisition systems; acquiring a second voice signal acquired by a voice acquisition module in an audio-visual AR system; analyzing the first voice signal and the second voice signal, and comparing the high-frequency component ratio of the first voice signal with a preset threshold to obtain an analysis result; processing the first voice signal and the second voice signal according to the analysis result to obtain a processing result; and controlling an AR display module in the audio-visual AR system to display the processing result. According to the invention, the voice signals acquired by the voice acquisition modules are processed and a processing result is displayed through a sound source positioning and voice-text conversion technology, so that the problem that hearing impaired people cannot hear danger warning of a visual blind area or cannot talk withpeople is solved.

Description

technical field [0001] The invention relates to the field of augmented reality, in particular to a method and system for multifunctional audio-visual assistance. Background technique [0002] There are often many difficulties and dangers in the life of hearing-impaired people. For example, when talking with people or walking on the road with vehicles, there will be some troubles or dangers. The life difficulties brought about by hearing-impaired people are problems that need to be solved. [0003] With the advancement of science and technology, many high-tech products appear in our lives, and there are endless levels of products to solve hearing-impaired people, such as the hearing aids we often see now, but long-term wearing of hearing aids will bring serious burden to the ears, and Hearing aids often introduce some loud noises, which cannot allow the hearing-impaired person to judge the direction of danger or hear the other party's conversation clearly. It is an urgent pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10L15/26G10L21/028G10L25/57
CPCG10L21/028G10L25/57
Inventor 张龙杰孙涛王诚成邓博渊刘玄冰赵祖星刘厚君林衍刘子谦李浩杰
Owner NAVAL AERONAUTICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com