A method, device, and terminal for visual audio playback and feedback

An audio and state technology, applied in video conferencing systems, two-way work systems, selective content distribution, etc., can solve problems such as low efficiency, inability to give feedback to users, lack of means to intuitively reflect the processing state of audio processing, etc., to achieve narrowing The effect of targeting range

Active Publication Date: 2022-02-01
SUIRUI TECH CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Since the audio processing of the system terminal lacks the means to intuitively reflect the processing status of each link of the audio, when the audio interaction is not smooth, if the person on the side cannot receive a response from the other party when speaking, it is usually necessary to ask the other party multiple times whether they can hear themselves, or use The third-party software communicates and judges the approximate problem. It cannot intuitively feed back the status of the key links of the local and remote terminal audio processing to the user, and the efficiency is very low.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method, device, and terminal for visual audio playback and feedback
  • A method, device, and terminal for visual audio playback and feedback

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] figure 1 It is a flow chart of the audio state visualization playback and feedback method according to the present invention, which will be referred to below figure 1 , the audio state visualization playing and feedback method of the present invention will be described in detail.

[0047] First, in step 101, sub-sampling is performed on the local audio collection samples to obtain resampling data of the local audio collection samples to form a resampling sequence sample of the local audio collection samples.

[0048] In the embodiment of the present invention, the sampling interval for re-sampling the audio samples collected at the local terminal is the length of the audio encoding frame, usually 20 ms, that is, one sample is drawn every 20 ms to form a resampling sequence sample.

[0049] In step 102, sub-sampling is performed on the playback samples of the local audio, and resampling data of the local audio playback samples are obtained to form a resampling sequence ...

Embodiment 2

[0064] In the embodiment of the present invention, there is also provided a device for audio status visualization and feedback, including a sub-sampling module 201, a curve drawing module 202, a video superimposition module 203, a packaging summary module 204, a feedback information sending and receiving module 205, and a solution Packet splitting module 206, wherein,

[0065] Resampling module 201, it carries out resampling to the collection sample of local audio frequency, obtains the resampling data of local audio collection sample, forms the resampling sequence sample of local collection audio frequency; It carries out resampling to the play sample of local audio frequency, Obtain the resampling data of the playback sample of the local audio, form the resampling sequence sample of the local playback audio; send the resampling sequence sample of the locally collected audio and the resampling sequence sample of the local playback audio to the curve drawing module 202 all the ...

Embodiment 3

[0074] In an embodiment of the present invention, a terminal is further provided, including the above-mentioned apparatus for visually playing and feedbacking the audio state, and implementing the steps of the above-mentioned method for visually playing and feedbacking the audio state.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An audio state visualization playback and feedback method, comprising the following steps: generating a resampling sequence sample of locally collected audio and a resampled sequence sample of locally played audio; drawing a locally collected audio curve bitmap and a locally played audio curve bitmap, and overlaying display in the local video frame; pack and send the resampling sequence sample of the local audio collection and the resampling sequence sample of the local playback audio; unpack and split the received remote feedback data packet to obtain the remote terminal's Collect audio resampling sequence samples and remote terminal playback audio resampling sequence samples; draw remote collected audio curve bitmap and remote playback audio curve bitmap, and superimpose them on the remote video frame for display. The present invention also provides a visual playback and feedback device for audio status, which can help users quickly understand the current status by visually feeding back the audio status of local and remote terminals to the user.

Description

technical field [0001] The invention relates to the technical field of multimedia conference systems, in particular to a method for playing and feedbacking audio states of terminals in the multimedia conference system. Background technique [0002] In the existing multimedia conferencing system or multimedia communication system, the audio processing of the system terminal includes: audio collection, audio coding, and audio transmission on the sending side, and reaches the receiving side through network transmission. The receiving side includes: audio receiving, audio decoding, Audio Player. Participants judge whether the current audio processing of each terminal is normal through the voice interaction. [0003] Since the audio processing of the system terminal lacks the means to intuitively reflect the processing status of each link of the audio, when the audio interaction is not smooth, if the person on the side cannot receive a response from the other party when speaking...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N7/15H04N21/439H04N21/431H04N21/81
CPCH04N7/15H04N21/439H04N21/4312H04N21/8106
Inventor 闫城辉冯文澜
Owner SUIRUI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap