Real-time audio processing method and device and intelligent terminal

Abstract

The application provides a real-time audio processing method and device and an intelligent terminal. The method comprises following steps: responding to audio processing operation triggered by a user on application program and designating an audio input device and an audio output device of an inner nuclear layer; determining sampling rate of the audio input device and the audio output device; controlling the audio input device to record audio data according to determined sampling rate; and outputting audio data to the audio output device and controlling the audio output device to output audio data according to determined sampling rate. The real-time audio processing method and device and the intelligent terminal have following beneficial effects: a cross-layer mode from an application layer to the inner nuclear layer helps reduce time delay from audio input to audio output; the application program of the intelligent terminal is triggered for processing audios in a real-time manner; data exchange with the application program is achieved so that better experience for application flexibility is provided; no additional equipment is needed so that using cost of a user is not increased; and using experience for low cost, higher application flexibility and high instantaneity is provided for the user.

Description

technical field [0001] The present application relates to the technical field of audio processing, in particular to a real-time audio processing method, device and intelligent terminal. Background technique [0002] With the rapid development and application of networks and smart terminals, users have higher and higher requirements for real-time audio processing on smart terminals. The existing technology has the following two audio processing methods: [0003] One way is to implement audio processing through the interaction between the Audio Flinger of the system framework layer and the PCM input and output devices of the application layer. Since the framework layer must support all hardware and software functions in the system, the complexity of its components is high, and the cache settings Large and non-adjustable, there will be a delay of about 200 milliseconds in audio processing. The delay in this method is too large to guarantee real-time performance. [0004] Anoth...

AI Technical Summary

Problems solved by technology

[0003] One way is to implement audio processing through the interaction between the Audio Flinger of the system framework layer and the PCM input and output devices of the application layer. Since the framework layer must support all hardware and software functions in the system, the complexity of its components is high, and the cache settings Large and non-adjustable, there will be a delay of about 200 milliseconds in audio processing. The delay in this method is too large to guarantee real-time performance

[0004] Another way is to realize audio processing by connecting the smart terminal with an external hardware device. Although this method can ensure the real-time performance of audio processing, it will increase the user's use cost on the one hand, and the use is not flexible enough. , because the external hardware device cannot perform data interaction with the APP of the smart terminal, it cannot support the audio processing needs of the user when using the APP, and the user basically only needs to perform audio processing when using the APP function. In addition, the user It is also necessary to perform other operations on the processed audio. For example, for the K-song APP, users need to mix their own singing voice with the music, display the lyrics synchronously on the terminal, and may also need to upload the song to the Internet to get netizens’ points like or rate etc.

Therefore, the existing audio processing methods cannot provide users with a low-cost, high application flexibility, and high real-time user experience

Images