IOS-based optional multi-audio-channel hardware mixing, acquisition and playing method

A technology of multi-audio and audio components, applied in the direction of selective content distribution, image communication, electrical components, etc., can solve the problems of efficiency consumption, system resource consumption, etc., to reduce sound quality loss, improve efficient execution, and increase battery life. Effect

Inactive Publication Date: 2018-06-29
安徽小马创意科技股份有限公司
View PDF7 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The object of the present invention is to provide the method based on IOS selectable multi-audio channel hardware mixing, collecting and playing, the original phoneme data PCM that all adopts when collecting, playing and mixing, the original phoneme data PCM is broadcasted to the server before the live release The data is transcoded into AAC to solve the problems of unnecessary system resource consumption and efficiency consumption brought about by multiple transcoding proposed in the above-mentioned background technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • IOS-based optional multi-audio-channel hardware mixing, acquisition and playing method
  • IOS-based optional multi-audio-channel hardware mixing, acquisition and playing method
  • IOS-based optional multi-audio-channel hardware mixing, acquisition and playing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] The method for selecting multi-audio channel hardware mixing, collecting and playing based on IOS comprises the following steps:

[0027] Step 1: Establish an audio collection and playback device interface: first create an AudioComponentInstance, that is, an audio component instance. The audio component instance must use the interface provided by the instance to call all audio devices in IOS; after the instance is initialized , associate the instance with the hardware device, and use the apiAudioUnitSetProperty provided by the system (the most important interface in the AudioComponentInstance audio component instance, which allows the user to configure the relevant parameters used by the associated hardware device in the audio component instance) to open the corresponding recording and playback ports , associate the recording and playback callback functions to collect and play sounds;

[0028] Step 2: Codec asynchronous processing queue: If the encoder speed and the acq...

Embodiment 2

[0034] Based on the description of Embodiment 1, the following specific workflow is provided:

[0035]Step 1: Host process:

[0036] see figure 1 , a. Data sent by the anchor to the mic-connector: the background music audio data and other branch data are transmitted to the mic-connecting mixer of the anchor through the audio collection device, converted into the ACC format by the mic-connecting transcoder of the anchor, and then transmitted by the network data The asynchronous send queue code is sent to all co-hosts;

[0037] see figure 2 , b. Anchor ear-return and broadcast data: The received audio data of the multi-channel mic receiver is sent to the ACC to the original phoneme transcoder, and combined with the anchor mic mixer, it is sent to the anchor network broadcast transcoder and the anchor link The mic transcoder, and then the asynchronous transmission queue code of the network data is sent to all the mics;

[0038] Step 2: Lianmai audience process:

[0039] see...

Embodiment 3

[0044] Based on the description of Embodiment 1 and Embodiment 2, combined with Xiaoma.com’s "Listen to Live", a video and voice live broadcast APP, the core of the APP uses the related technology of the present invention, and runs on all IOS platform iphones, the system Occupying resources and software operating efficiency are more efficient than similar software.

[0045] In summary: based on the IOS provided by the present invention, the method for optional multi-audio channel hardware mixing, collection and playback, the original phoneme data (PCM) that is used during collection, playback and mixing, will be released to the server before the live broadcast The original phoneme data is transcoded into AAC, which can solve the shortcomings of too large a volume and occupying traffic when the phoneme data is transmitted; when single-playing the ear loop and mixing, it does not need to process the original phoneme too much, which can reduce playback And the unnecessary system ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an IOS-based optional multi-audio-channel hardware mixing, acquisition and playing method, which comprises the following steps of establishing an audio acquisition and playingdevice interface, a codec asynchronous processing queue, an anchor microphone connection mixer, an anchor microphone connection encoder, a data network broadcasting module, a data asynchronous sendingqueue, an audio decoder and the like; a whole set of hardware processing mode is adopted and comprises audio hard transcoding, audio track hard mixing and original coding acquisition and processing of audios of input and output devices, the efficient execution of programs can be greatly improved through the hardware core processing, the sound quality loss of audio acquisition and playing is reduced, the system resource occupation is reduced, the standby time of a mobile phone is greatly prolonged, and the standby time of an IOS system can be effectively improved by about 40% after the test.

Description

technical field [0001] The invention relates to the technical field of audio processing, in particular to an IOS-based method for selecting multi-audio channel hardware mixing, collecting and playing. Background technique [0002] At present, the iOS system does not support the repeated connection of the same acquisition device or playback device in the same APP. The audio format of each AudioUnit in each AUGraph must be exactly the same. When different models of iPhones or different acquisition and playback devices are connected , the audio data will also have a great deviation, which requires the maximum classification of all the formats that will appear, causing the system to wait for the end of the transcoding during the transcoding process, causing the sound to not be played in time or freeze , and at the same time, unnecessary system resource consumption and efficiency consumption caused by multiple transcoding. Contents of the invention [0003] The object of the p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/233H04N21/439H04N21/81
CPCH04N21/2335H04N21/4398H04N21/8106H04N21/8113
Inventor 汪贵王彦迪
Owner 安徽小马创意科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products