Audio processing method and device for Android system, control panel and medium

Abstract

The application relates to the technical field of audio processing, and discloses an audio processing method for an Android system, which comprises the following steps: a HAL application performs audio synchronization processing on original audio data of a driver layer associated with the HAL application to generate synchronized audio data; the HAL application performs audio analysis on the synchronized audio data to generate different types of sound source data; the HAL application delivers the different types of sound source data to a Framework framework layer, so that the framework layer stores the different types of sound source data; and an application layer associated with the framework layer calls the different types of sound source data from the framework layer according to application requirements. The method can improve the response efficiency of different types of functions of an intelligent switch panel. The application further discloses an audio processing device for the Android system, a control panel and a medium.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of audio processing, for example, to an audio processing method and device for an Android system, a control panel and a medium. BACKGROUND

[0002] At present, with the development of science and technology, intelligent switch panels and intelligent sound boxes have been recognized by consumers. Taking an intelligent switch panel as an example, the intelligent switch panel is installed with an Android system. The Android system is configured with different types of functions such as voice recognition function and distributed wake-up function.

[0003] In the case that the intelligent switch panel has different types of functions such as voice recognition function and distributed wake-up function, the audio hardware resources are independently occupied by the voice recognition function or the distributed wake-up function at the same time. As a result, the user cannot use the voice recognition function and the distributed wake-up function at the same time.

[0004] In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related art:

[0005] Since the voice recognition and distributed wake-up functions of the intelligent switch panel independently occupy the audio hardware resources, there is a defect of conflict of audio hardware resources, which affects the response efficiency. SUMMARY

[0006] To have a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not a general review, nor is it intended to determine key / important components or delineate the scope of protection of these embodiments, but as a prelude to the detailed description below.

[0007] The embodiments of the present disclosure provide an audio processing method and device for an Android system, a control panel and a medium, to avoid conflict in the use of audio hardware resources and improve the response efficiency of different types of functions of the intelligent switch panel.

[0008] In some embodiments, the method comprises: a HAL application performing audio synchronization processing on original audio data of a driver layer associated with the HAL application to generate synchronized audio data; the HAL application performing audio analysis on the synchronized audio data to generate different types of sound source data; the HAL application delivering the different types of sound source data to a Framework framework layer, so that the framework layer stores the different types of sound source data; and an application layer associated with the framework layer calling the different types of sound source data from the framework layer according to application requirements.

[0009] In some embodiments, the terminal device comprises: a driver layer configured to generate raw audio data; a HAL layer configured with a HAL application configured to perform audio synchronization processing on the raw audio data to generate synchronized audio data and perform audio analysis on the synchronized audio data to generate different types of sound source data, and transmit the different types of sound source data to a framework layer; the framework layer is configured to store the different types of sound source data; and an application layer configured to call the different types of sound source data from the framework layer according to application requirements.

[0010] In some embodiments, the device comprises a processor and a memory storing program instructions, the processor is configured to execute the audio processing method for the Android system as described above when running the program instructions.

[0011] In some embodiments, the terminal device comprises the audio processing device for the Android system as described above.

[0012] In some embodiments, the storage medium stores program instructions, which, when executed, perform the audio processing method for the Android system as described above.

[0013] The audio processing method, device, control panel and medium for the Android system provided by the embodiments of the present disclosure can achieve the following technical effects:

[0014] The HAL application performs audio synchronization processing on the raw audio data to realize synchronization of sound sources. The HAL application performs audio analysis on the synchronized audio data and generates different types of sound source data to realize audio processing and distribution of the synchronized sound sources. The different types of sound source data are transmitted to the framework layer for reasonable storage of the different types of sound source data. Finally, the application layer can call corresponding sound source data from the framework layer according to specific application requirements to realize corresponding application business processing. Since each type of sound source data independently occupies hardware resources, conflicts in the use of audio hardware resources are effectively avoided, thereby improving the response efficiency of different types of functions of the intelligent switch panel.

[0015] The general description above and the following description below are exemplary and explanatory only and are not intended to be limiting of the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0016] One or more embodiments are illustrated by way of example with reference to the accompanying drawings, which are schematic and not intended to be limiting of the embodiments, and in which like reference numerals designate similar elements, the drawings are not necessarily to scale and wherein:

[0017] Figure 1is an architecture diagram of an Android system;

[0018] Figure 2 is a schematic diagram of an audio processing method for an Android system provided by an embodiment of the present disclosure;

[0019] Figure 3 is a schematic diagram of another audio processing method for an Android system provided by an embodiment of the present disclosure;

[0020] Figure 4 is a schematic diagram of another audio processing method for an Android system provided by an embodiment of the present disclosure;

[0021] Figure 5 is a schematic diagram of another audio processing method for an Android system provided by an embodiment of the present disclosure;

[0022] Figure 6 is a schematic diagram of another audio processing method for an Android system provided by an embodiment of the present disclosure;

[0023] Figure 7 is a schematic diagram of another audio processing method for an Android system provided by an embodiment of the present disclosure;

[0024] Figure 8 is a schematic diagram of an audio processing device for an Android system provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] In order to enable a person skilled in the art to more fully understand the features and technical contents of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, which are used only for reference and are not intended to limit the embodiments of the present disclosure. In the following technical description, in order to facilitate explanation, a plurality of details are provided to provide a full understanding of the disclosed embodiments. However, one or more embodiments can still be implemented without these details. In other cases, in order to simplify the drawings, well-known structures and devices can be simplified.

[0026] The terms "first", "second", and the like in the specification and claims of the embodiments of the present disclosure and the above drawings are used to distinguish similar objects, and do not necessarily have to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion.

[0027] Unless otherwise specified, the term "a plurality of" means two or more.

[0028] In the embodiments of the present disclosure, the character " / " represents an "or" relationship between the preceding and following objects. For example, A / B represents: A or B.

[0029] The term "and / or" is a description of the association relationship of the objects, which means that there can be three relationships. For example, A and / or B means: A or B, or, A and B, three relationships.

[0030] The term "corresponding" can refer to an association relationship or a binding relationship. A and B correspond to each other means that A and B have an association relationship or a binding relationship.

[0031] In the embodiments of the present disclosure, the smart home appliance refers to a home appliance product formed after introducing microprocessors, sensor technology, network communication technology into home appliances, having the characteristics of intelligent control, intelligent sensing and intelligent application. The operation process of the smart home appliance often depends on the application and processing of modern technologies such as the Internet of Things, the Internet and electronic chips. For example, the smart home appliance can realize remote control and management of the smart home appliance by connecting electronic devices.

[0032] In the embodiments of the present disclosure, the terminal device refers to an electronic device with wireless connection function. The terminal device can be connected to the smart home appliance as described above through the Internet, or can be directly connected to the smart home appliance as described above through Bluetooth, Wi-Fi and the like. In some embodiments, the terminal device is, for example, a mobile device, a computer, or a built-in vehicle device in a hovercar, or any combination thereof. The mobile device may, for example, include a mobile phone, a smart home device, a wearable device, a smart mobile device, a virtual reality device, or any combination thereof, wherein the wearable device may, for example, include a smart watch, a smart bracelet, a pedometer, and the like.

[0033] In combination Figure 1 As shown in the figure, the present disclosure provides an architecture diagram of an Android system, which includes a driver layer, a HAL (Hardware Abstraction Layer), a Framework framework layer (hereinafter referred to as a framework layer), and an application layer. The driver layer is configured with a first sound card and a second sound card. The first sound card stores a first original audio and a second original audio. The second sound card stores a first resampled audio and a second resampled audio. The HAL layer is configured with a HAL application, an audio processing module, and an audio interface. The HAL application can obtain the corresponding audio from the first sound card and the second sound card through the audio interface. The framework layer is configured with a memory, which is used to store different types of audio source data transmitted by the HAL application. The application layer includes a plurality of application programs. The application program can be an audio / video application, a speech recognition application, a distributed wake-up application, or a third-party application. The application program is specifically a local application configured by a control panel at the factory, or can be a third-party application obtained by the control panel through a server or a terminal device.

[0034] The Android system described above adds an audio processing module and an audio interface on the HAL layer to realize the processing and distribution of the synchronized sound source, and realizes the independent storage of different types of sound source data through the framework layer. The different types of sound source data each occupy hardware resources, effectively improving the processing rate of audio data.

[0035] Based on the Android system architecture described above, in combination with Figure 2 As shown in the figure, the embodiment of the present disclosure provides an audio processing method for an Android system, comprising:

[0036] S01, the HAL application performs audio synchronization processing on the original audio data of the driver layer associated with the HAL application to generate synchronized audio data.

[0037] S02, the HAL application performs audio analysis on the synchronized audio data to generate different types of sound source data.

[0038] S03, the HAL application transmits the different types of sound source data to the Framework framework layer, so that the framework layer stores the different types of sound source data.

[0039] S04, the application layer associated with the framework layer calls different types of sound source data from the framework layer according to application requirements.

[0040] In this step, the application layer configures multiple application programs. Different application programs have different application requirements. Specifically, the application layer can determine the application requirements according to the application programs configured by the application layer.

[0041] The audio processing method for the Android system provided by the embodiment of the present disclosure is adopted. The HAL application performs audio synchronization processing on the original audio data to realize the synchronization of the sound source. Then the HAL application performs audio analysis on the synchronized audio data and generates different types of sound source data to realize the audio processing and distribution of the synchronized sound source. Then the different types of sound source data are transmitted to the framework layer for reasonable storage of each type of sound source data. Finally, the application layer can call the corresponding sound source data from the framework layer according to the specific application requirements to realize the corresponding application business processing. Since each type of sound source data independently occupies hardware resources, conflicts in the use of audio hardware resources can be effectively avoided, thereby improving the response efficiency of different types of functions of the intelligent switch panel.

[0042] Optionally, in combination with Figure 3As shown, the original audio data includes the first original audio and the second original audio stored in the first sound card, and the first back-sampling audio and the second back-sampling audio stored in the second sound card. The HAL application performs audio synchronization processing on the original audio data of the driving layer associated with the HAL application to generate synchronized audio data, including:

[0043] S11, the HAL application sends a control instruction to the driving layer associated with the HAL application to control the first sound card and the second sound card to be synchronously turned on.

[0044] In this step, the HAL application sends a control instruction to the driving layer associated with the HAL application, which can be sent to the driving layer through the audio interface configured by the HAL layer.

[0045] S12, the HAL application performs audio synchronization processing on the audio stored in the first sound card and the audio stored in the second sound card to obtain synchronized audio data.

[0046] In this way, after the HAL application sends a control instruction to the driving layer, the synchronous opening of the two sound cards can be realized. And through the subsequent audio synchronization processing step, the synchronized audio data related to the original audio data is obtained.

[0047] Optionally, in combination with Figure 4 As shown, the HAL application performs audio analysis on the original audio data to generate different types of sound source data, including:

[0048] S21, the HAL application delivers the synchronized audio data to the audio processing module.

[0049] The audio processing module can be an SDK (Software Development Kit). The SDK has noise reduction functions such as echo cancellation, data compression functions, and data sampling functions. Since the audio obtained through the first sound card and the second sound card is usually affected or interfered by environmental noise and speaker playback sound, the corresponding noise reduction or data compression is performed through the audio processing module, so as to obtain relatively pure audio data.

[0050] S22, the audio processing module performs noise reduction processing on the synchronized audio data to generate first target audio, second target audio, and target back-sampling audio associated with the synchronized audio data.

[0051] In this step, the first target audio represents the audio data generated by performing noise reduction processing on the first original audio. The second target audio represents the audio data generated by performing noise reduction processing on the second original audio. The target back-sampling audio represents the audio data generated by performing noise reduction processing on the first back-sampling audio.

[0052] S23, the audio processing module performs data compression processing on the first target audio and the second target audio respectively, and then performs sampling processing on the data generated by the data compression to generate single-channel data.

[0053] In this step, the sampling rate and sampling accuracy during sampling processing can be pre-set. For example, the sampling rate can be 16KHz, and the sampling accuracy can be 16bit. In this way, mixed sampling of the first target audio and the second target audio double-channel data can be realized, and finally single-channel data is generated. As an example, the data amount of the single-channel data can be determined by the following formula:

[0054] ;

[0055] Wherein, the number of channels represents the sum of the number of channels of the data to be sampled. In the foregoing step, the number of channels is the sum of the number of channels of the first target audio and the second target audio, and the value is 2.

[0056] S24, the audio processing module transmits the target back-sampling audio and the single-channel data to the HAL application.

[0057] In this way, by performing noise reduction processing on the synchronous audio data, the first target audio, the second target audio and the target back-sampling audio corresponding to different target applications can be generated for subsequent target applications to call.

[0058] As an example, the first original audio and the second original audio are respectively the original audio collected by MIC1 and MIC2, and the first back-sampling audio and the second back-sampling audio are respectively the first road back-sampling audio of the speaker and the second road back-sampling audio of the speaker. The SDK performs noise reduction processing on the original audio collected by MIC1, MIC2, and the first back-sampling audio of the speaker respectively, to generate the corresponding first target audio AEC-MIC1, the second target audio AEC-MIC2 and the target back-sampling audio SBK-LB1.

[0059] The audio processing module further performs data compression processing on AEC-MIC1 and AEC-MIC2 respectively, and then performs sampling processing on the data generated by the data compression to generate single-channel data corresponding to AEC-MIC1 and AEC-MIC2. For example, the audio processing module performs data compression processing on AEC-MIC1 and AEC-MIC2 respectively, and then performs data sampling processing on the data generated by the compression processing at a sampling rate of 16KHz and a sampling accuracy of 16bit to generate single-channel data. Through the above method, the audio data obtained has convenient data storage and faster data transmission speed.

[0060] Optionally, in combination with Figure 5 As shown in the figure, the application layer associated with the framework layer calls different types of sound source data from the framework layer according to application requirements, including:

[0061] S31, the application layer associated with the framework layer obtains type information of the target application.

[0062] In this step, the target application can be a local application configured by the control panel at the factory, or a third-party application obtained through a server or a terminal device.

[0063] S32, the application layer determines target audio data corresponding to the type information according to the type information, and calls the target audio data from the framework layer for the target application to use the target audio data for service processing.

[0064] In this way, the audio data required by the target application is different when the type of the target application is different. Therefore, the application layer determines the type information of the target application, and determines the target audio data according to the type information, and then calls the target audio data from the framework layer, which effectively improves the response efficiency.

[0065] Optionally, in combination with Figure 6 As shown in the figure, the audio processing method for the Android system further includes: the HAL application transports the first raw audio and the second raw audio to the framework layer.

[0066] In this way, since some third-party applications have the demand to obtain raw audio, the HAL application further transports the first raw audio stored by the first sound card without being processed by the audio processing module and the second raw audio stored by the second sound card to the framework layer for the third-party application to call.

[0067] The application layer determines target audio data corresponding to the type information according to the type information, including:

[0068] S41, in the case where the type information indicates that the target application is a speech recognition application, determining single-channel data as the target audio data.

[0069] S42, in the case where the type information indicates that the target application is a third-party application, determining the first raw audio and the second raw audio as the target audio data.

[0070] S43, in the case where the type information indicates that the target application is a distributed wake-up application, determining the target back-sampling audio, the first raw audio, the first target audio, and the second target audio as the target audio data.

[0071] S44, in the case where the type information indicates that the target application is an audio-video call application, determining the first target audio, the second target audio, and the target back-sampling audio as the target audio data.

[0072] In this way, the target audio data matched with the target application can be called according to the type of the target application, thereby improving the response efficiency.

[0073] In combination Figure 7 As shown in the figure, the embodiment of the present disclosure further provides an audio processing method for an Android system, comprising:

[0074] S51, the HAL application performs audio synchronization processing on the original audio data of the driver layer associated with the HAL application to generate synchronized audio data.

[0075] S52, the HAL application performs audio analysis on the synchronized audio data to generate different types of sound source data.

[0076] S53, the HAL application delivers the different types of sound source data to the Framework framework layer, so that the framework layer stores the different types of sound source data.

[0077] S54, the framework layer encapsulates the different types of sound source data to provide the application layer with a calling interface corresponding to the different types of sound source data.

[0078] In this step, the framework layer can encapsulate the different types of sound source data through AudioFlinger and AudioManager.

[0079] S55, the application layer associated with the framework layer calls the different types of sound source data from the framework layer according to application requirements.

[0080] By using the audio processing method for the Android system provided by the embodiment of the present disclosure, the framework layer encapsulates the different types of sound source data, provides the application layer with a calling interface corresponding to the sound source data, and thus facilitates the calling of the sound source data by the application layer.

[0081] In actual application, in combination Figure 1 As shown in the figure, the framework layer performs AudioFlinger and AudioManager processing on the single-channel data and generates and stores AudioSource.VOICE_CALL, and this type of sound source data can be used for voice recognition applications.

[0082] The framework layer performs AudioFlinger and AudioManager processing on AEC-MIC1, the second target audio AEC-MIC2, and the target back-sampling audio SBK-LB1 and stores them, and this type of sound source data can be used for voice recognition applications.

[0083] The framework layer performs AudioFlinger and Audio Manager processing on the first target audio AEC-MIC1, the second target audio AEC-MIC2, the first original audio MIC1 and the target back audio SBK-LB1, and the type of the audio data can be used for distributed wake-up application. After the application layer obtains the first target audio AEC-MIC1, the second target audio AEC-MIC2, the first original audio MIC1 and the target back audio SBK-LB1, the smart home appliance associated with the application layer can perform voice wake-up and other services.

[0084] The framework layer stores the original audio and the second original audio, and the type of the audio data can be used for third-party application.

[0085] The disclosed embodiments also provide a control panel including a drive layer, a HAL layer, a framework layer and an application program. The drive layer is configured to generate original audio data. The HAL layer is configured with a HAL application, which is configured to perform audio synchronization processing on the original audio data to generate synchronized audio data, perform audio analysis on the synchronized audio data to generate different types of audio data, and deliver the different types of audio data to the framework layer. The framework layer is configured to store the different types of audio data. The application layer is configured to call the different types of audio data from the framework layer according to application requirements.

[0086] The control panel provided by the disclosed embodiments can effectively avoid conflicts caused by the use of audio hardware resources, thereby improving the response efficiency of different types of functions of the smart switch panel.

[0087] In combination with Figure 8 As shown in the figure, the disclosed embodiments provide an audio processing device for an Android system, which includes a processor 100 and a memory 101. Optionally, the device can also include a communication interface 102 and a bus 103. The processor 100, the communication interface 102 and the memory 101 can communicate with each other through the bus 103. The communication interface 102 can be used for information transmission. The processor 100 can call the logical instructions in the memory 101 to execute the audio processing method for the Android system of the above-mentioned embodiments.

[0088] In addition, the logical instructions in the memory 101 described above can be implemented in the form of a software functional unit and sold or used as an independent product, which can be stored in a computer readable storage medium.

[0089] The memory 101 can be used to store software programs, computer executable programs, such as program instructions / modules corresponding to the method in the embodiments of the present disclosure. The processor 100 executes the function application and data processing by running the program instructions / modules stored in the memory 101, that is, implements the audio processing method for the Android system in the above-mentioned embodiments.

[0090] The memory 101 can include a program storage area and a data storage area. The program storage area can store an operating system and at least one application required by a function. The data storage area can store data created according to the use of the terminal device. In addition, the memory 101 can include a high-speed random access memory, and can also include a non-volatile memory.

[0091] The embodiments of the present disclosure provide a control panel comprising the audio processing apparatus for the Android system.

[0092] The embodiments of the present disclosure provide a computer readable storage medium storing computer executable instructions, the computer executable instructions being configured to execute the audio processing method for the Android system.

[0093] The embodiments of the present disclosure provide a computer program product, the computer program product comprising a computer program stored on a computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, causing the computer to execute the audio processing method for the Android system.

[0094] The computer readable storage medium described above can be a transitory computer readable storage medium or a non-transitory computer readable storage medium.

[0095] The technical solutions of the embodiments of the present disclosure can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes one or more instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiments of the present disclosure. The aforementioned storage medium can be a non-transitory storage medium, including a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes, or a transitory storage medium.

[0096] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this application is for describing embodiments only and is not intended to limit the claims. As used in the description of embodiments and claims, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or” as used in this application means including one or more of the associated listed items and all possible combinations thereof. Additionally, when used in this application, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0097] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0098] In the embodiments disclosed herein, the disclosed methods, products (including but not limited to apparatuses, devices, etc.), can be implemented in other manners. For example, the apparatus embodiments described above are merely schematic. For example, the division of the units is merely logical function division. There can be other division manners in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, apparatuses, or units, and can be in electrical, mechanical, or other forms. The units described as separated components can or can not be physically separated, and components displayed as units can or can not be physical units. Some or all of the units can be selected according to actual needs to achieve the embodiments.

[0099] The flowcharts and block diagrams in the drawings show the possible implementation architectures, functions, and operations of the systems, methods, and computer program products according to the embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams can represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical functions. In some alternative implementations, the functions noted in the blocks can occur in different orders than those noted in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the drawings, the operations or steps corresponding to different blocks can also occur in different orders than those disclosed in the descriptions, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. Each block in the block diagrams and / or flowcharts, and the combination of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. An audio processing method for an Android system, the Android system comprising a driver layer, a HAL (Hardware Abstraction Layer), a Framework layer, and an application layer, characterized in that, The HAL hardware abstraction layer is configured with HAL application and audio processing modules, the driver layer is configured with a first sound card and a second sound card, and the method includes: The HAL application performs audio synchronization processing on the raw audio data of the driver layer associated with the HAL application to generate synchronized audio data; the raw audio data includes a first raw audio and a second raw audio stored in the first sound card, and a first re-sampled audio and a second re-sampled audio stored in the second sound card. The HAL application performs audio analysis on the synchronized audio data to generate different types of audio source data; The HAL application sends the different types of audio source data to the Framework layer so that the Framework layer can store the different types of audio source data. The framework layer encapsulates the different types of audio source data to provide the application layer with the corresponding calling interfaces for the different types of audio source data. The application layer associated with the framework layer calls the different types of audio source data from the framework layer according to application requirements; The HAL application performs audio analysis on the raw audio data to generate different types of sound source data, including: The HAL application transmits the synchronized audio data to the audio processing module; The audio processing module performs noise reduction processing on the synchronized audio data to generate a first target audio, a second target audio, and a target re-collected audio associated with the synchronized audio data; The audio processing module performs data compression processing on the first target audio and the second target audio respectively, and then samples the data generated by the data compression to generate single-channel data.

2. The method according to claim 1, characterized in that, The HAL application performs audio synchronization processing on the raw audio data of the driver layer associated with the HAL application to generate synchronized audio data, including: The HAL application sends control commands to the driver layer associated with the HAL application to control the first sound card and the second sound card to be turned on synchronously. The audio stored in the first sound card and the audio stored in the second sound card are subjected to audio synchronization processing to obtain synchronized audio data.

3. The method according to claim 2, characterized in that, The HAL application performs audio analysis on the raw audio data to generate different types of sound source data, and also includes: The audio processing module transmits the first target audio, the second target audio, the target re-acquired audio, and the single-channel data back to the HAL application.

4. The method according to claim 3, characterized in that, The application layer associated with the framework layer calls the different types of audio source data from the framework layer according to application requirements, including: The application layer associated with the framework layer obtains the type information of the target application; The application layer determines the target audio data corresponding to the type information based on the type information and calls the target audio data from the framework layer so that the target application can use the target audio data for business processing.

5. The method according to claim 4, characterized in that, Also includes: The HAL application delivers the first raw audio and the second raw audio to the frame layer; The application layer determines the target audio data corresponding to the type information based on the type information, including: If the type information indicates that the target application is a speech recognition application, then the single-channel data is determined to be the target audio data; If the type information indicates that the target application is a third-party application, then the first original audio and the second original audio are determined to be the target audio data; If the type information indicates that the target application is a distributed wake-up application, the target retrieval audio, the first original audio, the first target audio, and the second target audio are determined to be the target audio data. If the type information indicates that the target application is an audio / video call application, then the first target audio, the second target audio, and the target re-acquired audio are determined to be the target audio data.

6. A control panel, characterized in that, include: The driver layer is used to generate raw audio data and is configured with a first sound card and a second sound card. The HAL layer is configured with a HAL application and an audio processing module. The HAL application performs audio synchronization processing on the raw audio data to generate synchronized audio data, then performs audio analysis on the synchronized audio data to generate different types of sound source data, and sends the different types of sound source data to the Framework layer. The raw audio data includes a first raw audio and a second raw audio stored in the first sound card, and a first re-sampled audio and a second re-sampled audio stored in the second sound card. The audio analysis of the raw audio data to generate different types of sound source data includes: the HAL application sending the synchronized audio data to the audio processing module; the audio processing module performing noise reduction processing on the synchronized audio data to generate a first target audio, a second target audio, and a target re-sampled audio associated with the synchronized audio data; and the audio processing module performing data compression processing on the first target audio and the second target audio, and then sampling processing on the data generated by the data compression to generate single-channel data. The framework layer is used to store the different types of audio source data. The framework layer encapsulates the different types of audio source data to provide the application layer with the corresponding calling interfaces for the different types of audio source data. The application layer is used to call the different types of audio source data from the framework layer according to application requirements.

7. An audio processing device for an Android system, comprising a processor and a memory storing program instructions, characterized in that, The processor is configured to execute, when running the program instructions, the audio processing method for the Android system as described in any one of claims 1 to 5.

8. A control panel, characterized in that, Includes the audio processing device for the Android system as described in claim 7.

9. A storage medium storing program instructions, characterized in that, When the program instructions are executed, they perform the audio processing method for the Android system as described in any one of claims 1 to 5.

Images