Audio processing method, apparatus, system, electronic device, and readable storage medium

CN117896652BActive Publication Date: 2026-10-30VIVO MOBILE COMM CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311636016.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-11-30
Publication Date
2026-10-30
Estimated Expiration
2043-11-30

AI Technical Summary

Benefits of technology

[0021]在本申请实施例中,基于处理器的负载信息,从处理器的第一处理模块和第二处理模块中确定出功耗低的处理模块作为目标处理模块,利用目标处理模块运行音频处理算法,来对处理器接收到的音频数字信号进行处理,从而得到音频文件,如此,利用低功耗的处理模块运行音频处理算法,可以降低音频处理算法运行时所占的功耗,进而降低电子设备的收音能耗,提升电子设备的续航时间。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117896652B_ABST
    Figure CN117896652B_ABST
Patent Text Reader

Abstract

The application discloses an audio processing method, device, system, electronic equipment and readable storage medium, and belongs to the field of audio processing. Load information of a processor is acquired; based on the load information, a target processing module with low power consumption is determined from a first processing module and a second processing module of the processor, the first processing module and the second processing module can both run an audio processing algorithm; the audio processing algorithm is run by using the target processing module to process an audio digital signal received by the processor to obtain an audio file.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the field of audio processing technology, specifically relating to an audio processing method, apparatus, system, electronic device, and storage medium. Background Technology

[0002] Battery life is a crucial component of user experience for electronic devices, with longer battery life leading to a better experience. To improve battery life, power consumption optimization can be performed on functional modules within the device. By reducing the energy consumption of these modules, the overall battery life can be extended. For electronic devices with recording and shooting functions, power consumption optimization is particularly important, as this is a high-frequency and high-power usage scenario.

[0003] Electronic devices typically record sound during video recording, which consumes energy. This energy consumption includes the inherent power consumption of hardware such as microphones and audio codecs in the audio processing system, as well as the power consumption of the audio processing algorithms running in the processor. Therefore, power optimization for video recording can reduce the power consumption of hardware like microphones and codecs, and also reduce the power consumption of the audio processing algorithms. However, reducing hardware power consumption often requires hardware replacement, which is costly. Therefore, reducing the power consumption of the audio processing algorithms can be used to reduce the energy consumption of sound recording. Consequently, there is an urgent need for an audio processing solution that can reduce the power consumption of the audio processing algorithms. Summary of the Invention

[0004] The purpose of this application is to provide an audio processing method, apparatus, system, electronic device, and storage medium that can reduce the power consumption of audio processing algorithms during operation, thereby reducing the energy consumption of problematic audio recordings.

[0005] In a first aspect, embodiments of this application provide an audio processing method, the method comprising:

[0006] Obtain processor load information;

[0007] Based on load information, a target processing module with low power consumption is determined from the first and second processing modules of the processor. Both the first and second processing modules are capable of running audio processing algorithms.

[0008] The target processing module runs an audio processing algorithm to process the digital audio signal received by the processor to obtain an audio file.

[0009] Secondly, embodiments of this application provide an audio processing device, including: a processor, the processor including a first processing module and a second processing module, both the first processing module and the second processing module being capable of running audio processing algorithms;

[0010] The processor is used to obtain processor load information;

[0011] The processor is also used to determine, based on load information, the target processing module with lower power consumption between the first processing module and the second processing module;

[0012] The processor is also used to run audio processing algorithms using the target processing module to process the digital audio signals received by the processor to obtain audio files.

[0013] Thirdly, embodiments of this application provide an audio processing system, including a microphone, an audio codec, and an audio processing apparatus of the second aspect;

[0014] A microphone is used to collect sound signals and convert them into audio electrical signals.

[0015] Audio codecs are used to convert audio electrical signals into audio digital signals;

[0016] An audio processing device is used to process digital audio signals to obtain audio files.

[0017] Fourthly, embodiments of this application provide an electronic device including a processor and a memory, the memory storing programs or instructions executable on the processor, the programs or instructions, when executed by the processor, implementing the steps of the method described in the first aspect.

[0018] Fifthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0019] In a sixth aspect, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0020] In a seventh aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.

[0021] In this embodiment, based on the processor's load information, a low-power processing module is determined from the processor's first and second processing modules as the target processing module. The target processing module is used to run an audio processing algorithm to process the audio digital signal received by the processor, thereby obtaining an audio file. In this way, by using a low-power processing module to run the audio processing algorithm, the power consumption of the audio processing algorithm can be reduced, thereby reducing the audio reception power consumption of the electronic device and improving the battery life of the electronic device. Attached Figure Description

[0022] Figure 1 This is a schematic diagram of the structure of an audio processing system provided in some embodiments of this application;

[0023] Figure 2 This is a schematic flowchart of an audio processing method provided in some embodiments of this application;

[0024] Figure 3 This is a schematic diagram of the radio reception process provided in some embodiments of this application;

[0025] Figure 4 This is a schematic diagram of an audio processing apparatus provided in some embodiments of this application;

[0026] Figure 5 These are block diagrams of electronic devices provided in some embodiments of this application;

[0027] Figure 6 These are schematic diagrams of the structure of electronic devices provided in some embodiments of this application. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0029] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0030] The audio processing method, apparatus, electronic device, and readable storage medium provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0031] The audio processing method provided in this application can be applied to recording and shooting scenarios of electronic devices, including but not limited to audio recording, video recording, and screen recording. The following is a combination of... Figures 1-6 The audio processing method provided in the embodiments of this application will be described in detail. It should be noted that the audio processing method provided in the embodiments of this application can be executed by an audio processing device. This application uses an audio processing device executing the audio processing method as an example to illustrate the audio processing method provided in the embodiments of this application.

[0032] See Figure 1 This is a schematic diagram of the structure of the audio processing system in the electronic device provided in the embodiments of this application, such as... Figure 1 As shown, the audio processing system 100 includes a microphone 110, an audio codec 120, and a processor 130. The microphone 110 is connected to the audio codec 120, and the audio codec 120 can be connected to the processor 130 via an audio transmission line (Soundwire).

[0033] The microphone 110 is used to receive sound signals in the recording and shooting scenarios of electronic devices, and then converts the sound signals into audio electrical signals through sound-to-electric conversion, and transmits the audio electrical signals to the audio codec 120.

[0034] After receiving the audio electrical signal transmitted by the microphone 110, the audio codec 120 samples the audio electrical signal, converts it into an audio digital signal, and then transmits the audio digital signal to the processor 130 for audio processing through the audio transmission line.

[0035] The processor 130 includes an audio transmission interface 1301, a first processing module 1302, and a second processing module 1303. The audio transmission interface 1301 receives audio digital signals transmitted by the audio codec 120. Both the first processing module 1302 and the second processing module 1303 can run audio processing algorithms to process the audio digital signals. After receiving the audio digital signals through the audio transmission interface 1301, the processor 130 can use either the first processing module 1302 or the second processing module 1303 to process the audio digital signals using the audio processing algorithms, thereby obtaining an audio file. The power consumption of the first processing module 1302 and the second processing module 1303 in running the audio processing algorithms is not fixed and is mainly affected by the load on the processor 130. That is, when the load on the processor 130 is different, the power consumption of the first processing module 1302 running the audio processing algorithms may be greater or less than that of the second processing module 1303 running the audio processing algorithms.

[0036] In some embodiments of this application, the first processing module 1302 may include an AP (apps process, multimedia application) processor, and the second processing module 1303 may include an audio signal processor (audio DSP, abbreviated as ADSP). The ADSP is a processor specifically designed for audio processing, running only audio processing algorithms related to audio processing. The processing power of the ADSP is related to its allocated bandwidth and is usually pre-configured; therefore, the power consumption of the ADSP when running audio processing algorithms is stable, typically a fixed value. The AP processor, on the other hand, is a common processor with stronger processing capabilities. Besides audio processing, it can perform other processing, including but not limited to video processing and image processing. The processing power of the AP processor increases with the operating frequency of the processor 130; therefore, the power consumption of the AP processor when running audio processing algorithms is not stable and is mainly affected by the clock speed of the processor 130. In scenarios with high load, the frequency of processor 130 will increase, which will also increase the power consumption of the AP processor, making the power consumption of the AP processor potentially greater than that of the ADSP. In scenarios with low load, the frequency of processor 130 will decrease, and the power consumption of the AP processor will decrease accordingly, making the power consumption of the AP processor potentially lower than that of the ADSP.

[0037] See Figure 2 This is a flowchart illustrating an audio processing method provided in an embodiment of this application. This method can be used to control, for example... Figure 1 The processor 130 shown performs audio processing. For example... Figure 2As shown, the audio processing method provided in this application embodiment may include the following steps S21-S23, which will be described in detail below.

[0038] S21. Obtain processor load information.

[0039] Here, processor load information can include information related to processor load, which can include the number of processes using or waiting to use the processor at a single point in time.

[0040] In some embodiments of this application, the processor may be a central processing unit (CPU) of an electronic device. The electronic device may have, for example, […]. Figure 1 The electronic devices used in the audio processing system shown may include, but are not limited to, smartphones, laptops, tablets, smart wearable devices, etc.

[0041] In some embodiments of this application, the electronic device can perform audio processing using the audio processing method provided in this application in recording and shooting scenarios where audio recording is required. The recording and shooting scenarios may include, but are not limited to, audio recording scenarios, video recording scenarios, and screen recording scenarios. Audio recording scenarios refer to scenarios where audio is recorded, video recording scenarios refer to scenarios where image content outside the electronic device is recorded, and screen recording scenarios refer to scenarios where image content displayed on the electronic device is recorded.

[0042] S22. Based on the load information, determine the target processing module with low power consumption from the first processing module and the second processing module of the processor. Both the first processing module and the second processing module are capable of running audio processing algorithms.

[0043] In some embodiments of this application, the processor includes a first processing module and a second processing module capable of running audio processing algorithms. The power consumption of the first and second processing modules during audio processing differs depending on the processor's load information. Therefore, in this embodiment, during audio processing, the power consumption relationship between the first and second processing modules can be determined based on the processor's load information. This allows for the identification of the processing module with lower power consumption, which is then selected as the target processing module for audio processing.

[0044] S23. Use the target processing module to run the audio processing algorithm to process the audio digital signal received by the processor to obtain an audio file.

[0045] Here, the audio digital signal received by the processor may include the audio digital signal received by the processor through the audio transmission interface provided therein.

[0046] In some embodiments of this application, see Figure 1 The audio digital signal received by the processor 130 may include the audio digital signal transmitted from the audio codec 120 received through the audio transmission interface 1301.

[0047] In some embodiments of this application, the audio processing algorithm is a relevant algorithm for performing audio processing. Using the audio processing algorithm to process audio digital signals yields an audio file. The audio processing algorithm can be pre-set by the user or developer according to actual needs and stored in a designated location. Based on this, after determining the target processing module, the processor can transmit the received audio digital signal to the target processing module, and then use the target processing module to run the audio processing algorithm at the designated location, thereby processing the audio data signal and obtaining the processed audio file.

[0048] The audio processing method provided in this embodiment determines the low-power processing module as the target processing module from the first and second processing modules of the processor based on the processor's load information. The target processing module is then used to run an audio processing algorithm to process the audio digital signal received by the processor, thereby obtaining an audio file. In this way, by using a low-power processing module to run the audio processing algorithm, the power consumption of the audio processing algorithm during operation can be reduced, thereby reducing the audio reception power consumption of the electronic device and improving the battery life of the electronic device.

[0049] In some embodiments of this application, the processor's load information may include first recording scene information of the electronic device where the processor is located, wherein the first recording scene information includes at least one of the following: audio recording scene information, video recording scene information, screen recording scene information, etc.

[0050] Here, recording scene information refers to relevant information of electronic devices in a recording scene. Recording scene information may include, but is not limited to, the screen status of electronic devices in a recording scene. The screen status can be divided into on screen and off screen.

[0051] Video recording scene information refers to relevant information of electronic devices in a recording scene. Video recording scene information may include, but is not limited to, recording frame rate, recording resolution, etc.

[0052] Screen recording scene information refers to relevant information about the electronic device in the screen recording scene. Screen recording scene information may include, but is not limited to, the screen recording object, which may include, but is not limited to, game applications, video applications, files, etc.

[0053] Accordingly, in step S22 above, determining the target processing module with low power consumption from the first and second processing modules of the processor based on load information may include:

[0054] Based on the pre-defined correspondence between recording scene information and low-power processing modules, a first low-power processing module corresponding to the first recording scene information is determined. The first low-power processing module is the processing module with lower power consumption among the first processing module and the second processing module in the recording scene corresponding to the first recording scene information.

[0055] The first low-power processing module is identified as the target processing module.

[0056] In some embodiments of this application, the first processing module can be a processing module whose power consumption dynamically changes with the processor load, while the second processing module can be a processing module with fixed and known power consumption. In different recording scenarios, the processor load varies; therefore, the power consumption of the first processing module also varies in different recording scenarios.

[0057] Based on this, the power consumption of the first processing module in various recording and shooting scenarios of the electronic device can be determined in advance. Then, the power consumption relationship between the first processing module and the second processing module in various recording and shooting scenarios can be determined. In this way, the low-power processing module in the first processing module and the second processing module can be determined in various recording and shooting scenarios. The low-power processing module is the processing module with low power consumption.

[0058] Furthermore, based on the low-power processing modules in each recording scenario, a correspondence is created between recording scenario information and low-power processing modules. Thus, when an electronic device records audio in a recording scenario, it can determine the low-power processing module corresponding to the recording scenario based on this correspondence, and use that low-power processing module as the target processing module for audio processing. In some embodiments of this application, after determining the correspondence between recording scenario information and low-power processing modules, the correspondence can be synchronized to the recording application in the electronic device. The recording application refers to an application in the electronic device related to the recording scenario and used in that scenario; for example, the recording application may include, but is not limited to, camera applications, recorder applications, screen recording applications, etc. Thus, when the electronic device uses the recording application to record in a recording scenario, it can determine the target processing module matching the recording scenario based on the correspondence between the recording scenario information and the low-power processing module in the recording application.

[0059] In some embodiments of this application, see Table 1, which shows the correspondence between scene recording information and low-power processing modules in an electronic device:

[0060] Table 1

[0061]

[0062] In the table above, the first row contains the recording scene information, and the second row contains the low-power processing module corresponding to the recording scene information. As shown in the table, when the recording scene of the electronic device includes audio recording scene information, and the screen state in the audio recording scene information is either on or off, the first processing module is a low-power processing module, meaning its power consumption is lower than that of the second processing module. When the recording scene of the electronic device includes screen recording scene information, and the screen recording object in the screen recording scene information is a game, the first processing module is a low-power processing module, meaning its power consumption is lower than that of the second processing module. When the recording scene of the electronic device includes video recording scene information, and the video recording resolution in the video recording scene information is 720P or 1080P, the first processing module is a low-power processing module, meaning its power consumption is lower than that of the second processing module. When the recording scene of the electronic device includes video recording scene information, and the video recording resolution in the video recording scene information is 4K or 8K, the second processing module is a power-efficient processing module, meaning its power consumption is lower than that of the first processing module.

[0063] In this way, when the processor in the electronic device is performing audio processing, it only needs to obtain the recording scene information of the electronic device to quickly determine the target processing module that matches the recording scene from the correspondence between the recording scene information and the low-power processing module. It is not necessary to determine the specific power consumption of the first processing module and the second processing module, which can effectively improve the processing efficiency.

[0064] In some embodiments of this application, the power consumption of the first processing module may be positively correlated with the processor's load rate, while the power consumption of the second processing module is a fixed value. Based on this, the processor load information obtained in step S21 above may include the processor's load rate.

[0065] Here, processor load rate refers to the percentage of time the processor is used to process tasks. Processor load rate can be obtained from the processor's operational information.

[0066] Accordingly, in step S22 above, determining the target processing module with low power consumption from the first and second processing modules of the processor based on load information may include the following steps:

[0067] The power consumption of the first processing module is determined based on the load rate;

[0068] The power consumption of the first processing module is compared with the power consumption of the second processing module;

[0069] The processing module with lower power consumption among the first and second processing modules is identified as the target processing module.

[0070] In some embodiments of this application, a mathematical relationship between the processor's load rate and the power consumption of the first processing module can be predetermined. Thus, after obtaining the processor's load rate, the power consumption of the first processing module can be calculated based on this mathematical relationship. The calculated power consumption of the first processing module is compared with the known power consumption of the second processing module to determine the processing module with lower power consumption. The processing module with lower power consumption is then identified as the target processing module.

[0071] By using the above method, the power consumption of the first processing module can be determined in real time based on the processor's load rate. Then, the target processing module can be adjusted in real time based on the power consumption of the first processing module. This makes the determined target processing module more accurate, thereby further reducing the power consumption of the audio processing algorithm during operation.

[0072] In some embodiments of this application, the first processing module may include a multimedia application processor, i.e., an AP processor, and the second processing module may include an audio processor (ADSP).

[0073] Therefore, once the audio digital signal enters the processor, it can be processed in the ADSP or in the AP processor.

[0074] In some embodiments of this application, when the processor load is low, such as in low-pixel, low-frame-rate recording scenarios or screen-off recording scenarios, the power consumption of the audio processing algorithm running in the AP processor is lower than that of the audio processing algorithm running in the ADSP. In this case, the AP processor can be used as the target processor, and the audio processing algorithm can be run on the AP processor to process the audio digital signal entering the processor to obtain an audio file. As the processor load increases and the processor's operating frequency increases, the power consumption of the audio processing algorithm running in the AP processor also gradually increases, and may even exceed the power consumption of the audio processing algorithm running in the ADSP. For example, in high-frame-rate, high-pixel recording scenarios, the power consumption of the audio processing algorithm running in the AP processor can exceed that of the audio processing algorithm running in the ADSP. In this case, the audio processing algorithm can be run on the ADSP processor to process the audio digital signal entering the processor to obtain an audio file. In some embodiments of this application, when the first processing module includes an AP processor and the second processing module includes an ADSP, after the audio digital signal is processed by the target processing module using an audio processing algorithm in step S13 to obtain an audio file, the following steps can also be performed:

[0075] The audio file is stored in the first processing module.

[0076] Saving audio files makes them easier to retrieve and use.

[0077] See Figure 3 In order to apply the audio processing method provided in the embodiments of this application to, for example, Figure 1 The audio processing system described herein is a flowchart of the audio processing process during sound reception, wherein the first processing module in the processor is an AP processor and the second processing module is an ADSP.

[0078] like Figure 3 As shown, the radio reception process may include the following steps:

[0079] S31. Acquire sound signals through a microphone and convert the sound signals into audio electrical signals;

[0080] S32. Convert audio electrical signals into audio digital signals using an audio codec;

[0081] S33. Obtain processor load information through the processor;

[0082] S34. The processor determines the target processing module with low power consumption from the first and second processing modules of the processor based on the load information;

[0083] S35. The audio processing algorithm is run through the target processing module to process the audio digital signal to obtain an audio file;

[0084] S36. The audio file is stored in the first processing module via the processor.

[0085] The audio processing method provided in this application can be executed by an audio processing device. This application uses an audio processing device to perform the audio processing method as an example to illustrate the audio processing device provided in this application.

[0086] See Figure 4 The above is a schematic diagram of an audio processing apparatus provided in some embodiments of this application, such as... Figure 4 The audio processing device 400 may include: a processor 410;

[0087] Processor 410 includes a first processing module 411 and a second processing module 412, both of which are capable of running audio processing algorithms.

[0088] Processor 410 is used to obtain processor load information;

[0089] The processor 410 is also used to determine the target processing module with low power consumption in the first processing module 411 and the second processing module 412 based on load information.

[0090] The processor 410 is also used to run an audio processing algorithm using the target processing module to process the audio digital signal received by the processor to obtain an audio file.

[0091] In this embodiment, based on the processor's load information, a low-power processing module is determined from the processor's first and second processing modules as the target processing module. The target processing module is used to run an audio processing algorithm to process the audio digital signal received by the processor, thereby obtaining an audio file. In this way, by using a low-power processing module to run the audio processing algorithm, the power consumption of the audio processing algorithm can be reduced, thereby reducing the audio reception power consumption of the electronic device and improving the battery life of the electronic device.

[0092] In some embodiments of this application, the load information of the processor 410 includes the first recording scene information of the electronic device where the processor 410 is located. The first recording scene information includes at least one of the following: audio recording scene information, video recording scene information, and screen recording scene information.

[0093] Processor 410 is also used for:

[0094] Based on the preset correspondence between the recording scene information and the low-power processing module, the first low-power processing module corresponding to the first recording scene information is determined. The first low-power processing module is the low-power processing module among the first processing module 411 and the second processing module 412 in the recording scene corresponding to the first recording scene information.

[0095] The first low-power processing module is identified as the target processing module.

[0096] In some embodiments of this application, the video recording scene information includes at least one of the following:

[0097] Recording frame rate and recording resolution.

[0098] In some embodiments of this application, the power consumption of the first processing module 411 is positively correlated with the load rate of the processor 410, while the power consumption of the second processing module 412 is a fixed value.

[0099] In some embodiments of this application, the load information of processor 410, including the load rate of processor 410, is further used by processor 410 to:

[0100] The power consumption of the first processing module 411 is determined based on the load rate;

[0101] The power consumption of the first processing module 411 is compared with the power consumption of the second processing module 412;

[0102] The processing module with lower power consumption in the first processing module 411 and the second processing module 412 is identified as the target processing module.

[0103] In some embodiments of this application, the first processing module 411 includes a multimedia application processor 410, and the second processing module 412 includes an audio processor 410.

[0104] In some embodiments of this application, the processor 410 is further configured to run an audio processing algorithm using the target processing module to process the audio digital signal received by the processor 410 to obtain an audio file, and then store the audio file in the first processing module 411.

[0105] The audio processing device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television set (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0106] The audio processing device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0107] The audio processing device provided in this application embodiment can achieve... Figures 1 to 3 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.

[0108] Based on the audio processing apparatus provided in the embodiments of this application, the embodiments of this application also provide an audio processing system, which may include a microphone, an audio codec, and the audio processing apparatus provided in the embodiments of this application;

[0109] The microphone is used to collect sound signals and convert them into audio electrical signals.

[0110] Audio codecs are used to convert audio electrical signals into audio digital signals;

[0111] An audio processing apparatus is used to process audio digital signals based on the audio processing method provided in the embodiments of this application to obtain an audio file.

[0112] Optionally, such as Figure 5 As shown, this application embodiment also provides an electronic device 500, including a processor 501 and a memory 502. The memory 502 stores a program or instructions that can run on the processor 501. When the program or instructions are executed by the processor 501, they implement the various steps of the above-described audio processing method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0113] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0114] Figure 6 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0115] The electronic device 600 includes, but is not limited to, components such as: radio frequency unit 601, network module 602, audio output unit 603, input unit 604, sensor 605, display unit 606, user input unit 607, interface unit 608, memory 609, and processor 610.

[0116] Those skilled in the art will understand that the electronic device 600 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 610 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 6 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0117] The processor 610 includes a first processing module and a second processing module, both of which are capable of running audio processing algorithms.

[0118] Processor 610 is used to obtain processor load information;

[0119] The processor 610 is also used to determine, based on load information, the target processing module with lower power consumption between the first processing module and the second processing module;

[0120] The processor 610 is also used to run an audio processing algorithm using the target processing module to process the audio digital signal received by the processor to obtain an audio file.

[0121] In this embodiment, based on the processor's load information, a low-power processing module is determined from the processor's first and second processing modules as the target processing module. The target processing module is used to run an audio processing algorithm to process the audio digital signal received by the processor, thereby obtaining an audio file. In this way, by using a low-power processing module to run the audio processing algorithm, the power consumption of the audio processing algorithm can be reduced, thereby reducing the audio reception power consumption of the electronic device and improving the battery life of the electronic device.

[0122] In some embodiments of this application, the load information of the processor 610 includes the first recording scene information of the electronic device where the processor 610 is located. The first recording scene information includes at least one of the following: audio recording scene information, video recording scene information, and screen recording scene information.

[0123] The processor 610 is also used for:

[0124] Based on the pre-defined correspondence between recording scene information and low-power processing modules, a first low-power processing module corresponding to the first recording scene information is determined. The first low-power processing module is the processing module with lower power consumption among the first processing module and the second processing module in the recording scene corresponding to the first recording scene information.

[0125] The first low-power processing module is identified as the target processing module.

[0126] In some embodiments of this application, the video recording scene information includes at least one of the following:

[0127] Recording frame rate and recording resolution.

[0128] In some embodiments of this application, the power consumption of the first processing module is positively correlated with the load rate of the processor 610, while the power consumption of the second processing module is a fixed value.

[0129] In some embodiments of this application, the load information of processor 610, including the load rate of processor 610, is further used by processor 610 to:

[0130] The power consumption of the first processing module is determined based on the load rate;

[0131] The power consumption of the first processing module is compared with the power consumption of the second processing module;

[0132] The processing module with lower power consumption among the first and second processing modules is identified as the target processing module.

[0133] In some embodiments of this application, the first processing module includes a multimedia application processor 610, and the second processing module includes an audio processor 610.

[0134] In some embodiments of this application, the processor 610 is further configured to run an audio processing algorithm using the target processing module, so as to process the audio digital signal received by the processor 610 to obtain an audio file, and then store the audio file in the first processing module.

[0135] It should be understood that, in this embodiment, the input unit 604 may include a graphics processing unit (GPU) 6041 and a microphone 6042. The GPU 6041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 606 may include a display panel 6061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 607 includes at least one of a touch panel 6071 and other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0136] The memory 609 can be used to store software programs and various data. The memory 609 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 609 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 609 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0137] Processor 610 may include one or more processing units; optionally, processor 610 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 610.

[0138] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described audio processing method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0139] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0140] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described audio processing method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0141] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0142] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the audio processing method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0143] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0144] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0145] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An audio processing method, characterized in that, The method includes: Obtain processor load information; Based on the load information, a target processing module with low power consumption is determined from the first processing module and the second processing module of the processor. Both the first processing module and the second processing module are capable of running audio processing algorithms. The target processing module is used to run an audio processing algorithm to process the audio digital signal received by the processor to obtain an audio file; The processor's load information includes the first recording scene information of the electronic device where the processor is located, and the first recording scene information includes at least one of the following: audio recording scene information, video recording scene information, and screen recording scene information; The step of determining the target processing module with low power consumption from the first and second processing modules of the processor based on the load information includes: Based on the preset correspondence between recording scene information and low-power processing modules, a first low-power processing module corresponding to the first recording scene information is determined. The first low-power processing module is the processing module with low power consumption among the first processing module and the second processing module in the recording scene corresponding to the first recording scene information. The first low-power processing module is identified as the target processing module; The power consumption of the first processing module is positively correlated with the load rate of the processor, while the power consumption of the second processing module is a fixed value.

2. The method according to claim 1, characterized in that, The video scene information includes at least one of the following: Recording frame rate and recording resolution.

3. The method according to claim 1, characterized in that, The processor's load information includes the processor's load rate. The step of determining a low-power target processing module from the processor's first and second processing modules based on the load information includes: The power consumption of the first processing module is determined based on the load rate; Compare the power consumption of the first processing module with the power consumption of the second processing module; The processing module with lower power consumption between the first processing module and the second processing module is identified as the target processing module.

4. The method according to any one of claims 1-3, characterized in that, The first processing module includes a multimedia application processor, and the second processing module includes an audio processor.

5. The method according to claim 4, characterized in that, After the method utilizes the target processing module to run an audio processing algorithm to process the audio digital signal received by the processor to obtain an audio file, the method further includes: The audio file is stored in the first processing module.

6. An audio processing apparatus, characterized in that, include: The processor includes a first processing module and a second processing module, both of which are capable of running audio processing algorithms. The processor is used to obtain the processor's load information; The processor is further configured to determine, based on the load information, a target processing module with low power consumption between the first processing module and the second processing module; The processor is further configured to run an audio processing algorithm using the target processing module to process the audio digital signal received by the processor to obtain an audio file; The processor's load information includes the first recording scene information of the electronic device where the processor is located, and the first recording scene information includes at least one of the following: audio recording scene information, video recording scene information, and screen recording scene information; The processor is also used for: Based on the preset correspondence between recording scene information and low-power processing modules, a first low-power processing module corresponding to the first recording scene information is determined. The first low-power processing module is the processing module with low power consumption among the first processing module and the second processing module in the recording scene corresponding to the first recording scene information. The first low-power processing module is identified as the target processing module; The power consumption of the first processing module is positively correlated with the load rate of the processor, while the power consumption of the second processing module is a fixed value.

7. The apparatus according to claim 6, characterized in that, The video scene information includes at least one of the following: Recording frame rate and recording resolution.

8. The apparatus according to claim 6, characterized in that, The processor's load information includes the processor's load rate, and the processor is further configured to: The power consumption of the first processing module is determined based on the load rate; Compare the power consumption of the first processing module with the power consumption of the second processing module; The processing module with lower power consumption between the first processing module and the second processing module is identified as the target processing module.

9. The apparatus according to any one of claims 6-8, characterized in that, The first processing module includes a multimedia application processor, and the second processing module includes an audio processor.

10. The apparatus according to claim 9, characterized in that, The processor is further configured to run an audio processing algorithm using the target processing module, so as to process the audio digital signal received by the processor to obtain an audio file, and then store the audio file in the first processing module.

11. An audio processing system, characterized in that, Includes a microphone, an audio codec, and the audio processing apparatus according to any one of claims 6-10; The microphone is used to collect sound signals and convert the sound signals into audio electrical signals; The audio codec is used to convert the audio electrical signal into an audio digital signal; The audio processing device is used to process the audio digital signal to obtain an audio file.

12. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the audio processing method as described in any one of claims 1-5.

13. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the audio processing method as described in any one of claims 1-5.

Citation Information

Patent Citations

  • Method and device for controlling processor and electronic equipment

    CN104142729A

  • Audio processing method and electronic equipment

    CN110876098A