Audio processing method and device and computer storage medium

By obtaining and adjusting the volume curve, the problem of sharing volume adjustment of audio functions is solved, personalized adjustment of the volume module is realized, adapting to the needs of different audio functions, and improving the accuracy of audio adjustment.

CN118921600APending Publication Date: 2024-11-08ZHEJIANG LEAPMOTOR TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410866591.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-06-28
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

In the prior art, the volume adjustment of the audio function is shared and cannot adapt to the personalized needs of different audio functions, resulting in insufficient volume adjustment.

Method used

By obtaining the volume curve of the current volume module, adjusting the volume component in the audio data, using the speaker to output the adjusted audio signal, dynamically adjusting the volume curve according to the ambient noise and the difference in the volume module, realizing personalized volume adjustment of different volume modules.

Benefits of technology

Different volume modules are implemented to adjust the volume according to the volume curve, adapt to the needs of different audio functions, and improve the accuracy and personalization of audio adjustment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118921600A_ABST
    Figure CN118921600A_ABST
Patent Text Reader

Abstract

The invention provides an audio processing method and device and a computer storage medium, and the method comprises the steps: obtaining a current volume module, and obtaining a corresponding volume curve based on the current volume module; adjusting a volume component in the first audio data according to the volume curve to obtain second audio data; and outputting an audio signal corresponding to the second audio data through a loudspeaker. Through the above mode, different volume modules adjust the volume component in the first audio data according to the volume curve, and when the audio is adjusted, the volume of the audio of different volume modules is adjusted according to the volume curve.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of audio processing, and in particular to an audio processing method, device and computer storage medium. Background Art

[0002] As audio functions become more and more abundant, different functions and different scenarios have more and more audio functions. Audio includes: navigation sound, intelligent voice, multimedia sound, intelligent broadcast sound, telephone sound, intelligent driving prompt sound, etc.

[0003] In the prior art, the volumes of different audio functions can be adjusted individually, but each function shares a unified volume curve, that is, the changes in the volume adjustment of each function are the same, which cannot adapt to the current situation where different audio functions have different playback requirements. Summary of the invention

[0004] The present application provides an audio processing method, device and computer storage medium.

[0005] To solve the above technical problems, the present application proposes an audio processing method, which includes: obtaining first audio data; obtaining a current volume module, and obtaining a corresponding volume curve based on the current volume module; adjusting the volume component in the first audio data according to the volume curve to obtain second audio data; and outputting an audio signal corresponding to the second audio data through a speaker.

[0006] The volume curve includes an adjustment amplitude and an output decibel value corresponding to each adjustment amplitude.

[0007] The volume curve includes a high volume curve, a standard volume curve and a low volume curve; wherein the slope of the high volume curve in a low adjustment amplitude range is greater than the slope of the standard volume curve in a low adjustment amplitude range, and the slope of the standard volume curve in a low adjustment amplitude range is greater than the slope of the low volume curve in a low adjustment amplitude range.

[0008] Among them, obtaining the corresponding volume curve based on the current volume module includes: obtaining the current ambient noise and the standard ambient noise; obtaining a first difference between the current ambient noise and the standard ambient noise; obtaining volume increments of each order of a preset volume curve of the current volume module; adjusting the volume increments of each order according to the first difference to obtain an adjusted volume curve of the current volume module.

[0009] Among them, adjusting the volume increments of each order according to the first difference includes: in response to the current ambient noise being greater than the standard ambient noise, obtaining a second difference between the maximum volume of the preset volume curve and the standard ambient noise, and using the ratio of the first difference to the second difference as an adjustment parameter; in response to the current ambient noise being less than the standard ambient noise, obtaining a third difference between the standard ambient noise and the minimum volume of the preset volume curve, and using the ratio of the first difference to the third difference as an adjustment parameter; and adjusting the volume increments of each order using the adjustment parameter.

[0010] The volume module includes a music volume module, a navigation volume module, a telephone volume module and / or a voice volume module.

[0011] The obtaining of the current volume module includes: classifying the first audio data into types to obtain the audio type of the first audio data; matching a target volume module with the highest correlation among all volume modules based on the audio type; and setting the target volume module to the current volume module.

[0012] Wherein, setting the target volume module as the current volume module includes: obtaining an initialization volume module of the vehicle-mounted system; obtaining a module difference value between the initialization volume module and the target volume module based on a volume curve of the initialization volume module and a volume curve of the target volume module; judging whether the module difference value is greater than a preset threshold; if so, setting the target volume module as the current volume module; if not, keeping the initialization volume module as the current volume module.

[0013] To solve the above technical problems, the present application proposes an audio processing device, which includes a processor and a memory; a computer program is stored in the memory, and the processor is used to execute the computer program to implement the steps of the above audio processing method.

[0014] In order to solve the above technical problem, the present application proposes a computer storage medium, wherein the computer storage medium stores a computer program, and when the computer program is executed, the steps of the above audio processing method are implemented.

[0015] Different from the prior art, the beneficial effects of the present application are: the audio processing device obtains the first audio data; obtains the current volume module, and obtains the corresponding volume curve based on the current volume module; adjusts the volume component in the first audio data according to the volume curve to obtain the second audio data; and outputs the audio signal corresponding to the second audio data through the speaker. In the above manner, different volume modules adjust the volume component in the first audio data according to the volume curve, and when adjusting the audio, the audio of the different volume modules adjusts the volume according to the volume curve. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 is a flowchart of a first embodiment of an audio processing method provided by the present application;

[0018] Figure 2 is a schematic diagram of an embodiment of an audio processing framework provided by the present application;

[0019] Figure 3 is a schematic diagram of a volume curve data table in the audio processing method provided by the present application;

[0020] Figure 4 is a schematic diagram of a volume curve in the audio processing method provided by the present application;

[0021] Figure 5 is the low volume curve data table provided by this application;

[0022] Figure 6 is a schematic diagram of a low volume curve provided by the present application;

[0023] Figure 7 is the low volume curve data table provided by this application;

[0024] Figure 8 is a schematic diagram of a high volume curve provided by the present application;

[0025] Fig. 9 is a flowchart of a second embodiment of the audio processing method provided by the present application;

[0026] Fig.10 is a flowchart of a third embodiment of the audio processing method provided by the present application;

[0027] Fig.11is a schematic diagram of another embodiment of the audio processing framework provided by the present application;

[0028] Fig.12 is a structural schematic diagram of an embodiment of an audio processing device provided by the present application;

[0029] Fig.13 It is a structural diagram of an embodiment of a computer storage medium provided by the present application. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0031] The audio processing method of the present application is applied to an audio processing device, wherein the audio processing device of the present application can be a server, or a system composed of a server and a local terminal. Accordingly, the various parts of the audio processing device, such as various units, sub-units, modules, and sub-modules, can all be set in the server, or can be set in the server and the local terminal respectively.

[0032] Furthermore, the above-mentioned server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules, such as software or software modules used to provide distributed servers, or it can be implemented as a single software or software module, which is not specifically limited here. In some possible implementations, the audio processing method of the embodiment of the present application can be implemented by a processor calling computer-readable instructions stored in a memory.

[0033] The audio processing method in the embodiments of the present application can be applied to vehicle-mounted systems, and can also be applied to theaters, cinemas, etc. The specific embodiments of the present application are described using the application to a vehicle-mounted system as an example, and the implementation methods for application to other scenarios are similar and will not be described in detail.

[0034] See also Figure 1 and Figure 2 , Figure 1 is a flowchart of a first embodiment of an audio processing method provided by the present application; Figure 2 It is a schematic diagram of an embodiment of the audio processing framework provided by the present application.

[0035] like Figure 1 As shown, the specific steps are as follows:

[0036] Step S11: Acquire first audio data.

[0037] Among them, in the embodiment of the present application, the audio data can come from the music APP, navigation APP, telephone audio channel, etc. The audio processing system of the present application runs a virtual machine in the QNX system, and boots the system in the virtual machine. The Android system in the system supports multiple audio channels in the freamwork layer, Hal layer, and TinyAlsa layer, and allocates respective audio channels for music, navigation, telephone, and voice. The music APP, navigation APP, telephone function, and voice function use their own audio channels.

[0038] See also Figure 2 In ADSP, different audio channels are allocated for music, navigation, telephone, and voice. In the audio channels with different functions, the corresponding volume modules are implemented to realize the functions of multi-function and multi-volume curve.

[0039] Step S12: Acquire the current volume module, and acquire the corresponding volume curve based on the current volume module.

[0040] In the embodiment of the present application, the volume module includes but is not limited to a music volume module, a navigation volume module, a phone volume module, a voice volume module, etc. Each volume module represents a different audio function, each audio function obtains a corresponding volume module in its own audio channel, and each volume module uses a different volume curve.

[0041] For example, a music volume module represents a music playing function, and the audio processing device obtains the music volume module through a music audio channel.

[0042] Step S13: adjusting the volume component in the first audio data according to the volume curve to obtain second audio data.

[0043] Specifically, the audio processing device adjusts the volume component in the first audio data according to the volume curve to obtain the second audio data.

[0044] Step S14: outputting the audio signal corresponding to the second audio data through the speaker.

[0045] In the application embodiment, audio data of different functions can be output through different speakers according to their respective audio channels.

[0046] The audio processing device obtains the current volume module, obtains the corresponding volume curve based on the current volume module; adjusts the volume component in the first audio data according to the volume curve to obtain the second audio data; and outputs the audio signal corresponding to the second audio data through the speaker. In the above manner, different volume modules adjust the volume component in the first audio data according to the volume curve, and when adjusting the audio, the audio of the different volume modules adjusts the volume according to the volume curve.

[0047] like Figure 3-Figure 4 As shown, Figure 3 is a schematic diagram of a volume curve data table in the audio processing method provided in this application, Figure 4 Schematic diagram of the volume curve in the audio processing method provided by this application. Figure 3 As shown, the volume curve includes an adjustment amplitude and an output decibel value corresponding to each adjustment amplitude.

[0048] Among them, different volume modules correspond to different volume curves, which means that different audio functions have different volume increase precisions and extreme values. When responding to audio adjustment instructions of the same amplitude, different volume modules output different decibel volume values ​​according to different audio curves.

[0049] The volume from 0% to 100% is divided into 20 granularity adjustments, so the volume values ​​represented by these 21 volume grids are connected to form a curve called the volume curve. For example, at 50% volume, the output volume decibel value of the music volume module is: 75db, the output volume decibel value of the phone volume module is: 63db, the output volume decibel value of the navigation volume module is: 75db, and the output volume decibel value of the voice volume module is: 59db.

[0050] In an embodiment of the present application, the setting of the volume curve can be continuously adjusted according to historical audio adjustment data to meet the needs, and can also be adaptively adjusted according to scene requirements and dynamic rules.

[0051] In a specific embodiment of the present application, the volume curve can be adaptively adjusted according to different volume modes. For example, the volume mode may include a high volume mode, a standard volume mode, and a low volume mode. The high volume mode uses a high volume curve, the standard volume mode uses a standard volume curve, and the low volume mode uses a low volume curve.

[0052] For details, please see Figure 5-Figure 8 , Figure 5 is the low volume curve data table provided by this application; Figure 6 is a schematic diagram of a low volume curve provided by the present application; Figure 7 is the low volume curve data table provided by this application; Figure 8 is a schematic diagram of a high volume curve provided by this application.

[0053] The slope of the high volume curve in the low adjustment range is greater than the slope of the standard volume curve in the low adjustment range, and the slope of the standard volume curve in the low adjustment range is greater than the slope of the low volume curve in the low adjustment range.

[0054] At high volume, the volume curve will rise faster in the front part, and change smoothly in the back part after reaching a certain volume. At low volume, the volume curve will rise slowly in the front part, and change relatively greatly in the back part, and the maximum volume will remain unchanged.

[0055] Through the above method, the flatness of the volume curve can be adjusted according to different modes to meet different audio adjustment requirements.

[0056] Furthermore, the present application provides an embodiment for obtaining a volume curve according to environmental noise. For details, please refer to Fig. 9 , Fig. 9 It is a flowchart of the second embodiment of the audio processing method provided by the present application.

[0057] like Fig. 9 As shown, the specific steps are as follows:

[0058] Step S21: obtaining current environmental noise and standard environmental noise.

[0059] Specifically, any noise detection device can be used to test the current environmental noise. This application does not make any specific limitations. The standard environmental noise in the embodiment of this application takes the noise inside the car as an example. The standard volume curve is formulated based on historical data feedback under the usual standard noise environment of the car (60db).

[0060] Step S22: Obtain a first difference between the current ambient noise and the standard ambient noise.

[0061] Specifically, let the current in-car ambient noise be M b , the standard ambient noise is M l It should be noted that the first difference here is an absolute value. When the current environmental noise is greater than the standard environmental noise, the first difference between the current environmental noise and the standard environmental noise is M b -M l When the current environmental noise is less than the standard environmental noise, the first difference between the current environmental noise and the standard environmental noise is M l -M b .

[0062] Step S23: Obtaining the volume increments of each level of the preset volume curve of the current volume module.

[0063] Specifically, the audio processing device obtains the volume increment t of each order of the preset volume curve of the current volume module.

[0064] Step S24: adjusting the volume increments of each order according to the first difference, and obtaining an adjustment volume curve of the current volume module.

[0065] Specifically, in response to the current environmental noise being greater than the standard environmental noise, the audio processing device obtains a second difference between the maximum volume of the preset volume curve and the standard environmental noise, and uses the ratio of the first difference to the second difference as an adjustment parameter; in response to the current environmental noise being less than the standard environmental noise, the audio processing device obtains a third difference between the standard environmental noise and the minimum volume of the preset volume curve, and uses the ratio of the first difference to the third difference as an adjustment parameter; and uses the adjustment parameter to adjust the volume increments of each order, and the specific formula is as follows:

[0066] When the current environment noise > standard environment noise:

[0067]

[0068] When the current ambient noise is less than the standard ambient noise:

[0069]

[0070] Among them, S is the final increased volume, M b is the current ambient noise in the car, M l is the standard environmental noise, t is the volume increase value of each level, M max and M min They are the maximum and minimum values ​​in the volume curve respectively.

[0071] Through the above method, the volume curve can be dynamically adjusted according to the environmental noise.

[0072] Furthermore, the present application proposes an embodiment for obtaining the current volume module. For details, please refer to Fig.10 , Fig.10 It is a flowchart of the third embodiment of the audio processing method provided by the present application.

[0073] like Fig.10 As shown, the specific steps are as follows:

[0074] Step S31: classify the first audio data into types to obtain the audio type of the first audio data.

[0075] The types of audio data include but are not limited to music audio, navigation audio, voice audio, etc.

[0076] Step S32: matching the target volume module with the highest correlation among all volume modules based on the audio type.

[0077] Specifically, each volume module has its own volume curve. Different audio types need to match different audio curves. Therefore, it is necessary to match the audio type with the most suitable volume module.

[0078] Through the above method, the volume module can be matched more accurately and the audio can be adjusted more precisely.

[0079] In one embodiment of the present application, an audio processing device obtains an initialization volume module of a vehicle-mounted system; obtains a module difference value between the initialization volume module and the target volume module based on a volume curve of the initialization volume module and a volume curve of a target volume module; determines whether the module difference value is greater than a preset threshold; if so, sets the target volume module as the current volume module; if not, keeps the initialization volume module as the current volume module.

[0080] Specifically, the audio processing device obtains a custom initialization volume module, obtains a current volume curve and a volume curve of a preset target volume module, and obtains a difference between the two. If the difference is greater than a threshold, it indicates that the deviation between the volume curve of the custom volume module and the preset volume curve is too large. At this time, the target volume module is set as the current volume module. If the difference is less than or equal to the threshold, the custom volume module can be used.

[0081] Step S33: setting the target volume module as the current volume module.

[0082] Through the above method, the current volume module to be adjusted is accurately determined.

[0083] Please continue to see Fig.11 , Fig.11 It is a schematic diagram of another embodiment of the audio processing framework provided by the present application.

[0084] In one embodiment of the present application, the audio processing framework in the present application also includes an algorithm processing module. After converting the digital signal into an analog signal, the music, navigation, telephone, and voice are assigned to different audio paths through the DSP chip, and then the audio power amplifier module is used for power amplifier processing, and finally the signal is output through the speaker.

[0085] In an embodiment of the present application, the audio of a certain audio channel can be processed separately. For example, the in-car audio has high requirements on the playback quality of music audio. After the algorithm processing module obtains the digital signal, the music signal is reprocessed as a separate channel. The processing method includes but is not limited to any one of bass processing, mixing processing and / or frequency division processing.

[0086] Through the above method, different from the existing technology, the audio adjustment method of this application can better adapt to the development of new energy vehicles, achieve improved intelligent results, and realize personalized, customized, and adaptive adjustment technical strategies.

[0087] In order to implement the audio processing method of the above embodiment, the present application also provides an audio processing device. Fig.12 , Fig.12 It is a structural diagram of an embodiment of an audio processing device provided by the present application.

[0088] like Figure 6 As shown, the audio processing device 600 of this embodiment includes a processor 61 , a memory 62 , an input / output device 63 , and a bus 64 .

[0089] The processor 61 , the memory 62 , and the input / output device 63 are respectively connected to the bus 64 . The memory 62 stores a computer program, and the processor 61 is used to execute the computer program to implement the audio processing method of the above embodiment.

[0090] In this embodiment, the processor 61 may also be referred to as a CPU (Central Processing Unit). The processor 61 may be an integrated circuit chip having the ability to process signals. The processor 61 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The processor 61 may also be a GPU (Graphics Processing Unit), also known as a display core, a visual processor, or a display chip, which is a microprocessor that is specifically used for image computing on computers, workstations, game consoles, and some mobile devices (such as tablet computers, smart phones, etc.). The purpose of the GPU is to convert and drive the display information required by the computer system, and to provide a line scan signal to the display to control the correct display of the display. It is an important component that connects the display and the computer motherboard. As an important component of the computer host, the graphics card is responsible for outputting display graphics. The general-purpose processor may be a microprocessor or the processor 61 may also be any conventional processor, etc.

[0091] The present application also provides a computer storage medium, such as Fig.13 As shown, Fig.13 It is a structural diagram of an embodiment of a computer storage medium provided in the present application. The computer storage medium 700 is used to store a computer program 71. When the computer program 71 is executed by a processor, it is used to implement the method described in the embodiment of the audio processing method of the present application.

[0092] The method involved in the embodiment of the audio processing method of the present application, when implemented in the form of a software functional unit and sold or used as an independent product, can be stored in a device, such as a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

[0093] The above description is only an implementation mode of the present invention, and does not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. An audio processing method, characterized in that: The audio processing method comprises: Acquire first audio data; Obtain a current volume module, and obtain a corresponding volume curve based on the current volume module; Adjust the volume component in the first audio data according to the volume curve to obtain second audio data; An audio signal corresponding to the second audio data is output through a speaker.

2. The audio processing method according to claim 1, characterized in that: The volume curve includes an adjustment amplitude and an output decibel value corresponding to each adjustment amplitude.

3. The audio processing method according to claim 1, characterized in that: The volume curve includes a high volume curve, a standard volume curve and a low volume curve; wherein the slope of the high volume curve in a low adjustment amplitude range is greater than the slope of the standard volume curve in a low adjustment amplitude range, and the slope of the standard volume curve in a low adjustment amplitude range is greater than the slope of the low volume curve in a low adjustment amplitude range.

4. The audio processing method according to claim 1, characterized in that: The obtaining a corresponding volume curve based on the current volume module includes: Get the current environment noise and standard environment noise; Acquire a first difference between the current ambient noise and the standard ambient noise; Obtaining volume increments of each order of a preset volume curve of the current volume module; The volume increments of each order are adjusted according to the first difference, and an adjustment volume curve of the current volume module is obtained.

5. The audio processing method according to claim 4, characterized in that: The step of adjusting the volume increments of each order according to the first difference includes: In response to the current environmental noise being greater than the standard environmental noise, obtaining a second difference between the maximum volume of the preset volume curve and the standard environmental noise, and taking a ratio of the first difference to the second difference as an adjustment parameter; In response to the current environmental noise being less than the standard environmental noise, obtaining a third difference between the standard environmental noise and the minimum volume of the preset volume curve, and taking a ratio of the first difference to the third difference as an adjustment parameter; The volume increments of each order are adjusted using the adjustment parameters.

6. The audio processing method according to claim 1, characterized in that: The volume module includes a music volume module, a navigation volume module, a telephone volume module and / or a voice volume module.

7. The audio processing method according to claim 1 or 6, characterized in that: The module for obtaining the current volume includes: Classify the first audio data into types to obtain the audio type of the first audio data; Matching a target volume module with the highest correlation among all volume modules based on the audio type; The target volume module is set as the current volume module.

8. The audio processing method according to claim 7, characterized in that: The setting the target volume module as the current volume module comprises: Get the initialization volume module of the vehicle system; Based on the volume curve of the initialization volume module and the volume curve of the target volume module, obtaining a module difference value between the initialization volume module and the target volume module; Determine whether the module difference value is greater than a preset threshold; If so, setting the target volume module as the current volume module; If not, keep the initialized volume module as the current volume module.

9. An audio processing device, characterized in that: The audio processing device comprises a processor and a memory; a computer program is stored in the memory, and the processor is used to execute the computer program to implement the steps of the audio processing method according to any one of claims 1 to 8.

10. A computer storage medium, characterized in that: The computer storage medium stores a computer program, and when the computer program is executed, the steps of the audio processing method according to any one of claims 1 to 8 are implemented.