Audio processing method and device, electronic equipment and product

Abstract

The invention provides an audio processing method and device, electronic equipment and a product, and is applied to the technical field of audio processing. The method comprises the following steps: acquiring a second audio played by an audio playing device under the condition that a first audio is played by the audio playing device; extracting an encrypted first authentication audio from an audio clip of a target frequency band in the second audio, the target frequency band being an ultrasonic frequency band or an infrasound frequency band; decrypting the first authentication audio to obtain a decrypted authentication parameter; and under the condition that the decrypted authentication parameter is matched with a preset authentication parameter, controlling the target sound effect processing algorithm to carry out sound effect processing on the first audio, and controlling the audio playing equipment to output the first audio after the sound effect processing.

Description

Technical Field

[0001] The present application is applied to the field of audio processing technology, and in particular relates to an audio processing method, device, electronic equipment and product. Background Art

[0002] With the rapid adoption of smart audio playback devices and the increasing value of sound effect processing algorithms, intellectual property protection of these algorithms is needed to prevent unauthorized duplication, modification, and use. One method of protecting these algorithms is to encrypt them. When an audio playback device needs to use an audio effect processing algorithm for audio processing, the encrypted algorithm is verified. Only after passing verification can the algorithm be used to process the audio.

[0003] In the exemplary technology, the sound effect processing algorithm is encrypted using digital watermarking technology. However, digital watermarking technology is easy to obtain the watermark, and the sound effect processing algorithm lacks sufficient protection, making the encrypted sound effect processing algorithm easy to crack, and the use of the sound effect processing algorithm is less secure. Summary of the Invention

[0004] In order to solve the above problems, the present application proposes an audio processing method, device, electronic device and product to solve the problem of low security in the use of sound effect processing algorithms.

[0005] The first aspect of the present application provides an audio processing method, comprising:

[0006] When the first audio is played through an audio playback device, obtaining a second audio played by the audio playback device, wherein the second audio contains encrypted authentication audio corresponding to a target sound effect processing algorithm in the audio playback device;

[0007] Extracting the encrypted first authentication audio from an audio segment of a target frequency band in the second audio, where the target frequency band is an ultrasonic frequency band or an infrasonic frequency band;

[0008] decrypting the first authentication audio to obtain decrypted authentication parameters;

[0009] When the decrypted authentication parameter matches the preset authentication parameter, the target sound effect processing algorithm is controlled to perform sound effect processing on the first audio, and the audio playback device is controlled to output the first audio after the sound effect processing.

[0010] In one embodiment, before obtaining the second audio played by the audio playback device, the method further includes:

[0011] Encrypting the authentication parameter corresponding to the initial sound effect processing algorithm to obtain a first encryption parameter, and performing audio modulation according to the first encryption parameter to obtain a second authentication audio, where the audio frequency band of the second authentication audio is an ultrasonic frequency band or an infrasonic frequency band;

[0012] The second authentication audio is added to the target code in the form of code to obtain a target sound effect processing algorithm, and the target code is used to represent the initial sound effect algorithm.

[0013] In one embodiment, encrypting the authentication parameter corresponding to the initial sound effect processing algorithm to obtain a first encryption parameter, and performing audio modulation according to the first encryption parameter, includes:

[0014] Obtaining a first key generation rule, and generating a first encryption key and a first decryption key according to the first key generation rule;

[0015] Encrypting the authentication parameter corresponding to the initial sound effect processing algorithm using the first encryption key to obtain a first encryption parameter, and storing the first decryption key in a secure storage area;

[0016] Encoding the first encryption parameter into a first sequence parameter in a preset base, and modulating the first sequence parameter into a second authentication audio according to a preset audio modulation parameter;

[0017] The decrypting the first authentication audio includes:

[0018] Extracting a first decryption key from the secure storage area, and demodulating the first authentication audio based on a preset audio modulation parameter to obtain a second sequence parameter;

[0019] A deserialization operation is performed on the second sequence parameter to obtain a second encryption parameter, and the second encryption parameter is decrypted according to the first decryption key.

[0020] In one embodiment, after decrypting the first authentication audio, the method further includes:

[0021] If the decrypted authentication parameter matches the preset authentication parameter, configuring a second key generation rule;

[0022] Generate a second encryption key and a second decryption key according to the second key generation rule;

[0023] According to the second encryption key, the decrypted authentication parameters are processed to obtain a third authentication audio, and the second authentication audio in the target sound effect processing algorithm is replaced with the third authentication audio, and the first decryption key in the secure storage area is replaced with the second decryption key.

[0024] In one embodiment, the second authentication audio is added to the target code in the form of a code, including:

[0025] The second authentication audio is added to the set position of the target code in the form of code. The set position represents the position of the set frequency band in the audio corresponding to the initial sound effect processing algorithm in the target code. The set frequency band is an idle frequency band or a frequency band whose audio energy is lower than the preset energy.

[0026] In one embodiment, after performing audio modulation according to the first encryption parameter, the method further includes:

[0027] Storing the second authentication audio in a secure storage area;

[0028] The decrypting the first authentication audio includes:

[0029] comparing the first authentication audio with the second authentication audio in the secure storage area;

[0030] In a case where the first authentication audio matches the second authentication audio, the first authentication audio is decrypted.

[0031] In one embodiment, after decrypting the first authentication audio, the method further includes:

[0032] When the decrypted authentication parameter does not match the preset authentication parameter, the audio playback device is controlled to run a security mechanism mode, wherein when the audio playback device runs the security mechanism model, the audio playback device outputs an alarm message or performs silent output.

[0033] In a second aspect of the present application, an audio processing device is provided, comprising:

[0034] an acquisition module, configured to acquire, when a first audio is played through an audio playback device, a second audio played by the audio playback device, wherein the second audio includes encrypted authentication audio corresponding to a target sound effect processing algorithm in the audio playback device;

[0035] an extraction module, configured to extract the encrypted first authentication audio from an audio segment of a target frequency band in the second audio, wherein the target frequency band is an ultrasonic frequency band or an infrasonic frequency band;

[0036] a decryption module, configured to decrypt the first authentication audio to obtain decrypted authentication parameters;

[0037] The control module is used to control the target sound effect processing algorithm to perform sound effect processing on the first audio when the decrypted authentication parameter matches the preset authentication parameter, and control the audio playback device to output the first audio after sound effect processing.

[0038] The third aspect of the present application provides an electronic device, comprising a memory and a processor; the memory is connected to the processor and is used to store programs; the processor is used to implement the audio processing method as described in the first aspect or any embodiment of the first aspect by running the program in the memory.

[0039] In a fourth aspect, the present application provides a chip comprising a processor and a data interface, wherein the processor reads and runs a program stored in a memory through the data interface to execute the audio processing method as described in the first aspect or any embodiment of the first aspect.

[0040] In a fifth aspect, the present application provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, the audio processing method as described in the first aspect or any embodiment of the first aspect is implemented.

[0041] A sixth aspect of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the audio processing method as described in the first aspect or any embodiment of the first aspect.

[0042] The present application proposes an audio processing method, device, electronic device, and product. When an audio playback device plays a first audio, the second audio output by the audio playback device containing encrypted authentication audio corresponding to a sound effect processing algorithm is collected, and the encrypted first authentication audio is extracted from an audio segment in the ultrasonic frequency band or infrasonic frequency band of the second audio, and the first authentication audio is decrypted to obtain decrypted authentication parameters. If the decrypted authentication parameters match the preset authentication parameters, the sound effect processing algorithm is controlled to perform sound effect processing on the first audio, and then the audio playback device is controlled to output the first audio after sound effect processing. In the present application, the audio played by the audio playback device is collected to obtain the second audio, and the encrypted authentication audio is extracted from an audio segment in the infrasonic frequency band or ultrasonic frequency band of the second audio that is inaudible to the human ear, so as to verify the use of the sound effect processing algorithm through the encrypted authentication audio. The encrypted authentication audio that is inaudible to the human ear makes it impossible for the user to hear the authentication audio. The authentication audio has a strong concealment, which increases the difficulty of cracking the authentication parameters, improves the protection strength of the sound effect processing algorithm, and thus improves the security of the use of the sound effect processing algorithm. In addition, this application verifies the use of the sound effect processing algorithm imperceptibly through audio that is inaudible to the human ear, thereby preventing users from hearing noise when using audio playback devices for audio playback. In other words, the authentication of the sound effect processing algorithm will not affect the audio function of the audio playback device, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without any creative work.

[0044] Figure 1 A schematic diagram of an implementation environment according to an embodiment of the present application;

[0045] Figure 2 The following is a flow chart of the audio processing method provided in accordance with the embodiment of the present application: Figure 1 ;

[0046] Figure 3 The following is a flow chart of the audio processing method provided in accordance with the embodiment of the present application: Figure 2 ;

[0047] Figure 4 The following is a flow chart of the audio processing method provided in accordance with the embodiment of the present application: Figure 3 ;

[0048] Figure 5 The following is a flow chart of the audio processing method provided in accordance with the embodiment of the present application: Figure 4 ;

[0049] Figure 6 A schematic diagram of the structure of an audio processing device provided according to an embodiment of the present application;

[0050] Figure 7 A schematic diagram of the structure of an electronic device provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0051] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0052] With the rapid adoption of smart audio playback devices and the increasing value of sound effect processing algorithms, intellectual property protection of these algorithms is needed to prevent unauthorized duplication, modification, and use. One method of protecting these algorithms is to encrypt them. When an audio playback device needs to use an audio effect processing algorithm for audio processing, the encrypted algorithm is verified. Only after passing verification can the algorithm be used to process the audio.

[0053] In the exemplary technology, the sound effect processing algorithm is encrypted using digital watermarking technology. However, digital watermarking technology is easy to obtain the watermark, and the sound effect processing algorithm lacks sufficient protection, making the encrypted sound effect processing algorithm easy to crack, and the use of the sound effect processing algorithm is less secure.

[0054] In addition, existing technologies for sound effect soft core encryption mainly use technical solutions such as RTL (Register Transfer Level, describing hardware behavior) code encryption, FPGA bitstream encryption, hardware binding authentication, digital watermark embedding, and software authorization management. Among them, RTL code encryption protects hardware description language code through algorithms such as AES (Advanced Encryption Standard), but there are key management difficulties. FPGA bitstream encryption relies on the encryption function provided by the manufacturer but is limited to specific platforms and cannot prevent logical analysis. The hardware binding solution binds the IP core to the physical characteristics of the chip but lacks a dynamic verification mechanism and is vulnerable to replay attacks. Digital watermark technology achieves tracking by embedding identification information in the algorithm, but the protection strength is weak. Software authorization management relies on license files to control usage rights, but it is dependent on the software environment and is at risk of being cracked. These technologies generally have defects such as insufficient protection performance, poor platform adaptability, or high implementation complexity, making it difficult to cope with the increasingly complex security threat environment. Existing audio effect soft-core encryption technologies have the following major flaws: First, while RTL code encryption schemes can protect design source code, they suffer from complex key management and weak runtime protection. Second, FPGA bitstream encryption is limited to specific hardware platforms and cannot protect against logic analysis attacks. Third, hardware-bound authentication lacks a dynamic verification mechanism, making it vulnerable to replay attacks. Furthermore, digital watermarking technology lacks sufficient protection to resist professional cracking. Finally, software licensing schemes overly rely on the security of the software environment, posing a risk of key leakage. These technologies generally suffer from insufficient protection, poor platform compatibility, and high implementation complexity.

[0055] In response to the problems of insufficient security, high platform dependence, and complex implementation in existing sound effect soft-core encryption technologies, this application innovatively proposes an audio processing method, device, electronic device, and product. The audio processing method realizes a safer and more reliable sound effect soft-core protection solution by utilizing the unique characteristics of the ultrasonic / infrasonic frequency band. Compared with the existing technology, this application has the following significant advantages: First, it uses audio that is imperceptible to the human ear as an encryption carrier, which does not affect the normal audio function and can achieve covert communication; second, it effectively prevents replay attacks and man-in-the-middle attacks through dynamic voiceprint feature matching technology; third, it combines hardware PUF features and real-time environmental parameters to construct a multiple security authentication mechanism; in addition, the solution has excellent cross-platform compatibility and can be adapted to different hardware architectures. The various technical solutions of this application and the above-mentioned significant advantages are specifically described in the following embodiments.

[0056] Exemplary Implementation Environment

[0057] Please refer to Figure 1 , Figure 1 It is a schematic diagram of the implementation environment involved in the embodiment of the present application. The implementation environment involved in the present application includes an audio processing device, in which an audio player, a voice acquisition module and a processing center are provided. When the first audio is input to the audio player, the audio player plays the audio, and the audio includes the authentication audio of the target sound effect processing algorithm in the audio player. The voice acquisition module collects the audio played by the audio player to obtain the second audio, and sends the second audio to the processing center, which can be the CPU (Central Processing Unit) of the audio processing device. The processing center extracts the encrypted authentication audio from the audio segment of the ultrasonic frequency band or the infrasonic frequency band of the second audio, decrypts the encrypted authentication audio to obtain the decrypted authentication parameters, and if the decrypted authentication parameters match the preset authentication parameters, a message that the sound effect processing algorithm authentication is passed is sent to the audio player. The sound effect processing algorithm of the audio player performs sound effect processing on the first audio, and the audio player plays the first audio after the sound effect processing.

[0058] Exemplary Methods

[0059] See also Figure 2 In an exemplary embodiment, an audio processing method is provided, the audio processing method comprising the following steps:

[0060] In step S201, when a first audio is played through an audio playback device, a second audio played by the audio playback device is obtained, wherein the second audio contains encrypted authentication audio corresponding to a target sound effect processing algorithm in the audio playback device.

[0061] In this embodiment, the execution subject is an audio processing device, which can be a device equipped with an audio playback device. For example, a vehicle equipped with an in-vehicle audio system can serve as the audio processing device. For ease of description, the term "device" will be used to refer to the audio processing device.

[0062] The audio playback device is provided with a sound effect soft core. A soft core refers to a customizable and configurable hardware module described in a hardware description language, which can be implemented on a programmable device such as an FPGA (Field Programmable Gate Array). The soft core is a configurable code implemented inside the FPGA chip, that is, the soft core is a CPU core that can be implemented with code, and the sound effect soft core represents the code corresponding to the sound effect processing algorithm. The audio playback device is provided with a sound effect soft core. When the audio playback device needs to play audio, it can process the audio through the sound effect processing algorithm represented by the sound effect soft core, and then output the audio after the sound effect processing. However, the sound effect soft core is provided with authentication audio, and the authentication audio is required to verify whether the audio playback device is authorized to use the sound effect soft core.

[0063] In this regard, when audio is input to the audio playback device, the audio playback device will output audio, and the input audio is defined as the first audio. Exemplarily, after receiving the input first audio, the audio playback device needs to call the sound effect soft core to perform sound effect processing on the first audio, but it is necessary to verify whether the audio playback device is authorized to use the sound effect soft core. In one implementation, when the audio playback device calls the sound effect soft core, the sound effect soft core adds the encrypted authentication audio to the ultrasonic frequency band or the infrasonic frequency band of the first audio, so that the audio playback device outputs the audio with the encrypted authentication audio added; in another implementation, the sound effect soft core converts the word code representing the encrypted authentication audio in its own code into audio as the output audio of the audio playback device.

[0064] After the audio player plays the audio, the device collects the audio through the voice acquisition module to obtain a second audio, which is an audio containing the authentication audio corresponding to the target sound effect processing algorithm. The voice acquisition module can be a microphone or a digital-to-analog converter.

[0065] Step S202: extracting the encrypted first authentication audio from an audio segment of a target frequency band in the second audio, where the target frequency band is an ultrasonic frequency band or an infrasonic frequency band.

[0066] In this embodiment, the audio segment corresponding to the ultrasonic or infrasonic frequency band in the second audio contains the encrypted authentication audio. The device extracts the audio segment of the target frequency band from the second audio. The target frequency band is the ultrasonic or infrasonic frequency band. The ultrasonic frequency band refers to the frequency range of 20 kHz to 1 GHz, which exceeds the upper limit of human hearing. The infrasonic frequency band refers to the frequency range below 20 Hz, which is imperceptible to the human ear.

[0067] The device can use a digital filter to extract audio clips in the target frequency band, or use a vibration sensor to assist the digital filter in extracting audio clips in the target frequency band. Furthermore, adaptive gain control can be used to enhance the signal strength of the captured audio clips, and coherent demodulation or matched filtering techniques can be used to separate the encrypted authentication audio from the audio clips.

[0068] Step S203: decrypt the first authentication audio to obtain decrypted authentication parameters.

[0069] The device can obtain a pre-shared key or a temporary key to decrypt the first authentication audio. The pre-shared key or temporary key can be obtained by the device from the background device associated with the manufacturer of the sound effect soft core, that is, the device sends a key acquisition request to the background device, and the background device sends the pre-shared key or temporary key to the device, so that the device can decrypt the first authentication audio and obtain the decrypted authentication parameters. The decrypted authentication parameters can be the unique identifier of the sound effect soft core and the PUF (Physical Unclonable Functions) of the chip. The unique identifier is, for example, the hash value of the IP core (intellectual property core) of the sound effect soft core, the ID (Identity document) of the manufacturer or authorization information. The chip refers to the FPGA chip where the sound effect soft core is located.

[0070] The device stores preset authentication parameters. The preset authentication parameters can be the unique identifier of the sound effect soft core sent by the background device to the device and the PUF of the chip. The preset authentication parameters can be the parameters of the sound effect processing algorithm authorized by the manufacturer to the audio processing device. After obtaining the decrypted authentication parameters, the device compares the decrypted authentication parameters with the preset authentication parameters. In addition, after obtaining the decrypted authentication parameters, the device needs to digitally sign and perform CRC (Cyclic Redundancy Check) on the decrypted authentication parameters to verify the integrity of the decrypted authentication parameters. When the decrypted authentication parameters pass the integrity check, the decrypted authentication parameters are compared with the preset authentication parameters.

[0071] Step S204 : When the decrypted authentication parameter matches the preset authentication parameter, the target audio effect processing algorithm is controlled to perform audio effect processing on the first audio, and the audio playback device is controlled to output the first audio after the audio effect processing.

[0072] In the embodiment, whether the decrypted authentication parameter is the same as the preset authentication parameter can be determined by the sound effect soft core. When the decrypted authentication parameter is the same as the preset authentication parameter, it is determined that the decrypted authentication parameter matches the preset authentication parameter, the sound effect soft core is allowed to run normally, the use permission of the sound effect processing algorithm by the audio playing device is opened, the target sound effect processing algorithm can be controlled to perform sound effect processing on the first audio, and the audio playing device can be controlled to play the first audio after the sound effect processing.

[0073] When the decrypted authentication parameter is not the same as the preset authentication parameter, it is determined that the decrypted authentication parameter does not match the preset authentication parameter, the audio playing device is controlled to run in a security mechanism mode. In the security mechanism mode, the audio playing device outputs an alarm information or a mute output, and can also perform a degraded mode audio output. The degraded mode audio refers to a reduction in the output quality of the first audio. The alarm information is, for example, “the audio playing device fails to pass the verification and cannot use the sound effect processing algorithm”. The decrypted authentication parameter and the preset authentication parameter can be determined by the FPGA chip in the audio playing device. If the two parameters match, the sound effect processing algorithm can be controlled to run normally.

[0074] In the embodiment, when the audio playing device plays the first audio, a second audio containing encrypted authentication audio corresponding to the sound effect processing algorithm is collected from the audio output by the audio playing device, the encrypted first authentication audio is extracted from the audio segment in the infrasound frequency band or the ultrasonic frequency band of the second audio, and the decrypted authentication parameter is obtained by decrypting the first authentication audio. If the decrypted authentication parameter matches the preset authentication parameter, the sound effect processing algorithm is controlled to perform sound effect processing on the first audio, and the audio playing device is controlled to output the first audio after the sound effect processing. In the embodiment, the second audio is collected from the audio played by the audio playing device, and the encrypted authentication audio is extracted from the audio segment in the infrasound frequency band or the ultrasonic frequency band that cannot be heard by the human ear. The use of the sound effect processing algorithm is verified through the encrypted authentication audio. The encrypted authentication audio that cannot be heard by the human ear makes it impossible for the user to hear the authentication audio, and the authentication audio has strong concealment, which increases the difficulty of cracking the authentication parameter and improves the protection strength of the sound effect processing algorithm, thereby improving the use security of the sound effect processing algorithm. In addition, the use of the sound effect processing algorithm is verified without awareness through the audio that cannot be heard by the human ear, which avoids the user from hearing noise when using the audio playing device to play audio, that is, the authentication of the sound effect processing algorithm does not affect the audio function of the audio playing device, and the user experience is improved.

[0075] Please refer to Figure 3 In yet another exemplary embodiment, an audio processing method is provided, based on Figure 2 In the illustrated embodiment, step S202 includes:

[0076] In step S301, the authentication parameter corresponding to the initial sound effect processing algorithm is encrypted to obtain a first encryption parameter, and audio modulation is performed according to the first encryption parameter to obtain a second authentication audio. The audio frequency band of the second authentication audio is an ultrasonic frequency band or an infrasonic frequency band.

[0077] In this embodiment, the device configures the audio authentication for the sound effect soft core so that the sound effect processing algorithm can be used only after being authenticated based on the authentication audio, thereby improving the security of the use of the sound effect processing algorithm.

[0078] Specifically, the device obtains authentication parameters corresponding to the initial sound effect processing algorithm. The authentication parameters can be the unique identifier of the sound effect soft core and the PUF of the chip where the sound effect soft core is located. The unique identifier can be, for example, the hash value of the IP core of the sound effect soft core, the ID of the manufacturer of the sound effect soft core, or authorization information. The initial sound effect processing algorithm refers to the sound effect processing algorithm that requires the addition of authentication audio. In addition, the authentication parameters can also include the real-time environmental parameters of the device. The real-time environmental parameters can be obtained through the environmental parameter interface of the device. The real-time environmental parameters can be temperature, humidity, etc.

[0079] The device encrypts the authentication parameter to obtain a first encryption parameter. For example, the device encrypts the unique identifier, the chip PUF, and the real-time environment parameter to obtain each first encryption parameter, and then concatenates each first encryption parameter and adds a header to obtain the first encryption parameter.

[0080] After obtaining the first encryption parameter, the first encryption parameter is audio-modulated using ultrasonic carrier or infrasound modulation, that is, the first encryption parameter is converted into a second authentication audio using ultrasonic carrier or infrasound modulation, and the audio frequency band of the second authentication audio is the ultrasonic frequency band or the infrasound frequency band.

[0081] Step S302: Add the second authentication audio to the target code in the form of code to obtain a target sound effect processing algorithm. The target code is used to represent the initial sound effect algorithm.

[0082] After obtaining the third authentication audio, the third authentication audio is added to the target code in code form. The target code represents the code representing the initial sound effect algorithm. In one example, the third authentication audio is encoded into an audio code and then embedded into the target code to obtain the target sound effect processing algorithm. When the target sound effect processing algorithm is required, the sound effect soft core converts the audio code in the target sound effect processing algorithm into audio for output by an audio playback device; alternatively, the converted audio is added to the ultrasonic or infrasonic frequency band of the first audio for output.

[0083] In another example, the target code contains an audio code representing an audio, and the audio contains an idle frequency band and a low-energy frequency band, the idle frequency band refers to a blank area of the audio, and the low-energy frequency band refers to a frequency band with audio energy lower than a preset energy, the idle frequency band contains no human voice and instrument sound, and the low-energy frequency band contains only a small amount of instrument sound, and the idle frequency band and the audio with audio energy lower than the preset energy are defined as a set frequency band. The device adds the third authentication audio in the form of a code to a set position of the target code, and the set position is a position of the set frequency band in the audio corresponding to the audio effect processing algorithm in the target code, that is, the third authentication frequency band is added to the idle frequency band or the low-energy frequency band. The device adds the second authentication audio in the form of a code to a set position of the target code, and the set position represents the audio.

[0084] In the embodiment, the authentication parameter corresponding to the initial audio effect processing algorithm is encrypted to obtain a first encrypted parameter, and the first encrypted parameter is audio modulated to obtain a second authentication audio inaudible to human ears, so that the second authentication audio is added in the form of a code to the target code representing the initial audio effect processing algorithm, to add protection to the use of the audio effect processing algorithm, avoid the use of the audio effect processing algorithm without authorization, and improve the use security of the audio effect processing algorithm.

[0085] Please refer to Figure 4 In another example, an audio processing method is provided, based on Figure 3 In the embodiment shown, step S301 includes:

[0086] In step S401, a first key generation rule is obtained, and a first encryption key and a first decryption key are generated according to the first key generation rule.

[0087] In the embodiment, the device can encrypt the authentication parameter by using an encryption key. For example, the device obtains a first key generation rule, which can be a preset key generation algorithm, and generates a key pair including a first encryption key and a first decryption key by using the first key generation rule.

[0088] In step S402, the authentication parameter corresponding to the initial audio effect processing algorithm is encrypted by using the first encryption key to obtain a first encrypted parameter, and the first decryption key is stored in a secure storage area.

[0089] After obtaining the first encryption key, the encryption key is used to encrypt the authentication parameters corresponding to the initial sound effect algorithm to obtain encryption parameters, which are defined as the first encryption parameters. The authentication parameters include the identity of the sound effect soft core and the device identification of the initial sound effect processing algorithm on the chip. The identity is the hash value, authorization information or manufacturer's ID of the IP core, and the device identification of the chip is the PUF of the FPGA chip. In addition, the authentication parameters may also include the real-time environmental parameters of the device. For example, if the device is a vehicle, the real-time environmental parameters of the vehicle include temperature, humidity, etc. The device stores the first decryption key in a secure storage area. The secure storage area can only be read by the device to ensure that the first decryption key will not be tampered with.

[0090] Step S403: Encode the first encryption parameter into a first sequence parameter of a preset base, and modulate the first sequence parameter into a second authentication audio according to a preset audio modulation parameter.

[0091] After obtaining the first encryption parameter, the first encryption parameter is encoded into a sequence parameter in a preset base, which is defined as a first sequence parameter. The first sequence parameter is then modulated into a second authentication audio signal using a preset audio modulation parameter. The device may use a frequency shift keying method to modulate the first sequence parameter, and the preset base may be, for example, binary.

[0092] Specifically, frequency shift keying is a digital modulation technique that transmits digital information by changing the frequency of a carrier signal. It is widely used in fields such as audio encryption and wireless communications. The core idea is to use carriers of different frequencies to represent binary data. The mathematical expression is as follows:

[0093] s(t)=A·cos(2πf i t), f i ∈{f0,f1};

[0094] Where A is the amplitude, f i The two main peaks correspond to f0 and f1 according to the data bit switching. The bandwidth depends on the frequency interval Δf = |f1-f0|. f0 and f1 are the audio modulation parameters.

[0095] The modulation process includes baseband signal processing, specifically: 1. Converting the authentication parameters of the audio effect softcore (e.g., a 256-bit hash value) into a binary sequence (e.g., 0101...); 2. Adding a synchronization header (e.g., 1010) and an error correction code (e.g., Hamming code). This also includes carrier frequency selection. For ultrasound, for example: 1. Logic "0": 22kHz sine wave; 2. Logic "1": 24kHz sine wave.

[0096] The modulation process also includes modulating the output, specifically:

[0097] 1. Generate FSK (Frequency-shift keying) signals through DDS (Direct Digital Synthesizer) or PWM (Pulse Width Modulation) hardware modules;

[0098] 2. Embedded in the audio signal output by the sound effect soft core (such as superimposed on the frequency band above 18kHz).

[0099] It should be noted that the device can add encrypted authentication audio to the sound processing algorithm by setting it before leaving the factory. When the device is sold to the user, preset authentication parameters will be set in the device so that the user who owns the device can verify the use of the sound processing algorithm based on the preset authentication parameters, thereby allowing the user to listen to the audio processed by the sound processing algorithm, thereby improving the user experience.

[0100] Refer to Table 1, which shows the process of the device modulating the first encryption parameter into the second authentication audio.

[0101] Table-1

[0102]

[0103] Correspondingly, after the device captures the second audio, it needs to decrypt the authentication audio within the second audio to obtain decrypted authentication parameters. Specifically, the device extracts a first decryption key from a secure storage area, demodulates the first authentication audio based on preset audio modulation parameters, and obtains a sequence parameter, which is defined as a second sequence parameter. The device then deserializes the second sequence parameter to obtain an encryption parameter, which is defined as a second encryption parameter. The device then decrypts the second encryption parameter using the first decryption key to obtain the decrypted authentication parameter.

[0104] Exemplarily, the device uses a digital filter to separate the audio segment of the target frequency band (e.g., 21-25kHz) from the second audio. Specifically, the zero-crossing detection method can be used to count the number of zero crossings of the signal per unit time to distinguish between f0 and f1, and FFT (fast Fourier transform) spectrum analysis is performed to locate the frequency corresponding to the energy peak. The detected frequency is compared with a preset mapping table (e.g., 22kHz→0, 24kHz→1), the synchronization header and error correction code are verified, and the original authentication information is restored to obtain the decrypted authentication parameters.

[0105] Refer to Table 2, which is an example of decrypting the first authentication audio.

[0106] Table-2

[0107]

[0108] It should be noted that the binary parameters, authentication parameters and other parameters in Table 1 and Table 2 are only used for illustration and are not limited to the parameters in Table 1 and Table 2.

[0109] In this embodiment, encryption is performed through the PUF characteristics of the chip, environmental parameters, and the identity identifier of the initial sound effect processing algorithm, and the encrypted parameters are encrypted based on an audio modulation method in a frequency band inaudible to the human ear, so as to configure a multiple security authentication mechanism for the use of the sound effect processing algorithm, that is, through the triple binding of voiceprint (second authentication audio), PUF, and environmental parameters, a multiple security authentication mechanism for the sound effect processing algorithm is constructed, thereby improving the protection strength of the sound effect processing algorithm.

[0110] See also Figure 5 In another exemplary embodiment, an audio processing method is provided, based on Figure 4 In the embodiment shown, after step S203, the following steps are further included:

[0111] Step S501: When the decrypted authentication parameter matches the preset authentication parameter, a second key generation rule is configured.

[0112] In this embodiment, when the audio effect soft core is successfully verified, the key needs to be dynamically updated to prevent the encrypted authentication audio from being cracked due to repeated playback of the second audio through the audio playback device.

[0113] Exemplarily, when the decrypted authentication parameters match the preset authentication parameters, a second key generation rule is configured. The second key generation rule is different from the first key generation rule and is another key generation algorithm that is different from the key generation algorithm corresponding to the first key generation rule.

[0114] Step S502: Generate a second encryption key and a second decryption key according to a second key generation rule.

[0115] Step S503: Process the decrypted authentication parameters according to the second encryption key to obtain a third authentication audio, replace the second authentication audio in the target sound effect processing algorithm with the third authentication audio, and replace the first decryption key in the secure storage area with the second decryption key.

[0116] After obtaining the second key generation rule, the second encryption key and the second decryption key are generated based on the second key generation rule. The device uses the second encryption key to process the decrypted authentication parameters to obtain the third authentication audio. The construction method of the third authentication audio is the same as the construction method of the second authentication audio. For details, refer to Figure 4 The process of constructing the second authentication audio in the illustrated embodiment will not be described in detail here.

[0117] After obtaining the third authentication audio, the second authentication audio in the target sound effect processing algorithm is replaced with the third authentication audio, that is, the code about the second authentication audio in the target code is replaced with the code converted by the third authentication audio.

[0118] In this embodiment, when the use authentication of the sound effect processing algorithm is passed, the encryption key is updated to prevent the encrypted authentication audio from being cracked due to repeated playback of the second audio through the audio playback device, effectively preventing replay attacks and man-in-the-middle attacks.

[0119] In one embodiment, after performing audio modulation based on the first encryption parameter, the device obtains a second authentication audio and stores the second authentication audio in a secure storage area. When decryption of the extracted first authentication audio is required, the second authentication audio is retrieved from the secure storage area and compared with the first authentication audio. If the hash value of the first authentication audio is the same as the hash value of the second authentication audio, it is determined that the first authentication audio and the second authentication audio match, and the device then decrypts the first audio.

[0120] It should be noted that after the encryption key and authentication audio are updated, the authentication audio in the secure storage area will be replaced with the updated authentication audio.

[0121] In this embodiment, the authentication audio in the secure storage area is compared and matched with the extracted authentication audio, and when the first authentication audio matches the second authentication audio, the first authentication audio is decrypted, thereby improving the security of the use of the sound effect processing algorithm.

[0122] Exemplary devices

[0123] Correspondingly, an embodiment of the present application also provides an audio processing device.

[0124] See also Figure 6 In an exemplary embodiment, an audio processing apparatus 600 is provided, comprising:

[0125] An acquisition module 610 is configured to acquire, when the first audio is played by the audio playback device, a second audio played by the audio playback device, wherein the second audio includes encrypted authentication audio corresponding to a target sound effect processing algorithm in the audio playback device;

[0126] An extraction module 620 is configured to extract the encrypted first authentication audio from an audio segment of a target frequency band in the second audio, where the target frequency band is an ultrasonic frequency band or an infrasonic frequency band;

[0127] A decryption module 630, configured to decrypt the first authentication audio to obtain decrypted authentication parameters;

[0128] The control module 640 is configured to control the target audio effect processing algorithm to perform audio effect processing on the first audio when the decrypted authentication parameter matches the preset authentication parameter, and control the audio playback device to output the first audio after the audio effect processing.

[0129] In some embodiments, the audio processing device 600 is further configured to:

[0130] Encrypting the authentication parameter corresponding to the initial sound effect processing algorithm to obtain a first encryption parameter, and performing audio modulation according to the first encryption parameter to obtain a second authentication audio, where the audio frequency band of the second authentication audio is an ultrasonic frequency band or an infrasonic frequency band;

[0131] The second authentication audio is added to the target code in the form of code to obtain a target sound effect processing algorithm. The target code is used to represent the initial sound effect algorithm.

[0132] In some embodiments, the audio processing device 600 is further configured to:

[0133] Obtaining a first key generation rule, and generating a first encryption key and a first decryption key according to the first key generation rule;

[0134] Encrypting the authentication parameter corresponding to the initial sound effect processing algorithm using the first encryption key to obtain a first encryption parameter, and storing the first decryption key in a secure storage area;

[0135] Encoding the first encryption parameter into a first sequence parameter of a preset base, and modulating the first sequence parameter into a second authentication audio according to a preset audio modulation parameter;

[0136] Decrypting the first authentication audio includes:

[0137] Extracting a first decryption key from a secure storage area, and demodulating the first authentication audio based on a preset audio modulation parameter to obtain a second sequence parameter;

[0138] A deserialization operation is performed on the second sequence parameter to obtain a second encryption parameter, and the second encryption parameter is decrypted according to the first decryption key.

[0139] In some embodiments, the audio processing device 600 is further configured to:

[0140] If the decrypted authentication parameter matches the preset authentication parameter, configuring a second key generation rule;

[0141] Generate a second encryption key and a second decryption key according to a second key generation rule;

[0142] According to the second encryption key, the decrypted authentication parameters are processed to obtain the third authentication audio, and the second authentication audio in the target sound effect processing algorithm is replaced with the third authentication audio, and the first decryption key in the secure storage area is replaced with the second decryption key.

[0143] In some embodiments, the audio processing device 600 is further configured to:

[0144] The second authentication audio is added to the set position of the target code in the form of code. The set position represents the position of the set frequency band in the audio corresponding to the initial sound effect processing algorithm in the target code. The set frequency band is an idle frequency band or a frequency band whose audio energy is lower than the preset energy.

[0145] In some embodiments, the audio processing device 600 is further configured to:

[0146] Storing the second authentication audio in a secure storage area;

[0147] Decrypting the first authentication audio includes:

[0148] comparing the first authentication audio with the second authentication audio in the secure storage area;

[0149] If the first authentication audio matches the second authentication audio, the first authentication audio is decrypted.

[0150] In some embodiments, the audio processing device 600 is further configured to:

[0151] When the decrypted authentication parameter does not match the preset authentication parameter, the audio playback device is controlled to run a security mechanism mode, wherein when the audio playback device runs the security mechanism model, the audio playback device outputs an alarm message or performs silent output.

[0152] The audio processing device provided in this embodiment is based on the same concept as the audio processing method provided in the above embodiments of this application. It can execute the audio processing method provided in any of the above embodiments of this application and has the corresponding functional modules and beneficial effects. For technical details not fully described in this embodiment, please refer to the specific processing content of the audio processing method provided in the above embodiments of this application, and will not be repeated here.

[0153] Exemplary electronic devices

[0154] Another embodiment of the present application also provides an electronic device. Figure 7 As shown, the electronic device includes: a memory 700 and a processor 710; wherein the memory 700 is connected to the processor 710 and is used to store programs; the processor 710 is used to implement the audio processing method disclosed in any of the above embodiments by running the program stored in the memory 700.

[0155] Specifically, the electronic device may further include: a bus, a communication interface 720 , an input device 730 and an output device 740 .

[0156] The processor 710, the memory 700, the communication interface 720, the input device 730 and the output device 740 are interconnected via a bus.

[0157] A bus may include a pathway that transfers information between components of a computer system.

[0158] Processor 710 can be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, or the like, or an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application. It can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component.

[0159] The processor 710 may include a main processor, and may also include a baseband chip, a modem, and the like.

[0160] The memory 700 stores a program for executing the technical solution of the present application, and may also store an operating system and other key services. Specifically, the program may include program code, and the program code includes computer operating instructions. More specifically, the memory 700 may include a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM), other types of dynamic storage devices that can store information and instructions, disk storage, flash, etc.

[0161] The input device 730 may include a device for receiving data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input device, a touch screen, a pedometer, or a gravity sensor.

[0162] Output device 740 may include devices that allow information to be output to a user, such as a display screen, printer, speakers, etc.

[0163] The communication interface 720 may include any device such as a transceiver to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), etc.

[0164] The processor 710 executes the program stored in the memory 700 and calls other devices, and can be used to implement each step of any audio processing method provided in the above embodiments of the present application.

[0165] An embodiment of the present application also proposes a chip, which includes a processor and a data interface. The processor reads and runs a program stored in a memory through the data interface to execute the audio processing method introduced in any of the above embodiments. The specific processing process and its beneficial effects can be found in the embodiment introduction of the above-mentioned audio processing method.

[0166] Exemplary computer program products and storage media

[0167] In addition to the above-mentioned methods and devices, an embodiment of the present application may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the audio processing method according to various embodiments of the present application described in any of the above-mentioned embodiments of this specification.

[0168] The computer program product may be written in any combination of one or more programming languages ​​to implement the program code for performing the operations of the embodiments of the present application, including object-oriented programming languages ​​such as Java, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0169] In addition, an embodiment of the present application may also be a storage medium on which a computer program is stored, and the computer program is executed by a processor to execute the steps of the audio processing method according to various embodiments of the present application described in any of the above embodiments of this specification.

[0170] For the sake of simplicity, the aforementioned method embodiments are described as a series of action combinations. However, those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

[0171] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Similarities between the various embodiments can be referred to in conjunction with each other. For device embodiments, since they are generally similar to method embodiments, their description is relatively simple, and for relevant details, reference can be made to the description of the method embodiments.

[0172] The steps in the methods of each embodiment of the present application can be adjusted in sequence, merged, and deleted according to actual needs, and the technical features recorded in each embodiment can be replaced or combined.

[0173] The modules and sub-modules in the devices and terminals of the various embodiments of the present application can be merged, divided, and deleted according to actual needs.

[0174] In the several embodiments provided in this application, it should be understood that the disclosed terminals, devices, and methods can be implemented in other ways. For example, the terminal embodiments described above are merely illustrative. For example, the division of modules or submodules is merely a logical function division. In actual implementation, there may be other division methods, such as multiple submodules or modules can be combined or integrated into another module, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or module, which can be electrical, mechanical or other forms.

[0175] The modules or submodules described as separate components may or may not be physically separate, and the components of the modules or submodules may or may not be physical modules or submodules, that is, they may be located in one place or distributed across multiple network modules or submodules. Some or all of the modules or submodules may be selected to achieve the purpose of this embodiment according to actual needs.

[0176] In addition, each functional module or submodule in each embodiment of the present application may be integrated into a processing module, or each module or submodule may exist physically separately, or two or more modules or submodules may be integrated into a single module. The above-mentioned integrated modules or submodules may be implemented in the form of hardware or software functional modules or submodules.

[0177] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0178] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, software units executed by a processor, or a combination of the two. The software units may be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0179] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or device comprising the element.

[0180] The above description of the disclosed embodiments will enable those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is to be construed in the widest manner consistent with the principles and novel features disclosed herein.

Claims

1. An audio processing method, characterized in that: include: When the first audio is played through an audio playback device, obtaining a second audio played by the audio playback device, wherein the second audio contains encrypted authentication audio corresponding to a target sound effect processing algorithm in the audio playback device; Extracting the encrypted first authentication audio from an audio segment of a target frequency band in the second audio, where the target frequency band is an ultrasonic frequency band or an infrasonic frequency band; decrypting the first authentication audio to obtain decrypted authentication parameters; When the decrypted authentication parameter matches the preset authentication parameter, the target sound effect processing algorithm is controlled to perform sound effect processing on the first audio, and the audio playback device is controlled to output the first audio after the sound effect processing.

2. The audio processing method according to claim 1, wherein: Before obtaining the second audio played by the audio playback device, the method further includes: Encrypting the authentication parameter corresponding to the initial sound effect processing algorithm to obtain a first encryption parameter, and performing audio modulation according to the first encryption parameter to obtain a second authentication audio, where the audio frequency band of the second authentication audio is an ultrasonic frequency band or an infrasonic frequency band; The second authentication audio is added to the target code in the form of code to obtain a target sound effect processing algorithm, and the target code is used to represent the initial sound effect algorithm.

3. The audio processing method according to claim 2, characterized in that The step of encrypting the authentication parameter corresponding to the initial sound effect processing algorithm to obtain a first encryption parameter, and performing audio modulation according to the first encryption parameter, includes: Obtaining a first key generation rule, and generating a first encryption key and a first decryption key according to the first key generation rule; Encrypting the authentication parameter corresponding to the initial sound effect processing algorithm using the first encryption key to obtain a first encryption parameter, and storing the first decryption key in a secure storage area; Encoding the first encryption parameter into a first sequence parameter in a preset base, and modulating the first sequence parameter into a second authentication audio according to a preset audio modulation parameter; The decrypting the first authentication audio includes: Extracting a first decryption key from the secure storage area, and demodulating the first authentication audio based on a preset audio modulation parameter to obtain a second sequence parameter; A deserialization operation is performed on the second sequence parameter to obtain a second encryption parameter, and the second encryption parameter is decrypted according to the first decryption key.

4. The audio processing method according to claim 3, characterized in that: After decrypting the first authentication audio, the method further includes: If the decrypted authentication parameter matches the preset authentication parameter, configuring a second key generation rule; Generate a second encryption key and a second decryption key according to the second key generation rule; According to the second encryption key, the decrypted authentication parameters are processed to obtain a third authentication audio, and the second authentication audio in the target sound effect processing algorithm is replaced with the third authentication audio, and the first decryption key in the secure storage area is replaced with the second decryption key.

5. The audio processing method according to claim 2, wherein: The second authentication audio is added to the target code in the form of code, including: The second authentication audio is added to the set position of the target code in the form of a code. The set position represents the position of the set frequency band in the audio corresponding to the initial sound effect processing algorithm in the target code. The set frequency band is an idle frequency band or a frequency band whose audio energy is lower than a preset energy.

6. The audio processing method according to claim 2, characterized in that: After performing audio modulation according to the first encryption parameter, the method further includes: Storing the second authentication audio in a secure storage area; The decrypting the first authentication audio includes: comparing the first authentication audio with the second authentication audio in the secure storage area; In a case where the first authentication audio matches the second authentication audio, the first authentication audio is decrypted.

7. The audio processing method according to any one of claims 1 to 6, characterized in that: After decrypting the first authentication audio, the method further includes: When the decrypted authentication parameter does not match the preset authentication parameter, the audio playback device is controlled to run a security mechanism mode, wherein when the audio playback device runs the security mechanism model, the audio playback device outputs an alarm message or performs silent output.

8. An audio processing device, characterized in that: include: an acquisition module, configured to acquire, when a first audio is played through an audio playback device, a second audio played by the audio playback device, wherein the second audio includes encrypted authentication audio corresponding to a target sound effect processing algorithm in the audio playback device; an extraction module, configured to extract the encrypted first authentication audio from an audio segment of a target frequency band in the second audio, wherein the target frequency band is an ultrasonic frequency band or an infrasonic frequency band; a decryption module, configured to decrypt the first authentication audio to obtain decrypted authentication parameters; The control module is used to control the target sound effect processing algorithm to perform sound effect processing on the first audio when the decrypted authentication parameter matches the preset authentication parameter, and control the audio playback device to output the first audio after sound effect processing.

9. An electronic device, characterized in that: including memory and processor; The memory is connected to the processor and is used to store programs; The processor is configured to implement the audio processing method according to any one of claims 1 to 7 by running the program in the memory.

10. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, implements the audio processing method according to any one of claims 1 to 7.

Images