Audio processing method and device, electronic equipment and storage medium

Abstract

The invention relates to an audio processing method and device, electronic equipment and a storage medium. The method comprises the following steps: determining a first audio signal from initial audio based on a signal value of an audio signal in the initial audio; reducing a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal; wherein the first audio signal and the second audio signal generate a masking effect; and obtaining a to-be-played audio based on the output audio signal. By reducing the second audio signal generating the masking effect with the first audio signal to the output audio signal, the influence of the masking effect can be reduced, hearing protection is performed by using the masking effect in psychoacoustics, the objective output energy of sound is effectively reduced, the sound radiation of the music playing device to human ears is further reduced, and the user experience is improved. The perception of human ears on the reduction of the sound volume is not caused, that is, the subjective hearing feeling is not changed; and frequency-division processing is not needed, so that the requirement on computing power is reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of information technology, and in particular to an audio processing method, device, electronic device and storage medium. Background Art

[0002] With the popularity of terminal devices and short videos, there are more and more scenarios where people wear headphones for a long time. For example, there are more and more scenarios where users watch videos. How to ensure that the viewing experience is not affected while protecting the user's hearing during the long-term video watching process is a current pain point. For example, when users use mobile phones to watch short videos, if they wear headphones for a long time, it will cause damage to the user's hearing.

[0003] Currently, hearing protection measures for terminal devices are mainly implemented by prompting users to lower the volume, but this method affects the user experience. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides an audio processing method, device, electronic device and storage medium to overcome the problem that wearing headphones for a long time may damage the user's hearing.

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided an audio processing method, including:

[0006] determining a first audio signal from the initial audio based on a signal value of an audio signal in the initial audio;

[0007] reducing a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal; wherein the first audio signal and the second audio signal produce a masking effect;

[0008] Based on the output audio signal, audio to be played is obtained.

[0009] In some embodiments, the determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises:

[0010] Performing backup processing on the initial audio to obtain backup audio;

[0011] determining a third audio signal from the backup audio based on a signal value of the audio signal in the backup audio;

[0012] performing marking processing on the third audio signal based on the position of the third audio signal in the backup audio to obtain a marking position of the third audio signal;

[0013] Based on the respective flag bits, the first audio signal is determined from the initial audio.

[0014] In some embodiments, determining the third audio signal from the backup audio based on the signal value of the audio signal in the backup audio includes:

[0015] Determine a first signal difference between signal values ​​of two adjacent audio signals in the backup audio;

[0016] When the first signal difference is greater than a first signal threshold, the largest audio signal between two adjacent audio signals is determined as the third audio signal.

[0017] In some embodiments, the determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises:

[0018] Determine a second signal difference between signal values ​​of two adjacent audio signals in the initial audio;

[0019] When the second signal difference is greater than a second signal threshold, the largest audio signal between two adjacent audio signals is determined as the first audio signal.

[0020] In some embodiments, the method further comprises:

[0021] determining a first adjustment value based on a signal value of the first audio signal and a signal value of the second audio signal;

[0022] The step of reducing a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal comprises:

[0023] The output audio signal is obtained based on the signal value of the second audio signal and the first adjustment value.

[0024] In some embodiments, the method further comprises:

[0025] During audio playback, a hearing protection mode is activated based on a detected trigger event;

[0026] The determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises:

[0027] In a case where the hearing protection mode is successfully turned on, the first audio signal is determined from the initial audio based on a signal value of an audio signal in the initial audio.

[0028] In some embodiments, reducing the signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal includes:

[0029] When the hearing protection mode is successfully turned on, the adjustment controls are displayed through the display interface;

[0030] determining a second adjustment value corresponding to the adjustment operation acting on the adjustment control;

[0031] The output audio signal is obtained based on the signal value of the second audio signal and the second adjustment value.

[0032] According to a second aspect of an embodiment of the present disclosure, there is provided an audio processing device, including:

[0033] A first determination module, configured to determine a first audio signal from the initial audio based on a signal value of an audio signal in the initial audio;

[0034] an adjustment module, configured to reduce a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal; wherein the first audio signal and the second audio signal produce a masking effect;

[0035] The acquisition module is configured to obtain the audio to be played based on the output audio signal.

[0036] In some embodiments, the first determining module is configured to:

[0037] Performing backup processing on the initial audio to obtain backup audio;

[0038] determining a third audio signal from the backup audio based on a signal value of the audio signal in the backup audio;

[0039] performing marking processing on the third audio signal based on the position of the third audio signal in the backup audio to obtain a marking position of the third audio signal;

[0040] Based on the respective flag bits, the first audio signal is determined from the initial audio.

[0041] In some embodiments, the first determining module is configured to:

[0042] Determine a first signal difference between signal values ​​of two adjacent audio signals in the backup audio;

[0043] When the first signal difference is greater than a first signal threshold, the largest audio signal between two adjacent audio signals is determined as the third audio signal.

[0044] In some embodiments, the first determining module is configured to:

[0045] Determine a second signal difference between signal values ​​of two adjacent audio signals in the initial audio;

[0046] When the second signal difference is greater than a second signal threshold, the largest audio signal between two adjacent audio signals is determined as the first audio signal.

[0047] In some embodiments, the apparatus further comprises:

[0048] a second determining module, configured to determine a first adjustment value based on a signal value of the first audio signal and a signal value of the second audio signal;

[0049] The adjustment module is configured as follows:

[0050] The output audio signal is obtained based on the signal value of the second audio signal and the first adjustment value.

[0051] In some embodiments, the apparatus further comprises:

[0052] A processing module configured to enable a hearing protection mode based on a detected triggering event during audio playback;

[0053] The first determining module is configured as follows:

[0054] In a case where the hearing protection mode is successfully turned on, the first audio signal is determined from the initial audio based on a signal value of an audio signal in the initial audio.

[0055] In some embodiments, the adjustment module is configured to:

[0056] When the hearing protection mode is successfully turned on, the adjustment controls are displayed through the display interface;

[0057] determining a second adjustment value corresponding to the adjustment operation acting on the adjustment control;

[0058] The output audio signal is obtained based on the signal value of the second audio signal and the second adjustment value.

[0059] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0060] processor;

[0061] a memory configured to store processor-executable instructions;

[0062] Wherein, the processor is configured to: implement the steps in any one of the audio processing methods in the first aspect when executed.

[0063] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform any one of the audio processing methods in the first aspect.

[0064] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0065] The technical solution disclosed in the present invention can reduce the influence of the masking effect by reducing the second audio signal that produces a masking effect with the first audio signal to the output audio signal, and protect hearing by utilizing the masking effect in psychoacoustics, thereby effectively reducing the objective output energy of the sound, thereby reducing the sound radiation of the music playback device to the human ear, and will not cause the human ear to perceive a reduction in the sound volume, that is, the subjective hearing experience remains unchanged; and no frequency band processing is required, which reduces the computing power requirements.

[0066] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0068] Figure 1 The following is a flow chart of an audio processing method according to an exemplary embodiment. Figure 1 .

[0069] Figure 2 The following is a flow chart of an audio processing method according to an exemplary embodiment. Figure 2 .

[0070] Figure 3 The present invention is a block diagram of an audio processing device according to an exemplary embodiment.

[0071] Figure 4 It is a hardware structure block diagram of an electronic device 800 according to an exemplary embodiment. DETAILED DESCRIPTION

[0072] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0073] Figure 1The following is a flow chart of an audio processing method according to an exemplary embodiment. Figure 1 ,like Figure 1 As shown, the method mainly includes the following steps:

[0074] In step 101, a first audio signal is determined from the initial audio based on a signal value of an audio signal in the initial audio;

[0075] In step 102, a signal value of a second audio signal adjacent to the first audio signal is reduced to obtain an output audio signal; wherein the first audio signal and the second audio signal produce a masking effect;

[0076] In step 103, audio to be played is obtained based on the output audio signal.

[0077] It should be noted that the method can be applied to electronic devices. The electronic devices may include terminal devices. The terminal devices may include mobile terminals and fixed terminals, such as mobile phones, tablet computers, PDAs, laptop computers, desktop computers, wearable devices, smart speakers, televisions, and vehicle-mounted terminals.

[0078] Wearable devices may include: portable devices that are worn directly on the user or integrated into the user's accessories. For example, they may include: wearable devices supported by the head (including headphones, glasses, helmets, headbands, etc.). They may also include: smart clothing, school bags, crutches, accessories, etc.

[0079] In some embodiments, the electronic device may have an audio playback function, for example, may be a headset with an audio playback function.

[0080] In some embodiments, when audio playback is required, initial audio can be obtained, and signal values ​​of each audio signal in the initial audio can be determined, and then a first audio signal and a second audio signal adjacent to the first audio signal can be determined from the initial audio, wherein the second audio signal is the next audio signal adjacent to the first audio signal, and the signal value of the first audio signal is greater than the signal value of the second audio signal.

[0081] In some embodiments, the determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises:

[0082] Determine a second signal difference between signal values ​​of two adjacent audio signals in the initial audio;

[0083] When the second signal difference is greater than a second signal threshold, the largest audio signal between two adjacent audio signals is determined as the first audio signal.

[0084] In the embodiment of the present disclosure, after obtaining the initial audio, the second signal difference between the signal values ​​of two adjacent audio signals in the initial audio can be determined. After obtaining each second signal difference, the second signal difference can be compared with the second signal threshold, and when the second signal difference is greater than the second signal threshold, the largest audio signal of the two adjacent audio signals is determined as the first audio signal. In this way, each first audio signal can be determined from the initial audio, that is, the first audio signal in the present disclosure can be at least one.

[0085] After determining the first audio signal, the next audio signal (second audio signal) adjacent to the first audio signal can be determined. In the disclosed embodiment, by determining the second signal difference between the signal values ​​of two adjacent audio signals in the initial audio, and when the second signal difference is greater than the second signal threshold, determining the largest audio signal of the two adjacent audio signals as the first audio signal, it is possible to filter out a large signal that meets the conditions from the initial audio, and then accurately reduce the small signal adjacent to the large signal, which can improve the accuracy of audio processing and make the output effect of the obtained audio to be played better.

[0086] It should be noted that the initial audio is the audio that needs to be played initially. Since the first audio signal in the initial audio and the second audio signal adjacent to the first audio signal will produce a masking effect, that is, the second audio signal constitutes a masking sound of the first audio signal, when the user uses an electronic device to listen to sound, the first audio signal is followed by the second audio signal, and the second audio signal radiates to the human ear, but from a perceptual point of view, the second audio signal is equivalent to being invalid. Among them, the first audio signal can be a large signal, and the second audio signal can be a small signal that follows the large signal.

[0087] In some embodiments, after determining the first audio signal and the second audio signal adjacent to the first audio signal, the signal value of the second audio signal may be reduced to obtain an output audio signal, and then the audio to be played may be obtained based on the output audio signal.

[0088] If the current user is in a relatively noisy environment, when the person is using a headphone device to listen to music, a small signal follows a large signal, and this small signal radiates to the human ear, but from a perceptual point of view, this sound is equivalent to being invalid. In the disclosed embodiment, by reducing the second audio signal that produces a masking effect with the first audio signal to the output audio signal, the influence of the masking effect can be reduced, and hearing protection is performed by utilizing the masking effect in psychoacoustics, effectively reducing the objective output energy of the sound, thereby reducing the sound radiation of the music playback device to the human ear, and will not cause the human ear to perceive a reduction in the sound volume, that is, the subjective hearing experience remains unchanged; and no frequency band processing is required, which reduces the computing power requirements.

[0089] In some embodiments, the determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises:

[0090] Performing backup processing on the initial audio to obtain backup audio;

[0091] determining a third audio signal from the backup audio based on a signal value of the audio signal in the backup audio;

[0092] performing marking processing on the third audio signal based on the position of the third audio signal in the backup audio to obtain a marking position of the third audio signal;

[0093] Based on the respective flag bits, the first audio signal is determined from the initial audio.

[0094] In some embodiments, the initial audio (original audio signal) can be backed up by a digital signal processing (DSP) module in the electronic device to obtain a backup audio (analysis audio signal). For example, the original audio signal S1 can be copied in the DSP module to obtain the analysis audio signal S2.

[0095] After obtaining the backup audio, a third audio signal can be determined from the backup audio based on the signal value of the audio signal in the backup audio, and the third audio signal can be marked based on the position of the third audio signal in the backup audio to obtain a mark position of the third audio signal, and then the first audio signal can be determined from the initial audio based on the respective mark positions.

[0096] In some embodiments, determining the third audio signal from the backup audio based on the signal value of the audio signal in the backup audio includes:

[0097] Determine a first signal difference between signal values ​​of two adjacent audio signals in the backup audio;

[0098] When the first signal difference is greater than a first signal threshold, the largest audio signal between two adjacent audio signals is determined as the third audio signal.

[0099] In the embodiment of the present disclosure, after the backup audio is obtained, the first signal difference between the signal values ​​of two adjacent audio signals in the backup audio can be determined. After each first signal difference is obtained, the first signal difference and the first signal threshold can be compared, and when the first signal difference is greater than the first signal threshold, the largest audio signal of the two adjacent audio signals is determined as the third audio signal. In this way, each third audio signal can be determined from the backup audio, that is, the third audio signal in the present disclosure can be at least one.

[0100] In the embodiment of the present disclosure, by determining the first signal difference between the signal values ​​of two adjacent audio signals in the backup audio, and when the first signal difference is greater than the first signal threshold, determining the largest audio signal between the two adjacent audio signals as the third audio signal, a large signal that meets the conditions can be screened out from the backup audio.

[0101] After the third audio signal is determined, the third audio signal may be marked based on its position in the backup audio to obtain a mark position of the third audio signal, and then the first audio signal may be determined from the initial audio based on each mark position.

[0102] Since the backup audio is exactly the same as the initial audio, the mark position of the third audio signal in the backup audio can correspond to the position of the first audio signal in the initial audio. In the disclosed embodiment, by backing up the backup audio and determining the first audio signal based on the mark position of the third audio signal in the backup audio, the impact of audio processing on the initial audio can be reduced. Using the masking effect model in psychoacoustics, each audio signal is judged according to the set first signal threshold (difference between large and small signals), and the backup audio is detected and marked for large signals. Since the backup audio is exactly the same as the initial audio, the mark position of the backup audio is used to suppress the small signal after the large signal in the initial audio, and the suppression depth can be self-adjusted.

[0103] In some embodiments, the method further comprises:

[0104] determining a first adjustment value based on a signal value of the first audio signal and a signal value of the second audio signal;

[0105] The step of reducing a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal comprises:

[0106] The output audio signal is obtained based on the signal value of the second audio signal and the first adjustment value.

[0107] In the embodiment of the present disclosure, the first adjustment value may be determined based on the difference between the signal value of the first audio signal and the signal value of the second audio signal, and the output audio signal may be determined based on the difference between the signal value of the second audio signal and the first adjustment value.

[0108] In other embodiments, after obtaining the first adjustment value, the first adjustment value may be weighted to obtain a first weighted adjustment value, and then the output audio signal may be obtained based on the signal value of the second audio signal and the first weighted adjustment value. For example, the output audio signal may be determined based on the difference between the signal value of the second audio signal and the first weighted adjustment value.

[0109] In the embodiment of the present disclosure, the first adjustment value can be automatically determined based on the signal values ​​of the first audio signal and the second audio signal, and the second audio signal can be adjusted based on the first adjustment value. On the basis of improving the intelligence of audio processing, the obtained audio to be played can be made smoother and more natural.

[0110] In the disclosed embodiment, after the suppressed output audio signal is finally obtained, the audio to be played can be played to the user through the audio playback module (e.g., headphones). Compared with the initial audio, the audio to be played retains the large signal but suppresses many small signals, thereby reducing the sound radiation of the audio playback module to the human ear, achieving the effect of hearing protection.

[0111] In some embodiments, the method further comprises:

[0112] During audio playback, a hearing protection mode is activated based on a detected trigger event;

[0113] The determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises:

[0114] In a case where the hearing protection mode is successfully turned on, the first audio signal is determined from the initial audio based on a signal value of an audio signal in the initial audio.

[0115] In some embodiments, an application interface may be set for user input of a trigger event. For example, when an audio playback event is detected, a touch control may be displayed on the application interface, and when a user clicks the touch control, it is determined that a trigger event is detected, and the hearing protection mode may be turned on based on the trigger event.

[0116] In the embodiment of the present disclosure, when the user needs to protect his hearing, he can choose to turn on the hearing protection mode in the application interface UI window. By providing a trigger entrance for the user, the user can turn on or off the hearing protection mode according to his needs, which can improve the convenience of the user in using the electronic device.

[0117] In some embodiments, reducing the signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal includes:

[0118] When the hearing protection mode is successfully turned on, the adjustment controls are displayed through the display interface;

[0119] determining a second adjustment value corresponding to the adjustment operation acting on the adjustment control;

[0120] The output audio signal is obtained based on the signal value of the second audio signal and the second adjustment value.

[0121] In an embodiment of the present disclosure, when the hearing protection mode is successfully turned on, the adjustment control can be displayed through the display interface, and a second adjustment value corresponding to the adjustment operation acting on the adjustment control can be determined, and an output audio signal can be obtained based on the signal value of the second audio signal and the second adjustment value.

[0122] The adjustment control may be a progress bar displayed on the display interface, and the user may determine the corresponding second adjustment value by pulling the progress bar, thereby obtaining the output audio signal based on the signal value of the second audio signal and the second adjustment value. For another example, the adjustment control may also be a selection control with different gear position marks displayed on the user interface, and the user may determine the corresponding second adjustment value by selecting different selection controls, thereby obtaining the output audio signal based on the signal value of the second audio signal and the second adjustment value.

[0123] In some embodiments, the output audio signal may be obtained based on the difference between the signal value of the second audio signal and the second adjustment value. In other embodiments, after obtaining the second adjustment value, the second adjustment value may be weighted to obtain a second weighted adjustment value, and then the output audio signal may be obtained based on the signal value of the second audio signal and the second weighted adjustment value. For example, the output audio signal may be determined based on the difference between the signal value of the second audio signal and the second weighted adjustment value.

[0124] In the disclosed embodiment, an adjustment control is displayed through a display interface so that the user can determine the corresponding second adjustment value based on the adjustment control, that is, can determine the compression depth for the second audio signal. Since the user can hear the audio through the audio playback module, the user can make corresponding adjustments through the adjustment control according to the audio feeling he hears, which can make the adjusted audio to be played more adapted to the user's usage needs, thereby improving the user experience.

[0125] Figure 2 The following is a flow chart of an audio processing method according to an exemplary embodiment. Figure 2 ,like Figure 2As shown, when the central processing unit (CPU) of the electronic device detects a hearing protection on / off instruction, the hearing protection on / off instruction can be sent to the application processor (AP) of the audio processing module, and the audio processing module can send the initial audio (original audio data) to the digital signal processing module (DSP module). The audio processing module can suppress the initial audio based on the method in any of the above embodiments to obtain the audio to be played (processed audio data), and send the processed audio data to the digital-to-analog converter for digital-to-analog conversion, and play the audio through the audio playback device.

[0126] The technical solution disclosed in the present invention can reduce the influence of the masking effect by reducing the second audio signal that produces a masking effect with the first audio signal to the output audio signal, and protect hearing by utilizing the masking effect in psychoacoustics, thereby effectively reducing the objective output energy of the sound, thereby reducing the sound radiation of the music playback device to the human ear, and will not cause the human ear to perceive a reduction in the sound volume, that is, the subjective hearing experience remains unchanged; and no frequency band processing is required, which reduces the computing power requirements.

[0127] Figure 3 FIG. 1 is a block diagram of an audio processing device according to an exemplary embodiment. Figure 3 As shown, the audio processing device 300 mainly includes:

[0128] A first determination module 301 is configured to determine a first audio signal from the initial audio based on a signal value of an audio signal in the initial audio;

[0129] An adjustment module 301 is configured to reduce a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal; wherein the first audio signal and the second audio signal produce a masking effect;

[0130] The acquisition module 303 is configured to obtain the audio to be played based on the output audio signal.

[0131] In some embodiments, the first determining module 301 is configured to:

[0132] Performing backup processing on the initial audio to obtain backup audio;

[0133] determining a third audio signal from the backup audio based on a signal value of the audio signal in the backup audio;

[0134] performing marking processing on the third audio signal based on the position of the third audio signal in the backup audio to obtain a marking position of the third audio signal;

[0135] Based on the respective flag bits, the first audio signal is determined from the initial audio.

[0136] In some embodiments, the first determining module 301 is configured to:

[0137] Determine a first signal difference between signal values ​​of two adjacent audio signals in the backup audio;

[0138] When the first signal difference is greater than a first signal threshold, the largest audio signal between two adjacent audio signals is determined as the third audio signal.

[0139] In some embodiments, the first determining module 301 is configured to:

[0140] Determine a second signal difference between signal values ​​of two adjacent audio signals in the initial audio;

[0141] When the second signal difference is greater than a second signal threshold, the largest audio signal between two adjacent audio signals is determined as the first audio signal.

[0142] In some embodiments, the apparatus 300 further includes:

[0143] a second determining module, configured to determine a first adjustment value based on a signal value of the first audio signal and a signal value of the second audio signal;

[0144] The adjustment module 302 is configured as follows:

[0145] The output audio signal is obtained based on the signal value of the second audio signal and the first adjustment value.

[0146] In some embodiments, the apparatus 300 further includes:

[0147] A processing module configured to enable a hearing protection mode based on a detected triggering event during audio playback;

[0148] The first determining module 301 is configured to:

[0149] In a case where the hearing protection mode is successfully turned on, the first audio signal is determined from the initial audio based on a signal value of an audio signal in the initial audio.

[0150] In some embodiments, the adjustment module 302 is configured to:

[0151] When the hearing protection mode is successfully turned on, the adjustment controls are displayed through the display interface;

[0152] determining a second adjustment value corresponding to the adjustment operation acting on the adjustment control;

[0153] The output audio signal is obtained based on the signal value of the second audio signal and the second adjustment value.

[0154] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0155] Figure 4 8 is a hardware structure block diagram of an electronic device 800 according to an exemplary embodiment. For example, the device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, a wearable device, etc.

[0156] Reference Figure 4 , device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0157] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0158] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0159] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0160] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0161] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0162] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0163] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0164] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0165] In an exemplary embodiment, the device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0166] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of the device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0167] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform an audio processing method, the method comprising:

[0168] determining a first audio signal from the initial audio based on a signal value of an audio signal in the initial audio;

[0169] reducing a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal; wherein the first audio signal and the second audio signal produce a masking effect;

[0170] Based on the output audio signal, audio to be played is obtained.

[0171] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0172] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An audio processing method, characterized in that: include: determining a first audio signal from the initial audio based on a signal value of an audio signal in the initial audio; reducing a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal; wherein the first audio signal and the second audio signal produce a masking effect; Based on the output audio signal, audio to be played is obtained.

2. The method according to claim 1, characterized in that The determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises: Performing backup processing on the initial audio to obtain backup audio; determining a third audio signal from the backup audio based on a signal value of the audio signal in the backup audio; performing marking processing on the third audio signal based on the position of the third audio signal in the backup audio to obtain a marking position of the third audio signal; Based on the respective flag bits, the first audio signal is determined from the initial audio.

3. The method according to claim 2, characterized in that The determining the third audio signal from the backup audio based on the signal value of the audio signal in the backup audio comprises: Determine a first signal difference between signal values ​​of two adjacent audio signals in the backup audio; When the first signal difference is greater than a first signal threshold, the largest audio signal between two adjacent audio signals is determined as the third audio signal.

4. The method according to claim 1, characterized in that: The determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises: Determine a second signal difference between signal values ​​of two adjacent audio signals in the initial audio; When the second signal difference is greater than a second signal threshold, the largest audio signal between two adjacent audio signals is determined as the first audio signal.

5. The method according to claim 1, characterized in that The method further comprises: determining a first adjustment value based on a signal value of the first audio signal and a signal value of the second audio signal; The step of reducing a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal comprises: The output audio signal is obtained based on the signal value of the second audio signal and the first adjustment value.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: During audio playback, a hearing protection mode is activated based on a detected trigger event; The determining the first audio signal from the initial audio based on the signal value of the audio signal in the initial audio comprises: In a case where the hearing protection mode is successfully turned on, the first audio signal is determined from the initial audio based on a signal value of an audio signal in the initial audio.

7. The method according to any one of claims 1 to 5, characterized in that: The step of reducing a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal comprises: When the hearing protection mode is successfully turned on, the adjustment controls are displayed through the display interface; determining a second adjustment value corresponding to the adjustment operation acting on the adjustment control; The output audio signal is obtained based on the signal value of the second audio signal and the second adjustment value.

8. An audio processing device, characterized in that: include: A first determination module, configured to determine a first audio signal from the initial audio based on a signal value of an audio signal in the initial audio; an adjustment module, configured to reduce a signal value of a second audio signal adjacent to the first audio signal to obtain an output audio signal; wherein the first audio signal and the second audio signal produce a masking effect; The acquisition module is configured to obtain the audio to be played based on the output audio signal.

9. An electronic device, characterized in that: include: processor; a memory configured to store processor-executable instructions; Wherein, the processor is configured to: implement the steps in any one of the audio processing methods in claims 1 to 7 when executed.

10. A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform any one of the audio processing methods of claims 1 to 7.

Images