Audio noise reduction method, audio and video system, electronic equipment and computer storage medium
By setting the first noise collection component and the second noise collection component of the headphone on the dongle, using the physical distance difference, obtaining noise signals in different frequency bands for noise reduction processing, the problem that low-frequency noise in the prior art cannot be effectively reduced is solved, and the noise reduction effect and user experience of the headphones are improved.
Patent Information
- Application Number
- CN202211104946.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-09
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2042-09-09
AI Technical Summary
When existing active noise reduction headphones face low-frequency noise with strong penetration, the noise collection component receives the same noise signal, resulting in the low-frequency noise signal being unable to be effectively reduced, reducing the user experience.
A first noise collection component is set on the dongle, and the physical distance from the headset is used to combine it with the second noise collection component on the headset to obtain noise signals in different frequency bands, and process it through the noise reduction algorithm model to improve the noise reduction effect of low-frequency noise.
It improves the noise reduction effect of headphones on low-frequency noise, enhances the user's auditory experience, and reduces the computing burden of headphones.
Smart Images

Figure CN115426574B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of audio noise reduction, and in particular to an audio noise reduction method, an audio and video system, an electronic device, and a computer storage medium. Background Art
[0002] With the development of science and technology in the field of headphones, people's requirements for headphones are getting higher and higher. In particular, the requirements for noise reduction of headphones. However, in the existing technology, most noise-cancelling headphones only use the noise collection components on the headphones to collect ambient noise signals for active noise reduction, thereby reducing the impact of ambient noise signals. However, when faced with low-frequency noise information with strong penetrating power, since the noise collection components on the headphones are extremely close in physical distance (such as the feedforward microphone and the feedback microphone) will receive almost the same low-frequency noise signal, this will result in the low-frequency noise signal not being considered as a noise signal during noise reduction processing, causing the user to be disturbed by the external low-frequency noise signal, reducing the user experience. Summary of the Invention
[0003] This application proposes an audio noise reduction method, an audio and video system, an electronic device, and a computer storage medium to solve the interference of low-frequency noise and improve user experience.
[0004] In a first aspect, the present application provides an audio noise reduction method, comprising:
[0005] Acquire a first noise signal collected by a first noise collection component on the dongle;
[0006] Acquire a second noise signal collected by a second noise collection component on the earphone;
[0007] Noise reduction processing is performed on the audio signal played by the earphone based on the first noise signal and the second noise signal, so that the earphone plays the audio signal after the noise reduction processing.
[0008] In a second aspect, the present application provides an audio and video system, comprising:
[0009] earphone;
[0010] VR glasses;
[0011] A dongle, plugged into the VR glasses and connected to the headset;
[0012] The dongle is provided with a first noise collection component for obtaining a first noise signal; the headset is provided with a second noise collection component, the second noise collection component is used to obtain a second noise signal, the dongle and / or the headset performs noise reduction processing on the audio signal based on the first noise signal and the second noise signal, and the headset is used to play the audio signal after noise reduction processing.
[0013] In a third aspect, the present application provides an electronic device comprising a processor and a memory connected to the processor, wherein program data is stored in the memory, and the processor executes the program data stored in the memory to implement the above-mentioned audio noise reduction method.
[0014] In a fourth aspect, the present application provides a computer-readable storage medium having program instructions stored therein, and the program instructions are executed to implement the above-mentioned audio noise reduction method.
[0015] The beneficial effects of the present application are as follows: the audio noise reduction method of the present application collects a first noise signal by setting a first noise collection component on the dongle, then uses a second noise collection component on the headset to collect a second noise signal, and finally uses the first noise signal and the second noise signal to perform noise reduction processing on the audio signal. Because the physical distance between the dongle and the headset is relatively far, the low-frequency noise signals of the first noise signal collected by the first noise collection component and the second noise signal collected by the second noise component are different. When the audio signal played by the headset is subjected to noise reduction processing based on the first noise signal and the second noise signal, the noise reduction effect of the headset on the low-frequency noise signal can be improved, thereby improving the user's auditory experience. In addition, the dongle can also provide additional computing power for the headset to perform noise reduction processing on the audio signal, which can reduce the computing burden of the headset. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 This is a structural block diagram of an embodiment of the audio and video system of the present application;
[0017] Figure 2 This is a structural diagram of an embodiment of the audio and video system of the present application;
[0018] Figure 3 This is a flowchart of the first embodiment of the audio noise reduction method of the present application;
[0019] Figure 4 This is a flowchart of the second embodiment of the audio noise reduction method of the present application;
[0020] Figure 5 yes Figure 3 A schematic diagram of a specific flow chart of an embodiment of step S103;
[0021] Figure 6 yes Figure 5 A schematic diagram of a specific process of an embodiment of step S301;
[0022] Figure 7 yes Figure 5 A schematic diagram of a specific process of an embodiment of step S302;
[0023] Figure 8 This is a flowchart of the third embodiment of the audio noise reduction method of the present application;
[0024] Figure 9 This is a structural diagram of an embodiment of an electronic device of the present application;
[0025] Figure 10 It is a structural diagram of an embodiment of a computer-readable storage medium of the present application. DETAILED DESCRIPTION
[0026] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0027] With the development of headphone technology, users have higher and higher requirements for headphones, especially in the field of noise reduction of headphones. There are two types of noise reduction for headphones, namely passive noise reduction and active noise reduction. Passive noise reduction headphones are common in ordinary headphones. They can isolate external noise through slow-rebound sponge or silicone earmuffs, but the noise reduction effect is not good, especially for low and medium frequency noise signals. Active noise reduction headphones can handle low and medium frequency noise signals very well. By utilizing sound wave interference, active noise reduction headphones can collect noise through noise collection components (feedforward microphone and feedback microphone) and emit reverse sound waves to cancel out the noise.
[0028] Most of the active noise-cancelling headphones in the existing technology only use the noise collection components (feedforward microphone and feedback microphone) on the headphones to collect ambient noise signals for active noise reduction. When faced with low-frequency noise information with strong penetrating power, since the noise collection components on the headphones are extremely close in physical distance, they will receive almost the same low-frequency noise signals, resulting in the low-frequency noise signals not being considered as noise signals during noise reduction processing, causing users to be disturbed by external low-frequency noise signals, reducing the user experience.
[0029] In order to solve the above problems, this application first proposes an audio and video system. Figure 1 , Figure 1 This is a structural block diagram of an embodiment of the audio and video system of the present application. Figure 1 As shown, the audio and video system 100 of this embodiment includes headphones 10, VR glasses 20 and a dongle 30.
[0030] The VR glasses 20 are used to play video signals; the dongle 30 is plugged into the VR glasses 20, set away from the headphones 10, and communicates with the headphones 10; wherein, the dongle 30 is provided with a first noise collection component 31 for obtaining a first noise signal; the headphones 10 is provided with a second noise collection component 11 for obtaining a second noise signal, the dongle 30 and / or the headphones 10 perform noise reduction processing on the audio signal based on the first noise signal and the second noise signal, and the headphones 10 are used to play the audio signal after the noise reduction processing.
[0031] In this embodiment, the VR glasses 20 may be other terminal devices, such as a mobile phone or a computer device, etc., which are not limited here.
[0032] The dongle 30 is plugged into the VR glasses 20 and is used to communicate with the headset 10. The dongle 30 is a hardware and software encryption product that can be plugged into the parallel port of the VR glasses 20. The dongle 30 generally has tens or hundreds of bytes of non-volatile storage space for reading and writing, and a single-chip microcomputer can also be set up inside. Software developers can exchange data with the encryption lock through interface functions (i.e., read and write the dongle 30) to check whether the dongle 30 is plugged into the interface; or directly use the tools included with the dongle 30 to encrypt their own files. In this way, software developers can set multiple software locks in the software and use the dongle 30 as a key to open these locks; if the dongle 30 is not plugged in or the dongle 30 does not correspond, the software will not execute normally.
[0033] In this embodiment, the advantage of the dongle 30 being plugged into the VR glasses 20 and physically far away from the earphones 10 is utilized, and a first noise collection component 31 is provided on the dongle 30. The first noise collection component 31 is utilized to collect a first noise signal. The first noise signal includes ambient noise and noise signals of various frequency bands. Because the first noise collection component 31 is provided away from the earphones 10, the first noise signal collected by the first noise collection component 31 is different from the low-frequency noise signal of the second noise signal collected by the second noise collection component 11 on the earphones 10. Therefore, when the first noise signal and the second noise signal are input into the noise reduction algorithm model to perform noise reduction processing on the audio signal, the noise reduction effect of the earphones 10 on the low-frequency noise signal can be improved, and the impact of the low-frequency noise signal can be reduced. In this embodiment, the noise reduction algorithm model can adopt the more common LMS adaptive filtering noise reduction algorithm model, or other noise reduction algorithm models, which are not limited here.
[0034] When the earphones 10 and the dongle 30 are in communication, the second noise signal acquired by the earphones 10 is transmitted to the dongle 30 for processing. The first noise signal collected by the dongle 30 can also be processed by the dongle 30 itself. In this embodiment, the dongle 30 can be equipped with a partial noise reduction algorithm model, which can perform partial noise reduction processing on the first and second noise signals transmitted to the dongle 30 before transmitting them to the earphones 10 for further noise reduction processing. In other embodiments, the dongle 30 can also function as a data transmission device, transmitting only the first and second noise signals, or pre-processing the first and second noise signals before transmitting them to the earphones 10 for noise reduction processing.
[0035] The dongle 30 in this embodiment can not only obtain a better noise source, that is, the obtained first noise signal is different from the low-frequency noise signal of the second noise, but also provide additional computing power for the headset 10 to perform noise reduction processing on the audio signal, so that the processing of the newly obtained first noise signal does not bring a burden to the headset 10. If part of the noise reduction algorithm model is set in the dongle 30, it can also share the calculation of the headset 10.
[0036] See also Figure 2 , Figure 2 This is a structural diagram of an embodiment of the audio and video system of the present application. Figure 2 As shown, the VR glasses 20 in the audio and video system 100 of this embodiment can be virtual reality (VR) glasses for playing video signals. In other embodiments, the VR glasses 20 can also be other video playback mechanisms that play video signals, which is not limited here. The dongle 30 is plugged into the VR glasses 20 to prevent interference from the speakers of the headphones 10, ensuring that the low-frequency noise signal of the first noise signal collected by the first noise collection component 31 on the dongle 30 is different from the low-frequency noise signal of the second noise signal.
[0037] Optionally, in this embodiment, the first noise collecting component 31 of the dongle 30 and the second noise collecting component 11 of the headset 10 include microphones. In other embodiments, the first noise collecting component 31 and the second noise collecting component 11 may also be other noise collecting components, which is not limited here.
[0038] This application further proposes an audio noise reduction method, which uses the above-mentioned audio and video system 100. Figure 3 , Figure 3 This is a flow chart of the first embodiment of the audio noise reduction method of this application. Figure 3 As shown, the audio noise reduction method of this embodiment specifically includes steps S101 to S103:
[0039] Step S101: obtaining a first noise signal collected by the first noise collecting component 31 on the dongle.
[0040] The dongle 30 collects the first noise signal through the first noise collecting component 31. In this embodiment, taking the VR glasses 20 as an example, after the dongle 30 is plugged into the VR glasses 20, the dongle 30 is connected to the headset 10 for communication.
[0041] In this embodiment, the first noise collecting component 31 may be configured as a single feedforward microphone, and the dongle 30 collects the first noise signal through the feedforward microphone.
[0042] Step S102: Acquire a second noise signal collected by a second noise collecting component on the earphone.
[0043] After the earphone 10 is connected to the dongle 30, the earphone 10 sends the second noise signal collected by the second noise collection component 11 to the dongle 30, and the dongle 30 obtains the second noise signal collected by the earphone 10. The second noise collection component 11 can also be set as a single feedforward microphone.
[0044] Step S103: performing noise reduction processing on the audio signal played by the earphone based on the first noise signal and the second noise signal, so that the earphone plays the audio signal after the noise reduction processing.
[0045] If part or all of the noise reduction algorithm model is configured on the dongle 30, the dongle 30 can utilize the noise reduction algorithm model to perform noise reduction processing on the initial audio signal based on the first and second noise signals, and then transmit the processed audio signal to the earphones 10 for playback. In other embodiments, the dongle 30 may only pre-process the first and second noise signals, or the dongle 30 may only transmit the first and second noise signals.
[0046] Different from the prior art, the audio and video system 100 of the present application includes headphones 10, VR glasses 20 and a dongle 30. The dongle 30 is plugged into the VR glasses 20 and is physically far away from the headphones 10. The audio noise reduction method of the present application collects a first noise signal by setting a first noise collection component 31 on the dongle 30, and then uses the second noise collection component 11 on the headphones 10 to collect a second noise signal, and finally uses the first noise signal and the second noise signal to perform noise reduction processing on the audio signal. Because the first noise collection component 31 is set at a position far away from the headphones 10, the low-frequency noise signals of the obtained first noise signal and the second noise signal are different. When the audio signal is noise reduced based on the first noise signal and the second noise signal, the noise reduction effect of the low-frequency noise signal can be improved, thereby improving the user's auditory experience. Secondly, the dongle 30 can also provide additional computing power for the headphones 10 to perform noise reduction processing on the audio signal, which can reduce the computing burden of the headphones 10.
[0047] Optionally, see Figure 4 , Figure 4 This is a flow chart of the second embodiment of the audio noise reduction method of this application. Figure 4 As shown, the audio noise reduction method of this embodiment specifically includes steps S201 to S204:
[0048] Step S201: Obtain the wearing status of the headset and VR glasses.
[0049] Before using the first noise collection component 31 to collect the first noise signal, the audio and video system 100 first needs to detect the wearing status of the earphones 10 and the VR glasses 20. If they are not worn, there is no need to proceed to the next step. If the earphones 10 and the VR glasses 20 are detected to be worn, step S202 is performed.
[0050] Step S202: In response to the earphones and the VR glasses being in a wearing state, obtaining a first noise signal collected by a first noise collecting component of a dongle plugged into the VR glasses.
[0051] When the audio and video system 100 detects that the earphones 10 and the VR glasses 20 are in the wearing state, the first noise signal collected by the first noise collecting component 31 of the dongle 30 plugged into the VR glasses 20 is obtained.
[0052] Step S203: Acquire a second noise signal collected by a second noise collecting component on the earphone.
[0053] Step S203 is the same as step S102 and will not be described again.
[0054] Step S204: performing noise reduction processing on the audio signal played by the earphone based on the first noise signal and the second noise signal, so that the earphone plays the audio signal after the noise reduction processing.
[0055] Step S203 is the same as step S103 and will not be described again.
[0056] Optionally, the method for performing noise reduction processing on the audio signal is as follows: Figure 5 See Figure 5 , Figure 5 yes Figure 3 Specific flow chart of step S103 in an embodiment. Figure 5 As shown, this embodiment can be Figure 5 The method shown implements step S103, and the specific implementation steps include steps S301 to S303:
[0057] Step S301: obtaining a pure noise signal based on the first noise signal and the audio signal played by the earphone.
[0058] When the audio / video system 100 is in noise reduction mode, when performing noise reduction processing on an audio signal based on the first noise signal and the second noise signal, the first noise signal is first processed to obtain a pure noise signal. The pure noise signal can then be obtained by processing the first noise signal and the original audio signal. In this embodiment, an inverted audio signal can be superimposed on the first noise signal to obtain the pure noise signal.
[0059] Step S302: obtaining a feedforward noise reduction input signal of the audio signal based on the pure noise signal and the second noise signal.
[0060] After obtaining the pure noise signal, the second noise signal collected by the earphone 10 is processed with the pure noise to obtain a feedforward noise reduction input signal input into the noise reduction algorithm model. In this embodiment, the weight coefficients of the pure noise signal and the second noise signal can be set respectively to obtain the final feedforward noise reduction input signal.
[0061] Step S303: performing noise reduction processing on the audio signal based on the feedforward noise reduction input signal.
[0062] The dongle 30 obtains the feedforward noise reduction input signal and inputs it into the noise reduction algorithm model to obtain the reverse sound wave to perform noise reduction processing on the audio signal.
[0063] Optionally, a method for obtaining a pure noise signal is as follows: Figure 6 See Figure 6 , Figure 6 yes Figure 5 Detailed flow chart of step S301 in the embodiment. Figure 6 As shown, this embodiment can be Figure 6 The method shown implements step S301, and the specific implementation steps include steps S401 to S402:
[0064] Step S401: obtaining an inverted audio signal having the same amplitude and opposite phase as the audio signal based on the audio signal played by the earphone.
[0065] The dongle 30 first obtains the audio signal played by the earphone 10 and inverts the audio signal to obtain an inverted audio signal with the same amplitude and opposite phase as the audio signal.
[0066] Step S402: superimposing the inverted audio signal and the first noise signal to obtain a pure noise signal.
[0067] By superimposing an inverted audio signal with the same amplitude and opposite phase as the audio signal with the first noise signal, dongle 30 can remove the audio signal from the first noise signal, thereby obtaining a pure noise signal. The pure noise signal is the ambient noise signal without the audio signal. The ambient noise signal without the audio signal includes ambient noise in all frequency bands. However, because the first noise signal is physically far away from the earphone 10, the low-frequency noise signal in the pure noise signal obtained is different from that in the second noise signal. Therefore, inputting the pure noise signal and the second noise signal into the noise reduction algorithm model can improve the noise reduction effect on the low-frequency noise signal.
[0068] Different from the prior art, the present application uses the initial audio signal to process the first noise signal, removes the audio signal based on the first noise signal to obtain a pure noise signal, which can further improve the quality of the pure noise signal, thereby improving the noise reduction effect on the audio signal.
[0069] Optionally, the method for obtaining the feedforward noise reduction input signal is as follows: Figure 7 See Figure 7 , Figure 7 yes Figure 5 Detailed flow chart of step S302 in an embodiment. Figure 7 As shown, this embodiment can be Figure 7 The method shown implements step S302, and the specific implementation steps include steps S501 to S502:
[0070] Step S501: Obtain a first weight coefficient of a pure noise signal and a second weight coefficient of a second noise signal.
[0071] When calculating the feedforward noise reduction input signal, dongle 30 first obtains a first weight coefficient for the clean noise signal and a second weight coefficient for the second noise signal. The weights of the first and second weight coefficients can be preset based on the relative importance of the clean noise signal and the second noise signal, and are not limited herein.
[0072] Step S502: Calculating a feedforward noise reduction input signal based on the first weight coefficient, the second weight coefficient, the pure noise signal, and the second noise signal.
[0073] After obtaining the first weight coefficient of the pure noise signal and the second weight coefficient of the second noise signal, the dongle 30 may process the pure noise signal and the second noise signal based on the first weight coefficient and the second weight coefficient to obtain a feedforward noise reduction input signal.
[0074] In this embodiment, the pure noise signal and the second noise signal can be subjected to frequency domain analysis, and a first weight coefficient can be set for each sub-frequency band of the pure noise signal, where the first weight coefficients of each sub-frequency band can be the same or different; a second weight coefficient can be set for each sub-frequency band of the second noise signal, where the second weight coefficients of each sub-frequency band can be the same or different, and finally a calculation is performed to obtain the feedforward noise reduction input signal.
[0075] In other examples, frequency domain analysis may not be performed on the pure noise signal and the second noise signal. Instead, the first weight coefficient a of the pure noise signal y1(n) and the second weight coefficient b of the second noise signal y2(n) may be directly set to obtain the feedforward noise reduction input signal y(n) based on the following formula:
[0076] y(n)=ay1(n)+by2(n)
[0077] In other examples, the clean noise signal and the second noise signal can also be directly input into the noise reduction algorithm model as two inputs. Calculating the feedforward noise reduction input signal based on the first weight coefficient, the second weight coefficient, the clean noise signal, and the second noise signal can also be done using other methods, which are not limited here.
[0078] Optionally, in this embodiment, step S203 may be implemented by the following method. In this embodiment, the specific steps of implementing the noise reduction processing on the audio signal based on the feedforward noise reduction input signal include:
[0079] The noise reduction algorithm model is used to analyze the feedforward noise reduction input signal and generate a reverse sound wave with the opposite phase and the same amplitude as the feedforward noise reduction input signal to perform noise reduction on the audio signal.
[0080] The dongle 30 uses a noise reduction algorithm model to analyze the feedforward noise reduction input signal, generates a reverse sound wave with the opposite phase and the same amplitude as the feedforward noise reduction input signal, sends it to the earphone 10, and superimposes it with the original audio signal to obtain the noise-reduced audio signal. The earphone 10 plays the noise-reduced audio signal.
[0081] Optionally, see Figure 8 , Figure 8This is a flow chart of the third embodiment of the audio noise reduction method of the present application. Figure 8 As shown, the audio noise reduction method of this embodiment specifically includes steps S601 to S605:
[0082] Step S601: Acquire a first noise signal collected by a first noise collecting component on a dongle.
[0083] Step S601 is the same as step S101 and will not be described again.
[0084] Step S602: Acquire a second noise signal collected by a second noise collecting component on the earphone.
[0085] Step S602 is the same as step S102 and will not be described again.
[0086] Step S603: Determine whether the earphone is in voice mode.
[0087] The dongle 30 determines whether the earphone 10 is in the voice mode.
[0088] If the earphone 10 is in the voice mode, the process goes to step S604 ; if the earphone 10 is not in the voice mode, the process goes to step S606 .
[0089] Step S604: confirming that the earphone is in voice mode, extracting a human voice signal in the human voice frequency band from the first noise signal, and enhancing the human voice signal.
[0090] When it is confirmed that the headset 10 is in the human voice mode, in addition to performing noise reduction processing on the audio signal, the dongle 30 also extracts the collected first noise signal to obtain the human voice signal in the human voice frequency band and enhances the human voice signal in the human voice frequency band.
[0091] Step S605: superimposing the enhanced human voice signal and the audio signal to obtain the audio signal in the human voice mode, so that the earphone plays the audio signal in the human voice mode.
[0092] In this embodiment, the enhanced human voice signal can be superimposed on the audio signal in the dongle 30 to obtain the audio signal in the human voice mode, and the audio signal can be sent to the earphone 10 so that the earphone 10 plays the audio signal in the human voice mode. In other embodiments, the earphone 10 can also be used to superimpose the enhanced human voice signal on the audio signal to obtain the audio signal in the human voice mode, which is not limited here.
[0093] Step S606: performing noise reduction processing on the audio signal based on the first noise signal and the second noise signal, so that the earphone plays the audio signal after the noise reduction processing.
[0094] On the one hand, when the earphone 10 is in the human voice mode, the dongle 30 can perform noise reduction processing on the audio signal in the human voice mode based on the first noise signal and the second noise signal, so that the earphone 10 plays the audio signal after noise reduction processing in the human voice mode; on the other hand, the dongle 30 can also perform noise reduction processing on the audio signal in the non-human voice mode based on the first noise signal and the second noise signal, so that the earphone 10 plays the audio signal after noise reduction processing.
[0095] Optionally, this application further proposes an electronic device, see Figure 9 , Figure 9 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 200 includes a processor 201 and a memory 202 connected to the processor 201 .
[0096] Processor 201 may also be referred to as a CPU (Central Processing Unit). Processor 201 may be an integrated circuit chip with signal processing capabilities. Processor 201 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. A general-purpose processor may be a microprocessor or any conventional processor.
[0097] The memory 202 is used to store program data required for the processor 201 to run.
[0098] The processor 201 is further configured to execute program data stored in the memory 202 to implement the above-mentioned audio noise reduction method.
[0099] Optionally, the present application further proposes a computer-readable storage medium. Figure 10 , Figure 10 It is a structural diagram of an embodiment of a computer-readable storage medium of the present application.
[0100] The computer-readable storage medium 300 of the embodiment of the present application stores program instructions 310 therein, and the program instructions 310 are executed to implement the above-mentioned audio noise reduction method.
[0101] The program instructions 310 may be stored in the aforementioned storage medium in the form of a program file as a software product, so that an electronic device (which may be a personal computer, server, or network device, etc.) or a processor executes all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc., various media that can store program code, or a computer, server, mobile phone, tablet, etc.
[0102] The computer-readable storage medium 300 in this embodiment may be, but is not limited to, a USB flash drive, an SD card, a PD optical drive, a mobile hard drive, a large-capacity floppy drive, a flash memory, a multimedia memory card, a server, and the like.
[0103] In one embodiment, a computer program product or computer program is provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform the steps of each of the above method embodiments.
[0104] In addition, if the above functions are implemented as software functions and sold or used as independent products, they can be stored in a storage medium readable by a mobile terminal. That is, the present application also provides a storage device storing program data, which can be executed to implement the methods of the above embodiments. The storage device can be, for example, a USB flash drive, an optical disk, a server, etc. In other words, the present application can be embodied in the form of a software product, which includes a number of instructions for causing a smart terminal to execute all or part of the steps of the methods described in each embodiment.
[0105] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of such features. Throughout the description of this application, "plurality" means at least two, for example, two, three, etc., unless otherwise specifically defined.
[0106] Any process or method description in a flowchart or otherwise described herein may be understood to represent a mechanism, segment or portion of code comprising one or more executable instructions for implementing a specific logical function or process step, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed in a sequence other than as shown or discussed, including performing functions in a substantially simultaneous manner or in a reverse order depending on the functions involved, as should be understood by those skilled in the art to which the embodiments of the present application pertain.
[0107] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (which can be a personal computer, server, network device, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and a portable compact disc read-only memory (CDROM). Furthermore, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing it in another suitable manner if necessary, and then storing it in a computer memory.
[0108] The above description is merely an embodiment of the present application and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. An audio noise reduction method, characterized in that: Applied to audio and video systems, the audio and video system includes headphones, VR glasses and a dongle, the VR glasses are used to play video signals; The dongle is plugged into the VR glasses, is located away from the headset, and communicates with the headset; The audio noise reduction method comprises: Acquire a first noise signal collected by a first noise collection component on the dongle; Acquiring a second noise signal collected by a second noise collecting component on the headset; performing noise reduction processing on the audio signal played by the earphone based on the first noise signal and the second noise signal, so that the earphone plays the audio signal after the noise reduction processing; The performing noise reduction processing on the audio signal played by the earphone based on the first noise signal and the second noise signal includes: A pure noise signal is obtained based on the first noise signal and the audio signal played by the earphone; a feedforward noise reduction input signal of the audio signal is obtained based on the pure noise signal and the second noise signal; and noise reduction processing is performed on the audio signal based on the feedforward noise reduction input signal.
2. The audio noise reduction method according to claim 1, wherein: Before the step of obtaining the first noise signal collected by the first noise collecting component on the dongle, the method further includes: Obtaining the wearing status of the headset and the VR glasses; In response to the earphones and the VR glasses being in a wearing state, the first noise signal collected by the first noise collecting component of the dongle plugged into the VR glasses is obtained.
3. The audio noise reduction method according to claim 1, wherein: The obtaining of a pure noise signal based on the first noise signal and the audio signal played by the earphone includes: Acquire, based on the audio signal played by the earphone, an inverted audio signal having the same amplitude and opposite phase as the audio signal; The inverted audio signal is superimposed on the first noise signal to obtain the pure noise signal.
4. The audio noise reduction method according to claim 1, wherein: The step of obtaining the feedforward noise reduction input signal of the audio signal based on the pure noise signal and the second noise signal includes: Obtaining a first weight coefficient of the pure noise signal and a second weight coefficient of the second noise signal; The feedforward noise reduction input signal is calculated based on the first weight coefficient, the second weight coefficient, the clean noise signal, and the second noise signal.
5. The audio noise reduction method according to claim 1, wherein: The performing noise reduction processing on the audio signal based on the feedforward noise reduction input signal comprises: The feedforward noise reduction input signal is analyzed using a noise reduction algorithm model to generate a reverse sound wave with a phase opposite to that of the feedforward noise reduction input signal and the same amplitude as that of the feedforward noise reduction input signal, so as to perform noise reduction processing on the audio signal.
6. The audio noise reduction method according to claim 1, wherein: Before the step of performing noise reduction processing on the audio signal based on the first noise signal and the second noise signal so that the earphone plays the audio signal after the noise reduction processing, the method further includes: Determine whether the headset is in voice mode; confirming that the earphone is in voice mode, extracting a human voice signal in a human voice frequency band from the first noise signal, and enhancing the human voice signal; The enhanced human voice signal is superimposed on the audio signal to obtain the audio signal in the human voice mode, so that the earphone plays the audio signal in the human voice mode.
7. The audio noise reduction method according to claim 6, characterized in that: The step of superimposing the enhanced human voice signal and the audio signal to obtain the audio signal in the human voice mode includes: The enhanced human voice signal and the audio signal are superimposed on the dongle or the headset.
8. An electronic device, characterized in that: The electronic device includes a processor and a memory connected to the processor, wherein the memory stores program data, and the processor executes the program data stored in the memory to implement the audio noise reduction method according to any one of claims 1 to 7.
9. An audio and video system, characterized in that: The audio and video include: earphone; VR glasses; A dongle, plugged into the VR glasses and connected to the headset; The dongle is provided with a first noise collection component for acquiring a first noise signal; the headset is provided with a second noise collection component for acquiring a second noise signal; the dongle and / or the headset performs noise reduction processing on an audio signal based on the first noise signal and the second noise signal; and the headset is used to play the audio signal after the noise reduction processing; The performing noise reduction processing on the audio signal played by the earphone based on the first noise signal and the second noise signal includes: A pure noise signal is obtained based on the first noise signal and the audio signal played by the earphone; a feedforward noise reduction input signal of the audio signal is obtained based on the pure noise signal and the second noise signal; and noise reduction processing is performed on the audio signal based on the feedforward noise reduction input signal.
10. The audio and video system according to claim 9, characterized in that: The first noise collecting component and the second noise collecting component include microphones.
11. A computer-readable storage medium, characterized in that Program instructions are stored therein, and the program instructions are executed to implement the audio noise reduction method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Noise reduction method and device of earphone, electronic equipment and storage medium
CN114390390A
Audio device, audio system, and audio processing method
US20200351584A1
Audio playback method, audio playback apparatus, and electronic device
WO2022022536A1