Audio processing method, device, equipment and audio calibration system

Abstract

An embodiment of the present application provides an audio processing method, apparatus, device and audio calibration system, the method comprising: obtaining the current working mode of an audio playback device; determining a target filter curve according to the working mode; filtering an original audio signal to be played by the audio playback device according to the target filter curve to obtain a target audio signal adapted to the working mode; and playing the target audio signal.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the technical field of audio processing, and more specifically, to an audio processing method, apparatus, and audio playback device, and also to an audio calibration system. Background Art

[0002] Existing audio playback devices, such as mobile phones, glasses legs of smart glasses, virtual reality devices and augmented reality devices, usually have serious sound leakage when playing audio signals at a low volume or in call mode, which interferes with surrounding users and may cause privacy leaks; at the same time, when the audio playback device is in a noisy environment, the audio playback device based on traditional audio processing solutions may also have the problem of unclear audio signals or poor audio quality due to the use of noise reduction processing. Summary of the invention

[0003] An object of the present disclosure is to provide a new technical solution for audio processing, so as to reduce the sound leakage problem and the poor sound quality problem that may exist when an audio playback device plays an audio signal.

[0004] According to a first aspect of the present disclosure, an embodiment of an audio processing method is provided, comprising:

[0005] Get the current working mode of the audio playback device;

[0006] According to the working mode, determining a target filter curve;

[0007] According to the target filter curve, filtering is performed on the original audio signal to be played by the audio playback device to obtain a target audio signal adapted to the working mode;

[0008] The target audio signal is played.

[0009] Optionally, the operating mode includes a first operating mode for near-field playback of an audio signal;

[0010] Determining a target filter curve according to the working mode includes:

[0011] When the working mode is the first working mode, obtaining a first gain curve and a second gain curve, wherein the first gain curve is a pre-acquired gain curve for preventing leakage of audio signals in the far field and improving near-field sound quality, and the second gain curve is a sound field gain curve determined according to user characteristics, and the user characteristics are characteristics of a user using the audio playback device;

[0012] The first gain curve is subtracted from the second gain curve to obtain the target filter curve.

[0013] Optionally, after the step of playing the target audio signal, the method further includes:

[0014] Collecting a reflected audio signal corresponding to the target audio signal, wherein the reflected audio signal includes an audio signal generated by the user's head reflecting the target audio signal;

[0015] Obtaining leakage volume quantification data reflecting the amount of leakage sound change according to the reflected audio signal;

[0016] The playback volume of the target audio signal is adjusted according to the leakage volume quantization data.

[0017] Optionally, the operating mode includes a second operating mode for far-field audio playback;

[0018] Determining a target filter curve according to the working mode includes:

[0019] When the working mode is the second working mode, obtaining user characteristics of a user using the audio playback device;

[0020] According to the user characteristics, obtaining preset audio speaker parameters;

[0021] The target filter curve is determined according to the audio speaker parameters.

[0022] Optionally, the working mode further includes a third working mode for performing audio calibration;

[0023] The first gain curve is obtained by the following steps:

[0024] When the audio playback device is in the third working mode, controlling at least one speaker of the audio playback device to play a first calibration audio signal;

[0025] Acquire a phase difference curve corresponding to the first calibration audio signal provided by an electronic device, wherein the electronic device is communicatively connected to the audio playback device and is used to generate the phase difference curve according to at least one first far-field audio signal collected in the far field and corresponding to the first calibration audio signal respectively played by the at least one speaker;

[0026] The first gain curve is generated according to the phase difference curve and the first calibration audio signal.

[0027] Optionally, generating the first gain curve according to the phase difference curve and the first calibration audio signal includes:

[0028] generating a second calibration audio signal according to the phase difference curve;

[0029] Controlling the audio playback device to simultaneously play the first calibration audio signal and the second calibration audio signal through the at least one speaker;

[0030] The first gain curve generated by the electronic device according to a near-field audio signal collected in the near field and corresponding to the first calibration audio signal and the second calibration audio signal is obtained.

[0031] Optionally, the working mode further includes a third working mode for performing audio calibration;

[0032] The audio speaker parameters are obtained by the following steps:

[0033] When the audio playback device is in the third working mode, controlling at least one speaker of the audio playback device to play a first calibration audio signal;

[0034] The audio external speaker parameter generated by the electronic device based on at least one second far-field audio signal collected in the far field and corresponding to the first calibration audio signal played respectively by the at least one speaker is obtained.

[0035] According to a second aspect of the present disclosure, there is provided an embodiment of an audio processing device, comprising:

[0036] A working mode acquisition module is used to obtain the working mode of the audio playback device at the current moment;

[0037] A filter curve determination module, used to determine a target filter curve according to the working mode;

[0038] An audio processing module, configured to filter the original audio signal to be played by the audio playback device according to the target filter curve to obtain a target audio signal adapted to the working mode;

[0039] The playing module is used to play the target audio signal.

[0040] According to a third aspect of the present disclosure, an embodiment of an audio playback device is provided, including the apparatus according to the second aspect of the present disclosure, or the audio playback device includes:

[0041] A memory for storing executable computer programs;

[0042] A processor is used to run the audio playback device to execute the method described in the first aspect of the present disclosure under the control of the computer program.

[0043] According to a fourth aspect of the present disclosure, an embodiment of an audio calibration system is provided, comprising:

[0044] Audio playback devices and electronic devices;

[0045] The audio playback device is configured to play a first calibration audio signal through at least one speaker when in a third working mode; receive audio calibration information provided by the electronic device in response to the first calibration audio signal, wherein the audio calibration information includes at least one of a phase difference curve, a first gain curve, and an audio external speaker parameter;

[0046] The electronic device is used to collect, in the far field or near field, a far-field audio signal and / or a near-field audio signal respectively corresponding to the first calibration audio signal played by the at least one speaker to generate the audio calibration information.

[0047] One beneficial effect of the embodiments of the present disclosure is that, according to the embodiments of the present disclosure, by obtaining the working mode of the audio playback device at the current moment, and determining the target filter curve based on the working mode; then, according to the target filter curve, the original audio signal to be played is filtered, so that the audio playback device can play the target audio signal adapted to the current working mode, so as to reduce the possible sound leakage and poor sound quality problems when the audio playback device plays the audio signal.

[0048] Other features and advantages of the present specification will become apparent from the following detailed description of exemplary embodiments of the present specification with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the specification and, together with the description, serve to explain the principles of the specification.

[0050] Figure 1 It is a schematic diagram showing the hardware structure of an audio playback device that can be used to implement the audio processing method of an embodiment of the present disclosure.

[0051] Figure 2 It is a flowchart of the audio processing method provided by an embodiment of the present disclosure.

[0052] Figure 3 3 is a schematic diagram of sound field comparison of the audio playback device provided in the second working mode according to an embodiment of the present disclosure.

[0053] Figure 4 3 is a schematic diagram comparing the first audio leakage amount of the audio playback device provided by an embodiment of the present disclosure in the second working mode.

[0054] Figure 53 is a schematic diagram comparing the second audio leakage amount of the audio playback device provided by an embodiment of the present disclosure in the second working mode.

[0055] Figure 6 It is a block diagram of an audio processing device provided by an embodiment of the present disclosure.

[0056] Figure 7 It is a schematic diagram of the hardware structure of another audio playback device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0057] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless otherwise specifically stated.

[0058] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

[0059] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0060] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0061] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0062] <Hardware Configuration>

[0063] Figure 1 It is a schematic diagram showing the hardware structure of an audio playback device that can be used to implement the audio processing method of an embodiment of the present disclosure.

[0064] The audio playback device 1000 may be a smart phone, the temples of smart glasses, a virtual reality device, an augmented reality device, or the like, which is not limited here.

[0065] The audio playback device 1000 may include, but is not limited to, a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and the like. Among them, the processor 1100 may be a central processing unit CPU, a graphics processing unit GPU, a microprocessor MCU, and the like, and is used to execute a computer program, and the computer program may be written in an instruction set of an architecture such as x86, Arm, RISC, MIPS, SSE, and the like. The memory 1200 may include, for example, a ROM (read-only memory), a RAM (random access memory), a non-volatile memory such as a hard disk, and the like. The interface device 1300 may include, for example, a USB interface, a serial interface, a parallel interface, and the like. The communication device 1400 may, for example, be capable of wired communication using an optical fiber or a cable, or wireless communication, and may specifically include WiFi communication, Bluetooth communication, 2G / 3G / 4G / 5G communication, and the like. The display device 1500 may, for example, be a liquid crystal display screen, a touch display screen, and the like. The input device 1600 may, for example, include a touch screen, a keyboard, a somatosensory input, and the like. The speaker 1700 is used to output audio signals. The microphone 1800 is used to collect audio signals.

[0066] As used in the embodiments of the present disclosure, the memory 1200 of the audio playback device 1000 is used to store a computer program, which is used to control the processor 1100 to operate to implement the method according to the embodiments of the present disclosure. A technician can design the computer program according to the scheme disclosed in the present disclosure. How the computer program controls the processor to operate is well known in the art, so it will not be described in detail here. The audio playback device 1000 can be installed with an intelligent operating system (such as Windows, Linux, Android, IOS, etc.) and application software.

[0067] It should be understood by those skilled in the art that although Figure 1 , multiple devices of the audio playback device 1000 are shown, but the audio playback device 1000 of the embodiment of the present disclosure may only involve some of the devices, for example, only the processor 1100 and the memory 1200, etc.

[0068] <Method Example>

[0069] Please see Figure 2 , which is a flowchart of an audio processing method provided by an embodiment of the present disclosure, the method can be implemented by an audio playback device, for example, by Figure 1 The audio playback device 1000 is shown implemented as such.

[0070] like Figure 2 As shown, the method provided in this embodiment may include the following steps S2100-S2400, which are described in detail below.

[0071] Step S2100, obtaining the current working mode of the audio playback device.

[0072] Specifically, in the embodiments of the present disclosure, according to different ways in which the audio playback device plays the audio signal, the working mode of the audio playback device may be a first working mode, a second working mode, and a third working mode.

[0073] The first working mode, also known as the sound field privacy mode, refers to a working mode in which the audio playback device plays audio signals at a low volume or uses a handset in a call mode; the second working mode, also known as the audio external speaker mode, refers to a working mode in which the audio playback device plays audio signals at a high volume based on at least one speaker; the third working mode, also known as the audio calibration mode, is used to generate an original audio signal to be played for calibrating the audio playback device in a pre-built audio calibration system, so as to generate audio calibration information that matches the target sound field and can avoid far-field leakage volume.

[0074] In a specific implementation, the working mode of the audio playback device can be obtained when the user clicks a mode switching button. For example, the user can adjust and obtain the working mode of the audio playback device by clicking a mode switching menu provided in the audio playback device.

[0075] It should be noted that, in a specific implementation, the working mode of the audio playback device may also be automatically switched by the audio playback device according to the distance between the audio playback device and the user's ear and / or the current playback volume, which is not specifically limited here.

[0076] Step S2200: determining a target filter curve according to the working mode.

[0077] In an embodiment of the present disclosure, after determining the working mode of the audio playback device, a target filter curve for filtering the original audio signal to be played can be generated based on the audio calibration information pre-obtained in the audio calibration system and matching the current working mode, for example, a first gain curve for reducing the amount of far-field leakage of the audio signal, and then the original audio signal is filtered according to the target filter curve to obtain the target audio signal. In the following, how to determine the target filter curve is described according to the different working modes of the audio playback device.

[0078] In one embodiment, the working mode includes a first working mode for near-field playback of audio signals; determining the target filter curve according to the working mode includes: when the working mode is the first working mode, obtaining a first gain curve and a second gain curve, wherein the first gain curve is a pre-acquired gain curve for avoiding leakage of audio signals in the far field and improving near-field sound quality, and the second gain curve is a sound field gain curve determined according to user characteristics, and the user characteristics are characteristics of a user using the audio playback device; subtracting the first gain curve from the second gain curve to obtain the target filter curve.

[0079] Specifically, the first gain curve can be a pre-calibrated curve. Based on the first gain curve, the phase of the audio signal that is easily transmitted in the far field can be offset, thereby avoiding the interference of the audio signal played by the audio playback device in the far field to the surrounding users and the possible leakage of user privacy.

[0080] The second gain curve may be a sound field gain curve determined based on user characteristics, which adjusts the phase, frequency range and gain of the original audio signal so that the target audio signal can present a sound field (soundfield) that matches the user characteristics. In an embodiment of the present disclosure, the user characteristics may be information about the target sound field that the user likes in the second working mode.

[0081] In addition, in one embodiment, the working mode includes a second working mode for far-field audio playback; determining the target filter curve based on the working mode includes: when the working mode is the second working mode, obtaining user characteristics of a user using the audio playback device; based on the user characteristics, obtaining preset audio playback parameters; and determining the target filter curve based on the audio playback parameters.

[0082] In one embodiment, the working mode also includes a third working mode for performing audio calibration. The third working mode can be used to calibrate and obtain the above-mentioned first calibration audio signal, audio speaker parameters and other audio calibration information based on a pre-built audio calibration system.

[0083] Specifically, the audio calibration system may include the audio playback device and an electronic device, the audio playback device is used to play the first calibration audio signal through at least one speaker when in the third working mode; and receive audio calibration information provided by the electronic device in response to the first calibration audio signal, the audio calibration information may specifically include at least one of a phase difference curve, a first gain curve and an audio external speaker parameter; the electronic device can be used to collect far-field audio signals and / or near-field audio signals corresponding to the first calibration audio signal played by the at least one speaker in the far field or near field to generate the above-mentioned audio calibration information. In the following, firstly, how to calibrate and obtain the above-mentioned first gain curve based on the audio calibration system when the audio playback device is in the third working mode is described in detail.

[0084] In one embodiment, the first gain curve can be obtained through the following steps: step S2211, when the audio playback device is in the third working mode, controlling at least one speaker of the audio playback device to play a first calibration audio signal; step S2212, obtaining a phase difference curve corresponding to the first calibration audio signal provided by an electronic device, wherein the electronic device is communicatively connected to the audio playback device and is used to generate the phase difference curve based on at least one first far-field audio signal collected in the far field and corresponding to the first calibration audio signal played by at least one speaker respectively; step S2213, generating a first gain curve based on the phase difference curve and the first calibration audio signal.

[0085] In an embodiment of the present disclosure, the first calibration audio signal may be at least one of a sine-cosine swept frequency signal, white noise, and pink noise.

[0086] The following takes the example that the audio playback device is a mobile phone including two sound outlets, namely, sound outlet A and sound outlet B, and the electronic device is a personal computer, and the mobile phone and the personal computer are connected via Bluetooth to explain how to obtain the first gain curve.

[0087] For example, the mobile phone can be adjusted to a third working mode, namely, an audio calibration mode, in which the mobile phone is controlled to play white noise through sound outlet A and sound outlet B respectively; the personal computer can obtain the audio signal PA of the white noise played by the corresponding sound outlet A and the audio signal PB of the white noise played by the corresponding sound outlet B respectively in the far field through a microphone, and obtain a phase difference curve that can offset the far-field phase by performing phase analysis on the PA and PB locally; after obtaining the phase difference curve, the personal computer can send the phase difference curve to the mobile phone in a Bluetooth communication manner, so that the mobile phone can generate an audio signal that can offset the far-field phase based on the phase difference curve, and can also further perform near-field calibration processing on the audio signal based on the phase difference curve to improve the clarity and volume of the near-field audio signal.

[0088] In this embodiment, generating a first gain curve based on the phase difference curve and the first calibration audio signal includes: generating a second calibration audio signal based on the phase difference curve; controlling an audio playback device to simultaneously play the first calibration audio signal and the second calibration audio signal through at least one speaker; and obtaining a first gain curve generated by the electronic device based on a near-field audio signal collected in the near field and corresponding to the first calibration audio signal and the second calibration audio signal.

[0089] Here, we still take the audio playback device as the above-mentioned mobile phone and the electronic device as the above-mentioned personal computer as an example. After the personal computer provides the generated phase difference curve for offsetting the far-field phase to the mobile phone, the personal computer can be moved to the near field range of the mobile phone; thereafter, the mobile phone generates a second calibration audio signal based on the phase difference curve, and thereafter, the mobile phone can simultaneously play the first calibration audio signal and the second calibration audio signal through sound outlet A and sound outlet B; the personal computer collects the near-field audio signals corresponding to the first calibration audio signal and the second calibration audio signal played by the two sound outlets through a microphone in the near-field range, and obtains a first gain curve corresponding to improving the sound quality and volume of the audio signal in the near field by locally analyzing it.

[0090] In addition, in one embodiment, the audio playback parameters can be obtained through the following steps: step S2221, when the audio playback device is in the third working mode, controlling at least one speaker of the audio playback device to play a first calibration audio signal; step S2222, obtaining the audio processing parameters generated by the electronic device based on at least one second far-field audio signal corresponding to the first calibration audio signal respectively played by at least one speaker collected in the far field.

[0091] For detailed processing on how to determine the audio speaker parameters, please refer to the above description of obtaining the first gain curve, which will not be repeated here.

[0092] Step S2300, filtering the original audio signal to be played by the audio playback device according to the target filter curve to obtain a target audio signal adapted to the working mode; and step S2400, playing the target audio signal.

[0093] Specifically, after the target filter curve corresponding to the current working mode is determined through the above steps, the audio processing module in the audio playback device can call the target filter curve to filter the original audio signal to be played in real time, for example, adjust the phase of the original audio signal, and obtain the target audio signal based on the filter division frequency range and gain value, and then play the target audio signal based on at least one speaker of the audio playback device.

[0094] Please see Figure 3-Figure 5 , which are respectively used to illustrate a sound field comparison diagram of the audio playback device in the second working mode, a first audio leakage comparison diagram in the second working mode, and a second audio leakage comparison diagram in the second working mode, wherein, Figure 4 It is a schematic diagram formed by collecting far-field side leakage test data of the audio playback device in the second working mode, that is, the sound field privacy mode, before and after implementing the method provided in this embodiment. Figure 5 The diagram is a schematic diagram formed by collecting the far-field back leakage test data of the audio playback device in the second working mode before and after the implementation of the method provided in this embodiment. Figure 3-Figure 5 It can be seen from the shown content that the audio processing method provided by the embodiment of the present disclosure can provide a sound field effect that is extremely close to the target sound field, and can also significantly reduce the leakage of audio signals played by the audio playback device, thereby avoiding interference with surrounding users and privacy leakage problems that may be caused by audio signal leakage.

[0095] In one embodiment, when the working mode of the audio playback device at the current moment is the first working mode, that is, the sound field privacy mode, after the step of playing the target audio signal, the method also includes: collecting a reflected audio signal corresponding to the target audio signal, wherein the reflected audio signal includes an audio signal generated by the user's head reflecting the target audio signal; obtaining leakage volume quantification data reflecting the change in leakage sound based on the reflected audio signal; and adjusting the playback volume of the target audio signal based on the leakage volume quantification data.

[0096] Specifically, because the volume will decrease accordingly when the audio playback device deviates from the user's ear to a certain extent, the built-in microphone in the audio playback device can be used to collect the reflected audio signal, that is, the leakage volume, in real time. Because when the audio playback device is far away from the user's head, the amount of leakage sound reflected by the user's head will increase, so a real-time feedback module can be set in the audio playback device, and the real-time feedback module obtains the reflected audio signal corresponding to the currently played target audio signal collected by the audio playback device in the near field to detect and obtain leakage volume quantification data reflecting the change in the leakage sound; then, the leakage volume quantification data is sent to the audio processing module in the audio playback device, so that the audio processing module adjusts the gain of the target audio signal accordingly according to the leakage volume quantification data, so as to automatically increase the volume when the audio playback device is far away from the user's ear, and automatically reduce the volume when the audio playback device is close to the user's ear, so as to improve the clarity of the target audio signal played by the audio playback device.

[0097] In summary, the audio processing method provided by the embodiments of the present disclosure obtains the current working mode of the audio playback device and determines the target filter curve based on the working mode; then, according to the target filter curve, the original audio signal to be played is filtered, so that the audio playback device can play the target audio signal adapted to the current working mode, so as to reduce the possible sound leakage and poor sound quality problems when the audio playback device plays the audio signal.

[0098] <Device Example>

[0099] Figure 6 is a principle block diagram of an audio processing device provided by an embodiment of the present disclosure. The audio processing device can be applied to an audio playback device, for example, Figure 1 In the audio playback device 1000 shown in FIG. Figure 6 As shown, the audio processing device may include: a working mode acquisition module 6100 , a filter curve determination module 6200 , an audio processing module 6300 and a playing module 6400 .

[0100] The working mode acquisition module 6100 is used to obtain the working mode of the audio playback device at the current moment.

[0101] The filter curve determination module 6200 is used to determine a target filter curve according to the working mode.

[0102] In one embodiment, the working mode includes a first working mode for near-field playback of audio signals. When the filter curve determination module 6200 determines the target filter curve according to the working mode, it can be used to: when the working mode is the first working mode, obtain a first gain curve and a second gain curve, wherein the first gain curve is a pre-obtained gain curve for avoiding leakage of audio signals in the far field and improving near-field sound quality, and the second gain curve is a sound field gain curve determined according to user characteristics, and the user characteristics are characteristics of users using the audio playback device; subtract the first gain curve from the second gain curve to obtain the target filter curve.

[0103] In one embodiment, the working mode includes a second working mode for far-field audio playback; when the filter curve determination module 6200 determines the target filter curve according to the working mode, it can be used to: when the working mode is the second working mode, obtain user characteristics of a user using the audio playback device; according to the user characteristics, obtain preset audio external parameters; according to the audio external parameters, determine the target filter curve.

[0104] In one embodiment, the working mode also includes a third working mode for performing audio calibration; the device also includes an audio calibration module, which is used to control at least one speaker of the audio playback device to play a first calibration audio signal when the audio playback device is in the third working mode; obtain a phase difference curve corresponding to the first calibration audio signal provided by an electronic device, wherein the electronic device is communicatively connected to the audio playback device and is used to generate a phase difference curve based on at least one first far-field audio signal collected in the far field and corresponding to the first calibration audio signal played by at least one speaker respectively; and generate a first gain curve based on the phase difference curve and the first calibration audio signal.

[0105] In one embodiment, when the audio calibration module generates a first gain curve based on the phase difference curve and the first calibration audio signal, it can be used to: generate a second calibration audio signal based on the phase difference curve; control the audio playback device to simultaneously play the first calibration audio signal and the second calibration audio signal through at least one speaker; and obtain a first gain curve generated by the electronic device based on a near-field audio signal collected in the near field and corresponding to the first calibration audio signal and the second calibration audio signal.

[0106] In one embodiment, the audio calibration module is also used to control at least one speaker of the audio playback device to play a first calibration audio signal when the audio playback device is in a third working mode; and obtain audio external playback parameters generated by the electronic device based on at least one second far-field audio signal corresponding to the first calibration audio signal respectively played by at least one speaker collected in the far field.

[0107] The audio processing module 6300 is used to filter the original audio signal to be played by the audio playback device according to the target filter curve to obtain a target audio signal adapted to the working mode.

[0108] The playing module 6400 is used to play the target audio signal.

[0109] In one embodiment, the device 6000 also includes a real-time feedback module, which is used to: after playing the target audio signal, collect a reflected audio signal corresponding to the target audio signal, wherein the reflected audio signal includes an audio signal generated by the user's head reflecting the target audio signal; based on the reflected audio signal, obtain leakage volume quantification data reflecting the amount of leakage sound change; based on the leakage volume quantification data, adjust the playback volume of the target audio signal.

[0110] <Equipment Embodiment>

[0111] Corresponding to the above method embodiment, this embodiment also provides an audio processing device, please refer to Figure 7 , which is a schematic diagram of the hardware structure of another audio playback device provided in an embodiment of the present disclosure.

[0112] like Figure 7 As shown, the audio playback device 7000 includes a memory 7100 and a processor 7200, wherein the memory 7100 is used to store an executable computer program, and the processor 7200 is used to run the audio playback device to execute an audio processing method such as any of the above method embodiments under the control of the computer program.

[0113] <System Embodiment>

[0114] Corresponding to the above-mentioned method, apparatus and device embodiments, this embodiment also provides an audio calibration system, which includes an audio playback device and an electronic device; the audio playback device is used to play a first calibration audio signal through at least one speaker when in a third working mode; the audio calibration information provided by the receiving electronic device in response to the first calibration audio signal, wherein the audio calibration information includes a phase difference curve, a first gain curve and at least one of audio external speaker parameters; the electronic device is used to collect far-field audio signals and / or near-field audio signals corresponding to the first calibration audio signal played by at least one speaker in the far field or near field to generate the audio calibration information.

[0115] One or more embodiments of the present specification may be a system, method and / or computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present specification.

[0116] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0117] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0118] The computer program instructions for performing the operation of the embodiments of this specification may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, executed as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In certain embodiments, by utilizing the state information of a computer-readable program instruction to customize an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA) or a programmable logic array (PLA), the electronic circuit may execute a computer-readable program instruction, thereby realizing various aspects of this specification.

[0119] Various aspects of this specification are described herein with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of this specification. It should be understood that each box in the flowchart and / or block diagram and the combination of boxes in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0120] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0121] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0122] The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to the multiple embodiments of this specification. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of an instruction, and a part of a module, a program segment or an instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that it is equivalent to implement it by hardware, implement it by software, and implement it by combining software and hardware.

[0123] The embodiments of the present specification have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The choice of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the marketplace, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein. The scope of this application is defined by the appended claims.

Claims

1. An audio processing method, characterized in that: include: Acquire a current working mode of the audio playback device, where the working mode includes a first working mode for near-field playback of audio signals; According to the working mode, determining a target filter curve; According to the target filter curve, filtering is performed on the original audio signal to be played by the audio playback device to obtain a target audio signal adapted to the working mode; Playing the target audio signal; Determining a target filter curve according to the working mode includes: When the working mode is the first working mode, obtaining a first gain curve and a second gain curve, wherein the first gain curve is a pre-acquired gain curve for preventing leakage of audio signals in the far field and improving near-field sound quality, and the second gain curve is a sound field gain curve determined according to user characteristics, and the user characteristics are characteristics of a user using the audio playback device; The first gain curve is subtracted from the second gain curve to obtain the target filter curve.

2. The method according to claim 1, characterized in that After the step of playing the target audio signal, the method further includes: Collecting a reflected audio signal corresponding to the target audio signal, wherein the reflected audio signal includes an audio signal generated by the user's head reflecting the target audio signal; Obtaining leakage volume quantification data reflecting the amount of leakage sound change according to the reflected audio signal; The playback volume of the target audio signal is adjusted according to the leakage volume quantization data.

3. The method according to claim 1, characterized in that The operating modes include a second operating mode for far-field audio playback; Determining a target filter curve according to the working mode includes: When the working mode is the second working mode, obtaining user characteristics of a user using the audio playback device; According to the user characteristics, obtaining preset audio speaker parameters; The target filter curve is determined according to the audio speaker parameters.

4. The method according to claim 1, characterized in that: The working modes also include a third working mode for performing audio calibration; The first gain curve is obtained by the following steps: When the audio playback device is in the third working mode, controlling at least one speaker of the audio playback device to play a first calibration audio signal; Acquire a phase difference curve corresponding to the first calibration audio signal provided by an electronic device, wherein the electronic device is communicatively connected to the audio playback device and is used to generate the phase difference curve according to at least one first far-field audio signal collected in the far field and corresponding to the first calibration audio signal respectively played by the at least one speaker; The first gain curve is generated according to the phase difference curve and the first calibration audio signal.

5. The method according to claim 4, characterized in that The step of generating the first gain curve according to the phase difference curve and the first calibration audio signal comprises: generating a second calibration audio signal according to the phase difference curve; Controlling the audio playback device to simultaneously play the first calibration audio signal and the second calibration audio signal through the at least one speaker; The first gain curve generated by the electronic device according to a near-field audio signal collected in the near field and corresponding to the first calibration audio signal and the second calibration audio signal is obtained.

6. The method according to claim 3, characterized in that: The working modes also include a third working mode for performing audio calibration; The audio speaker parameters are obtained by the following steps: When the audio playback device is in the third working mode, controlling at least one speaker of the audio playback device to play a first calibration audio signal; The audio external speaker parameter generated by the electronic device based on at least one second far-field audio signal collected in the far field and corresponding to the first calibration audio signal played respectively by the at least one speaker is obtained.

7. An audio processing device, characterized in that: include: A working mode acquisition module, used to acquire the working mode of the audio playback device at a current moment, wherein the working mode includes a first working mode for near-field playback of audio signals; A filter curve determination module, used to determine a target filter curve according to the working mode; An audio processing module, configured to filter the original audio signal to be played by the audio playback device according to the target filter curve to obtain a target audio signal adapted to the working mode; A playing module, used for playing the target audio signal; The filter curve determination module is specifically used for: When the working mode is the first working mode, obtaining a first gain curve and a second gain curve, wherein the first gain curve is a pre-acquired gain curve for preventing leakage of audio signals in the far field and improving near-field sound quality, and the second gain curve is a sound field gain curve determined according to user characteristics, and the user characteristics are characteristics of a user using the audio playback device; The first gain curve is subtracted from the second gain curve to obtain the target filter curve.

8. An audio playback device, characterized in that: The device comprises the apparatus as claimed in claim 7, or the audio playback device comprises: A memory for storing executable computer programs; A processor, configured to run the audio playback device to execute the method according to any one of claims 1 to 6 under the control of the computer program.

9. An audio calibration system, characterized in that: include: The audio playback device and the electronic device as claimed in claim 8; The audio playback device is configured to play a first calibration audio signal through at least one speaker when in a third working mode; receive audio calibration information provided by the electronic device in response to the first calibration audio signal, wherein the audio calibration information includes at least one of a phase difference curve, a first gain curve, and an audio external speaker parameter; The electronic device is used to collect, in the far field or near field, a far-field audio signal and / or a near-field audio signal respectively corresponding to the first calibration audio signal played by the at least one speaker to generate the audio calibration information.

Images