Audio playback method and device and computer readable storage medium

Abstract

The invention discloses an audio playback method and device and a computer readable storage medium, the audio playback method is applied to an audio playback system, and the audio playback system comprises an intelligent musical instrument and an open earphone; the method comprises an intelligent musical instrument and an open earphone. The audio playback method comprises the following steps: the intelligent musical instrument generates an audio signal according to a pressure signal, and sends the audio signal to the open earphone; the open earphone plays the audio signal, and analyzes the main frequency band of sound leakage of the open earphone; and the intelligent musical instrument outputs a sound masking signal strongly related to the audio signal according to the sound leakage main frequency band. The intelligent musical instrument and the open type earphone work cooperatively, the loudspeaker of the intelligent musical instrument compensates for the deficiency of the earphone in the aspect of low frequency, and the open type earphone compensates for the problem of insufficient details of high-frequency playback of the intelligent musical instrument, thereby effectively making up the advantages and disadvantages of the two products, and ensuring high-fidelity output and spatial perception of audio.

Description

Technical Field

[0001] This application relates to the field of audio processing technology, and in particular to an audio playback method, apparatus, device, and computer-readable storage medium. Background Technology

[0002] In traditional audio playback systems, headphones are usually used as independent audio output devices, playing sound waves through traditional audio signal input. However, the audio signals of smart musical instruments are often processed independently, failing to achieve dynamic coordination with headphones. Summary of the Invention

[0003] This application provides at least one audio playback method, apparatus, and computer-readable storage medium.

[0004] This application provides an audio playback method, which is applied to an audio playback system comprising: a smart musical instrument and open-back headphones; the audio playback method comprising: the smart musical instrument generating an audio signal based on a pressure signal and sending the audio signal to the open-back headphones; the open-back headphones playing the audio signal and analyzing the main leakage frequency band of the open-back headphones; and the smart musical instrument outputting a sound masking signal strongly correlated with the audio signal based on the main leakage frequency band.

[0005] Before sending the audio signal to the open-back headphones, the smart musical instrument performs convolution processing on the audio signal and the head-related transfer function.

[0006] The intelligent musical instrument extracts the required simulation head model related transmission functions from a preset database.

[0007] The audio playback method further includes the following steps after the open-back headphones play the audio signal: the open-back headphones acquire error microphone signals and fidelity microphone signals; the open-back headphones calculate a digital filter corresponding to each speaker unit based on the error microphone signals, the fidelity microphone signals, and the audio signal; and the open-back headphones control the speaker array to output the audio signal based on the digital filters.

[0008] The open-back headphones calculate a digital filter for each speaker unit based on the error microphone signal, the fidelity microphone signal, and the audio signal. This includes: the open-back headphones comparing the audio signal with the error microphone signal and the fidelity microphone signal collected by the microphone to construct a frequency domain transfer function; the open-back headphones constructing a spatial correlation matrix at each frequency point of the frequency domain transfer function to form an optimization objective; the open-back headphones obtaining the optimal weight vector for each frequency point by solving the optimization objective; and the open-back headphones calculating the digital filter for each speaker unit based on the optimal weight vector for each frequency point.

[0009] Specifically, the open-back headphones construct a spatial correlation matrix at each frequency point of the frequency domain transfer function to form an optimization objective, including: the open-back headphones construct a spatial correlation matrix at each frequency point of the frequency domain transfer function, and combine this with response change constraints to form an optimization objective.

[0010] The audio playback method includes: the open-back headphones calculating the frequency response vector for each bright area control point using an array weight vector and a transfer function; and the open-back headphones summing the squared differences between the frequency response vectors of each frequency point and the response at a reference frequency to obtain a response change constraint value.

[0011] The error microphone is located on the outer wall of the open-back earphone, facing the dark area outside the earphone, while the fidelity microphone faces the bright area at the ear canal opening of the earphone.

[0012] To address the aforementioned technical problems, this application proposes an audio playback device, which includes a processor and a memory connected to the processor, wherein the memory stores program instructions; the processor is used to execute the program instructions stored in the memory to implement the aforementioned audio playback method.

[0013] To address the aforementioned technical problems, this application proposes a computer-readable storage medium, characterized in that the computer-readable storage medium has program instructions, which, when executed, implement the aforementioned audio playback method.

[0014] To address the aforementioned technical problems, this application proposes an audio playback device, which includes a processor and a memory connected to the processor, wherein the memory stores program instructions; the processor is used to execute the program instructions stored in the memory to implement the aforementioned audio playback method.

[0015] To address the aforementioned technical problems, this application proposes a computer-readable storage medium having program instructions that, when executed, implement the audio playback method described above.

[0016] Unlike existing technologies, the beneficial effects of this application are: a smart musical instrument and open-back headphones; the audio playback method includes: the smart musical instrument generating an audio signal based on a pressure signal and sending the audio signal to the open-back headphones; the open-back headphones playing the audio signal and analyzing the main leakage frequency band of the open-back headphones; the smart musical instrument outputting a sound masking signal strongly correlated with the audio signal based on the main leakage frequency band. The collaborative work of the smart musical instrument and the open-back headphones allows the smart musical instrument's speakers to compensate for the headphones' low-frequency deficiencies, while the open-back headphones compensate for the lack of high-frequency reproduction detail in the smart musical instrument, effectively compensating for the strengths and weaknesses of the two products and ensuring high-fidelity audio output and spatial perception. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with this application and, together with the specification, serve to explain the technical solutions of this application.

[0018] Figure 1 This is a flowchart illustrating the first embodiment of the audio playback method provided in this application;

[0019] Figure 2 This is a flowchart illustrating a second embodiment of the audio playback method provided in this application;

[0020] Figure 3 This is a schematic diagram of the signal flow graph provided in this application;

[0021] Figure 4 The audio playback method provided in this application Figure 2 A flowchart illustrating the sub-steps of step S22;

[0022] Figure 5 This is a schematic diagram of the framework of an embodiment of the audio playback device provided in this application;

[0023] Figure 6 This is a schematic diagram of the structure of an embodiment of the computer storage medium provided in this application. Detailed Implementation

[0024] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0025] Musical signals, especially those from electric guitars, exhibit typical broadband characteristics. They contain not only the fundamental frequency but also rich harmonics, overtones, and dynamic transient components that determine their unique timbre. Therefore, sound field control algorithms related to broadband signals must be considered. The following algorithms are primarily applicable to sound field control of narrowband signals.

[0026] Acoustic Contrast Control (ACC) algorithms typically optimize independently for a set of discrete control frequencies in the frequency domain. While they offer good sound leakage prevention, they severely distort the original audio signal, leading to frequency response and phase distortion. Pressure Matching (PM) is an algorithm that controls sound by minimizing the error between the desired sound pressure level and the actual reconstructed sound pressure level at the control point. Although it offers high sound fidelity, its ability to suppress sound leakage is weak. Furthermore, both of these traditional sound field control techniques experience a significant decrease in acoustic contrast at non-control frequencies.

[0027] Since existing open-back headphones and smart musical instruments have not yet been able to work together, the following mainly introduces the product structure of open-back headphones and smart musical instruments, as well as their respective sound quality and performance deficiencies. This application, through the collaborative development of open-back headphones and smart musical instruments, aims to optimize and improve the sound quality and performance deficiencies of both.

[0028] It should be noted that the smart musical instruments applicable to the solution in this application include, but are not limited to: guitar, piano, harmonica, electric wind instrument, electronic drum, electric organ, violin, cello, etc.

[0029] Open-back headphones

[0030] Due to their open design, open-back headphones have the following typical acoustic performance drawbacks:

[0031] • Insufficient low-frequency performance: Open-back headphones typically use balanced armature drivers, whose main characteristic is rapid high-frequency response, but poor low-frequency extension. Therefore, open-back headphones often suffer from insufficient low-frequency response. If this deficiency is compensated for solely by boosting the low frequencies through equalization, the low-frequency sound pressure level may quickly reach the limiter's threshold, resulting in a strong sense of compression and causing the audio signal to lose its natural listening feel during playback.

[0032] • Sound leakage: Open-back headphone design allows sound to propagate freely, with speakers near the ear canal emitting sound directly, preventing sound waves from being completely enveloped by the closed ear cavity. Unlike closed-back headphones, open-back headphones lack effective sound isolation, causing audio signals to leak out directly through the headphone opening, in addition to being received by the ear canal. This leaked sound can disturb those around the listener in certain environments (such as public places, offices, or performance venues), reducing audio privacy, and may also degrade sound quality, especially in low-frequency energy transmission. Furthermore, due to the longer wavelength of low frequencies, destructive interference can occur.

[0033] High-frequency instability: Due to the short wavelength of high-frequency signals, their propagation and localization are extremely sensitive to the wearing angle of the headphones, the ear shape, and the fit between the headphones and the ear canal. This structural problem is particularly prominent in open-back headphones, as the lack of a sealed cavity makes it impossible to effectively focus or stabilize the propagation path of high-frequency signals. This results in significant changes in high-frequency performance at different wearing angles. In particular, when the headphones are slightly offset from the ear canal, high-frequency sound quality may fluctuate severely, causing inconsistencies in sound quality and affecting audio clarity and stability.

[0034] In summary, the main technical challenge lies in how to improve the low-frequency response and dynamic performance of open-back headphones while maintaining their open structure and wearing comfort, and controlling high-frequency directional distortion, thus resolving the contradiction between acoustic performance and structural transparency.

[0035] Intelligent musical instruments

[0036] While the built-in speaker design offers advantages such as small size, flexible control, and adjustable tone, it also introduces acoustic problems, primarily concerning high-frequency directivity. Due to the limited size of the built-in speaker unit, the radiation angle of high-frequency sound waves is narrower, mainly prioritizing good high-frequency response for axial projection. This makes it difficult for users at a 90-degree angle or even behind the speaker to clearly hear high-frequency details, impacting the playing experience.

[0037] In addition, most existing smart musical instruments are typically equipped with only one output channel, namely a two-way speaker, which limits them to reproducing only single-channel audio signals. As a result, the spatial information of the original audio cannot be fully reproduced, leading to a lack of spatial sense and positional information in the audio, ultimately affecting the overall listening experience.

[0038] The audio playback system described in this application includes a smart musical instrument and open-back headphones. This application utilizes the collaborative operation of the smart musical instrument and the open-back headphones. The smart musical instrument's speakers compensate for the headphones' low-frequency deficiencies, while the open-back headphones address the smart musical instrument's lack of high-frequency detail. Simultaneously, the stereo channels of the open-back headphones can reproduce the sound field information of the sound source signal. This interconnected audio playback architecture effectively compensates for the strengths and weaknesses of the two products, ensuring high-fidelity audio output and spatial awareness.

[0039] The headphones selected for this application are open-back (OWS) headphones, whose typical structure includes: earcups / shells, driver units, ventilation holes and acoustic damping materials, as well as headband and ear pad assemblies. Open-back headphones do not employ a closed acoustic cavity structure, allowing sound to propagate freely to the outside world, enabling the wearer to simultaneously hear ambient sounds and the headphone's audio output. Furthermore, compared to in-ear headphones, they offer greater wearing comfort and are suitable for extended use or interactive performance scenarios.

[0040] The structure of an intelligent musical instrument includes the following main parts:

[0041] • Enclosed Instrument Pickup Module: This module is responsible for converting the pressure signals from different frequencies applied by the user to the neck of the smart instrument into electrical signals, which are then input into the internal audio processing system. Unlike traditional instruments that rely on acoustic cavity resonance to produce sound, this system uses an electronic pickup system for audio acquisition.

[0042] • Audio DSP: This processor processes and adjusts the received audio signal, including signal equalization and dynamic signal optimization, to achieve the ideal audio output.

[0043] • Loudspeaker system: This system outputs sound through loudspeaker driver units, replacing the traditional wooden sound chamber structure. The loudspeaker converts processed audio signals into sound waves, which are then output as audio through a smart instrument.

[0044] Please see Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the audio playback method provided in this application.

[0045] Step S11: The intelligent musical instrument generates an audio signal based on the pressure signal and sends the audio signal to the open-back headphones.

[0046] In this embodiment, before sending the audio signal to the open-back headphones, the intelligent musical instrument performs convolution processing on the audio signal and a head-related transfer function (HRT). The intelligent musical instrument extracts the HRT of a simulated head model of the open-back headphones from a preset database.

[0047] Specifically, the Head-Related Transfer Function (HRTF) refers to the acoustic transfer function experienced by a sound source as it travels from the source to the ear under free-field conditions. It comprehensively reflects the directional filtering characteristics of sound waves by human structures such as the auricle, head, and torso. The HRTF plays a crucial role in reconstructing spatial hearing and is often used in three-dimensional audio playback at the headphone end. By convolving the sound source signal with the HRTF for each of the left and right channels (using the formula below), a realistic spatial sound field can be simulated in both ears, thereby enhancing stereo perception and spatial awareness.

[0048]

[0049]

[0050] For open-back headphones, the reproduced signal does not pass through the auricle's filtering effect and enters the ear canal directly. Therefore, the directional filtering process that should be completed by the auricle in the natural auditory path is omitted, resulting in a weakened sense of spatial hearing and insufficient sound source localization and immersion.

[0051] To compensate for this structural deficiency, this application proposes to perform convolution processing on the input audio signal with a preset non-personalized signal to compensate to some extent for the directional audio cues lost by in-ear headphones due to the inability to pass through auricular filtering. Specifically, this is manifested in improving the clarity of sound source localization, enhancing the externalization of sound, and creating a more realistic and immersive virtual acoustic environment.

[0052] When a user plays a smart instrument, the integrated pickup system converts the acoustic vibrations into high-fidelity digital audio signals. Before entering the wireless link, this signal is convolved with a head-related transfer function (HRTF). The HRTF data comes from a pre-set database, such as the HRTF of a pre-set KU100 or KEMAR simulated head model, and is used to compensate for the missing auricular filtering process in open-back headphone structures to enhance spatial hearing.

[0053] The processed audio signal is transmitted to open-back headphones via a low-latency wireless protocol. Because a purely digital signal is transmitted, the smart instrument can directly output a reference signal to the input of the open-back headphones.

[0054] Step S12: The open-back headphones play the audio signal and analyze the main frequency bands of the sound leakage of the open-back headphones.

[0055] Specifically, the open-back headphones integrate a signal processing module. After playing the reference signal, the microphone will collect the feedback signal in real time and analyze the main frequency bands of the sound leakage of the open-back headphones.

[0056] This application also proposes an embodiment for analyzing the main frequency bands of sound leakage in the open-back headphones; please refer to the following for details. Figure 2 , Figure 2 This is a flowchart illustrating a second embodiment of the audio playback method provided in this application.

[0057] like Figure 2 As shown, the specific steps are as follows:

[0058] Step S21: The open-back headphones acquire error microphone signals and fidelity microphone signals.

[0059] In one embodiment of this application, an error microphone is disposed on the outer wall of the open-back earphone, facing the dark area outside the open-back earphone, and the fidelity microphone faces the bright area of ​​the ear canal opening of the open-back earphone.

[0060] The outward error microphone collects the sound leakage signal in the dark area and provides feedback on the sound leakage situation; the inward fidelity microphone collects the actual sound pressure in the ear in the bright area and provides feedback on the fidelity status.

[0061] Specifically, to achieve real-time perception and adaptive adjustment of the sound field, multiple microphone units need to be appropriately configured at the earphone shell and ear canal entrance to collect and feedback sound pressure information from different areas. This microphone array mainly includes:

[0062] The Leakage Monitoring Microphone is a microphone positioned on the outside of the earphones, facing outwards, to collect sound signals in real time from dark areas (i.e., the area outside the earphone wearer). This microphone signal reflects the actual sound pressure level leaking outwards from the speaker output audio. It serves as negative feedback input to the system's sound leakage suppression algorithm, assisting the algorithm in evaluating sound wave diffusion effects and dynamically adjusting control parameters to reduce environmental interference and prevent sound leakage. This structure constitutes the core component of the sound pickup stage in the "active sound leakage control" system.

[0063] The Fidelity Monitoring Microphone is a microphone positioned near the ear canal opening, facing inwards, to detect the "bright area"—the actual sound field response of the inner ear's hearing region—in real time. The signal collected by this microphone is compared in real-time with the input sound source, such as the original signal from a smart musical instrument, thus creating a closed-loop feedback mechanism focused on sound quality. This configuration helps the system accurately assess the consistency between the reproduced sound quality and the original signal, further improving the fidelity of sound reproduction and ensuring users enjoy a high-quality audio experience while experiencing sound field isolation.

[0064] The BACC-RV algorithm then activates, using the three inputs (reference signal, error microphone signal, and fidelity microphone signal) as a basis to calculate the optimal digital filter (FIR) for each speaker unit in real time. Specifically:

[0065] The BACC section is responsible for maximizing the sound energy ratio between bright and dark areas to achieve sound field focusing;

[0066] • The RV section constrains changes in the frequency response within the ear, ensuring accurate and clear sound reproduction.

[0067] like Figure 3 As shown, Figure 3 This is a schematic diagram of the signal flow provided in this application. At the earphone end, after receiving the reference signal, the system enters the core signal processing flow. The earphone has two microphone units with different orientations: one is an outward-facing error microphone, used to collect leakage sound signals from outside the earphone (dark area) in real time, providing feedback on the current sound field control effect; the other is a "fidelity microphone" facing the ear canal opening, used to monitor the sound actually heard by the user inside the ear (bright area), providing feedback on sound quality performance. These three signals (reference signal, error signal, and fidelity signal) are input together into the signal processing module in the earphone, ensuring effective real-time operation of the core algorithm BACC-RV used in this system.

[0068] In this embodiment, a multi-speaker array is used. This array is the core physical basis for sound field control, precisely calculating and sending slightly different audio signals to different speaker units. The spatial distribution of the sound field is controlled using the principle of sound wave interference, thereby achieving directional audio transmission and regional isolation. To effectively reduce sound source leakage in open-back headphones, each earpiece is equipped with at least two independently driven speaker units. This design aims to minimize sound diffusion to the outside of the headphones by continuously changing the phase difference and power distribution between the two sets of speakers, ensuring that the audio is concentrated only within the target area, thus improving audio privacy and spatial sound experience.

[0069] Step S22: The open-back headphones calculate the digital filter corresponding to each speaker unit based on the error microphone signal, the fidelity microphone signal, and the audio signal.

[0070] Please see details. Figure 4 , Figure 4 The audio playback method provided in this application Figure 2 A flowchart illustrating the sub-step of step S22.

[0071] like Figure 4 As shown, the specific steps are as follows:

[0072] Step S221: The open-back headphones compare the audio signal with the error microphone signal and the fidelity microphone signal collected by the microphone to construct a frequency domain transfer function.

[0073] Specifically, the signal processing module in the open-back headphones compares the reference signal with the signal acquired in real time by the microphone array to estimate the frequency domain transfer function from each speaker to these measurement points.

[0074] Step S222: The open-back headphones construct a spatial correlation matrix at each frequency point of the frequency domain transfer function to form an optimization target.

[0075] In this embodiment, the open-back headphones construct a spatial correlation matrix at each frequency point of the frequency domain transfer function, and combine this matrix with response change constraints to form an optimization objective.

[0076] In this embodiment, the open-back headphone calculates the frequency response vector for each bright area control point using an array weight vector and a transfer function; the open-back headphone sums the squared difference between the frequency response vector of each frequency point and the response at the reference frequency to obtain the response change constraint value.

[0077] Specifically, a bright / dark spatial correlation matrix is ​​constructed at each frequency point.

[0078] and

[0079] and with RV constraint matrix Incorporating the frequency response variation within the bright region into the regularization term of the denominator forms the optimization objective:

[0080]

[0081] Step S223: The open-back headphones obtain the optimal weight vector for each frequency point by solving the optimization objective.

[0082] By solving this generalized eigenvalue problem, the optimal weight vector is obtained at each frequency point.

[0083] .

[0084] This application introduces a Response Variation (RV) constraint. This constraint, added as a regularization term to the objective function, effectively limits drastic fluctuations in the frequency response within bright regions, ensuring that the system output maintains a frequency response characteristic highly consistent with the original audio signal (such as a guitar tone). By introducing this RV term, the method proposed in this application effectively ensures that the frequency response within the target region remains relatively flat and stable while improving acoustic contrast, thereby significantly improving sound clarity and listening comfort.

[0085] The specific calculation method for BACC-RV is as follows:

[0086] Bright area frequency response modeling: for each bright area control point Using array weight vectors and transfer function

[0087] Calculate the frequency response

[0088] And write it in vector form

[0089] .

[0090]

[0091] RV definition: in the target frequency band Internally, the response at each frequency point is compared with the reference frequency. The sum of the squared differences in the responses yields the RV value.

[0092] ,in This represents the uniform number of sampling points in this frequency band. A matrix representing the frequency response differences in the illuminated area.

[0093]

[0094]

[0095] Objective function construction: The optimization objective of BACC-RV is to add to the denominator of the original BACC acoustic contrast objective function... item( (as a tradeoff factor) in order to achieve a balance between acoustic contrast and frequency uniformity in the bright area.

[0096] Optimization solution: Final weight vector It is the largest eigenvector of the generalized eigenvalue problem, corresponding to the optimal solution that comprehensively balances the acoustic energy ratio and frequency smoothness.

[0097]

[0098] Step S224: The open-back headphones calculate the digital filter corresponding to each speaker unit based on the optimal weight vector of each frequency point.

[0099] The open-back headphones obtain the corresponding low-delay FIR filter that each speaker output signal needs to pass through before the optimal weights of each frequency point are obtained by inverse Fourier transform and regularization.

[0100] This application introduces a Response Variation (RV) constraint, which is added to the objective function as a regularization term. Its function is to limit drastic fluctuations in the frequency response within bright regions, ensuring that the system output maintains a frequency response characteristic highly consistent with the original audio signal. By introducing the RV term, the method proposed in this application effectively ensures that the frequency response within the target region remains relatively flat and stable while improving acoustic contrast, thereby significantly improving sound clarity and listening comfort.

[0101] Step S23: The open-back headphones control the speaker array to output audio signals according to the digital filter.

[0102] The processed audio signal is played simultaneously through a multi-speaker array of open-back headphones and a smart instrument speaker.

[0103] Specifically, the system generates a specific driving signal for each speaker of the open-back headphones, so that multiple speakers form constructive interference and destructive interference acoustic effects in different areas of space, ultimately achieving the effect of complementary functions and collaborative work between the open-back headphones and smart musical instruments.

[0104] Step S13: The intelligent musical instrument outputs a sound masking signal that is strongly correlated with the audio signal according to the main frequency band of the sound leakage.

[0105] Specifically, the sound masking effect is one of the most fundamental phenomena in psychoacoustics, which refers to the decrease in the human ear's auditory sensitivity to other sounds when a certain sound is present.

[0106] The minimum sound pressure that the human ear can hear in a quiet environment is called the absolute hearing threshold, while the sound pressure that needs to be increased to be audible under masking conditions is called the masking threshold. The difference between the two is the masking amount.

[0107] Sound masking can be classified into time-domain masking, frequency-domain masking, and polyphonic / monophonic masking. Among them, frequency-domain masking refers to the masking effect that occurs when the masking sound and the masked sound coexist. It has a high masking intensity and strong persistence.

[0108] The sound masking technology used in this application is based on this strong masking mechanism. During playback, in addition to the sound emitted by the open-back headphones, the speaker of the smart musical instrument also plays the content at the same time, forming a main / auxiliary sound source structure.

[0109] Specifically, the open-back headphones serve as the main sound source, outputting the target audio signal to the wearer; the guitar speaker serves as the auxiliary sound source, synchronously outputting a signal highly correlated with the main sound source in space. Its sound pressure level, spectral characteristics, and phase relationship are precisely adjusted so that the auxiliary sound source forms a sound masking effect with the outside world in the main frequency band of the sound leakage from the headphones.

[0110] This processing method utilizes the principles of frequency and time domain masking in hearing, making it difficult for external receivers to distinguish the leakage sound from the headphones in the superimposed sound field of the main / auxiliary sound sources. Thus, without affecting the wearer's hearing experience, it effectively increases the masking threshold of the leakage sound and achieves active masking of the leakage sound.

[0111] Open-back headphones typically use balanced armature drivers, whose main characteristic is their extremely fast high-frequency transient response, accurately reproducing details and rapid changes in audio, making them particularly suitable for mid-to-high frequency performance. However, due to the smaller vibration range of their diaphragms, balanced armature drivers cannot effectively drive enough air in the low-frequency range, resulting in poor low-frequency extension and a lack of sufficient low-frequency response and depth.

[0112] At the same time, the open-back design of headphones allows users to perceive the sounds of the outside environment while wearing them. While this structure helps to maintain the perception of external audio, it also further exacerbates the problem of insufficient low-frequency response.

[0113] Therefore, in order to solve this problem, this application chooses to use the low-frequency speaker in the intelligent musical instrument to compensate for the lack of low-frequency response in open-back headphones through its large sound pressure level and powerful low-frequency output, thereby providing a fuller and richer low-frequency experience and enhancing the overall reproduction performance of the product.

[0114] The high-frequency driver unit of a smart musical instrument speaker has strong directionality, making it difficult to clearly capture high-frequency details at the point where a guitar is being played. However, the balanced armature driver unit of open-back headphones has a fast high-frequency transient response, effectively compensating for this deficiency and providing users with a clearer, faster-responding high-frequency sound experience.

[0115] When intelligent musical instruments reproduce audio, the performer is often not at the optimal listening point. Furthermore, because the signal output is mono, spatial information is lost, failing to provide a stereo experience at the playback end. In contrast, dual-channel stereo open-back headphones can accurately construct spatial sound field information, providing a wider audio experience through independent control of each headphone unit.

[0116] Meanwhile, the headphone signal is processed by a convolutional personalized head-related transfer function (HRTF), which can better simulate the natural sense of space, make up for the shortcomings of smart musical instruments in audio spatial performance, and ensure that users get a more realistic and immersive listening experience.

[0117] Compared with existing similar products, this application achieves several technological breakthroughs and advantages through an audio playback architecture that links open-back headphones with smart musical instruments. First, the close collaboration between the open-back headphones and the smart musical instruments overcomes the shortcomings of independent playback.

[0118] For example, the low-frequency speaker of a smart musical instrument can effectively compensate for the lack of low-frequency response in open-back headphones, providing a fuller and richer low-frequency experience. Meanwhile, the balanced armature driver of open-back headphones, with its fast high-frequency transient response, compensates for the lack of high-frequency performance in smart musical instrument speakers, providing a clearer and more delicate high-frequency sound quality.

[0119] Furthermore, the open-back headphones employ a stereo channel design, providing rich sound field information for the audio signal, thus compensating for the lack of spatial information caused by the mono output of intelligent musical instruments when reproducing audio. The BACC-RV sound field control algorithm used in this application significantly enhances the directional transmission and spatial sense of sound by maximizing the sound energy ratio between bright and dark areas. Simultaneously, by introducing response variation (RV) constraints, it ensures the stability and high fidelity of sound quality, overcoming to some extent the distortion and frequency response instability problems present in traditional sound field control technologies.

[0120] However, despite algorithmic optimizations, the issue of sound source leakage cannot be completely eliminated. Therefore, the smart instrument speaker, with its higher sound pressure level, creates a masking effect, concealing the sound source leakage of open-back headphones and enhancing audio privacy. The dual-channel stereo design of the smart instrument and headphones further compensates for the lack of spatial information in the mono signal of the smart instrument through convolutional personalized head-related transfer function processing, providing users with a more natural and immersive audio experience. Therefore, overall, this application not only improves low-frequency and high-frequency performance but also enhances the spatial sense, positioning, and listening comfort of the audio.

[0121] To implement the image detection method in the above embodiments, this application also provides an audio playback apparatus. Please refer to [link to relevant documentation]. Figure 5 , Figure 5 This is a schematic diagram of a framework of an embodiment of the audio playback device provided in this application.

[0122] The audio playback device 500 of this application embodiment includes a processor 51, a memory 52, an input / output device 53, and a bus 54.

[0123] The processor 51, memory 52, and input / output device 53 are respectively connected to the bus 54. The memory 52 stores program data, and the processor 51 is used to execute the program data to implement the audio playback method described in the above embodiment.

[0124] In this embodiment, processor 51 can also be referred to as a CPU (Central Processing Unit). Processor 51 may be an integrated circuit chip with signal processing capabilities. Processor 51 can also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The general-purpose processor can be a microprocessor, or processor 51 can be any conventional processor, etc.

[0125] This application also provides a computer storage medium; please refer to the following: Figure 6 , Figure 6 This is a schematic diagram of a computer storage medium according to an embodiment of the present application. The computer storage medium 600 stores a computer program 61, which, when executed by a processor, is used to implement the audio playback method of the above embodiment.

[0126] When the embodiments of this application are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes, but is not limited to, various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0127] The above description is merely an embodiment of this application and does not limit the patent scope of this application. Equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. An audio playback method, characterized in that, The audio playback method is applied to an audio playback system, wherein the audio playback system includes: a smart musical instrument and open-back headphones; the audio playback method includes: The intelligent musical instrument generates an audio signal based on the pressure signal and sends the audio signal to the open-back headphones; The open-back headphones play the audio signal, and the main frequency bands of the sound leakage of the open-back headphones are analyzed; The intelligent musical instrument outputs a sound masking signal that is strongly correlated with the audio signal according to the main frequency band of the sound leakage.

2. The audio playback method according to claim 1, characterized in that, Before sending the audio signal to the open-back headphones, the smart instrument performs convolution processing on the audio signal and the head-related transfer function.

3. The audio playback method according to claim 2, characterized in that, The intelligent musical instrument extracts the relevant transmission functions of the simulated head model required by the open-back headphones from a preset database.

4. The audio playback method according to claim 1, characterized in that, After the open-back headphones play the audio signal, the audio playback method further includes: The open-back headphones acquire error microphone signals and high-fidelity microphone signals; The open-back headphones calculate the digital filter corresponding to each speaker unit based on the error microphone signal, the fidelity microphone signal, and the audio signal; The open-back headphones control the speaker array to output audio signals according to the digital filter.

5. The audio playback method according to claim 4, characterized in that, The open-back headphones calculate a digital filter for each speaker unit based on the error microphone signal, the fidelity microphone signal, and the audio signal, including: The open-back headphones compare the audio signal with the error microphone signal and the fidelity microphone signal collected by the microphone to construct a frequency domain transfer function; The open-back headphones construct a spatial correlation matrix at each frequency point of the frequency domain transfer function to form an optimization objective. The open-back headphones obtain the optimal weight vector for each frequency point by solving the optimization objective; The open-back headphones calculate the digital filter corresponding to each speaker unit based on the optimal weight vector of each frequency point.

6. The audio playback method according to claim 5, characterized in that, The open-back headphones construct a spatial correlation matrix at each frequency point of the frequency domain transfer function to form an optimization objective, including: The open-back headphones construct a spatial correlation matrix at each frequency point of the frequency domain transfer function, and combine it with response change constraints to form an optimization objective.

7. The audio playback method according to claim 6, characterized in that, The audio playback method includes: The open-back headphones calculate the frequency response vector for each bright area control point using an array weight vector and a transfer function; The open-back headphones sum the squared differences between the frequency response vectors at each frequency point and the response at the reference frequency to obtain the response change constraint value.

8. The audio playback method according to claim 4, characterized in that, The error microphone is disposed on the outer wall of the open-back headphones, facing the dark area outside the open-back headphones, while the fidelity microphone faces the bright area at the ear canal opening of the open-back headphones.

9. An audio playback device, characterized in that, The audio playback device includes a processor and a memory connected to the processor, wherein... The memory stores program instructions; The processor is used to execute program instructions stored in the memory to implement the audio playback method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium has program instructions that, when executed, implement the audio playback method as described in any one of claims 1 to 8.

Images