Audio playing method and device, electronic equipment, storage medium and program product

Abstract

The invention relates to an audio playing method and device, electronic equipment, a storage medium and a program product. The audio playing method comprises the following steps: acquiring an audio to be played; determining a target amplitude adjustment value of the first loudspeaker and / or the second loudspeaker based on the first azimuth angle of the first loudspeaker, the second azimuth angle of the second loudspeaker and a preset target velocity vector; and after the amplitude of the first loudspeaker and / or the second loudspeaker is adjusted based on the target amplitude adjustment value, audio is played through the first loudspeaker and the second loudspeaker. According to the embodiment of the invention, the tone quality of the audio played by the first loudspeaker and the second loudspeaker can be prevented from changing, and the audio playing effect of the first loudspeaker and the second loudspeaker can be improved.

Description

Technical Field

[0001] This disclosure relates to the field of audio technology, and more particularly to an audio playback method and apparatus, electronic device, storage medium and program product. Background Technology

[0002] With the continuous development of electronic devices, binaural reproduction of loudspeakers (BROL) is commonly used to create accurate sound source localization for listeners. This involves using the speaker of an electronic device, such as a mobile phone, to reproduce binaural sound signals. However, this BROL method is prone to crosstalk from the speaker to the listener's opposite ear. For example, the listener's left ear may receive signals from both the speaker on the same side as their ear and the speaker on the opposite side. This crosstalk disrupts the spatial information contained in the binaural sound signal, resulting in poor sound source localization accuracy and altered timbre of the perceived sound source. Summary of the Invention

[0003] To overcome the problems existing in the related technologies, this disclosure provides an audio playback method and apparatus, electronic device, storage medium and computer program product, which can improve the audio playback effect of the first speaker and the second speaker while avoiding changes in the timbre of the audio played by the first speaker and the second speaker.

[0004] According to a first aspect of the present disclosure, an audio playback method is provided, comprising at least:

[0005] Get the audio to be played;

[0006] Based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector, a target amplitude adjustment value for the first speaker and / or the second speaker is determined; wherein, the target velocity vector is determined based on a velocity vector synthesis equation after playing sample audio through a sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group, the target velocity vector is used to characterize the propagation speed and propagation angle when the audio is played, and the velocity vector synthesis equation characterizes the mapping relationship between the amplitude adjustment value and the velocity vector;

[0007] After adjusting the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, the audio is played through the first speaker and the second speaker.

[0008] In some embodiments, determining the target amplitude adjustment value of the first speaker and / or the second speaker based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector includes:

[0009] In response to a propagation angle where the first azimuth angle is less than the target velocity vector, a target amplitude adjustment value for the first loudspeaker is determined based on the initial amplitude of the second loudspeaker and the velocity vector composition equation, with the target velocity vector as the target; and / or,

[0010] In response to the second azimuth angle being less than the propagation angle of the target velocity vector, a target amplitude adjustment value for the second loudspeaker is determined based on the initial amplitude of the first loudspeaker and the velocity vector composition equation, with the target velocity vector as the target.

[0011] In some embodiments, the method further includes:

[0012] Determine the crossover frequency of the first loudspeaker and the second loudspeaker; wherein the crossover frequency is used to characterize the intersection point of the frequency response of the first loudspeaker and the second loudspeaker;

[0013] For either the first speaker or the second speaker, the initial amplitude of the speaker is determined based on the amplitude of each frequency in the frequency range below the cross frequency of the speaker.

[0014] In some embodiments, determining the cross frequency of the first speaker and the second speaker includes:

[0015] Based on the phase difference between the first speaker and the second speaker, a set of frequency points with a phase difference less than a preset phase difference threshold is determined; the set of frequency points includes frequency points in the first speaker and frequency points in the second speaker;

[0016] The frequency at which the first speaker and the second speaker in the set of frequency points are the same is taken as the cross frequency.

[0017] In some embodiments, determining the initial amplitude of any loudspeaker based on the amplitudes corresponding to frequencies within a frequency range below the crossover frequency includes:

[0018] The average value of the amplitudes corresponding to each frequency in the frequency range below the cross frequency of any loudspeaker is determined as the initial amplitude of any loudspeaker.

[0019] In some embodiments, after adjusting the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, playing the audio through the first speaker and the second speaker includes:

[0020] Based on the target amplitude adjustment value of the first loudspeaker and the initial amplitude of the first loudspeaker, determine the target gain of the first loudspeaker; and / or,

[0021] Based on the target amplitude adjustment value of the second speaker and the initial amplitude of the second speaker, the target gain of the second speaker is determined; wherein, the target gain is used to adjust the output intensity of the audio.

[0022] After applying the corresponding target gain to the first speaker and / or the second speaker, the audio is played through the first speaker and the second speaker.

[0023] In some embodiments, applying a corresponding target gain to the first speaker and / or the second speaker includes:

[0024] Apply the target gain of the first loudspeaker to the frequency band of the first loudspeaker that is lower than the crossover frequency of the first loudspeaker and the second loudspeaker; and / or,

[0025] Apply the target gain of the second loudspeaker to the frequency band below the cross frequency in the second loudspeaker.

[0026] In some embodiments, the method further includes:

[0027] In response to the first azimuth angle being greater than or equal to the propagation angle of the target velocity vector, and the second azimuth angle being greater than or equal to the propagation angle of the target velocity vector, the amplitudes of the first speaker and the second speaker remain unchanged, and the audio is played through the first speaker and the second speaker.

[0028] According to a second aspect of the present disclosure, an audio playback device is provided, comprising at least:

[0029] The acquisition module is configured to acquire the audio to be played.

[0030] The determining module is configured to determine the target amplitude adjustment value of the first speaker and / or the second speaker based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector; wherein, the target velocity vector is determined based on the velocity vector synthesis equation after playing sample audio through the sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group, the target velocity vector is used to characterize the propagation speed and propagation angle corresponding to the audio playback, and the velocity vector synthesis equation characterizes the mapping relationship between the amplitude adjustment value and the velocity vector;

[0031] The processing module is configured to adjust the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, and then play the audio through the first speaker and the second speaker.

[0032] In some embodiments, the determining module is specifically configured to: in response to the first azimuth angle being less than the propagation angle of the target velocity vector, determine a target amplitude adjustment value for the first speaker based on the initial amplitude of the second speaker and the velocity vector composition equation with the target velocity vector as the target; and / or, in response to the second azimuth angle being less than the propagation angle of the target velocity vector, determine a target amplitude adjustment value for the second speaker based on the initial amplitude of the first speaker and the velocity vector composition equation with the target velocity vector as the target.

[0033] In some embodiments, the determining module is further configured to: determine the crossover frequency of the first speaker and the second speaker; wherein the crossover frequency is used to characterize the intersection of the first speaker and the second speaker in frequency response; and for either the first speaker or the second speaker, determine the initial amplitude of the speaker based on the amplitude of each frequency in the frequency range below the crossover frequency of the speaker.

[0034] In some embodiments, the determining module is further configured to: determine a set of frequency points where the phase difference is less than a preset phase difference threshold based on the phase difference between the first speaker and the second speaker; the set of frequency points includes frequency points in the first speaker and frequency points in the second speaker; and use the frequency points in the set of frequency points that are the same as the frequency points of the first speaker and the second speaker as the cross frequency.

[0035] In some embodiments, the determining module is further configured to: determine the average value of the amplitudes corresponding to each frequency in the frequency range below the cross frequency of any loudspeaker as the initial amplitude of any loudspeaker.

[0036] In some embodiments, the processing module is specifically configured to: determine a target gain for the first speaker based on the target amplitude adjustment value of the first speaker and the initial amplitude of the first speaker; and / or determine a target gain for the second speaker based on the target amplitude adjustment value of the second speaker and the initial amplitude of the second speaker; wherein the target gain is used to adjust the output intensity of the audio; and after applying the corresponding target gain to the first speaker and / or the second speaker, play the audio through the first speaker and the second speaker.

[0037] In some embodiments, the processing module is further configured to: apply a target gain of the first speaker to a frequency band of the first speaker that is lower than the crossover frequency of the first speaker and the second speaker; and / or apply a target gain of the second speaker to a frequency band of the second speaker that is lower than the crossover frequency.

[0038] In some embodiments, the processing module is further configured to: in response to the first azimuth angle being greater than or equal to the propagation angle of the target velocity vector, and the second azimuth angle being greater than or equal to the propagation angle of the target velocity vector, maintain the amplitude of the first speaker and the second speaker unchanged, and play the audio through the first speaker and the second speaker.

[0039] According to a third aspect of the present disclosure, an electronic device is provided, comprising at least:

[0040] processor;

[0041] Memory used to store computer programs or instructions;

[0042] The processor executes the computer program or instructions to implement the audio playback method described in the first aspect.

[0043] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, the storage medium storing a computer program or instructions that, when executed by a processor, implement the steps of the audio playback method described in the first aspect.

[0044] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program or instructions, which, when executed by a processor, implement the steps of the audio playback method described in the first aspect.

[0045] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:

[0046] This disclosure provides an audio playback method that, after playing sample audio through a sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group, determines a target velocity vector that characterizes the propagation speed and propagation angle of the audio playback based on a velocity vector synthesis equation that characterizes the mapping relationship between the amplitude adjustment value and the velocity vector. Then, based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and the target velocity vector, a target amplitude adjustment value for the first speaker and / or the second speaker is determined. After adjusting the amplitude of the first speaker and / or the second speaker according to the target amplitude adjustment value, the audio to be played is played through the first speaker and the second speaker. This improves the audio playback effect of the first speaker and the second speaker while avoiding changes in the timbre of the audio played by the first speaker and the second speaker. Furthermore, this disclosure can increase the actual perceived angle of the listener by increasing the amplitude of the first speaker and / or the second speaker when the propagation angle of the target velocity vector is large, thereby effectively improving the listener's positioning accuracy for the audio.

[0047] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0048] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0049] Figure 1 This is a flowchart illustrating an audio playback method according to an exemplary embodiment. Figure 1 .

[0050] Figure 2 This is a schematic diagram of a first speaker and a second speaker in an audio playback method according to an exemplary embodiment.

[0051] Figure 3 This is a flowchart illustrating an audio playback method according to an exemplary embodiment. Figure 2 .

[0052] Figure 4 This is a structural block diagram of an audio playback device according to an exemplary embodiment.

[0053] Figure 5 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment. Detailed Implementation

[0054] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0055] The technical solutions provided by the embodiments of this disclosure are described in detail below with reference to the accompanying drawings.

[0056] In related technologies, to create a precise sound source localization effect for the listener, a BROL (Binaural Arrangement) scheme, which reproduces binaural sound signals using the speaker of an electronic device such as a mobile phone, is commonly used. However, this BROL scheme is prone to crosstalk from the speaker to the listener's opposite ear. For example, the listener's left ear may receive signals not only from the speaker on the same side as the ear but also from the speaker on the opposite side. This crosstalk disrupts the spatial information contained in the binaural sound signal, resulting in poor sound source localization accuracy for the listener and changes in the timbre of the sound source heard.

[0057] In response, this disclosure provides an audio playback method. Figure 1 This is a flowchart illustrating an audio playback method according to an exemplary embodiment. Figure 1 ,like Figure 1 As shown, the audio playback method provided in this embodiment includes at least the following steps:

[0058] S110, Obtain the audio to be played;

[0059] S120. Based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and the preset target velocity vector, determine the target amplitude adjustment value of the first speaker and / or the second speaker; wherein, the target velocity vector is determined based on the velocity vector synthesis equation after playing sample audio through the sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group, the target velocity vector is used to characterize the propagation speed and propagation angle corresponding to the audio playback, and the velocity vector synthesis equation characterizes the mapping relationship between the amplitude adjustment value and the velocity vector;

[0060] S130. After adjusting the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, audio is played through the first speaker and the second speaker.

[0061] The audio playback method provided in this disclosure can be applied to any electronic device with audio playback functionality. This electronic device can be equipped with multiple speakers, including but not limited to a first speaker and a second speaker, to provide stereo effects or a complex audio experience. Here, the electronic device can include: mobile phones, tablets, smartwatches, digital cameras, head-mounted displays (HMDs), etc., and this disclosure does not impose any limitations.

[0062] In steps S110-S120, the electronic device can first acquire the audio to be played, then play the sample audio through the sample speaker group and adjust the amplitude of each sample speaker in the sample speaker group. Based on the velocity vector synthesis equation, a target velocity vector that can characterize the propagation speed and propagation angle corresponding to the audio playback is determined. Then, the target amplitude adjustment value of the first speaker and / or the second speaker is determined through the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and the target velocity vector.

[0063] In this embodiment of the disclosure, the audio to be played can be audio prepared for playback through a first speaker and a second speaker in an electronic device; for example, the audio to be played can include audio content such as music, voice or video.

[0064] The first azimuth angle of the first speaker can refer to the direction of the first speaker of the electronic device relative to the listener in space; the second azimuth angle of the second speaker can refer to the direction of the second speaker of the electronic device relative to the listener in space. The target velocity vector can be the velocity vector of the sound wave synthesized after the audio is played through the first speaker and after the audio is played through the second speaker, which can characterize the corresponding propagation speed and propagation angle during audio playback. The target amplitude adjustment value can be the amplitude value for adjusting the amplitude of the first speaker and / or the second speaker.

[0065] It should be noted that the first azimuth angle of the first speaker and the second azimuth angle of the second speaker can both be measured and calculated by devices such as distance sensors, accelerometers and gyroscopes in electronic devices, and this disclosure does not impose any limitations.

[0066] Here, the target velocity vector can be determined based on the velocity vector synthesis equation after the sample audio is played in advance through the sample speaker group and the amplitude of each sample speaker in the sample speaker group is adjusted.

[0067] Among them, the sample speaker group can be a collection of sample speakers of the sample equipment used in the pre-experiment; the sample audio can be the audio played through the sample speaker group; the velocity vector synthesis equation can characterize the mapping relationship between the amplitude adjustment value and the velocity vector.

[0068] For example, in the preliminary experiment, sample audio is played through a sample speaker group, and the amplitude of each sample speaker in the sample speaker group is continuously adjusted to obtain multiple sample velocity vectors through the velocity vector synthesis equation. Technicians can observe the spectrum diagram corresponding to the sample audio output through each sample speaker and their own listening experience to determine the target velocity vector with the best auditory experience from multiple sample velocity vectors.

[0069] It should be noted that, through preliminary experiments, the present invention can determine the target velocity vector for the optimal auditory experience of each of the multiple sample devices. When adjusting the amplitude of the first speaker and / or the second speaker of the electronic device, the target velocity vector for the optimal auditory experience of the electronic device, i.e., the preset target velocity vector, can be directly obtained.

[0070] It is understood that step S120 may include, but is not limited to: determining the target amplitude adjustment value of the first speaker based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector; determining the target amplitude adjustment value of the second speaker based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector; and determining the target amplitude adjustment value of both the first speaker and the second speaker based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector.

[0071] In this embodiment of the disclosure, the magnitudes of the first azimuth angle of the first speaker and the propagation angle of the target velocity vector, and the second azimuth angle of the second speaker and the propagation angle of the target velocity vector, can be determined. If the first azimuth angle is greater than or equal to the propagation angle of the target velocity vector, and the second azimuth angle is also greater than or equal to the propagation angle of the target velocity vector, the target amplitude adjustment values ​​for both the first and second speakers are determined to be 0, meaning that no adjustment to the amplitudes of the first and second speakers is required. If the first azimuth angle is less than the propagation angle of the target velocity vector, and / or the second azimuth angle is less than the propagation angle of the target velocity vector, the target amplitude adjustment values ​​for the first and / or second speakers are determined based on the target velocity vector, so that the amplitudes of the first and / or second speakers can be adjusted in subsequent processes based on the target amplitude adjustment values.

[0072] In step S130, the electronic device can first adjust the amplitude of the first speaker and / or the second speaker according to the target amplitude adjustment value, and then play the audio to be played through the first speaker and the second speaker after the amplitude is adjusted.

[0073] Here, the adjusted amplitudes of the first and / or second speakers can be determined first based on their initial amplitudes and target amplitude adjustment values. The amplitudes of the first and / or second speakers are then adjusted to the adjusted values, and audio is played through the first and second speakers after the amplitudes have been adjusted. Alternatively, the target gains of the first and / or second speakers can be determined first based on their initial amplitudes and target amplitude adjustment values, and the corresponding target gains can be applied to each speaker. Audio is then played through the first and second speakers after the target gains have been applied.

[0074] In this embodiment of the disclosure, by adjusting the amplitude of the first and second speakers to play audio, the audio playback effect can be optimized, for example, by improving the clarity of the audio playback, enhancing the stereo effect, or improving the audio positioning effect. In practical application scenarios such as watching movies, playing games, or enjoying high-quality music, adjusting the amplitude of the first and second speakers to play audio can improve the audio playback effect, thereby enhancing the listener's auditory experience.

[0075] In some embodiments, the above audio playback method further includes:

[0076] In response to the first azimuth angle being greater than or equal to the propagation angle of the target velocity vector, and the second azimuth angle being greater than or equal to the propagation angle of the target velocity vector, the amplitudes of the first speaker and the second speaker remain unchanged, and audio is played through the first speaker and the second speaker.

[0077] In this way, the electronic device can keep the amplitudes of the first and second speakers unchanged when the first azimuth angle of the first speaker is greater than or equal to the propagation angle of the target velocity vector and the second azimuth angle of the second speaker is greater than or equal to the propagation angle of the target velocity vector. The audio to be played can be played directly through the first and second speakers. Thus, when the propagation angle of the target velocity vector is within the range of the first and second speakers, there is no need to adjust the amplitudes of the first and second speakers, so as to optimize the audio playback effect while simplifying the operation.

[0078] Here, the propagation angle of the target velocity vector can refer to the direction of the target velocity vector in space relative to the listener.

[0079] In this embodiment of the present disclosure, the electronic device can determine that the propagation angle of the target velocity vector is within the range of the first speaker and the second speaker by detecting that the first azimuth angle of the first speaker is greater than or equal to the propagation angle of the target velocity vector and the second azimuth angle of the second speaker is greater than or equal to the propagation angle of the target velocity vector, so as to keep the amplitude of the first speaker and the second speaker unchanged and play audio through the first speaker and the second speaker.

[0080] As mentioned earlier, in related technologies, the BROL scheme is prone to crosstalk from the speaker to the listener's opposite ear. This crosstalk disrupts the spatial information contained in the binaural sound signal, leading to poor localization accuracy of the sound source and changes in the perceived timbre. Optimization methods for addressing this crosstalk, such as crosstalk cancellation filters or head-related transfer functions (HRTF), require expensive hardware, such as head tracking and binaural recording equipment, resulting in high costs; furthermore, real-time measurement and calculation are necessary, which is time-consuming and labor-intensive.

[0081] In contrast, the audio playback method provided in this disclosure can play sample audio through a sample speaker group and adjust the amplitude of each sample speaker in the sample speaker group. Based on the velocity vector synthesis equation that can characterize the mapping relationship between the amplitude adjustment value and the velocity vector, a target velocity vector that can characterize the propagation speed and propagation angle during audio playback is determined. Then, based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and the target velocity vector, the target amplitude adjustment value of the first speaker and / or the second speaker is determined. After adjusting the amplitude of the first speaker and / or the second speaker according to the target amplitude adjustment value, the audio to be played is played through the first speaker and the second speaker. This can improve the audio playback effect of the first speaker and the second speaker while avoiding changes in the timbre of the audio played by the first speaker and the second speaker. Furthermore, when the propagation angle of the target velocity vector is large, this disclosure can increase the amplitude of the first speaker and / or the second speaker to increase the actual perceived angle of the listener, thereby effectively improving the listener's positioning accuracy for the audio.

[0082] In some embodiments, step S120 may include:

[0083] In response to a propagation angle where the first azimuth angle is less than the target velocity vector, a target amplitude adjustment value for the first loudspeaker is determined based on the initial amplitude of the second loudspeaker and the velocity vector synthesis equation, with the target velocity vector as the target; and / or,

[0084] In response to the second azimuth angle being less than the propagation angle of the target velocity vector, the target amplitude adjustment value of the second loudspeaker is determined based on the initial amplitude of the first loudspeaker and the velocity vector synthesis equation, with the target velocity vector as the target.

[0085] In this embodiment of the present disclosure, the electronic device can determine a target amplitude adjustment value for the first speaker based on the initial amplitude and velocity vector synthesis equation of the second speaker with the target velocity vector as the target when the first azimuth angle is less than the propagation angle of the target velocity vector, and adjust the amplitude of the first speaker based on the target amplitude adjustment value of the first speaker; and when the second azimuth angle is less than the propagation angle of the target velocity vector, determine a target amplitude adjustment value for the second speaker based on the initial amplitude and velocity vector synthesis equation of the first speaker with the target velocity vector as the target, and adjust the amplitude of the second speaker based on the target amplitude adjustment value of the second speaker.

[0086] Here, the initial amplitude of the second speaker can refer to the maximum distance that the diaphragm of the second speaker deviates from its static position during the initial moment of motion; the initial amplitude of the first speaker can refer to the maximum distance that the diaphragm of the first speaker deviates from its static position during the initial moment of motion.

[0087] It is understandable that, when the first azimuth angle is less than the propagation angle of the target velocity vector and the second azimuth angle is greater than or equal to the propagation angle of the target velocity vector, the amplitude of the first speaker is adjusted according to the target amplitude adjustment value of the first speaker, but the amplitude of the second speaker is not adjusted; when the first azimuth angle is greater than or equal to the propagation angle of the target velocity vector and the second azimuth angle is less than the propagation angle of the target velocity vector, the amplitude of the second speaker is adjusted according to the target amplitude adjustment value of the second speaker, but the amplitude of the first speaker is not adjusted; when the first azimuth angle is less than the propagation angle of the target velocity vector and the second azimuth angle is less than the propagation angle of the target velocity vector, the amplitude of the first speaker is adjusted according to the target amplitude adjustment value of the first speaker, and the amplitude of the second speaker is adjusted according to the target amplitude adjustment value of the second speaker.

[0088] For example, such as Figure 2 As shown, the electronic device may include a first speaker L1 and a second speaker L2, with the listener L3 located on the central axis of the first speaker L1 and the second speaker L2. Taking the listener L3 as the origin and the central axis of the first speaker L1 and the second speaker L2 as the 0-degree direction axis, the first azimuth angle of the first speaker L1 can be θ. The target amplitude adjustment value A of the first speaker L1 is then calculated. l2 For example, the initial amplitude of the second speaker L2 is A. p The velocity vector composition equation can be as follows:

[0089]

[0090] In formula (1), r v It can be the target velocity vector, A l '2u l It can refer to the velocity vector of the first speaker L1 when it plays audio, A' p u p This can refer to the velocity vector of the second speaker L2 when it plays audio. θ can be the first azimuth angle of the first speaker L1, for example, θ is 30 degrees; The target velocity vector r v The angle of dissemination. A l2 This can be the target amplitude adjustment value for the first loudspeaker L1; u l It can be the unit velocity vector of the first loudspeaker L1, u l The direction can be from the first speaker L1 to the listener L3. A p This can be the initial amplitude of the second speaker L2, with a default value of 1; u p It can be the unit velocity vector of the second loudspeaker L2, u p The direction can be from the listener L3 to the second speaker L2.

[0091] It should be noted that, in That is, when the propagation angle of the target velocity vector is greater than the first azimuth angle, the target amplitude adjustment value of the first speaker can be determined based on the initial amplitude and velocity vector synthesis equation of the second speaker, with the target velocity vector as the target, so as to adjust the amplitude of the first speaker; while That is, when the propagation angle of the target velocity vector is less than or equal to the first azimuth angle, r v =u p This allows the amplitude of the first speaker to remain constant.

[0092] Similarly, in calculating the target amplitude adjustment value A of the second speaker L2... r2 At this time, the target velocity vector r can be determined first. v The angle of dissemination Is it greater than the second azimuth angle θ of the second speaker L2? If That is, when the propagation angle of the target velocity vector is greater than the second azimuth angle, the initial amplitude of the first loudspeaker and the target velocity vector r are... v Substituting into formula (1), the target amplitude adjustment value A of the second loudspeaker L2 is calculated. r2 .like That is, when the propagation angle of the target velocity vector is less than or equal to the second azimuth angle, r v =u p This way, the amplitude of the second speaker can remain unchanged.

[0093] In this embodiment of the present disclosure, the electronic device can determine the target amplitude adjustment value of the first speaker based on the initial amplitude and velocity vector synthesis equation of the second speaker with the target velocity vector as the target when the first azimuth angle of the first speaker is less than the propagation angle of the target velocity vector; and / or, when the second azimuth angle of the second speaker is less than the propagation angle of the target velocity vector, determine the target amplitude adjustment value of the second speaker based on the initial amplitude and velocity vector synthesis equation of the first speaker with the target velocity vector as the target, thereby enabling the amplitude of the first speaker and / or the second speaker to be adjusted according to the target amplitude adjustment value of the first speaker and / or the second speaker, so as to avoid changes in the timbre of the audio when playing audio through the first speaker and the second speaker in the future, and improve the effect of the first speaker and the second speaker playing audio.

[0094] In some embodiments, the above audio playback method further includes:

[0095] Determine the crossover frequency of the first loudspeaker and the second loudspeaker; wherein the crossover frequency is used to characterize the intersection of the frequency response of the first loudspeaker and the second loudspeaker;

[0096] For either the first speaker or the second speaker, the initial amplitude of the speaker is determined based on the amplitude of each frequency in the frequency range below the crossover frequency.

[0097] In this embodiment of the present disclosure, the electronic device can first determine the crossover frequency that can characterize the intersection point of the first speaker and the second speaker in the frequency response, and then determine the initial amplitude of the first speaker based on the amplitude of each frequency in the frequency range below the crossover frequency in the first speaker, and determine the initial amplitude of the second speaker based on the amplitude of each frequency in the frequency range below the crossover frequency in the second speaker.

[0098] Here, the crossover frequency can refer to the frequency corresponding to the intersection point in the frequency response when the first speaker and the second speaker are working together. For example, the frequency corresponding to the intersection point in the spectrum diagrams of the first speaker and the second speaker is the crossover frequency of the first speaker and the second speaker.

[0099] In this spectrum, the horizontal axis can represent the frequency of the first and second loudspeakers, and the vertical axis can represent the amplitude of the first and second loudspeakers.

[0100] Understandably, after determining the crossover frequency of the first speaker and the second speaker, the amplitude of each frequency in the first speaker below the crossover frequency and the amplitude of each frequency in the second speaker below the crossover frequency can be determined in the frequency spectrum.

[0101] In this embodiment of the disclosure, determining the initial amplitude of any loudspeaker based on the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in any loudspeaker may include, but is not limited to: determining the initial amplitude of the first loudspeaker based on the average value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in the first loudspeaker, and determining the initial amplitude of the second loudspeaker based on the average value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in the second loudspeaker; or, determining the initial amplitude of the first loudspeaker based on the weighted value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in the first loudspeaker, and determining the initial amplitude of the second loudspeaker based on the weighted value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in the second loudspeaker.

[0102] It should be noted that the crossover frequency of the first speaker and the second speaker can be one or more; when there are multiple crossover frequencies, the amplitude corresponding to each frequency in any speaker within the frequency range below each crossover frequency can be determined, so that the average value or weighted value of these amplitudes can be determined as the initial amplitude of any speaker. This disclosure does not impose any limitations.

[0103] In this embodiment of the present disclosure, the electronic device can first determine the crossover frequency that characterizes the intersection point of the first speaker and the second speaker in the frequency response, and then determine the initial amplitude of the first speaker based on the amplitude of each frequency in the frequency range below the crossover frequency in the first speaker, and determine the initial amplitude of the second speaker based on the amplitude of each frequency in the frequency range below the crossover frequency in the second speaker. This can prepare for the subsequent determination of the target amplitude adjustment value of the first speaker and / or the second speaker, so that the audio can be played by the first speaker and the second speaker after the amplitude is adjusted, so as to avoid the change of the timbre of the audio and improve the effect of the first speaker and the second speaker playing audio.

[0104] In some embodiments, determining the crossover frequency of the first speaker and the second speaker includes:

[0105] Based on the phase difference between the first speaker and the second speaker, a set of frequency points with a phase difference less than a preset phase difference threshold is determined; the set of frequency points includes the frequency points in the first speaker and the frequency points in the second speaker;

[0106] The frequency that is the same for the first and second speakers in the frequency point set is taken as the cross frequency.

[0107] In this embodiment of the present disclosure, the electronic device can first determine a set of frequency points where the phase difference between the first speaker and the second speaker is less than a preset phase difference threshold, and use the frequency points of the first speaker and the second speaker in the set of frequency points that are the same as each other as the cross frequency.

[0108] Here, the phase difference between the first speaker and the second speaker can refer to the time difference between the audio signals played by the first speaker and the second speaker. This time difference can cause a change in the phase of the audio signal waveform, thereby affecting the audio's localization, clarity, and overall auditory effect. For example, the phase difference between the first speaker and the second speaker can be the difference between the phases of the first speaker and the second speaker, or the ratio between the phases of the first speaker and the second speaker.

[0109] It should be noted that the preset phase difference threshold can be pre-set in the electronic device according to the actual application scenario, and this disclosure embodiment does not impose any limitations. For example, the preset phase difference threshold can be 1.5π, then the frequency point set can include all frequency points where the phase difference between the first speaker and the second speaker is less than 1.5π.

[0110] Understandably, the phase difference between the first and second speakers at each frequency point can be determined in the spectrum diagrams of the first and second speakers. The frequency points in the first speaker and the second speaker whose phase difference is less than a preset phase difference threshold are added to the frequency point set. The frequency points in the frequency point set that are the same for the first and second speakers are used as the cross frequency, so as to determine the initial amplitude of the first speaker and the initial amplitude of the second speaker in the subsequent process.

[0111] In this embodiment of the present disclosure, the electronic device can first determine a set of frequency points where the phase difference between the first speaker and the second speaker is less than a preset phase difference threshold, and take the frequency points of the first speaker and the second speaker that are the same in the set of frequency points as the cross frequency. This can prepare for the subsequent determination of the initial amplitude of the first speaker and the initial amplitude of the second speaker, and then determine the target amplitude adjustment value of the first speaker and / or the second speaker. By adjusting the amplitude of the first speaker and the second speaker, the audio can be played, thereby avoiding changes in the timbre of the audio and improving the effect of the first speaker and the second speaker playing audio.

[0112] In some embodiments, determining the initial amplitude of any loudspeaker based on the amplitude corresponding to each frequency in the frequency range below the crossover frequency includes:

[0113] The average amplitude of each frequency in the frequency range below the crossover frequency of any loudspeaker is determined as the initial amplitude of any loudspeaker.

[0114] In this embodiment of the present disclosure, the electronic device can determine the initial amplitude of any speaker by the average value of the amplitudes corresponding to each frequency in the frequency range below the cross frequency in any speaker, so that the target amplitude adjustment value of any speaker can be determined subsequently based on the initial amplitude of any speaker and the velocity vector synthesis equation with the target velocity vector as the target.

[0115] Here, the average value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in the first loudspeaker can be determined as the initial amplitude of the first loudspeaker; and the average value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in the second loudspeaker can be determined as the initial amplitude of the second loudspeaker.

[0116] It should be noted that the amplitude corresponding to each frequency in the frequency range below the crossover frequency in any loudspeaker can be one or more, and the embodiments disclosed herein do not impose any limitations.

[0117] In this embodiment of the disclosure, the electronic device can determine the initial amplitude of any speaker by the average amplitude of each frequency in the frequency range below the cross frequency in any speaker, so as to prepare for the subsequent determination of the target amplitude adjustment value of any speaker, thereby enabling the first and second speakers to play audio after the amplitude is adjusted, so as to avoid changes in the timbre of the audio and improve the effect of the first and second speakers playing audio.

[0118] In some embodiments, step S130 may include:

[0119] Based on the target amplitude adjustment value of the first loudspeaker and the initial amplitude of the first loudspeaker, determine the target gain of the first loudspeaker; and / or,

[0120] The target gain of the second speaker is determined based on the target amplitude adjustment value of the second speaker and the initial amplitude of the second speaker; wherein, the target gain is used to adjust the output intensity of the audio.

[0121] After applying the corresponding target gain to the first speaker and / or the second speaker, audio is played through the first speaker and the second speaker.

[0122] In this embodiment of the present disclosure, the electronic device can determine the target gain of the first speaker based on the target amplitude adjustment value of the first speaker and the initial amplitude of the first speaker, and / or determine the target gain of the second speaker based on the target amplitude adjustment value of the second speaker and the initial amplitude of the second speaker, so that after applying the corresponding target gain to the first speaker and / or the second speaker, audio can be played through the first speaker and the second speaker.

[0123] Here, the target gain of the first speaker can be used to adjust the output intensity of the first speaker when playing audio; the target gain of the second speaker can be used to adjust the output intensity of the second speaker when playing audio.

[0124] It is understood that, in the embodiments of this disclosure, the ratio between the initial amplitude of the first speaker and the target amplitude adjustment value of the first speaker can be determined as the target gain of the first speaker; and the ratio between the initial amplitude of the second speaker and the target amplitude adjustment value of the second speaker can be determined as the target gain of the second speaker.

[0125] For example, the initial amplitude of the first loudspeaker is A. l1 The target amplitude adjustment value for the first loudspeaker is A. l2 Then the target gain of the first loudspeaker can be expressed as shown in formula (2):

[0126]

[0127] The initial amplitude of the second loudspeaker is A r1 The target amplitude adjustment value for the first loudspeaker is A. r2 Then the target gain of the first loudspeaker can be expressed as shown in formula (3):

[0128]

[0129] It should be noted that the amplitude of the first speaker and / or the second speaker can be adjusted directly based on the target amplitude adjustment value of the first speaker and / or the second speaker; alternatively, the target gain of the first speaker and / or the second speaker can be determined first based on the target amplitude adjustment value of the first speaker and / or the second speaker, and then the corresponding target gain can be applied to the first speaker and / or the second speaker to adjust the amplitude of the first speaker and / or the second speaker. This disclosure does not impose any limitations.

[0130] In this embodiment of the present disclosure, the electronic device can determine the target gain of the first speaker based on the target amplitude adjustment value of the first speaker and the initial amplitude of the first speaker, and / or determine the target gain of the second speaker based on the target amplitude adjustment value of the second speaker and the initial amplitude of the second speaker. This allows the electronic device to apply corresponding target gains to the first speaker and / or the second speaker, and then play audio through the first speaker and the second speaker. This improves the audio playback effect of the first speaker and the second speaker while avoiding changes in the timbre of the audio played by the first speaker and the second speaker. Furthermore, by applying corresponding target gains to the first speaker and / or the second speaker, the electronic device can adjust the amplitude of the first speaker and / or the second speaker, thereby effectively widening the sound field width of the electronic device and enhancing the spatial and stereoscopic feel of the audio.

[0131] In some embodiments, applying a corresponding target gain to the first speaker and / or the second speaker includes:

[0132] Apply the target gain of the first loudspeaker to the frequency band of the first loudspeaker that is lower than the crossover frequency of the first and second loudspeakers; and / or,

[0133] Apply the target gain of the second loudspeaker to the frequency band below the crossover frequency.

[0134] In this embodiment of the disclosure, the electronic device may apply a target gain of the first speaker to a frequency band of the first speaker that is lower than the crossover frequency of the first speaker and the second speaker; and / or apply a target gain of the second speaker to a frequency band of the second speaker that is lower than the crossover frequency.

[0135] Here, the frequency band in the first speaker that is lower than the crossover frequency of the first speaker and the second speaker can refer to the frequency band in the first speaker that needs to optimize the audio playback effect; the frequency band in the second speaker that is lower than the crossover frequency can refer to the frequency band in the second speaker that needs to optimize the audio playback effect.

[0136] It is understood that, in the embodiments of this disclosure, a target gain of the first speaker can be applied to the frequency band below the crossover frequency of the first speaker to adjust the amplitude corresponding to the frequency band below the crossover frequency of the first speaker; and a target gain of the second speaker can be applied to the frequency band below the crossover frequency of the second speaker to adjust the amplitude corresponding to the frequency band below the crossover frequency of the second speaker, so that audio can be played through the first and second speakers after the amplitude is adjusted in subsequent processes.

[0137] In this embodiment of the present disclosure, the electronic device can apply a target gain of the first speaker to the frequency band of the first speaker that is lower than the crossover frequency of the first speaker and the second speaker; and / or apply a target gain of the second speaker to the frequency band of the second speaker that is lower than the crossover frequency, so that audio can be played through the first speaker and the second speaker after the gain is applied, thereby improving the effect of the first speaker and the second speaker playing audio while avoiding changes in the timbre of the audio played by the first speaker and the second speaker; and, in this embodiment of the present disclosure, by applying corresponding target gains to the first speaker and / or the second speaker, the sound field width of the electronic device can be effectively widened, and the spatial sense and stereo sense of the audio can be enhanced.

[0138] Figure 3 This is a flowchart illustrating an audio playback method according to an exemplary embodiment. Figure 2 .like Figure 3As shown, the audio playback method provided in this disclosure is merely an example and not a limitation, and is intended to help those skilled in the art better understand the technical solutions of this disclosure. See also Figure 3 The audio playback method provided in this disclosure can be applied to electronic devices, and may specifically include the following steps:

[0139] S301. Obtain the audio to be played.

[0140] S302. Based on the phase difference between the first speaker and the second speaker, determine the set of frequency points where the phase difference is less than a preset phase difference threshold.

[0141] Here, the phase difference between the first speaker and the second speaker can be the difference between the phases of the first speaker and the second speaker, or the ratio between the phases of the first speaker and the second speaker. The set of frequency points can include frequency points in the first speaker and frequency points in the second speaker.

[0142] S303. The frequency that is the same for the first speaker and the second speaker in the frequency point set is taken as the cross frequency.

[0143] Here, the crossover frequency can be used to characterize the intersection of the frequency response of the first speaker and the second speaker.

[0144] S304. For either the first speaker or the second speaker, the average value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency of the speaker is determined as the initial amplitude of the speaker.

[0145] Here, the average value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in the first loudspeaker can be determined as the initial amplitude of the first loudspeaker; and the average value of the amplitudes corresponding to each frequency in the frequency range below the crossover frequency in the second loudspeaker can be determined as the initial amplitude of the second loudspeaker.

[0146] S305. Determine whether the first azimuth angle of the first loudspeaker is less than the propagation angle of the preset target velocity vector; if yes, proceed to step S306; if no, proceed to step S314.

[0147] S306. Based on the initial amplitude of the second loudspeaker and the velocity vector synthesis equation, determine the target amplitude adjustment value of the first loudspeaker with the target velocity vector as the target.

[0148] Here, the target velocity vector can be determined based on the velocity vector synthesis equation after playing sample audio through the sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group. The target velocity vector can be used to characterize the propagation speed and propagation angle when the audio is played. The velocity vector synthesis equation can characterize the mapping relationship between the amplitude adjustment value and the velocity vector.

[0149] S307. Determine the target gain of the first loudspeaker based on the target amplitude adjustment value of the first loudspeaker and the initial amplitude of the first loudspeaker.

[0150] Here, the ratio between the initial amplitude of the first speaker and the target amplitude adjustment value of the first speaker can be determined as the target gain of the first speaker. The target gain of the first speaker can be used to adjust the output intensity of the first speaker when playing audio.

[0151] S308. Apply the target gain of the first loudspeaker to the frequency band below the crossover frequency in the first loudspeaker.

[0152] S309. Determine whether the second azimuth angle of the second loudspeaker is less than the propagation angle of the target velocity vector; if yes, proceed to step S310; if no, proceed to step S314.

[0153] S310. Based on the initial amplitude of the first loudspeaker and the velocity vector synthesis equation, determine the target amplitude adjustment value of the second loudspeaker with the target velocity vector as the target.

[0154] S311. Determine the target gain of the second speaker based on the target amplitude adjustment value of the second speaker and the initial amplitude of the second speaker.

[0155] Here, the ratio between the initial amplitude of the second speaker and the target amplitude adjustment value of the second speaker can be determined as the target gain of the second speaker. The target gain of the second speaker can be used to adjust the output intensity of the second speaker when playing audio.

[0156] S312. Apply the target gain of the second loudspeaker to the frequency band below the crossover frequency in the second loudspeaker.

[0157] S313. After applying the corresponding target gain to the first speaker and / or the second speaker, audio is played through the first speaker and the second speaker.

[0158] S314. Keep the amplitude of the first speaker and the second speaker unchanged, and play audio through the first speaker and the second speaker.

[0159] The audio playback method provided in this disclosure can play sample audio using a sample speaker group and adjust the amplitude of each sample speaker in the sample speaker group. Based on the velocity vector synthesis equation, which characterizes the mapping relationship between the amplitude adjustment value and the velocity vector, a target velocity vector that characterizes the propagation speed and propagation angle during audio playback is determined. Then, based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and the target velocity vector, a target amplitude adjustment value for the first speaker and / or the second speaker is determined. After adjusting the amplitude of the first speaker and / or the second speaker according to the target amplitude adjustment value, the audio to be played is played through the first speaker and the second speaker. This improves the audio playback effect of the first speaker and the second speaker while avoiding changes in the timbre of the audio played by the first speaker and the second speaker. Furthermore, when the propagation angle of the target velocity vector is large, this disclosure can increase the actual perceived angle of the listener by increasing the amplitude of the first speaker and / or the second speaker, thereby effectively improving the listener's positioning accuracy for the audio. In addition, this disclosure can also effectively widen the sound field width of the electronic device and enhance the spatial and stereoscopic sense of the audio by applying a corresponding target gain to the first speaker and / or the second speaker.

[0160] Figure 4 This is a structural block diagram illustrating an audio playback device according to an exemplary embodiment. See also... Figure 4 The audio playback device 400 provided in this embodiment of the present disclosure is applied to an electronic device and may include: an acquisition module 410, a determination module 420 and a processing module 430.

[0161] The acquisition module 410 is configured to acquire the audio to be played.

[0162] The determining module 420 is configured to determine the target amplitude adjustment value of the first speaker and / or the second speaker based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector; wherein, the target velocity vector is determined based on the velocity vector synthesis equation after playing sample audio through the sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group, the target velocity vector is used to characterize the propagation speed and propagation angle corresponding to the audio playback, and the velocity vector synthesis equation characterizes the mapping relationship between the amplitude adjustment value and the velocity vector;

[0163] The processing module 430 is configured to adjust the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, and then play audio through the first speaker and the second speaker.

[0164] The audio playback device provided in this disclosure can play sample audio through a sample speaker group and adjust the amplitude of each sample speaker in the sample speaker group. Based on the velocity vector synthesis equation that can characterize the mapping relationship between the amplitude adjustment value and the velocity vector, a target velocity vector that can characterize the propagation speed and propagation angle during audio playback is determined. Then, based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and the target velocity vector, the target amplitude adjustment value of the first speaker and / or the second speaker is determined. After adjusting the amplitude of the first speaker and / or the second speaker according to the target amplitude adjustment value, the audio to be played is played through the first speaker and the second speaker. This can improve the audio playback effect of the first speaker and the second speaker while avoiding changes in the timbre of the audio played by the first speaker and the second speaker. Furthermore, when the propagation angle of the target velocity vector is large, this disclosure can increase the actual perceived angle of the listener by increasing the amplitude of the first speaker and / or the second speaker, thereby effectively improving the listener's positioning accuracy for the audio.

[0165] for Figure 4 In one possible implementation of the technical solution shown, the determining module 420 is specifically configured as follows: in response to a first azimuth angle being less than the propagation angle of the target velocity vector, the target amplitude adjustment value of the first speaker is determined based on the initial amplitude of the second speaker and the velocity vector synthesis equation, with the target velocity vector as the target; and / or, in response to a second azimuth angle being less than the propagation angle of the target velocity vector, the target amplitude adjustment value of the second speaker is determined based on the initial amplitude of the first speaker and the velocity vector synthesis equation, with the target velocity vector as the target.

[0166] for Figure 4 In one possible implementation of the technical solution shown, the determining module 420 is further configured to: determine the crossover frequency of the first speaker and the second speaker; wherein the crossover frequency is used to characterize the intersection of the first speaker and the second speaker in frequency response; and for either the first speaker or the second speaker, determine the initial amplitude of the speaker based on the amplitude of each frequency in the frequency range below the crossover frequency of the speaker.

[0167] for Figure 4 In one possible implementation of the technical solution shown, the determining module 420 is further configured to: determine a set of frequency points with a phase difference less than a preset phase difference threshold based on the phase difference between the first speaker and the second speaker; the set of frequency points includes frequency points in the first speaker and frequency points in the second speaker; and use the frequency points in the set of frequency points that are the same as the frequency points of the first speaker and the second speaker as the cross frequency.

[0168] for Figure 4In one possible implementation of the technical solution shown, the determining module 420 is further configured to: determine the average value of the amplitudes corresponding to each frequency in the frequency range below the cross frequency of any loudspeaker as the initial amplitude of any loudspeaker.

[0169] for Figure 4 In one possible implementation of the technical solution shown, the processing module 430 is specifically configured to: determine the target gain of the first speaker based on the target amplitude adjustment value of the first speaker and the initial amplitude of the first speaker; and / or determine the target gain of the second speaker based on the target amplitude adjustment value of the second speaker and the initial amplitude of the second speaker; wherein the target gain is used to adjust the output intensity of the audio; and after applying the corresponding target gain to the first speaker and / or the second speaker, the audio is played through the first speaker and the second speaker.

[0170] for Figure 4 In one possible implementation of the technical solution shown, the processing module 430 is further configured to: apply a target gain of the first speaker to the frequency band of the first speaker that is lower than the crossover frequency of the first speaker and the second speaker; and / or apply a target gain of the second speaker to the frequency band of the second speaker that is lower than the crossover frequency.

[0171] for Figure 4 In one possible implementation of the technical solution shown, the processing module 430 is further configured to: in response to the first azimuth angle being greater than or equal to the propagation angle of the target velocity vector, and the second azimuth angle being greater than or equal to the propagation angle of the target velocity vector, maintain the amplitude of the first speaker and the second speaker unchanged, and play audio through the first speaker and the second speaker.

[0172] It should be noted that the audio playback device provided in this embodiment corresponds to the audio playback method mentioned above. Related details can be found in the description of the audio playback method above, and will not be repeated here.

[0173] Figure 5 This is a schematic diagram illustrating the structure of an electronic device according to an exemplary embodiment. For example, the electronic device 500 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0174] Reference Figure 5 The electronic device 500 may include one or more of the following components: processing component 502, memory 504, power supply component 506, multimedia component 508, audio component 510, input / output (I / O) interface 512, sensor component 514, and communication component 516.

[0175] Processing component 502 typically controls the overall operation of electronic device 500, such as operations associated with at least one of display, telephone call, data communication, camera operation, and recording operation. Processing component 502 may include one or more processors 520 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 502 may include one or more modules to facilitate interaction between processing component 502 and other components. For example, processing component 502 may include a multimedia module to facilitate interaction between multimedia component 508 and processing component 502.

[0176] Memory 504 is configured to store various types of data to support the operation of electronic device 500. Examples of such data include at least one of the following: instructions for any application or method operating on electronic device 500, contact data, phonebook data, messages, pictures, and videos. Memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0177] Power supply component 506 provides power to various components of electronic device 500. Power supply component 506 may include at least one of the following: a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 500.

[0178] Multimedia component 508 includes a screen that provides an output interface between electronic device 500 and user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a Touch Panel, the screen may be implemented as a touchscreen to receive input signals from the user. The Touch Panel includes one or more touch sensors to sense touches, swipes, and gestures on the Touch Panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 508 includes a front-facing camera and / or a rear-facing camera. When electronic device 500 is in an operating mode, such as a shooting mode or video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0179] Audio component 510 is configured to output and / or input audio signals. For example, audio component 510 includes a microphone (MIC) configured to receive external audio signals when electronic device 500 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 504 or transmitted via communication component 516. In some embodiments, audio component 510 also includes a speaker for outputting audio signals.

[0180] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as keyboards, click wheels, and buttons. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0181] Sensor assembly 514 includes one or more sensors for providing state assessments of various aspects of electronic device 500. For example, sensor assembly 514 may detect the on / off state of electronic device 500, the relative positioning of components such as the display and keypad of electronic device 500, changes in position of electronic device 500 or one of its components, the presence or absence of user contact with electronic device 500, orientation or acceleration / deceleration of electronic device 500, and temperature changes of electronic device 500. Sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 514 may also include an optical sensor, such as a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, sensor assembly 514 may also include, but is not limited to, at least one of the following: an accelerometer, a gyroscope, a magnetometer, a pressure sensor, and a temperature sensor.

[0182] Communication component 516 is configured to facilitate wired or wireless communication between electronic device 500 and other devices. Electronic device 500 can access wireless networks based on communication standards, such as Wi-Fi, 4G, 5G, or combinations thereof. In one exemplary embodiment, communication component 516 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 516 also includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), Bluetooth (BT), and other technologies.

[0183] In an exemplary embodiment, the electronic device 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components.

[0184] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory including executable instructions or a computer program that can be executed by a processor of an electronic device to perform an audio playback method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.

[0185] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of an electronic device, enables the electronic device to perform any of the audio playback methods described above. For example, the audio playback method includes: acquiring audio to be played; determining a target amplitude adjustment value for the first speaker and / or the second speaker based on a first azimuth angle of a first speaker, a second azimuth angle of a second speaker, and a preset target velocity vector; wherein the target velocity vector is determined based on a velocity vector synthesis equation after playing sample audio through a sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group, the target velocity vector is used to characterize the propagation speed and propagation angle during audio playback, and the velocity vector synthesis equation characterizes the mapping relationship between the amplitude adjustment value and the velocity vector; adjusting the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, and then playing the audio through the first speaker and the second speaker.

[0186] This disclosure provides a computer program product comprising a computer program or executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or executable instructions from the computer-readable storage medium and executes the computer program or executable instructions, causing the computer device to perform any of the audio playback methods described above.

[0187] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0188] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. An audio playback method, characterized in that, include: Get the audio to be played; Based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector, a target amplitude adjustment value for the first speaker and / or the second speaker is determined; wherein, the target velocity vector is determined based on a velocity vector synthesis equation after playing sample audio through a sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group, the target velocity vector is used to characterize the propagation speed and propagation angle when the audio is played, and the velocity vector synthesis equation characterizes the mapping relationship between the amplitude adjustment value and the velocity vector; After adjusting the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, the audio is played through the first speaker and the second speaker.

2. The method according to claim 1, characterized in that, The determination of the target amplitude adjustment value for the first speaker and / or the second speaker based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector includes: In response to a propagation angle where the first azimuth angle is less than the target velocity vector, a target amplitude adjustment value for the first loudspeaker is determined based on the initial amplitude of the second loudspeaker and the velocity vector composition equation, with the target velocity vector as the target; and / or, In response to the second azimuth angle being less than the propagation angle of the target velocity vector, a target amplitude adjustment value for the second loudspeaker is determined based on the initial amplitude of the first loudspeaker and the velocity vector composition equation, with the target velocity vector as the target.

3. The method according to claim 2, characterized in that, The method further includes: Determine the crossover frequency of the first loudspeaker and the second loudspeaker; wherein the crossover frequency is used to characterize the intersection point of the frequency response of the first loudspeaker and the second loudspeaker; For either the first speaker or the second speaker, the initial amplitude of the speaker is determined based on the amplitude of each frequency in the frequency range below the cross frequency of the speaker.

4. The method according to claim 3, characterized in that, Determining the crossover frequency of the first speaker and the second speaker includes: Based on the phase difference between the first speaker and the second speaker, a set of frequency points with a phase difference less than a preset phase difference threshold is determined; the set of frequency points includes frequency points in the first speaker and frequency points in the second speaker; The frequency at which the first speaker and the second speaker in the set of frequency points are the same is taken as the cross frequency.

5. The method according to claim 3, characterized in that, Determining the initial amplitude of any loudspeaker based on the amplitudes corresponding to frequencies within a frequency range below the crossover frequency includes: The average value of the amplitudes corresponding to each frequency in the frequency range below the cross frequency of any loudspeaker is determined as the initial amplitude of any loudspeaker.

6. The method according to any one of claims 1 to 5, characterized in that, After adjusting the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, playing the audio through the first speaker and the second speaker includes: Based on the target amplitude adjustment value of the first loudspeaker and the initial amplitude of the first loudspeaker, determine the target gain of the first loudspeaker; and / or, Based on the target amplitude adjustment value of the second speaker and the initial amplitude of the second speaker, the target gain of the second speaker is determined; wherein, the target gain is used to adjust the output intensity of the audio. After applying the corresponding target gain to the first speaker and / or the second speaker, the audio is played through the first speaker and the second speaker.

7. The method according to claim 6, characterized in that, Applying a corresponding target gain to the first speaker and / or the second speaker includes: Apply the target gain of the first loudspeaker to the frequency band of the first loudspeaker that is lower than the crossover frequency of the first loudspeaker and the second loudspeaker; and / or, Apply the target gain of the second loudspeaker to the frequency band below the cross frequency in the second loudspeaker.

8. The method according to any one of claims 1 to 5, characterized in that, The method further includes: In response to the first azimuth angle being greater than or equal to the propagation angle of the target velocity vector, and the second azimuth angle being greater than or equal to the propagation angle of the target velocity vector, the amplitudes of the first speaker and the second speaker remain unchanged, and the audio is played through the first speaker and the second speaker.

9. An audio playback device, characterized in that, include: The acquisition module is configured to acquire the audio to be played. The determining module is configured to determine the target amplitude adjustment value of the first speaker and / or the second speaker based on the first azimuth angle of the first speaker, the second azimuth angle of the second speaker, and a preset target velocity vector; wherein, the target velocity vector is determined based on the velocity vector synthesis equation after playing sample audio through the sample speaker group and adjusting the amplitude of each sample speaker in the sample speaker group, the target velocity vector is used to characterize the propagation speed and propagation angle corresponding to the audio playback, and the velocity vector synthesis equation characterizes the mapping relationship between the amplitude adjustment value and the velocity vector; The processing module is configured to adjust the amplitude of the first speaker and / or the second speaker based on the target amplitude adjustment value, and then play the audio through the first speaker and the second speaker.

10. An electronic device, characterized in that, include: processor; Memory used to store computer programs or instructions; The processor executes the computer program or instructions to implement the steps of the audio playback method according to any one of claims 1 to 8.

11. A non-transitory computer-readable storage medium storing a computer program or instructions, characterized in that, When the computer program or instructions in the storage medium are executed by a processor, the steps of the audio playback method according to any one of claims 1 to 8 are implemented.

12. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by the processor, they implement the steps of the audio playback method according to any one of claims 1 to 8.

Images