Method for audio playing equipment and audio playing system

Abstract

One or more embodiments of the present disclosure provide a method for an audio playing device, an audio playing device, an audio playing system and a computer readable storage medium, the method for a first audio playing device comprising: connecting with an audio acquisition device and at least one second audio playing device; sending connection information of the first audio playing device and the audio acquisition device to at least one second audio playing device, so that the second audio playing device receives an audio acquisition signal sent by the audio acquisition device at least based on the connection information; receiving an audio acquisition signal sent by audio acquisition equipment; and synchronously playing the first audio corresponding to the audio acquisition signal with at least one second audio playing device. According to the method for the audio playing device, the time delay between the sound transmitted through air and the sound transmitted after being processed by the audio collecting device and the audio playing device can be reduced, and the auditory experience of a user is improved.

Description

Technical Field

[0001] This disclosure relates to fields such as audio processing and electronic information, and more specifically, to methods for use in audio playback devices, audio playback devices, audio playback systems, and computer-readable storage media. Background Technology

[0002] As people's demands for audio playback quality increase, single audio playback devices often have limited performance and cannot provide users with a rich audio-visual experience. Therefore, it is necessary to connect multiple audio playback devices and utilize audio multi-device playback technology to enhance the user's auditory experience.

[0003] By utilizing multi-device audio playback technology to process audio from various playback devices, synchronized audio playback across multiple devices provides users with a richer and more flexible audio experience in applications such as home entertainment, commercial presentations, and meetings. For example, in a home environment, users can connect audio sources such as mobile phones and computers to multiple speakers or loudspeakers to achieve synchronized audio playback throughout the house. This not only enhances the home entertainment experience but also allows for volume and sound effects adjustments based on room size and layout. In shopping malls and exhibitions, multi-device audio playback technology can simultaneously transmit background music, product introductions, and other audio content to multiple audio devices. This helps create a unified atmosphere and presentation effect, attracting customer attention and enhancing brand image. In meetings or presentations, multi-device audio playback technology ensures that attendees in different locations can hear the speaker clearly. By configuring multiple audio devices and adjusting volume and sound effects, meeting efficiency and quality can be improved while reducing noise interference.

[0004] In applications where audio signals are acquired by an audio acquisition device and then sent to multiple audio playback devices for playback, a significant delay exists between the sound traveling through the air and the sound after processing by the acquisition and playback devices. Furthermore, the audio outputs from multiple playback devices are prone to desynchronization. Therefore, ensuring synchronization across all playback devices and minimizing latency to enhance the user's listening experience is a key research focus in the field of audio processing. Summary of the Invention

[0005] To enhance the user's auditory experience, this disclosure proposes a method for a first audio playback device, comprising: connecting to an audio acquisition device and at least one second audio playback device; sending connection information between the first audio playback device and the audio acquisition device to the at least one second audio playback device, so that the at least one second audio playback device receives an audio acquisition signal sent by the audio acquisition device at least based on the connection information; receiving the audio acquisition signal sent by the audio acquisition device; and synchronously playing a first audio corresponding to the audio acquisition signal with the at least one second audio playback device.

[0006] According to one or more embodiments of this disclosure, the method further includes: acquiring data packet guidance information indicating the audio acquisition signal, and sending the data packet guidance information to the at least one second audio playback device, so that the at least one second audio playback device can receive the audio acquisition signal sent by the audio acquisition device based on the connection information and the data packet guidance information.

[0007] According to one or more embodiments of this disclosure, the method further includes: sending an audio playback instruction to the at least one second audio playback device, wherein the audio playback instruction is used to instruct the at least one second audio playback device to play a second audio synchronously with the first audio playback device, wherein the first audio is audio acquired in real time by the audio acquisition device, and the second audio is pre-recorded audio; and playing the second audio synchronously with the second audio playback device.

[0008] According to one or more embodiments of this disclosure, playing a first audio corresponding to the audio acquisition signal synchronously with the at least one second audio playback device includes: adjusting the audio acquisition signal according to the characteristics of the first audio playback device, and playing the first audio based on the adjusted audio acquisition signal, wherein the characteristics of the first audio playback device include at least one of the frequency response of the first audio playback device and the audio channel corresponding to the first audio playback device.

[0009] According to one or more embodiments of this disclosure, the first audio playback device and the at least one second audio playback device are uniformly arranged in space, and the method further includes: obtaining first setting information of the first audio playback device; and sending the first setting information of the first audio playback device to the at least one second audio playback device, so that the at least one second audio playback device can determine second setting information of the at least one second audio playback device based on the first setting information.

[0010] One or more embodiments of this disclosure also provide a method for a second audio playback device, comprising: connecting to a first audio playback device; receiving connection information between the first audio playback device and an audio acquisition device from the first audio playback device; receiving an audio acquisition signal sent by the audio acquisition device based at least on the connection information; and playing a first audio corresponding to the audio acquisition signal synchronously with the first audio playback device.

[0011] One or more embodiments of this disclosure also provide a first audio playback device, comprising: a connection module configured to connect to an audio acquisition device and at least one second audio playback device; a transmission module configured to transmit connection information between the first audio playback device and the audio acquisition device to the at least one second audio playback device, so that the at least one second audio playback device receives an audio acquisition signal transmitted by the audio acquisition device at least based on the connection information; a receiving module configured to receive the audio acquisition signal transmitted by the audio acquisition device; and a playback module configured to play a first audio corresponding to the audio acquisition signal synchronously with the at least one second audio playback device.

[0012] One or more embodiments of this disclosure also provide a second audio playback device, including: a connection module configured to connect to a first audio playback device; a receiving module configured to receive connection information between the first audio playback device and an audio acquisition device from the first audio playback device; and receive an audio acquisition signal sent by the audio acquisition device based at least on the connection information; and a playback module configured to play a first audio corresponding to the audio acquisition signal synchronously with the first audio playback device.

[0013] One or more embodiments of this disclosure also provide an audio playback system, including: an audio acquisition device; a first audio playback device; and at least one second audio playback device, wherein the first audio playback device is connected to the audio acquisition device and the at least one second audio playback device, the first audio playback device sends connection information between the first audio playback device and the audio acquisition device to the at least one second audio playback device, such that the second audio playback device receives an audio acquisition signal sent by the audio acquisition device at least based on the connection information; the first audio playback device and the at least one second audio playback device synchronously play a first audio corresponding to the audio acquisition signal.

[0014] One or more embodiments of this disclosure also provide a computer program product comprising computer software code that, when run by a processor, provides the methods described above.

[0015] One or more embodiments of this disclosure also provide a computer-readable storage medium having computer-executable instructions stored thereon, which, when executed by a processor, provide the above-described method.

[0016] The method disclosed herein for audio playback devices can reduce the delay between sound propagating through the air and sound propagated after being processed by the audio acquisition device and the audio playback device, thereby ensuring that the sound played by each audio playback device is synchronized and improving the user's auditory experience. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are merely some exemplary embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0018] In the attached image:

[0019] Figure 1A-Figure 1B It is a schematic diagram illustrating an application scenario based on one or more examples;

[0020] Figures 1C-1D This is a schematic diagram illustrating an application scenario according to one or more embodiments of the present disclosure;

[0021] Figures 2A-2B This is a schematic flowchart illustrating a method for an audio playback device according to one or more embodiments of the present disclosure;

[0022] Figure 3 This is a schematic diagram illustrating the information processing procedure of an audio playback device according to one or more embodiments of the present disclosure; and

[0023] Figures 4A-4B This is a schematic diagram illustrating the composition of an audio playback device according to one or more embodiments of the present disclosure. Detailed Implementation

[0024] To make the objectives, technical solutions, and advantages of this disclosure more apparent, exemplary embodiments according to this disclosure will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this disclosure, and not all embodiments of this disclosure. It should be understood that this disclosure is not limited to the exemplary embodiments described herein.

[0025] Furthermore, in this specification and the accompanying drawings, steps and elements that are substantially the same or similar are indicated by the same or similar reference numerals, and repeated descriptions of these steps and elements will be omitted.

[0026] Furthermore, in this specification and accompanying drawings, elements are described in singular or plural forms according to embodiments. However, the singular and plural forms have been suitably chosen for the presented cases merely for ease of explanation and are not intended to limit this disclosure. Thus, a singular form may include a plural form, and a plural form may include a singular form, unless the context clearly indicates otherwise.

[0027] Furthermore, the terms "first / second" used in this specification and drawings are merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first / second" may be interchanged in a specific order or sequence where permitted, so that one or more embodiments of this disclosure described herein can be implemented in an order other than that illustrated or described herein.

[0028] Furthermore, in this specification and accompanying drawings, unless otherwise expressly stated, "connection" does not necessarily mean "direct connection" or "direct contact." Here, "connection" can mean both a fixing function and electrical connection.

[0029] One or more embodiments of this disclosure will now be described in further detail with reference to the accompanying drawings.

[0030] Figure 1A A schematic diagram illustrating an application scenario based on one or more examples is shown. For example... Figure 1A As shown, the main audio playback device D2 (e.g., speaker, loudspeaker, etc.) can be connected to the audio acquisition device D0 (e.g., microphone, microphone, etc.) to receive the audio acquisition signal A2 from the audio acquisition device D0. Figure 1A In the diagram, all solid arrows indicate the propagation direction of the audio acquisition signal A2. Optionally, the main audio playback device D2 can be wirelessly connected to the audio acquisition device D0. Further, the main audio playback device D2 can play audio corresponding to the received audio acquisition signal A2.

[0031] Because the performance of a single main audio playback device D2 is limited and cannot provide users with a rich audio-visual experience, the main audio playback device D2 can be combined with multiple secondary audio playback devices (e.g., Figure 1A The secondary audio playback devices (D4, D6, D8, D10) are connected to play audio together. Figure 1AThis example uses four secondary audio playback devices, D4, D6, D8, and D10, as an example, but is not a limitation. In practice, there can be one or more secondary audio playback devices. To reduce the number of wired cables, the main audio playback device D2 can be connected to multiple secondary audio playback devices wirelessly via Bluetooth, WiFi, or radio communication. Multiple secondary audio playback devices can receive audio acquisition signals forwarded by the main audio playback device D2 to play the audio corresponding to those signals.

[0032] Sound, while being transmitted to the audio acquisition device D0, also travels directly through the air (without being processed by the audio acquisition and playback devices) to the user's ears. For example, when a speaker speaks through a microphone, the audience hears not only the sound processed by the microphone and speakers, but also the sound traveling directly through the air. However, the sound traveling directly through the air to the user is difficult to synchronize with the sound transmitted through multiple secondary audio playback devices. Typically, if the delay between multiple sounds exceeds a certain delay threshold (e.g., 30ms), the user will clearly perceive that the multiple sounds are out of sync. Figure 1A In the application scenarios shown, the delay between the sound played through the secondary audio playback device and the sound transmitted through the air is often difficult to be less than the delay threshold. Therefore, users will feel that the sounds heard through different means (or devices) are out of sync. For example, the sound heard through the secondary audio playback device has a significant delay compared to the sound transmitted through the air, or the sound played through the primary audio playback device is out of sync with the sound played through the secondary audio playback device, thus affecting the user's auditory experience.

[0033] In order to solve Figure 1A The sound latency problem in the application scenario shown can be solved by... Figure 1B The audio is played in the manner shown. Figure 1B In the diagram, the functions and connections of the audio acquisition device D0 and various audio playback devices (including the main audio playback device D2 and multiple secondary audio playback devices D4, D6, D8, and D10) are described. Figure 1A Similar. The difference is that, in Figure 1A In this application scenario, after the main audio playback device D2 receives the audio acquisition signal A2 sent by the audio acquisition device D0, it forwards the audio acquisition signal A2 to each secondary audio playback device. Both the main audio playback device D2 and each secondary audio playback device will then play the audio corresponding to the audio acquisition signal A2. And... Figure 1BIn this application scenario, after the main audio playback device D2 receives the audio acquisition signal A2 sent by the audio acquisition device D0, it will not forward the audio acquisition signal A2 to any of the secondary audio playback devices (i.e., only the main audio playback device D2 will play the audio corresponding to the audio acquisition signal A2). Since the delay between the sound played through the main audio playback device D2 and the sound propagating through the air can be less than a delay threshold, the user will not perceive any discrepancies in the sounds heard through different methods. However, Figure 1B In the application scenarios shown, only one audio playback device plays sound (even if the main audio playback device D2 can play audio at the largest possible volume), which often cannot meet the user's volume requirements for the played sound or provide the user with a rich audio-visual experience.

[0034] By targeting Figure 1A and Figure 1B As the description shows, a single audio playback device often has limited performance and cannot provide users with a rich audio-visual experience. Therefore, it is necessary to connect multiple audio playback devices and utilize audio multi-device playback technology to enhance the user's auditory experience. However, in application scenarios where audio signals are acquired by an audio acquisition device and sent to multiple audio playback devices for playback, the delay between the sound propagating through the air and the sound after processing by the audio acquisition and playback devices is significant, and the audio output from each audio playback device (including the main audio playback device and multiple secondary audio playback devices) is prone to desynchronization.

[0035] Therefore, this disclosure proposes that it can be done through Figure 1C The audio is played in the manner shown.

[0036] like Figure 1C As shown, the main audio playback device D2 (e.g., a speaker, loudspeaker, etc.) can be connected to the audio acquisition device D0 (e.g., a microphone, microphone, etc.) to receive the audio acquisition signal A2 from the audio acquisition device D0. Furthermore, the main audio playback device D2 can play audio corresponding to the received audio acquisition signal A2 based on the received audio acquisition signal A2. Figure 1C In the diagram, all solid arrows indicate the propagation direction of the audio acquisition signal A2.

[0037] The main audio playback device D2 can also connect to multiple secondary audio playback devices, and send the connection information between the main audio playback device D2 and the audio acquisition device D0 to the multiple secondary audio playback devices, so that the multiple secondary audio playback devices can receive the audio acquisition signal A2 sent by the audio acquisition device D0, at least based on the connection information. Therefore, the multiple secondary audio playback devices can also play the audio corresponding to the received audio acquisition signal A2. Because... Figure 1C In the application scenario shown, multiple secondary audio playback devices receive audio acquisition signal A2 directly from audio acquisition device D0, instead of receiving audio acquisition signal A2 forwarded by the main audio playback device D2. Therefore, the delay between the sound played by each audio playback device and the sound propagated through the air is less than the delay threshold (e.g., 30ms), and the user will not feel that the sounds heard through different means are out of sync.

[0038] Furthermore, in Figure 1C On this basis, it can also be done through Figure 1D The audio is played in the manner shown. For clarity, Figure 1D Only a portion of the audio acquisition signal A2 and the pre-recorded audio signal A4 are shown. In reality, Figure 1D In the diagram, all solid arrows indicate the propagation direction of the audio acquisition signal A2, and all dashed arrows indicate the propagation direction of the audio signal A4 corresponding to the pre-recorded audio. That is, after receiving the audio signal A4 corresponding to the pre-recorded audio, the main audio playback device D2 can play the pre-recorded audio based on this audio signal A4. Simultaneously, the main audio playback device D2 can forward the audio signal A4 corresponding to the pre-recorded audio to multiple secondary audio playback devices, so that each secondary audio playback device can also play the pre-recorded audio.

[0039] Because the audio captured in real time by the audio acquisition device is transmitted to the user's ears directly through the air (without being processed by the audio acquisition device and the audio playback device) at the same time as it is transmitted to the audio acquisition device, therefore, if according to Figure 1A Playing audio in a certain way can easily make users feel that the sounds heard through different methods (or devices) are out of sync. Pre-recorded audio, however, does not travel directly through the air; it is processed and output by the audio playback devices. Therefore, when the main audio playback device D2 forwards the audio signal A4 corresponding to the pre-recorded audio to multiple secondary audio playback devices, with proper time synchronization settings, users can perceive no noticeable sound delay.

[0040] Figure 2A This is a schematic flowchart illustrating a method 210 for a first audio playback device according to one or more embodiments of the present disclosure.

[0041] In step S212, the first audio playback device is connected to the audio acquisition device and at least one second audio playback device.

[0042] According to one or more embodiments of this disclosure, the audio acquisition device can be a microphone, microphone pen, etc., of various models or structures, and the first audio playback device and the second audio playback device can be speakers, loudspeakers, etc., of various models or structures. The performance of the first audio playback device and the second audio playback device can be the same or different. The first audio playback device can be the primary audio playback device, and the second audio playback device can be the secondary audio playback device. Optionally, the first audio playback device used as the primary audio playback device can have higher performance than the second audio playback device used as the secondary audio playback device.

[0043] To reduce the number of wired cables and thus lower costs, the main audio playback device can be connected to the audio acquisition device and / or at least one second audio playback device wirelessly via Bluetooth, WiFi, radio communication, or other wireless methods.

[0044] In step S214, the first audio playback device may send the connection information between the first audio playback device and the audio acquisition device to the at least one second audio playback device, so that the at least one second audio playback device may receive the audio acquisition signal sent by the audio acquisition device at least based on the connection information.

[0045] According to one or more embodiments of this disclosure, the connection information may include information related to the device identifier of the first audio playback device, information related to the device identifier of the audio acquisition device, information related to the communication protocol between the first audio playback device and the audio acquisition device, etc. Optionally, the connection information may include information related to the model of the first audio playback device, information related to the model of the audio acquisition device, etc.

[0046] According to one or more embodiments of this disclosure, the first audio playback device may further acquire data packet guidance information indicating the audio acquisition signal, and send the data packet guidance information to the at least one second audio playback device, so that the at least one second audio playback device can receive the audio acquisition signal sent by the audio acquisition device based on the connection information and the data packet guidance information. The data packet guidance information may include an identifier of the audio acquisition signal, decoding information of the audio acquisition signal, etc. By enabling at least one second audio playback device to receive the audio acquisition signal sent by the audio acquisition device based on the connection information and the data packet guidance information, the security and accuracy of the at least one second audio playback device receiving the audio acquisition signal can be improved.

[0047] In step S216, the first audio playback device receives the audio acquisition signal sent by the audio acquisition device.

[0048] According to one or more embodiments of this disclosure, the first audio playback device can receive an audio acquisition signal broadcast by the audio acquisition device. That is, the audio acquisition device can broadcast the audio acquisition signal, and each audio playback device (including the first audio playback device and the at least one second audio playback device) can receive the audio acquisition signal broadcast by the audio acquisition device based solely on the aforementioned connection information (i.e., the aforementioned connection information is equivalent to a key for broadcast communication with the audio acquisition device).

[0049] In other words, in step S212, when the first audio playback device and the audio acquisition device are connected, they can communicate point-to-point; when the connection information between the first audio playback device and the audio acquisition device is sent to the at least one second audio playback device in step S214, the audio acquisition device communicates with each audio playback device via broadcast. This method avoids complex point-to-point communication verification between the audio acquisition device and each second audio playback device, thus improving communication efficiency.

[0050] In step S218, the first audio playback device and the at least one second audio playback device synchronously play the first audio corresponding to the audio acquisition signal.

[0051] According to one or more embodiments of this disclosure, the first audio playback device can adjust the audio acquisition signal according to its characteristics and play the first audio based on the adjusted audio acquisition signal. The characteristics of the first audio playback device include at least one of the frequency response of the first audio playback device and the audio channel corresponding to the first audio playback device. Optionally, frequency domain analysis can be used to adjust the gain, phase, etc., of the first audio for different frequency bands. This adjustment fully considers the characteristics of the first audio playback device, enabling the first audio to be played with the highest possible quality. Optionally, this adjustment process can be implemented either in hardware or software.

[0052] According to one or more embodiments of this disclosure, the first audio playback device may further send an audio playback instruction to the at least one second audio playback device, and play the second audio synchronously with the second audio playback device, wherein the audio playback instruction is used to instruct the at least one second audio playback device to play the second audio synchronously with the first audio playback device, the first audio being audio acquired in real time by the audio acquisition device, and the second audio being pre-recorded audio. As described above regarding... Figure 1D As described, the at least one second audio playback device receives the audio acquisition signal directly from the audio acquisition device, rather than receiving the audio acquisition signal forwarded by the first audio playback device. Therefore, the user will not perceive any delay or misalignment between sounds heard through different means (i.e., sound played through various audio playback devices and sound propagating through the air). The pre-recorded audio does not propagate directly through the air; it is processed and output by the audio playback device. Therefore, even when the first audio playback device forwards the audio signal A4 corresponding to the pre-recorded audio to the at least one second audio playback device, the user will not perceive any sound delay or misalignment.

[0053] According to one or more embodiments of this disclosure, the first audio playback device may be evenly arranged in space with the at least one second audio playback device to enhance the user's immersive auditory experience.

[0054] According to one or more embodiments of this disclosure, the first audio playback device may further acquire first setting information of the first audio playback device; and send the first setting information of the first audio playback device to the at least one second audio playback device, so that the at least one second audio playback device can determine second setting information of the at least one second audio playback device based on the first setting information. Optionally, the settings at the first audio playback device can affect the settings at all second audio playback devices, while the settings at each second audio playback device do not affect the settings at the first audio playback device or the settings at other second audio playback devices. In this way, the functions, performance, etc. of each audio playback device can be set more efficiently and accurately.

[0055] Figure 2B This is a schematic flowchart illustrating a method 220 for a second audio playback device according to one or more embodiments of the present disclosure.

[0056] In step S222, the second audio playback device is connected to the first audio playback device.

[0057] According to one or more embodiments of this disclosure, the second audio playback device can be wirelessly connected to the first audio playback device via Bluetooth, WiFi, radio communication, or other means. The first audio playback device can be a primary audio playback device, and the second audio playback device can be a secondary audio playback device.

[0058] In step S224, the second audio playback device receives connection information between the first audio playback device and the audio acquisition device from the first audio playback device.

[0059] According to one or more embodiments of this disclosure, the connection information may include information related to the device identifier of the first audio playback device, information related to the device identifier of the audio acquisition device, information related to the communication protocol between the first audio playback device and the audio acquisition device, etc. Optionally, the connection information may include information related to the model of the first audio playback device, information related to the model of the audio acquisition device, etc.

[0060] According to one or more embodiments of this disclosure, the second audio playback device may also receive data packet guidance information indicating the audio acquisition signal from the first audio playback device; and receive the audio acquisition signal sent by the audio acquisition device based on the connection information and the data packet guidance information. This improves the security and accuracy of the at least one second audio playback device receiving the audio acquisition signal.

[0061] In step S226, the second audio playback device receives the audio acquisition signal sent by the audio acquisition device based at least on the connection information.

[0062] According to one or more embodiments of this disclosure, the second audio playback device can receive audio acquisition signals broadcast by the audio acquisition device. That is, the second audio playback device can acquire audio acquisition signals through broadcast communication without establishing a point-to-point connection with the audio acquisition device, and the aforementioned connection information is equivalent to a key for broadcast communication with the audio acquisition device.

[0063] In step S228, the second audio playback device synchronously plays the first audio corresponding to the audio acquisition signal with the first audio playback device.

[0064] According to one or more embodiments of this disclosure, the second audio playback device can adjust the audio acquisition signal according to its characteristics, and play the first audio based on the adjusted audio acquisition signal. The characteristics of the second audio playback device include at least one of the frequency response of the second audio playback device and the corresponding audio channel of the second audio playback device. Optionally, frequency domain analysis can be used to adjust the gain, phase, etc., of the first audio for different frequency bands. This adjustment fully considers the characteristics of the second audio playback device, enabling the first audio to be played with the highest possible quality. Optionally, this adjustment process can be implemented either in hardware or software.

[0065] According to one or more embodiments of this disclosure, the second audio playback device may also receive an audio playback instruction from the first audio playback device and play the second audio synchronously with the first audio playback device, wherein the audio playback instruction is used to instruct the second audio playback device to play the second audio synchronously with the first audio playback device, the first audio is audio acquired in real time by the audio acquisition device, and the second audio is pre-recorded audio.

[0066] Since the at least one second audio playback device receives the audio acquisition signal directly from the audio acquisition device, rather than receiving the audio acquisition signal forwarded by the first audio playback device, the user will not perceive any delay or misalignment between the sounds heard through different means (i.e., sound played through various audio playback devices and sound propagating through the air). The pre-recorded audio does not propagate directly through the air; it is processed and output by the audio playback device. Therefore, even when the first audio playback device forwards the audio signal corresponding to the pre-recorded audio to the at least one second audio playback device, the user will not perceive any sound delay or misalignment.

[0067] According to one or more embodiments of this disclosure, the audio playback instruction may include the start time of the second audio playback. During the process of the second audio playback device synchronously playing the second audio with the first audio playback device, the second audio playback device may acquire the time when the second audio playback device receives the audio playback instruction; and based on the start time of the second audio playback and the time when the second audio playback device receives the audio playback instruction, it may synchronously play the audio with the first audio playback device.

[0068] As an example, if the second audio playback device receives the audio playback instruction earlier than the start time of the second audio, the second audio playback device can play the second audio at the start time of the second audio. For example, assuming the second audio playback device receives the second audio playback instruction at 9:00:00 and the second audio starts playing at 9:00:02, then the second audio playback device can play the second audio at 9:00:02. If the second audio playback device receives the second audio playback instruction later than the start time of the second audio by a certain amount of time, the second audio playback device can skip the first portion of the second audio and directly play the remaining portion of the second audio. For example, assuming the second audio playback device receives the second audio playback instruction at 9:00:02 and the second audio starts playing at 9:00:00, then the second audio playback device can skip the first 2 seconds of the second audio and directly play the remaining portion of the second audio; that is, assuming the length of the second audio is 10 seconds, playback of the second audio begins from the 3rd second. This method improves the synchronization between the second audio playback device and the first audio playback device when playing the second audio.

[0069] According to one or more embodiments of this disclosure, during the process of the second audio playback device synchronously playing the second audio with the first audio playback device, the number of unit audio segments already played by the first audio playback device when the second audio playback device receives the audio playback instruction can also be obtained; and if the first audio playback device has played a first number of the unit audio segments, the first first number of the unit audio segments in the second audio are deleted, and the remaining part of the second audio is played.

[0070] For example, assuming the first audio playback device has an audio sampling rate of 48kHz, meaning the playback speed of a single audio segment is 1 / 48kHz, approximately 20.8μs, then playing 1000 audio segments on the first audio playback device would take 20800μs. If the second audio playback device plays only 900 audio segments in the same 20800μs, then it can be determined that the playback speed of the second audio playback device is slower than that of the first audio playback device. In this case, the audio sampling rate of the second audio playback device can be increased to ensure that the second audio playback device plays audio synchronously with the first audio playback device. Furthermore, if the first audio playback device has already played 1000 audio segments when the second audio playback device receives the audio playback instruction, then the first 1000 audio segments in the second audio can be deleted, and the remaining portion of the second audio can be played to ensure that the second audio playback device plays the second audio synchronously with the first audio playback device. This method improves the synchronization between the second and first audio playback devices when playing the second audio.

[0071] According to one or more embodiments of this disclosure, the second audio playback device may further receive first setting information of the first audio playback device from the first audio playback device; determine second setting information of the second audio playback device based on the first setting information; and play the first audio based on the second setting information.

[0072] Optionally, the settings at the first audio playback device can affect the settings at all the second audio playback devices, while the settings at each of the second audio playback devices will not affect the settings at the first audio playback device or the settings at other second audio playback devices. This approach allows for more efficient and accurate configuration of the functions and performance of each audio playback device.

[0073] Figure 3 This is a schematic diagram illustrating the information processing procedure of an audio playback device according to one or more embodiments of the present disclosure. Figure 3 In the image, solid arrows indicate the audio signal processing flow.

[0074] like Figure 3As shown, after receiving the audio acquisition signal A2 sent by the audio acquisition device, the first audio playback device (i.e., the main audio playback device) processes the audio acquisition signal A2 through processing P100 at its own processing unit, and then outputs the processed audio V2. Similarly, after receiving the audio acquisition signal A2 from the audio acquisition device, the second audio playback device (i.e., the secondary audio playback device) processes the audio acquisition signal A2 through processing P100' at its own processing unit, and then outputs the processed audio V4. By simultaneously listening to both the audio V2 processed by the first audio playback device and the audio V4 processed by the second audio playback device, the user can obtain a better immersive experience.

[0075] More specifically, the processing P100 at the first audio playback device may include audio synchronization P2, audio adjustment P4, and audio driving P6. The processing P100' at the second audio playback device may include audio synchronization P2', audio adjustment P4', and audio driving P6'.

[0076] According to one or more embodiments of this disclosure, in the audio adjustment process (i.e., Figure 3 In the audio synchronization P2 and audio synchronization P2' shown, the first audio playback device and the second audio playback device can synchronize audio playback information by communicating with the audio acquisition device respectively, so as to achieve synchronized audio playback. Optionally, the first audio playback device and the second audio playback device can also synchronize audio playback information by communicating with each other (for example, by the first audio playback device sending an audio playback instruction to the second audio playback device), so as to achieve synchronized audio playback.

[0077] During the audio adjustment P4 process, the first audio playback device can adjust the audio acquisition signal according to the characteristics of the first audio playback device, and play audio based on the adjusted audio acquisition signal. The characteristics of the first audio playback device include at least one of the frequency response of the first audio playback device and the audio channels corresponding to the first audio playback device (including the number and type of audio channels (e.g., high-frequency audio channels, low-frequency audio channels, etc.)).

[0078] By adjusting the audio based on the frequency response of the first audio playback device (for example, compensating for the high-frequency portion of the audio played by the first audio playback device when the high-frequency response of the first audio playback device is poor; smoothing the high-frequency and low-frequency portions of the audio, etc.), the audio played by the first audio playback device can have good quality in all frequency bands.

[0079] According to one or more embodiments of this disclosure, when the first audio playback device corresponds to multiple audio channels, during the audio adjustment P4 process, the sounds of the multiple audio channels can also be mixed, equalized, filtered, etc., to improve the quality of the audio played by the first audio playback device.

[0080] By adjusting the audio P4, the characteristics of the first audio playback device can be taken into account when playing audio from the first audio playback device, thereby playing audio in a high-quality manner.

[0081] Similarly, during the audio adjustment P4' process, the second audio playback device can adjust the audio acquisition signal according to the characteristics of the second audio playback device, and play audio based on the adjusted audio acquisition signal. The characteristics of the second audio playback device include at least one of the frequency response of the second audio playback device and the audio channels corresponding to the second audio playback device (including the number of audio channels, the type (e.g., high-frequency audio channel, low-frequency audio channel, etc.)).

[0082] By adjusting the audio based on the frequency response of the second audio playback device (for example, compensating for the high-frequency portion of the audio played by the second audio playback device when the high-frequency response of the second audio playback device is poor; smoothing the high-frequency and low-frequency portions of the audio played by the first audio playback device, etc.), the audio played by the second audio playback device can have good quality in all frequency bands.

[0083] According to one or more embodiments of this disclosure, when the second audio playback device corresponds to multiple audio channels, during the audio adjustment P4' process, the sounds of the multiple audio channels can also be mixed, equalized, filtered, etc., to improve the quality of the audio played by the second audio playback device.

[0084] By adjusting the audio P4', the characteristics of the second audio playback device can be taken into account when playing audio from the second audio playback device, thereby playing audio in a high-quality manner.

[0085] The audio driver module of the first audio playback device can convert the signal obtained after processing by audio synchronization P2 and audio adjustment P4 into audio (i.e., audio V2) and output it to the user (i.e., ...). Figure 3 (See audio driver P6). Optionally, the audio driver module of the first audio playback device may also provide information related to the characteristics of the first audio playback device to the audio adjustment module of the first audio playback device, so that the audio adjustment module can make full use of the characteristics of the first audio playback device and enable the audio to be played with the highest possible quality.

[0086] Similarly, the audio driver module of the second audio playback device can convert the signal obtained after processing by audio synchronization P2' and audio adjustment P4' into audio (i.e., audio V4) and output it to the user (i.e., ...). Figure 3 (See audio driver P6'). Optionally, the audio driver module of the second audio playback device can also provide information related to the characteristics of the second audio playback device to the audio adjustment module of the second audio playback device, so that the audio adjustment module can make full use of the characteristics of the second audio playback device and enable the audio to be played with the highest possible quality.

[0087] It should be understood that the aforementioned processing P100 and processing P100' can be implemented by hardware and / or software, without limitation. Processing P100 and processing P100' ensures that the audio played by each audio playback device is synchronized when multiple audio playback devices are playing audio simultaneously, allowing each audio playback device to play audio at its optimal performance, thereby providing users with a better immersive listening experience.

[0088] Figure 4A This is a schematic diagram illustrating the composition of a first audio playback device 410 according to one or more embodiments of the present disclosure.

[0089] According to one or more embodiments of this disclosure, the first audio playback device 410 includes a connection module 412, a sending module 414, a receiving module 416, and a playback module 418.

[0090] The connection module 412 can be configured to connect to the audio acquisition device and at least one second audio playback device.

[0091] The sending module 414 can be configured to send the connection information between the first audio playback device and the audio acquisition device to the at least one second audio playback device, so that the second audio playback device can receive the audio acquisition signal sent by the audio acquisition device based at least on the connection information.

[0092] The receiving module 416 can be configured to receive audio acquisition signals sent by the audio acquisition device.

[0093] The playback module 418 can be configured to play a first audio signal corresponding to the audio acquisition signal synchronously with the at least one second audio playback device.

[0094] It should be understood that Figure 4A The first audio playback device 410 in the middle can achieve targeting Figure 2AThe method 210 for the first audio playback device described herein includes a connection module 412, a sending module 414, a receiving module 416, and a playback module 418, which can be used to implement the processing procedures described for steps S212, S214, S216, and S218, respectively, and will not be repeated here.

[0095] According to one or more embodiments of this disclosure, the first audio playback device 410 can be used for... Figure 1C or Figure 1D In the described application scenario, that is, the first audio playback device 410 can be... Figure 1C or Figure 1D The main audio playback device D2 is described in the document.

[0096] Figure 4B This is a schematic diagram illustrating the composition of a second audio playback device 420 according to one or more embodiments of the present disclosure.

[0097] According to one or more embodiments of this disclosure, the second audio playback device 420 includes a connection module 422, a receiving module 424, and a playback module 426.

[0098] The connection module 422 can be configured to connect to the first audio playback device.

[0099] The receiving module 424 can be configured to: receive connection information between the first audio playback device and the audio acquisition device from the first audio playback device; and receive an audio acquisition signal sent by the audio acquisition device based at least on the connection information.

[0100] The playback module 426 can be configured to play the first audio corresponding to the audio acquisition signal synchronously with the first audio playback device.

[0101] It should be understood that Figure 4B The second audio playback device 420 in the middle can achieve targeting Figure 2B The method 220 for a second audio playback device described herein includes a connection module 422 that can implement the processing described for step S222, a receiving module 424 that can implement the processing described for steps S224 and S226, and a playback module 426 that can implement the processing described for step S228, which will not be described further here.

[0102] According to one or more embodiments of this disclosure, the second audio playback device 420 can be used for... Figure 1C or Figure 1D In the described application scenario, that is, the second audio playback device 420 can be... Figure 1C or Figure 1D The secondary audio playback devices described herein are D4, D6, D8, or D10.

[0103] In general, the various exemplary embodiments of this disclosure can be implemented in hardware or dedicated circuitry, software, firmware, logic, or any combination thereof. Some aspects can be implemented in hardware, while others can be implemented in firmware or software that can be executed by a controller, microprocessor, or other computing device. When aspects of one or more embodiments of this disclosure are illustrated or described as block diagrams, flowcharts, or using some other graphical representation, it will be understood that the blocks, apparatuses, systems, techniques, or methods described herein can be implemented as non-limiting examples in hardware, software, firmware, dedicated circuitry or logic, general-purpose hardware or controllers or other computing devices, or some combination thereof.

[0104] According to another aspect of this disclosure, a computer-readable storage medium is also provided. Computer-readable instructions are stored on the computer storage medium. When executed by a processor, the computer-readable instructions can perform methods according to one or more embodiments of this disclosure described with reference to the above-drawn figures. The computer-readable storage medium in one or more embodiments of this disclosure may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory may be random access memory (RAM) used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous interconnected dynamic random access memory (SLDRAM), and direct memory bus random access memory (DR RAM). It should be noted that the memory used in the methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0105] One or more embodiments of this disclosure also provide a computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform a method according to one or more embodiments of this disclosure.

[0106] In summary, this disclosure provides a method, an audio playback device, an audio playback system, and a computer-readable storage medium for use with an audio playback device. The method for a first audio playback device includes: connecting to an audio acquisition device and at least one second audio playback device; sending connection information between the first audio playback device and the audio acquisition device to the at least one second audio playback device, so that the second audio playback device receives an audio acquisition signal sent by the audio acquisition device at least based on the connection information; receives the audio acquisition signal sent by the audio acquisition device; and plays a first audio signal corresponding to the audio acquisition signal synchronously with the at least one second audio playback device. The method for a second audio playback device includes: connecting to a first audio playback device; receiving connection information between the first audio playback device and the audio acquisition device from the first audio playback device; receiving an audio acquisition signal sent by the audio acquisition device at least based on the connection information; and playing a first audio signal corresponding to the audio acquisition signal synchronously with the first audio playback device.

[0107] The method disclosed herein for audio playback devices can reduce the delay between sound propagating through the air and sound propagated after being processed by the audio acquisition device and the audio playback device, thereby ensuring that the sound played by each audio playback device is synchronized and improving the user's auditory experience.

[0108] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing at least one executable instruction for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0109] This disclosure uses specific terms to describe one or more embodiments of the present disclosure. Terms such as "first / second embodiment," "an embodiment," and / or "some embodiments" refer to a particular feature, structure, or characteristic associated with at least one embodiment of the present disclosure. Therefore, it should be emphasized and noted that references to "an embodiment," "one embodiment," or "an alternative embodiment" in different locations throughout this specification do not necessarily refer to the same embodiment. Furthermore, certain features, structures, or characteristics in one or more embodiments of the present disclosure can be appropriately combined.

[0110] In one or more embodiments of this disclosure, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0111] It should be noted that, in this disclosure, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0112] Furthermore, the aforementioned series of processes includes not only processes executed in the order described herein in a time sequence, but also processes executed in parallel or separately, rather than in a time sequence.

[0113] Unless otherwise defined, all terms used herein (including technical and scientific terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It should also be understood that terms such as those defined in a common dictionary shall be interpreted as having a meaning consistent with their meaning in the context of the relevant art, and not as having an idealized or highly formalized meaning, unless expressly defined herein.

[0114] The foregoing description is illustrative of the present disclosure and should not be construed as limiting it. Although several exemplary embodiments of the present disclosure have been described, those skilled in the art will readily understand that many modifications can be made to the exemplary embodiments without departing from the novel teachings and advantages of the present disclosure. Therefore, all such modifications are intended to be included within the scope of the present disclosure as defined by the claims. It should be understood that the foregoing description is illustrative of the present disclosure and should not be construed as limiting it to the specific embodiments disclosed, and modifications to the disclosed embodiments and other embodiments are intended to be included within the scope of the appended claims. The present disclosure is defined by the claims and their equivalents.

Claims

1. A method for a first audio playback device, comprising: Connected to an audio acquisition device and at least one second audio playback device; The connection information between the first audio playback device and the audio acquisition device is sent to the at least one second audio playback device, so that the at least one second audio playback device can receive the audio acquisition signal sent by the audio acquisition device based at least on the connection information; Receive the audio acquisition signal sent by the audio acquisition device; as well as The first audio corresponding to the audio acquisition signal is played synchronously with the at least one second audio playback device.

2. The method of claim 1, further comprising: The system acquires data packet guidance information indicating the audio acquisition signal and sends the data packet guidance information to the at least one second audio playback device, so that the at least one second audio playback device can receive the audio acquisition signal sent by the audio acquisition device based on the connection information and the data packet guidance information.

3. The method of claim 1, further comprising: Sending an audio playback instruction to the at least one second audio playback device, wherein the audio playback instruction is used to instruct the at least one second audio playback device to play a second audio synchronously with the first audio playback device, wherein the first audio is audio acquired in real time by the audio acquisition device, and the second audio is pre-recorded audio; and The second audio is played synchronously with the at least one second audio playback device.

4. The method of claim 1, wherein, Playing the first audio corresponding to the audio acquisition signal synchronously with the at least one second audio playback device includes: The audio acquisition signal is adjusted according to the characteristics of the first audio playback device, and the first audio is played based on the adjusted audio acquisition signal. The characteristics of the first audio playback device include at least one of the frequency response of the first audio playback device and the audio channel corresponding to the first audio playback device.

5. The method of claim 1, wherein, The first audio playback device and the at least one second audio playback device are evenly arranged in space, and the method further includes: Obtain the first setting information of the first audio playback device; and The first setting information of the first audio playback device is sent to the at least one second audio playback device, so that the at least one second audio playback device can determine the second setting information of the at least one second audio playback device based on the first setting information.

6. A method for a second audio playback device, comprising: Connect to the first audio playback device; Receive connection information between the first audio playback device and the audio acquisition device from the first audio playback device; At least based on the connection information, the audio acquisition signal sent by the audio acquisition device is received; as well as The first audio signal corresponding to the audio acquisition signal is played synchronously with the first audio playback device.

7. The method of claim 6, further comprising: Receive data packet guidance information indicating the audio acquisition signal from the first audio playback device; Receiving the audio acquisition signal sent by the audio acquisition device based at least on the connection information includes: The audio acquisition signal sent by the audio acquisition device is received based on the connection information and the data packet guidance information.

8. The method of claim 6, further comprising: Receive an audio playback instruction from the first audio playback device, wherein the audio playback instruction is used to instruct the second audio playback device to play a second audio synchronously with the first audio playback device, wherein the first audio is audio acquired in real time by the audio acquisition device, and the second audio is pre-recorded audio; and The second audio is played synchronously with the first audio playback device.

9. The method of claim 6, wherein playing the first audio corresponding to the audio acquisition signal synchronously with the first audio playback device comprises: The audio acquisition signal is adjusted according to the characteristics of the second audio playback device, and the first audio is played based on the adjusted audio acquisition signal. The characteristics of the second audio playback device include at least one of the frequency response of the second audio playback device and the audio channel corresponding to the second audio playback device.

10. The method of claim 6, further comprising: Receive first setting information from the first audio playback device; as well as The second setting information of the second audio playback device is determined based on the first setting information; The step of synchronously playing the first audio corresponding to the audio acquisition signal with the first audio playback device includes: playing the first audio based on the second setting information.

11. An audio playback system, comprising: Audio acquisition equipment; First audio playback device; as well as At least one second audio playback device, The first audio playback device is connected to the audio acquisition device and the at least one second audio playback device. The first audio playback device sends the connection information between the first audio playback device and the audio acquisition device to the at least one second audio playback device, so that the second audio playback device receives the audio acquisition signal sent by the audio acquisition device based at least on the connection information. The first audio playback device and the at least one second audio playback device synchronously play the first audio corresponding to the audio acquisition signal.

12. A computer-readable storage medium having stored thereon computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-10.

Images