Audio playing time adjusting method and electronic equipment

Abstract

The invention discloses an audio playing time adjusting method and electronic equipment, and relates to the technical field of electronics. The method comprises the following steps: respectively sending first signals corresponding to audio playing devices to a plurality of audio playing devices, wherein the first signals comprise to-be-played audio data corresponding to the audio playing devices and synchronization signals corresponding to the audio playing devices; collecting a first signal played by the audio playing device through a microphone; determining a playing time delay corresponding to the audio playing device based on the arrival time of the synchronization signal corresponding to the audio playing device collected by the microphone; and adjusting the time for sending the audio data to be played to the audio playing device based on the playing time delay corresponding to the audio playing device. Based on the method, the playing time delay corresponding to the audio playing equipment can be determined, and the audio data playing time of the audio playing equipment can be adjusted, so that the actual playing time difference among multiple pieces of audio playing equipment is reduced, and the playing effect is improved.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and in particular to an audio playback time adjustment method and electronic device. Background Technology

[0002] With the development of short-range wireless technology, in order to improve the playback effect of audio data, multiple audio playback devices (such as speakers) can be connected to electronic devices (such as large-screen devices) via Bluetooth or WIFI protocols, and the electronic devices can send audio data to multiple audio playback devices for simultaneous audio playback.

[0003] However, current short-range protocols all suffer from audio playback data transmission delays, resulting in significant differences in actual playback time between multiple audio playback devices connected to an electronic device, thus affecting the playback effect. Summary of the Invention

[0004] This application provides an audio playback time adjustment method and an electronic device, which helps to reduce the difference in actual playback time between multiple audio playback devices connected to the electronic device and improve the playback effect.

[0005] Firstly, this application provides an audio playback time adjustment method. For example, this method can be applied to an electronic device. For instance, it can be implemented by an electronic device or a communication / processing module within the electronic device, or by a circuit or chip within the electronic device responsible for communication / processing functions.

[0006] The method includes:

[0007] The system sends a first signal corresponding to each audio playback device to multiple audio playback devices. The first signal includes the audio data to be played and the synchronization signal corresponding to each audio playback device. The system also collects the first signal played by the audio playback device through a microphone. Based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone, the system determines the playback delay corresponding to the audio playback device. Based on the playback delay corresponding to the audio playback device, the system adjusts the time for sending the audio data to be played to the audio playback device.

[0008] In other words, electronic devices can overlay the audio data to be played and a corresponding synchronization signal to an audio playback device. This allows the audio playback device to play the synchronization signal simultaneously with the audio data. The electronic device's microphone can then capture this synchronization signal and determine the playback delay of the audio playback device based on its arrival time. This allows the electronic device to adjust the playback time of the audio data based on the corresponding playback delay, thereby reducing the actual playback time differences between multiple audio playback devices and improving the playback experience.

[0009] In one possible embodiment, determining the playback delay of the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device, as captured by the microphone, can be implemented in the following two possible ways:

[0010] (1) Based on the transmission time of the synchronization signal corresponding to the audio playback device and the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone, determine the playback delay corresponding to the audio playback device.

[0011] This method of determining the playback latency of an audio playback device can accurately determine the playback latency of the audio playback device with low complexity.

[0012] Optionally, the playback delay corresponding to the audio playback device is: the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the transmission time of the synchronization signal corresponding to the audio playback device.

[0013] Based on this optional method, the playback latency of the audio playback device can be accurately determined with low complexity.

[0014] (2) The electronic device can also play the corresponding synchronization signal of the electronic device through the speaker of the electronic device, and collect the synchronization signal played by the electronic device through the microphone; the playback delay of the audio playback device is determined based on the arrival time of the corresponding synchronization signal of the audio playback device collected by the microphone, including: the playback delay of the audio playback device is determined based on the arrival time of the corresponding synchronization signal of the electronic device collected by the microphone and the arrival time of the corresponding synchronization signal of the audio playback device collected by the microphone.

[0015] Based on this method, the playback latency corresponding to the audio playback device can be determined accurately.

[0016] Optionally, the implementation method for determining the playback delay of the audio playback device based on the arrival time of the synchronization signal corresponding to the electronic device acquired by the microphone and the arrival time of the synchronization signal corresponding to the audio playback device acquired by the microphone is as follows: the sound wave transmission delay from the speaker to the microphone of the electronic device is determined based on the distance between the speaker and the microphone of the electronic device; the playback delay of the audio playback device is determined based on the arrival time of the synchronization signal corresponding to the electronic device acquired by the microphone, the arrival time of the synchronization signal corresponding to the audio playback device acquired by the microphone, and the sound wave transmission delay from the speaker to the microphone of the electronic device.

[0017] Based on this optional method, the playback latency corresponding to the audio playback device can be accurately determined.

[0018] In one possible embodiment, the playback delay corresponding to the audio playback device is the sum of a first time interval and the sound wave transmission delay from the speaker to the microphone of the electronic device. The first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone and the arrival time of the synchronization signal corresponding to the electronic device collected by the microphone.

[0019] Based on this possible implementation, the playback latency corresponding to the audio playback device can be accurately determined.

[0020] In another possible embodiment, if the transmission time of the synchronization signal sent by the electronic device to the audio playback device is before the playback time of the corresponding synchronization signal of the electronic device, then the playback delay of the audio playback device is the sum of a first time interval, the sound wave transmission delay from the speaker to the microphone of the electronic device, and a second time interval. The first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the arrival time of the synchronization signal corresponding to the electronic device captured by the microphone, and the second time interval is the time interval between the transmission time of the synchronization signal sent to the audio playback device and the playback time of the corresponding synchronization signal of the electronic device.

[0021] Based on this possible implementation, the playback latency corresponding to the audio playback device can be accurately determined.

[0022] In another possible embodiment, if the transmission time of the synchronization signal sent by the electronic device to the audio playback device is after the playback time of the corresponding synchronization signal of the electronic device, then the playback delay of the audio playback device is the sum of the first time interval and the sound wave transmission delay from the speaker to the microphone of the electronic device minus the second time interval. The first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the arrival time of the synchronization signal corresponding to the electronic device captured by the microphone, and the second time interval is the time interval between the transmission time of the synchronization signal sent to the audio playback device and the playback time of the corresponding synchronization signal of the electronic device.

[0023] Based on this possible implementation, the playback latency corresponding to the audio playback device can be accurately determined.

[0024] In one possible embodiment, the method of adjusting the time for sending audio data to be played to the audio playback device based on the playback latency corresponding to the audio playback device is as follows: based on the playback latency corresponding to the audio playback device and one or more of the following: the location of the audio playback device or the location of the user, the time for sending audio data to be played to the audio playback device is adjusted.

[0025] Based on this possible implementation, it is beneficial to make the playback of multiple audio playback devices more stereo.

[0026] In one possible embodiment, the synchronization signals corresponding to multiple audio playback devices can be distinguished in the following four possible ways:

[0027] (1) The synchronization signals of different audio playback devices in multiple audio playback devices are located in different frequency bands;

[0028] (2) The synchronization signals of different audio playback devices in multiple audio playback devices are sent at different times;

[0029] (3) Different sequences are used for the synchronization signals of different audio playback devices in multiple audio playback devices;

[0030] (4) The synchronization signal corresponding to the audio playback device includes the identifier of the audio playback device.

[0031] Based on this possible implementation, the synchronization signals corresponding to multiple audio playback devices can be accurately distinguished, thereby enabling a more accurate determination of the playback delay corresponding to the audio playback device.

[0032] In one possible embodiment, the plurality of audio playback devices includes a first audio playback device, which corresponds to multiple channels, including a first channel. The first channel is associated with a synchronization signal corresponding to the first audio playback device. The association of the first channel with the synchronization signal of the first audio playback device can be understood as the synchronization signal corresponding to the first audio playback device being sent to the first audio playback device for playback via the first channel. That is, for each audio playback device, only one channel of that audio playback device receives the synchronization signal.

[0033] Based on this possible embodiment, it is beneficial to avoid interference with the synchronization signal corresponding to the first audio playback device, thereby enabling a more accurate determination of the playback delay corresponding to the audio playback device. Furthermore, by sending a synchronization signal only to one channel of each audio playback device, transmission resources are saved.

[0034] In one possible embodiment, the synchronization signal is an ultrasonic signal; or, the frequency band of the synchronization signal does not overlap with the frequency band of the audio data to be played; or, the synchronization signal can be a signal with a relatively high frequency band; or, the synchronization signal can be a signal with a frequency band that is inaudible to humans. Based on this possible embodiment, it is advantageous to avoid interference from the audio data to be played on the synchronization signal, which could lead to an inability to accurately determine the playback delay corresponding to the audio playback device. Furthermore, if the synchronization signal is an ultrasonic signal, even if the audio playback device plays the first signal, the user can only hear the audio data to be played. Therefore, by making the synchronization signal an ultrasonic signal or a signal with a frequency band that is inaudible to humans, it is possible to avoid affecting the user's listening to the audio data to be played.

[0035] Secondly, this application provides an audio playback time adjustment method. For example, this method can be applied to an audio playback device. For example, it can be implemented by the audio playback device itself, a communication module / processing module within the audio playback device, or a circuit or chip within the audio playback device responsible for communication / processing functions. The method includes:

[0036] The electronic device receives a first signal corresponding to an audio playback device, the first signal including audio data to be played and a synchronization signal corresponding to the audio playback device; plays the first signal; the played synchronization signal is used by the electronic device to determine the playback delay corresponding to the audio playback device, and adjusts the time of sending the audio data to be played to the audio playback device based on the playback delay corresponding to the audio playback device.

[0037] In one possible embodiment, the audio playback device corresponds to multiple channels, including a first channel, which is associated with a synchronization signal corresponding to the audio playback device.

[0038] In one possible embodiment, the electronic device is connected to multiple audio playback devices, and the synchronization signals corresponding to these multiple audio playback devices can be distinguished in the following four possible ways:

[0039] (1) The synchronization signals of different audio playback devices in multiple audio playback devices are located in different frequency bands;

[0040] (2) The synchronization signals of different audio playback devices in multiple audio playback devices are sent at different times;

[0041] (3) Different sequences are used for the synchronization signals of different audio playback devices in multiple audio playback devices;

[0042] (4) The synchronization signal corresponding to the audio playback device includes the identifier of the audio playback device.

[0043] In one possible embodiment, the synchronization signal is an ultrasonic signal, or the frequency band of the synchronization signal does not overlap with the frequency band of the audio data to be played, or the synchronization signal can be a signal with a relatively high frequency band, or the synchronization signal can be a signal with a frequency band that is inaudible to humans.

[0044] The beneficial effects in the second aspect can be found in the beneficial effects in the first aspect, and will not be repeated here.

[0045] Thirdly, this application provides an audio playback time adjustment device, which is included in an electronic device and has the function of implementing the behavior of the electronic device in the first aspect and possible embodiments thereof. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above-described function. For example, a determining module or unit, a transmission module or unit, etc.

[0046] Alternatively, the device may be the aforementioned electronic device.

[0047] Fourthly, this application provides an audio playback time adjustment device, which is included in an audio playback device. This device has the function of implementing the behavior of the audio playback device in the second aspect and possible embodiments thereof. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above-described functions. For example, a determining module or unit, a transmission module or unit, etc.

[0048] Alternatively, the device may be the audio playback device described above.

[0049] Fifthly, this application provides an audio playback time adjustment device, the device including a processor coupled to a memory for storing computer programs or instructions, the memory for executing the computer programs or instructions stored in the memory, such that the methods in the first aspect or the second aspect or the possible embodiments of the first aspect or the second aspect described above are executed.

[0050] For example, a processor is used to execute a computer program or instructions stored in memory, causing the device to perform the methods described in the first aspect or the second aspect, or in possible embodiments of the first aspect or the second aspect.

[0051] Optionally, the device may include one or more processors.

[0052] Optionally, the device may also include a memory coupled to the processor.

[0053] Optionally, the device may include one or more memories.

[0054] Alternatively, the memory can be integrated with the processor or set up separately.

[0055] Optionally, the device may also include a transceiver.

[0056] Alternatively, the device may be the aforementioned electronic device or audio playback device.

[0057] In a sixth aspect, this application provides an electronic device including a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to perform the method described in the first aspect or any possible embodiment of the first aspect.

[0058] In a seventh aspect, this application provides an audio playback device, including a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to perform the method described in the second aspect or any possible embodiment of the second aspect.

[0059] Eighthly, this application provides a computer-readable storage medium storing computer-readable instructions that, when executed by a device positioning device, implement the methods described in the first aspect or the second aspect, or in possible embodiments of the first aspect or the second aspect.

[0060] Ninthly, this application provides a computer program product, including a computer program or instructions, which, when executed by a device positioning device, implement the methods described in the first aspect or the second aspect, or in possible embodiments of the first aspect or the second aspect.

[0061] In a tenth aspect, this application provides an audio playback time adjustment device, comprising units for performing the methods described in the first aspect or the second aspect, or in possible embodiments of the first aspect or the second aspect. Attached Figure Description

[0062] Figure 1 A possible, non-limiting system schematic diagram provided for an embodiment of this application;

[0063] Figure 2 This is a schematic diagram of the structure of a device 100 provided in an embodiment of this application;

[0064] Figure 3 This is a software structure block diagram of a device 100 provided in an embodiment of this application;

[0065] Figure 4 A flowchart illustrating an audio playback time adjustment method provided in an embodiment of this application;

[0066] Figure 5A schematic diagram illustrating the transmission of a synchronization signal according to an embodiment of this application;

[0067] Figure 6 A schematic diagram illustrating the transmission of a synchronization signal according to an embodiment of this application;

[0068] Figure 7 A schematic diagram illustrating the playback latency of an audio playback device provided in an embodiment of this application;

[0069] Figure 8 A schematic diagram illustrating the playback latency of an audio playback device provided in an embodiment of this application;

[0070] Figure 9 A schematic diagram illustrating the playback latency of an audio playback device provided in an embodiment of this application;

[0071] Figure 10 This is a schematic diagram of the structure of an audio playback time adjustment device 1000 provided in an embodiment of this application. Detailed Implementation

[0072] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0073] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0074] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0075] In this application, "at least one (item)" means one or more, "more than one" means two or more, "at least two (items)" means two or three or more, and "and / or" is used to describe the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0076] To reduce the difference in actual playback time between multiple audio playback devices connected to an electronic device and improve playback quality, this application provides an audio playback time adjustment method and an electronic device. To better understand this application, the system architecture involved is first described below:

[0077] The embodiments of this application can be applied to long-term evolution (LTE) systems, 5th generation mobile communication (5G) systems, 6th generation mobile communication (6G) systems, and other communication systems evolving after 5G, as well as satellite communication and short-range wireless communication systems. The wireless communication systems mentioned in the embodiments of this application include, but are not limited to: the three major application scenarios of 5G / 6G mobile communication systems: enhanced mobile broadband (eMBB), ultra-reliable low latency communication (URLLC), and massive machine-type communication (mMTC), long-range (LoRa) systems, or vehicle-to-everything (V2X) systems.

[0078] Figure 1 A possible, non-limiting system schematic diagram is shown. For example... Figure 1 As shown, the communication system includes electronic devices and multiple audio playback devices. Figure 1 Taking four audio playback devices as an example, it is possible to include fewer or more audio playback devices, but this application does not limit the scope of the embodiments.

[0079] In this system, electronic devices and multiple audio playback devices are connected wirelessly or via wired connections. For example, electronic devices can connect to multiple audio playback devices via Bluetooth, WiFi, or mobile communication networks. The electronic device can output audio data to be played to the connected audio playback devices, allowing the audio playback devices to play the audio data. For example, the electronic device can be a large-screen device, television, computer, tablet, game console, set-top box, mobile phone, in-vehicle system, or any other device with audio output capabilities. The audio playback devices can be speakers, mobile phones, or other devices with audio playback capabilities.

[0080] The hardware structure of the device involved in the embodiments of this application is described below:

[0081] For example, Figure 2 This is a schematic diagram of the structure of a device 100 provided in an embodiment of this application. The device 100 can be the aforementioned electronic device or audio playback device. The device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180I, a touch sensor 180J, an ambient light sensor 180K, a bone conduction sensor 180L, etc.

[0082] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on device 100. In other embodiments of this application, device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0083] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0084] The controller can serve as the central nervous system and command center of the device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control the fetching and execution of instructions.

[0085] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0086] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0087] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180J, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180J through the I2C interface, enabling the processor 110 and the touch sensor 180J to communicate through the I2C bus interface, thus realizing the touch function of the device 100.

[0088] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0089] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0090] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0091] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the camera's shooting function. The processor 110 and the display screen 194 communicate via the DSI interface to enable the device 100's display function.

[0092] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0093] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge device 100, and can also be used for data transfer between device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as augmented reality (AR) devices.

[0094] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the device 100. In other embodiments of this application, the device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0095] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the device 100. While charging the battery 142, the charging management module 140 can also supply power to the device 100 via the power management module 141.

[0096] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0097] The wireless communication function of device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0098] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Each antenna in device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0099] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G or later, applied to the device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0100] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0101] The wireless communication module 160 can provide solutions for wireless communication applications on device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0102] In some embodiments, antenna 1 of device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TDSCDMA), Long Term Evolution (LTE), and 5G. th Generation of wireless communication systems, including BT, GNSS, WLAN, NFC, FM, and / or IR technologies. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0103] Device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0104] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0105] Device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0106] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0107] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0108] A digital signal processor (DSP) is used to process digital signals. Besides digital image signals, it can also process other digital signals. For example, when device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0109] Video codecs are used to compress or decompress digital video. Device 100 may support one or more video codecs. Thus, device 100 can play or record video in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0110] NPU stands for Neural Network (NN) Computing Processor. By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0111] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the device 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0112] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0113] Device 100 can implement audio functions, such as music playback and recording, through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, and an application processor.

[0114] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0115] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. Device 100 can listen to music or make hands-free calls through the speaker 170A. In some embodiments, the speaker 170A is used to transmit ultrasonic signals.

[0116] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the device 100 is answering a phone call or voice message, the receiver 170B can be brought close to the listener's ear to receive the voice message.

[0117] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Device 100 may have at least one microphone 170C. In some embodiments, device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, device 100 may have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc. In some embodiments, the two microphones 170C of device 100 can receive ultrasonic signals transmitted by the speaker of another electronic device. Optionally, the distance between the two microphones 170C of device 100 is greater than a preset distance, for example, a preset distance of 2cm, 4cm, 6cm, 8cm, or 10cm.

[0118] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0119] Pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When a force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, device 100 detects the intensity of the touch operation based on pressure sensor 180A. Device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A.

[0120] The gyroscope sensor 180B can be used to determine the motion attitude of the device 100. In some embodiments, the gyroscope sensor 180B can detect the angle of rotation of the device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shake of the device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the device 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0121] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0122] The magnetic sensor 180D includes a Hall sensor. The device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the device 100 is a flip phone, the device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0123] The 180E accelerometer sensor can detect the magnitude of acceleration of device 100 in various directions (typically three axes). When device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices, and is applied to applications such as screen orientation switching and pedometers.

[0124] A distance sensor 180F is used to measure distance. Device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0125] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. Device 100 emits infrared light outward through the LED. Device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near device 100. When insufficient reflected light is detected, device 100 can determine that no object is near device 100. Device 100 may use the proximity sensor 180G to detect when a user holds device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0126] The ambient light sensor 180K is used to sense the brightness of ambient light. Device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180K can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180K can also work with the proximity sensor 180G to detect whether device 100 is in a pocket to prevent accidental touches.

[0127] The fingerprint sensor 180H is used to collect fingerprints. The device 100 can use the characteristics of the collected fingerprints to achieve fingerprint unlocking, access to application locks, fingerprint photography, fingerprint answering of incoming calls, etc.

[0128] Temperature sensor 180I is used to detect temperature. In some embodiments, device 100 uses the temperature detected by temperature sensor 180I to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180I exceeds a threshold, device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180I to reduce power consumption. In other embodiments, when the temperature is below another threshold, device 100 heats battery 142 to prevent abnormal shutdown of device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0129] Touch sensor 180J, also known as a "touch panel," can be located on display screen 194. The touch sensor 180J and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180J detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180J may also be located on the surface of device 100, in a different position than display screen 194.

[0130] The bone conduction sensor 180L can acquire vibration signals. In some embodiments, the bone conduction sensor 180L can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180L can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180L can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180L to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180L to realize heart rate detection functionality.

[0131] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Device 100 can receive button input and generate key signal inputs related to user settings and function control of device 100.

[0132] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can be corresponding to touch operations applied to different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0133] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0134] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the device 100. The device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the device 100 and cannot be separated from the device 100.

[0135] It should be noted that the electronic device or audio playback device mentioned in the embodiments of this application may also include more or fewer modules in device 100.

[0136] The software system of device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered architecture Android system as an example to illustrate the software structure of device 100.

[0137] The software structure of the device involved in the embodiments of this application is described below:

[0138] Figure 3 This is a software architecture block diagram of a device 100 provided in an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0139] For example, such as Figure 3 As shown, the application package may include, but is not limited to, one or more of the following applications: camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0140] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0141] like Figure 3 As shown, the application framework layer may include, but is not limited to, one or more of the following: window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0142] The window manager is used to manage windowed applications. For example, the window manager can obtain the screen size, determine whether there is a status bar, lock the screen, and capture the screen.

[0143] Content providers are used to store and retrieve data, making that data accessible to applications. For example, the data may include videos, images, audio, phone calls made and received, browsing history and bookmarks, phone books, etc.

[0144] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0145] The phone manager is used to provide communication functions for device 100. This includes managing call status (including connection and disconnection).

[0146] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0147] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0148] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0149] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0150] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. For example, the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0151] The system library may include multiple functional modules. For example, it may include, but is not limited to, one or more of the following: surface manager, media libraries, 3D graphics processing library (e.g., OpenGL ES), 2D graphics engine (e.g., SGL), etc.

[0152] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0153] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0154] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0155] A 2D graphics engine is a graphics engine for 2D drawing.

[0156] The kernel layer is the layer between hardware and software. For example, the kernel layer may include, but is not limited to, one or more of the following: display driver, camera driver, audio driver, and sensor driver.

[0157] The audio playback time adjustment method and electronic device will be further described below with reference to the accompanying drawings. It is understood that this application uses an electronic device and an audio playback device as examples to illustrate the interaction, but this application does not limit the execution subject of the interaction. For example, the method executed by the electronic device (or audio playback device) in this application can also be implemented by a communication / processing module in the electronic device (or audio playback device), or a circuit or chip in the electronic device (or audio playback device) responsible for communication / processing functions, or a logic node, logic module, or software that can implement all or part of the functions of the electronic device (or audio playback device).

[0158] Please see Figure 4 , Figure 4 This is a flowchart illustrating an audio playback time adjustment method provided in an embodiment of this application, wherein:

[0159] 401. An electronic device sends a first signal corresponding to each audio playback device to multiple audio playback devices. The first signal includes audio data to be played corresponding to the audio playback device and a synchronization signal corresponding to the audio playback device. Accordingly, each audio playback device can receive its corresponding first signal.

[0160] In this embodiment, before the electronic device sends the first signal corresponding to each audio playback device to multiple audio playback devices, it can establish a connection with the multiple audio playback devices so that the electronic device can subsequently send the first signal corresponding to each audio playback device to the multiple audio playback devices through the connection. As mentioned above, the electronic device and the audio playback devices can be connected via Bluetooth, WiFi, mobile communication network, or wired connection.

[0161] Optionally, after an electronic device establishes a connection with multiple audio playback devices, it can also assign channels to those audio devices. For example, suppose there are 4 audio playback devices with 5 channels. Channel 1 and channel 2 can be assigned to audio playback device 1, channel 3 to audio playback device 2, channel 4 to audio playback device 3, and channel 5 to audio playback device 4.

[0162] Optionally, after the electronic device assigns channels to the multiple audio devices, it can also generate a corresponding synchronization signal for each of the multiple audio playback devices, that is, each audio playback device has a corresponding synchronization signal.

[0163] Optionally, the audio data to be played for different audio playback devices among the multiple audio playback devices can be the same or different.

[0164] For example, suppose there are 4 audio playback devices. The electronic device generates synchronization signal 1 for audio playback device 1, synchronization signal 2 for audio playback device 2, synchronization signal 3 for audio playback device 3, and synchronization signal 4 for audio playback device 4.

[0165] The electronic device sends a first signal 1 to audio playback device 1, the first signal 1 including audio data to be played and a synchronization signal 1. The electronic device sends a first signal 2 to audio playback device 2, the first signal 2 including audio data to be played and a synchronization signal 2. The electronic device sends a first signal 3 to audio playback device 3, the first signal 3 including audio data to be played and a synchronization signal 3. The electronic device sends a first signal 4 to audio playback device 4, the first signal 4 including audio data to be played and a synchronization signal 4. The audio data to be played included in the first signals 1, 2, 3, and 4 may be the same or different.

[0166] Optionally, the first signal includes the audio data to be played corresponding to the audio playback device and the synchronization signal corresponding to the audio playback device. This can also be understood as the audio data to be played corresponding to the audio playback device and the synchronization signal corresponding to the audio playback device being sent in the time domain in superposition.

[0167] In one possible embodiment, the plurality of audio playback devices includes a first audio playback device, which corresponds to multiple channels, including a first channel. This first channel is associated with a synchronization signal corresponding to the first audio playback device. The association of the first channel with the synchronization signal of the first audio playback device can be understood as the synchronization signal of the first audio playback device being sent to the first audio playback device for playback via the first channel. That is, for each audio playback device, only one channel of that audio playback device receives the synchronization signal. Based on this possible embodiment, it is advantageous to avoid interference with the synchronization signal corresponding to the first audio playback device, thereby allowing for a more accurate determination of the playback delay of the audio playback device. Furthermore, sending the synchronization signal to only one channel of each audio playback device helps save transmission resources.

[0168] For example, such as Figure 5 As shown, audio playback device 1 is assigned channel 1 and channel 2, audio playback device 2 is assigned channel 3, audio playback device 3 is assigned channel 4, and audio playback device 4 is assigned channel 5. The electronic device sends a first signal 1 to audio playback device 1 through channel 1. This first signal 1 includes the audio data to be played and a synchronization signal 1. The electronic device sends the audio data to be played to audio playback device 1 through channel 2. The electronic device sends a first signal 2 to audio playback device 2 through channel 3. This first signal 2 includes the audio data to be played and a synchronization signal 2. The electronic device sends a first signal 3 to audio playback device 3 through channel 4. This first signal 3 includes the audio data to be played and a synchronization signal 3. The electronic device sends a first signal 4 to audio playback device 4 through channel 5. This first signal 4 includes the audio data to be played and a synchronization signal 4. The audio data to be played included in the first signals 1, 2, 3, and 4 may be the same or different.

[0169] In one possible embodiment, the electronic device can periodically send synchronization signals corresponding to multiple audio playback devices to correct for playback delays caused by variations in network latency. For example, as Figure 5 As shown, the electronic device sends its corresponding synchronization signal to audio playback device 1 to audio playback device 4 at regular intervals.

[0170] In one possible embodiment, the synchronization signals corresponding to multiple audio playback devices can be distinguished in the following four possible ways:

[0171] (1) The synchronization signals of different audio playback devices in multiple audio playback devices are located in different frequency bands.

[0172] For example, the synchronization signal 1 sent by the electronic device to audio playback device 1 is in the frequency band of 20-20.5kHz. The synchronization signal 2 sent by the electronic device to audio playback device 2 is in the frequency band of 20.5-21kHz. The synchronization signal 3 sent by the electronic device to audio playback device 3 is in the frequency band of 21-21.5kHz. The synchronization signal 4 sent by the electronic device to audio playback device 4 is in the frequency band of 21.5-22kHz.

[0173] (2) The timing of the transmission of the synchronization signal for different audio playback devices in multiple audio playback devices is different.

[0174] For example, the electronic device sends synchronization signal 1 to audio playback device 1 in 0-0.1s. The electronic device sends synchronization signal 2 to audio playback device 2 in 1-1.1s. The electronic device sends synchronization signal 3 to audio playback device 3 in 2-2.1s. The electronic device sends synchronization signal 4 to audio playback device 4 in 3-3.1s.

[0175] (3) Different sequences are used for the synchronization signals of different audio playback devices in multiple audio playback devices.

[0176] For example, the synchronization signal 1 sent by the electronic device to audio playback device 1 is 10111. The synchronization signal 2 sent by the electronic device to audio playback device 2 is 10110. The synchronization signal 3 sent by the electronic device to audio playback device 3 is 10101. The synchronization signal 3 sent by the electronic device to audio playback device 3 is 10100.

[0177] (4) The synchronization signal corresponding to the audio playback device includes the identifier of the audio playback device.

[0178] For example, synchronization signal 1 sent by the electronic device to audio playback device 1 includes the identifier of audio playback device 1. Synchronization signal 2 sent by the electronic device to audio playback device 2 includes the identifier of audio playback device 2. Synchronization signal 3 sent by the electronic device to audio playback device 3 includes the identifier of audio playback device 3. Synchronization signal 4 sent by the electronic device to audio playback device 4 includes the identifier of audio playback device 4.

[0179] Based on these four possible methods, the synchronization signals corresponding to multiple audio playback devices can be distinguished accurately, thereby allowing for a more accurate determination of the playback delay corresponding to the audio playback device.

[0180] In one possible embodiment, the synchronization signal is an ultrasonic signal; or, the frequency band of the synchronization signal does not overlap with the frequency band of the audio data to be played; or, the synchronization signal can be a signal with a relatively high frequency band; or, the synchronization signal can be a signal with a frequency band that is inaudible to humans. Based on this possible embodiment, it is advantageous to avoid interference from the audio data to be played on the synchronization signal, which could lead to an inability to accurately determine the playback delay corresponding to the audio playback device. Furthermore, if the synchronization signal is an ultrasonic signal, even if the audio playback device plays the first signal, the user can only hear the audio data to be played. Therefore, by making the synchronization signal an ultrasonic signal or a signal with a frequency band that is inaudible to humans, it is possible to avoid affecting the user's listening to the audio data to be played.

[0181] Optionally, before sending the audio data to be played and the synchronization signal corresponding to the audio playback device, the electronic device can filter the audio data to be played to remove signals in the same frequency band as the synchronization signal, and then send the filtered audio data to be played and the synchronization signal corresponding to the audio playback device. This optional approach helps avoid interference from the audio data to be played to the synchronization signal, which could lead to an inability to accurately determine the playback delay corresponding to the audio playback device.

[0182] 402. The audio playback device plays the first signal.

[0183] In this embodiment of the application, after receiving its corresponding first signal, the audio playback device plays the first signal through a speaker. For example, as... Figure 5 As shown, after receiving the first signal 1, audio playback device 1 plays the first signal 1 through a speaker. After receiving the first signal 2, audio playback device 2 plays the first signal 2 through a speaker. After receiving the first signal 3, audio playback device 3 plays the first signal 3 through a speaker. After receiving the first signal 4, audio playback device 4 plays the first signal 4 through a speaker.

[0184] 403. Electronic devices acquire the first signal played by an audio playback device through a microphone.

[0185] In this embodiment of the application, after the electronic device sends the first signal corresponding to the audio playback device to multiple audio playback devices respectively, the first signal played by the audio playback device can be collected by the microphone.

[0186] For example, suppose audio playback device 1 plays a first signal 1 through a speaker, audio playback device 2 plays a first signal 2 through a speaker, audio playback device 3 plays a first signal 3 through a speaker, and audio playback device 4 plays a first signal 4 through a speaker. An electronic device can capture the first signal 1 played by audio playback device 1, the first signal 2 played by audio playback device 2, the first signal 3 played by audio playback device 3, and the first signal 4 played by audio playback device 4 through a microphone.

[0187] 404. Electronic devices determine the playback delay of the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone.

[0188] Optionally, the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone can be understood as the start time of recognizing the synchronization signal after the microphone collects the first signal corresponding to the audio playback device.

[0189] For example, the electronic device determines the playback delay of audio playback device 1 based on the arrival time of synchronization signal 1 collected by the microphone. The electronic device determines the playback delay of audio playback device 2 based on the arrival time of synchronization signal 2 collected by the microphone. The electronic device determines the playback delay of audio playback device 3 based on the arrival time of synchronization signal 3 collected by the microphone. The electronic device determines the playback delay of audio playback device 4 based on the arrival time of synchronization signal 4 collected by the microphone.

[0190] The following describes two possible implementation methods for determining the playback delay of an audio playback device based on the arrival time of the synchronization signal acquired by the microphone:

[0191] 1) The electronic device determines the playback delay of the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone. The implementation method is as follows: The electronic device determines the playback delay of the audio playback device based on the transmission time of the synchronization signal corresponding to the audio playback device and the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone.

[0192] For example, the electronic device determines the playback delay corresponding to audio playback device 1 based on the transmission time of the synchronization signal 1 sent to audio playback device 1 and the arrival time of the synchronization signal 1 captured by the microphone. The electronic device determines the playback delay corresponding to audio playback device 2 based on the transmission time of the synchronization signal 2 sent to audio playback device 2 and the arrival time of the synchronization signal 2 captured by the microphone. The determination of the playback delay corresponding to audio playback device 3 and audio playback device 4 is similar and will not be elaborated upon here.

[0193] Optionally, when transmitting the first signal, the electronic device can internally acquire the first signal through hardware acquisition and find the synchronization signal from the first signal. The electronic device can determine the transmission time of the synchronization signal by the time the synchronization signal is found. Alternatively, in another optional approach, the electronic device can also record the transmission time of the first signal when transmitting it.

[0194] Optionally, the playback delay corresponding to the audio playback device is: the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the transmission time of the synchronization signal corresponding to the audio playback device.

[0195] For example, assuming that the electronic device sends the synchronization signal 1 to the audio playback device 1 at 9:10:01, and the microphone receives the synchronization signal 1 at 9:10:02, then the playback delay of the audio playback device 1 is 1 second, which is the time interval between 9:10:02 and 9:10:01.

[0196] For example, suppose the electronic device sends synchronization signal 2 to audio playback device 2 at 9:10:01, and the microphone picks up synchronization signal 1 at 9:10:02.5. Then the playback delay for audio playback device 1 is 1.5 seconds, which is the time interval between 9:10:02.5 and 9:10:01. The electronic device determines the playback delay for audio playback device 3 and audio playback device 4 in the same way, and will not be elaborated here.

[0197] 2) The electronic device can also play the synchronization signal corresponding to the electronic device through the speaker of the electronic device, and collect the synchronization signal played by the electronic device through the microphone; the electronic device determines the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone. The implementation method is as follows: the electronic device determines the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the electronic device collected by the microphone and the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone.

[0198] In other words, the electronic device also has a corresponding synchronization signal, and the electronic device can also play this synchronization signal. Optionally, the arrival time of the synchronization signal corresponding to the electronic device, which is collected by the microphone, can be understood as the start time of recognizing the synchronization signal after the microphone collects it.

[0199] For example, such as Figure 6As shown, audio playback device 1 is assigned channel 1 and channel 2, audio playback device 2 is assigned channel 3, audio playback device 3 is assigned channel 4, audio playback device 4 is assigned channel 5, and electronic device 6 is assigned channel 6. The electronic device sends a first signal 1 to audio playback device 1 via channel 1. This first signal 1 includes the audio data to be played and a synchronization signal 1. The electronic device sends the audio data to be played to audio playback device 1 via channel 2. The electronic device sends a first signal 2 to audio playback device 2 via channel 3. This first signal 2 includes the audio data to be played and a synchronization signal 2. The electronic device sends a first signal 3 to audio playback device 3 via channel 4. This first signal 3 includes the audio data to be played and a synchronization signal 3. The electronic device sends a first signal 4 to audio playback device 4 via channel 5. This first signal 4 includes the audio data to be played and a synchronization signal 4. The audio data to be played included in the first signals 1, 2, 3, and 4 may be the same or different.

[0200] Audio playback device 1 plays first signal 1, audio playback device 2 plays first signal 2, audio playback device 3 plays first signal 3, audio playback device 4 plays first signal 4, and the electronic device plays synchronization signal 5. The electronic device uses a microphone to collect the first signal 1 played by audio playback device 1, the first signal 2 played by audio playback device 2, the first signal 3 played by audio playback device 3, the first signal 4 played by audio playback device 4, and the synchronization signal 5 played by the electronic device. Based on the arrival time of synchronization signal 5 and synchronization signal 1 collected by the microphone, the electronic device determines the playback delay corresponding to audio playback device 1. Similarly, based on the arrival time of synchronization signal 5 and synchronization signal 2 collected by the microphone, the electronic device determines the playback delay corresponding to audio playback device 2. The determination of the playback delay corresponding to audio playback device 3 and audio playback device 4 is done in the same way and will not be elaborated here.

[0201] In one possible embodiment, the electronic device can periodically send synchronization signals corresponding to each audio playback device and a synchronization signal corresponding to the playback electronic device to multiple audio playback devices, respectively, to correct for playback latency issues caused by variations in network latency. For example, as... Figure 6 As shown, the electronic device sends its corresponding synchronization signal to audio playback device 1 to audio playback device 4 at regular intervals, and also plays its own corresponding synchronization signal at regular intervals.

[0202] In one possible embodiment, the electronic device determines the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the electronic device acquired by the microphone and the arrival time of the synchronization signal corresponding to the audio playback device acquired by the microphone. The implementation method is as follows: the electronic device determines the sound wave transmission delay from the speaker to the microphone based on the distance between the electronic device's speaker and microphone; the electronic device determines the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the electronic device acquired by the microphone, the arrival time of the synchronization signal corresponding to the audio playback device acquired by the microphone, and the sound wave transmission delay from the speaker to the microphone. Based on this possible embodiment, the playback delay corresponding to the audio playback device can be accurately determined.

[0203] In one possible embodiment, the playback delay corresponding to the audio playback device is the sum of a first time interval and the sound wave transmission delay from the speaker to the microphone of the electronic device. The first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the arrival time of the synchronization signal corresponding to the electronic device captured by the microphone. Based on this possible embodiment, the playback delay corresponding to the audio playback device can be accurately determined.

[0204] For example, such as Figure 7 As shown, assume the playback time of synchronization signal 5 corresponding to the electronic device is 9:10:010ms, the sound wave transmission delay from the speaker to the microphone of the electronic device is 3ms, the arrival time of synchronization signal 5 collected by the microphone is 9:10:013ms, and the arrival time of synchronization signal 1 collected by the microphone is 9:10:0113ms. Assume the transmission time of synchronization signal 1 from the electronic device to the audio playback device 1 is the same as the playback time of the corresponding synchronization signal of the electronic device. Then, the playback delay corresponding to audio playback device 1 can be equal to the sound wave transmission delay from the speaker to the microphone of the electronic device (i.e., 3ms) + the time interval between the arrival time of synchronization signal 1 collected by the microphone and the arrival time of synchronization signal 5 collected by the microphone (i.e., 100ms), that is, the playback delay corresponding to audio playback device 1 is 103ms.

[0205] In another possible embodiment, if the transmission time of the synchronization signal sent by the electronic device to the audio playback device is before the playback time of the corresponding synchronization signal of the electronic device, then the playback delay of the audio playback device is the sum of a first time interval, the sound wave transmission delay from the speaker to the microphone of the electronic device, and a second time interval. The first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the arrival time of the synchronization signal corresponding to the electronic device captured by the microphone. The second time interval is the time interval between the transmission time of the synchronization signal sent to the audio playback device and the playback time of the corresponding synchronization signal of the electronic device. Based on this possible embodiment, the playback delay of the audio playback device can be accurately determined.

[0206] For example, such as Figure 8 As shown, assume the electronic device sends synchronization signal 1 to audio playback device 1 at 9:10:08 ms. The time interval between the sending time of synchronization signal 1 and the playback time of the corresponding synchronization signal of the electronic device is 2 ms. Therefore, the playback delay of audio playback device 1 can be equal to the time interval between the sending time of synchronization signal 1 and the playback time of synchronization signal 5 (i.e., 2 ms) + the sound wave transmission delay from the speaker to the microphone of the electronic device (i.e., 3 ms) + the time interval between the arrival time of synchronization signal 1 and the arrival time of synchronization signal 5 (i.e., 100 ms), that is, the playback delay of audio playback device 1 is 105 ms.

[0207] In another possible embodiment, if the transmission time of the synchronization signal sent by the electronic device to the audio playback device is after the playback time of the corresponding synchronization signal of the electronic device, then the playback delay of the audio playback device is the sum of a first time interval and the sound wave transmission delay from the speaker to the microphone of the electronic device minus a second time interval. The first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the arrival time of the synchronization signal corresponding to the electronic device captured by the microphone. The second time interval is the time interval between the transmission time of the synchronization signal sent to the audio playback device and the playback time of the corresponding synchronization signal of the electronic device. Based on this possible embodiment, the playback delay of the audio playback device can be accurately determined.

[0208] For example, such as Figure 9As shown, assume the electronic device sends synchronization signal 1 to audio playback device 1 at 9:10:012ms. The time interval between the sending time of synchronization signal 1 and the playback time of the corresponding synchronization signal of the electronic device is 2ms. Therefore, the playback delay of audio playback device 1 can be equal to the sound wave transmission delay from the speaker to the microphone of the electronic device (i.e., 3ms) + the time interval between the arrival time of synchronization signal 1 and the arrival time of synchronization signal 5 (i.e., 100ms) - the time interval between the sending time of synchronization signal 1 and the playback time of synchronization signal 5 (i.e., 2ms), that is, the playback delay of audio playback device 1 is 101ms.

[0209] In another possible embodiment, the distance between the speaker and microphone of the electronic device is relatively short, so the sound wave transmission delay from the speaker to the microphone of the electronic device can be ignored.

[0210] For example, the transmission time of the synchronization signal sent by the electronic device to the audio playback device is equal to the playback time of the corresponding synchronization signal of the electronic device; the playback delay of the audio playback device can be a first time interval, which is the time interval between the arrival time of the synchronization signal of the audio playback device captured by the microphone and the arrival time of the synchronization signal of the electronic device captured by the microphone.

[0211] For example, the transmission time of the synchronization signal sent by the electronic device to the audio playback device is earlier than the playback time of the corresponding synchronization signal of the electronic device; the playback delay of the audio playback device can be the sum of a first time interval and a second time interval. The first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the arrival time of the synchronization signal corresponding to the electronic device captured by the microphone, and the second time interval is the time interval between the transmission time of the synchronization signal sent to the audio playback device and the playback time of the corresponding synchronization signal of the electronic device.

[0212] For example, the transmission time of the synchronization signal sent by the electronic device to the audio playback device is later than the playback time of the corresponding synchronization signal of the electronic device; the playback delay of the audio playback device can be the difference between a first time interval and a second time interval. The first time interval is the time interval between the arrival time of the synchronization signal of the audio playback device captured by the microphone and the arrival time of the synchronization signal of the electronic device captured by the microphone, and the second time interval is the time interval between the transmission time of the synchronization signal sent to the audio playback device and the playback time of the corresponding synchronization signal of the electronic device.

[0213] 405. The electronic device adjusts the time for sending the audio data to be played to the audio playback device based on the playback delay corresponding to the audio playback device.

[0214] For example, suppose the playback latency for audio playback device 1 is 100ms, for audio playback device 2 it is 200ms, for audio playback device 3 it is 300ms, and for audio playback device 4 it is 400ms. Electronic devices can send the audio data to be played to audio playback device 1 100ms in advance, to audio playback device 2 200ms in advance, to audio playback device 3 300ms in advance, and to audio playback device 4 400ms in advance.

[0215] For example, suppose the playback latency for audio playback device 1 is 100ms, for audio playback device 2 it's 200ms, for audio playback device 3 it's 300ms, and for audio playback device 4 it's 400ms. The electronic device can delay the playback of the video by 100ms. However, the electronic device doesn't advance the time it sends the audio data to be played to audio playback device 1, but it sends the audio data to audio playback device 2 100ms in advance, to audio playback device 3 200ms in advance, and to audio playback device 4 300ms in advance.

[0216] For example, in real-time video playback, such as live streaming or video calls, electronic devices may not be able to obtain audio data in advance. In this case, to achieve audio-visual synchronization, the video playback can also be delayed. For instance, suppose the playback delay for audio playback device 1 is 100ms, for audio playback device 2 it's 200ms, for audio playback device 3 it's 300ms, and for audio playback device 4 it's 400ms. Then, if the electronic device delays the video playback by 400ms, it can send the audio data to be played to audio playback device 1 by 300ms, to audio playback device 2 by 200ms, to audio playback device 3 by 100ms, and to audio playback device 4 by 0ms, ensuring that all four speakers play simultaneously with a 400ms delay.

[0217] In one possible embodiment, the electronic device adjusts the timing of sending audio data to be played to the audio playback device based on the playback latency corresponding to the audio playback device. Specifically, the electronic device adjusts the timing of sending the audio data to be played to the audio playback device based on the playback latency corresponding to the audio playback device and one or more of the following: the location of the audio playback device or the user's location. Based on this possible embodiment, it is beneficial to make the playback from multiple audio playback devices more stereo-like, or to improve the playback effect.

[0218] Alternatively, electronic devices can identify the user's location using methods such as cameras or millimeter-wave radar.

[0219] For example, based on the playback latency of the audio playback device and one or more of the following: the sound wave transmission latency between the audio playback device and the electronic device, the stereo model, or the user's location, the specific method by which the electronic device adjusts the timing of sending the audio data to be played to the audio playback device is as follows:

[0220] For example, electronic devices can calculate the latency of audio data transmission from each audio playback device to the user based on the location of the audio playback devices and the user's location, ensuring that the audio data from each audio playback device arrives at the user at the same time. For instance, if audio playback devices 1 to 4 are located at distances of 2 meters, 3 meters, 4 meters, and 6 meters from the user, respectively, and the speed of sound is 340 meters per second (at 15°C), then the latency of audio data transmission from these four devices to the user is 5.9 ms, 8.2 ms, 11.8 ms, and 17.6 ms, respectively. When adjusting the time for sending audio data to be played to the audio playback devices, the latency of audio data transmission from each audio playback device to the user can be added to ensure that the audio data from all four devices arrives at the user at the same time, thereby improving the playback effect.

[0221] For example, to achieve a stereo effect, it might be desirable for the audio data from different audio playback devices to arrive at the user at different times. For instance, based on the location of the audio playback devices, among audio playback devices 1 through 4, the two closest to the electronic device are audio playback devices 1 and 2, and the two farthest are audio playback devices 3 and 4. The electronic device can delay sending the audio data to be played to audio playback devices 3 and 4 by 10ms to ensure that the audio data from audio playback devices 3 and 4 arrives at the user at a different time than the audio data from audio playback devices 1 and 2, thus creating a more stereo effect from multiple audio playback devices.

[0222] It is evident that through implementation Figure 4The described method allows an electronic device to overlay audio data to be played and a corresponding synchronization signal to an audio playback device. This allows the audio playback device to play the synchronization signal simultaneously with the audio data. The electronic device's microphone can then capture the synchronization signal played by the audio playback device and determine the playback delay of the audio playback device based on the arrival time of the captured synchronization signal. This allows the electronic device to adjust the playback time of the audio data based on the playback delay of the audio playback device, thereby reducing the actual playback time difference between multiple audio playback devices and improving the playback effect.

[0223] This application provides an audio playback time adjustment device, which can be used to implement the functions of the aforementioned electronic device. This audio playback time adjustment device can be an electronic device. The device includes modules or units corresponding to the methods / operations / steps / actions performed by the electronic device in the above method embodiments. These units can be hardware circuits, software, or a combination of hardware circuits and software. Please refer to... Figure 10 , Figure 10 This is a schematic diagram of the structure of an audio playback time adjustment device 1000 provided in an embodiment of this application. The audio playback time adjustment device 1000 may include a communication unit 1001 and a processing unit 1002. Wherein:

[0224] The communication unit 1001 is used to send a first signal corresponding to the audio playback device to multiple audio playback devices respectively. The first signal includes audio data to be played corresponding to the audio playback device and a synchronization signal corresponding to the audio playback device.

[0225] Processing unit 1002 is used to acquire a first signal played by an audio playback device via a microphone;

[0226] The processing unit 1002 is also used to determine the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone.

[0227] The processing unit 1002 is also used to adjust the time for sending audio data to be played to the audio playback device based on the playback delay corresponding to the audio playback device.

[0228] In one possible embodiment, the processing unit 1002 determines the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone, including:

[0229] The playback delay of the audio playback device is determined based on the transmission time of the synchronization signal corresponding to the audio playback device and the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone.

[0230] In one possible embodiment, the playback delay corresponding to the audio playback device is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device captured by the microphone and the transmission time of the synchronization signal corresponding to the audio playback device.

[0231] In one possible embodiment, the processing unit 1002 is further configured to play a synchronization signal corresponding to the electronic device through a speaker; and to acquire the synchronization signal played by the electronic device through a microphone; the processing unit 1002 determines the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device acquired by the microphone, including: determining the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the electronic device acquired by the microphone and the arrival time of the synchronization signal corresponding to the audio playback device acquired by the microphone.

[0232] In one possible embodiment, the processing unit 1002 determines the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the electronic device acquired by the microphone and the arrival time of the synchronization signal corresponding to the audio playback device acquired by the microphone, including: determining the sound wave transmission delay from the speaker to the microphone of the electronic device based on the distance between the speaker and the microphone of the electronic device; and determining the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the electronic device acquired by the microphone, the arrival time of the synchronization signal corresponding to the audio playback device acquired by the microphone, and the sound wave transmission delay.

[0233] In one possible embodiment, the playback delay corresponding to the audio playback device is the sum of a first time interval and a sound wave transmission delay, wherein the first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone and the arrival time of the synchronization signal corresponding to the electronic device collected by the microphone.

[0234] In one possible embodiment, the processing unit 1002 adjusts the time for sending audio data to be played to the audio playback device based on the playback latency corresponding to the audio playback device, including: adjusting the time for sending audio data to be played to the audio playback device based on the playback latency corresponding to the audio playback device and one or more of the following: the location of the audio playback device or the location of the user.

[0235] In one possible embodiment, the synchronization signals of different audio playback devices in the plurality of audio playback devices are located in different frequency bands; or...

[0236] The synchronization signals for different audio playback devices in a multi-audio playback device are sent at different times; or,

[0237] Different audio playback devices in a multi-audio playback device may use different sequences for their synchronization signals; or...

[0238] The synchronization signal corresponding to the audio playback device includes the identifier of the audio playback device.

[0239] In one possible embodiment, the plurality of audio playback devices includes a first audio playback device, which corresponds to a plurality of channels, including a first channel, which is associated with a synchronization signal corresponding to the first audio playback device.

[0240] In one possible embodiment, the synchronization signal is an ultrasonic signal, or the frequency band of the synchronization signal does not overlap with the frequency band of the audio data to be played.

[0241] This application provides an audio playback time adjustment device, which can be used to implement the functions of the aforementioned audio playback device. This audio playback time adjustment device can be an audio playback device. The device includes modules or units corresponding to the methods / operations / steps / actions performed by the audio playback device in the above method embodiments. These units can be hardware circuits, software, or a combination of hardware circuits and software. Please refer to... Figure 10 , Figure 10 This is a schematic diagram of the structure of an audio playback time adjustment device 1000 provided in an embodiment of this application. The audio playback time adjustment device 1000 may include a communication unit 1001 and a processing unit 1002. Wherein:

[0242] The communication unit 1001 is used to receive a first signal sent by the electronic device corresponding to the audio playback device, the first signal including audio data to be played corresponding to the audio playback device and a synchronization signal corresponding to the audio playback device; the processing unit 1002 is used to play the first signal; the played synchronization signal is used by the electronic device to determine the playback delay corresponding to the audio playback device, and adjust the time of sending the audio data to be played to the audio playback device based on the playback delay corresponding to the audio playback device.

[0243] In one possible embodiment, the audio playback device corresponds to multiple channels, including a first channel, which is associated with a synchronization signal corresponding to the audio playback device.

[0244] In one possible embodiment, the electronic device is connected to multiple audio playback devices, and the synchronization signals corresponding to these multiple audio playback devices can be distinguished in the following four possible ways:

[0245] (1) The synchronization signals of different audio playback devices in multiple audio playback devices are located in different frequency bands;

[0246] (2) The synchronization signals of different audio playback devices in multiple audio playback devices are sent at different times;

[0247] (3) Different sequences are used for the synchronization signals of different audio playback devices in multiple audio playback devices;

[0248] (4) The synchronization signal corresponding to the audio playback device includes the identifier of the audio playback device.

[0249] In one possible embodiment, the synchronization signal is an ultrasonic signal, or the frequency band of the synchronization signal does not overlap with the frequency band of the audio data to be played, or the synchronization signal can be a signal with a relatively high frequency band, or the synchronization signal can be a signal with a frequency band that is inaudible to humans.

[0250] In the various embodiments of this application, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of different embodiments are consistent and can be referenced by each other. The technical features of different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0251] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application. The order of the process numbers described above does not imply the order of execution; the execution order of each process should be determined by its function and internal logic.

[0252] This application also provides a computer-readable storage medium storing computer-executable instructions. When the computer-executable instructions are executed, the method executed by the electronic device or audio playback device in the above method embodiments is implemented.

[0253] This application also provides a computer program product, which includes a computer program that, when executed, causes the method executed by the electronic device or audio playback device in the above method embodiments to be implemented.

[0254] This application also provides a communication system, which includes an electronic device and an audio playback device. The electronic device is used to execute the method described in the above method embodiments. The audio playback device is used to execute the method described in the above method embodiments.

[0255] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0256] The descriptions of the various embodiments provided in this application can be referenced mutually. Each embodiment has its own emphasis, and parts not described in detail in a certain embodiment can be referred to the relevant descriptions of other embodiments. For the sake of convenience and brevity, for example, the functions and execution steps of the various devices and equipment provided in the embodiments of this application can be referred to the relevant descriptions of the method embodiments of this application. The method embodiments and the device embodiments can also be referenced, combined or cited from each other.

[0257] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for adjusting audio playback time, characterized in that, The method includes: Send a first signal corresponding to each audio playback device to multiple audio playback devices respectively. The first signal includes the audio data to be played corresponding to the audio playback device and the synchronization signal corresponding to the audio playback device. The first signal played by the audio playback device is acquired through the microphone; Based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone, the playback delay corresponding to the audio playback device is determined; Based on the playback latency of the audio playback device, the time for sending the audio data to be played to the audio playback device is adjusted.

2. The method according to claim 1, characterized in that, Determining the playback delay of the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone includes: Based on the transmission time of the synchronization signal corresponding to the audio playback device and the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone, the playback delay corresponding to the audio playback device is determined.

3. The method according to claim 2, characterized in that, The playback delay corresponding to the audio playback device is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone and the transmission time of the synchronization signal corresponding to the audio playback device.

4. The method according to claim 1, characterized in that, When applied to electronic devices, the method further includes: The electronic device plays a synchronization signal corresponding to the electronic device through its speaker; The microphone is used to acquire the synchronization signal played by the electronic device; Determining the playback delay of the audio playback device based on the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone includes: Based on the arrival time of the synchronization signal corresponding to the electronic device collected by the microphone and the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone, the playback delay corresponding to the audio playback device is determined.

5. The method according to claim 4, characterized in that, The determination of the playback delay corresponding to the audio playback device based on the arrival time of the synchronization signal corresponding to the electronic device collected by the microphone and the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone includes: Based on the distance between the speaker and microphone of the electronic device, the sound wave transmission delay from the speaker to the microphone of the electronic device is determined; Based on the arrival time of the synchronization signal corresponding to the electronic device collected by the microphone, the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone, and the sound wave transmission delay, the playback delay corresponding to the audio playback device is determined.

6. The method according to claim 5, characterized in that, The playback delay of the audio playback device is the sum of the first time interval and the sound wave transmission delay. The first time interval is the time interval between the arrival time of the synchronization signal corresponding to the audio playback device collected by the microphone and the arrival time of the synchronization signal corresponding to the electronic device collected by the microphone.

7. The method according to any one of claims 1 to 6, characterized in that, Applied to electronic devices, the method of adjusting the time for sending audio data to be played to the audio playback device based on the playback latency corresponding to the audio playback device includes: Based on the playback latency of the audio playback device and one or more of the following: the location of the audio playback device or the location of the user, the time for sending the audio data to be played to the audio playback device is adjusted.

8. The method according to any one of claims 1 to 7, characterized in that, The synchronization signals of different audio playback devices among the multiple audio playback devices are located in different frequency bands; or... The synchronization signals of different audio playback devices among the multiple audio playback devices are sent at different times; or, The synchronization signals for different audio playback devices among the multiple audio playback devices use different sequences; or... The synchronization signal corresponding to the audio playback device includes the identifier of the audio playback device.

9. The method according to any one of claims 1 to 8, characterized in that, The plurality of audio playback devices includes a first audio playback device, which corresponds to a plurality of channels, including a first channel, which is associated with a synchronization signal corresponding to the first audio playback device.

10. The method according to any one of claims 1 to 9, characterized in that, The synchronization signal is an ultrasonic signal, or the frequency band of the synchronization signal does not overlap with the frequency band of the audio data to be played.

11. An audio playback time adjustment device, characterized in that, Includes units for performing the method as described in any one of claims 1 to 10.

12. An electronic device, characterized in that, The device includes a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, The storage medium stores a computer program or instructions, which, when executed by the device positioning device, implement the method as described in any one of claims 1 to 10.

14. A computer program product comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by the device positioning device, the method as described in any one of claims 1 to 10 is implemented.

Images