Wireless audio and video synchronization

Abstract

An electronic device and method for synchronization of wireless audio and video are provided. The electronic device determines a first wireless audio processing delay associated with the electronic device and receives media content including video content and audio content associated with the video content. The electronic device transmits audio content to a wireless audio device and controls playback of the video content on a display device based on the determined first wireless audio processing delay, so that playback of the video content is synchronized in time with playback of the audio content on the wireless audio device.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS / INCORPORATED BY REFERENCE

[0002] none. Technical Field

[0003] Various embodiments of the present disclosure relate to audio to video (AV) synchronization. More specifically, various embodiments of the present disclosure relate to electronic devices and methods for synchronization of wireless audio and video. Background Art

[0004] AV synchronization or lip sync problems are well-known issues associated with media transmission and playback. Typically, lip sync errors are measured by the amount of time that the audio of the AV content lags behind or leads the video of the AV content. In the case of wireless audio, such as Audio, there are noticeable lip sync issues which can be extremely annoying and actually make the show unwatchable for some people.

[0005] Limitations and disadvantages of conventional and traditional approaches will become apparent to those skilled in the art by comparing the described system with certain aspects of the present disclosure, as set forth in the remainder of this application and with reference to the accompanying figures. Summary of the invention

[0006] There is provided an electronic device and method for synchronization of wireless audio and video, substantially as shown in and / or described in connection with at least one of the figures, as more fully set forth in the claims.

[0007] These and other features and advantages of the present disclosure may be understood by reading the following detailed description of the disclosure and the accompanying drawings, in which like reference numerals refer to like parts throughout. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 is a block diagram illustrating an exemplary network environment for synchronization of wireless audio and video according to an embodiment of the present disclosure.

[0009] Figure 2 is a block diagram illustrating an exemplary electronic device for synchronization of wireless audio and video according to an embodiment of the present disclosure.

[0010] Figure 3 is a diagram illustrating an exemplary operation for synchronization of wireless audio and video according to an embodiment of the present disclosure.

[0011] Figure 4 is a diagram illustrating an exemplary operation for synchronization of wireless audio and video according to an embodiment of the present disclosure.

[0012] Figure 5is a flow chart illustrating an exemplary method for synchronization of wireless audio and video according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0013] The embodiments described below may be found in the disclosed electronic device and method for synchronization of wireless audio and video. Exemplary aspects of the present disclosure provide an electronic device that can determine a wireless audio processing delay associated with the electronic device (i.e., an audio source). The wireless audio processing delay may include a duration that the playback of video content may lead or lag behind the playback of audio content on a wireless audio device. The electronic device may transmit audio content to a wireless audio device for playback, and may control the playback of video content on a display device so that the playback of the video content is synchronized in time with the playback of the transmitted audio content on the wireless audio device.

[0014] The playback of video content can be controlled based on the determined wireless audio processing delay. For example, the electronic device can use the determined wireless audio processing delay to delay the playback of video content on the display device. Because the playback of audio content is delayed due to wireless audio processing, the delayed playback of video content can be timed to match the delayed playback of audio content on the wireless audio device. This can alleviate lip sync (or AV synchronization problem) and enhance the listening experience of the user on the wireless audio device. When the video content is displayed on the display device, the user can hear the audio content on the wireless audio device.

[0015] Figure 1 is a block diagram illustrating an exemplary network environment for synchronization of wireless audio and video according to an embodiment of the present disclosure. Figure 1 , a network environment 100 is shown. The network environment 100 may include an electronic device 102, an audio / video (AV) source 104, a display device 106, and a wireless audio device 108. The electronic device 102 may be coupled to the wireless audio device 108 via a wireless network 110. A user 112 that may be associated with the wireless audio device 108 is also shown. Figure 1 In the present disclosure, the electronic apparatus 102 and the display device 106 are shown as two separate devices, however, in some embodiments, the entire functionality of the display device 106 may be incorporated into the electronic apparatus 102 without departing from the scope of the present disclosure.

[0016] The electronic device 102 may include suitable logic, circuit systems, interfaces and / or code that may be configured to receive media content from the AV source 104 and control playback of the received media content via the display device 106 and one or more audio devices communicatively coupled to the electronic device 102.

[0017] In an exemplary embodiment, the electronic device 102 may be a display-enabled media player and the display device 106 may be included in the electronic device 102. Examples of such implementations of the electronic device 102 may include, but are not limited to, a television (TV), an Internet Protocol television (IPTV), a smart TV, a smart phone, a personal computer, a laptop computer, a tablet computer, a wearable electronic device, or any other display device capable of receiving, decoding, and playing content encapsulated in a broadcast signal from a cable or satellite network, a wireless broadcast, or an Internet-based communication signal.

[0018] In another exemplary embodiment, the electronic device 102 may be a media player that may communicate with the display device 106 via a wired or wireless connection. Examples of such implementations of the electronic device 102 may include, but are not limited to, a digital media player (DMP), a micro-console, a TV tuner, an Advanced Television Systems Committee (ATSC) 3.0 tuner, a set-top box, an over-the-top (OTT) player, a digital media streamer, a media extender / modulator, a digital media hub, a computer workstation, a mainframe computer, a handheld computer, a smart appliance, a plug-in device, and / or any other computing device with content streaming and playback capabilities.

[0019] The AV source 104 may include suitable logic, circuitry, and interfaces that may be configured to transmit media content to the electronic device 102. The media content on the AV source 104 may include audio content and video content associated with the audio content. For example, if the media content is a television program, the audio content may include background audio, actor voices or speeches, and other audio components (such as audio description).

[0020] In an embodiment, the AV source 104 can be implemented as a storage device for storing media content. Examples of such implementations of the AV source 104 can include, but are not limited to, a pen drive, a flash USB stick, a hard disk drive (HDD), a solid state drive (SSD), and / or a secure digital (SD) card. In another embodiment, the AV source 104 can be implemented as a media streaming server that can transmit media content to the electronic device 102 via a communication network (not shown). In another embodiment, the AV source 104 can be a TV tuner (such as an ATSC tuner) that can receive a digital TV (DTV) signal from an air broadcast network and can extract media content from the received DTV signal. Thereafter, the AV source 104 can transmit the extracted media content to the electronic device 102.

[0021] exist Figure 1, the AV source 104 and the electronic device 102 are shown as two separate devices. However, the present disclosure may not be limited thereto, and in some embodiments, the functionality of the AV source 104 may be fully or at least partially incorporated into the electronic device 102 without departing from the scope of the present disclosure.

[0022] The display device 106 may include suitable logic, circuit systems, and / or interfaces that may be configured to display video content received from the electronic device 102. In one embodiment, the display device 106 may be a touch screen that enables the user 112 to provide user input via the display device 106. The display device 106 may be implemented by several known technologies, such as, but not limited to, at least one of a liquid crystal display (LCD) display, a light emitting diode (LED) display, a plasma display, or an organic LED (OLED) display technology or other display device. Depending on the embodiment, the display device 106 may refer to a display screen of a smart glasses device, a perspective display, a projection-based display, an electrochromic display, a transparent display, or a head mounted device (HMD).

[0023] The wireless audio device 108 may include suitable logic, circuitry, and / or interfaces that may be configured to receive audio content from the electronic apparatus 102. The wireless audio device 108 may be a portable wireless speaker, a wearable audio device, or a head-mounted audio device. Examples of the wireless audio device 108 may include, but are not limited to, wireless speakers for a surround sound system, headphones, in-ear headphones, clip-on headphones, bone conduction headphones, hearing aids, smart glasses, or head-mounted displays (e.g., augmented reality (AR) headsets, mixed reality (MR) headsets, or virtual reality (VR) goggles). The wireless audio device 108 may rely on wireless communication protocols (such as Wi-Fi, or Low Energy (BLE)) to receive audio content from the electronic device 102.

[0024] The wireless network 110 may include a medium through which two or more wireless devices may communicate with each other. For example, the wireless network 110 may be established between the electronic device 102 and the wireless audio device 108, and may allow the electronic device 102 and the wireless audio device 108 to communicate with each other. In the case where there are two or more wireless audio devices, each of the two or more wireless audio devices may be paired and communicate with the electronic device 102 via the wireless network 110.

[0025] Examples of wireless network protocols may include, but are not limited to, radio frequency identification (RFID), wireless USB, and near field communication (NFC) (e.g., NFC peer-to-peer), Bluetooth TM, or Bluetooth Low Energy (BLE TM ), ZigBee, Personal Area Network (PAN), Wi-Max, cellular network, Long Term Evolution (LTE) network, or evolved High Speed ​​Packet Access (HSPA+), protocols based on 802 wireless standards, such as 802.3, 802.15.1, 802.16 (wireless local loop), 802.20 (Mobile Broadband Wireless Access (MBWA)), 802.11-1997 (legacy), 802.15.4, 802.11a, 802.11b, 802.11g, 802.11e, 802.11i, 802 .11f, 802.11c, 802.11h (for European standards only), 802.11n, 802.11j (for Japanese standards only), 802.11p, 802.11ac, 802.11ad, 802.11ah, 802.11aj, 802.11ax, 802.11ay, 802.11az, 802.11hr (high data rate), 802.11af (blank spectrum), 802.11-2007, 802.11-2008, 802.11-2012, 802.11-2016.

[0026] In operation, the electronic device 102 may determine a first wireless audio processing delay associated with the electronic device 102. According to an embodiment, the first wireless audio processing delay may be based on a memory (e.g., Figure 2 The memory may store the first delay profile in the form of a lookup table, which may include a list of wireless audio processing delays associated with various models or variants of the electronic device 102 (identified by the unique identifier). The lookup table may also include a media access control (MAC) address associated with the electronic device 102. An example of a lookup table is provided in Table 1, as shown below:

[0027]

[0028] Table 1: Lookup table

[0029] The data provided in Table 1 are provided only as experimental data and should not be construed as limiting the present disclosure. The first wireless audio processing delay may be associated with an audio processing pipeline of the electronic device 102. The audio processing pipeline may include various audio processing operations that may be performed on the electronic device 102 before the audio content is wirelessly transmitted to the wireless audio device 108. Examples of such audio processing operations may include, but are not limited to, audio frame buffering, sample rate conversion, file format conversion, or audio transcoding.

[0030] In some embodiments, the first wireless audio processing delay may depend on the size of each audio buffer and the number of times audio frames of audio content are stored and retrieved from each audio buffer. Larger audio buffers introduce greater delays between the time an audio sample is written to it and read out for the next operation. For wireless audio transmission, the audio processing pipeline may also include operations to convert the audio content into a suitable codec format. For example, if the audio content needs to be transmitted as If audio is transmitted, the audio content may need to be converted into a suitable codec format to match Audio Standards. Thus, the first wireless audio processing delay may include delays that may be incurred due to conversion to a suitable codec format for wireless audio.

[0031] Conversion to the appropriate codec format may use an appropriate audio codec. Examples of audio codecs for audio may include, but are not limited to, LDAC TM 、AptX TM 、AptX TM Adaptive, Low Latency and High Definition Audio Codec (LHDC TM ), low complexity communication codec (LC3), and low complexity sub-band codec (SBC). Since each type of audio codec can consume computing resources and buffers in different ways, the delay included in the first wireless audio processing delay can vary depending on the type of audio codec used for conversion.

[0032] In some other embodiments, the first wireless audio processing delay may also include a delay associated with a wireless audio transmission operation that may be performed by the wireless data transmission hardware or circuit system of the electronic device 102. Audio transmission, audio samples of audio content can be transmitted through The audio transmission hardware queues, packages and sends the audio content. The Bluetooth audio transmission hardware can package and transmit the packaged audio content via the wireless network 110. The delay associated with audio transmission may be included in the first wireless audio processing delay. For audio, the first wireless audio processing delay may include a 100 millisecond delay for the audio processing operations of the audio processing pipeline, an additional 2-5 milliseconds delay for conversion to the appropriate codec format, and a 100 millisecond delay for the audio processing operations of the audio processing pipeline. Another 100 ms delay for audio transmission.

[0033] In some other embodiments, the electronic device 102 may also determine a second wireless audio processing delay associated with the wireless audio device 108. For example, the electronic device 102 may first determine the MAC address of the wireless audio device 108, and then determine the second wireless processing delay associated with the wireless audio device 108 based on the determined MAC address. The second wireless audio processing delay may be determined based on a second delay profile stored in the memory of the electronic device 102. Similar to the first delay profile, the memory may also store the second delay profile in the form of a lookup table. The lookup table may include wireless audio processing delays associated with different models or variants of the wireless audio device 108. An example of a lookup table is provided in Table 2, as shown below:

[0034] Identifier of the wireless audio device 108 Wireless Audio Processing Latency MAC Address Device A 5 ms 00:1A:7D:10:7C:84 Device B 7 ms F8:DF:15:6D:E9:7B Device C 10 ms 0D:1D:86:88:CC:F0

[0035] Table 2: Lookup table

[0036] The data provided in Table 2 are provided only as experimental data and should not be construed as limiting the present disclosure. The second wireless audio processing delay may be associated with a delay caused by an audio processing operation on the wireless audio device 108. Examples of such audio processing operations may include, but are not limited to, audio packet / frame buffering, audio decoding or decryption, or other audio effects (such as audio equalization).

[0037] In some other embodiments, the electronic device 102 may control the display device 106 to display the test video. Furthermore, the electronic device 102 may transmit the test audio associated with the test video to the wireless audio device 108. The electronic device 102 may receive a user input via the wireless audio device 108, which may include a duration for which the playback of the test video will be delayed to match the playback time of the transmitted test audio on the wireless audio device 108. The user input may be received in the form of a touch input, a hand gesture, a head movement, a voice input, etc. The electronic device 102 may determine the first wireless audio processing delay as the duration included in the user input.

[0038] At any time, the electronic device 102 can receive media content from the AV source 104. The media content may include, for example, audio content, video content associated with the audio content, and other information (such as subtitles and closed captions). The electronic device 102 can transmit the audio content to the wireless audio device 108 via the wireless network 110. Thereafter, the electronic device 102 can control the playback of the video content on the display device 106 based on the determined first wireless audio processing delay, so that the playback of the video content is synchronized in time with the playback of the audio content on the wireless audio device 108. For example, the playback of the video content may be delayed by at least the determined first wireless audio processing delay to match the time of the audio content being played back on the wireless audio device 108.

[0039] In some embodiments, the electronic device 102 may further control the playback of the video content on the display device 106 based on the determined second audio processing delay. For example, the playback of the video content may be delayed by a time equal to the sum of the determined first wireless audio processing delay and the determined second wireless audio processing delay. Due to the delay in video playback, the user 112 may be able to listen to the audio content on the wireless audio device 108 and watch the video content on the display device 106 without any noticeable lip sync issues.

[0040] Figure 2 is a block diagram illustrating an exemplary electronic device for synchronization of wireless audio and video according to an embodiment of the present disclosure. Figure 2 Combination Figure 1 The elements in are explained. Figure 2 , a block diagram 200 of an electronic device 102 is shown. The electronic device 102 may include a circuit system 202, a memory 204, an AV source 206, a buffer memory 208, and a network interface 210. The circuit system 202 may be communicatively coupled to the wireless audio device 108, the AV source 206, the buffer memory 208, and the network interface 210. The AV source 206 is Figure 1 An exemplary embodiment of the AV source 104.

[0041] The circuit system 202 may include suitable logic, circuit systems, and / or interfaces that may be configured to execute program instructions associated with different operations to be performed by the electronic device 102. The circuit system 202 may include one or more special processing units, which may be implemented as an integrated processor or a cluster of processors that together perform the functions of one or more special processing units. The circuit system 202 may be implemented based on a variety of processor technologies known in the art. Examples of implementations of the circuit system 202 may be an x86-based processor, a graphics processing unit (GPU), a reduced instruction set computing (RISC) processor, an application specific integrated circuit (ASIC) processor, a complex instruction set computing (CISC) processor, a microcontroller, a central processing unit (CPU), and / or other computing circuits.

[0042] The memory 204 may include suitable logic, circuit systems, and / or interfaces that may be configured to store program instructions to be executed by the circuit system 202. In at least one embodiment, the memory 204 may be configured to store a first delay profile for the electronic device 102. The first delay profile may include a first wireless audio processing delay associated with the electronic device 102. In addition, the first delay profile may include a model name or identifier (ID) of the electronic device 102 and / or a media access control (MAC) address associated with the electronic device 102. The memory 204 may also be configured to store a second delay profile for the wireless audio device 108. The second delay profile may include a second wireless audio processing delay associated with the wireless audio device 108. In addition, the second delay profile may include a model name or identifier of the wireless audio device 108 and / or a MAC address associated with the wireless audio device 108. The memory 204 may also be configured to store media content including video content and audio content associated with the video content. Examples of implementations of memory 204 may include, but are not limited to, random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), a hard disk drive (HDD), a solid-state drive (SSD), CPU cache, and / or a secure digital (SD) card.

[0043] AV source 206 may include suitable logic, circuit systems, and / or interfaces that may be configured to output compressed media including compressed audio data and compressed video data. AV source 206 may also include a memory for storing compressed media. AV source 206 may receive compressed media via various content delivery systems, such as terrestrial content broadcast networks, satellite-based broadcast networks, Internet Protocol (IP)-based content networks, or combinations thereof.

[0044] The buffer memory 208 may include suitable logic, circuitry, and interfaces that may be configured to temporarily store data to be transmitted to or received from the electronic device 102. In one embodiment, the memory 204 may be configured to allocate the buffer memory 208 immediately when required to store data. The size of the allocation (in kilobytes or megabytes) may depend on the content bandwidth (in Mbps) and whether compressed or uncompressed data is required to be stored in the buffer memory 208. In another embodiment, the buffer memory 208 may be a memory module that may be separate from the memory 204. Example implementations of such a memory module may include, but are not limited to, a random access memory (RAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a hard disk drive (HDD), a solid-state drive (SSD), and / or a secure digital (SD) card.

[0045] The network interface 210 may include suitable logic, circuitry, interfaces, and / or code that may be configured to facilitate communication between the circuitry 202 and the wireless audio device 108 via the wireless network 110. The network interface 210 may be implemented using various known techniques to support wireless communication of the electronic device 102 via the wireless network 110. The network interface 210 may include, for example, an antenna, a radio frequency (RF) transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a coder-decoder (CODEC) chipset, a subscriber identity module (SIM) card, local buffering circuitry, and the like.

[0046] The network interface 210 may be configured to communicate with a network such as the Internet, an intranet, a wireless network, a cellular telephone network, a wireless local area network (LAN), or a metropolitan area network (MAN) via wireless communication. The wireless communication may be configured to use one or more of a variety of communication standards, protocols, and technologies, such as Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (such as IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, or IEEE802.11n), Voice over Internet Protocol (VoIP), Light Fidelity (Li-Fi), or Worldwide Interoperability for Microwave Access (Wi-MAX).

[0047] like Figure 1 The functions or operations performed by the electronic device 102 may be performed by the circuit system 202. For example, in Figure 3 and Figure 4The operations performed by circuit system 202 are described in detail in FIG.

[0048] Figure 3 is a diagram illustrating an exemplary operation for synchronization of wireless audio and video according to an embodiment of the present disclosure. Figure 3 Combination Figure 1 and Figure 2 The elements in are explained. Figure 3 , a block diagram 300 is shown, which illustrates exemplary operations from 304 to 308 for synchronization of wireless audio and video. The exemplary operations can be performed by any computing system, such as by Figure 1 The electronic device 102 or Figure 2 The circuit system 202 is executed.

[0049] It is further shown that it can be coupled to Figure 2 The AV source 302 is a buffer memory 208. The AV source 302 is Figure 2 AV source 206 or Figure 1 For the sake of brevity, the present disclosure omits the description of the AV source 302. The AV source 302 may store compressed media including compressed audio data 302A and compressed video data 302B associated with the compressed audio data 302A.

[0050] At 304, the compressed audio data 302A may be decoded. According to an embodiment, the circuit system 202 may decode the compressed audio data 302A to output uncompressed audio, which may be referred to as audio content. The compressed audio data 302A may be decoded and converted into a suitable codec format supported by an audio codec for wireless audio transmission. Thereafter, the circuit system 202 may transmit the audio content to the wireless audio device 108 via the wireless network 110.

[0051] The decoding of the compressed audio data 302A, the conversion to the appropriate codec format, and the wireless transmission of the audio content may result in a delay in the wireless audio processing pipeline of the electronic device 102. The delay may be equal to (or may be approximately) a determined first wireless audio processing delay associated with the electronic device 102 (e.g., Figure 1 To avoid any lip sync errors due to such delays in the wireless audio processing pipeline of the electronic device 102 , the decoding of the compressed video data 302B may be delayed, as described at 306 .

[0052] At 306, the compressed video data 302B may be stored in the buffer memory 208. According to an embodiment, the circuit system 202 may store the compressed video data 302B in the buffer memory 208 for a hold duration while the compressed audio data 302A is being decoded, converted, and transmitted to the wireless audio device 108 (at 304). The hold duration may refer to a duration that the compressed video data 302B may be stored in the buffer memory 208 to delay playback of the uncompressed video data (i.e., video content) on the display device 106 and match the playback time of the audio content transmitted to the wireless audio device 108. The hold duration may include the determined first wireless audio processing delay and / or any delay associated with moving the compressed video data 302B into and out of the buffer memory 208. In at least one embodiment, the hold duration may also include a second wireless audio processing delay (e.g., a delay associated with the wireless audio device 108) associated with the wireless audio device 108. Figure 1 described in ).

[0053] At 308, the compressed video data 302B may be decoded. According to an embodiment, the circuit system 202 may extract the compressed video data 302B from the buffer memory 208 after the hold duration. After extraction, the circuit system 202 may decode the compressed video data 302B to output uncompressed video, which may be referred to as video content. After the compressed video data 302B is decoded, the circuit system 202 may transmit the video content to the display device 106 and may control the playback of the video content on the display device 106. Since the operation at 308 may only start after the compressed video data 302B is removed from the buffer memory 208, the playback of the video content may be delayed to match the playback time of the audio content on the wireless audio device 108. This may allow the electronic device 102 to remove lip sync errors that are typically associated with the playback of the video content and the playback of the audio content.

[0054] Figure 4 is a diagram illustrating an exemplary operation for synchronization of wireless audio and video according to an embodiment of the present disclosure. Figure 4 Combination Figure 1 , 2 and 3. Figure 4 , a block diagram 400 is shown, which illustrates exemplary operations from 404 to 408 for synchronization of wireless audio and video. The exemplary operations from 404 to 408 can be performed by any computing system, such as by Figure 1 The electronic device 102 or Figure 2 The circuit system 202 is executed.

[0055] It is further shown that it can be coupled to Figure 2The AV source 402 is a buffer memory 208. The AV source 402 is Figure 2 AV source 206 or Figure 1 For the sake of brevity, the present disclosure omits the description of the AV source 402. The AV source 402 may store compressed media including compressed audio data 402A and compressed video data 402B associated with the compressed audio data 402A.

[0056] At 404, the compressed audio data 402A may be decoded. According to an embodiment, the circuit system 202 may decode the compressed audio data 402A to output uncompressed audio, which may be referred to as audio content. The compressed audio data 402A may be decoded and converted into a suitable codec format supported by an audio codec for wireless audio transmission. Thereafter, the circuit system 202 may transmit the audio content to the wireless audio device 108 via the wireless network 110.

[0057] The decoding of the compressed audio data 402A, the conversion to the appropriate codec format, and the wireless transmission of the audio content may result in a delay in the wireless audio processing pipeline of the electronic device 102. The delay may be equal to (approximately) a determined first wireless audio processing delay associated with the electronic device 102 (e.g., Figure 1 To avoid any lip sync errors due to such delays in the wireless audio processing pipeline of the electronic device 102, the compressed video data 402B may first be decoded and then stored in a buffer for delayed playback, as described at 406 and thereafter.

[0058] At 406, compressed video data 402B may be decoded. According to an embodiment, circuitry 202 may decode compressed video data 402B to output uncompressed video, which may be referred to as video content.

[0059] At 408, the video content may be stored in the buffer memory 208 after the compressed video data 402B is decoded. According to an embodiment, the circuit system 202 may store the compressed video data 402B in the buffer memory 208 for a hold duration while the compressed audio data 402A is decoded, converted, and transmitted to the wireless audio device 108 (at 404).

[0060] The hold duration may refer to a duration that the compressed video data 402B may be stored in the buffer memory 208 to delay playback of the uncompressed video data (i.e., video content) on the display device 106 and match the playback time of the audio content transmitted to the wireless audio device 108. The hold duration may include the determined first wireless audio processing delay and / or any delay associated with moving the compressed video data 402B into and out of the buffer memory 208. In at least one embodiment, the hold duration may also include a second wireless audio processing delay (e.g., a delay associated with the wireless audio device 108) associated with the wireless audio device 108. Figure 2 described in ).

[0061] The circuit system 202 may extract the video content (i.e., uncompressed video data) from the buffer memory 208 after the hold duration and may transmit the video content to the display device 106. Thereafter, the circuit system 202 may control the playback of the video content on the display device 106 and match the playback time of the audio content on the wireless audio device 108.

[0062] Figure 5 is a flow chart illustrating an exemplary method for synchronization of wireless audio and video according to an embodiment of the present disclosure. Figure 5 Combination Figure 1 , 2 , 3 and 4 are explained. Figure 5 , a flowchart 500 is shown. The method shown in flowchart 500 may be performed by any computing system, such as by electronic device 102 or circuit system 202. The method may start at 502 and proceed to 504.

[0063] At 504 , a first wireless audio processing delay may be determined. In one or more embodiments, the circuit system 202 may be configured to determine a first wireless audio processing delay associated with the electronic device 102 .

[0064] At 506, media content may be received. In one or more embodiments, circuit system 202 may be configured to receive media content including video content and audio content associated with the video content.

[0065] At 508, the audio content may be transmitted to the wireless audio device 108. In one or more embodiments, the circuit system may be configured to transmit the audio content to the wireless audio device 108.

[0066] At 510, playback of the video content on the display device 106 may be controlled based on the determined first wireless audio processing delay. In one or more embodiments, the circuit system 202 may be configured to control playback of the video content on the display device 106 based on the determined first wireless audio processing delay such that playback of the video content is synchronized in time with playback of the audio content on the wireless audio device 108. Control may be passed to end.

[0067] Although flowchart 500 is shown as discrete operations, such as 504, 506, 508, and 510, the present disclosure is not limited thereto. Thus, in certain embodiments, such discrete operations may be further divided into additional operations, combined into fewer operations, or eliminated, depending on the particular implementation, without departing from the essence of the disclosed embodiments.

[0068] Various embodiments of the present disclosure may provide a non-transitory computer-readable medium and / or storage medium on which instructions that can be executed by a machine and / or computer to operate an electronic device are stored. The instructions may cause the machine and / or computer to perform operations including determining a first wireless audio processing delay associated with the electronic device. The operations may also include receiving media content including video content and audio content associated with the video content. The operations may also include transmitting the audio content to a wireless audio device that is communicatively coupled to the electronic device. The operations may also include controlling the playback of the video content on a display device associated with the electronic device based on the determined first wireless audio processing delay, so that the playback of the video content is synchronized in time with the playback of the audio content on the wireless audio device.

[0069] An exemplary aspect of the present disclosure may provide an electronic device (such as Figure 1 An electronic device 102) includes a circuit system (such as circuit system 202) that can be communicatively coupled to a display device (such as display device 106) and a wireless audio device (such as wireless audio device 108). The circuit system can be configured to determine a first wireless audio processing delay associated with the electronic device. At any time, the circuit system can also be configured to receive media content including video content and audio content associated with the video content. The circuit system can also be configured to transmit the audio content to the wireless audio device and control the playback of the video content on the display device based on the determined first wireless audio processing delay, so that the playback of the video content is synchronized in time with the playback of the audio content on the wireless audio device. According to an embodiment, the playback of the video content is delayed by at least the determined first wireless audio processing delay to match the time of the playback of the audio content on the wireless audio device.

[0070] According to an embodiment, the circuit system may also be configured to determine a media access control (MAC) address of the wireless audio device and determine a second wireless audio processing delay associated with the wireless audio device based on the determined MAC address. According to an embodiment, the circuit system may also be configured to control playback of the video content on the display device further based on the determined second wireless audio processing delay.

[0071] According to an embodiment, the electronic device may further include a memory (such as memory 204) configured to store a first delay profile for the electronic device. The first delay profile includes a first wireless audio processing delay associated with the electronic device. According to an embodiment, the circuit system may also be configured to determine the first wireless audio processing delay based on the first delay profile.

[0072] According to an embodiment, the electronic device may also include an audio / video (AV) source (such as AV source 206) that is configured to output compressed media including compressed audio data (e.g., compressed audio data 302A) and compressed video data (e.g., compressed video data 302B).

[0073] According to an embodiment, the electronic device may further include a buffer memory (such as buffer memory 208) coupled to the AV source. The circuit system may be configured to store the compressed video data in the buffer memory for a retention duration including a determined first wireless audio processing delay while decoding the compressed audio data into audio content and transmitting it to the wireless audio device. The circuit system may also be configured to extract the compressed video data from the buffer memory after the retention duration. After extraction, the circuit system may also be configured to decode the compressed video data into video content. Thereafter, the circuit system may be configured to control the playback of the video content on the display device to match the playback timing of the audio content on the wireless audio device.

[0074] According to an embodiment, the electronic device may further include a buffer memory (such as buffer memory 208) coupled to the AV source. The circuit system may be configured to decode the compressed video data to obtain video content. After decoding, the circuit system may be configured to store the video content in the buffer memory for a retention duration including a determined first wireless audio processing delay while decoding the compressed audio data into audio content and transmitting it to the wireless audio device. The circuit system may also be configured to extract the stored video data from the buffer memory after the retention duration. Thereafter, the circuit system may be configured to control the playback of the video content on the display device to match the playback timing of the transmitted audio content on the wireless audio device.

[0075] According to an embodiment, the circuit system may also be configured to control a display device to display a test video. The circuit system may also be configured to transmit a test audio associated with the test video to the wireless audio device 108. The circuit system may also be configured to receive a user (such as user 112) input via the wireless audio device, the user input including a duration for which playback of the test video will be delayed to match the playback time of the test audio transmitted to the wireless audio device. Thereafter, the circuit system may be configured to set the first wireless audio processing delay to the duration included in the user input.

[0076] The present disclosure may be implemented in hardware or in a combination of hardware and software. The present disclosure may be implemented in a centralized manner, in at least one computer system, or in a distributed manner, wherein different elements may be distributed over a plurality of interconnected computer systems. A computer system or other device suitable for performing the methods described herein may be suitable. The combination of hardware and software may be a general-purpose computer system with a computer program that, when loaded and executed, can control the computer system so that it performs the methods described herein. The present disclosure may be implemented in hardware including a portion of an integrated circuit that also performs other functions.

[0077] The present disclosure may also be embedded in a computer program product comprising all the features enabling the implementation of the methods described herein and which, when loaded into a computer system, is capable of carrying out these methods. In this context, a computer program refers to any expression of a set of instructions in any language, code or notation that is intended to cause a system with information processing capabilities to perform specific functions directly, or after one or both of the following: a) conversion into another language, code or notation; b) reproduction in a different material form.

[0078] Although the present disclosure is described with reference to certain embodiments, it will be appreciated by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the present disclosure. In addition, many modifications may be made to adapt specific circumstances or materials to the teachings of the present disclosure without departing from the scope of the present disclosure. Therefore, it is intended that the present disclosure is not limited to the specific embodiments disclosed, but that the present disclosure will include all embodiments falling within the scope of the appended claims.

Claims

1. An electronic device for synchronization of wireless audio and video, comprising: A circuit system communicatively coupled to a display device and a wireless audio device, wherein the circuit system is configured to: determining a first wireless audio processing delay associated with the electronic device based on a size of each audio buffer, a number of times audio frames of audio content are stored and retrieved from each audio buffer, a type of audio codec used for format conversion, and a latency associated with wireless audio transfer operations; Determine the media access control MAC address of the wireless audio device; determining a second wireless audio processing delay associated with the wireless audio device based on the determined MAC address; receiving media content including video content and audio content associated with the video content; Stream audio content to wireless audio devices; as well as Playback of the video content on the display device is controlled based on the determined first wireless audio processing delay and the determined second wireless audio processing delay such that playback of the video content is synchronized in time with playback of the audio content on the wireless audio device.

2. The electronic apparatus of claim 1, wherein playback of the video content is delayed by at least a first determined wireless audio processing delay and a second determined wireless audio processing delay to match the timing of playback of the audio content on the wireless audio device.

3. The electronic device according to claim 1, further comprising an audio / video AV source configured to output compressed media including compressed audio data and compressed video data.

4. The electronic device of claim 3, further comprising a buffer memory coupled to the AV source, wherein the circuit system is further configured to: storing the compressed video data in a buffer memory for a retention duration including a determined first wireless audio processing delay while decoding the compressed audio data into audio content and transmitting to the wireless audio device; as well as extracting the compressed video data from the buffer memory after the hold duration; After extraction, the compressed video data is decoded into video content; as well as Playback of the video content on the display device is controlled to match the timing of playback of the audio content on the wireless audio device.

5. The electronic device of claim 3, further comprising a buffer memory coupled to the AV source, wherein the circuit system is further configured to: Decoding the compressed video data to obtain video content; After decoding, storing the video content in a buffer memory for a retention duration including a determined first wireless audio processing delay while the compressed audio data is decoded into audio content and transmitted to the wireless audio device; extracting the stored video content from the buffer memory after the hold duration; and Playback of the video content on the display device is controlled to match the timing of playback of the transmitted audio content on the wireless audio device.

6. The electronic device according to claim 1, wherein the circuit system is further configured to: Controlling a display device to display a test video; transmitting test audio associated with the test video to the wireless audio device; and receiving, via the wireless audio device, a user input comprising a duration for which playback of the test video is to be delayed to match a playback time of the transmitted test audio on the wireless audio device; and The first wireless audio processing delay is set to a duration included in the user input.

7. A method for synchronization of wireless audio and video, comprising: In an electronic device communicatively coupled to a wireless audio device and a display device: determining a first wireless audio processing delay associated with the electronic device based on a size of each audio buffer, a number of times audio frames of audio content are stored and retrieved from each audio buffer, a type of audio codec used for format conversion, and a latency associated with wireless audio transfer operations; Determine the media access control MAC address of the wireless audio device; determining a second wireless audio processing delay associated with the wireless audio device based on the determined MAC address; receiving media content including video content and audio content associated with the video content; Stream audio content to wireless audio devices; as well as Playback of the video content on the display device is controlled based on the determined first wireless audio processing delay and the determined second wireless audio processing delay such that playback of the video content is synchronized in time with playback of the audio content on the wireless audio device.

8. The method of claim 7, wherein controlling the playback of the video content corresponds to delaying the playback of the video content by at least a determined first wireless audio processing delay and a determined second wireless audio processing delay to match the timing of playback of the audio content on the wireless audio device.

9. The method of claim 7, further comprising outputting compressed media including compressed audio data and compressed video data via an audio / video AV source of the electronic device.

10. The method according to claim 9, further comprising: storing the compressed video data in a buffer memory on the electronic device for a retention duration that includes a determined first wireless audio processing delay while decoding the compressed audio data into audio content and transmitting to the wireless audio device; as well as extracting the compressed video data from the buffer memory after the hold duration; After extraction, the compressed video data is decoded into video content; as well as Playback of the video content on the display device is controlled to match the timing of playback of the audio content on the wireless audio device.

11. The method according to claim 9, further comprising: Decoding the compressed video data to obtain video content; After decoding, storing the video content in a buffer memory for a retention duration including a determined first wireless audio processing delay while the compressed audio data is decoded into audio content and transmitted to the wireless audio device; extracting the stored video content from a buffer memory on the electronic device after the hold duration; as well as Playback of the video content on the display device is controlled to match the timing of playback of the transmitted audio content on the wireless audio device.

12. The method according to claim 7, further comprising: Controlling a display device to display a test video; transmitting test audio associated with the test video to a wireless audio device; as well as receiving, via the wireless audio device, a user input including a duration for which playback of the test video is to be delayed to match a playback time of the transmitted test audio on the wireless audio device; as well as The first wireless audio processing delay is set to a duration included in the user input.

13. A non-transitory computer-readable medium storing computer-executable instructions, the computer-executable instructions, when executed by a computer in an electronic device, causing the electronic device to perform operations comprising: determining a first wireless audio processing delay associated with the electronic device based on a size of each audio buffer, a number of times audio frames of audio content are stored and retrieved from each audio buffer, a type of audio codec used for format conversion, and a latency associated with wireless audio transfer operations; Determine the media access control MAC address of the wireless audio device; determining a second wireless audio processing delay associated with the wireless audio device based on the determined MAC address; receiving media content including video content and audio content associated with the video content; transmitting the audio content to a wireless audio device communicatively coupled to the electronic device; as well as Playback of the video content on a display device associated with the electronic apparatus is controlled based on the determined first wireless audio processing delay and the determined second wireless audio processing delay such that playback of the video content is synchronized in time with playback of the audio content on the wireless audio device.

Images