Audio and video synchronization processing method and related equipment

By sending the target sound signal in the TV device and recording the playback time difference, and adjusting the audio and video synchronization, the audio and video synchronization problem between the TV and the external audio device is solved, improving the user experience.

CN115802087BActive Publication Date: 2024-11-01SHENZHEN SKYWORTH RGB ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202211368593.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-03
Publication Date
2024-11-01
Estimated Expiration
2042-11-03

AI Technical Summary

Technical Problem

The audio and video synchronization problem between the TV and external audio equipment leads to a high audio delay when Bluetooth audio output, causing the audio and video to be out of synchronization and affecting the user experience.

Method used

By sending target sound signal playback instructions, internal and external audio playback devices play target sound signals at the same time, record the playback time point, calculate the time difference. If the difference is greater than the preset value, audio and video synchronous adjustment will be performed, including increasing audio and video playback The device's signal delays or adjusts the external audio decoding method.

Benefits of technology

Effectively adjust the audio and video delay of external audio playback devices to ensure consistency between the audio signal and the video signal, and improve the user's audition experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115802087B_ABST
    Figure CN115802087B_ABST
Patent Text Reader

Abstract

The embodiment of the present application discloses a method for processing audio and video synchronization, which is applied to an audio and video playback device with an external audio playback device, including: sending a target sound signal playback instruction; playing the target sound signal through an internal audio playback structure, and sending a first audio signal; playing the target sound signal through an external audio playback device, and sending a second audio signal; receiving the first audio signal, and recording the receiving time as a first time point; receiving the second audio signal, and recording the receiving time as a second time point; adjusting the audio and video synchronization based on the difference between the first time point and the second time point. Through the above method, the audio and video delay of the external audio playback device is adjusted, ensuring the consistency of the audio signal and video signal output by the external audio playback device and the audio and video playback device during use, and improving the user's listening experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of data processing, and in particular, relates to a method for synchronously processing audio and video and related equipment. Background Art

[0002] Television (TV) refers to a device that uses electronic technology to transmit moving images and audio signals, that is, a television receiver, and is also an important broadcast and video communication tool. As a commonly used audio-visual device, the most common scenario for television is to output images and sounds so that users can watch and hear at the same time. Therefore, images and sounds need to be output synchronously to give users a better user experience.

[0003] When in use, the TV can also be used in conjunction with external audio playback devices, such as HDMI audio output, optical fiber audio output, Bluetooth audio output, etc., to output the TV's own audio to external audio devices through different channels, and the external audio playback device plays the corresponding audio.

[0004] However, after being processed by an external audio device, the time difference between the audio played by the external device and the image and audio played by the TV itself will become larger. Taking Bluetooth audio output as an example, when Bluetooth audio is transmitted, the audio will be encoded first, then transmitted to the Bluetooth audio playback device via Bluetooth, and then decoded and played. Due to the influence of these factors, the audio playback process of Bluetooth devices usually has a high delay, resulting in the problem of audio and video being out of sync. Summary of the invention

[0005] A first aspect of an embodiment of the present application provides a method for audio-visual synchronization processing, the method being applied to an audio-visual playback device having an external audio playback device, comprising:

[0006] Sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used to instruct the internal audio playing structure of the audio and video playing device and the external audio playing device to play the target sound signal simultaneously;

[0007] Play the target sound signal through the internal audio playing structure to send out a first audio signal;

[0008] Play the target sound signal through the external audio playback device to emit a second audio signal;

[0009] receiving the first audio signal, and recording the receiving time as a first time point;

[0010] receiving the second audio signal, and recording the receiving time as a second time point;

[0011] The audio and video synchronization is adjusted based on the difference between the first time point and the second time point.

[0012] According to the audio and video synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the audio and video playback device is a television device.

[0013] According to the audio and video synchronization processing method provided by the first aspect of the embodiment of the present application, optionally, receiving the first audio signal includes:

[0014] receiving the first audio signal through a microphone;

[0015] The receiving the second audio signal comprises:

[0016] The second audio signal is received through the microphone.

[0017] According to the audio and video synchronization processing method provided by the first aspect of the embodiment of the present application, optionally, the audio and video synchronization adjustment based on the difference between the first time point and the second time point includes:

[0018] Determine whether the difference between the first time point and the second time point is greater than a preset value;

[0019] If the difference is greater than a preset value, the process of adjusting the audio and video synchronization is performed;

[0020] If the difference is less than or equal to the preset value, the audio and video synchronization adjustment process is not performed.

[0021] According to the audio and video synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the process of adjusting the audio and video synchronization includes:

[0022] A signal delay of a difference duration is added to the local signal processing process of the audio and video playback device, and the difference duration is equal to the difference between the first time point and the second time point.

[0023] According to the audio and video synchronization processing method provided by the first aspect of the embodiment of the present application, optionally, the audio and video synchronization adjustment process includes:

[0024] Adjust the audio decoding mode of the external audio playback device.

[0025] According to the audio and video synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the microphone is arranged on the control device of the audio and video playback device.

[0026] A second aspect of an embodiment of the present application provides an audio-visual synchronization processing device, the device being used in association with an audio-visual playback device including an external audio playback device, including:

[0027] A sending unit, used for sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used for instructing the internal audio playing structure of the audio and video playing device and the external audio playing device to play the target sound signal simultaneously;

[0028] A first audio playing unit, configured to play the target sound signal through the internal audio playing structure to emit a first audio signal;

[0029] A second audio playback unit, configured to play the target sound signal through the external audio playback device to emit a second audio signal;

[0030] A first receiving unit, configured to receive the first audio signal and record a receiving time as a first time point;

[0031] A second receiving unit, configured to receive the second audio signal and record a receiving time as a second time point;

[0032] An adjustment unit is used to adjust the audio and video synchronization based on the difference between the first time point and the second time point.

[0033] Based on the audio and video synchronization processing device provided in the second aspect of the embodiment of the present application, optionally, the audio and video playback device is a television device.

[0034] Based on the audio and video synchronization processing device provided by the second aspect of the embodiment of the present application, optionally, the first receiving unit is specifically used to: receive the first audio signal through a microphone;

[0035] The second receiving unit is specifically configured to receive the second audio signal through the microphone.

[0036] Based on the audio and video synchronization processing device provided by the second aspect of the embodiment of the present application, optionally, the adjustment unit is specifically used for:

[0037] Determine whether the difference between the first time point and the second time point is greater than a preset value;

[0038] If the difference is greater than a preset value, the process of adjusting the audio and video synchronization is performed;

[0039] If the difference is less than or equal to the preset value, the audio and video synchronization adjustment process is not performed.

[0040] Based on the audio and video synchronization processing device provided by the second aspect of the embodiment of the present application, optionally, the adjustment unit is specifically used for:

[0041] A signal delay of a difference duration is added to the local signal processing process of the audio and video playback device, and the difference duration is equal to the difference between the first time point and the second time point.

[0042] Based on the audio and video synchronization processing device provided by the second aspect of the embodiment of the present application, optionally, the adjustment unit is specifically used for:

[0043] Adjust the audio decoding mode of the external audio playback device.

[0044] Based on the audio and video synchronization processing device provided in the second aspect of the embodiment of the present application, optionally, the microphone is arranged on the control device of the audio and video playback device.

[0045] A third aspect of the present application provides an audio and video playback device, including:

[0046] Processor, memory, internal audio playback structure, external audio playback device;

[0047] The memory is a short-term storage memory or a persistent storage memory;

[0048] The processor is configured to communicate with the memory, and to control the internal audio playback structure and the external audio playback device on the audio and video playback device to execute instruction operations in the memory and thereby execute a method as described in any one of the first aspects of the embodiments of the present application.

[0049] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, comprising instructions, which, when executed on a computer, enable the computer to execute a method as described in any one of the first aspects of the embodiment of the present application.

[0050] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages: the embodiments of the present application provide a method for processing audio and video synchronization, which is applied to an audio and video playback device with an external audio playback device, including: sending a target sound signal playback instruction, the target sound signal playback instruction is used to instruct the internal audio playback structure of the audio and video playback device and the external audio playback device to play the target sound signal at the same time; playing the target sound signal through the internal audio playback structure to emit a first audio signal; playing the target sound signal through the external audio playback device to emit a second audio signal; receiving the first audio signal and recording the receiving time as a first time point; receiving the second audio signal and recording the receiving time as a second time point; adjusting the audio and video synchronization based on the difference between the first time point and the second time point. Through the above method, the audio and video delay of the external audio playback device is adjusted, ensuring the consistency of the audio and video signals output by the external audio playback device and the audio and video playback device during use, and improving the user's listening experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without creative work. It is understood that the drawings provided in this section are only used to better understand the present solution and do not constitute a limitation of the present application.

[0052] Figure 1 A flowchart of an embodiment of the audio and video synchronization processing method provided by the present application;

[0053] Figure 2 Another flowchart of an embodiment of the audio and video synchronization processing method provided by the present application;

[0054] Figure 3 A structural diagram of an embodiment of the audio and video synchronization processing method provided by the present application;

[0055] Figure 4 A structural schematic diagram of an embodiment of the audio and video playback device provided in this application. DETAILED DESCRIPTION

[0056] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application are clearly and completely described below. Obviously, the described embodiments are only embodiments of a part of the present application, rather than all embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work should belong to the scope of protection of the present application. At the same time, for the sake of clarity and simplicity, the description of well-known functions and structures is omitted in the following description.

[0057] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0058] As a commonly used audio-visual device, the most common scenario for TV is to output images and sounds so that users can watch and listen at the same time. Therefore, images and sounds need to be output synchronously to give users a better user experience. When using TV, it can also be used in conjunction with external audio playback devices, such as HDMI audio output, optical fiber audio output, Bluetooth audio output, etc., to output the audio of the TV itself to external audio devices through different channels, and the external audio playback device plays the corresponding audio.

[0059] However, after being processed by an external audio device, the time difference between the audio played by the external device and the image and audio played by the TV itself will become larger. Taking Bluetooth audio output as an example, when Bluetooth audio is transmitted, the audio will be encoded first, then transmitted to the Bluetooth audio playback device via Bluetooth, and then decoded and played. Under the influence of these factors, a higher delay will usually be generated, about 200 milliseconds. This delay effect will cause users to feel the phenomenon of audio and video being out of sync more obviously, affecting the user's experience. To solve this problem, the first aspect of the embodiment of the present application provides a method for audio and video synchronization processing, please refer to Figure 1 , including: step 101 to step 106.

[0060] 101. Send a target sound signal playing instruction.

[0061] Specifically, before explaining the method, it is necessary to introduce the implementation environment of this solution. In the actual implementation process, this solution can be applied to any device with audio and video playback function, especially the device can be a TV, personal computer, IPAD, projector or even a smart phone, or an audio and video playback device composed of a TV and a set-top box. It only needs to be a device that can be connected to an external audio playback device and has an audio and video playback function. The specific type is not limited here. The type of external audio playback device connected to the audio and video playback device can also be determined according to the actual situation, such as Bluetooth speakers or Bluetooth headphones, etc., which is not limited here.

[0062] In this step, the user can choose to perform the audio and video processing process through a specific application or an interface provided by the audio and video playback device, thereby activating the process of sending the target sound signal playback instruction to the internal audio playback structure and the external audio playback device. The target sound signal playback instruction sent in this step is used to instruct the internal audio playback structure of the audio and video playback device and the external audio playback device to play the target sound signal at the same time, that is, to instruct the device body and the external device to play a certain specific sound at the same time, thereby simulating the audio and video playback process under normal conditions, so as to support the judgment of whether there is a situation where the audio and video are out of sync, and provide support for the processing process of the audio and video being out of sync. The specific target sound signal played should be stored in association with the instruction, and the target sound signal should have a specific frequency and duration for the subsequent recognition process. The specific form can be determined according to the actual situation and is not limited here.

[0063] 102. Play a target sound signal through an internal audio playback structure to send out a first audio signal.

[0064] Specifically, the target sound signal is played through the internal audio playback structure to send out a first audio signal. The internal audio playback structure is a structure such as a speaker or loudspeaker possessed by the audio and video playback device itself. When the target sound signal is played through the internal audio playback structure, no additional data processing is required, and the playback process can be performed directly. Therefore, the time difference between the first audio signal sent and the instruction is small. In addition, for the audio and video playback device itself, there is a high consistency between its audio playback time and video playback time, and it can be considered that there is no time difference or the time difference is small. Taking television equipment as an example, under normal circumstances, the delay standard of images and sounds is controlled within 50 milliseconds, so it can be determined that the time when the first audio signal is sent is the time when the picture is played.

[0065] 103. Play the target sound signal through an external audio playback device to send out a second audio signal.

[0066] Specifically, the target sound signal is played through the external audio playback device to send out a second audio signal. The external audio playback device is a device that has established a data connection with the audio and video playback device in advance and has a control relationship. In the general working process, when the audio and video playback device plays the audio signal in the media signal through the internal audio playback structure, it will also transmit the electronic data of the audio signal to the external audio playback device, and the external audio playback device will play it synchronously. However, during the playback process, the external audio playback device needs to encode the audio first, then transmit it to the external audio playback device side, and then decode it. This process will produce unnecessary delays, which can easily cause a large gap between the audio signal played by the external audio playback device and the time point when the instruction is issued. Therefore, there will be a time gap between the second audio signal and the first audio signal.

[0067] 104. Receive a first audio signal, and record the receiving time as a first time point;

[0068] Specifically, a first audio signal is received, and the receiving time is recorded as a first time point. In the actual implementation process, it can be implemented through an audio receiving device, specifically through a receiver or a microphone. In the actual implementation process, the audio receiving process can be performed through a microphone of an audio and video playback device, and the first time point when the first audio signal is received is recorded to compare the time difference with the time when the second audio signal is sent.

[0069] 105. Receive the second audio signal, and record the receiving time as a second time point;

[0070] Specifically, a second audio signal is received, and the receiving time is recorded as a second time point. The receiving process of the second audio signal is similar to the receiving process of the aforementioned first audio signal, and the details are not repeated here. It is worth noting that when the second audio signal is received, there may be a superposition of the first audio signal and the second audio signal. At this time, the audio recognition process should be processed accordingly to accurately identify the second audio signal.

[0071] 106. Perform audio and video synchronization adjustment based on the difference between the first time point and the second time point.

[0072] Specifically, the audio and video synchronization adjustment is performed based on the difference between the first time point and the second time point. Specifically, if the difference between the two is too large, the audio and video synchronization adjustment process can be performed. If the difference is small, the process can be terminated without making corresponding adjustments.

[0073] For situations where adjustments are needed, the audio and video synchronization can also be adjusted in different ways. For example, a certain delay can be set for the audio and video processing and playback process of the audio and video playback device itself to make it match the processing time of the external audio playback device, thereby achieving a consistent processing effect of audio and video. In addition, the delay can also be reduced by changing the audio decoding method of the external audio playback device. The specific method can be determined according to the actual situation and is not limited here.

[0074] It is understandable that after performing the audio and video synchronization adjustment process, the process as described above in steps 101 to 105 can be performed again to obtain the difference between the first time point and the second time point again, and then determine whether the audio and video synchronization adjustment process has achieved the predetermined effect. If not, it can be adjusted again to ensure the processing effect.

[0075] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages: the embodiments of the present application provide a method for processing audio and video synchronization, which is applied to an audio and video playback device with an external audio playback device, including: sending a target sound signal playback instruction, the target sound signal playback instruction is used to instruct the internal audio playback structure of the audio and video playback device and the external audio playback device to play the target sound signal at the same time; playing the target sound signal through the internal audio playback structure to emit a first audio signal; playing the target sound signal through the external audio playback device to emit a second audio signal; receiving the first audio signal and recording the receiving time as a first time point; receiving the second audio signal and recording the receiving time as a second time point; adjusting the audio and video synchronization based on the difference between the first time point and the second time point. Through the above method, the audio and video delay of the external audio playback device is adjusted, ensuring the consistency of the audio and video signals output by the external audio playback device and the audio and video playback device during use, and improving the user's listening experience.

[0076] To facilitate the use of this method in actual implementation, this application also provides a more detailed embodiment that can be optionally implemented, please refer to Figure 2 , an embodiment of the present application includes: step 101-step 105.

[0077] 201. Send a target sound signal playing instruction.

[0078] Specifically, this embodiment is described by taking a television device as an example. When using the television, the user can control the television to enter the audio and video adjustment process through the television remote control, and then execute this method.

[0079] 202. Play a target sound signal through an internal audio playing structure to send out a first audio signal.

[0080] 203. Play the target sound signal through an external audio playback device to send out a second audio signal.

[0081] Specifically, the above steps 202 to 203 are the same as the above Figure 1 Steps 102 to 103 in the corresponding embodiment are similar, and the details can be referred to the aforementioned content, which will not be repeated here.

[0082] 204. Receive a first audio signal through a microphone, and record a receiving time as a first time point.

[0083] 205. Receive a second audio signal through a microphone, and record the receiving time as a second time point.

[0084] Specifically, the above steps 204 to 205 can be completed by a microphone set on the TV device, wherein the microphone for receiving sound can also be set on a remote control corresponding to the TV device, or as an independent device with a data connection with the TV device. The specific details can be determined according to actual conditions and are not limited here.

[0085] 206. Determine whether the difference between the first time point and the second time point is greater than a preset value.

[0086] Specifically, the difference between the first time point and the second time point is calculated, and the relationship between the difference and the preset value is compared, wherein the preset value is pre-set by the staff to indicate the maximum acceptable delay of the audio and video. The smaller the preset value is, the better the audio and video synchronization effect is, but the higher the accuracy requirement for the adjustment process is. Generally speaking, the value can be set to 50ms. The specific value setting can be determined according to the actual situation and is not limited here. If the difference between the first time point and the second time point is less than or equal to the preset value, it means that the delay is within a reasonable range, and step 207 is executed without performing the audio and video synchronization adjustment process. If the difference between the first time point and the second time point is greater than the preset value, step 208 is executed to perform the audio and video synchronization adjustment process.

[0087] 207. The audio and video synchronization adjustment process is not performed.

[0088] Specifically, if the difference between the first time point and the second time point is less than or equal to the preset value, it means that the degree of audio and video asynchrony in the current environment is small, and no adjustment is required. The audio and video synchronization adjustment process can be skipped and the process can be ended.

[0089] 208. Perform the process of adjusting the synchronization between audio and video.

[0090] Specifically, there are two ways to implement the audio and video synchronization adjustment process, which are described below:

[0091] (1) A signal delay of a difference duration is added to the local signal processing process of the audio and video playback device, where the difference duration is equal to the difference between the first time point and the second time point.

[0092] That is, during the processing of the audio and video playback device, the video and audio signals are output after the difference in time, but the delay is not increased for the external audio playback device. Then, by increasing the processing delay in the local signal processing process, the audio and video output by the audio and video playback device and the audio output by the external audio playback device are kept consistent in time.

[0093] (2) Adjusting the audio decoding method of the external audio playback device.

[0094] Specifically, in the actual implementation process, the external audio device may use some encoding methods that obtain better audio effects but are more complex to process. Although this method obtains better sound effects, it will cause higher latency. Therefore, it can be switched to some encoding methods with average processing effects but relatively simple and fast. For example, the common Bluetooth audio encoding format is SBC (Sub-band coding) / AAC (Advanced Audio Coding), and the low-latency Bluetooth audio encoding format is aptX LL (APTX Low Latency, low-latency lossless transmission technology) / LC3 (Low Complexity Communication Codec) / LHDC (Low-Latency Hi-Definition Audio Codec). In the actual implementation process, the conventional encoding method can be converted into an encoding method under the low-latency classification, thereby reducing the latency of the external audio playback device during the playback process, thereby ensuring the consistency of sound and picture effects. It can be understood that in the actual implementation process, the category adjustment of the audio decoding method can be based on the decoding type supported by the device, and it is not specifically limited here.

[0095] The above content describes the audio-visual synchronization processing method provided by the present application. To support the implementation of the above embodiment, the present application also provides an audio-visual synchronization processing device, which is used in association with an audio-visual playback device including an external audio playback device. Figure 3 , an embodiment of the audio and video synchronization processing device provided by the present application includes:

[0096] A sending unit 301 is used to send a target sound signal playing instruction, wherein the target sound signal playing instruction is used to instruct the internal audio playing structure of the audio and video playing device and the external audio playing device to play the target sound signal simultaneously;

[0097] A first audio playing unit 302, configured to play the target sound signal through the internal audio playing structure to emit a first audio signal;

[0098] The second audio playing unit 303 is used to play the target sound signal through the external audio playing device to send out a second audio signal;

[0099] A first receiving unit 304 is used to receive the first audio signal and record the receiving time as a first time point;

[0100] The second receiving unit 305 is used to receive the second audio signal and record the receiving time as a second time point;

[0101] The adjustment unit 306 is configured to adjust the audio and video synchronization based on the difference between the first time point and the second time point.

[0102] Optionally, the audio and video playback device is a television device.

[0103] Optionally, the first receiving unit is specifically configured to: receive the first audio signal through a microphone;

[0104] The second receiving unit is specifically configured to receive the second audio signal through the microphone.

[0105] Optionally, the adjustment unit is specifically used for:

[0106] Determine whether the difference between the first time point and the second time point is greater than a preset value;

[0107] If the difference is greater than a preset value, the process of adjusting the audio and video synchronization is performed;

[0108] If the difference is less than or equal to the preset value, the audio and video synchronization adjustment process is not performed.

[0109] Optionally, the adjustment unit is specifically used for:

[0110] A signal delay of a difference duration is added to the local signal processing process of the audio and video playback device, and the difference duration is equal to the difference between the first time point and the second time point.

[0111] Optionally, the adjustment unit is specifically used for:

[0112] Adjust the audio decoding mode of the external audio playback device.

[0113] Optionally, the microphone is arranged on a control device of the audio and video playback device.

[0114] In this embodiment, the process performed by each unit in the audio and video synchronization processing device is the same as the above Figure 1 The method flow described in the corresponding embodiment is similar and will not be repeated here.

[0115] Figure 4 It is a structural diagram of an audio and video playback device provided in an embodiment of the present application. The audio and video playback device 400 may include one or more processors 401 and a memory 402. The memory 402 stores one or more application programs or data.

[0116] In this embodiment, the specific functional module division in the processor 401 can be the same as the above Figure 3 The functional module division method of each unit described in is similar and will not be repeated here.

[0117] The memory 402 may be a volatile storage or a persistent storage. The program stored in the memory 402 may include one or more modules, each of which may include a series of instruction operations on the server. Furthermore, the processor 401 may be configured to communicate with the memory 402 and execute a series of instruction operations in the memory 402 on the audio and video playback device 400.

[0118] The audio and video playback device 400 also includes an internal audio playback structure 403 and an external audio playback device 404; the internal audio playback structure 403 can be a structure such as a speaker or a loudspeaker, and the external audio playback device 404 can be an audio playback device that has a data connection with the audio and video playback device 400 and is controlled by the processor 401, such as a Bluetooth speaker or a Bluetooth headset.

[0119] The processor 401 may execute the aforementioned Figure 1 or Figure 2 The operations performed by the audio and video synchronization processing method in the illustrated embodiment will not be described in detail here.

[0120] The embodiment of the present application also provides a computer storage medium, which is used to store computer software instructions used for the above-mentioned audio and video synchronization processing method, and includes a program designed for executing the audio and video synchronization processing method.

[0121] The audio and video synchronization processing method can be as described above Figure 1 or Figure 2 The audio and video synchronization processing method described in .

[0122] The present application also provides a computer program product, which includes computer software instructions, which can be loaded by a processor to implement the above Figure 1 Figure 2 The process of any one of the audio and video synchronization processing methods.

[0123] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the equivalent transformation of the circuit, the division of the unit, is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0124] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0125] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0126] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modification, equivalent substitution or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for processing audio and video synchronization, characterized in that: The method is applied to an audio and video playback device having an external audio playback device, comprising: Sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used to instruct the internal audio playing structure of the audio and video playing device and the external audio playing device to play the target sound signal simultaneously; Play the target sound signal through the internal audio playing structure to send out a first audio signal; Play the target sound signal through the external audio playback device to emit a second audio signal; receiving the first audio signal, and recording the receiving time as a first time point; Performing audio recognition on the superposition of the first audio signal and the second audio signal, receiving the second audio signal, and recording the receiving time as a second time point; The audio and video synchronization is adjusted based on the difference between the first time point and the second time point.

2. The method for synchronously processing audio and video according to claim 1, characterized in that: The audio and video playback device is a television device.

3. The method for synchronously processing audio and video according to claim 1, characterized in that: The receiving the first audio signal comprises: receiving the first audio signal through a microphone; The receiving the second audio signal comprises: The second audio signal is received through the microphone.

4. The method for synchronously processing audio and video according to claim 1, characterized in that: The adjusting the audio and video synchronization based on the difference between the first time point and the second time point includes: Determine whether the difference between the first time point and the second time point is greater than a preset value; If the difference is greater than a preset value, the process of adjusting the audio and video synchronization is performed; If the difference is less than or equal to the preset value, the audio and video synchronization adjustment process is not performed.

5. The audio and video synchronization processing method according to claim 1, characterized in that the process of adjusting the audio and video synchronization comprises: A signal delay of a difference duration is added to the local signal processing process of the audio and video playback device, and the difference duration is equal to the difference between the first time point and the second time point.

6. The audio and video synchronization processing method according to claim 1, characterized in that the audio and video synchronization adjustment process comprises: Adjust the audio decoding mode of the external audio playback device.

7. The method for synchronously processing audio and video according to claim 3, characterized in that: The microphone is arranged on the control device of the audio and video playback device.

8. An audio and video synchronization processing device, characterized in that: The device is used in association with an audio and video playback device including an external audio playback device, including: A sending unit, used for sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used for instructing the internal audio playing structure of the audio and video playing device and the external audio playing device to play the target sound signal simultaneously; A first audio playing unit, configured to play the target sound signal through the internal audio playing structure to emit a first audio signal; A second audio playback unit, configured to play the target sound signal through the external audio playback device to emit a second audio signal; A first receiving unit, configured to receive the first audio signal and record a receiving time as a first time point; A second receiving unit, configured to perform audio recognition on the superposition of the first audio signal and the second audio signal, receive the second audio signal, and record a receiving time as a second time point; An adjustment unit is used to adjust the audio and video synchronization based on the difference between the first time point and the second time point.

9. An audio and video playback device, characterized in that: include: Processor, memory, internal audio playback structure, external audio playback device; The memory is a short-term storage memory or a persistent storage memory; The processor is configured to communicate with the memory, and control the internal audio playback structure and the external audio playback device on the audio and video playback device to execute the instruction operation in the memory and then execute the method as claimed in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The method comprises instructions, which, when executed on a computer, cause the computer to execute the method according to any one of claims 1 to 7.