Video optimization method and device of set top box, medium and equipment

By caching and adjusting the playback rate, the video jamming and user experience reduction caused by the existing technology of mid-sample and mid-sample synchronization are solved, and the synchronization of video and audio and video and user experience are improved.

CN119893225AActive Publication Date: 2025-04-25SICHUAN TIANYI COMHEART TELECOM
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202510380083.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-03-28
Publication Date
2025-04-25
Estimated Expiration
2045-03-28

AI Technical Summary

Technical Problem

The methods used for video and audio synchronization in the prior art may lead to phenomena such as stuck video programs, skipped frame playback, black screen, etc., resulting in a decrease in user experience.

Method used

By responding to the audio and video synchronization command initiated by the user, the live video after the current frame video is cached, the lagged data in the cached screen data and audio data is determined as the data to be synchronized, the playback rate is adjusted, and the cached video data is played instead of the live video until the screen and audio data are synchronized.

Benefits of technology

Without interruption or causing lag, gradual synchronization of audio and video can be achieved, ensuring the integrity of the video viewed by users and improving the user's viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119893225A_ABST
    Figure CN119893225A_ABST
Patent Text Reader

Abstract

The invention discloses a video optimization method and device for a set top box, a medium and equipment, relates to the technical field of video processing, and aims to solve the problem that in the prior art, audio and picture synchronization means for videos can cause reduction of user experience. According to the method and the device, when the watching effect becomes poor due to audio and picture asynchronization when the user watches the video, the user autonomously initiates the synchronization instruction, the live video after the instruction is initiated is cached, and then the cached data is played to replace the live video, so that the watching integrity of the user is ensured, and the user experience is improved. In the process of playing the cached video, the lagging one of the picture and the audio is enabled to accelerate the playing rate, the audio and the picture are enabled to be gradually synchronized under the conditions of no interruption and clamping stagnation, and the time point during synchronization is taken as a mark to switch back to the live video, so that the currently played picture of the live video is enabled to be synchronized with the timestamp of the audio, and the playing speed is improved. The audio and picture synchronization of the set top box video is realized, and the watching experience of the user is effectively enhanced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a method, device, medium and equipment for video optimization of a set-top box. Background Art

[0002] A set-top box, or STB for short, is a device that connects a TV to an external signal source. It can receive digital TV signals from cable, satellite antenna, broadband network, and terrestrial broadcasting, and convert them into a format suitable for playing on a TV. Through a set-top box, users can watch high-definition and 4K ultra-high-definition TV programs and enjoy more delicate images and stunning sound effects.

[0003] When watching a program video, the audio and video may be out of sync, and there may be a significant time difference between the picture and the sound, resulting in a poor user experience. The current common solution is to set a delay time for the video stream (picture) or audio stream appropriately, and wait for the timestamps of the two to match and synchronize before playing, but this method may cause the video program to lag, skip frames, black screen, etc., resulting in interruptions in the user's video viewing, incomplete video viewing, and reduced user experience. Summary of the invention

[0004] The main purpose of the present application is to provide a set-top box video optimization method, device, medium and equipment, aiming to solve the problem in the prior art that the audio and video synchronization means for video will lead to a reduced user experience.

[0005] To achieve the above objectives, the technical solutions adopted in the embodiments of the present application are as follows: In a first aspect, an embodiment of the present application provides a video optimization method for a set-top box, comprising the following steps: In response to the audio and video synchronization instruction initiated by the user, the live video after the current frame video is cached to obtain cached video data; wherein the cached video data includes cached picture data and cached audio data; Determine that one of the buffered picture data and the buffered audio data, which is delayed in playing, is the data to be synchronized; Adjust the playback rate of the data to be synchronized, and play the cached video data instead of the live video until the cached picture data and the cached audio data are synchronized, and the synchronization time point is obtained; At the synchronization point, the playback is switched back to the live video and the cached video data is cleared.

[0006] In a possible implementation manner of the first aspect, before adjusting the playback rate of the to-be-synchronized data, the method further includes: Obtain the number of delayed frames according to the cached picture data and the cached audio data; The playback rate of the data to be synchronized is determined according to the size of the delayed frame number.

[0007] In a possible implementation manner of the first aspect, after obtaining the synchronization time point, the method further includes: Determine the number of transition frames according to the size of the delayed frames; Delay the synchronization time point according to the number of transition frames to obtain the target time point; Play the cached video data at a normal playback rate between the synchronization time point and the target time point; At the synchronization point, the playback is switched back to the live video and the cached video data is cleared, including: At the target time point, the playback is switched back to the live video and the cached video data is cleared.

[0008] In a possible implementation of the first aspect, playing the cached video data at a normal playback rate between the synchronization time point and the target time point includes: Between the synchronization time point and the target time point, the cached video data is played at a normal playback rate, and the color parameters of the cached video data are adjusted to be consistent with the live video based on color correction.

[0009] In a possible implementation manner of the first aspect, adjusting the color parameters of the cached video data to be consistent with the live video based on the color correction includes: The color parameters of the cached video data are adjusted based on the color correction, so that the color parameters of the cached video data are changed step by step from a time point until they are changed to be consistent with the live video at a target time point.

[0010] In a possible implementation of the first aspect, adjusting the playback rate of the data to be synchronized, and playing the cached video data instead of the live video, until the cached picture data and the cached audio data are synchronized, and obtaining the time point of synchronization, includes: Adjust the playback rate of the data to be synchronized, and play the cached video data instead of the live video until the timestamp difference between the cached picture data and the cached audio data in the currently played cached video data is within the threshold range, confirm that the cached picture data and the cached audio data are synchronized, and obtain the time point of synchronization.

[0011] In a possible implementation manner of the first aspect, before adjusting the playback rate of the data to be synchronized and playing the cached video data instead of the live video, the method further includes: Set the filter window; Adjust the playback rate of the data to be synchronized, and play the cached video data instead of the live video, including: Adjust the playback rate of the data to be synchronized, and play the cached video data processed by the filter window instead of the live video.

[0012] In a second aspect, an embodiment of the present application provides a video optimization device for a set-top box, comprising: A cache module, the cache module is used to cache the live video after the current frame video in response to the audio and video synchronization instruction initiated by the user, and obtain cached video data; wherein the cached video data includes cached picture data and cached audio data; A determination module, the determination module is used to determine that one of the cached picture data and the cached audio data, which has a delayed playback, is the data to be synchronized; A synchronization module is used to adjust the playback rate of the data to be synchronized, and to play the cached video data instead of the live video until the cached picture data and the cached audio data are synchronized, and the time point of synchronization is obtained; The switching module is used to switch the playback back to the live video at the synchronization time point and clear the cached video data.

[0013] In a third aspect, an embodiment of the present application provides a computer-readable storage medium storing a computer program. When the computer program is loaded and executed by a processor, the video optimization method of a set-top box provided in any one of the first aspects above is implemented.

[0014] In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, wherein: The memory is used to store computer programs; The processor is used to load and execute a computer program so that the electronic device executes the video optimization method for a set-top box provided in any one of the first aspects above.

[0015] Compared with the prior art, the beneficial effects of this application are: The embodiment of the present application proposes a method, device, medium and equipment for video optimization of a set-top box, the method comprising: in response to an audio and video synchronization instruction initiated by a user, caching a live video after a current frame of video to obtain cached video data; wherein the cached video data comprises cached picture data and cached audio data; determining that one of the cached picture data and the cached audio data that is delayed in playback is the data to be synchronized; adjusting the playback rate of the data to be synchronized, and playing the cached video data instead of the live video until the cached picture data and the cached audio data are synchronized, and obtaining a synchronization time point; switching the playback back to the live video at the synchronization time point, and clearing the cached video data. When the viewing effect of a user is poor due to the lack of synchronization between audio and video when watching a video, this application allows the user to initiate a synchronization command on his own. After the command is initiated, the subsequent live video is cached, and then the cached data is played to replace the live video to ensure the integrity of the user's viewing. In the process of playing the cached video, the lagging party of the picture and audio is accelerated to play at a faster rate, and the audio and video are gradually synchronized without interruption or lag. The time point of synchronization is used as a mark to switch back to the live video, so that the currently played picture of the live video is synchronized with the timestamp of the audio, thereby realizing the synchronization of the set-top box video, audio and video, and effectively enhancing the user's viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic diagram of the structure of an electronic device of a hardware operating environment involved in an embodiment of the present application; Figure 2 A schematic diagram of a flow chart of a video optimization method for a set-top box provided in an embodiment of the present application; Figure 3 A schematic diagram of a module of a video optimization device for a set-top box provided in an embodiment of the present application; Markings in the figure: 101 - processor, 102 - communication bus, 103 - network interface, 104 - user interface, 105 - memory. DETAILED DESCRIPTION

[0017] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0018] See attached Figure 1 , attached Figure 1This is a schematic diagram of the structure of an electronic device of the hardware operating environment involved in the embodiment of the present application. The electronic device may include: a processor 101, such as a central processing unit (CPU), a communication bus 102, a user interface 104, a network interface 103, and a memory 105. Among them, the communication bus 102 is used to realize the connection and communication between these components. The user interface 104 may include a display (Display), an input unit such as a keyboard (Keyboard), and the user interface 104 may also include a standard wired interface and a wireless interface. The network interface 103 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 105 may optionally be a storage device independent of the aforementioned processor 101. The memory 105 may be a high-speed random access memory (RAM) memory, or it may be a stable non-volatile memory (NVM), such as at least one disk storage. The processor 101 may be a general-purpose processor, including a central processing unit, a network processor, etc., or it may be a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component.

[0019] Those skilled in the art will appreciate that Figure 1 The structure shown in the figure does not constitute a limitation on the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0020] As attached Figure 1 As shown, the memory 105 as a storage medium may include an operating system, a network communication module, a user interface module, and a video optimization device of a set-top box.

[0021] In the attached Figure 1 In the electronic device shown, the network interface 103 is mainly used for data communication with the network server; the user interface 104 is mainly used for data interaction with the user; the processor 101 and the memory 105 in the present application can be set in the electronic device, and the electronic device calls the video optimization device of the set-top box stored in the memory 105 through the processor 101, and executes the video optimization method of the set-top box provided in the embodiment of the present application.

[0022] See attached Figure 2 Based on the hardware device of the aforementioned embodiment, the embodiment of the present application provides a video optimization method for a set-top box, comprising the following steps: S10: In response to an audio and video synchronization instruction initiated by a user, a live video after a current frame of video is cached to obtain cached video data; wherein the cached video data includes cached picture data and cached audio data.

[0023] During the specific implementation process, when the user is watching a TV program and finds that the audio and video are not synchronized, the user can trigger the audio and video synchronization command through the button on the set-top box or remote control. A storage module can be set in the set-top box to cache the video. The video frame when the synchronization command is initiated is regarded as the current frame, and the subsequent live video begins to be cached, that is, the cached video data. The problem of audio and video being out of sync lies in the asynchrony between the video stream (picture) and the audio stream. Therefore, the cached video data is also divided into picture data and audio data for processing. Since the live video is played step by step, and the present application will immediately perform alternative playback after caching and processing the data, there will be no pressure to cache a large amount of video data, and there will be no stagnation in the synchronization of audio and video due to insufficient data processing capabilities.

[0024] S20: Determine that one of the buffered picture data and the buffered audio data that is delayed in playing is the data to be synchronized.

[0025] In the specific implementation process, the audio-video asynchrony refers to the obvious time difference between the picture and the sound when watching the video. If the video playback is decomposed into the playback of the picture and the audio, the audio-video asynchrony simply means that the playback of the two is fast and slow. The data that is played later is used as the data to be synchronized, and it is synchronized with the other data.

[0026] S30: adjusting the playback rate of the data to be synchronized, and playing the cached video data instead of the live video, until the cached picture data and the cached audio data are synchronized, and the time point of synchronization is obtained.

[0027] In the specific implementation process, the playback rate of the data with delayed playback is adjusted, which is often referred to as fast-forwarding the video or audio. After the adjustment, in order to ensure the integrity of the user's viewing and not let the user wait for a long time, the cached video data is used to play instead of the live video. During this playback time, as the data to be synchronized is played fast-forward, its time difference relative to the other data will gradually be made up to achieve audio and video synchronization, and the time point when audio and video synchronization is achieved is the time point of synchronization. In order to improve the effect of the adjustment, the playback rate can be controlled, that is: before adjusting the playback rate of the data to be synchronized, the method also includes: Obtain the number of delayed frames according to the cached picture data and the cached audio data; The playback rate of the data to be synchronized is determined according to the size of the delayed frame number.

[0028] By comparing the cached image data and the cached audio data, the number of frames between the two at the same time is obtained, which is recorded as the delayed frame number. The delayed frame number is the number of frames that need to be fast-forwarded to catch up with the normal playback data. In order to achieve a better synchronization effect, the progress of this process is controlled by the rate. The larger the delayed frame number, the faster the playback rate is controlled, so that the synchronization efficiency remains at the same level.

[0029] In one embodiment, adjusting the playback rate of the data to be synchronized, and playing the cached video data instead of the live video, until the cached picture data and the cached audio data are synchronized, and obtaining the time point of synchronization includes: Adjust the playback rate of the data to be synchronized, and play the cached video data instead of the live video until the timestamp difference between the cached picture data and the cached audio data in the currently played cached video data is within the threshold range, confirm that the cached picture data and the cached audio data are synchronized, and obtain the time point of synchronization.

[0030] In the specific implementation process, the adjustment of audio and video synchronization does not necessarily mean that the timestamps are completely consistent. Due to signal delays and the time it takes for users to react and give feedback, the deviation of audio and video synchronization will not affect the normal viewing experience within a certain range. Therefore, a threshold range can be set to periodically verify the difference in the timestamps of the picture data and the audio data of the currently playing video during playback. If the timestamp difference of a certain frame is within the threshold range, the audio and video synchronization is considered to be complete.

[0031] Since the cached video data is affected to a certain extent by the built-in modules of the set-top box, such as the storage module, the acquisition module, the signal transmitter, etc., the cached video may contain noise. In order to improve the video quality, the embodiment of the present application adopts filtering processing, and plays the cached video after filtering processing, that is, adjusting the playback rate of the data to be synchronized, and playing the cached video data instead of the live video. The method also includes: Set the filter window; Adjust the playback rate of the data to be synchronized, and play the cached video data instead of the live video, including: Adjust the playback rate of the data to be synchronized, and play the cached video data processed by the filter window instead of the live video.

[0032] In the specific implementation process, filtering can be achieved through a filter. In this application, since the cached video is to be played and the data will change, a filter window can be set to allow the video data to be processed through the filter window first. The filtering operation only processes the data entering the window within the window range, which also reduces the processing pressure. Since it is not clear when the synchronization is completed, this processing method can also save resources and there is no need to waste resources to process the video after the synchronization is completed.

[0033] S40: Switch the playback back to the live video at the synchronization time point, and clear the cached video data.

[0034] In the specific implementation process, after the audio and video synchronization is achieved by using the cached video, the playback is switched back to the normal live video at the synchronization time point, and the timestamp of the cached video data at the synchronization time point is synchronized to the live video, so that the live video that is normally played plays the subsequent video with the synchronized timestamp, realizing the switching of audio and video synchronization without interrupting the video playback. After the switch, the cached video is cleared, no memory resources are occupied, and the original working effect of the set-top box is maintained.

[0035] In one embodiment, after obtaining the synchronization time point, the method further includes: Determine the number of transition frames according to the size of the delayed frames; Delay the synchronization time point according to the number of transition frames to obtain the target time point; Play the cached video data at a normal playback rate between the synchronization time point and the target time point; At the synchronization point, the playback is switched back to the live video and the cached video data is cleared, including: At the target time point, the playback is switched back to the live video and the cached video data is cleared.

[0036] During the specific implementation process, in order to ensure a smooth transition between switching between cached video and live video, a period of playback is retained for transition after synchronization is achieved, that is, the time between the synchronization time point and the target time point. Since synchronization has been achieved at the previous time point, the cached video is played at a normal playback rate during this period of time, and after playing to the target time point, it is switched back to the live video for playback.

[0037] In order to further improve the switching effect, a color correction method is provided to process the video data. Specifically, the cached video data is played at a normal playback rate between the synchronization time point and the target time point, including: Between the synchronization time point and the target time point, the cached video data is played at a normal playback rate, and the color parameters of the cached video data are adjusted to be consistent with the live video based on color correction.

[0038] In the specific implementation process, the process of caching the video may lead to a decrease in video quality, which is usually reflected as a color change. Direct switching will cause the color of the picture to change suddenly in perception. In order to avoid the reduction in viewing experience caused by this sudden change, it is processed through color correction. Color correction refers to adjusting the hue, brightness, contrast and other color-related video parameters so that these parameters of the processed object are consistent with the expected parameters. In the embodiment of the present application, the color correction processing of the unique cached video data is used to keep its various parameters consistent with the live video. In order to further avoid the sudden color change in perception and make this correction smoother, the color correction adjustment is carried out gradually. During the transition period, the adjustment starts from the time point of synchronization, and the size of each parameter is gradually adjusted. At the target time point, it is adjusted to be consistent with the live video, that is: based on color correction, the color parameters of the cached video data are adjusted to be consistent with the live video, including: The color parameters of the cached video data are adjusted based on the color correction, so that the color parameters of the cached video data are changed step by step from a time point until they are changed to be consistent with the live video at a target time point.

[0039] In this way, not only the connection of audio and video synchronization is achieved, but also the connection of sensory colors is achieved, further enhancing the user experience.

[0040] In this embodiment, when the viewing effect of a user is poor due to the lack of synchronization between audio and video when watching a video, the user is allowed to initiate a synchronization command on his own initiative. After the command is initiated, the subsequent live video is cached, and then the cached data is played to replace the live video, so as to ensure the integrity of the user's viewing. In the process of playing the cached video, the lagging one of the picture and audio is accelerated to play at a faster rate, and the audio and video are gradually synchronized without interruption or lag. The time point of synchronization is used as a mark to switch back to the live video, so that the picture currently played in the live video is synchronized with the timestamp of the audio, so as to achieve synchronization of the video, audio and picture of the set-top box and effectively enhance the user's viewing experience.

[0041] See attached Figure 3 Based on the same inventive concept as in the above-mentioned embodiment, the embodiment of the present application further provides a video optimization device for a set-top box, comprising: A cache module, the cache module is used to cache the live video after the current frame video in response to the audio and video synchronization instruction initiated by the user, and obtain cached video data; wherein the cached video data includes cached picture data and cached audio data; A determination module, the determination module is used to determine that one of the cached picture data and the cached audio data, which has a delayed playback, is the data to be synchronized; A synchronization module is used to adjust the playback rate of the data to be synchronized, and to play the cached video data instead of the live video until the cached picture data and the cached audio data are synchronized, and the time point of synchronization is obtained; The switching module is used to switch the playback back to the live video at the synchronization time point and clear the cached video data.

[0042] Those skilled in the art should understand that the division of the various modules in the embodiment is merely a division of logical functions, and in actual application, all or part of them can be integrated into one or more actual carriers, and these modules can be implemented entirely in the form of software called through a processing unit, or entirely in the form of hardware, or in the form of a combination of software and hardware. It should be noted that each module in the video optimization device of the set-top box in this embodiment corresponds one-to-one to each step in the video optimization method of the set-top box in the aforementioned embodiment. Therefore, the specific implementation of this embodiment can refer to the implementation of the video optimization method of the set-top box in the aforementioned embodiment, which will not be repeated here.

[0043] Based on the same inventive concept as in the aforementioned embodiment, an embodiment of the present application further provides a computer-readable storage medium storing a computer program, which, when loaded and executed by a processor, implements a video optimization method for a set-top box as provided in an embodiment of the present application.

[0044] Based on the same inventive concept as in the above-mentioned embodiment, an embodiment of the present application further provides an electronic device, including a processor and a memory, wherein: The memory is used to store computer programs; The processor is used to load and execute a computer program so that the electronic device executes the video optimization method of the set-top box provided in the embodiment of the present application.

[0045] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or various devices including one or any combination of the above memories. The computer may be various computing devices including intelligent terminals and servers.

[0046] In some embodiments, executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.

[0047] As an example, executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file storing other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).

[0048] By way of example, executable instructions may be deployed to be executed on one computing device, or on multiple computing devices located at one site, or on multiple computing devices distributed across multiple sites and interconnected by a communication network.

[0049] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0050] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0051] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory / random access memory, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a multimedia terminal device (which can be a mobile phone, a computer, a television receiver, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0052] In summary, the present application provides a method, device, medium and equipment for video optimization of a set-top box, the method comprising: in response to an audio and video synchronization instruction initiated by a user, caching the live video after the current frame video to obtain cached video data; wherein the cached video data includes cached picture data and cached audio data; determining that one of the cached picture data and the cached audio data that is delayed in playback is the data to be synchronized; adjusting the playback rate of the data to be synchronized, and playing the cached video data instead of the live video until the cached picture data and the cached audio data are synchronized, and obtaining a time point when synchronization occurs; switching the playback back to the live video at the time point when synchronization occurs, and clearing the cached video data. When the viewing effect of a user is poor due to the lack of synchronization between audio and video when watching a video, this application allows the user to initiate a synchronization command on his own. After the command is initiated, the subsequent live video is cached, and then the cached data is played to replace the live video to ensure the integrity of the user's viewing. In the process of playing the cached video, the lagging party of the picture and audio is accelerated to play at a faster rate, and the audio and video are gradually synchronized without interruption or lag. The time point of synchronization is used as a mark to switch back to the live video, so that the currently played picture of the live video is synchronized with the timestamp of the audio, thereby realizing the synchronization of the set-top box video, audio and video, and effectively enhancing the user's viewing experience.

[0053] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A video optimization method for a set-top box, characterized in that: The following steps are involved: In response to an audio and video synchronization instruction initiated by a user, a live video after a current frame of video is cached to obtain cached video data; wherein the cached video data includes cached picture data and cached audio data; Determine that one of the buffered picture data and the buffered audio data, which is delayed in playing, is the data to be synchronized; Adjusting the playback rate of the data to be synchronized, and playing the cached video data instead of the live video, until the cached picture data and the cached audio data are synchronized, and obtaining a synchronization time point; At the time point of synchronization, the playback is switched back to the live video, and the cached video data is cleared.

2. The video optimization method of a set-top box according to claim 1, characterized in that: Before adjusting the playback rate of the data to be synchronized, the method further includes: Obtaining a delayed frame number according to the cached picture data and the cached audio data; The size of the playback rate of the data to be synchronized is determined according to the size of the delayed frame number.

3. The video optimization method of a set-top box according to claim 2, characterized in that: After the time point when synchronization is obtained, the method further includes: Determining the number of transition frames according to the size of the delayed frame number; Delaying the time point during synchronization according to the number of transition frames to obtain a target time point; Play the cached video data at a normal playback rate between the time point during synchronization and the target time point; The step of switching the playback back to the live video at the time point during synchronization and clearing the cached video data includes: At the target time point, the playback is switched back to the live video, and the cached video data is cleared.

4. The video optimization method of a set-top box according to claim 3, characterized in that: Playing the cached video data at a normal playback rate between the time point during synchronization and the target time point includes: Between the time point during synchronization and the target time point, the cached video data is played at a normal playback rate, and the color parameters of the cached video data are adjusted to be consistent with the live video based on color correction.

5. The video optimization method of a set-top box according to claim 4, characterized in that: The adjusting the color parameters of the cached video data to be consistent with the live video based on color correction includes: The color parameters of the cached video data are adjusted based on color correction, so that the color parameters of the cached video data change step by step from the time point until they change to be consistent with the live video at the target time point.

6. The video optimization method of a set-top box according to claim 1, characterized in that: The adjusting the playback rate of the data to be synchronized and playing the cached video data instead of the live video until the cached picture data and the cached audio data are synchronized and the synchronization time point is obtained includes: Adjust the playback rate of the data to be synchronized, and play the cached video data instead of the live video until the timestamp difference between the cached picture data and the cached audio data in the currently played cached video data is within a threshold range, confirm that the cached picture data and the cached audio data are synchronized, and obtain the time point of synchronization.

7. The video optimization method of a set-top box according to claim 1, characterized in that: Before adjusting the playback rate of the data to be synchronized and playing the cached video data instead of the live video, the method further includes: Set the filter window; The adjusting the playback rate of the data to be synchronized and playing the cached video data instead of the live video includes: The playback rate of the data to be synchronized is adjusted, and the cached video data processed by the filter window is played instead of the live video.

8. A video optimization device for a set-top box, characterized in that: include: A cache module, the cache module is used to cache the live video after the current frame video in response to the audio and video synchronization instruction initiated by the user, and obtain cached video data; wherein the cached video data includes cached picture data and cached audio data; A determination module, the determination module is used to determine that one of the buffered picture data and the buffered audio data, which has a delayed playback, is the data to be synchronized; A synchronization module, the synchronization module is used to adjust the playback rate of the data to be synchronized, and play the cached video data instead of the live video until the cached picture data and the cached audio data are synchronized, and a synchronization time point is obtained; A switching module, the switching module is used to switch the playback back to the live video at the time point during synchronization and clear the cached video data.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is loaded and executed by the processor, the video optimization method for the set-top box according to any one of claims 1 to 7 is implemented.

10. An electronic device, characterized in that: comprising a processor and a memory, wherein: The memory is used to store computer programs; The processor is used to load and execute the computer program so that the electronic device executes the video optimization method for a set-top box according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Live broadcast method, device and system, equipment and computer readable storage medium

    CN111294634A

  • Live broadcast method, live broadcast device and computer program product

    CN112788360A

  • Display device and sound and picture synchronization method

    CN114827679A

  • Live video switching method, set top box, equipment and storage medium

    CN116233527A

  • System and method of audio / video streaming

    EP1879347A1