A monitoring analysis method and analysis system for a set-top box application

Abstract

The present application relates to the technical field of television system, and more particularly to a monitoring analysis method and analysis system for set-top box application, comprising a signal acquisition module, a real-time video feature extraction module, a standby signal source storage module and a seamless switching module. According to the mapping relationship between the video features and the viewing quality indicators, on the one hand, when the viewing experience is not optimal, the signal source can be switched, and through the buffer technology and the seamless switching algorithm, the standby signal source with weighted ranking can be switched to, so as to realize stable switching, reduce the interruption caused by signal switching, and at the same time, the signal source in the cloud can be called out to save switching time and improve the experience. On the other hand, the signal quality indicators are verified through the video features, so as to realize the quality indicators reflected by the double indicators, not only to ensure the accuracy of the quality indicator identification, but also to timely give an early warning when the signal acquisition module determines that the signal quality indicator is inaccurate, so as to improve the sustainable use effect of the monitoring set-top box.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of television systems, specifically, a monitoring analysis method and system for set-top box applications. BACKGROUND

[0002] With the popularity of smart TVs and network video services, set-top boxes as an important device connecting users and digital content, in modern home entertainment, set-top boxes as an important terminal device, bear the function of receiving and playing TV programs. However, signal quality monitoring and user experience optimization of set-top box has always been a technical difficulty, the traditional signal quality monitoring method usually only focuses on a single indicator, such as signal strength or bit error rate, while ignoring other key factors such as frame loss rate and network delay, resulting in insufficient comprehensive signal quality evaluation;

[0003] In actual use, due to signal interference, weather conditions or other factors, the set-top box may receive unstable signals, resulting in picture freezing, audio and video out of sync and other problems, although the existing technology can solve some problems by manually switching channels or restarting the device, but this method is inefficient and the user experience is poor;

[0004] In addition, the existing system often lacks effective correlation and optimization mechanism when processing multi-source signals, resulting in unstable user experience, its running state and user experience quality become particularly important, in view of this, we propose a monitoring analysis method and system for set-top box applications. SUMMARY

[0005] The purpose of the present application is to provide a monitoring analysis method and system for set-top box applications to solve the problems of insufficient comprehensiveness of signal quality evaluation, weak correlation between signal source and user experience, unintelligent management of backup signal source, and low efficiency of real-time monitoring and early warning.

[0006] To solve the above technical problems, one of the purposes of the present application is to provide a monitoring analysis method for set-top box applications, comprising the following steps:

[0007] S1, deploying a signal acquisition module in the set-top box to collect quality data of the signal source, and defining the mapping relationship between the quality data and the signal quality index, and calculating the signal quality index of the current signal source through normalization processing and weighting;

[0008] S2, triggering a video feature extraction technology to identify the current playing TV program content, and outputting the video features in video feature extraction, and feeding back to S1 according to the mapping relationship between the video features and the viewing quality index, comparing the signal quality index and the viewing quality index, if they do not match, a device fault warning signal is issued, if they match, the quality index is output, including poor viewing experience, good viewing experience and excellent viewing experience;

[0009] S3, search for video feature matching signal source, use the technology in S1 to detect the quality of the signal source, and perform weighted sorting and association to the cloud, defined as backup signal source.

[0010] S4, when the quality index signal except watching experience is perceived, switch to the backup signal source with the highest weighted ranking through buffer technology and seamless switching algorithm, and transmit to S1 and S2 output quality index again, if the quality index signal except watching experience is output again, the next backup signal source with weighted ranking is called out until watching experience is output.

[0011] Preferably, the quality data in S1 includes signal strength, bit error rate, frame loss rate and network delay;

[0012] The signal strength is obtained through the API of the modem or network interface card, which represents the strength of the received radio signal;

[0013] The bit error rate is obtained through the statistical information of the network device, which represents the ratio of the number of error bits to the total number of transmission bits in the data transmission process; the frame loss rate is from the feedback of the video decoder, which represents the ratio of the number of lost frames to the total number of transmission frames in the video transmission process; the network delay is obtained by ping command, which represents the transmission time of data from source to target.

[0014] Preferably, the video feature extraction technology in S2 includes the following steps:

[0015] Audio stream extraction: real-time capture of playing audio stream, extraction of audio amplitude, zero crossing rate and other features, reflection of audio dynamic change, Fourier transform, analysis of frequency spectrum, peak frequency and bandwidth characteristics, reflection of audio frequency distribution, use of MFCC to extract speech features, generation of unique identification of audio, used for subsequent matching of same program content;

[0016] Video stream extraction: real-time capture of playing video stream, use of OpenCV library to extract key frames of video, use of pre-trained deep learning model for image recognition of key frames, identification of video content, generation of unique identification of video content, combination of audio fingerprint, more accurate identification of program content.

[0017] Preferably, the mapping relationship between video features and watching quality index in S2 includes the following steps:

[0018] By analyzing the change of the zero-crossing rate of the audio stream, and comparing the synchronization of the audio and video, the stall result is output. If the audio stream breakpoint is detected, and the audio and video are not synchronized, the watching experience is poor. If the audio stream has no breakpoint, and the audio and video are not synchronized, or the audio stream has a breakpoint, and the audio and video are synchronized, the watching experience is good. If the audio stream has no breakpoint, and the audio and video are synchronized, the watching experience is excellent.

[0019] Preferably, the S3 searches for a signal source matching the video features, including the following steps:

[0020] According to the type of signal source supported by the set-top box, the corresponding scanning is implemented to obtain the signal source list;

[0021] And a feature matching algorithm is used to verify the matching degree of the video features of the signal source playing program and the video features in S2. If they match, the backup signal source is output. If they do not match, the signal source continues to be searched;

[0022] Quality detection is performed on multiple backup signal sources to measure the strength of the radio frequency signal (such as dBm), calculate the error rate in data transmission, detect the frame loss in the video stream, measure the delay time of signal transmission, and again normalize and weight the signal quality index of the current signal source.

[0023] Preferably, the S3 weighting sorting includes the following steps:

[0024] The quality index of multiple backup signal sources is standardized to the same range, the comprehensive signal quality index is calculated according to the pre-defined weight distribution, and the signal quality index of each backup signal source is detected. According to the signal quality index from high to low, the signal source is sorted, and the backup signal source with the highest priority is placed at the front;

[0025] The sorted backup signal source list is converted into a format for storage, the cloud storage service is used to store the signal source list, and the signal source list stored in the cloud is regularly updated.

[0026] Preferably, the S4 switches to the backup signal source with the highest priority in the weighted sorting through the buffer technology and seamless switching algorithm, including the following steps:

[0027] The size of the buffer is dynamically adjusted according to the network bandwidth and signal quality, a certain amount of video data is pre-loaded in the buffer, and the size of the buffer is reduced if the signal quality index in S1 is appropriate;

[0028] If the signal quality index in the receiving S1 is not suitable, the size of the buffer is immediately increased, when the quality index signal except for the watching experience is perceived, the output switching signal source executes the command, the switching logic suspends the playing of the current signal source, and the pre-loaded content is continued to be played from the buffer, and the video data of the standby signal source is loaded to the new buffer in the background;

[0029] The video stream characteristics of the current signal source and the standby signal source are extracted, including frame rate, video resolution, audio synchronization, the consistency of the standby signal source and the current playing content is verified through a feature matching algorithm, and a natural switching point is found in the video stream.

[0030] Preferably, the S4 further comprises a re-output limiting algorithm, the re-output limiting algorithm is used for dynamically presetting a number threshold of switching standby signal sources, and an output device warning signal is output when the switching number is equal to the number threshold.

[0031] The second purpose of the application is to provide a monitoring analysis system for a set top box application, comprising the monitoring analysis method for the set top box application in any one of the above, comprising a signal collection module, a real-time video feature extraction module, a standby signal source storage module and a seamless switching module.

[0032] The signal collection module is used for collecting quality data of the signal source, and defining a mapping relationship between the quality data and the signal quality index, and calculating the signal quality index of the current signal source through normalization processing and weighting;

[0033] The real-time video feature extraction module is used for triggering a video feature extraction technology to identify the current playing television program content, and outputting the video features in the video feature extraction, and feeding back the video features to the signal collection module according to the mapping relationship between the video features and the watching quality index, comparing the signal quality index and the watching quality index, if they are not matched, a device fault warning signal is sent out, and if they are matched, the quality index is output.

[0034] The standby signal source storage module is used for searching the signal source matched with the video features, detecting the quality of the signal source through the signal collection module, and performing weighted sorting and association to the cloud, and defining as a standby signal source, and storing the standby signal source matched with the video features through the cloud.

[0035] The seamless switching module is used for switching to the standby signal source with the first weighted sorting through the buffer technology and the seamless switching algorithm when the quality index signal except for the watching experience is perceived, and outputting the quality index to the signal collection module and the real-time video feature extraction module again, if the quality index signal except for the watching experience is output again, the standby signal source with the next weighted sorting is called out, and the watching experience is output until the watching experience is output.

[0036] Compared with the prior art, the present application has the following beneficial effects:

[0037] By recognizing the content of the currently played television program through a video feature extraction technology and outputting the video features in the video feature extraction, according to the mapping relationship between the video features and the viewing quality indicators, on the one hand, it is convenient for subsequent matching of the same program signal source, and it is beneficial to switching to a standby signal source stored in the cloud when the viewing experience is not good, saving time and avoiding the occupation time of searching for a signal source after perceiving the poor experience, and at the same time, the signal sources are weighted and sorted, which is convenient for subsequent calling of the standby signal source according to the cycle, and the quality of the standby signal source is preferentially retrieved, reducing the running intensity caused by frequent replacement, and through the buffer technology and seamless switching algorithm, the standby signal source is switched to the weighted and sorted standby signal source, realizing stable switching of the standby signal source and reducing the interruption caused by signal switching, on the other hand, the signal quality indicators are verified through the video features, realizing the quality indicators reflected by the double indicators, not only ensuring the accuracy of the quality indicator identification, but also timely warning when the signal acquisition module determines that the signal quality indicator is inaccurate, improving the sustainable use effect of the monitoring set top box. BRIEF DESCRIPTION OF DRAWINGS

[0038] Fig. 1 is the overall flowchart of embodiment 1;

[0039] Fig. 2 is the re-output restriction algorithm flowchart of embodiment 1. DETAILED DESCRIPTION

[0040] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0041] Embodiment 1

[0042] As Figs. 1-2 shown, one of the purposes of the present application is to provide a monitoring analysis method for a set top box application, comprising the following steps:

[0043] S1, deploying a signal acquisition module in the set top box to acquire quality data of the signal source, and defining a mapping relationship between the quality data and the signal quality indicators, and calculating the signal quality indicators of the current signal source through normalization processing and weighting, because the quality of the acquired signal source is multi-sourced, including signal strength, bit error rate, frame loss rate and network delay, etc. quality indicators, therefore, the above data is integrated to obtain a more accurate final signal quality indicator;

[0044] Specifically, the quality data in S1 includes signal strength, bit error rate, frame loss rate and network delay;

[0045] Signal strength is obtained through the API of the modem or network interface card, representing the strength of the received radio signal;

[0046] Bit error rate is obtained through the statistical information of the network device, representing the ratio of the number of bits with errors to the total number of transmitted bits during data transmission; frame loss rate comes from the feedback of the video decoder, representing the ratio of the number of lost frames to the total number of transmitted frames during video transmission; network delay is obtained through the ping command or similar network delay measurement tools, representing the transmission time of data from source to target, with the unit of milliseconds;

[0047] Convert each signal quality indicator to the range of 0 to 1 for unified weighted calculation, assuming that the range of signal strength is -100 dBm to -50 dBm (typical value), through the normalization formula: , so that the signal strength value is 0 at -100 dBm and 1 at -50 dBm; assuming that the range of bit error rate is 0 to 1%, through the normalization formula: , so that the bit error rate is 1 when it is 0 and 0 when it is 1%; assuming that the range of frame loss rate is 0 to 5%, the normalization formula is: , so that the frame loss rate is 1 when it is 0 and 0 when it is 5%; assuming that the range of network delay is 0 to 200 milliseconds, the normalization formula is: , so that the network delay is 1 when it is 0 and 0 when it is 200 milliseconds, according to the influence degree of each signal quality indicator on the overall signal quality, the weight is assigned, assuming that the weight is as follows: signal strength is 0.3, bit error rate is 0.4, frame loss rate is 0.2, network delay is 0.1, multiply the normalized indicator value by the corresponding weight, then sum up to get the comprehensive signal quality indicator (SQI), finally, the range of SQI is 0 to 1, the value closer to 1 indicates better signal quality, normalization processing and weighted calculation ensure fair comparison of different indicators, weight allocation reflects the influence degree of each indicator on the overall signal quality, which helps to improve the stability and user experience of set-top box application.

[0048] S2, triggering a video feature extraction technology to identify the content of the currently played TV program, and outputting the video features in the video feature extraction, feeding back to S1 according to the mapping relationship between the video features and the viewing quality indicators, comparing the signal quality indicators and the viewing quality indicators, if they do not match, issuing a device failure warning signal, if they match, outputting the quality indicators, including poor viewing experience, good viewing experience and excellent viewing experience, through the video features, on the one hand, it is convenient for subsequent matching of the same program signal source, which is conducive to switching the signal source when the viewing experience is not optimal, and conducive to the user's viewing experience, on the other hand, the video features verify the signal quality indicators, realize double indicators to reflect the quality indicators, not only ensure the accuracy of the quality indicators identification, but also timely warning when the signal acquisition module determines that the signal quality indicators are inaccurate, improve the sustainable use effect of the monitoring set-top box;

[0049] In order to monitor the effect of TV programs in actual use in real time, the video feature extraction technology in S2 includes the following steps:

[0050] Audio stream extraction: real-time capture of the audio stream being played, extraction of the amplitude, zero-crossing rate and other features of the audio, reflection of the dynamic changes of the audio, Fourier transform, analysis of the frequency spectrum, peak frequency and bandwidth characteristics, reflection of the frequency distribution of the audio, extraction of speech features using MFCC (Mel Frequency Cepstrum Coefficient), suitable for identifying speech content, generation of a unique identifier for the audio, used for subsequent matching of the same program content;

[0051] Video stream extraction: real-time capture of the video stream being played, use of OpenCV library to extract key frames of the video, reduce data volume, facilitate subsequent processing, use of pre-trained deep learning model (such as ResNet, Yolo) for image recognition of key frames, identify video content, generate a unique identifier for the video content, combined with the audio fingerprint, more accurately identify the program content.

[0052] Further, the mapping relationship between the video features and the viewing quality indicators in S2 includes the following steps:

[0053] By analyzing the change of the zero-crossing rate of the audio stream and comparing the synchronization of the audio and video, the stall result is output, if the audio stream breakpoint is detected, and the audio and video are not synchronized, the viewing experience is poor, if the audio stream has no breakpoint, and the audio and video are not synchronized, or the audio stream has a breakpoint, and the audio and video are synchronized, the viewing experience is good, if the audio stream has no breakpoint, and the audio and video are synchronized, the viewing experience is excellent, realize audio stream and video stream to verify the viewing experience at the same time, improve the accuracy of the actual situation of verifying the viewing experience.

[0054] S3, search for video feature matching signal sources, use the technology in S1 to detect the quality of the signal source and perform weighted ranking association to the cloud, defined as backup signal source, through the cloud storage video feature matching (same program) backup signal source, convenient for subsequent call out at any time, save time, avoid the occupation time of searching for signal sources after perceiving the experience difference, at the same time, weighted ranking signal source, convenient for subsequent according to the cycle to call out the backup signal source, preferentially quality good to retrieve, reduce the running intensity caused by frequent replacement;

[0055] Among them, S3 searches for video feature matching signal sources, including the following steps:

[0056] According to the signal source type supported by the set top box, implement corresponding scanning, obtain the signal source list, the signal source type includes cable television signal, satellite television signal, IPTV (Internet television) and local media file (such as video in USB storage device), IPTV signal source scanning uses IGMP (Internet Group Management Protocol) or UPnP (Universal Plug and Play) protocol, scans the IPTV signal source in the local area network, through cooperation with the IPTV service provider, obtains the available signal source list, the cable and satellite signal source scanning uses the tuner of the set top box, automatically scans the available cable or satellite channels, detects the signal strength and quality, obtains the electronic program guide (EPG), identifies the available television program content, local media signal source scanning, through scanning the connected storage device (such as USB, hard disk), identifies the available video file, integrates third-party media library service, obtains the local or network stored video content;

[0057] And use the feature matching algorithm to verify the matching degree of the video features of the signal source playing program and the video features in S2, if matched, output the backup signal source, if not matched, continue to search for signal sources, ensure that the content played by the backup signal source is consistent with the current program, avoid the problem of inconsistent content after switching signal sources, and improve the user experience;

[0058] Quality detection is performed on multiple backup signal sources, the strength of the radio frequency signal (such as dBm) is measured, the error rate in data transmission is calculated, the frame loss in the video stream is detected, the delay time of signal transmission is measured, the signal quality index of the current signal source is calculated again through normalization processing and weighted calculation, each quality index is standardized to the same range (such as 0-1), so as to facilitate subsequent calculation, for example, signal strength = (current value - minimum value) / (maximum value - minimum value), error rate = 1 - (current value / maximum value), and the same as in S1, which is not described here.

[0059] Then, S3 weighted ranking, including the following steps:

[0060] The quality indicators of multiple backup signal sources are standardized to the same range, the comprehensive signal quality indicators are calculated according to the pre-defined weight distribution, and the signal quality indicators of each backup signal source are detected, the signal sources are ranked from high to low according to the signal quality indicators, and the highest priority backup signal source is ranked first, so that the signal source with higher quality is preferentially selected to ensure the best viewing effect and reduce lag and interruption;

[0061] The ranked backup signal source list is converted into a format (such as JSON or CSV) for storage, the signal source list is stored using a cloud storage service (such as AWS S3, Google Cloud Storage), the safety and privacy of the data are ensured (such as encrypted transmission and storage), and the signal source list stored in the cloud is updated regularly (such as once an hour), so that the cloud data can be updated in time when the signal source quality changes, the backup signal source list is stored in the cloud for subsequent quick calling, search time is saved, switching efficiency is improved, especially when the current signal source quality decreases, the backup signal source can be quickly switched to reduce the sense of interruption, and at the same time, the cloud list is updated regularly to ensure that the quality information of the signal source is up-to-date and reflects the changes in the signal source in time to avoid watching problems caused by fluctuations in the quality of the signal source;

[0062] In summary, the third-party media library service is integrated to expand the recognition and acquisition capabilities of local media, enrich the available signal sources, and improve the multifunctionality of the set-top box. When the quality of the signal source decreases, becomes unavailable, or fluctuates, the backup signal source can be switched to in time to ensure stable viewing, which is suitable for various use scenarios and improves the reliability and user experience of the set-top box.

[0063] S4, when a quality indicator signal other than the best viewing experience is perceived, switches to the backup signal source with the highest weighted ranking through the buffer technology and seamless switching algorithm, and transmits the quality indicator to S1 and S2 again. If a quality indicator signal other than the best viewing experience is output again, the next backup signal source with the weighted ranking is called out until the best viewing experience is output. Not only does this realize stable switching of the backup signal source and reduce the sense of interruption caused by signal switching, but also, when the signal quality indicators are weighted and ranked, the actual experience during viewing is not represented, so the quality indicators are determined again through the double indicators of video features and quality data, which is beneficial to better program experience output by the set-top box. At the same time, it is not necessary to run the search again, but only to call out the cloud, which saves switching time and improves the experience;

[0064] In the application of the set-top box, in order to realize seamless switching of the signal source, when the signal quality decreases, the set-top box can quickly and smoothly switch to the backup signal source to ensure the viewing experience of the user, so that S4 switches to the backup signal source with the highest weighted ranking through the buffer technology and seamless switching algorithm, including the following steps:

[0065] According to the network bandwidth and signal quality, the size of the buffer is dynamically adjusted, a certain amount of video data (such as 10 to 30 seconds) is pre-loaded in the buffer, if the signal quality index in the receiving S1 is appropriate, the size of the buffer is reduced to save storage resources;

[0066] If the signal quality index in the receiving S1 is not appropriate, the size of the buffer is immediately increased to cope with possible delays. When the quality index signal is perceived in addition to the optimal viewing experience, the output switching signal source execution command is output, and the switching logic will pause the current signal source playback and continue playing the pre-loaded content from the buffer, and start loading video data of the backup signal source to a new buffer in the background;

[0067] Extract the video stream characteristics of the current signal source and the backup signal source, including frame rate, video resolution, and audio synchronization, verify the consistency of the backup signal source and the current playing content through the feature matching algorithm, find the natural switching point in the video stream, such as scene switching, still frame or blackout, and the switching point is used as the opportunity for seamless switching to avoid switching in dynamic pictures, which may cause picture freezing or tearing. By analyzing the inter-frame difference of the video stream, the switching point is found when the frame difference exceeds the preset threshold. Through buffer technology and seamless switching algorithm, the continuity and smoothness of video playback are ensured, and the buffer size and switching strategy are dynamically adjusted to adapt to different network bandwidth and signal quality. When signal quality problems are detected, the backup signal source is quickly switched to reduce user waiting time. At the same time, by preloading and dynamically managing the buffer, the occupation of network resources is reduced.

[0068] In addition, as shown in Fig. 2 S4 also includes a second output limiting algorithm, which is used to dynamically preset a threshold number of times for switching to a backup signal source. When the number of switching times is equal to the threshold number of times, an equipment warning signal is output. If the program viewing experience cannot reach optimal after multiple switching to the backup signal source, it means that there may be a problem with the television equipment itself, which is unrelated to the signal received by the set-top box. Therefore, an equipment warning signal is issued to facilitate timely repair of the television equipment. At the same time, the threshold number of times is dynamically adjusted, which can adjust the threshold number of times according to the service life of the television equipment. As the service life is shorter, that is, the longer the use time (the greater the probability of damage to the television equipment), the smaller the threshold number of times, to avoid multiple adjustments that may still cause the set-top box to run large. Conversely, as the service life is longer, the threshold number of times is larger, to avoid the actual playback status being affected by external factors (such as distance, weather, etc.) when the backup signal source is used on this television;

[0069] Conversely, if the number of switching times is less than the threshold number of times, the switching command is continued to be executed until the optimal viewing experience is output.

[0070] The second object of the present application is to provide a monitoring analysis system for set-top box applications, comprising the monitoring analysis method for set-top box applications of any one of the above, comprising a signal acquisition module, a real-time video feature extraction module, a backup signal source storage module and a seamless switching module;

[0071] The signal acquisition module is used to acquire quality data of the signal source, and define the mapping relationship between the quality data and the signal quality index, and calculate the signal quality index of the current signal source through normalization processing and weighting;

[0072] The real-time video feature extraction module is used to trigger the video feature extraction technology to identify the current playing television program content, and output the video features in the video feature extraction, and feedback to the signal acquisition module according to the mapping relationship between the video features and the viewing quality index, and compare the signal quality index and the viewing quality index, if they do not match, a device fault warning signal is sent out, if they match, the quality index is outputted;

[0073] The backup signal source storage module is used to search the signal source matched with the video features, detect the quality of the signal source through the signal acquisition module, and perform weighted sorting and association to the cloud, and define as a backup signal source, and store the backup signal source matched with the video features through the cloud.

[0074] The seamless switching module is used to perceive the quality index signal other than the optimal viewing experience, switch to the backup signal source with the highest weighted sorting through the buffer technology and seamless switching algorithm, and output the quality index to the signal acquisition module and the real-time video feature extraction module again, if the quality index signal other than the optimal viewing experience is outputted again, the next backup signal source with weighted sorting is called out, until the optimal viewing experience is outputted.

[0075] The basic principles, main features and advantages of the present application are shown and described above. It should be understood by those skilled in the art that the present application is not limited by the above embodiments, the above embodiments and descriptions in the specification are only preferred examples of the present application, and are not intended to limit the present application, various changes and improvements can be made to the present application without departing from the spirit and scope of the present application, and these changes and improvements all fall within the scope of the claimed present application. The scope of protection of the present application is defined by the appended claims and their equivalents.

Claims

1. A monitoring and analysis method for set-top box applications, characterized in that, Includes the following steps: S1. Deploy a signal acquisition module in the set-top box to collect the quality data of the signal source, define the mapping relationship between the quality data and the signal quality index, and calculate the signal quality index of the current signal source through normalization processing and weighted calculation. S2 triggers video feature extraction technology to identify the content of the currently playing TV program and outputs the video features extracted from the video feature extraction. Based on the mapping relationship between the video features and the viewing quality indicators, it feeds back to S1 to compare the signal quality indicators and the viewing quality indicators. If they do not match, a device fault warning signal is issued. If they match, the quality indicators are output, including poor viewing experience, good viewing experience, and excellent viewing experience. Image recognition is performed on keyframes to identify video content and generate a unique identifier for the video content. Combined with audio features, the program content is identified more accurately. S3. Search for signal sources that match video features and use a feature matching algorithm to verify the matching degree between the video features of the program played by the signal source and the video features in S2. If they match, output a backup signal source. If they do not match, continue to search for signal sources to ensure that the content played by the backup signal source is consistent with the current program. Use the technology in S1 to detect the quality of the signal source and perform weighted sorting to associate it with the cloud and define it as a backup signal source. S4. When a quality indicator signal other than "Good Viewing Experience" is detected, the system switches to the backup signal source with the highest weighted ranking through buffer technology and seamless switching algorithm, and transmits it to S1 and S2 to output the quality indicator again. If a quality indicator signal other than "Good Viewing Experience" is output again, the next backup signal source with the highest weighted ranking is called up until "Good Viewing Experience" is output. The S4 also includes a re-output limiting algorithm, which dynamically presets a threshold for the number of times the backup signal source is switched. When the number of switching times equals the threshold, a device warning signal is output. If the viewing experience of the program still cannot be optimal after multiple switching of the backup signal source, it indicates that there may be a problem with the TV equipment itself, which is unrelated to the signal received by the set-top box. Therefore, a device warning signal is issued to facilitate timely repair of the TV equipment by the user. At the same time, the number of switching times threshold is dynamically adjusted according to the lifespan of the TV equipment. The shorter the lifespan, the smaller the number of switching times threshold, to avoid the problem of lag even after multiple adjustments, which would cause the set-top box to run at high speed. Conversely, the longer the lifespan, the larger the number of switching times threshold, to avoid the actual playback situation being affected by external factors when the backup signal source is used on this TV. The video feature extraction technology in S2 includes the following steps: Audio stream extraction: Real-time capture of the playing audio stream, extraction of features such as amplitude and zero-crossing rate to reflect the dynamic changes of the audio, Fourier transform to analyze the spectrum, peak frequency and bandwidth features to reflect the frequency distribution of the audio, MFCC to extract speech features, and generation of a unique identifier for the audio for subsequent matching of the same program content. Video stream extraction: Capture the playing video stream in real time, extract keyframes of the video using the OpenCV library, use a pre-trained deep learning model to perform image recognition on the keyframes, identify video content, generate a unique identifier for the video content, and combine audio fingerprints to more accurately identify program content; The mapping relationship between video features and viewing quality indicators in S2 includes the following steps: By analyzing the changes in the zero-crossing rate of the audio stream and comparing the synchronization of audio and video, the stuttering result is output. If an audio stream breakpoint is detected and the audio and video are out of sync, the viewing experience is output as poor. If no audio stream breakpoint is detected and the audio and video are out of sync, or if the audio stream breakpoint is detected and the audio and video are synchronized, the viewing experience is output as good. If no audio stream breakpoint is detected and the audio and video are synchronized, the viewing experience is output as excellent. The step S3, which involves searching for signal sources that match video features, includes the following steps: Based on the types of signal sources supported by the set-top box, perform the corresponding scan to obtain a list of signal sources; The feature matching algorithm is used to verify the matching degree between the video features of the program played by the signal source and the video features in S2. If they match, the backup signal source is output; if they do not match, the search for a signal source continues. Quality testing is performed on multiple backup signal sources, including measuring the strength of radio frequency signals, calculating the error rate in data transmission, detecting frame loss in the video stream, measuring the signal transmission delay, and then calculating the signal quality index of the current signal source through normalization and weighting. The weighted sorting in S3 includes the following steps: The receiver receives multiple backup signal sources with standardized quality indicators to the same range. Based on a predefined weight allocation, it calculates the comprehensive signal quality index and detects the signal quality index of each backup signal source. The signal sources are sorted from high to low according to the signal quality index, with the backup signal source with the highest priority placed at the front. The sorted list of backup signal sources is converted into a storage format, stored using cloud storage services, and the list of signal sources in the cloud is updated regularly.

2. The monitoring and analysis method for set-top box applications according to claim 1, characterized in that: The quality data in S1 includes signal strength, bit error rate, frame loss rate, and network latency; The signal strength is obtained through the API of the modem or network interface card and represents the strength of the received radio signal; The bit error rate is obtained from the statistical information of the network device and represents the ratio of the number of erroneous bits during data transmission to the total number of transmitted bits; the frame loss rate comes from the feedback of the video decoder and represents the ratio of the number of frames lost during video transmission to the total number of transmitted frames; the network latency is obtained through the ping command and represents the transmission time of data from the source to the destination.

3. The monitoring and analysis method for set-top box applications according to claim 1, characterized in that: The process in S4, which switches to the backup signal source at the top of the weighted sort using buffer technology and a seamless switching algorithm, includes the following steps: The size of the buffer is dynamically adjusted according to network bandwidth and signal quality. A certain amount of video data is preloaded into the buffer. If the signal quality indicators in the receiver S1 are suitable, the size of the buffer is reduced. If the signal quality indicators in S1 are not suitable, the size of the buffer will be increased immediately. When a signal with quality indicators other than good viewing experience is detected, a signal source switching command will be output. The switching logic will pause the playback of the current signal source and continue to play the pre-loaded content from the buffer. The background will start loading the video data of the backup signal source into the new buffer. Extract video stream features from the current and backup signal sources, including frame rate, video resolution, and audio synchronization. Use feature matching algorithms to verify the consistency between the backup signal source and the currently playing content, and find natural switching points in the video stream.

4. A monitoring and analysis system for set-top box applications, applied to the monitoring and analysis method for set-top box applications as described in any one of claims 1-3, characterized in that, It includes a signal acquisition module, a real-time video feature extraction module, a backup signal source storage module, and a seamless switching module; The signal acquisition module is used to acquire the quality data of the signal source and define the mapping relationship between the quality data and the signal quality index. It calculates the signal quality index of the current signal source through normalization and weighted calculation. The real-time video feature extraction module is used to trigger video feature extraction technology to identify the content of the currently playing TV program and output the video features extracted from the video features. Based on the mapping relationship between the video features and the viewing quality index, the module feeds back to the signal acquisition module to compare the signal quality index and the viewing quality index. If they do not match, a device fault warning signal is issued. If they match, the quality index is output. The backup signal source storage module is used to search for signal sources that match video features. The quality of the signal sources is detected by the signal acquisition module, and they are weighted, sorted, and associated with the cloud. These backup signal sources are defined as backup signal sources, and the backup signal sources that match video features are stored in the cloud. The seamless switching module is used to switch to the backup signal source with the highest weighted ranking when it senses a quality indicator signal other than "Good Viewing Experience" through buffer technology and seamless switching algorithm. The signal is then transmitted to the signal acquisition module and the real-time video feature extraction module to output the quality indicator. If a quality indicator signal other than "Good Viewing Experience" is output again, the next backup signal source with the highest weighted ranking is called up until "Good Viewing Experience" is output.

Images