Multi-channel synchronous decoding control system based on remote iptv signal virtual tunnel

Abstract

The application discloses a multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel, and relates to the technical field of video transmission synchronous control, and specifically comprises the following modules: a global semantic module, a synchronous level module, a tunnel allocation module, a synchronous management module, a synchronous dispatching module and a playback correction module; key frame detection, audio fingerprint extraction and subtitle alignment are performed on a plurality of IPTV signal streams, semantic events are generated and merged, a global time axis and a unified semantic label are established and clustered; a synchronous level record of each IPTV signal stream is generated and updated; a candidate tunnel set is selected for each IPTV signal stream according to tunnel preferences, a time window scheduling table is generated and issued; device node clocks are collected and corrected, limited clocks are marked based on time difference data, and a local compensation strategy is issued; a receiving end decoding buffer is established and a decoding start signal aligned by time is triggered; transmission quality is monitored in real time, tunnel configurations are updated, and logs are recorded.

Description

Technical Field

[0001] This invention relates to the field of video transmission synchronization control technology, specifically to a multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel. Background Technology

[0002] Existing IPTV / multi-screen transmission has the following problems in terms of parallel transmission of multiple signals, synchronous decoding, bandwidth allocation, and clock coordination: Time alignment of multiple signals is difficult to achieve at the global time axis level; Network fluctuations increase the risk of stuttering and frame errors at the decoding end; Conflicts frequently occur in resource allocation between critical and non-critical flows; Furthermore, it lacks consistency verification and playback correction mechanisms during playback.

[0003] Existing technologies typically distribute synchronization control across several independent modules, lacking cross-stream global semantic consistency, dynamic degradation strategies, and collaborative scheduling of decoding nodes, making it difficult to achieve high robustness and observability in large-scale, multi-terminal scenarios.

[0004] The information disclosed in the background section is only intended to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] The purpose of this invention is to provide a multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel to solve the problems mentioned in the background art.

[0006] To achieve the above objectives, the present invention provides the following technical solution: a multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel, specifically including the following modules: a global semantic module, a synchronization level module, a tunnel allocation module, a synchronization management module, a synchronization dispatch module, and a playback correction module; Global Semantic Module: Performs keyframe detection, audio fingerprint extraction, and subtitle alignment on multiple IPTV signal streams, generates and merges semantic events, and establishes and clusters them into a global timeline and unified semantic tags; Synchronization Level Module: Dynamically generates and updates the synchronization level record for each IPTV signal stream based on service requests and network quality. Tunnel allocation module: Initializes the available tunnel resource table, selects a set of candidate tunnels for each IPTV signal stream according to tunnel preferences, and generates and distributes time window scheduling table and decoding resource allocation; Synchronization Management Module: Starts the local reference clock, collects and corrects the clocks of each device node, calculates the one-way delay offset, marks the restricted clocks based on the time difference data, and issues local compensation strategies. Synchronous delivery module: Based on the priority of information tags, the relevant IPTV signal streams are divided into synchronous groups within a time period, a receiver decoding buffer is established, and a time-aligned decoding start signal is triggered. Playback Correction Module: Monitors transmission quality in real time and dynamically downgrades decoding when thresholds are exceeded, updates tunnel configuration and logs, verifies playback consistency, and marks time periods that require playback correction.

[0007] As a preferred embodiment of the multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel described in this invention, wherein: Receive multiple IPTV signal streams; Perform video keyframe detection on each IPTV signal, identify the keyframe location, and write the keyframe time point into the semantic event list; For each IPTV signal stream, audio fingerprint extraction is performed to generate an audio fingerprint sequence and the fingerprint time points are written into a semantic event list. For each IPTV signal stream, the subtitle timeline is parsed and aligned, and the subtitle time points and subtitle content indices are written into the semantic event list.

[0008] Merge the semantic event lists of each IPTV signal stream, create global semantic timeline entries in chronological order, and label the event source stream identifier and event type.

[0009] Event clustering is performed on global semantic timeline entries, merging similar events from different streams within similar time ranges into the same semantic label and recording the clustering error range.

[0010] As a preferred embodiment of the multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel described in this invention, wherein: Read the initial synchronization level label of each IPTV signal stream from the service request; Generate a synchronization level record for each IPTV signal stream. The fields of the record include: stream identifier, current level, target maximum tolerance deviation, preferred tunnel type, and corresponding time window length. Receive and parse the content attribute reports from the sending device node, and update the synchronization level of the IPTV signal stream; Receive and parse user policies and subscription information from terminal device nodes, and adjust the synchronization level of the IPTV signal stream according to priority weight; The quality indicators of the current transmission network are obtained periodically through link monitoring. For each IPTV signal stream, a level evaluation function is executed. If the evaluation result exceeds the level switching threshold, the level is adjusted from the current value to the new value and the reason for the change is recorded. When the synchronization level changes, a level change notification is generated and sent to the sending device node and the terminal device node. The notification includes the new level identifier, the recommended time window length, the preferred tunnel type, and redundancy recommendations.

[0011] As a preferred embodiment of the multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel described in this invention, wherein: Initialize the available tunnel resource table, recording the identifier, physical link to which each tunnel belongs, current status, latency, jitter, packet loss rate and remaining bandwidth for each tunnel; Receive the IPTV signal stream to be allocated and the corresponding synchronization level information, and select a set of candidate tunnels for each IPTV signal stream according to tunnel preference; For each IPTV signal stream, determine the primary tunnel and allocate one or more backup tunnels according to the strategy; The tunnel mapping table is issued, which contains a list of tunnels for each IPTV signal stream, the transmission level and transmission rules for each tunnel; Receive the synchronization level, target time window recommended length, and current terminal decoding resource report for each IPTV signal stream; A time window scheduling table is generated for each device node and decoding node. The table lists the start and end times of consecutive time windows, the expected stream list to be received within each window, and the decoding trigger time.

[0012] Based on the decoding resource status reported by the nodes and the parallelism limit set by the controller, the decoding priority and resource quota are allocated to the IPTV signal stream in each time window; The scheduling table is sent to the corresponding node, along with the expected arrival time range and replica selection rules for each flow within that window.

[0013] The node is assessed based on the actual arrival status to determine whether it can complete parallel decoding. If the assessment result indicates that it cannot complete the decoding, adjustment instructions are issued immediately, including reducing the resolution of non-critical streams, extending the window trigger time, or migrating some streams to other terminal / edge decoding nodes. When terminal resource anomalies occur, select a target node, transfer the stream decoding task of that node in the subsequent time window, and notify the sending device node before the transfer. Statistically record the decoding completion time, decoding failure rate, and resource utilization rate for each time window.

[0014] As a preferred embodiment of the multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel described in this invention, wherein: Start the local reference clock via the controller and set it as the domain time base identifier; Receive clock handshake responses from each device node and record their reported local time and round-trip latency; The controller time minus the node local time and half the round-trip time is used as the estimated value as the one-way delay offset for each device node; Send a time correction command to each device node. The command includes the node's time compensation amount and the correction effective time. The system receives the time difference data between the time correction confirmation and the corrected report from the receiving device node. If the correction error of the receiving device node exceeds the threshold, the receiving device node is marked as a restricted clock and an anomaly log is recorded.

[0015] As a preferred embodiment of the multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel described in this invention, wherein: A priority score is calculated for each semantic tag based on the timeline entries and the cluster density of events; Based on the priority scores of semantic tags, the corresponding time periods of related IPTV signal streams are divided into synchronization groups, and logical tunnel identifiers and bandwidth quotas are assigned to each synchronization group in the tunnel control table. A decoding buffer window is established on the receiving device node, and the buffer length is set based on the maximum time deviation within the synchronization group and the target playback delay. The decoding start signal is triggered according to the time alignment requirements of the semantic tags within the synchronization group.

[0016] As a preferred embodiment of the multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel described in this invention, wherein: Monitor tunnel transmission quality indicators in real time, including packet loss rate, jitter and latency, and write them into the quality record table; When the transmission quality index of any path in the synchronization group is detected to drop beyond the threshold, a dynamic priority adjustment process is executed to select downgraded decoding based on semantic tag priority and real-time quality. When performing a downgrade, update the tunnel control table and send a tunnel reconfiguration command to the edge node, record the reconfiguration transaction log and return a reconfiguration confirmation code; During playback, the output of the synchronization group is verified for consistency, including frame consistency check, audio alignment check and subtitle synchronization check, and the verification results are written into the consistency report entry. Mark the time period where consistency verification fails with a replay correction flag and submit the corresponding media segment to the replay correction queue; The correction process is executed on segments in the playback correction queue in order of priority. The correction methods include adjusting the playback time, replacing with alternative stream segments, or reassembling according to semantic tags, and the correction operation log is recorded.

[0017] On the other hand, the present invention provides a computer device including a memory and a processor, wherein the memory stores a computer program, wherein when the computer program is executed by the processor, it implements the steps of the multi-channel synchronous decoding control system based on the virtual tunnel of remote IPTV signal as described above.

[0018] On the other hand, the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, it implements the steps of the multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel as described above.

[0019] The technical effects and advantages provided by the present invention in the above technical solution are as follows: (1) The global semantic module can perform key frame detection, audio fingerprint extraction and subtitle alignment on multiple IPTV signal streams, thereby establishing a global timeline, reducing the time deviation between different streams and improving the accuracy of synchronization. (2) The synchronization level of each signal stream is dynamically generated and updated by the synchronization level module according to changes in network quality, service requests and user policies, which can maintain high decoding consistency in different network environments. (3) The tunnel allocation module intelligently selects a set of candidate tunnels based on tunnel preferences and network resource conditions, and dynamically adjusts resource allocation, which not only ensures the transmission efficiency of the system, but also optimizes the utilization of network resources and avoids bandwidth waste and resource bottlenecks. (4) The playback correction module monitors the transmission quality in real time. Once the quality drops below the preset threshold, it will dynamically downgrade the decoding and ensure the consistency of playback through playback correction. When the transmission quality is poor or the network latency increases, it can ensure the smoothness and synchronization of the playback content and avoid the phenomenon of audio-visual asynchrony or subtitle delay. (5) By using decoding resource scheduling and tunnel mapping table, the resource allocation of each node is optimized, maximizing the efficiency of parallel decoding and avoiding decoding failure or playback stuttering due to insufficient resources. (6) It can dynamically adjust the decoding priority within the synchronization group according to the priority of information tags and real-time transmission quality, and perform decoding degradation processing when quality problems occur, so as to prioritize the stable playback of high-priority streams; (7) Based on the priority management of the global time axis and synchronization group, it can ensure the strict alignment of multiple streams within a time period, guarantee the accurate synchronization and seamless switching of multi-channel signals, and avoid the asynchronous problem caused by delay or error. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this invention. For those skilled in the art, other drawings can be obtained based on these drawings.

[0021] Figure 1 This is a flowchart of the method for a multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel, as described in this invention.

[0022] Figure 2 This is a schematic diagram of the multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel according to the present invention. Detailed Implementation

[0023] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that the description of this disclosure will be more complete and fully convey the concept of the exemplary embodiments to those skilled in the art.

[0024] Example 1, referring to Figure 1 and Figure 2 This is the first embodiment of the present invention. This embodiment provides a multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel, which specifically includes the following modules: a global semantic module, a synchronization level module, a tunnel allocation module, a synchronization management module, a synchronization dispatch module, and a playback correction module. Global Semantic Module: Performs keyframe detection, audio fingerprint extraction, and subtitle alignment on multiple IPTV signal streams, generates and merges semantic events, and establishes and clusters them into a global timeline and unified semantic tags; The global semantic module, Receive multiple IPTV signal streams; Perform video keyframe detection on each IPTV signal, identify the keyframe location, and write the keyframe time point into the semantic event list; For each IPTV signal stream, audio fingerprint extraction is performed to generate an audio fingerprint sequence and the fingerprint time points are written into a semantic event list. For each IPTV signal stream, the subtitle timeline is parsed and aligned, and the subtitle time points and subtitle content indices are written into the semantic event list.

[0025] Merge the semantic event lists of each IPTV signal stream, create global semantic timeline entries in chronological order, and label the event source stream identifier and event type.

[0026] Event clustering is performed on global semantic timeline entries, merging similar events from different streams within similar time ranges into the same semantic label and recording the clustering error range.

[0027] Synchronization Level Module: Dynamically generates and updates the synchronization level record for each IPTV signal stream based on service requests and network quality. The synchronization level module, Read the initial synchronization level label of each IPTV signal stream from the service request; Generate a synchronization level record for each IPTV signal stream. The fields of the record include: stream identifier, current level, target maximum tolerance deviation, preferred tunnel type, and corresponding time window length. Receive and parse the content attribute reports from the sending device node (such as the content type of the stream, whether it is a key view or key frame identifier), and update the synchronization level of the IPTV signal stream; Receive and parse user policies and subscription information from terminal device nodes (such as the user's selected main view or multi-screen synchronization requirements), and adjust the synchronization level of the IPTV signal stream according to priority weight; The quality indicators of the current transmission network (latency, jitter, packet loss rate, available bandwidth) are obtained periodically through link monitoring. For each IPTV signal stream, a level evaluation function is executed. If the evaluation result exceeds the level switching threshold, the level is adjusted from the current value to the new value and the reason for the change is recorded. When the synchronization level changes, a level change notification is generated and sent to the sending device node and the terminal device node. The notification includes the new level identifier, the recommended time window length, the preferred tunnel type, and redundancy recommendations.

[0028] Tunnel allocation module: Initializes the available tunnel resource table, selects a set of candidate tunnels for each IPTV signal stream according to tunnel preferences, and generates and distributes time window scheduling table and decoding resource allocation; Initialize the available tunnel resource table, recording the identifier, physical link to which each tunnel belongs, current status, latency, jitter, packet loss rate and remaining bandwidth for each tunnel; Receive the IPTV signal stream to be allocated and the corresponding synchronization level information, and select a set of candidate tunnels (main tunnel, backup tunnel, low priority tunnel) for each IPTV signal stream according to tunnel preference.

[0029] For each IPTV signal stream, determine the primary tunnel and allocate one or more backup tunnels according to the strategy; It should also be noted that during tunnel allocation, the remaining bandwidth of each tunnel is checked to see if it meets the bandwidth requirements after mapping. If it is insufficient, additional bandwidth is requested from the superior level according to priority. The tunnel mapping table is issued, which contains a list of tunnels for each IPTV signal stream, the transmission level (primary / backup / low priority) of each tunnel, and the transmission rules (under what conditions to send a copy). Receive the synchronization level, target time window recommended length, and current terminal decoding resource report for each IPTV signal stream; A time window scheduling table is generated for each device node and decoding node. The table lists the start and end times of consecutive time windows, the expected stream list to be received within each window, and the decoding trigger time.

[0030] Based on the decoding resource status reported by the nodes and the parallelism limit set by the controller, the decoding priority and resource quota (number of threads or hardware decoding unit number) are allocated to the IPTV signal stream in each time window. The scheduling table is sent to the corresponding node, along with the expected arrival time range and replica selection rules for each flow within that window.

[0031] The node is assessed based on the actual arrival status to determine whether it can complete parallel decoding. If the assessment result indicates that it cannot complete the decoding, adjustment instructions are issued immediately, including reducing the resolution of non-critical streams, extending the window trigger time, or migrating some streams to other terminal / edge decoding nodes. When terminal resource anomalies occur (decoder failure or CPU overload), select a target node, transfer the stream decoding task of that node in the subsequent time window, and notify the sending device node before the transfer. The decoding completion time, decoding failure rate, and resource utilization rate for each time window are statistically analyzed and recorded for subsequent scheduling strategy optimization and historical auditing.

[0032] Synchronization Management Module: Starts the local reference clock, collects and corrects the clocks of each device node, calculates the one-way delay offset, marks the restricted clocks based on the time difference data, and issues local compensation strategies. Start the local reference clock via the controller and set it as the domain time base identifier; Receive clock handshake responses from each device node and record their reported local time and round-trip latency; The controller time minus the node local time and half the round-trip time is used as the estimated value as the one-way delay offset for each device node; Send a time correction command to each device node. The command includes the node's time compensation amount and the correction effective time. Receive the time difference data between the time correction confirmation and the corrected report from the device node. If the correction error of the device node exceeds the threshold, mark the device node as a restricted clock and record the anomaly log. It should also be noted that for device nodes marked as constrained clocks, local compensation strategies are calculated and issued, including increasing the correction frequency or establishing an auxiliary clock proxy at the edge and issuing proxy access instructions.

[0033] Synchronous delivery module: Based on the priority of information tags, the relevant IPTV signal streams are divided into synchronous groups within a time period, a receiver decoding buffer is established, and a time-aligned decoding start signal is triggered. A priority score is calculated for each semantic tag based on the timeline entries and the cluster density of events; Based on the priority scores of semantic tags, the corresponding time periods of related IPTV signal streams are divided into synchronization groups, and logical tunnel identifiers and bandwidth quotas are assigned to each synchronization group in the tunnel control table. A decoding buffer window is established on the receiving device node, and the buffer length is set based on the maximum time deviation within the synchronization group and the target playback delay. The decoding start signal is triggered according to the time alignment requirements of the semantic tags within the synchronization group.

[0034] Playback Correction Module: Monitors transmission quality in real time and dynamically downgrades decoding when thresholds are exceeded, updates tunnel configuration and logs, verifies playback consistency, and marks time periods that require playback correction; Monitor tunnel transmission quality indicators in real time, including packet loss rate, jitter and latency, and write them into the quality record table; When the transmission quality index of any path in the synchronization group is detected to drop beyond the threshold, a dynamic priority adjustment process is executed to select downgraded decoding based on semantic tag priority and real-time quality. When performing a downgrade, update the tunnel control table and send a tunnel reconfiguration command to the edge node, record the reconfiguration transaction log and return a reconfiguration confirmation code; During playback, the output of the synchronization group is verified for consistency, including frame consistency check, audio alignment check and subtitle synchronization check, and the verification results are written into the consistency report entry. Mark the time period where consistency verification fails with a replay correction flag and submit the corresponding media segment to the replay correction queue; The correction process is executed on segments in the playback correction queue in order of priority. The correction methods include adjusting the playback time, replacing with alternative stream segments, or reassembling according to semantic tags, and the correction operation log is recorded.

[0035] The global semantic module enables keyframe detection, audio fingerprint extraction, and subtitle alignment for multiple IPTV signal streams, thereby establishing a global timeline, reducing time discrepancies between different streams, and improving synchronization accuracy. The synchronization level module dynamically generates and updates the synchronization level of each signal stream based on changes in network quality, service requests, and user policies, which can maintain high decoding consistency in different network environments. The tunnel allocation module intelligently selects a set of candidate tunnels based on tunnel preferences and network resource conditions, and dynamically adjusts resource allocation. This not only ensures the transmission efficiency of the system, but also optimizes the utilization of network resources, avoiding bandwidth waste and resource bottlenecks. The playback correction module monitors the transmission quality in real time. Once it detects that the quality has dropped beyond the preset threshold, it will dynamically downgrade the decoding and ensure the consistency of playback through playback correction. When the transmission quality is poor or the network latency increases, it can ensure the smoothness and synchronization of the playback content, avoiding the phenomenon of audio and video desynchronization or subtitle delay. By using decoding resource scheduling and tunnel mapping tables, the resource allocation of each node is optimized, maximizing the efficiency of parallel decoding and avoiding decoding failures or playback stuttering due to insufficient resources. It can dynamically adjust the decoding priority within the synchronization group based on the priority of information tags and real-time transmission quality, and perform decoding degradation processing when quality problems occur, prioritizing the stable playback of high-priority streams; Based on priority management of the global time axis and synchronization groups, it can ensure strict alignment of multiple streams within a time period, guarantee accurate synchronization and seamless switching of multi-channel signals, and avoid asynchrony problems caused by delay or error. Example

[0036] The following is another embodiment of the present invention, which provides a multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel. In order to verify the beneficial effects of the present invention, a simulation experiment is conducted for scientific demonstration.

[0037] The network infrastructure specifically includes: a 1Gbps core switch supporting multipath transmission and link aggregation; and edge link bandwidth totaling ≥4Gbps, with low jitter links. Data structure definition, specifically including: Global timeline entry: {timestamp, event type {KF / audio / subtitle}, source stream ID, cluster label}; Synchronization level record: {Stream ID, Current level, Target deviation, Preferred tunnel type, Time window length}; Tunnel table: {Tunnel ID, Physical Link ID, Status, Latency, Jitter, Packet Loss Rate, Remaining Bandwidth, Primary / Backup / Low Priority}; Synchronization Group: {Group ID, set of member stream IDs, information tag priority, maximum allowed time deviation}; Select the IEEE 1588 precision clock as the local reference clock and the local TCXO as the backup reference clock; The experimental subjects specifically include: multiple IPTV signal streams: 4 high-definition and 1 4K mixed signals, containing different subtitles and audio tracks; Experimental indicators, specifically including: Cross-stream time alignment error (global timeline consistency): in milliseconds, counting the alignment error of each keyframe, audio fingerprint, and subtitle point; Synchronization level change order and stability: Record the number of level switching times, switching latency, and switching reasons; Decoding parallelism and throughput: the number of decoded streams completed per unit time and the average decoding latency per stream.

[0038] The core logic of modules such as global semantics, synchronization level, tunnel allocation, synchronization management, synchronization dispatch, and playback correction is deployed on the control node, while the decoding node is deployed with decoding and local clock synchronization capabilities.

[0039] Set an initial baseline of 1Gbps bandwidth, 20ms round-trip latency, 5ms jitter, and 0.1% packet loss rate using a static network condition simulator.

[0040] Under conditions of no significant network fluctuations, verify the consistency of the global timeline, the initial state of the synchronization level of each stream, and the correct distribution of the tunnel mapping table.

[0041] Four IPTV streams (including one 4K stream and three 1080p streams) are introduced and triggered at different subtitle / audio event times. The alignment error of keyframes, audio fingerprints, and subtitle points on the global timeline is recorded.

[0042] Record the mean, median, and 75th / 95th percentile of the cross-stream alignment error; The target is set as follows: the alignment error is less than 5 ms when there are no network anomalies (actual robust scenario); Network quality fluctuations: bandwidth fluctuations ±30%, round-trip latency fluctuations ±10 ms, and jitter significantly improved; Observe the number of times the synchronization level changes, the switching latency from the current level to the target level, and the notification latency of terminal device nodes and sending device nodes; Under different network conditions, test the correctness of the allocation of primary / backup tunnels and verify whether the decoding resource allocation under the time window meets the requirements of parallel decoding; The main tunnel hit rate, backup tunnel switching latency, and the maximum number of paths that can be decoded in parallel within a single window are used as indicators. When the transmission quality degrades, the system triggers downgrade decoding and records the playback smoothness (instantaneous jitter, number of stutters), audio-visual synchronization, and subtitle alignment of each channel before and after the downgrade. Inject anomalies such as edge decoding node failure, network partitioning, and clock drift to verify the system's failover, task migration, and logging capabilities.

[0043] Control experiments, specifically including: Compare with system A: System without a global semantic module, which only synchronizes based on local clock and local timestamp, and compare cross-stream alignment error with playback consistency.

[0044] Comparison B: No playback correction module. When encountering network fluctuations, it only downgrades without performing playback correction. Compare playback continuity and audio-visual synchronization.

[0045] Compare resource utilization and decoding success rate with C: static tunnel allocation strategy.

[0046] The experimental results will be repeated multiple times based on the same video content and the same hardware environment, and the improvement effect will be evaluated using statistical significance methods.

[0047] No global semantic module (as opposed to A): Cross-path alignment error mean: 7.8ms, median: 7.1ms, 95th percentile: 12.5ms, maximum: 26.3ms There is a global semantic module (in this invention): Cross-path alignment error mean: 1.9ms, median: 1.6ms, 95th percentile: 3.7ms, maximum: 8.2ms Based on the above experiments, the alignment error was significantly reduced after introducing the global semantic module (from an average of 7.8ms to 1.9ms, an improvement of >70%). The drop to the 95th percentile indicates a significant improvement in edge events (such as subtitle alignment points and audio pointers), and enhanced robustness across streams.

[0048] Comparison A: Number of level switching times = 9, average switching latency = 110ms This invention: Number of level switching times = 4, average switching latency = 70ms Based on the above experiments, strategic level updates in a dynamic network environment reduce unnecessary switching and improve stability. The keystream maintains high priority during network fluctuations, improving playback continuity.

[0049] No dynamic tunneling strategy (comparison C): Maximum number of parallel decoding channels: 3; Bandwidth utilization: 82% Dynamic tunneling strategy (in this invention): Maximum number of parallel decoding channels: 4; Bandwidth utilization: 91% Based on the above experiments, the dynamic adjustment of tunnel allocation improves parallel decoding capabilities and bandwidth utilization, and reduces stuttering caused by insufficient resources.

[0050] The comparison before and after the correction specifically includes: Average audio-visual synchronization error: Original 6.2ms → Corrected 1.7ms Subtitle alignment error: Original 9.1ms → Corrected 2.1ms Playback duration deviation: Original deviation 120ms → Corrected deviation 15ms The significant decrease in the number of triggers during network fluctuations demonstrates the necessity and effectiveness of replay correction.

[0051] The playback correction mechanism significantly improves playback continuity and subtitle alignment stability, reducing the sense of misalignment in the viewing experience.

[0052] By combining a degradation strategy with a playback correction queue, normal playback can be quickly restored in different situations.

[0053] Overall robustness score without a global semantic module (comparison A): 72 / 100 The overall robustness score of the global semantic module (in this invention) is 89 / 100. The collaborative work of the global semantics and synchronization management modules significantly improves system robustness and reduces performance degradation in abnormal situations.

[0054] It should also be noted that the improvement in global timeline alignment accuracy is directly related to the global semantic module, confirming the effectiveness of cross-stream time alignment capabilities.

[0055] It should also be noted that the improved robustness of the synchronization level, which supports maintaining decoding consistency under varying network conditions, is closely related to the synchronization level module.

[0056] Furthermore, it should be noted that the improvement in tunnel allocation and resource scheduling reflects the actual effect of resource management and bandwidth utilization optimization.

[0057] It should also be noted that the playback correction function performs degradation and correction when transmission fluctuations occur, verifying the continuity and consistency of playback.

[0058] The foregoing has only described certain exemplary embodiments of the present invention by way of illustration. Undoubtedly, those skilled in the art can modify the described embodiments in various ways without departing from the spirit and scope of the present invention. Therefore, the foregoing drawings and descriptions are illustrative in nature and should not be construed as limiting the scope of protection of the claims of the present invention.

Claims

1. A multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel, characterized in that, Specifically, it includes the following modules: global semantic module, synchronization level module, tunnel allocation module, synchronization management module, synchronization dispatch module, and replay correction module; Global Semantic Module: Performs keyframe detection, audio fingerprint extraction, and subtitle alignment on multiple IPTV signal streams, generates and merges semantic events, and establishes and clusters them into a global timeline and unified semantic tags; Synchronization Level Module: Dynamically generates and updates the synchronization level record for each IPTV signal stream based on service requests and network quality. Tunnel allocation module: Initializes the available tunnel resource table, selects a set of candidate tunnels for each IPTV signal stream according to tunnel preferences, and generates and distributes time window scheduling table and decoding resource allocation; Synchronization Management Module: Starts the local reference clock, collects and corrects the clocks of each device node, calculates the one-way delay offset, marks the restricted clocks based on the time difference data, and issues local compensation strategies. Synchronous delivery module: Based on the priority of information tags, the relevant IPTV signal streams are divided into synchronous groups within a time period, a receiver decoding buffer is established, and a time-aligned decoding start signal is triggered. Playback Correction Module: Monitors transmission quality in real time and dynamically downgrades decoding when thresholds are exceeded, updates tunnel configuration and logs, verifies playback consistency, and marks time periods that require playback correction.

2. The multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel according to claim 1, characterized in that: The global semantic module, Receive multiple IPTV signal streams; Perform video keyframe detection on each IPTV signal, identify the keyframe location, and write the keyframe time point into the semantic event list; For each IPTV signal stream, audio fingerprint extraction is performed to generate an audio fingerprint sequence and the fingerprint time points are written into a semantic event list. For each IPTV signal stream, the subtitle timeline is parsed and aligned, and the subtitle time points and subtitle content indices are written into the semantic event list. Merge the semantic event lists of each IPTV signal stream, create global semantic timeline entries in chronological order, and label the event source stream identifier and event type. Event clustering is performed on global semantic timeline entries, merging similar events from different streams within similar time ranges into the same semantic label and recording the clustering error range.

3. The multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel according to claim 1, characterized in that: The synchronization level module, Read the initial synchronization level label of each IPTV signal stream from the service request; Generate a synchronization level record for each IPTV signal stream; Receive and parse the content attribute reports from the sending device node, and update the synchronization level of the IPTV signal stream; Receive and parse user policies and subscription information from terminal device nodes, and adjust the synchronization level of the IPTV signal stream according to priority weight; The quality indicators of the current transmission network are obtained periodically through link monitoring. For each IPTV signal stream, a level evaluation function is executed. If the evaluation result exceeds the level switching threshold, the level is adjusted from the current value to the new value and the reason for the change is recorded. When the synchronization level changes, a level change notification is generated and sent to the sending device node and the terminal device node.

4. The multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel according to claim 1, characterized in that: The tunnel allocation module Initialize the available tunnel resource table; Receive the IPTV signal stream to be allocated and the corresponding synchronization level information, and select a candidate tunnel set for each IPTV signal stream according to tunnel preference. For each IPTV signal stream, determine the primary tunnel and allocate one or more backup tunnels according to the strategy; Issue the tunnel mapping table; Receive the synchronization level, target time window recommended length, and current terminal decoding resource report for each IPTV signal stream; Generate a time window scheduling table for each device node and decoding node. Based on the decoding resource status reported by the nodes and the parallelism limit set by the controller, the decoding priority and resource quota are allocated to the IPTV signal stream in each time window; Send the scheduling table to the corresponding nodes; Assess whether the node can complete parallel decoding based on the actual arrival status; if the assessment result is that it cannot complete it, issue an adjustment instruction immediately. When terminal resource anomalies occur, select a target node, transfer the stream decoding task of that node in the subsequent time window, and notify the sending device node before the transfer. Statistically record the decoding completion time, decoding failure rate, and resource utilization rate for each time window.

5. The multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel according to claim 1, characterized in that: The synchronization management module, Start the local reference clock via the controller and set it as the domain time base identifier; Receive clock handshake responses from each device node and record their reported local time and round-trip latency; The controller time minus the node local time and half the round-trip time is used as the estimated value as the one-way delay offset for each device node; Send a time correction command to each device node; The system receives the time difference data between the time correction confirmation and the corrected report from the receiving device node. If the correction error of the receiving device node exceeds the threshold, the receiving device node is marked as a restricted clock and an anomaly log is recorded.

6. The multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel according to claim 1, characterized in that: The synchronous distribution module. A priority score is calculated for each semantic tag based on the timeline entries and the cluster density of events; Based on the priority scores of semantic tags, the corresponding time periods of related IPTV signal streams are divided into synchronization groups, and logical tunnel identifiers and bandwidth quotas are assigned to each synchronization group in the tunnel control table. A decoding buffer window is established on the receiving device node, and the buffer length is set based on the maximum time deviation within the synchronization group and the target playback delay. The decoding start signal is triggered according to the time alignment requirements of the semantic tags within the synchronization group.

7. The multi-channel synchronous decoding control system based on a remote IPTV signal virtual tunnel according to claim 1, characterized in that: The playback correction module, Monitor tunnel transmission quality indicators in real time and write them into the quality record table; When the transmission quality index of any path in the synchronization group is detected to drop beyond the threshold, a dynamic priority adjustment process is executed to select downgraded decoding based on semantic tag priority and real-time quality. When performing a downgrade, update the tunnel control table and send a tunnel reconfiguration command to the edge node, record the reconfiguration transaction log and return a reconfiguration confirmation code; During playback, the consistency of the output of the synchronization group is verified. Mark the time period where consistency verification fails with a replay correction flag and submit the corresponding media segment to the replay correction queue; The correction process is executed on segments in the replay correction queue in order of priority.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, it implements the module of the multi-channel synchronous decoding control system based on the virtual tunnel of remote IPTV signal as described in any one of claims 1 to 7.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, it implements the module of the multi-channel synchronous decoding control system based on the virtual tunnel of remote IPTV signal as described in any one of claims 1 to 7.

Images