Multi-display synchronous display method and display system

Through the central coordinator real-time monitoring and dynamic grouping, the status data of the device, combined with the delay compensation strategy based on prior information and the precise control of synchronization signals, the problem of video stream data being out of synchronization in multi-display synchronous display is solved, and high-precision synchronous display is realized, improving the accuracy of user experience and information communication.

CN118741011BActive Publication Date: 2025-05-13SICHUAN GUANGXIN TIANXIA MEDIA CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410980323.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-22
Publication Date
2025-05-13
Estimated Expiration
2044-07-22

AI Technical Summary

Technical Problem

The existing multi-display synchronous display technology cannot effectively solve the problem of video streaming data out of synchronization due to hardware differences, network delays and different processing speeds, which affects the accuracy of user experience and information communication.

Method used

By introducing a central coordinator, the status data of the slave device is monitored in real time, dynamic packetization and delay compensation strategies based on prior information, combined with the precise control of synchronization signals, high-precision synchronous display of video stream data is achieved.

Benefits of technology

It effectively improves the synchronization accuracy and adaptability of multi-display synchronous display, improves the accuracy of user experience and information communication, and meets the strict requirements of modern multimedia applications for real-time and consistency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118741011B_ABST
    Figure CN118741011B_ABST
Patent Text Reader

Abstract

The present invention provides a multi-display synchronous display method and a display system, which belongs to the field of synchronous display technology, and includes a central coordinator, a master device and at least one slave device. The central coordinator monitors the status data of all slave devices in real time, and dynamically groups all slave devices based on the similarity between the status data to obtain at least one slave device group; according to the status data of different slave device groups, the central coordinator matches the corresponding delay compensation strategy from a preset strategy library; the central coordinator receives the video stream data from the master device, and compensates the video stream data according to the delay compensation strategy matched by each slave device; each slave device correspondingly receives the video stream data compensated by the central coordinator, and decodes the compensated video stream data, so as to perform synchronous display of each slave device according to the synchronization signal contained in the video stream data, thereby realizing synchronous display based on real-time status monitoring and dynamic grouping strategy.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of synchronous display technology, and in particular to a multi-display synchronous display method and a display system. Background Art

[0002] With the rapid development of information technology and the increasing popularity of multimedia applications, multi-monitor synchronous display technology has gradually become one of the key technologies in various application scenarios. Multi-monitor synchronous display technology can not only provide a wider field of view and richer information display methods, but also show great application potential in many fields such as education, monitoring, games, virtual reality, etc. However, in actual applications, due to hardware differences, network delays, and different processing speeds between various slave devices (such as displays, projectors, etc.), video stream data often has asynchronous problems during transmission and display, which seriously affects user experience and accurate information transmission.

[0003] In the prior art, the methods for achieving multi-display synchronous display mostly rely on static configuration and simple delay adjustment strategies, and cannot be dynamically adjusted and optimized according to the real-time status of the slave device. This static method often seems to be powerless when facing complex and changeable network environments, device status changes, and the diversity of video content, and it is difficult to meet the needs of high-precision synchronous display.

[0004] Therefore, it is necessary to provide a multi-display synchronous display method and a display system to solve the above technical problems. Summary of the invention

[0005] In order to solve the above technical problems, the present invention provides a multi-display synchronous display method and display system, which effectively solves the problems of low synchronization accuracy and poor adaptability of multi-display synchronous display in the prior art by introducing a central coordinator, realizing real-time status monitoring and dynamic grouping, a delay compensation strategy based on prior information, and precise control of synchronization signals.

[0006] The present invention provides a multi-display synchronous display method, comprising a central coordinator, a master device and at least one slave device, and the display method comprises the following steps:

[0007] S1: monitoring the status data of all slave devices in real time through the central coordinator, and dynamically grouping all slave devices based on the similarity between the status data to obtain at least one slave device group;

[0008] S2: According to the status data of different slave device groups, a corresponding delay compensation strategy is matched from a preset strategy library through a central coordinator, wherein the strategy library is generated based on prior information learning;

[0009] S3: The central coordinator receives the video stream data from the master device, and compensates the video stream data according to the delay compensation strategy matched by each slave device to compensate for the delay of each slave device;

[0010] S4: Each slave device correspondingly receives the video stream data compensated by the central coordinator, and decodes the compensated video stream data, so as to perform synchronous display of each slave device according to the synchronization signal contained in the video stream data.

[0011] Preferably, the status data includes the network status and geographic location of the slave device.

[0012] Preferably, step S1 comprises the following steps:

[0013] S101: monitoring the network status and geographical location of all slave devices in real time through the central coordinator to obtain status data of the slave devices in real time;

[0014] S102: Perform cluster analysis on the status data of all slave devices using a K-means clustering algorithm to obtain a clustering result;

[0015] S103: Based on the clustering result, dynamically group all slave devices to obtain at least one slave device group.

[0016] Preferably, step S102 includes the following steps:

[0017] S102a: normalizing the network status and geographic location of all slave devices, and performing feature fusion on the normalized network status and geographic location to obtain a comprehensive feature;

[0018] S102b: Determine the expected number of slave device groups based on prior knowledge;

[0019] S102c: Use the K-means algorithm to iteratively cluster the comprehensive features of each slave device until convergence, thereby obtaining a clustering result.

[0020] Preferably, step S2 comprises the following steps:

[0021] S201: The central coordinator performs feature screening and fusion on the status data of all slave device groups to obtain the status features of each slave device group;

[0022] S202: Based on the status characteristics of each slave device group, use a preset policy library to perform policy matching on each slave device group to obtain a delay compensation policy adapted to each slave device group, wherein the policy library includes a plurality of associated delay compensation policies and status characteristic pairs.

[0023] Preferably, step S202 includes the following steps:

[0024] S202a: querying using a preset policy library based on the status characteristics of each slave device group;

[0025] S202b: using a nearest neighbor algorithm to compare the state characteristics of each slave device group with the policy instances in the policy library, and obtaining the most similar policy instances matching each slave device group;

[0026] S202c: Use the most similar policy instance as the delay compensation policy of the corresponding slave device group.

[0027] Preferably, step S3 comprises the following steps:

[0028] S301: receiving video stream data from a master device through a central coordinator and parsing a synchronization signal;

[0029] S302: Performing delay compensation on the video stream data using the delay compensation strategy matched by each slave device;

[0030] S303: Re-encapsulate and send the compensated video stream data.

[0031] Preferably, step S4 comprises the following steps:

[0032] S401: decoding the compensated video stream data through the decoder of each slave device to obtain a displayable video frame;

[0033] S402: performing time alignment on decoded video frames based on a synchronization signal included in the video stream data;

[0034] S403: Using the display hardware of each slave device to display and output the time-aligned video frames, so as to achieve visual synchronization among multiple displays.

[0035] The present invention also provides a multi-display synchronous display system for executing the multi-display synchronous display method, comprising a central coordinator, a master device and at least one slave device, wherein the display system comprises:

[0036] A grouping module, used to monitor the status data of all slave devices in real time through the central coordinator, and dynamically group all slave devices based on the similarity between the status data to obtain at least one slave device group;

[0037] A strategy matching module, used to match corresponding delay compensation strategies from a preset strategy library through a central coordinator according to the status data of different slave device groups, wherein the strategy library is generated based on prior information learning;

[0038] A video stream compensation module, used for the central coordinator to receive video stream data from the master device and compensate the video stream data according to the delay compensation strategy matched by each slave device to compensate for the delay of each slave device;

[0039] The synchronous display module is used for each slave device to correspondingly receive the video stream data compensated by the central coordinator, and decode the compensated video stream data to perform synchronous display of each slave device according to the synchronization signal contained in the video stream data.

[0040] Compared with the related art, the multi-display synchronous display method and display system provided by the present invention have the following beneficial effects: BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A flowchart of a multi-display synchronous display method provided by the present invention;

[0042] Figure 2 A module structure diagram of a multi-display synchronous display system provided by the present invention. DETAILED DESCRIPTION

[0043] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only the parts related to the present invention, rather than all structures, are shown in the accompanying drawings. In addition, the embodiments of the present invention and the features in the embodiments may be combined with each other without conflict.

[0044] It should also be noted that, for ease of description, only the part relevant to the present invention but not all the content is shown in the accompanying drawings. It should be mentioned before discussing the exemplary embodiments in more detail that some exemplary embodiments are described as the processing or method described as a flow chart. Although the flow chart describes each operation (or step) as being processed sequentially, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. When its operation is completed, the processing can be terminated, but it can also have additional steps not included in the accompanying drawings. The processing can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

[0045] Embodiment 1

[0046] The present invention provides a multi-display synchronous display method, comprising a central coordinator, a master device and at least one slave device, referring to Figure 1 As shown, the display method comprises the following steps:

[0047] S1: The central coordinator monitors the status data of all slave devices in real time, and dynamically groups all slave devices based on similarities between the status data to obtain at least one slave device group.

[0048] In this embodiment, by real-time monitoring of the network status and geographic location information of all slave devices and using the K-means clustering algorithm to intelligently group the devices, the system's adaptability to dynamic network environments is greatly improved. At the same time, the central coordinator can flexibly adjust resource allocation and policy execution based on the actual conditions of the devices, thereby significantly improving the efficiency, stability and user viewing experience of video streaming transmission.

[0049] S2: According to the status data of different slave device groups, a corresponding delay compensation strategy is matched from a preset strategy library through a central coordinator, wherein the strategy library is generated based on prior information learning.

[0050] In this embodiment, through feature screening, fusion and strategy matching, an in-depth understanding and utilization of the state characteristics of the slave device group is achieved, which not only improves the accuracy of strategy matching, but also ensures that the delay compensation strategy can adapt to the specific needs of different slave device groups, greatly improving the synchronization of video streaming and the quality of user viewing experience. Through the intelligent strategy matching process, the system can continuously provide efficient and stable multi-display synchronous display services in a complex and changeable network environment, meeting the strict requirements of modern multimedia communications for real-time and synchronization.

[0051] S3: The central coordinator receives the video stream data from the master device, and compensates the video stream data according to the delay compensation strategy matched by each slave device to compensate for the delay of each slave device.

[0052] In this embodiment, through the reception and analysis of video stream data, delay compensation, repackaging and sending, video stream transmission optimization from the master device to each slave device group is achieved, ensuring accurate delivery and time synchronization of video content, overcoming the challenges brought by network delay and processing differences, and providing users with a high-quality multi-display synchronous display experience. Through the intelligent management and optimization of the central coordinator, it can dynamically adapt to changes in the network environment, ensure the synchronization and smoothness of video playback, and meet the strict requirements of modern multimedia applications for real-time and consistency.

[0053] S4: Each slave device correspondingly receives the video stream data compensated by the central coordinator, and decodes the compensated video stream data, so as to perform synchronous display of each slave device according to the synchronization signal contained in the video stream data.

[0054] In this embodiment, through decoding, time alignment and display output of video stream data, video playback optimization and visual synchronization between multiple displays are achieved from the device side, ensuring that video content can be played with high accuracy and smoothness on all displays even when there are differences in network conditions and geographical locations, meeting the requirements of modern multimedia applications for real-time and consistency. Through intelligent processing from the device side, the system can overcome technical challenges, provide excellent video synchronization display effects, and enhance user experience and interactivity.

[0055] The status data includes the network status and geographic location of the slave device.

[0056] Specifically, step S1 includes the following steps:

[0057] S101: The central coordinator monitors the network status and geographical location of all slave devices in real time to obtain status data of the slave devices in real time.

[0058] In this embodiment, the central coordinator continuously collects the network status (such as latency, packet loss rate, bandwidth, etc.) of each slave device and their geographic location information through integrated network monitoring functions and geolocation services. This information can be uploaded to the central coordinator in real time through sensors or software agents on the device, or the central coordinator actively sends heartbeat requests to the slave devices and extracts the required data from the responses.

[0059] This ensures that the central coordinator can grasp the network health status and physical location of all slave devices in real time, which is crucial for subsequent dynamic grouping and policy matching, because the network conditions and geographical location of the device directly affect its processing capacity and communication delay. Real-time monitoring enables the system to respond quickly to network changes and improve overall response speed and stability.

[0060] S102: Perform cluster analysis on the status data of all slave devices using a K-means clustering algorithm to obtain a clustering result.

[0061] In this embodiment, the K-means clustering algorithm is used to analyze the collected status data of all slave devices, wherein K-means is an unsupervised learning method that groups data points with similar characteristics into the same cluster. In this application, the central coordinator will pre-set the number of clusters K, and the algorithm will automatically assign slave devices to different clusters based on the similarity of network status and geographical location to form a preliminary grouping result.

[0062] The K-means algorithm can automatically identify groups of devices with similar network conditions and geographical locations. This data-driven grouping method is more flexible and efficient than manual static grouping. It can adapt to the ever-changing network environment, optimize resource allocation and policy application, and improve the overall performance of the system and user experience.

[0063] S103: Based on the clustering result, dynamically group all slave devices to obtain at least one slave device group.

[0064] In this embodiment, the central coordinator divides the slave devices into multiple groups based on the clustering results obtained in step S102. The slave devices in each group have high similarity in network conditions and geographical locations. After the grouping is completed, each slave device group is regarded as a logical unit for subsequent policy matching and delay compensation processing.

[0065] Dynamic grouping allows the central coordinator to customize the delay compensation strategy according to the characteristics of different groups. This can more effectively solve the delay problem in specific areas or network conditions, improve the synchronization and smoothness of video streaming transmission, and enhance the efficiency and coordination of multi-device collaboration.

[0066] Specifically, step S102 includes the following steps:

[0067] S102a: Normalize the network status and geographic location of all slave devices, and perform feature fusion on the normalized network status and geographic location to obtain comprehensive features.

[0068] In this embodiment, the central coordinator first normalizes the network status and geographic location data reported by all slave devices. This is because the original data may have different dimensions and ranges, and direct comparison or cluster analysis may lead to deviations. After normalization, all features will be converted to a unified scale, such as the [0, 1] interval, which can ensure that the network status and geographic location features have equal importance in subsequent analysis.

[0069] After normalization, the central coordinator will fuse the network status and geographic location features to form a comprehensive feature vector. Specifically, feature fusion is achieved through a weighted summation feature combination method. The selection of weights is based on prior knowledge. For example, if the proximity of geographic locations is more important for synchronous display, then the weight of geographic location features may be higher.

[0070] S102b: Determine the expected number of slave device groups based on prior knowledge.

[0071] In this embodiment, the central coordinator determines the expected number of slave device groups based on prior knowledge. The expected number of groups can be based on historical data, system design goals, or the needs of the current application scenario. For example, if the system designer knows that most users are distributed in a few specific areas, or based on past experience, a specific number of groups can achieve the best delay compensation effect, then this information can be used to set the expected number of groups.

[0072] S102c: Use the K-means algorithm to iteratively cluster the comprehensive features of each slave device until convergence, thereby obtaining a clustering result.

[0073] In this embodiment, the central coordinator uses the K-means algorithm to iteratively cluster the comprehensive features of each slave device until the algorithm converges, wherein the basic idea of ​​the K-means algorithm is to assign data points to K clusters, each cluster is represented by a center point (centroid). The algorithm iteratively updates the centroid of the cluster and the cluster assignment of the data point until the cluster division no longer changes.

[0074] Through iterative clustering of the K-means algorithm, the central coordinator can automatically discover the inherent structure in the data and cluster slave devices with similar comprehensive characteristics into the same group. This not only reduces the computational complexity, but also improves the accuracy of strategy matching, because slave device groups with similar characteristics can share similar delay compensation strategies, thereby reducing the system's need to adjust each device individually and improving the overall synchronization display effect and efficiency.

[0075] Specifically, step S2 includes the following steps:

[0076] S201: The central coordinator performs feature screening and fusion on the status data of all slave device groups to obtain the status features of each slave device group.

[0077] In this embodiment, the central coordinator performs in-depth analysis of the status data of all slave device groups. Specifically, it screens key indicators such as network delay, packet loss rate, bandwidth, and geographic location to identify the factors that have the greatest impact on the delay compensation strategy. Through data cleaning and feature selection technology, the central coordinator can eliminate irrelevant or redundant features and focus on those attributes that can significantly affect the efficiency and synchronization of video streaming transmission.

[0078] The central coordinator then performs feature fusion on the filtered state data to construct a comprehensive state feature vector. This fusion process also uses feature weighting to form a feature representation that can comprehensively and concisely reflect the network status and geographic location of the slave device group. The purpose of feature fusion is to integrate multiple information into a compact description to facilitate efficient subsequent strategy matching.

[0079] S202: Based on the status characteristics of each slave device group, use a preset policy library to perform policy matching on each slave device group to obtain a delay compensation policy adapted to each slave device group, wherein the policy library includes a plurality of associated delay compensation policies and status characteristic pairs.

[0080] In this embodiment, the central coordinator uses a preset policy library to perform policy matching based on the status characteristics of each slave device group, where the policy library is a database containing multiple delay compensation strategies and their applicable status characteristics. These strategies may be generated based on historical data, expert experience, or machine learning models, and aim to provide the best delay compensation solutions for slave device groups under different network conditions and geographical locations.

[0081] The central coordinator compares the status characteristics of the slave device group with the entries in the policy library to find the best matching policy instance. The matching process ensures that the delay compensation policy can accurately reflect the actual needs of the slave device group, thereby achieving efficient and accurate delay compensation.

[0082] Specifically, step S202 includes the following steps:

[0083] S202a: Perform a query using a preset policy library based on the status characteristics of each slave device group.

[0084] In this embodiment, the central coordinator uses the state characteristics of the slave device group as query parameters to search for corresponding policy instances in a preset policy library. The policy library is designed as an index database, in which each entry contains a specific state characteristic description and the corresponding delay compensation policy. When the central coordinator receives the state characteristics, it compares these characteristics with the entries in the policy library to find a policy instance that matches the current query characteristics.

[0085] S202b: Using a nearest neighbor algorithm, compare the state characteristics of each slave device group with the policy instances in the policy library to obtain the most similar policy instances matching each slave device group.

[0086] In this embodiment, in order to find the policy instance that is most similar to each slave device group, the central coordinator uses the nearest neighbor algorithm for comparison, wherein the nearest neighbor algorithm is a method based on distance measurement, which can calculate the distance between the state characteristics of the slave device group and the characteristics of each policy instance in the policy library, such as Euclidean distance or Manhattan distance. The smaller the distance, the more similar the two characteristics are, so the most similar policy instance is the one with the smallest distance.

[0087] S202c: Use the most similar policy instance as the delay compensation policy of the corresponding slave device group.

[0088] In this embodiment, once the most similar policy instance to each slave device group is found, the central coordinator determines it as the delay compensation policy of the slave device group. This means that each slave device group will obtain a personalized, match-verified delay compensation solution to adapt to its specific state characteristics.

[0089] By applying the most similar policy instances directly to the corresponding slave device groups, the system can achieve accurate delay compensation for each device group, improving the synchronization and smoothness of video streaming. This approach ensures personalized application of policies and avoids the inefficiency and resource waste that may be caused by a one-size-fits-all general policy.

[0090] Specifically, step S3 includes the following steps:

[0091] S301: Receive video stream data from a master device through a central coordinator and parse a synchronization signal.

[0092] In this embodiment, the central coordinator is responsible for receiving the video stream data from the master device. This process usually involves network transmission protocols, including but not limited to RTSP (Real-Time Streaming Protocol) or HLS (HTTP Live Streaming), to ensure the real-time and reliability of the video stream. At the same time, the central coordinator needs to parse the synchronization signals in the video stream data. These signals are embedded in the video stream in the form of specific timestamps to indicate the playback time of the video frame, which is the key information for realizing the synchronous display of multiple displays.

[0093] S302: Perform delay compensation on the video stream data using the delay compensation strategy matched by each slave device.

[0094] In this embodiment, the central coordinator uses the delay compensation strategy previously matched for each slave device group to perform delay compensation on the video stream data. Specifically, the sending time of the video frame is adjusted to compensate for the delay in network transmission and data processing of the slave device group. The delay compensation strategy may include but is not limited to adjusting the encoding parameters of the video stream, introducing additional buffering time, or modifying the sending order of the data packets to ensure that the video stream can be played synchronously when it reaches each slave device.

[0095] S303: Re-encapsulate and send the compensated video stream data.

[0096] In this embodiment, the central coordinator re-encapsulates the compensated video stream data, specifically, divides the video stream into smaller data packets, or re-arranges the data packets to meet the needs of network transmission. The re-encapsulated video stream data will be sent to each slave device group. This process needs to consider network congestion control and error detection mechanisms to ensure that the data packets can reliably reach the destination.

[0097] Specifically, step S4 includes the following steps:

[0098] S401: Decoding the compensated video stream data through the decoder of each slave device to obtain a displayable video frame.

[0099] In this embodiment, after receiving the delay-compensated video stream data sent by the central coordinator, each slave device sends the data to the decoder for decoding. The decoder is responsible for converting the compressed video stream into a series of displayable video frames, including decoding video encoding formats such as H.264, H.265 or VP9, ​​and audio encoding formats such as AAC or Opus. The decoder needs to quickly and accurately parse the encoding information in the video stream and restore the original image and sound data.

[0100] S402: Time-aligning the decoded video frames based on the synchronization signal included in the video stream data.

[0101] In this embodiment, the slave device performs time alignment on the decoded video frames according to the synchronization signal contained in the video stream data. The synchronization signal is usually embedded in the video stream in the form of a timestamp to indicate the correct playback time of the video frame. The slave device needs to adjust the playback order and time point of the video frame according to these timestamps to ensure that the playback time of the video frame is consistent with the synchronization time set by the central coordinator.

[0102] S403: Using the display hardware of each slave device to display and output the time-aligned video frames, so as to achieve visual synchronization among multiple displays.

[0103] In this embodiment, the slave device sends the time-aligned video frames to display hardware, such as LCD, OLED or projector, for actual video content display. The display hardware converts the video frames into visible image signals according to the instructions of the slave device and presents them to the audience. In order to ensure the smoothness and visual effect of video playback, the display hardware needs to have sufficient refresh rate and response speed.

[0104] The working principle of a multi-display synchronous display method provided by the present invention is as follows:

[0105] First, the central coordinator monitors the status data of all slave devices in real time, including but not limited to network delay, device load, display performance, etc., and dynamically groups all slave devices according to the similarity between these status data. This dynamic grouping strategy can flexibly respond to changes in device status and ensure that slave devices in the same group are relatively close in hardware performance and network conditions, providing a basis for subsequent delay compensation.

[0106] Secondly, the delay compensation strategy based on prior information: The central coordinator matches the corresponding delay compensation strategy from the preset strategy library according to the status data of the slave device group. The strategy library is generated based on a large amount of prior information learning and contains optimized compensation schemes for different device states and network conditions. This data-driven strategy matching method can significantly improve the accuracy and efficiency of delay compensation.

[0107] Next, dynamic compensation of video stream data: After receiving the video stream data from the master device, the central coordinator will dynamically compensate the video stream data according to the delay compensation strategy matched by each slave device. This compensation method not only takes into account the inherent delay differences between devices, but also takes into account the impact of real-time state changes on delay, thereby achieving high-precision synchronous display of video stream data on each slave device.

[0108] Finally, precise control of synchronization signals: After receiving the video stream data compensated by the central coordinator, each slave device will decode it and display it synchronously according to the synchronization signal contained in the video stream data. Since the video stream data has been accurately delayed compensated, each slave device can achieve synchronous display with almost no delay difference, greatly improving the user experience and the accuracy of information transmission.

[0109] Embodiment 2

[0110] The present invention also provides a multi-display synchronous display system for executing the multi-display synchronous display method, comprising a central coordinator, a master device and at least one slave device, referring to Figure 2 As shown, the display system comprises:

[0111] The grouping module 100 is used to monitor the status data of all slave devices in real time through the central coordinator, and dynamically group all slave devices based on the similarity between the status data to obtain at least one slave device group.

[0112] The strategy matching module 200 is used to match corresponding delay compensation strategies from a preset strategy library through a central coordinator according to the status data of different slave device groups, wherein the strategy library is generated based on prior information learning.

[0113] The video stream compensation module 300 is used for the central coordinator to receive the video stream data from the master device and compensate the video stream data according to the delay compensation strategy matched by each slave device to compensate for the delay of each slave device.

[0114] The synchronous display module 400 is used for each slave device to correspondingly receive the video stream data compensated by the central coordinator, and decode the compensated video stream data to perform synchronous display of each slave device according to the synchronization signal contained in the video stream data.

[0115] The present application is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0116] A person skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0117] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

Claims

1. A multi-display synchronous display method, comprising a central coordinator, a master device and at least one slave device, characterized in that: The display method comprises the following steps: S1: monitoring the status data of all slave devices in real time through the central coordinator, and dynamically grouping all slave devices based on the similarity between the status data to obtain at least one slave device group; S2: According to the status data of different slave device groups, a corresponding delay compensation strategy is matched from a preset strategy library through a central coordinator, wherein the strategy library is generated based on prior information learning; S3: The central coordinator receives the video stream data from the master device, and compensates the video stream data according to the delay compensation strategy matched by each slave device to compensate for the delay of each slave device; S4: Each slave device correspondingly receives the video stream data compensated by the central coordinator, and decodes the compensated video stream data, so as to perform synchronous display of each slave device according to the synchronization signal contained in the video stream data; The status data includes the network status and geographic location of the slave device; Step S1 includes the following steps: S101: monitoring the network status and geographical location of all slave devices in real time through the central coordinator to obtain status data of the slave devices in real time; S102: Perform cluster analysis on the status data of all slave devices using a K-means clustering algorithm to obtain a clustering result; S103: Based on the clustering result, dynamically group all slave devices to obtain at least one slave device group; Step S102 includes the following steps: S102a: normalizing the network status and geographic location of all slave devices, and performing feature fusion on the normalized network status and geographic location to obtain a comprehensive feature; S102b: Determine the expected number of slave device groups based on prior knowledge; S102c: Use the K-means algorithm to iteratively cluster the comprehensive features of each slave device until convergence, thereby obtaining a clustering result.

2. A multi-display synchronous display method according to claim 1, characterized in that: Step S2 includes the following steps: S201: The central coordinator performs feature screening and fusion on the status data of all slave device groups to obtain the status features of each slave device group; S202: Based on the status characteristics of each slave device group, use a preset policy library to perform policy matching on each slave device group to obtain a delay compensation policy adapted to each slave device group, wherein the policy library includes a plurality of associated delay compensation policies and status characteristic pairs.

3. A multi-display synchronous display method according to claim 2, characterized in that: Step S202 includes the following steps: S202a: querying using a preset policy library based on the status characteristics of each slave device group; S202b: using a nearest neighbor algorithm to compare the state characteristics of each slave device group with the policy instances in the policy library, and obtaining the most similar policy instances matching each slave device group; S202c: Use the most similar policy instance as the delay compensation policy of the corresponding slave device group.

4. A multi-display synchronous display method according to claim 3, characterized in that: Step S3 includes the following steps: S301: receiving video stream data from a master device through a central coordinator and parsing a synchronization signal; S302: Performing delay compensation on the video stream data using the delay compensation strategy matched by each slave device; S303: Re-encapsulate and send the compensated video stream data.

5. A multi-display synchronous display method according to claim 4, characterized in that: Step S4 includes the following steps: S401: decoding the compensated video stream data through the decoder of each slave device to obtain a displayable video frame; S402: Time-aligning the decoded video frames based on the synchronization signal included in the video stream data; S403: Using the display hardware of each slave device to display and output the time-aligned video frames, so as to achieve visual synchronization among multiple displays.

Citation Information

Patent Citations

  • Sending card grouping control method of display system, sending card and display control system

    CN111462674A

  • The multi-media streaming method and system of anetwork adaptation live broadcasting for packetfiltering

    KR1020060030879A