Multi-screen interactive display content synchronization method and system
By acquiring the timestamps and point-to-point path transmission strategies of the LED display screen, the source node is dynamically identified and guided, achieving precise alignment of multi-screen display content. This solves the problems of timing consistency and low synchronization response efficiency in traditional multi-screen synchronous display technology, thus improving the display effect.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HUIZHOU XINGCHEN VISUAL DISPLAY TECHNOLOGY CO LTD
- Filing Date
- 2026-03-10
- Publication Date
- 2026-06-05
AI Technical Summary
Traditional multi-screen synchronous display technology struggles to meet dynamic synchronization requirements in complex network environments, and its timing consistency control precision is limited, resulting in screen tearing and low interactive response efficiency.
By acquiring the timestamps of each display screen in the LED interactive broadcast control network, the source node is dynamically identified, and the refresh time interval of each node is calculated and adjusted in conjunction with the point-to-point path transmission strategy, so as to achieve precise alignment and synchronization of multi-screen display content.
It significantly improves the timing consistency and synchronization accuracy of multi-screen displays, overcoming the problems of frame errors and control lag caused by physical link latency fluctuations and uneven content distribution.
Smart Images

Figure CN122152257A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of multi-screen synchronous display technology, and in particular to a method and system for synchronizing multi-screen interactive display content. Background Technology
[0002] Multi-screen synchronous display technology involves achieving synchronized presentation of image or video content across multiple display devices. This includes data distribution control, timing consistency assurance, signal synchronization processing, and coordinated driving of multiple display devices. Typically, a master control system is established to uniformly schedule and push content to multiple display terminals. Synchronous control protocols or clock synchronization mechanisms are used to achieve time consistency and image continuity of the displayed content, ensuring collaborative display effects across multiple screens. Traditional LED display multi-screen interactive content synchronization methods refer to a method for achieving collaborative content display across multiple LED displays. This typically involves constructing a master-slave display structure through physical connections. Data transmission mechanisms between sending and receiving cards are used to transmit display content in segments to different display units, which are then spliced together using frame-by-frame or line-by-line scanning. Alternatively, a control computer can synchronously control the playback content of multiple display terminals through multi-channel video output. This process relies on fixed video transmission interfaces for data copying and delay calibration to achieve synchronization.
[0003] Traditional multi-screen synchronous display technology relies on physical connections to establish a master-slave structure when realizing collaborative display between multiple LED displays. The information distribution process is fixed on the data path between the sending card and the receiving card, which makes the transmission of display content inflexible and highly dependent on the interface. The system is difficult to adapt to dynamic synchronization requirements in complex network environments. In addition, its synchronization process is mainly based on the delay calibration and content copying of the video transmission interface, which leads to limited timing consistency control accuracy. The displayed content often has inter-frame differences or screen tearing, which affects the visual continuity and interactive response efficiency between multiple screens and cannot effectively meet the precise synchronization control requirements under multi-node collaborative driving conditions. Summary of the Invention
[0004] The purpose of this invention is to address the shortcomings of existing technologies by proposing a method for synchronizing multi-screen interactive display content.
[0005] To achieve the above objectives, the present invention adopts the following technical solution: a method for synchronizing multi-screen interactive display content, comprising the following steps: S1: Obtain the numbers of all LED displays in the LED interactive broadcast control network, monitor the local timestamp of the start signal received by each LED display, and match it with the display number to obtain a time stamp sequence table; S2: Based on all timestamps in the time stamp sequence table, extract the LED display number corresponding to the earliest timestamp item as the guiding source node, record the current cached frame number, synchronization flag and timestamp information of the guiding source node, and construct a synchronization instruction data frame; S3: Based on the information recorded by the guiding source node in the synchronization instruction data frame, instructions are issued sequentially and the reception time of each node to the synchronization instruction is recorded. The time interval between the reception time and the timestamp of the guiding source node is calculated. The node number and the time interval duration are combined to obtain the node time sequence table. S4: Based on the node time sequence table, align the time interval data of each node with the local frame refresh cycle, delay the start time of content display, inject the delayed refresh command into each node, record the set of node numbers that have completed the injection action, and obtain the refresh control command list. S5: Based on the refresh control command list, receive feedback response signals after all LED displays synchronously execute refresh actions, count whether each node has completed the refresh start action, filter out abnormal nodes that do not respond, form a network linkage status confirmation record, and obtain the multi-screen interactive display content synchronization result.
[0006] As a further embodiment of the present invention, the time stamp sequence table includes a guide source node number, a local receiving timestamp, and a display screen number correspondence; the synchronization instruction data frame includes a guide source node cache frame number, a synchronization flag, and a guide timestamp; the node time sequence table includes each node number, the time interval between the node and the guide source node, and the instruction receiving time; the refresh control instruction list includes a delay processing instruction, each node display control module number, and a set of completed injection nodes; and the multi-screen interactive display content synchronization result includes an abnormal node number, response status statistics, and network linkage status confirmation records.
[0007] As a further aspect of the present invention, the step of obtaining the time stamp sequence table specifically includes: S111: Obtain all LED display screen numbers in the LED interactive broadcast control network, extract the node information of each LED display screen, filter out non-display screen device numbers, mark all valid numbers as data monitoring target numbers, and generate a set of display screen numbers; S112: Read the synchronization start signal broadcast by the master control node, locate the flag field in the received broadcast content, identify the synchronization signal excitation time, and monitor the timestamp of each LED display receiving the synchronization start signal in sequence with the display number set. Establish an index mapping between the timestamp and the corresponding number to generate a timestamp number corresponding list. S113: Based on the timestamp number correspondence list, reorganize each group of numbers and corresponding timestamps into key-value pairs according to the display number order, verify the data structure consistency of all key-value pairs timestamp fields, aggregate them into a single data sequence, and generate a time stamp sequence table.
[0008] As a further aspect of the present invention, the step of acquiring the synchronization instruction data frame specifically comprises: S211: Based on the time stamp sequence table, extract all timestamp fields and establish a numerical sequence. Sort the data in ascending order according to the time sequence. Locate the number index corresponding to the first timestamp after sorting. Extract the corresponding LED display number as the unique target number and generate the guiding source node number. S212: Based on the guide source node number, obtain the current cache register content of the corresponding LED display screen, read the current cache frame number and confirm the data bit format, extract the current synchronization flag bit, extract the original index of the guide source node number in the time stamp sequence table, record the corresponding timestamp, and integrate the three items to generate a guide node status field group. S213: Based on the state field group of the guiding node, construct a data frame format with a fixed field arrangement structure, and embed the three fields of cache frame number, synchronization flag and timestamp in sequence to generate a synchronization instruction data frame.
[0009] As a further aspect of the present invention, the step of obtaining the node time series table specifically includes: S311: Obtain the guiding source node number and corresponding timestamp in the synchronization instruction data frame, and send instruction frames sequentially from the guiding source node to each downstream node in the network according to the preset point-to-point transmission path in the LED interactive network, monitor the communication interface reception time of each node, and generate a node reception time record table. S312: Based on the node receiving time record table, for each receiving time record, perform a numerical subtraction operation with the timestamp of the guiding source node to construct a mapping structure between node number and time interval, and generate a node time interval mapping table; S313: Based on the node time interval mapping table, extract the node number and time interval of all mapping entries, perform row-wise aggregation sorting on each node number and its corresponding time interval, combine them into a unified two-dimensional structure, and generate a node time sequence table.
[0010] As a further aspect of the present invention, the step of obtaining the refresh control command list specifically comprises: S411: Obtain the time interval of each node in the node time series table, extract the local frame refresh period and perform period normalization processing, determine whether the node time interval is less than the frame refresh period, if not, perform division operation and round up to obtain the delay frame period multiple, and generate a frame delay multiple dictionary. S412: Based on the frame delay multiple dictionary, for each node number, combined with the local frame refresh cycle, the node corresponding time interval and the preset synchronization tolerance threshold, calculate the required insertion delay time for each node, determine the control signal insertion time point, construct the insertion control instruction data frame, and establish a refresh instruction data frame set. S413: Based on the refresh instruction data frame set, inject it into each node in sequence, record the node number that successfully receives and completes instruction loading, verify the uniqueness of the node number structure and remove redundant numbers to obtain the refresh control instruction list.
[0011] As a further aspect of the present invention, the formula for calculating the insertion delay time is as follows: ; in, The insertion time represents the refresh start signal delay for node n. This represents the time interval between node n and the guiding source node. Represents the local frame refresh cycle. The synchronization tolerance threshold is represented by the symbol. This indicates rounding up to the nearest integer.
[0012] As a further aspect of the present invention, the step of obtaining the synchronization result of multi-screen interactive display content specifically includes: S511: Obtain all node numbers in the refresh control instruction list, monitor the feedback response signals returned by each node in the LED interactive network after receiving the instruction, extract the node number field in the response signal and perform format matching verification, filter out incomplete fields, and generate a set of feedback response nodes. S512: Based on the set of feedback response nodes, retrieve all node numbers in the refresh control instruction list, extract missing node numbers, and use the refresh execution status field in the local control log to filter node numbers whose refresh status is marked as abnormal, and generate an abnormal node identifier list. S513: Based on the list of abnormal node identifiers and the set of feedback response nodes, mark the refresh result status of all responded and unresponded nodes, aggregate all node numbers and corresponding refresh statuses, and obtain the synchronization result of multi-screen interactive display content.
[0013] A multi-screen interactive content synchronization system includes: The time stamp recording module is used to perform S1: obtain the numbers of all LED displays in the LED interactive broadcast control network, monitor the local timestamp of each LED display for the start signal, and match it with the display number to obtain a time stamp sequence list; The instruction frame generation module is used to execute S2: based on all timestamps in the time stamp sequence table, extract the LED display number corresponding to the earliest timestamp item as the guiding source node, record the current cache frame number, synchronization flag bit and timestamp information of the guiding source node, and construct a synchronization instruction data frame; The path time identification module is used to execute S3: according to the information recorded by the guiding source node in the synchronization instruction data frame, it sequentially issues instructions and records the reception time of each node to the synchronization instruction, calculates the time interval between the reception time and the timestamp of the guiding source node, and combines the node number and the time interval duration to obtain the node time sequence table. The refresh control adjustment module is used to execute S4: based on the node time sequence table, the time interval data of each node is time-aligned with the local frame refresh cycle, the start time of content display is delayed, the refresh command after delay processing is injected into each node, the set of node numbers that have completed the injection action is recorded, and a refresh control command list is obtained. The synchronization status confirmation module is used to execute S5: based on the refresh control instruction list, receive feedback response signals after all LED displays have synchronously executed refresh actions, count whether each node has completed the refresh start action, filter out abnormal nodes that have not responded, form a network linkage status confirmation record, and obtain the synchronization result of multi-screen interactive display content.
[0014] Compared with the prior art, the advantages and positive effects of the present invention are as follows: In this invention, the timestamps of the locally received start signals of each node are extracted in real time and paired with numbers to construct a time stamp sequence. The node with the earliest time is dynamically identified as the guiding source to establish a synchronization command frame. Then, the response time of each node is recorded and the time interval with the guiding source is calculated in combination with the point-to-point path transmission strategy to complete the dynamic generation of the multi-node time sequence, achieving precise alignment with their respective refresh cycles. The refresh start time is controlled by delay injection and the response status is summarized to ensure that all nodes in the network work together to complete the content refresh action. This significantly improves the timing consistency and accuracy of synchronous response of multi-screen display under complex topology structures, and effectively overcomes the problems of frame errors and control lag caused by physical link delay fluctuations and uneven content distribution. Attached Figure Description
[0015] Figure 1 This is a flowchart of the main steps of the present invention; Figure 2 This is a flowchart of the time stamp sequence table acquisition process of the present invention; Figure 3 This is a flowchart of the synchronization instruction data frame acquisition process of the present invention; Figure 4 This is a flowchart of the process for obtaining the node time series table in this invention; Figure 5This is a flowchart illustrating the process of obtaining the refresh control command list in this invention. Figure 6 This is a flowchart of the process for obtaining the synchronization results of multi-screen interactive display content in this invention. Detailed Implementation
[0016] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.
[0017] In the description of this invention, it should be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships, are based on the orientation or positional relationships shown in the accompanying drawings and are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, in the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.
[0018] Please see Figure 1 A method for synchronizing content displayed on multiple screens includes the following steps: S1: Obtain the numbers of all LED displays in the LED interactive broadcast control network, read the broadcast synchronization start signal of the main control node, monitor the local timestamp of each LED display for the start signal, and match it with the display number to obtain a time stamp sequence table; S2: Based on all timestamps in the time stamp sequence list, extract the LED display number corresponding to the earliest timestamp item as the guide source node, record the current cached frame number, synchronization flag and timestamp information of the guide source node, and construct the synchronization instruction data frame. S3: Based on the information recorded by the guiding source node in the synchronization instruction data frame, instruction frames are sequentially sent out according to the point-to-point transmission path in the LED interactive network. The reception time of each node to the synchronization instruction is recorded, and the time interval between the reception time and the timestamp of the guiding source node is calculated. The node time sequence table is obtained by combining the node number and the time interval duration. S4: Based on the time interval data of each node in the node time sequence table, time alignment is performed with the local frame refresh cycle. The start time of content display is delayed by inserting a refresh start control signal. The delayed refresh command is injected into the display control module of each node, and the set of node numbers that have completed the injection action is recorded to obtain the refresh control command list. S5: Based on the refresh control command list, receive feedback response signals after all LED displays synchronously execute refresh actions, count whether each node has completed the refresh start action, filter out abnormal nodes that do not respond, form a network linkage status confirmation record, and obtain the synchronization result of multi-screen interactive display content.
[0019] The time stamp sequence table includes the source node number, local received timestamp, and display screen number correspondence. The synchronization instruction data frame includes the source node buffer frame number, synchronization flag, and guide timestamp. The node time sequence table includes each node number, the time interval between the node and the source node, and the instruction reception time. The refresh control instruction list includes delay processing instructions, each node display control module number, and the completed injection node set. The multi-screen interactive display content synchronization result includes the abnormal node number, response status statistics, and network linkage status confirmation record.
[0020] Please see Figure 2 Step S1 is as follows: S111: Obtain all LED display screen numbers in the LED interactive broadcast control network, extract the node information of each LED display screen, filter out non-display screen device numbers, mark all valid numbers as data monitoring target numbers, and generate a set of display screen numbers; The system initiates device polling requests to all online terminals within the LED interactive broadcast control network via the underlying RS-485 industrial bus or Gigabit Ethernet interface, sending hexadecimal command code 0xA5 and setting the response timeout threshold to 200 milliseconds. Simultaneously, the network topology view is initialized on the main control terminal's human-machine interface (GUI), displaying a real-time device scanning progress bar and network connection status icons for intuitive monitoring of the polling process. The system receives device descriptor data packets from each terminal, parses the first 16 bytes of the packet header, and extracts the unique device identifier and device type. It iterates through all extracted device type fields, comparing them with a pre-defined device type definition table. This table specifies that hexadecimal values 0x01 represent LED display panels, 0x02 represent light effect controllers, and 0x03 represent environmental sensors. Logical filtering is performed, retaining records with a device type field value of 0x01. The identified display nodes are then illuminated in a ready state on the interactive interface, allowing users to view detailed attributes of each node. The unique device identifier is then extracted from the corresponding record. For each extracted LED display screen number, its current physical connection port number and cascade level index are obtained by sending a status query command 0x04. The number, port number, and level index are combined into a node information tuple. The check bit of each number (usually the last bit) is checked, and integrity verification is performed using the CRC-16 algorithm. Numbers that fail the check or whose format length does not conform to the 12-bit standard encoding are discarded. If a check fails, a highlighted warning message will pop up in the operation and maintenance log window, and manual inspection of the corresponding line is recommended. All device numbers that pass the verification and are confirmed to be display screens are stored in a dynamic array according to the physical connection topology (from the main control output port to the end). This array is ultimately established as the set of display screen numbers, serving as the basic addressing target for subsequent synchronous control.
[0021] S112: Read the synchronization start signal broadcast by the master control node, locate the flag field in the received broadcast content, identify the synchronization signal excitation time, and monitor the timestamp of each LED display receiving the synchronization start signal in turn by combining the display number set, establish an index mapping between the timestamp and the corresponding number, and generate a list of timestamp number correspondences. The system monitors the master node's broadcast synchronization messages via a precise time protocol. These messages are sent periodically at a frequency of 10 times per second. The indicator lights on the interactive interface flash dynamically according to the message reception frequency, representing the health of the heartbeat signal. In the received binary data stream, a sliding window algorithm is used to retrieve the specific synchronization frame header sequence 0xFFFFAA55. Once the frame header is located, the following 8 bytes of payload content are read, and the 64-bit nanosecond-level transmission timestamp is extracted and identified as the synchronization signal activation time. Using this activation time as the trigger point, a local high-precision hardware timer (accuracy better than 1 microsecond) is immediately started. Combining this with the generated set of LED display screen numbers, each LED display node in the set is polled sequentially, and the local latch time value recorded in the physical layer (PHY) register of each node's network interface card at the moment the synchronization message was received is read. The read local latch time value is converted into a unified Unix timestamp format (accurate to 6 decimal places) and paired with the corresponding LED display screen number. A hash mapping table is allocated in memory, with the LED display screen number as the key and the corresponding received timestamp as the value. The mapping relationship is written record by record. During this process, the response latency curves of each node are calculated in real time and plotted as waveforms on the dashboard to visually demonstrate the stability of time synchronization. If a node fails to return a valid timestamp within three consecutive broadcast cycles, its timestamp field is marked as NULL in the mapping table, and a red "Signal Loss" warning is overlaid on the corresponding node icon in the interactive interface. After traversing and recording all nodes, a list containing all key-value pairs and their corresponding timestamp numbers is output to quantify the transmission latency differences between each display screen node on the physical link.
[0022] S113: Based on the timestamp number corresponding list, reorganize each group of numbers and corresponding timestamps into key-value pairs according to the display number order, verify the data structure consistency of the timestamp fields of all key-value pairs, aggregate them into a single data sequence, and generate a time stamp sequence table; Load the timestamp number mapping list from memory and initiate the data cleaning and reorganization process. Following the physical topology order of the display screen number set (i.e., port numbers from smallest to largest, hierarchical index from lowest to highest), extract the corresponding number and timestamp key-value pairs sequentially from the list. Perform a data structure compliance scan on each key-value pair, checking if the timestamp field is double-precision floating-point data and that the value must be greater than the current startup time and less than the current real-time time. Simultaneously verify if the number field conforms to the ASCII encoding standard. If an entry with a NULL timestamp or abnormal data type is found, initiate an interpolation repair mechanism, taking the arithmetic mean of the timestamps of the two physically adjacent normal nodes as a replacement value and automatically generating a data repair record in the operation log for administrator review; if interpolation is not possible, the entry is directly removed. While performing data cleaning, provide the user with feedback on the data integrity percentage through a progress panel and provide a preview function for the cleaning report after completion. Repackage all verified and repaired key-value pairs into a standardized JSON object array according to physical order. Each element in this array contains two fields: "DeviceID" and "RecvTimestamp". Finally, the cleaned ordered arrays are aggregated and locked into immutable serialized binary data blocks to generate a time-stamped sequence table, providing cleaned high-confidence data support for subsequent determination of the bootstrap source.
[0023] Please see Figure 3 Step S2 is as follows: S211: Based on the time stamp sequence table, extract all timestamp fields and establish a numerical sequence. Sort the data in ascending order according to the time sequence. Locate the number index corresponding to the first timestamp after sorting. Extract the corresponding LED display number as the unique target number and generate the guide source node number. Read the binary data blocks from the timestamp sequence table and deserialize them into an object array. Traverse the array, extract all RecvTimestamp field values, and construct a temporary numerical vector. Perform a quicksort algorithm on this vector, sorting it in ascending order of numerical value, i.e., the smallest time value (earliest received signal) is placed first, and the largest time value is placed last. After sorting, directly locate the first element at index 0 in the vector. This element represents the timestamp of the node with the lowest transmission latency and fastest response speed in the network. Based on this first timestamp, reverse the index back to the original object array to find the LED display number that exactly matches this timestamp. Automatically lock the physical device corresponding to this number on the topology map and highlight it as the "primary boot source." At the same time, a pop-up window asks the operator whether to confirm the automatic selection result, allowing the operator to manually specify other candidate nodes as backup boot sources through a drop-down menu in special scenarios (such as physical damage to the screen). Confirm the uniqueness of this number in the current network topology and define it as the reference benchmark for network-wide synchronization. Extract the specific value of this number (e.g., "LED_N001") and solidify it as the boot source node number. The device represented by this number is usually the display screen that is physically closest to the main controller or has the best signal quality. All subsequent synchronization operations will be aligned with the status of this device.
[0024] S212: Based on the boot source node number, obtain the current cache register content of the corresponding LED display screen, read the current cache frame number and confirm the data bit format, extract the current synchronization flag, extract the original index of the boot source node number in the time stamp sequence table, record the corresponding timestamp, and integrate the three items to generate the boot node status field group. Using the determined boot source node number, the memory controller of the specific LED display is accessed via unicast instructions. Its internal frame buffer register is directly read to obtain the sequence number of the image frame currently waiting to be displayed. To enhance the interactive experience, the console will synchronously capture a thumbnail of the buffered frame data and display the current screen content of the boot source in real time in the monitor window, allowing technicians to verify the correctness of the screen source. The header descriptor of the buffered frame data is read to confirm that the total bit width of the data is 24 bits (RGB888 format) or 32 bits (RGBA8888 format) to ensure alignment of subsequent data bit operations. The 7th bit in the register status word is extracted as a synchronization flag; a value of 1 indicates that the current frame is ready, and a value of 0 indicates that writing is in progress. Simultaneously, the original row index value (i.e., physical topology location) of the boot source node number is retrieved from the time stamp sequence table generated in S113. The current buffer frame number (e.g., 1024), the extracted synchronization flag (e.g., 1), and the original receive timestamp recorded by the node in the timestamp sequence table (e.g., 1678888888.123456) are packaged together. These three pieces of data are closely arranged to generate a bootstrap node status field group, which fully describes the runtime snapshot of the reference source at a specific moment.
[0025] S213: Based on the boot node status field group, construct a data frame format with a fixed field arrangement structure, and embed the three fields of cache frame number, synchronization flag and timestamp in sequence to generate a synchronization instruction data frame; Based on the contents of the bootstrap node status field group, a binary data frame conforming to a custom communication protocol is constructed. First, the frame header is defined as 0xAA55, and the frame trailer as 0x55AA. After the frame header, 4 bytes are allocated to store the buffered frame number, arranged in big-endian order. Immediately following, 1 byte is allocated to store the synchronization flag. Next, 8 bytes are allocated to store the double-precision floating-point timestamp data. After these three fields are filled, the sum of all bytes from the frame header to the timestamp field is calculated, generating a 2-byte checksum which is appended to the timestamp. Finally, the frame trailer is added. The total length of the entire data packet is fixed at 19 bytes (2 bytes header + 4 bytes frame number + 1 byte flag + 8 bytes timestamp + 2 bytes checksum + 2 bytes trailer). At this point, the communication debugging window will display the constructed data frame content in hexadecimal format, facilitating protocol-level analysis and debugging for developers. The encapsulated binary stream is defined as a synchronization command data frame. This data frame will serve as the "command stick" for network-wide synchronization, carrying the absolute spatiotemporal information of the reference source, ready to be sent to other subordinate nodes in the network.
[0026] Please see Figure 4 Step S3 is as follows: S311: Obtain the source node number and corresponding timestamp in the synchronization instruction data frame, and send instruction frames sequentially from the source node to each downstream node in the network according to the preset point-to-point transmission path in the LED interactive network. Monitor the communication interface reception time of each node and generate a node reception time record table. Read the source node number (e.g., LED_01) and its reception timestamp (e.g., 100.00ms) from the synchronization command data frame. Based on the network topology, determine the data flow path starting from LED_01. This path is typically a daisy chain or a tree structure. Along the preset path, forward the synchronization command data frame sequentially to each downstream slave node (LED_02, LED_03...) in the network. During forwarding, the link connections in the GUI interface will generate flowing light effects according to the data flow direction, visually demonstrating the propagation trajectory of the command in the network. Deploy a hardware interrupt service routine at the network interface controller of each downstream node. When the frame end byte 0x55AA of the command frame is detected, immediately trigger hardware latching to record the local time at that moment. This time is the reception time of each node. Record each node's number and its corresponding reception time in pairs and store them in high-speed SRAM, forming a node reception time record table containing communication delay data for all slave nodes in the entire network.
[0027] Please refer to Table 1, which lists the reception time records of some nodes. The data is exported in spreadsheet format for engineers to perform offline analysis.
[0028] Table 1. Node Reception Time Record Table (Partial) As shown in Table 1, the local reception time increases with the increase of node number (the topological distance becomes longer), indicating the existence of network transmission delay.
[0029] S312: Based on the node receiving time record table, for each receiving time record, perform a value subtraction operation with the timestamp of the guiding source node to construct a mapping structure between node number and time interval, and generate a node time interval mapping table; Iterate through each record in the node reception time record table. For any node n, extract its local reception time (e.g., 100.035ms) and the timestamp of the bootstrap source stored in the record table (e.g., 100.000ms). Perform a numerical subtraction operation to calculate the transmission time lag of the node relative to the bootstrap source. For example, for LED_02, 100.035 - 100.000 = 0.035ms (i.e., 35 microseconds). If the calculation result is negative, it indicates that the network clock is not synchronized, and an error should be marked and an alarm should be triggered. A buzzer alarm will be triggered immediately, and a modal dialog box "Clock Severely Out of Synchronization" will pop up on the main interface, prompting the user to check the PTP service status. Establish a one-to-one mapping relationship between the calculated time interval and the corresponding node number n, store it in a hash structure, generate a node time interval mapping table, and quantify the degree of "lateness" of each node relative to the reference source at the physical transmission level.
[0030] S313: Based on the node time interval mapping table, extract the node number and time interval of all mapping entries, perform row-wise aggregation sorting on each node number and its corresponding time interval, combine them into a unified two-dimensional structure, and generate a node time series table. Read all key-value pairs stored in the node time interval mapping table. Export the data as a two-dimensional matrix structure, where the first column is the node number and the second column is the corresponding transmission time interval. Sort the two-dimensional matrix row-wise according to the node number value or the preset physical installation coordinate order, ensuring that the data is arranged according to the physical splicing order of the display screen. The sorted matrix structure can intuitively reflect the signal transmission delay distribution gradient in physical space. Check the matrix for duplicate node numbers or abnormally large time interval values (such as exceeding 1 second) and eliminate outliers. After confirming that there are no errors, solidify the sorted two-dimensional matrix to generate a node time series table. Generate a "delay heatmap" based on this list, using color gradations (such as from green to red) to overlay on the screen layout map, allowing users to clearly observe the high-latency areas at the end of the network. This will serve as the core input data for subsequent calculation of frame delay compensation strategies, ensuring that the delay of each screen can be indexed and processed individually.
[0031] Please see Figure 5 Step S4 is as follows: S411: Obtain the time interval of each node in the node time series table, extract the local frame refresh period and perform period normalization processing, determine whether the node time interval is less than the frame refresh period, if not, perform division operation and round up to obtain the delay frame period multiple, and generate a frame delay multiple dictionary. Extract the time interval (e.g., 35ms) of a specific node n from the node time series table. Read the EDID information of that node to obtain its local frame refresh cycle. For example, if the screen refresh rate is 60Hz, the value is 16.666ms. Perform cycle normalization processing, i.e., calculate the ratio of the time interval to the local frame refresh cycle. Determine if the time interval is less than the local frame refresh cycle. In this example, 35ms > 16.666ms, which does not meet the condition. Perform a division operation and round up the result to obtain an integer 3. This means that the signal transmission time has spanned two complete frame cycles and entered the third cycle. Define this integer 3 as the delay frame cycle multiple K. If the time interval < the local frame refresh cycle, then K = 1. Store the node number and the calculated K value into a dictionary structure to generate a frame delay multiple dictionary. The contents of this dictionary can be queried in the debugging interface. Users can enter the node ID and immediately return its calculated delay cycle multiple to assist in on-site optimization. This dictionary specifies how many frame cycles each node needs to wait to ensure it "catches up" with and surpasses the current transmission delay on the timeline, thus aligning with a future frame synchronization point.
[0032] S412: Based on the frame delay multiplier dictionary, for each node number, combined with the local frame refresh cycle, the corresponding time interval of the node, and the preset synchronization tolerance threshold, the following formula is used: ; Calculate the required insertion delay time for each node, determine the control signal insertion time point, construct the insertion control command data frame, and establish a refresh command data frame set; among which, The insertion time represents the refresh start signal delay for node n. This represents the time interval between node n and the guiding source node. Represents the local frame refresh cycle. The synchronization tolerance threshold is represented by the symbol. Indicates rounding up; Load the frame latency multiplier dictionary. For each node n to be synchronized, retrieve its local frame refresh cycle (value 16.666ms), the latency between the node and the boot source (value 5.2ms, this example is different from the previous high latency scenario, simulating short-distance microsecond-level latency), and the preset synchronization tolerance threshold. .
[0033] The synchronization tolerance threshold θ is set based on the human eye's perception limit of motion image tearing. A visual adjustment slider is provided in the settings options, allowing advanced technicians to fine-tune θ in real time within the range of 0ms to 1ms, and to make empirical corrections based on the synchronization effect of the test screen. Experimental data shows that when the display time difference between adjacent screens exceeds 100 microseconds, noticeable misalignment occurs in high-speed motion images. Considering hardware processing jitter, θ is set to 0.1ms (i.e., 100 microseconds). This value range is typically between 0.05ms and 0.5ms, which can cover hardware jitter while meeting visual synchronization requirements.
[0034] The refresh start signal delay insertion time of node n is calculated using the formula. : Assume the transmission time interval of a certain node n ms, local frame refresh cycle ms, synchronization tolerance threshold ms. Substitute the above values into the formula and perform the calculation step by step: The first step is to calculate the period multiple factor that includes tolerance: ; The second step is to perform an up-rounding operation to determine the target frame period: ; The third step is to calculate the final refresh start signal delay insertion time. : ; Verification of calculation results: The result is exactly equal to Proof of the process After ms of insertion delay compensation, the actual action time of this node will be strictly aligned to the ms after the guiding source signal is emitted. The time interval is set to ms (i.e., the start point of the next complete frame), thereby eliminating transmission time difference.
[0035] Calculated =11.4ms. This means that after receiving the signal (at which point 5.2ms have passed), the node does not need to refresh immediately, but is forced to wait for 11.4ms by the controller.
[0036] The results show that, after insertion delay control, the actual refresh action of this node will occur precisely at 16.6 ms after the guiding source signal is emitted (i.e., the start of the next complete frame). In this way, regardless of the transmission delay time interval of each node, the refresh action will occur precisely at the time calculated by each node. After compensation, the final action time of all nodes will fall at an integer multiple of the local frame refresh cycle, thus achieving physical synchronous refresh.
[0037] S413: Based on the refresh instruction data frame set, inject it into each node in sequence, record the node number that successfully receives and completes instruction loading, verify the uniqueness of the node number structure and remove redundant numbers to obtain the refresh control instruction list. Specific instructions from the refresh instruction data frame set are injected into the corresponding node controller via network broadcast or multicast. Pressing the "Synchronous Execution" button on the console displays a loading animation, providing real-time feedback on the instruction injection progress percentage. Utilizing the parallel processing capabilities of the FPGA, the insertion delay time parameter is parsed and loaded into a countdown counter as each node receives the instruction. The instruction load status register of each node is monitored; if the register returns a "LoadOK" status code (0x06), the node number is recorded. During the recording process, the deduplication property of hash sets is used to verify the structural uniqueness of the collected successful node numbers, automatically eliminating redundant duplicate numbers caused by network retransmission mechanisms. The final generated list is the refresh control instruction list, which confirms which nodes are ready to execute precise delay refreshes.
[0038] Please see Figure 6 The S5 steps are as follows: S511: Obtain all node numbers in the refresh control command list, monitor the feedback response signals returned by each node in the LED interactive network after receiving the command, extract the node number field in the response signal and perform format matching and verification, filter out incomplete fields, and generate a set of feedback response nodes. Immediately after sending the refresh command, a 50ms time window is opened to monitor the feedback channels of each node in the LED interactive network. ACK confirmation frames returned by each node are received. The data payload of the ACK frame is parsed, extracting the node number field and status code field. The extracted node number is then matched against a pre-stored standard number format (e.g., "LED_xxxx") using regular expressions. If the number field is missing, has an incorrect length, or contains illegal characters, it is considered an invalid response and is directly filtered out. All compliant feedback items are retained, and their corresponding node numbers are stored in a temporary memory area, generating a set of feedback response nodes. In the device matrix view on the interface, the icon of a node that successfully passes the verification and responds will instantly change from yellow (waiting) to green (confirmed), achieving visual monitoring of the entire network's response status. This set represents a subset of devices in the network that "heard the command and responded."
[0039] S512: Based on the set of feedback response nodes, retrieve all node numbers in the refresh control instruction list, extract missing node numbers, and use the refresh execution status field in the local control log to filter node numbers whose refresh status is marked as abnormal, and generate an abnormal node identifier list. The refresh control command list (the theoretically complete set of nodes that should succeed) and the feedback response node set (the subset of nodes that actually respond) are compared using a difference operation. This involves retrieving node numbers that exist in the command list but not in the feedback set, identifying them as "missing nodes." For these missing nodes, the local control server logs are retrieved to query their most recent heartbeat status and refresh execution status fields. If the logs show the node's refresh status as "Error," "Timeout," or "Busy," it is considered abnormal. These node numbers, confirmed as abnormal through log cross-validation, are extracted to generate an abnormal node identifier list. This abnormal node information is automatically summarized, and a "Fault Diagnosis List" is generated in the screen sidebar. Clicking on items in the list will take you to the corresponding maintenance suggestion page (e.g., "Suggest checking network cable interface" or "Suggest restarting module"), accurately pinpointing whether the lack of response is due to communication loss or an internal device fault.
[0040] S513: Based on the list of abnormal node identifiers and the set of feedback response nodes, mark the refresh result status of all responded and unresponded nodes, aggregate all node numbers and corresponding refresh statuses, and obtain the synchronization result of multi-screen interactive display content; Load the list of abnormal node identifiers and the set of feedback response nodes. For nodes in the feedback response node set, if their status code is "Success", mark the refresh result status as "Synchronization Successful"; if the status code is "Fail", mark it as "Execution Failed". For nodes in the list of abnormal node identifiers, directly mark the refresh result status as "Communication Timeout" or "Device Offline". Use all node numbers as row indices and the corresponding refresh result statuses as column values to aggregate and generate a global status table. Finally, based on this status table, automatically generate a multi-screen interactive display content synchronization result report. This report uses a pie chart to statistically analyze the overall network synchronization success rate and supports exporting and archiving in PDF format, providing maintenance personnel with a visual basis for troubleshooting and overall synchronization rate statistics. This table represents the multi-screen interactive display content synchronization result, intuitively displaying the final synchronization status of every screen across the entire network.
[0041] A multi-screen interactive content synchronization system includes: The time stamp recording module is used to perform S1: obtain the numbers of all LED displays in the LED interactive broadcast control network, monitor the local timestamp of each LED display for the start signal, and match it with the display number to obtain a time stamp sequence list; The instruction frame generation module is used to execute S2: based on all timestamps in the time stamp sequence table, extract the LED display number corresponding to the earliest timestamp item as the guide source node, record the current cache frame number, synchronization flag and timestamp information of the guide source node, and construct a synchronization instruction data frame; The path time identification module is used to execute S3: based on the information recorded by the guiding source node in the synchronization instruction data frame, it sequentially issues instructions and records the reception time of each node to the synchronization instruction, calculates the time interval between the reception time and the timestamp of the guiding source node, and combines the node number and the time interval duration to obtain the node time sequence table. The refresh control adjustment module is used to execute S4: based on the node time sequence table, the time interval data of each node is aligned with the local frame refresh cycle, the start time of content display is delayed, the delayed refresh instructions are injected into each node, the set of node numbers that have completed the injection action is recorded, and a refresh control instruction list is obtained. The synchronization status confirmation module is used to execute S5: based on the refresh control command list, it receives feedback response signals after all LED displays synchronously execute refresh actions, counts whether each node has completed the refresh start action, filters out abnormal nodes that do not respond, forms a network linkage status confirmation record, and obtains the synchronization result of multi-screen interactive display content.
[0042] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention in any other way. Any person skilled in the art may make changes or modifications to the above-disclosed technical content to create equivalent embodiments that can be applied to other fields. However, any simple modifications, equivalent changes, and modifications made to the above embodiments based on the technical essence of the present invention without departing from the scope of the present invention shall still fall within the protection scope of the present invention.
Claims
1. A method for synchronizing content displayed on multiple screens in an interactive manner, characterized in that, Includes the following steps: S1: Obtain the numbers of all LED displays in the LED interactive broadcast control network, monitor the local timestamp of the start signal received by each LED display, and match it with the display number to obtain a time stamp sequence table; S2: Based on all timestamps in the time stamp sequence table, extract the LED display number corresponding to the earliest timestamp item as the guiding source node, record the current cached frame number, synchronization flag and timestamp information of the guiding source node, and construct a synchronization instruction data frame; S3: Based on the information recorded by the guiding source node in the synchronization instruction data frame, instructions are issued sequentially and the reception time of each node to the synchronization instruction is recorded. The time interval between the reception time and the timestamp of the guiding source node is calculated. The node number and the time interval duration are combined to obtain the node time sequence table. S4: Based on the node time sequence table, align the time interval data of each node with the local frame refresh cycle, delay the start time of content display, inject the delayed refresh command into each node, record the set of node numbers that have completed the injection action, and obtain the refresh control command list. S5: Based on the refresh control command list, receive feedback response signals after all LED displays synchronously execute refresh actions, count whether each node has completed the refresh start action, filter out abnormal nodes that do not respond, form a network linkage status confirmation record, and obtain the multi-screen interactive display content synchronization result.
2. The method for synchronizing multi-screen interactive display content according to claim 1, characterized in that: The time stamp sequence table includes the source node number, local reception timestamp, and display screen number correspondence. The synchronization instruction data frame includes the source node cache frame number, synchronization flag, and guidance timestamp. The node time sequence table includes each node number, the time interval between the node and the source node, and the instruction reception time. The refresh control instruction list includes delay processing instructions, each node display control module number, and the completed injection node set. The multi-screen interactive display content synchronization result includes the abnormal node number, response status statistics, and network linkage status confirmation record.
3. The method for synchronizing multi-screen interactive display content according to claim 1, characterized in that, The specific steps for obtaining the time-stamped sequence table are as follows: S111: Obtain all LED display screen numbers in the LED interactive broadcast control network, extract the node information of each LED display screen, filter out non-display screen device numbers, mark all valid numbers as data monitoring target numbers, and generate a set of display screen numbers; S112: Read the synchronization start signal broadcast by the master control node, locate the flag field in the received broadcast content, identify the synchronization signal excitation time, and monitor the timestamp of each LED display receiving the synchronization start signal in sequence with the display number set. Establish an index mapping between the timestamp and the corresponding number to generate a timestamp number corresponding list. S113: Based on the timestamp number correspondence list, reorganize each group of numbers and corresponding timestamps into key-value pairs according to the display number order, verify the data structure consistency of all key-value pairs timestamp fields, aggregate them into a single data sequence, and generate a time stamp sequence table.
4. The method for synchronizing multi-screen interactive display content according to claim 1, characterized in that, The specific steps for acquiring the synchronization instruction data frame are as follows: S211: Based on the time stamp sequence table, extract all timestamp fields and establish a numerical sequence. Sort the data in ascending order according to the time sequence. Locate the number index corresponding to the first timestamp after sorting. Extract the corresponding LED display number as the unique target number and generate the guiding source node number. S212: Based on the guide source node number, obtain the current cache register content of the corresponding LED display screen, read the current cache frame number and confirm the data bit format, extract the current synchronization flag bit, extract the original index of the guide source node number in the time stamp sequence table, record the corresponding timestamp, and integrate the three items to generate a guide node status field group. S213: Based on the state field group of the guiding node, construct a data frame format with a fixed field arrangement structure, and embed the three fields of cache frame number, synchronization flag and timestamp in sequence to generate a synchronization instruction data frame.
5. The method for synchronizing multi-screen interactive display content according to claim 1, characterized in that, The specific steps for obtaining the node time series table are as follows: S311: Obtain the guiding source node number and corresponding timestamp in the synchronization instruction data frame, and send instruction frames sequentially from the guiding source node to each downstream node in the network according to the preset point-to-point transmission path in the LED interactive network, monitor the communication interface reception time of each node, and generate a node reception time record table. S312: Based on the node receiving time record table, for each receiving time record, perform a numerical subtraction operation with the timestamp of the guiding source node to construct a mapping structure between node number and time interval, and generate a node time interval mapping table; S313: Based on the node time interval mapping table, extract the node number and time interval of all mapping entries, perform row-wise aggregation sorting on each node number and its corresponding time interval, combine them into a unified two-dimensional structure, and generate a node time sequence table.
6. The method for synchronizing multi-screen interactive display content according to claim 1, characterized in that, The specific steps for obtaining the refresh control command list are as follows: S411: Obtain the time interval of each node in the node time series table, extract the local frame refresh period and perform period normalization processing, determine whether the node time interval is less than the frame refresh period, if not, perform division operation and round up to obtain the delay frame period multiple, and generate a frame delay multiple dictionary. S412: Based on the frame delay multiple dictionary, for each node number, combined with the local frame refresh cycle, the node corresponding time interval and the preset synchronization tolerance threshold, calculate the required insertion delay time for each node, determine the control signal insertion time point, construct the insertion control instruction data frame, and establish a refresh instruction data frame set. S413: Based on the refresh instruction data frame set, inject it into each node in sequence, record the node number that successfully receives and completes instruction loading, verify the uniqueness of the node number structure and remove redundant numbers to obtain the refresh control instruction list.
7. The method for synchronizing multi-screen interactive display content according to claim 6, characterized in that, The formula for calculating the insertion delay time is: ; in, The insertion time represents the refresh start signal delay for node n. This represents the time interval between node n and the guiding source node. Represents the local frame refresh cycle. The synchronization tolerance threshold is represented by the symbol. This indicates rounding up to the nearest integer.
8. The method for synchronizing multi-screen interactive display content according to claim 1, characterized in that, The specific steps for obtaining the synchronization results of multi-screen interactive display content are as follows: S511: Obtain all node numbers in the refresh control instruction list, monitor the feedback response signals returned by each node in the LED interactive network after receiving the instruction, extract the node number field in the response signal and perform format matching verification, filter out incomplete fields, and generate a set of feedback response nodes. S512: Based on the set of feedback response nodes, retrieve all node numbers in the refresh control instruction list, extract missing node numbers, and use the refresh execution status field in the local control log to filter node numbers whose refresh status is marked as abnormal, and generate an abnormal node identifier list. S513: Based on the list of abnormal node identifiers and the set of feedback response nodes, mark the refresh result status of all responded and unresponded nodes, aggregate all node numbers and corresponding refresh statuses, and obtain the synchronization result of multi-screen interactive display content.
9. A multi-screen interactive content synchronization system, characterized in that, The system is used to implement the multi-screen interactive display content synchronization method according to any one of claims 1-8, including: The time stamp recording module is used to perform S1: obtain the numbers of all LED displays in the LED interactive broadcast control network, monitor the local timestamp of each LED display for the start signal, and match it with the display number to obtain a time stamp sequence list; The instruction frame generation module is used to execute S2: based on all timestamps in the time stamp sequence table, extract the LED display number corresponding to the earliest timestamp item as the guiding source node, record the current cache frame number, synchronization flag bit and timestamp information of the guiding source node, and construct a synchronization instruction data frame; The path time identification module is used to execute S3: according to the information recorded by the guiding source node in the synchronization instruction data frame, it sequentially issues instructions and records the reception time of each node to the synchronization instruction, calculates the time interval between the reception time and the timestamp of the guiding source node, and combines the node number and the time interval duration to obtain the node time sequence table. The refresh control adjustment module is used to execute S4: based on the node time sequence table, the time interval data of each node is time-aligned with the local frame refresh cycle, the start time of content display is delayed, the refresh command after delay processing is injected into each node, the set of node numbers that have completed the injection action is recorded, and a refresh control command list is obtained. The synchronization status confirmation module is used to execute S5: based on the refresh control instruction list, receive feedback response signals after all LED displays have synchronously executed refresh actions, count whether each node has completed the refresh start action, filter out abnormal nodes that have not responded, form a network linkage status confirmation record, and obtain the synchronization result of multi-screen interactive display content.