A multi-signal simultaneous transmission real-time monitoring system

Abstract

The application provides a multi-signal simultaneous transmission real-time monitoring system, comprising a synchronous acquisition module for simultaneously acquiring multiple heterogeneous signals and stamping a uniform time stamp, a data processing and transmission module for processing, compressing, and encrypting transmission signals and dynamically adjusting strategies in an edge-cloud collaborative architecture, and a display and control module for supporting dynamic layout display of multiple signals on a splicing screen and specified signal operation; the synchronous acquisition module comprises a synchronous signal generator and a wireless time service unit; the data processing and transmission module adopts a publish-subscribe mechanism and a common cable transmission technology; the display and control module is provided with a chroma detection and adjustment unit and a time delay detection and adjustment unit; and the system further comprises an operation monitoring and identity association module.The application achieves multi-signal simultaneous transmission and real-time monitoring, ensures signal acquisition synchronization, processing efficiency, display consistency, and operation identity traceability, and the like.

Description

Technical Field

[0001] This invention relates to the field of real-time monitoring system technology, and in particular to a real-time monitoring system for simultaneous transmission of multiple signals. Background Technology

[0002] With the rapid development of the Internet of Things (IoT), the Industrial Internet, and smart security, the importance of real-time multi-signal monitoring is becoming increasingly prominent. Real-time multi-signal monitoring plays a crucial role in numerous fields, including industrial production and security. In industrial production, real-time monitoring of multiple signals allows for the timely detection of equipment failures and production anomalies, ensuring the continuity and safety of production. In the security field, real-time multi-signal monitoring enables comprehensive monitoring of complex environments and the timely detection of potential safety hazards. Simultaneously, as industries increasingly demand precise data analysis and real-time feedback, the need for simultaneous, real-time, and highly reliable monitoring of multiple signals is becoming increasingly urgent.

[0003] In existing technologies, the following methods are commonly used to achieve real-time monitoring of multiple signals. For signal synchronization, traditional systems rely on single software or simple hardware synchronization to attempt time alignment of signals from different sources and with different sampling rates. For data processing and transmission, traditional polling mechanisms or centralized processing architectures are often used, querying and processing data in a specific order. For system integration, the integration of multi-source components is often achieved through manual configuration and fixed interfaces. Regarding display, when multiple signals are displayed on a video wall, they are simply spliced ​​together without effective processing of color and latency. In terms of user interaction, a single operation method is often used, limiting users to fixed operation modes.

[0004] However, existing technologies have significant drawbacks. Signals from different sources and with different sampling rates are difficult to align with high precision in time, leading to "spatiotemporal misalignment" during data fusion and analysis, resulting in distorted data analysis results. Furthermore, massive amounts of real-time data can easily cause system bottlenecks; traditional polling mechanisms or centralized processing architectures are prone to response delays, data loss, and even system overload and crashes. In addition, the system lacks adaptive capabilities, relying heavily on fixed threshold alarms and failing to predict faults. Moreover, the integration of multi-source devices is complex, resulting in inconsistent displays, cumbersome operation, and a poor user experience. Summary of the Invention

[0005] This invention solves the problem of achieving high-precision time alignment for signals from different sources and with different sampling rates, and proposes a real-time monitoring system for simultaneous transmission of multiple signals.

[0006] To achieve the above objectives, the following technical solution is proposed: A real-time monitoring system for simultaneous transmission of multiple signals includes: a synchronous acquisition module for simultaneously acquiring multiple heterogeneous signals and assigning a unified timestamp to each signal, wherein the heterogeneous signals include video signals, audio signals, sensor data, and control signals; a data processing and transmission module that adopts an edge-cloud collaborative computing architecture to perform distributed processing, compression, and encrypted transmission of the acquired heterogeneous signals, and dynamically adjusts the transmission strategy according to signal priority and network status; and a display and control module that supports dynamic layout and display of multiple signals on an external splicing screen, and can amplify, switch, and correlate specified signals according to user input commands and automatic analysis results.

[0007] By adopting the above technical solutions, the synchronous acquisition module can simultaneously acquire multiple heterogeneous signals and assign them a unified timestamp, solving the problem of difficult synchronization of heterogeneous signals and laying the foundation for subsequent accurate data fusion and analysis. The data processing and transmission module adopts an edge-cloud collaborative computing architecture to perform distributed processing, compression, and encrypted transmission of multiple heterogeneous signals, and dynamically adjusts the transmission strategy according to signal priority and network status, solving the bottleneck problem of data processing and transmission. The display and control module supports dynamic layout and display of multiple signals on the splicing screen, and can amplify, switch, or associate the display of specified signals according to user input commands or automatic analysis results, solving the problems of integration difficulties and poor interactive experience.

[0008] Preferably, the synchronization acquisition module includes a synchronization signal generator, a synchronization controller, and an acquisition terminal with a counter. The synchronization signal generator can generate a synchronization trigger signal including signal A and signal B, and the synchronization signal generator accepts switching control from the synchronization controller.

[0009] By adopting the above technical solution, the synchronous acquisition module uses a synchronous signal generator, a synchronous controller, and an acquisition terminal with a counter. The synchronous signal generator generates A signal and B signal and is switched and controlled by the synchronous controller. Combined with the synchronous acquisition module's scheme of simultaneously acquiring multiple heterogeneous signals and stamping them with a unified timestamp, it can achieve microsecond-level synchronization, diagnose its own synchronization status abnormalities in real time, ensure the consistency of heterogeneous signals in the spatiotemporal dimension, and lay the foundation for subsequent accurate data fusion analysis.

[0010] Preferably, the acquisition terminal is equipped with two counters to count signals A and B respectively.

[0011] By adopting the above technical solution, the synchronous acquisition module can simultaneously acquire multiple heterogeneous signals and stamp them with a unified timestamp. By using a dual trigger signal and dual counter synchronization scheme, it can achieve microsecond-level synchronization and can also diagnose its own synchronization status abnormalities in real time, ensuring the consistency of heterogeneous signals in the spatiotemporal dimension, thus laying the foundation for subsequent accurate data fusion and analysis.

[0012] Preferably, the synchronization controller controls the synchronization signal generator to alternately generate signal A and signal B in time periods, and the synchronization controller reads the counter values ​​of each acquisition terminal that are in a non-working state during the switching interval.

[0013] By adopting the above technical solutions, the system can achieve microsecond-level synchronization and diagnose its own synchronization status anomalies in real time, upgrading from "passive alignment" to "active monitoring and compensation," ensuring the consistency of heterogeneous signals in the spatiotemporal dimension and laying the foundation for subsequent accurate data fusion analysis. At the same time, combined with the synchronous acquisition module that simultaneously acquires multiple heterogeneous signals and assigns a unified timestamp, and the synchronous acquisition module including a synchronization signal generator, a synchronization controller, and an acquisition terminal with counters, the synchronous signal generator can generate synchronization trigger signals including A signal and B signal and accept the switching control of the synchronization controller. The acquisition terminal is equipped with two counters to count A signal and B signal respectively. These technologies further ensure high-precision time alignment of heterogeneous signals and effective monitoring and diagnosis of synchronization status.

[0014] Preferably, the synchronous acquisition module is further provided with a wireless time synchronization unit for time synchronization of acquisition terminals distributed in different geographical locations.

[0015] By adopting the above technical solution, the synchronous acquisition module simultaneously acquires multiple heterogeneous signals and adds a unified timestamp, and the wireless timing unit synchronizes the time of acquisition terminals in different geographical locations. This solves the problem of difficult synchronization of heterogeneous signals, achieves microsecond-level synchronization, ensures the consistency of heterogeneous signals in the spatiotemporal dimension, and lays the foundation for subsequent accurate data fusion and analysis.

[0016] Preferably, the wireless timing unit is based on an improved timing message-response message mechanism. The acquisition terminal sends a timing message to the master clock server. The master clock server records the received time and assembles a response message containing multiple timestamps and returns it. The acquisition terminal calculates the clock deviation with the master clock server based on the round-trip timestamps and compensates for the local clock.

[0017] By adopting the above technical solution, time synchronization of acquisition terminals distributed in different geographical locations can be achieved, reaching microsecond-level precise synchronization, ensuring the consistency of heterogeneous signals in the spatiotemporal dimension, and laying the foundation for subsequent accurate data fusion and analysis.

[0018] Preferably, the data processing and transmission module adopts a publish-subscribe mechanism, with the signal acquisition module acting as the publisher, publishing the acquired signal data according to the topic, and the signal processing module and the application module acting as subscribers, subscribing to the data of the topic. The data processing and transmission module also has an event processing service module, which is responsible for managing the subscription relationship and filtering, storing and distributing the data according to preset filtering and storage rules.

[0019] By adopting the above technical solution, a publish-subscribe mechanism is used to replace the traditional polling. The signal acquisition module acts as the publisher, publishing the acquired signal data according to the topic. The signal processing module and the application module act as subscribers, subscribing to the topic data. Together with the event processing service module, the subscription relationship is managed, and the data is filtered, stored, and distributed in a targeted manner. This enables the data stream to be pushed proactively on demand, greatly reducing the load caused by invalid queries. The modules of the system are loosely coupled and easy to expand.

[0020] Preferably, the data processing and transmission module adopts coaxial cable transmission technology, which uses a single radio frequency coaxial cable to simultaneously transmit multiple modulated monitoring signals, and is equipped with a coaxial cable modulator and a coaxial cable demodulator to realize bidirectional signal transmission and system expansion. The monitoring signals include video signals, audio signals, alarm signals and control signals.

[0021] By adopting the above technical solutions, the system uses an edge-cloud collaborative computing architecture to perform distributed processing, compression, and encrypted transmission of the collected heterogeneous signals. It also dynamically adjusts the transmission strategy based on signal priority and network status. At the same time, it uses a publish-subscribe mechanism to filter, store, and distribute data in a targeted manner. On this basis, the data processing and transmission module uses a single RF coaxial cable to transmit multiple modulated video, audio, alarm, and control signals simultaneously. It is also equipped with a coaxial cable modulator and demodulator, realizing bidirectional signal transmission and system expansion.

[0022] Preferably, the display and control module includes: a chromaticity detection unit for acquiring the chromaticity values ​​of each screen in the splicing screen; a chromaticity difference calculation unit for comparing the chromaticity values ​​of each screen with preset standard values ​​and calculating the chromaticity difference; a chromaticity adjustment unit for automatically adjusting the screen chromaticity to ensure overall display consistency when the chromaticity difference exceeds a preset threshold; and a latency detection and compensation unit for detecting the latency of the displayed content on each screen through a clock signal determination device and performing data compensation for screens with latency.

[0023] By adopting the above technical solutions, the synchronous acquisition module can simultaneously acquire multiple heterogeneous signals and assign a unified timestamp. The data processing and transmission module uses an edge-cloud collaborative architecture to perform distributed processing on multiple heterogeneous signals and dynamically adjust the transmission strategy. The display and control module supports dynamic layout and display of multiple signals on the splicing screen. Based on this, the display and control module sets up a colorimetry detection unit to obtain the colorimetry values ​​of each screen in the splicing screen. The color difference calculation unit compares the colorimetry values ​​with preset standard values ​​to calculate the color difference. The colorimetry adjustment unit automatically adjusts the screen colorimetry when the color difference exceeds the threshold, which can ensure the overall display consistency of the splicing screen. The delay detection and compensation unit detects the delay of each screen through a clock signal determination device and performs data compensation for the delayed screen, which can eliminate the problem of delay asynchrony when multiple signals are displayed on the splicing screen.

[0024] Preferably, the system further includes an operation monitoring and identity association module. When a user operates the signal source through the terminal, the system automatically records the operation process and triggers the camera to capture the environmental image of the terminal operator. The system associates and stores the screen recording result with the environmental image to ensure that the identity of the actual operator and the system login account is traceable.

[0025] By adopting the above technical solution, the system can automatically record the operation process and capture the operator's environmental image when the user operates the signal source. The screen recording result is associated with the environmental image and stored, which solves the problem of identity mismatch, ensures that the identity of the actual operator and the system login account is traceable, and improves system security and management efficiency.

[0026] The beneficial effects of this invention are: 1. The synchronous acquisition module simultaneously acquires multiple heterogeneous signals and assigns them a unified timestamp. The dual trigger signal and dual counter synchronization scheme, supplemented by a wireless timing unit, achieves microsecond-level synchronization and real-time diagnosis of synchronization status anomalies, solving the problem of difficult synchronization of heterogeneous signals and ensuring accurate data fusion analysis. 2. The data processing and transmission module adopts an edge-cloud collaborative architecture, a publish-subscribe mechanism, and shared cable transmission technology to perform distributed processing, compression, and encrypted transmission. It dynamically adjusts the transmission strategy based on signal priority and network status to solve data processing and transmission bottlenecks and reduce system load and latency. 3. The display and control module supports dynamic layout and display of multiple signals, and has color correction and time delay compensation functions, solving the problems of integration difficulties and poor interactive experience, ensuring consistent and synchronized display of splicing screens, and supporting multi-mode display and intelligent switching; 4. The operation monitoring and identity association module associates and stores screen recording results with environmental images to solve the identity mismatch problem and ensure that the actual operator and the system login account are traceable. Attached Figure Description

[0027] Figure 1 This is a system module connection diagram of the present invention.

[0028] Figure 2 for Figure 1 Internal sub-unit connection diagram of the data processing and transmission module. Detailed Implementation

[0029] The technical solutions in the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. The described embodiments are only possible technical implementations of the present invention, but are not limited thereto. Other embodiments obtained by those skilled in the art in conjunction with the embodiments of the present invention without creative effort are also within the protection scope of the present invention.

[0030] This application mainly adopts a signal synchronous acquisition, edge-cloud collaborative processing and intelligent display control scheme, which achieves high-precision synchronous monitoring of multiple signals and solves problems such as heterogeneous signal synchronization and data processing and transmission bottlenecks. The following is a further detailed description of this application. Example 1:

[0031] This application provides a real-time monitoring system for simultaneous transmission of multiple signals, including: a synchronous acquisition module for simultaneously acquiring multiple heterogeneous signals and assigning a unified timestamp to each signal, wherein the heterogeneous signals include video signals, audio signals, sensor data, and control signals; a data processing and transmission module that adopts an edge-cloud collaborative computing architecture to perform distributed processing, compression, and encrypted transmission of the acquired heterogeneous signals, and dynamically adjusts the transmission strategy according to signal priority and network status; and a display and control module that supports dynamic layout and display of multiple signals on an external splicing screen, and can amplify, switch, and correlate specified signals according to user input commands and automatic analysis results.

[0032] Each module works together to ensure synchronization from the signal acquisition source, processes and transmits data through a reasonable computing architecture, and finally presents a good monitoring effect on the display end.

[0033] The synchronous acquisition module includes a synchronous signal generator, a synchronous controller, and an acquisition terminal with a counter.

[0034] The synchronization signal generator accepts switching control from the synchronization controller. Based on programmable logic devices, it can generate stable synchronization trigger signals, including signal A and signal B, according to a certain frequency and pattern. Signal A is used for sampling in odd-numbered time windows, and signal B is used in even-numbered time windows. The frequency can be configured via software. Alternatively, a signal generator based on programmable logic devices can be used, allowing for more flexible adjustment of signal parameters.

[0035] The synchronization controller can be a microprocessor that reads the counter values ​​of each acquisition terminal that are in an inactive state during the switching interval. The synchronization controller accepts user settings or follows a preset program to switch and control the synchronization signal generator, causing it to alternately generate signal A or signal B. Its core logic is a state machine model that monitors the counter values ​​of each acquisition terminal. If the difference exceeds a threshold (e.g., ±2 count), a synchronization calibration sequence is triggered. An alternative feature is the use of a microcontroller to achieve the same control function.

[0036] The acquisition terminal is equipped with two counters. Each terminal integrates two hardware counters to count signals A and B respectively. The analog signals are digitized by an ADC and output as a data packet with a timestamp, in the format of {signal value, timestamp, counter A value, counter B value}.

[0037] The counter is a digital counter, which uses an integrated circuit chip to implement the counting function and is installed inside the data acquisition terminal. Another approach is to use a software counter, where the counting function is implemented by the processor of the data acquisition terminal running a counting program.

[0038] The synchronization controller controls the synchronization signal generator to alternately generate signal A or signal B in time-sharing intervals, and reads the counter values ​​of inactive terminals in each acquisition terminal during the switching intervals. By comparing the count values ​​of different acquisition terminals, the synchronization status is determined, thereby achieving real-time monitoring and anomaly diagnosis of the synchronization status. This combinational logic enables the system to monitor the synchronization status of each acquisition terminal in real time. When there is a significant difference in the count values ​​of different acquisition terminals, it indicates an anomaly in the synchronization status, and the system can take timely measures to adjust, ensuring the synchronization accuracy of signal acquisition.

[0039] The synchronization acquisition module also integrates a wireless time synchronization unit for time synchronization of acquisition terminals distributed in different geographical locations. The wireless time synchronization unit is based on an improved time synchronization message-response message mechanism. The acquisition terminal sends a time synchronization message to the master clock server. The master clock server records the received time and assembles a response message containing multiple timestamps, returning it to the acquisition terminal. The acquisition terminal calculates the clock deviation with the master clock server based on the round-trip timestamps and compensates for the local clock. The wireless time synchronization unit is a device based on wireless communication technology, such as Bluetooth or Wi-Fi, to communicate with the master clock server. It uses a two-way delay calculation model: the acquisition terminal sends a time synchronization message, and the master server returns a response message containing T1 (receive time), T2 (processing time), and T3 (send time). The terminal compensates for the local clock according to the formula clock deviation = [(T2-T1)+(T4-T3)] / 2 (T4 is the local receive time), with an accuracy down to the microsecond level. Another approach is to use a dedicated wireless time synchronization module, which offers even higher time synchronization accuracy and stability. This combination method enables the acquisition terminals distributed in different geographical locations to maintain time synchronization with the master clock server, further improving the synchronization accuracy of signal acquisition and providing an accurate time basis for subsequent data processing and analysis.

[0040] Dynamic process: Initialization phase: The synchronization controller loads the configuration and starts the A signal cycle; the counters of each acquisition terminal are cleared to zero, and the wireless timing unit completes network time synchronization.

[0041] Synchronous acquisition cycle: The synchronization signal generator outputs signal A, and all terminals count and sample the signal A. During the switching interval (e.g., 1ms), the synchronization controller reads the B counter value of each terminal and calculates the variance. If the variance > threshold, it is determined to be out of sync, and the B signal is triggered to activate early. The wireless timing unit sends a synchronization message every 30 seconds to dynamically calibrate the terminal clock drift.

[0042] Anomaly Handling: When the counter difference continues to exceed the limit, the synchronization controller records the faulty terminal ID and switches to the backup acquisition terminal.

[0043] The data processing and transmission module adopts an edge-cloud collaborative computing architecture to perform distributed processing, compression, and encrypted transmission of the acquired multi-channel signals, and dynamically adjusts the transmission strategy based on signal priority and network status. This module includes edge computing devices and a cloud computing platform.

[0044] Edge computing devices are small computers or servers installed near the data acquisition site. They perform preliminary processing and compression of the acquired signals, reducing the burden on cloud computing platforms. Specifically, they include edge computing nodes, data preprocessing units, and rule engine units. Edge computing nodes deploy embedded AI chips and run lightweight algorithms; the data preprocessing unit performs Kalman filtering for noise reduction and compression on the input signals to reduce bandwidth consumption; the rule engine unit prioritizes data according to preset strategies (such as "vibration signal > video signal") and triggers local events (such as immediate alarms when sensors malfunction). Another approach is to use industrial-grade embedded computers as edge computing devices, which offer higher stability and reliability.

[0045] The cloud computing platform is responsible for further processing and storing the data transmitted from edge computing devices, leveraging its powerful computing capabilities and storage capacity to achieve efficient processing of massive amounts of data. Based on a microservices architecture, the cloud computing platform includes a stream processing engine and a storage management unit. The stream processing engine calculates signal characteristics in real time, while the storage management unit uses a time-series database to store historical data, supporting queries by time window.

[0046] The data processing and transmission module employs a publish-subscribe mechanism. The signal acquisition module acts as the publisher, publishing the acquired signal data according to topics. The signal processing module and the application module act as subscribers, subscribing to data based on these topics. The data processing and transmission module also includes an event processing service module, responsible for managing subscription relationships and filtering, storing, and distributing data according to preset filtering and storage rules.

[0047] The event processing service module is a server program running on a cloud computing platform. Its core is a publish / subscribe message queue, which uses software algorithms to manage subscription relationships and process data. Subscription relationships are managed through topics, for example: topic / sensor / vibration: subscribers are cloud analytics services; topic / video / alert: subscribers are mobile apps. Another approach is to use a distributed event processing service module, distributed across multiple servers, improving system processing capacity and reliability. This combination allows the system to flexibly process and transmit data according to the needs of different modules, avoiding data bottlenecks caused by traditional polling mechanisms or centralized processing architectures, and improving the efficiency of data processing and transmission.

[0048] The data processing and transmission module employs coaxial cable transmission technology, utilizing a single RF coaxial cable to simultaneously transmit multiple modulated monitoring signals. It is equipped with a coaxial cable modulator and demodulator to enable bidirectional signal transmission and system expansion. The monitoring signals include video, audio, alarm, and control signals. Specifically, it includes a coaxial cable transmission unit that uses QAM modulation technology to modulate multiple signals onto different frequency bands of the coaxial cable (e.g., video signals: 500-800MHz, sensor signals: 200-400MHz), supporting frequency division multiplexing. Expansion only requires adding a modulator.

[0049] A shared-cable modulator is an electronic device that modulates different types of monitoring signals, enabling their transmission over the same radio frequency coaxial cable. Alternatively, more advanced modulation techniques and equipment can be used to improve signal transmission quality and capacity. A shared-cable demodulator is responsible for demodulating the received modulated signal, restoring it to the original monitoring signal. This shared-cable transmission technology reduces the number of cables used, lowers system construction costs, and also facilitates system expansion and maintenance.

[0050] Dynamic process: Data flow pipeline: After receiving data from the acquisition module, the edge node's preprocessing unit compresses the data to 30%-50% of its original size and adds priority tags. High-priority data (such as alarm events) is directly pushed to the cloud via the MQTT protocol; low-priority data is batch-cached and then transmitted. The event service module routes data according to topics: for example, vibration data is published to / sensor / vibration, and the cloud platform subscribes to this topic and triggers an analysis job.

[0051] Adaptive transmission strategy: The network state monitoring unit based on ICMP latency detection dynamically adjusts the transmission mode: when bandwidth is sufficient, it sends the original data; when the network is congested, it only transmits feature summaries (such as the coordinates of moving targets in a video).

[0052] Fault tolerance: If an edge node goes offline, the data is temporarily stored on the local SD card and will resume transmission once the network is restored.

[0053] The display and control module includes a colorimetric detection unit, a color difference calculation unit, a colorimetric adjustment unit, and a time delay detection and compensation unit.

[0054] The colorimetric detection unit is an optical sensor that collects CIE Lab colorimetric values ​​from each screen via a color sensor, with a sampling frequency of 60Hz. It is installed near the video wall to obtain the colorimetric values ​​of each screen in the video wall. Alternatively, a camera can be used to acquire the colorimetric information of the screens, and image processing algorithms can be used to calculate the colorimetric values.

[0055] The color difference calculation unit is a processor that compares the chromaticity values ​​of each screen with preset standard values ​​and calculates the chromaticity difference. The unit calculates the screen color difference ΔE based on the CIEDE2000 algorithm. If ΔE > 5 (threshold is configurable), adjustment is required. Its replaceable feature is the use of a dedicated color difference calculation chip to improve calculation speed and accuracy.

[0056] The chromaticity adjustment function adjusts the screen's RGB gain value via the GPU driver interface, iterating until ΔE ≤ 2. When the chromaticity difference exceeds a preset threshold, it automatically adjusts the screen's chromaticity to ensure overall display consistency. It is a screen driver circuit that adjusts the screen's color parameters to achieve chromaticity adjustment. Another approach is to use software control, adjusting the chromaticity through the screen's driver program.

[0057] The latency detection and compensation unit detects the latency of the displayed content on each screen using a clock signal determination device and compensates for the latency on screens. Specifically, it uses PTP to synchronize the display clock of each screen. The latency detection algorithm calculates the deviation by comparing the frame buffer timestamp with the actual display timestamp. If the deviation is greater than 16.7ms (corresponding to a 60Hz refresh rate), frame dropping or frame interpolation is used for compensation. The clock signal determination device is a high-precision clock chip installed in the display and control module. Another approach is to use clock synchronization technology based on network time protocols to detect latency. This combined method solves the problems of color difference and latency asynchrony when multiple signals are displayed on a splicing screen, improving display consistency and user interaction experience.

[0058] Dynamic process: Display pipeline: After data input, the chroma management unit periodically (e.g., every 10 seconds) checks the screen color difference and automatically adjusts the color parameters. The latency compensation unit checks the latency before rendering each frame and dynamically adjusts the frame buffer queue length.

[0059] User operation tracking: After a user logs in, the operation monitoring module starts screen recording and environmental cameras. Sensitive operations (such as parameter modification) trigger real-time image capture, and the data is encrypted and uploaded to the audit server after correlation.

[0060] Linkage control: Supports rule engine configuration, such as "when the vibration signal exceeds the threshold, automatically switch the large screen to display the signal source".

[0061] The system also includes an operation monitoring and identity association module, which specifically comprises a screen recording subunit, an environmental image capture subunit, and an association storage subunit. The screen recording subunit records the user's operation stream using the FFmpeg library and saves it as H.264 format video. The environmental image capture subunit triggers a USB camera to capture the operator's facial image and extracts the feature code using a face recognition API (such as OpenFace). The association storage subunit binds and stores the operation video, environmental image, and user account in a database, with an index format of {timestamp, user ID, operation type, feature code hash}. When a user operates the signal source through the terminal, the system automatically records the operation process and triggers the camera to capture the operator's environmental image. The system associates and stores the screen recording result with the environmental image, ensuring the traceability of the actual operator and the system login account. The operation monitoring and identity association module can be a software program running on the system server, using screen recording software and camera drivers to record the operation process and capture environmental images. Alternatively, dedicated hardware can be used to implement the operation monitoring and identity association functions, offering higher stability and security. This module setup solves the identity mismatch problem in the existing system, improving system security and management efficiency.

[0062] System operating principle: The modules collaborate through standardized interfaces, and the overall data flow is as follows: Acquisition phase: The synchronous acquisition module outputs data frames with PTP timestamps and sends them to the edge computing node via Ethernet.

[0063] Processing phase: Data processed by edge nodes is published to a message queue; the cloud platform subscribes to the required topics, and the analysis results are stored in the database.

[0064] Display phase: The display module retrieves data from the database, performs color / latency correction, and then renders it onto the video wall. User operations are audited throughout the entire process.

[0065] Abnormal feedback loop: When the display module detects an abnormal signal (such as video stuttering), it can trigger the acquisition module to recalibrate in reverse.

[0066] The implementation principle of this embodiment is as follows: The multi-signal simultaneous transmission real-time monitoring system in this embodiment ensures the synchronous acquisition of multiple heterogeneous signals from the source through a synchronous acquisition module. It utilizes a synchronous signal generator, a synchronous controller, and an acquisition terminal with a counter to achieve real-time monitoring and anomaly diagnosis of signal synchronization status. Furthermore, the wireless timing unit further improves time synchronization accuracy. The data processing and transmission module adopts an edge-cloud collaborative computing architecture and a publish-subscribe mechanism, effectively solving data processing and transmission bottlenecks. The application of shared cable transmission technology reduces system costs and maintenance difficulty. The display and control module improves display effects and user interaction experience through units such as colorimetry detection, color difference calculation, colorimetry adjustment, and latency detection and compensation. The operation monitoring and identity association module ensures the traceability and security of system operations. Through the collaborative work of each module, the entire system achieves real-time monitoring of simultaneous multi-signal transmission, solving key deficiencies in synchronization accuracy, data processing efficiency, transmission reliability, display consistency, and system intelligence in existing technologies. It has high practical value and promising prospects, representing a significant improvement and enhancement compared to existing technologies. Example 2:

[0067] This embodiment is based on Embodiment 1, but differs in that the data processing and transmission module, while employing an edge-cloud collaborative computing architecture, introduces IP multicast technology for audio and video data transmission. IP multicast technology is a data transmission method based on network communication protocols. When multiple terminals need to view the same video simultaneously, multicast only needs to send one copy of the data on a single network link, thereby greatly saving network bandwidth and avoiding the bottlenecks of server and network bandwidth in unicast mode.

[0068] The implementation principle of this embodiment is as follows: By introducing IP multicast technology, the functions of the data processing and transmission modules are further optimized. This results in more efficient use of network resources for audio and video data transmission, reducing the possibility of network congestion and improving the system's performance when processing large amounts of audio and video data. In real-time monitoring systems that transmit multiple signals simultaneously, audio and video data typically consume significant network bandwidth. The application of IP multicast technology solves this problem, enabling the system to better handle the transmission needs of massive amounts of real-time data. Compared to traditional transmission methods, this represents a significant improvement, enhancing the overall performance and reliability of the system.

[0069] The above are all preferred embodiments of this application, and are not intended to limit the scope of protection of this application. Therefore, all equivalent changes made in accordance with the structure, shape and principle of this application should be covered within the scope of protection of this application.

Claims

1. A real-time monitoring system for simultaneous transmission of multiple signals, characterized in that, include: The synchronous acquisition module is used to simultaneously acquire multiple heterogeneous signals and assign a unified timestamp to each signal. The heterogeneous signals include video signals, audio signals, sensor data, and control signals. The data processing and transmission module adopts an edge-cloud collaborative computing architecture to perform distributed processing, compression, and encrypted transmission of the acquired heterogeneous signals, and dynamically adjusts the transmission strategy based on signal priority and network status. The display and control module supports dynamic layout and display of multiple signals on an external splicing screen, and can amplify, switch and associate the display of specified signals according to user input commands and automatic analysis results.

2. The real-time monitoring system for simultaneous transmission of multiple signals according to claim 1, characterized in that, The synchronous acquisition module includes a synchronous signal generator, a synchronous controller, and an acquisition terminal with a counter. The synchronous signal generator can generate synchronous trigger signals including A signal and B signal, and the synchronous signal generator accepts switching control from the synchronous controller.

3. The real-time monitoring system for simultaneous transmission of multiple signals according to claim 2, characterized in that, The acquisition terminal is equipped with two counters, which count the A signal and the B signal respectively.

4. The real-time monitoring system for simultaneous transmission of multiple signals according to claim 2, characterized in that, The synchronization controller controls the synchronization signal generator to alternately generate signals A and B in time periods. During the switching interval, the synchronization controller reads the counter values ​​of each acquisition terminal that are in a non-working state.

5. A real-time monitoring system for simultaneous transmission of multiple signals according to claim 1, characterized in that, The synchronous acquisition module is also equipped with a wireless time synchronization unit for time synchronization of acquisition terminals distributed in different geographical locations.

6. A real-time monitoring system for simultaneous transmission of multiple signals according to claim 5, characterized in that, The wireless timing unit is based on an improved timing message-response message mechanism. The acquisition terminal sends a timing message to the master clock server. The master clock server records the received time and assembles a response message containing multiple timestamps and returns it. The acquisition terminal calculates the clock deviation with the master clock server based on the round-trip timestamps and compensates for the local clock.

7. A real-time monitoring system for simultaneous transmission of multiple signals according to claim 1, characterized in that, The data processing and transmission module adopts a publish-subscribe mechanism. The signal acquisition module acts as the publisher, publishing the acquired signal data according to the topic. The signal processing module and the application module act as subscribers, subscribing to the data of the topic. The data processing and transmission module also has an event processing service module, which is responsible for managing the subscription relationship and filtering, storing and distributing the data according to preset filtering and storage rules.

8. A real-time monitoring system for simultaneous transmission of multiple signals according to claim 1 or 7, characterized in that, The data processing and transmission module adopts coaxial cable transmission technology, which uses a single radio frequency coaxial cable to transmit multiple modulated monitoring signals simultaneously. It is equipped with a coaxial cable modulator and a coaxial cable demodulator to achieve bidirectional signal transmission and system expansion. The monitoring signals include video signals, audio signals, alarm signals, and control signals.

9. A real-time monitoring system for simultaneous transmission of multiple signals according to claim 1, characterized in that, The display and control module is equipped with: Colorimetric detection unit: used to acquire the colorimetric values ​​of each screen in the splicing screen; Color difference calculation unit: compares the chromaticity values ​​of each screen with preset standard values ​​and calculates the chromaticity difference; Color adjustment unit: When the color difference exceeds a preset threshold, it automatically adjusts the screen color to ensure overall display consistency; Delay detection and compensation unit: Detects the delay of the content displayed on each screen through a clock signal determination device, and performs data compensation for screens with delay.

10. A real-time monitoring system for simultaneous transmission of multiple signals according to claim 1, characterized in that, The system also includes an operation monitoring and identity association module. When a user operates the signal source through the terminal, the system automatically records the operation process and triggers the camera to capture the environmental image of the terminal operator. The system associates and stores the screen recording result with the environmental image to ensure that the identity of the actual operator and the system login account is traceable.

Images