Visual communication system based on weak current engineering and operation method thereof

Abstract

The invention relates to the technical field of intelligent industry, and discloses a visual communication system based on weak current engineering and an operation method thereof, and the system comprises a multi-mode signal collection module, an intelligent data processing module, a dual-channel communication transmission module, an interactive visualization module and an autonomous control system module. The method comprises the following steps: synchronously acquiring video, audio and environmental parameters through a distributed sensor array; eliminating multi-source signal deviation by adopting a space-time alignment algorithm; feature fusion and quality evaluation are realized based on a deep neural network; dynamically selecting a wired and wireless hybrid transmission mode; an AR enhanced visual human-computer interface is constructed; and implementing a fault self-diagnosis and fault-tolerant recovery mechanism. According to the invention, the bit error rate of the communication system is reduced, the continuity and reliability of the communication process are ensured, and the man-machine interaction efficiency and the emergency response speed are improved.

Description

Technical Field

[0001] This invention relates to the field of intelligent industrial technology, specifically to a visual communication system based on low-voltage engineering and its operation method. Background Technology

[0002] Intelligent industry is a new type of industrial system that continuously integrates various terminals with environmental sensing capabilities, ubiquitous computing models, mobile communications, and other technologies into all aspects of industrial production. This improves manufacturing efficiency, enhances product quality, reduces product costs and resource consumption, and elevates traditional industries to a new stage of intelligence.

[0003] Currently, due to the characteristics of strong electromagnetic interference and variable environment in low-voltage engineering application scenarios, when transmitting multimodal data in real time, the deployed communication equipment is affected by environmental electromagnetic noise and cannot dynamically adjust the signal processing strategy. If the signal distortion exceeds the tolerance range, it may cause video stuttering and audio interruption, and the stability of communication quality cannot be guaranteed.

[0004] Therefore, a visual communication system based on low-voltage engineering and its operation method are proposed to solve the above problems. Summary of the Invention

[0005] To address the shortcomings of existing technologies, this invention provides a visual communication system based on low-voltage engineering and its operation method. The visual communication system and its operation method provided by this invention solve the problems mentioned in the background technology, such as the inability to dynamically adjust signal processing strategies and the inability to guarantee the stability of communication quality.

[0006] To achieve the above objectives, the present invention provides the following technical solution: a visual communication system based on low-voltage engineering and its operation method, the system comprising: The signal acquisition module uses a multimodal sensor unit to simultaneously acquire video, audio, and infrared signals from the target area, obtains ambient light and electromagnetic parameters through an environmental parameter detection unit, and outputs standardized acquisition data through a signal preprocessing unit. The data processing module receives the standardized collected data, analyzes the multimodal signal features through the feature extraction unit, performs spatiotemporal alignment processing using the data fusion unit, and outputs the fused data through system performance evaluation. The communication transmission module receives the fusion data, distributes the data through a dual-channel transmission network composed of a wired transmission unit and a wireless transmission unit, and has three working modes: standard mode, anti-interference mode, and emergency mode. In the standard mode, when the detected electromagnetic interference intensity is lower than the electromagnetic interference intensity threshold and the transmission efficiency is greater than 0.75, wireless transmission is performed using the 5 GHz frequency band. In the anti-interference mode, when the detected electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, it automatically switches to wired transmission and enables channel encryption. In the emergency mode, when the main transmission link is interrupted, a Mesh network is enabled for multi-hop relay transmission; The visualization presentation module receives the transmission status data, realizes information partition presentation through a multi-screen display unit, responds to user operation instructions using an interactive control unit, and dynamically adjusts display parameters through a layout optimization unit; The system control module coordinates the operation processes of each module, realizes task scheduling through a central control unit, monitors the system health status using a self-check and maintenance unit, and outputs control instructions through an exception handling unit.

[0007] Preferably, the multi-modal sensor unit includes: A high-definition camera array is arranged at key positions in the target area and real-time collects video streams with a resolution of 1080P or higher using the H.265 encoding format; A directional microphone array uses beamforming technology to collect audio in a specific direction and has an echo cancellation function; An infrared thermal imager has a thermal imaging ability with a temperature sensitivity of 0.05 °C and can generate a thermal map of 256×256 pixels; Among them, the system performance evaluation uses a normalization formula: ; Among them, is the normalized quality coefficient, and when the threshold ≥0.6, it is determined to be qualified, is the normalized signal-to-noise ratio, is the measured value of the signal-to-noise ratio, with the unit of dB, is the normalized bandwidth, is the measured value of the bandwidth, with the unit of MHz, is the environment correction factor, with the default =1.0, and when the temperature and humidity exceed the standard, it is calculated according to =0.9.

[0008] Preferably, the operations performed by the signal preprocessing unit include: Perform adaptive filtering processing on the video signal based on the spatio-temporal domain to eliminate the influence of motion blur and sudden light changes; Perform spectral analysis and background noise suppression on the audio signal, preserving the 200Hz-8kHz frequency band; Non-uniformity correction and temperature calibration of infrared signals are performed to eliminate the influence of sensor thermal noise.

[0009] Preferably, the operating modes of the communication transmission module include: In standard mode, when the detected electromagnetic interference intensity is below the electromagnetic interference intensity threshold and the transmission efficiency is greater than 0.75, the 5GHz frequency band is used for wireless transmission. Anti-interference mode: When the detected electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, it automatically switches to wired transmission and enables channel encryption. Emergency mode: When the main transmission link is interrupted, the Mesh network is activated for multi-hop relay transmission. The transmission efficiency calculation uses a normalized formula: ; in, For transmission efficiency, the transmission efficiency threshold is 0.75. When the transmission efficiency is greater than 0.75, the standard mode is activated. When the electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, the system switches to anti-interference mode. This is the bit error rate correction term. To measure the actual bit error rate, For bandwidth utilization, For throughput, Bandwidth, measured in Mbps. This represents the percentage of time spent on protocol overhead, by default. =0.1.

[0010] Preferably, the visualization module further includes: Augmented reality overlay unit, used to overlay device status information onto the real-time screen in AR format; The multi-view synchronization unit ensures that the content on different display terminals maintains consistent timestamps. The intelligent layout unit automatically adjusts the information arrangement priority and display ratio according to the user's role.

[0011] Preferably, the method includes the following steps: S1. Simultaneously acquire video, audio, and infrared signals of the target area through a multimodal sensor array, while detecting ambient light and electromagnetic parameters; S2. Perform time-domain alignment and format standardization on the acquired raw signals to eliminate time deviations between different sensors; S3. Extract the feature vectors of each modal signal, including motion features in video, voiceprint features in audio, and temperature distribution features in infrared. S4. Based on deep neural networks, multimodal features are fused to generate a comprehensive feature representation with spatiotemporal consistency; S5. Dynamically calculate transmission efficiency based on current network conditions. The transmission efficiency threshold is 0.75. Standard mode is activated when the transmission efficiency is greater than 0.75 and the electromagnetic interference intensity is lower than the electromagnetic interference intensity threshold. The standard mode is activated when the electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold. When the value is less than 0.75, switch to anti-interference mode; when the main link is interrupted, activate emergency mode. S6. Intelligent layout of multimodal information in a visual interface, supporting interactive user operation and display parameter adjustment; S7. Monitors the operating status of each component of the system in real time, and automatically activates the fault tolerance mechanism when an anomaly is detected.

[0012] Preferably, step S1, which involves simultaneously acquiring video, audio, and infrared signals of the target area using a multimodal sensor array while detecting ambient light and electromagnetic parameters, includes: Various sensors are triggered synchronously according to the preset sampling frequency to ensure the consistency of data acquisition time; The camera gain and infrared sensor sensitivity are automatically adjusted according to the ambient light intensity. Create a raw data packet with timestamps to record the acquisition parameters and status information of each sensor.

[0013] Preferably, the process of S3 extracting feature vectors for each modal signal, including motion features in video, voiceprint features in audio, and temperature distribution features in infrared, includes: Video feature extraction: 3D convolutional neural networks are used to extract spatiotemporal features from video sequences, including motion trajectories and object shapes; Audio feature extraction: Speech content is analyzed using Mel frequency cepstral coefficients, while abnormal sounds are detected; Infrared feature extraction: Identify temperature anomaly regions based on region growing algorithm and calculate thermal radiation distribution gradient.

[0014] Preferably, the process of S4, which fuses multimodal features based on a deep neural network to generate a comprehensive feature representation with spatiotemporal consistency, includes: Establish a multimodal feature association matrix and calculate the similarity weights between features of different modalities; The fusion ratio of each modality feature is dynamically adjusted through an attention mechanism; Generate a unified time-space-feature three-dimensional tensor representation that preserves the hierarchical relationship of the original signal.

[0015] Preferably, the fault tolerance mechanism in step S7 includes: Sensor failure handling: When a sensor fails, virtual signal generation based on generative adversarial networks is enabled; Network interruption handling: During communication interruptions, critical data is cached locally, and non-critical data is compressed and stored. Display anomaly handling: When the main display unit fails, the content is automatically migrated to the backup display terminal.

[0016] Compared with the prior art, the present invention provides a visual communication system and its operation method based on low-voltage engineering, which has the following beneficial effects: 1. In this invention, by synchronously acquiring video, audio, and infrared signals and detecting environmental electromagnetic parameters in real time, the integrity and time synchronization of the acquisition of different signal sources are ensured. At the same time, adaptive filtering technology is used to process the original signal, which can reduce signal distortion caused by motion blur and electromagnetic interference, ensure the acquisition quality of multimodal data, and further reduce the bit error rate of the communication system.

[0017] 2. In this invention, when transmitting data in real time in a low-voltage engineering environment, the wired and wireless transmission modes are dynamically switched according to the intensity of electromagnetic interference. The channel quality is evaluated in real time and the optimal transmission strategy is selected, so that the system can maintain a stable communication link in a strong interference environment. When the transmission link is interrupted, the Mesh network is automatically activated for multi-hop relay to ensure the continuity and reliability of the communication process.

[0018] 3. In this invention, when displaying multi-source information, the information layout priority is automatically adjusted according to the user role and operation requirements, and augmented reality technology is used to overlay equipment status information, so that the system can display key monitoring data, reduce the cognitive load of operators, and further improve human-computer interaction efficiency and emergency response speed. Attached Figure Description

[0019] Figure 1 This is a schematic diagram of the architecture of a visual communication system based on low-voltage engineering according to the present invention; Figure 2 This is a flowchart illustrating the steps of a visual communication operation method based on low-voltage engineering according to the present invention. Detailed Implementation

[0020] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0021] Please see Figure 1-2, A visual communication system based on a weak current project and its operation method. The system includes: A signal acquisition module that synchronously acquires video, audio, and infrared signals in the target area using a multi-modal sensor unit, obtains environmental light and electromagnetic parameters through an environmental parameter detection unit, and outputs standardized acquisition data by a signal preprocessing unit; A data processing module that receives the standardized acquisition data, analyzes multi-modal signal features through a feature extraction unit, performs spatio-temporal alignment processing using a data fusion unit, and outputs fusion data through system performance evaluation; A communication transmission module that receives the fusion data, distributes the data through a dual-channel transmission network composed of a wired transmission unit and a wireless transmission unit, and has three working modes: a standard mode, when the detected electromagnetic interference intensity is lower than the electromagnetic interference intensity threshold and the transmission efficiency is greater than 0.75, wireless transmission is performed using the 5GHz frequency band; an anti-interference mode, when the detected electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, it automatically switches to wired transmission and enables channel encryption; an emergency mode, when the main transmission link is interrupted, a Mesh network is enabled for multi-hop relay transmission; A visualization presentation module that receives transmission status data, realizes information partition presentation through a multi-screen display unit, responds to user operation instructions using an interactive control unit, and dynamically adjusts display parameters through a layout optimization unit; A system control module that coordinates the operation processes of each module, realizes task scheduling through a central control unit, monitors the system health status using a self-check and maintenance unit, and outputs control instructions through an exception handling unit; The multi-modal sensor unit includes: A high-definition camera array arranged at key positions in the target area, which uses the H.265 encoding format to real-time collect video streams with a resolution of 1080P or higher; A directional microphone array that uses beamforming technology to achieve audio collection in a specific direction and has an echo cancellation function; An infrared thermal imager with a thermal imaging ability of temperature sensitivity of 0.05°C, which can generate a thermal map of 256×256 pixels; Among them, the system performance evaluation uses a normalization formula: ; Among them, is the normalized quality coefficient, and when the threshold ≥0.6, it is determined to be qualified, is the normalized signal-to-noise ratio, is the measured value of the signal-to-noise ratio, with the unit of dB, is the normalized bandwidth, is the measured value of the bandwidth, with the unit of MHz, is the environmental correction factor, with a default = 1.0. When the temperature and humidity exceed the standard, it is calculated according to = 0.9; The operations performed by the signal preprocessing unit include: Perform adaptive filtering processing on the video signal based on the spatio-temporal domain to eliminate the influence of motion blur and sudden illumination changes; Perform spectral analysis and background noise suppression on the audio signal, and retain the frequency band of 200 Hz - 8 kHz; Perform non-uniformity correction and temperature calibration on the infrared signal to eliminate the influence of the sensor's own thermal noise; Among them, the signal processing efficiency evaluation uses a normalization formula: ; Among them, is the normalized fidelity, and the threshold ≥ 0.92 is judged as qualified, is the normalized video frame after processing, and the pixel values are scaled to [0, 1], is the normalized original video frame, and the pixel values are scaled to [0, 1], is the L2 norm calculation; The working modes of the communication transmission module include: Standard mode. When the detected electromagnetic interference intensity is lower than the electromagnetic interference intensity threshold and the transmission efficiency is greater than 0.75, wireless transmission is performed using the 5 GHz frequency band; Anti-interference mode. When the detected electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, it automatically switches to wired transmission and enables channel encryption; Emergency mode. When the main transmission link is interrupted, the Mesh network is enabled for multi-hop relay transmission; Among them, the transmission efficiency calculation uses a normalization formula: ; Among them, is the transmission efficiency, the transmission efficiency threshold is 0.75, the standard mode is enabled when the transmission efficiency is greater than 0.75, and it switches to the anti-interference mode when the electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, is the error rate correction term, is the measured error rate, is the bandwidth utilization rate, is the throughput, is the bandwidth, with the unit of Mbps, is the proportion of protocol overhead time, with a default = 0.1; The visualization presentation module also includes: Augmented reality overlay unit, used to overlay device status information onto the real-time screen in AR format; The multi-view synchronization unit ensures that the content on different display terminals maintains consistent timestamps. Intelligent layout units automatically adjust the information arrangement priority and display ratio according to the user's role; The display quality index uses a normalized model: ; in, For normalized quality index, threshold ≥3.2 is considered excellent. The normalized weight of the k-th parameter. =1, For the normalized measurement value of the k-th parameter, To normalize the response delay, The unit is seconds. To normalize the resolution, The unit is megapixels; The method includes the following steps: S1. Simultaneously acquire video, audio, and infrared signals of the target area through a multimodal sensor array, while detecting ambient light and electromagnetic parameters; S2. Perform time-domain alignment and format standardization on the acquired raw signals to eliminate time deviations between different sensors; S3. Extract the feature vectors of each modal signal, including motion features in video, voiceprint features in audio, and temperature distribution features in infrared. S4. Based on deep neural networks, multimodal features are fused to generate a comprehensive feature representation with spatiotemporal consistency; S5. Dynamically calculate transmission efficiency based on current network conditions. The transmission efficiency threshold is 0.75. Standard mode is activated when the transmission efficiency is greater than 0.75 and the electromagnetic interference intensity is lower than the electromagnetic interference intensity threshold. The standard mode is activated when the electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold. When the value is less than 0.75, switch to anti-interference mode; when the main link is interrupted, activate emergency mode. S6. Intelligent layout of multimodal information in a visual interface, supporting interactive user operation and display parameter adjustment; S7. Monitor the operating status of each component of the system in real time, and automatically start the fault tolerance mechanism when an anomaly is detected; The feature fusion efficiency normalization model is as follows: ; in, ∈(0,1) represents the normalized fusion efficiency, and the threshold is... ≥0.88, The normalized weights for the m-th mode are... , Let m be the normalized confidence level of the m-th mode; S1 synchronously acquires video, audio, and infrared signals from the target area using a multimodal sensor array, while simultaneously detecting ambient light and electromagnetic parameters. The process includes: Various sensors are triggered synchronously according to the preset sampling frequency to ensure the consistency of data acquisition time; The camera gain and infrared sensor sensitivity are automatically adjusted according to the ambient light intensity. Create a raw data packet with timestamps to record the acquisition parameters and status information of each sensor; The process by which S3 extracts feature vectors from each modality of signal, including motion features in video, voiceprint features in audio, and temperature distribution features in infrared, includes: Video feature extraction: 3D convolutional neural networks are used to extract spatiotemporal features from video sequences, including motion trajectories and object shapes; Audio feature extraction: Speech content is analyzed using Mel frequency cepstral coefficients, while abnormal sounds are detected; Infrared feature extraction: Identify temperature anomaly regions based on region growing algorithm and calculate thermal radiation distribution gradient; The feature completeness normalization index is: ; in, For normalization completeness, the threshold ≥0.95, The normalized weights for the i-th type of feature are... To normalize mutual information; S4's process of fusing multimodal features based on deep neural networks to generate a comprehensive feature representation with spatiotemporal consistency includes: Establish a multimodal feature association matrix and calculate the similarity weights between features of different modalities; The fusion ratio of each modality feature is dynamically adjusted through an attention mechanism; Generate a unified time-space-feature three-dimensional tensor representation that preserves the hierarchical relationship of the original signal; The fault tolerance mechanism in step S7 includes: Sensor failure handling: When a sensor fails, virtual signal generation based on generative adversarial networks is enabled; Network interruption handling: During communication interruptions, critical data is cached locally, and non-critical data is compressed and stored. Display anomaly handling: When the main display unit fails, the content is automatically migrated to the backup display terminal; The fault tolerance efficiency normalization model is as follows: ; in, To normalize fault tolerance performance, the threshold ≥0.94, To normalize the recovery time, The unit is seconds. Let j be the normalized recovery success rate of the j-th fault. For normalized complexity factor, This represents the proportion of normalized redundant resources.

[0022] The operation steps of a visual communication system based on low-voltage engineering and its operation method are as follows: Step 1: Environmental Sensing and Data Acquisition After the system starts up, each sensor node synchronously collects environmental data according to the preset sampling frequency. The high-definition camera captures the video stream of the monitored area in real time, the directional microphone array uses beamforming technology to focus on the direction of a specific sound source, the infrared thermal imager continuously scans the temperature distribution, and at the same time, the environmental detection unit measures the light intensity, temperature, humidity and electromagnetic interference parameters in real time to provide an environmental benchmark for subsequent signal processing.

[0023] Step 2: Multi-source signal preprocessing The collected raw data is first processed for temporal alignment. The millisecond-level time deviation between different sensors is eliminated by hardware timestamps and software interpolation algorithms. The video signal is subjected to spatiotemporal adaptive filtering to reduce image blur caused by device movement and sudden changes in lighting. The audio signal is subjected to spectrum analysis and noise suppression to preserve the human voice frequency band. The infrared data is subjected to non-uniformity correction and temperature calibration to ensure the accuracy of the heat map.

[0024] Step 3: Intelligent Feature Extraction The preprocessed data is fed into the feature extraction engine. The video analysis module uses a 3D convolutional neural network to extract motion trajectories and abnormal behavior features from continuous frame sequences. The audio processing module uses Mel-frequency cepstral coefficient analysis to identify specific voiceprints and abnormal sounds. The infrared analysis module uses a region growing algorithm to mark temperature anomaly areas and calculate thermal radiation gradients. The feature vectors output by each module are accompanied by confidence scores.

[0025] Step 4: Dynamic Data Fusion After the feature data enters the fusion center, the system first assesses the channel quality in the current environment. When the electromagnetic interference is low, the wireless transmission mode is enabled. If the transmission efficiency threshold is exceeded, the system automatically switches to the wired channel. The fusion algorithm dynamically adjusts the weights according to the confidence of each modality feature and achieves spatiotemporal alignment through the attention mechanism. Finally, it generates a comprehensive situational representation that includes multi-dimensional information such as video, audio, and temperature.

[0026] Step 5: Adaptive Visualization The merged data is intelligently laid out according to user roles and task requirements. Key monitoring information is overlaid on the real-time screen in augmented reality form. Multiple displays keep the content updated synchronously. The system continuously monitors the operator's interactive behavior. When it detects frequent retrieval of a certain type of data, it automatically increases the display priority and detail of that information.

[0027] Step Six: Autonomous Fault Tolerance and Optimization The system diagnoses the status of each component in real time through a health monitoring module. When a sensor malfunctions, it immediately activates virtual signal generation based on generative adversarial networks. When the network is interrupted, it starts a local caching and compression transmission mechanism. When an anomaly is displayed, it automatically migrates the content to a backup terminal. At the same time, the system records performance indicators during operation and continuously optimizes parameter configuration through machine learning algorithms.

[0028] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0029] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A visual communication system based on low-voltage engineering, characterized in that: include: The signal acquisition module uses a multimodal sensor unit to simultaneously acquire video, audio, and infrared signals from the target area, obtains ambient light and electromagnetic parameters through an environmental parameter detection unit, and outputs standardized acquisition data through a signal preprocessing unit. The data processing module receives the standardized collected data, analyzes the multimodal signal features through the feature extraction unit, performs spatiotemporal alignment processing using the data fusion unit, and outputs the fused data through system performance evaluation. The communication transmission module receives the fused data and distributes it through a dual-channel transmission network consisting of wired and wireless transmission units. It has three working modes: standard mode, anti-interference mode, and emergency mode. In standard mode, when the detected electromagnetic interference intensity is lower than the electromagnetic interference intensity threshold and the transmission efficiency is greater than 0.75, it uses the 5GHz frequency band for wireless transmission. In anti-interference mode, when the detected electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, it automatically switches to wired transmission and enables channel encryption. In emergency mode, when the main transmission link is interrupted, it enables multi-hop relay transmission using a Mesh network. The visualization module receives transmitted status data, displays information in partitions through a multi-screen display unit, responds to user operation commands using an interactive control unit, and dynamically adjusts display parameters through a layout optimization unit. The system control module coordinates the operation of each module, performs task scheduling through the central control unit, monitors the system health status through the self-test and maintenance unit, and outputs control commands through the anomaly handling unit.

2. The visual communication system based on low-voltage engineering according to claim 1, characterized in that: The multimodal sensor unit includes: A high-definition camera array is deployed at key locations in the target area, using H.265 encoding format to capture video streams at resolutions of 1080P and above in real time. A directional microphone array uses beamforming technology to achieve audio acquisition in a specific direction and has echo cancellation capabilities; The infrared thermal imager has a thermal imaging capability with a temperature sensitivity of 0.05℃ and can generate a 256×256 pixel thermal map. The system performance evaluation uses a normalized formula: ； Among them, is the normalized quality coefficient, and the threshold is judged to be qualified when ≥ 0.

6. is the normalized signal-to-noise ratio, is the measured signal-to-noise ratio value, with the unit of dB. is the normalized bandwidth, is the measured bandwidth value, with the unit of MHz. is the environment correction factor, with the default = 1.

0. When the temperature and humidity exceed the standard, it is calculated according to = 0.

9.

3. A visual communication system based on low-voltage engineering according to claim 1, characterized in that: The operations performed by the signal preprocessing unit include: Adaptive filtering based on the spatiotemporal domain is applied to the video signal to eliminate the effects of motion blur and sudden changes in illumination. Perform spectral analysis and background noise suppression on the audio signal, preserving the 200Hz-8kHz frequency band; Non-uniformity correction and temperature calibration of infrared signals are performed to eliminate the influence of sensor thermal noise.

4. A visual communication system based on low-voltage engineering according to claim 1, characterized in that: The operating modes of the communication transmission module include: In standard mode, when the detected electromagnetic interference intensity is below the electromagnetic interference intensity threshold and the transmission efficiency is greater than 0.75, the 5GHz frequency band is used for wireless transmission. Anti-interference mode: When the detected electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, it automatically switches to wired transmission and enables channel encryption. Emergency mode: When the main transmission link is interrupted, the Mesh network is activated for multi-hop relay transmission. The transmission efficiency calculation uses a normalized formula: ； in, For transmission efficiency, the transmission efficiency threshold is 0.

75. When the transmission efficiency is greater than 0.75, the standard mode is activated. When the electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold and the transmission efficiency is less than 0.75, the system switches to anti-interference mode. This is the bit error rate correction term. To measure the actual bit error rate, For bandwidth utilization, For throughput, Bandwidth, measured in Mbps. This represents the percentage of time spent on protocol overhead, by default. =0.

1.

5. A visual communication system based on low-voltage engineering according to claim 1, characterized in that: The visualization module also includes: Augmented reality overlay unit, used to overlay device status information onto the real-time screen in AR format; The multi-view synchronization unit ensures that the content on different display terminals maintains consistent timestamps. The intelligent layout unit automatically adjusts the information arrangement priority and display ratio according to the user's role.

6. A visual communication operation method based on low-voltage engineering, characterized in that: The method includes the following steps: S1. Simultaneously acquire video, audio, and infrared signals of the target area through a multimodal sensor array, while detecting ambient light and electromagnetic parameters; S2. Perform time-domain alignment and format standardization on the acquired raw signals to eliminate time deviations between different sensors; S3. Extract the feature vectors of each modal signal, including motion features in video, voiceprint features in audio, and temperature distribution features in infrared. S4. Based on deep neural networks, multimodal features are fused to generate a comprehensive feature representation with spatiotemporal consistency; S5. Dynamically calculate transmission efficiency based on current network conditions. The transmission efficiency threshold is 0.

75. Standard mode is activated when the transmission efficiency is greater than 0.75 and the electromagnetic interference intensity is lower than the electromagnetic interference intensity threshold. The standard mode is activated when the electromagnetic interference intensity exceeds the electromagnetic interference intensity threshold. When the value is less than 0.75, switch to anti-interference mode; when the main link is interrupted, activate emergency mode. S6. Intelligent layout of multimodal information in a visual interface, supporting interactive user operation and display parameter adjustment; S7. Monitors the operating status of each component of the system in real time, and automatically activates the fault tolerance mechanism when an anomaly is detected.

7. The visual communication operation method based on low-voltage engineering according to claim 6, characterized in that: The process of S1 synchronously acquiring video, audio, and infrared signals of the target area through a multimodal sensor array, while simultaneously detecting ambient light and electromagnetic parameters, includes: Various sensors are triggered synchronously according to the preset sampling frequency to ensure the consistency of data acquisition time; The camera gain and infrared sensor sensitivity are automatically adjusted according to the ambient light intensity. Create a raw data packet with timestamps to record the acquisition parameters and status information of each sensor.

8. A visual communication operation method based on low-voltage engineering according to claim 6, characterized in that: The process of S3 extracting feature vectors for each modal signal, including motion features in video, voiceprint features in audio, and temperature distribution features in infrared, includes: Video feature extraction: 3D convolutional neural networks are used to extract spatiotemporal features from video sequences, including motion trajectories and object shapes; Audio feature extraction: Speech content is analyzed using Mel frequency cepstral coefficients, while abnormal sounds are detected; Infrared feature extraction: Identify temperature anomaly regions based on region growing algorithm and calculate thermal radiation distribution gradient.

9. A visual communication operation method based on low-voltage engineering according to claim 6, characterized in that: The process of S4, which fuses multimodal features based on a deep neural network to generate a comprehensive feature representation with spatiotemporal consistency, includes: Establish a multimodal feature association matrix and calculate the similarity weights between features of different modalities; The fusion ratio of each modality feature is dynamically adjusted through an attention mechanism; Generate a unified time-space-feature three-dimensional tensor representation that preserves the hierarchical relationship of the original signal.

10. A visual communication operation method based on low-voltage engineering according to claim 6, characterized in that: The fault tolerance mechanism in S7 includes: Sensor failure handling: When a sensor fails, virtual signal generation based on generative adversarial networks is enabled; Network interruption handling: During communication interruptions, critical data is cached locally, and non-critical data is compressed and stored. Display anomaly handling: When the main display unit fails, the content is automatically migrated to the backup display terminal.

Images