AR intelligent terminal supporting multi-sensor fusion inspection and inspection method

Abstract

The invention discloses an AR intelligent terminal supporting multi-sensor fusion routing inspection and a routing inspection method, and relates to the technical field of industrial intelligent routing inspection, and the method comprises the following steps: collecting time information and electromagnetic interference signs of a routing inspection site, generating an interference record manuscript based on the collected data, and establishing a time correlation between a routing inspection time sequence and an interference event; time analysis is carried out according to the interference record manuscript, the starting moment and the ending moment of electromagnetic pulse interference are identified, a data backhaul disorder suspected list is generated based on an analysis result, and the communication time period influenced by the interference is determined. According to the invention, by establishing an interference record manuscript and time correlation analysis, real-time identification and disorder correction of Bluetooth signals under electromagnetic interference are realized, and continuous and stable collection and uploading of inspection data are ensured; and by generating a time rhythm adjusting draft, the cooperative rhythm of the terminal, the relay and the acquisition end is dynamically adjusted, the interference influence is weakened, the data return sequence and time sequence matching are optimized, and the inspection time sequence accuracy and the system reliability are improved.

Description

Technical Field

[0001] This invention relates to the field of industrial intelligent inspection technology, specifically to an AR intelligent terminal and inspection method that supports multi-sensor fusion inspection. Background Technology

[0002] AR intelligent inspection supporting multi-sensor fusion refers to the use of smart glasses equipped with augmented reality technology as the core terminal during inspection operations. This allows for the simultaneous access of multiple types of sensors, including infrared temperature measurement, Bluetooth vibration measurement, visual recognition, voice input, and QR code recognition. Through real-time acquisition and fusion processing of multi-source data, a three-dimensional perception and dynamic analysis of equipment operating status is formed. Inspection personnel can directly overlay equipment information, inspection standards, warning prompts, and knowledge base content onto the AR interface, and instantly judge temperature anomalies, vibration deviations, or appearance defects based on algorithm recognition results. With edge computing and cloud-based collaborative support, the system can automatically upload multimodal data collected on-site to the backend for comparison, archiving, and remote expert collaboration. This achieves a closed-loop inspection approach from data acquisition and intelligent recognition to diagnostic decision-making, significantly improving the accuracy, efficiency, and intelligence level of inspections.

[0003] The existing technology has the following shortcomings: In existing multi-sensor fusion inspection technologies, when inspectors pass through high-voltage equipment areas, transient strong electromagnetic pulse interference is generated in the environment. This interference can easily affect the transmission stability of Bluetooth signals, causing reflections and delays in the wireless link. As a result, the equipment operation data uploaded by the sensors may be transmitted out of order within a short period of time. That is, data packets that should be received in chronological order are recorded by the system in an incorrect order, causing the time sequence of abnormal alarms to be reversed. This situation is more likely to occur during rapid changes in the high-voltage electric field or during the instant of equipment discharge. It not only interferes with the inspection system's correct judgment of the sequence of fault occurrences but also causes risks such as alarm event crosstalk, false triggering, or delayed response, thereby affecting the safety and accuracy of the inspection process.

[0004] The information disclosed in the background section is only intended to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] The purpose of this invention is to provide an AR smart terminal and inspection method that support multi-sensor fusion inspection, so as to solve the problems in the background art.

[0006] To achieve the above objectives, the present invention provides the following technical solution: an AR intelligent inspection method supporting multi-sensor fusion inspection, comprising the following steps: Collect time information and electromagnetic interference signs at the inspection site, generate interference record drafts based on the collected data, and establish the time correlation between inspection time sequence and interference events; Based on the interference record draft, time analysis is performed to identify the start and end times of electromagnetic pulse interference. Based on the analysis results, a list of suspected out-of-order data transmissions is generated to determine the communication periods affected by the interference. Based on the list of suspected out-of-order data transmission, the back-transmission delay trajectory of Bluetooth signals is tracked, abnormal intervals in the back-transmission order of Bluetooth data packets are identified, and out-of-order feature records are generated to characterize the specific time distribution of out-of-order data packets. Based on the analysis of the root cause of electromagnetic interference by recording out-of-order characteristics, the reflection echo time window of Bluetooth signals is decomposed, the change in data transmission delay is calculated, and a draft of timing adjustment is generated to guide timing correction. Based on the time rhythm adjustment draft, dynamic adjustment operations are performed to control the inspection terminal to perform Bluetooth signal transmission time slot flipping rhythm, control the relay node to perform echo absorption period adjustment, and control the data acquisition terminal to perform time code reverse order caching processing. This continuously optimizes the data transmission order and timing matching accuracy, thereby achieving time consistency and stability of inspection data under electromagnetic interference environment.

[0007] Preferably, the steps for generating the interference record draft are as follows: Initialize the time recording device and set a unified time reference; the time acquisition device continuously records the time information of the entire inspection process. Under a unified time reference, the changes in electric field strength, electric field fluctuation frequency, magnetic field direction change rate, wireless signal strength attenuation characteristics, and background noise amplitude fluctuations are detected, and interference signs are combined with time information to form a synchronized data set. Arrange the synchronized data groups in chronological order to create a timeline and divide it into interference-stable, interference-active, and interference-recovery segments. The time information and electromagnetic interference signs are summarized and organized to generate an interference record draft, which records the start time, end time, interference intensity change trend and interference impact range of the interference event.

[0008] Preferably, the steps for performing time analysis based on the interference record draft and generating a list of suspected out-of-order data for feedback are as follows: The interference events in the interference record draft are organized in chronological order, and the interference start time, interference duration node, interference end time and recovery time are extracted to construct a continuous interference timeline; Analyze the trend of interference signal strength over time on the interference time axis, determine the start time of the interference signal rising from the background level and the end time of its recovery to the background level, and record the start and end times of continuous pulse interference. By analyzing the correlation between the interference time interval and the Bluetooth communication time record, and by comparing the overlap between the communication transmission time, reception time and the interference interval, the communication period affected by interference can be identified. The communication periods affected by interference are sorted in chronological order to generate a list of suspected out-of-order data return data, which includes the interference event number, start and end time, communication transmission and reception time, delay duration, and communication delay magnitude.

[0009] Preferably, when generating a list of suspected out-of-order data transmission, the time difference between the peak time of the interference signal and the time of the increase in communication delay is recorded, and the change in time difference is used as the basis for judging the characteristics of communication delay. The communication period in which the delay fluctuation occurs continuously is divided into independent suspected out-of-order segments, and the impact range of data transmission out-of-order is determined based on the time correspondence between the trend of the change in interference signal intensity and the trend of the change in communication delay.

[0010] Preferably, the steps for tracking Bluetooth signal backhaul delay trajectories and generating out-of-order feature records based on the list of suspected out-of-order data transmissions are as follows: The communication events in the suspected out-of-order data return list are unfolded in the order of transmission time, and the interference start time, interference end time, data packet transmission time, reception time, delay duration and delay recovery time are recorded to construct a continuous Bluetooth communication time chain; Based on the interference start time, the Bluetooth signal return delay trajectory is tracked segment by segment, the start time, duration and recovery time of the delay are recorded, and a delay trajectory curve is formed on the time axis. The reception times of each data packet in the delay trajectory are compared sequentially to identify the abnormal interval where the subsequent data packet is received earlier than the previous data packet, and the interference intensity, duration and data packet number involved in the abnormal interval are recorded. All abnormal intervals are summarized to generate out-of-order feature records with the time axis as the main line, recording the duration of the out-of-order sequence, the change in interference intensity, and the recovery time of the transmission order.

[0011] Preferably, the steps for analyzing the root causes of electromagnetic interference based on disordered characteristic records and generating a draft for time rhythm adjustment are as follows: The interference time distribution, disorder duration interval, delay trajectory curve and interference intensity change characteristics in the disorder feature records are sorted out to identify the root cause of electromagnetic interference and establish the time correspondence between the interference source and the delay change. The propagation process of Bluetooth signals is analyzed in a time-division manner. The time window of the reflected echo is identified based on the peak value of the received signal, and the primary reflected wave, secondary reflected wave and multiple superimposed reflected wave are distinguished. The change in data transmission delay is calculated based on the reflected echo time window, and the delay change trends during the interference rise, peak, attenuation and recovery phases are recorded. Based on the analysis results of interference time patterns, a draft time rhythm adjustment is generated and the time offset value, the time of transmission rhythm switching and the smooth period of reception rhythm are recorded.

[0012] Preferably, during the generation of the timing adjustment draft, the timing adjustment range is determined based on the start time, peak time, and end time of the interference event. By increasing the transmission interval to reduce echo overlap, shortening the data packet transmission interval to achieve stable backhaul, and extending the signal reception interval to absorb the residual effect of the echo, the backhaul start time is adjusted synchronously, so that the Bluetooth signal backhaul rhythm can achieve timing coordination and recovery stability at different interference stages.

[0013] Preferably, the dynamic adjustment steps for the draft based on time rhythm are as follows: Based on the time rhythm adjustment draft, the inspection terminal controls the Bluetooth signal transmission time slot flipping rhythm, avoids the high-energy range of interference signals by exchanging adjacent transmission time slots, and records the flipping start time, duration and end time. Based on the interference duration and echo delay characteristics recorded in the draft time rhythm adjustment, the relay node is controlled to perform echo absorption period adjustment, which extends the absorption period in the early stage of interference, separates the reception and absorption windows in the peak stage of interference, and gradually restores the reception rhythm in the interference attenuation stage. Based on the time rhythm, the time code arrangement rules of the draft are adjusted to control the data acquisition end to perform time code reverse caching. The reverse caching restores the data transmission order and records the cache start time and output time. The timing of Bluetooth signal transmission and the order of data transmission are optimized by comparing and adjusting the time records of the terminal, relay node and acquisition end.

[0014] An AR smart terminal supporting multi-sensor fusion inspection includes an interference information acquisition module, a time analysis module, a delay trajectory tracking module, an interference analysis and timing modeling module, and a dynamic adjustment and control module. The interference information acquisition module collects time information and electromagnetic interference signs at the inspection site, generates an interference record draft based on the collected data, and establishes a time correlation between the inspection sequence and interference events. The time analysis module performs time analysis based on the interference record draft, identifies the start and end times of electromagnetic pulse interference, generates a list of suspected out-of-order data transmissions based on the analysis results, and determines the communication periods affected by the interference. The delay trajectory tracking module tracks the return delay trajectory of Bluetooth signals based on a list of suspected out-of-order data transmissions, identifies abnormal intervals in the Bluetooth data packet return order, and generates out-of-order feature records to characterize the specific time distribution of data packet out-of-order. The interference analysis and timing modeling module analyzes the root causes of electromagnetic interference based on out-of-order characteristic records, decomposes the reflection echo time window of Bluetooth signals, calculates the change in data transmission delay, and generates a timing adjustment draft to guide timing correction. The dynamic adjustment and control module performs dynamic adjustment operations based on the time rhythm adjustment draft, controls the inspection terminal to perform Bluetooth signal transmission time slot flipping rhythm, controls the relay node to perform echo absorption period adjustment, and controls the data acquisition terminal to perform time code reverse order caching processing, continuously optimizing the data transmission order and timing matching accuracy, and realizing the time consistency and stability of inspection data in electromagnetic interference environment.

[0015] The technical effects and advantages provided by the present invention in the above technical solution are as follows: This invention establishes an interference log during inspections and performs time correlation analysis, enabling real-time identification and timing of Bluetooth signals affected by electromagnetic interference. By accurately identifying the start and end times of interference and tracking the Bluetooth signal return delay trajectory, it can promptly detect abnormal data return order and generate out-of-order characteristic records after interference occurs. This allows for rapid detection and correction of out-of-order issues during the data upload phase, ensuring that the inspection terminal maintains time synchronization even in electromagnetic interference environments and guaranteeing continuous and stable data collection and upload processes.

[0016] This invention establishes a time-level coordinated adjustment mechanism among inspection terminals, relay nodes, and data acquisition terminals by generating a draft time rhythm adjustment mechanism and executing dynamic adjustment operations. The Bluetooth signal transmission rhythm, echo absorption period, and data buffering order of the terminals are adjusted in real time in interference environments, effectively reducing the impact of electromagnetic interference on signal transmission. By continuously optimizing the order and matching accuracy of data feedback, the inspection data maintains complete time consistency when uploaded to the backend, thereby improving the timing accuracy and operational reliability of multi-sensor fusion inspection. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this invention. For those skilled in the art, other drawings can be obtained based on these drawings.

[0018] Figure 1 This is a flowchart of an AR intelligent inspection method that supports multi-sensor fusion inspection according to the present invention.

[0019] Figure 2 This is a schematic diagram of an AR smart terminal that supports multi-sensor fusion inspection according to the present invention. Detailed Implementation

[0020] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that the description of this disclosure will be more complete and fully convey the concept of the exemplary embodiments to those skilled in the art.

[0021] This invention provides, for example Figure 1 The AR intelligent inspection method shown includes the following steps: (This section is incomplete and requires further context.) Collect time information and electromagnetic interference signs at the inspection site, generate interference record drafts based on the collected data, and establish the time correlation between inspection time sequence and interference events; During implementation, to establish an accurate correspondence between the inspection site's time series and electromagnetic interference events, a series of steps were taken to comprehensively collect and organize the inspection site's time information and electromagnetic interference indicators. The entire process, centered on time synchronization and based on the actual changes in the interference signal, formed a complete operational workflow, from acquiring the original signal, constructing time correlations, extracting interference features, to generating the final interference record. The specific steps are as follows: Before the inspection begins, the time recording devices at the inspection site are initialized, and a unified time reference is set. During the inspection, the time acquisition devices continuously record time information from the start to the end of the inspection. This time information includes the start time of the inspection, the time when inspection personnel arrive at different equipment areas, the start and stop times of the sensors, the specific times of sensor data upload and storage, the intervals between inspection task switching, and the trigger times for voice or image data acquisition. Under the same time reference, the electromagnetic interference monitoring device operates synchronously, continuously detecting changes in the electromagnetic environment at the site. Monitoring includes instantaneous changes in electric field strength, electric field fluctuation frequency, rate of change of magnetic field direction, periodic attenuation characteristics of wireless signal strength, and amplitude fluctuations of background noise. The electromagnetic interference indicators collected at each time point, together with the corresponding time information, constitute a synchronized data set. All synchronized data sets are recorded continuously, forming a raw dataset arranged in chronological order, providing a continuous time basis for subsequent analysis.

[0022] After completing the initial data acquisition, the time information and electromagnetic interference (EMI) indicators underwent preliminary organization and structuring. First, the time records were arranged in the order of acquisition, forming a complete timeline. Then, EMI indicators were mapped one-to-one with the timeline based on their acquisition time, including the time of interference occurrence, amplitude changes in the interference signal, the duration of the interference, the equipment status at the time of interference, and the location of the inspection personnel. Based on this, the interference situation was divided into different time periods on the timeline, dividing the entire inspection process into a stable period before interference, an active period during interference, and a recovery period after interference. The start and end times of each time period, the corresponding trend of interference intensity changes, and the corresponding inspection operation status were all recorded in detail. This method created an ordered data record structure with time as the main thread and interference status as the identifier, ensuring the continuity and completeness of subsequent interference event analysis.

[0023] After the initial establishment of the timeline and interference records, feature extraction and event labeling were performed on electromagnetic interference signs within different time periods. By comparing the differences in the rate of change of electric field intensity, amplitude of change of magnetic field, stability of wireless signal, and duration of interference at adjacent time points on the timeline, the specific time points of interference events were identified. For each interference sign, the start time of interference, the time of interference peak occurrence, the time of interference end, and the duration of interference impact were recorded. If multiple interference events occurred within the same time period, the time location, interference amplitude, duration, and corresponding inspection behavior of each event were sequentially labeled, such as equipment photography, voice input, and data upload. Through this one-to-one correspondence between time points and interference signs, a complete sequence of interference events was formed. This sequence not only records the time of interference occurrence but also reflects the correspondence between interference and specific inspection operations, creating a one-to-one time match between interference events and inspection behaviors.

[0024] After the time information and interference signs are matched and labeled, all the compiled results are summarized and standardized to generate an interference record draft. The interference record draft uses time as the primary index and interference events as sub-items, recording all electromagnetic interference events that occurred during the inspection process. The draft includes the start time, end time, interference intensity change trend, interference impact range, corresponding inspection stage, related operation type, equipment status description, and time status before and after the interference for each interference event. The draft also records the time intervals between interference events and the distribution pattern of interference events throughout the inspection process, thus reflecting the overall impact of the electromagnetic environment on the stability of the inspection signal transmission. The interference record draft established in this way not only possesses complete time information but also a clear event structure, making the interference trajectory during the inspection process traceable and analyzable. This provides a temporal basis and logical support for subsequent tracing of data disorder issues, timing adjustment, and signal delay analysis.

[0025] Based on the interference record draft, time analysis is performed to identify the start and end times of electromagnetic pulse interference. Based on the analysis results, a list of suspected out-of-order data transmissions is generated to determine the communication periods affected by the interference. Based on the interference log, time analysis is conducted to identify the start and end times of electromagnetic pulse interference. Then, based on the analysis results, a list of suspected out-of-order data transmissions is generated, and the communication periods affected by the interference are determined. The entire process follows a rigorous time series analysis approach. The specific implementation steps are as follows: After obtaining the interference record draft, all interference events contained in the draft are comprehensively organized to construct a continuous interference time series based on time. This organization process includes arranging each interference event in chronological order and extracting the start time, time nodes during the interference duration, interference end time, and recovery time recorded for each event. To ensure the continuity of the time series, time intervals between adjacent interference events are filled in, and undisturbed intervals are marked as stable intervals. For interference events with partial temporal overlap, the boundary moments of the interference intervals are determined by comparing the intersection points of the interference intensity curves one by one, and recorded in the time series as time markers, enabling subsequent time analysis to distinguish the overlapping effects of different interference events. Through this process, a complete interference time axis is formed, covering the entire inspection process and reflecting the distribution characteristics of interference events in the time dimension and their relationship with the inspection process.

[0026] After establishing a complete timeline, each interference event on the timeline is analyzed in detail to identify the start and end times of the interference signal. During the analysis, based on the electromagnetic interference indications recorded in the interference log, the signal changes of each interference event on the timeline are observed point by point. By comparing the trend of interference signal intensity changes over time, the point at which the interference signal begins to rise rapidly from the background level is determined and defined as the start time of the electromagnetic pulse interference. Continuing the analysis along the timeline, the duration and fluctuation pattern of the interference signal in the peak range are observed. When the signal intensity gradually decreases and returns to the background level, this point is defined as the end time of the interference. For multiple consecutive pulse interference events in the electromagnetic environment, the start time, peak time, and end time of each pulse are recorded separately, and these time points are summarized to form a complete interference time sequence record. Through this process, the start and end boundaries of electromagnetic pulse interference on the timeline are precisely defined, providing a clear time reference for subsequent communication comparisons.

[0027] After identifying the start and end times of electromagnetic pulse interference, these time points are analyzed in relation to the communication time records during the data transmission process. The communication time records include the Bluetooth signal transmission time, signal reception time, acknowledgment time, and data transmission completion time. By comparing the interference time interval with the communication time interval segment by segment, the communication processes affected during the interference event can be determined. When the interference start time is earlier than a Bluetooth signal transmission time and the interference end time is later than the signal reception time, it indicates that the communication process occurred during the interference period, and this communication is identified as an interference-affected communication event. If the interference interval covers multiple communication cycles, the time stamp of each communication event is compared sequentially, and all communication processes overlapping with the interference time interval are recorded. During the comparison, the time difference between the peak time of the interference signal and the time of increased communication delay is also recorded to reflect the direct impact of the interference on the communication timing. Through this correspondence, the communication periods affected by interference are determined, and the start and end times of these periods are marked on the timeline.

[0028] After mapping the interference time intervals to the communication time intervals, all communication periods affected by interference are compiled to generate a suspected out-of-order data transmission list. This list is organized chronologically, with each record including the interference event number, interference start time, interference end time, corresponding transmission and reception times, delay duration, and communication delay magnitude. Each communication event affected by interference is numbered and categorized into a suspected out-of-order category based on its communication delay characteristics. Multiple communication events occurring within the same interference interval are arranged chronologically to form consecutive suspected out-of-order segments. The list also includes a comparison record of the trend of interference signal strength changes and the trend of communication delay changes, reflecting the temporal correlation between electromagnetic interference intensity and communication stability. If multiple consecutive communication events affected by interference exist on the same timeline, their time ranges are merged in the list to form a complete record of communication interference periods. Through this process, the final suspected out-of-order list comprehensively reflects the communication time periods where data transmission may be out of order under electromagnetic interference, providing detailed temporal information and event ranges for subsequent delay trajectory tracking and out-of-order correction.

[0029] Based on the list of suspected out-of-order data transmission, the back-transmission delay trajectory of Bluetooth signals is tracked, abnormal intervals in the back-transmission order of Bluetooth data packets are identified, and out-of-order feature records are generated to characterize the specific time distribution of out-of-order data packets. To track the Bluetooth signal return delay trajectory based on a suspected out-of-order data return list, thereby identifying abnormal intervals in the Bluetooth data packet return order and generating out-of-order feature records, a systematic analysis and continuous tracking of the Bluetooth communication time behavior during inspection is conducted. The entire process is based on the time information and communication records in the suspected out-of-order list, completely reconstructing the entire process of Bluetooth signal delay, out-of-order delivery, and recovery during interference in a time-dimensional manner. This ultimately forms feature records that reflect the distribution pattern of out-of-order data, which are used for subsequent interference root cause analysis and time correction. The specific implementation steps are as follows: After obtaining the list of suspected out-of-order data transmissions, each communication event listed in the list is analyzed in detail. The list includes the interference event number, interference start time, interference end time, the transmission time of the corresponding data packet, the reception time, the duration of the delay, and the recovery time. To ensure the completeness of time tracking, all communication events are arranged in chronological order of transmission time to construct a continuous Bluetooth communication time sequence. During the construction process, the transmission interval, reception interval, and time difference between adjacent data packets are recorded, and the interference background information corresponding to each data packet is labeled, including the trend of interference intensity changes and the duration of interference. In this way, the time distribution of Bluetooth communication events forms a continuous time chain throughout the inspection cycle, which fully reflects the temporal sequence of Bluetooth signal transmission, reception, and transmission under electromagnetic interference.

[0030] After obtaining a continuous communication time chain, delay tracking analysis is performed on the transmission status of Bluetooth signals in each time period. Starting from the interference initiation time, the changes in the time interval between Bluetooth data packets sent and received are observed segment by segment. For communication records before the interference occurs, the average time interval is extracted as a reference. After the interference event begins, the sending and receiving times of each data packet are continuously recorded, and the difference between their time intervals and the reference is calculated. During the observation process, each delay phenomenon is recorded as an independent delay event, specifying the initiation time, duration, and recovery time of the delay. If the interference persists, the delay trajectory is continuously recorded until communication returns to a stable state. For communication processes where delays persist after the interference ends, the recovery time is extended to the end of the stable interval after the interference ends to ensure that the record fully covers the entire time range affected by the interference. Through this continuous recording method, a Bluetooth signal delay trajectory curve can be formed on the time axis, reflecting the entire process of data packet transmission delay occurrence, duration, and recovery under interference.

[0031] After the delay trajectory is formed, the time anomalies reflected in the delay trajectory are compared sequentially and identified. The comparison process is based on the data packet transmission sequence, comparing the reception time of each data packet with the reception time of the preceding data packet one by one. When a later-transmitted data packet is received earlier than the previous data packet on the timeline, it is determined that the Bluetooth data packet return sequence is abnormal. After identifying the abnormal time period, the interference intensity, delay amplitude, number of data packets, and corresponding time range within that time period are marked. If multiple return sequence anomalies occur during the same interference event, the start time, end time, duration, and involved data packet number of each abnormal event are recorded separately, and the corresponding position is marked on the timeline. For continuous out-of-order situations occurring during the overlap of multiple interference events, these out-of-order events are merged into a whole abnormal interval according to the temporal continuity by comparing the time boundaries between different events. In this way, multiple Bluetooth data packet return sequence abnormal intervals can be formed on the timeline, so that each abnormal interval has a clear time range, interference background, and communication state characteristics.

[0032] After identifying abnormal intervals in the Bluetooth data packet return order, all abnormal intervals are summarized and structured to generate out-of-order feature records. These records, organized along a timeline and indexed by interference events, comprehensively record the time information, interference intensity changes, delay trajectory patterns, duration of out-of-order events, number of data packets involved, and return order recovery time for each abnormal interval. To reflect the temporal characteristics of the out-of-order distribution, out-of-order intervals are overlaid and compared with delay trajectories during the processing, extracting the correspondence between peak interference intensity and the time of out-of-order occurrence. For out-of-order phenomena that persist after the interference ends, recording continues until the data packet return order stabilizes, fully demonstrating the order recovery process after interference. The out-of-order feature records also include the frequency of out-of-order occurrence, temporal distribution density, and the time proportion of out-of-order intervals within the interference event, reflecting the persistence and concentration of electromagnetic interference's impact on Bluetooth signal order. All records are continuously arranged on the timeline, forming a complete out-of-order feature time graph, which visually demonstrates the temporal correspondence between interference occurrence, delay generation, order disorder, and order recovery.

[0033] Based on the analysis of the root cause of electromagnetic interference by recording out-of-order characteristics, the reflection echo time window of Bluetooth signals is decomposed, the change in data transmission delay is calculated, and a draft of timing adjustment is generated to guide timing correction. This study delves into the root causes of electromagnetic interference by recording out-of-order characteristics and decomposes the reflection echo time window of Bluetooth signals in the interference environment. It then calculates the change in data transmission delay and generates a draft timing adjustment plan to guide subsequent timing correction operations. The entire process unfolds along the time dimension, focusing on the occurrence patterns of interference events, signal propagation characteristics, delay variation trends, and timing adjustment strategies. It accurately identifies the root causes of interference, analyzes the multi-echo characteristics of the Bluetooth signal propagation path, and quantifies the temporal patterns of delay changes, ultimately resulting in a fully functional and executable timing adjustment draft. The specific implementation steps are as follows: After obtaining the disordered characteristic records, the interference time distribution, disordered duration interval, delay trajectory curve, and interference intensity variation over time contained in the records are systematically organized to identify the root cause of electromagnetic interference. During the analysis, records with high frequency of interference events, stable duration, and significant delay fluctuations are first extracted as the focus of research. By comparing the interference start time, interference peak time, and interference end time, the changing trends of interference intensity in three stages—growth, stabilization, and attenuation—are observed. On the same time axis, the interference intensity curve is superimposed with the Bluetooth signal delay curve to identify the overlapping area. When the interference intensity peak corresponds to the delay peak, it can be determined that the interference event directly affects the Bluetooth signal return timing. Further analysis, combined with spatial information from the inspection site, is conducted on the interference location and Bluetooth signal propagation path to confirm whether the interference signal originates from actual scenarios such as transient discharge of a high-voltage electric field, transformer start-up and shutdown, conductor surface corona, grounding fault, or local arc discharge. If the time correspondence between interference peak and delay peak occurs repeatedly in multiple inspections within the same area, it is determined that a stable electromagnetic interference source exists in that area. In this way, the root cause of abnormal Bluetooth signal transmission delay can be determined, and the time correspondence between the interference source and the delay change can be established.

[0034] After identifying the root cause of electromagnetic interference, a time-division analysis was performed on the propagation behavior of Bluetooth signals during interference to divide the time windows of reflected echoes. Using the Bluetooth signal transmission and reception times recorded in the out-of-order feature log as a benchmark, the signal propagation process was unfolded on a timeline. By observing multiple reception peaks during the Bluetooth signal reception process, the arrival times of different echoes were identified. The first reception peak represents the signal return time of the direct propagation path, and subsequent reception peaks correspond to the time points when the signal returns after being reflected by objects in the environment. To clarify the source of each reflected echo, a time correlation analysis was performed on the inspection environment at the time of interference. For example, reflection paths may be formed near metal equipment casings, pipe surfaces, steel structures, and high-voltage wires. By comparing the arrival times of different reflected waves with the time series of interference intensity changes, primary reflected waves, secondary reflected waves, and multiple superimposed reflected waves can be distinguished. Primary reflected waves usually appear in the rising phase of the interference signal, reflecting the moment the signal is first reflected by interference; secondary reflected waves mostly appear in the peak phase of interference intensity, corresponding to the multi-path back-and-forth propagation of the electromagnetic field in space; multiple superimposed reflected waves often appear in the attenuation phase of the interference signal, indicating the process of the signal returning after multiple reflections. This time decomposition method divides the reflection echo time window in the Bluetooth signal propagation path into multiple independent sub-intervals, allowing the multipath effect of signal propagation to be clearly presented in the time dimension.

[0035] After decomposing the Bluetooth signal reflection echo time window, the data return delay within different time windows is quantitatively compared to calculate the delay variation and reveal the dynamic impact of interference on Bluetooth signal transmission. During the analysis, the transmission time of the direct propagation path is used as a reference, and the transmission time of each reflected echo is compared one by one, recording the difference between the Bluetooth signal arrival delay and the reference time in each time window. This method allows us to obtain the delay variation trend under electromagnetic interference. During the rising phase of the interference signal, the delay variation typically increases, indicating that the signal propagation is more affected by interference and has more paths. During the peak interference phase, the delay variation reaches its maximum value, representing the strongest energy interference and the most complex transmission path. During the interference attenuation phase, the delay variation gradually decreases, indicating that the signal propagation path is recovering to a stable state. For cases where delay fluctuations persist after the interference ends, the delay recovery time is recorded until the end of the stable interval to reflect the residual impact of the interference. By continuously recording the delay variation, a complete time curve of the data return delay is formed, accurately demonstrating the delay evolution process of the Bluetooth signal under electromagnetic interference.

[0036] After calculating the change in data return delay, the results of interference root cause analysis, the reflected echo time window structure, and the delay change curve are integrated to generate a draft time rhythm adjustment plan. The draft time rhythm adjustment plan formulates Bluetooth signal return time rhythm correction parameters based on the temporal patterns of interference events to ensure timing coordination during communication. During the drafting process, the effective range of rhythm adjustment is first determined based on the start time, peak time, and end time of the interference event. For the interference rise phase, the transmission interval is increased to reduce echo overlap and avoid the interference signal coinciding with the data return time slot; for the interference peak phase, the transmission interval between adjacent data packets is appropriately shortened to allow the signal to complete return within a stable window; for the interference attenuation phase, the signal reception interval is extended to absorb residual echo effects; for the interference recovery phase, the return start time is adjusted synchronously to gradually restore the signal rhythm to normal. The draft records the adjustment range, corresponding time offset value, transmission rhythm switching time, and reception rhythm smoothing period for each interference phase, and aligns them with the interference event records on the timeline, thus forming a rhythm adjustment scheme with a time hierarchy. By implementing this draft, the inspection terminal can automatically adjust the Bluetooth signal return rhythm when subjected to electromagnetic interference, thereby correcting the accumulated delay and synchronizing the data timing, and enabling Bluetooth communication to remain continuous and stable in complex electromagnetic environments.

[0037] Based on the time rhythm adjustment draft, dynamic adjustment operations are performed to control the inspection terminal to execute the Bluetooth signal transmission time slot flipping rhythm, control the relay node to execute echo absorption period adjustment, and control the data acquisition terminal to execute time code reverse order caching, thereby continuously optimizing the data transmission order and timing matching accuracy, and realizing the time consistency and stability of inspection data in electromagnetic interference environment; The draft time rhythm adjustment is implemented in the dynamic adjustment operations of inspection terminals, relay nodes, and data acquisition terminals. This ensures that each component maintains time consistency and data transmission stability under electromagnetic interference. The entire process revolves around the time rhythm parameters, echo absorption period, and time code arrangement rules preset in the draft. It achieves the execution of Bluetooth signal transmission time slot flipping rhythm, real-time adjustment of echo absorption period, synchronous processing of time code reverse order buffering, and continuous optimization of data transmission timing. Each step is interconnected in the time dimension, forming a closed-loop dynamic collaborative process to ensure the continuity and stability of data transmission in interference environments. The specific implementation steps are as follows: After the draft timing adjustment plan is generated, the inspection terminal initiates the Bluetooth signal transmission time slot reversal operation according to the timing parameters set in the draft. The core of this operation is to rearrange the Bluetooth signal transmission time slots so that the distribution of the transmitted signal on the time axis avoids the time segment with the strongest interference signal, thereby reducing the delay and disorder caused by interference to signal transmission. In specific implementation, the inspection terminal first selects two adjacent signal transmission time slots before and after the interference peak time as the reversal targets, based on the interference start time and interference peak time recorded in the draft. The originally continuous transmission order is swapped, changing the Bluetooth signal transmission sequence from a linear order to an alternating order. By reversing the time slots, the signal transmission time point is staggered from the high-energy range of the interference signal, thereby reducing the reflection and delay caused by interference superposition on the signal propagation path. For cases of continuous interference, the inspection terminal rearranges the transmission order in each interference cycle according to the periodic adjustment rules defined in the draft, ensuring that the signal transmission rhythm maintains a dynamic avoidance state in different time periods. During the interference dissipation phase, the inspection terminal gradually restores the time slots to their original order based on the recovery time points recorded in the draft, allowing the Bluetooth signal backhaul rhythm to return to stability. The entire time slot flipping process is executed continuously on the timeline, and the terminal records the start time, duration, and end time of each flip for subsequent analysis of the relationship between interference fluctuations and signal time slots.

[0038] After the inspection terminal completes the Bluetooth signal transmission time slot flipping operation, the relay node adjusts the interference duration and echo delay characteristics set in the draft according to the time rhythm, and performs echo absorption period adjustment. The relay node's adjustment process is based on time, performing time-domain segmentation processing on the reflected echo signal caused by interference to absorb echo energy and prevent reflected signals from superimposing on the main signal channel. In the early stage of interference, the relay node extends the signal reception period according to the echo delay rise interval recorded in the draft, so that its reception window covers the reflected echo generated in the initial stage of interference, thereby absorbing early echo energy in the signal channel. In the peak stage of interference, the relay node sets the absorption period according to the peak time period in the draft, separating the echo absorption window from the signal reception window, so that the energy of the reflected echo is captured in a separate absorption time period, preventing the main signal from being affected by superposition. After entering the interference attenuation stage, the relay node gradually shortens the absorption period, so that the reception window and absorption window overlap again, restoring the normal signal reception rhythm. After each period adjustment, the relay node marks the start time, end time, and absorption duration of the current absorption window in the time record, forming a continuous time tracking record. By dynamically adjusting the time domain, the absorption process of echo energy is made to correspond in time with the switching rhythm of the Bluetooth signal transmission time slot, thereby maintaining the stability of signal backhaul during multiple interference cycles.

[0039] After the terminal completes the time slot flipping operation and the relay node completes the echo absorption period adjustment, the data acquisition end adjusts the timecode arrangement rules of the draft according to the time rhythm and performs timecode reverse caching. The purpose of this process is to restore the continuity of the data transmission order under the influence of electromagnetic interference. In specific implementation, the data acquisition end first receives Bluetooth data packets transmitted from the relay node and records the reception time of each data packet according to the timecode identifier defined in the draft. When the reception order of the data packets is inconsistent with the timecode order, the acquisition end temporarily stores the later received data packets in the buffer and rearranges the order of the data packets in reverse order so that the data packets can be restored to the original transmission order according to the timecode when output. In order to ensure the continuity of the caching process, the acquisition end simultaneously records the buffer start time, buffer duration, and buffer output time, so that the data reception, caching, and output processes form a closed loop in time. During the interference, the acquisition end continuously executes reverse-order buffering to cope with out-of-order data transmission caused by signal delay. After the interference ends, based on the recovery time parameters recorded in the draft, the execution frequency of reverse-order buffering is gradually reduced, and the system reverts to sequential output mode, ensuring that the data stream remains continuous and stable in time. This time adjustment method of reverse-order buffering effectively eliminates the time misalignment caused by interference, ensuring that the data transmission process maintains complete time consistency even under interference conditions.

[0040] After completing Bluetooth signal transmission time slot flipping, relay node echo absorption cycle adjustment, and time code reverse-order buffering at the acquisition end, the data backhaul throughout the inspection process is dynamically optimized to maintain time coordination in Bluetooth signal transmission under continuous interference. During optimization, at the end of each cycle, the inspection terminal compares the time slot flipping time record with the echo absorption cycle time record, analyzes the correspondence between interference intensity changes and time slot rhythm, and automatically fine-tunes the transmission time slot order in the next cycle to better match the transmission rhythm with interference fluctuations. During reception, the relay node compares the current echo absorption time with the interference delay time of the previous cycle and adjusts the absorption window length in real time to keep the echo absorption process synchronized with the actual distribution of interference. The data acquisition end fine-tunes the buffer start time for the next cycle based on the time code offset recorded during reverse-order buffering, making the time interval between buffering and output more balanced. Based on this, the three elements form a closed-loop coordination in time. The terminal's transmission time slot adjustment results affect the relay node's absorption cycle change, and the relay node's absorption time change affects the data acquisition end's buffer output timing. Ultimately, all nodes achieve continuous optimization through the transmission and synchronization of time information. After multiple cycles of operation, the entire backhaul process gradually stabilizes in time, the Bluetooth signal delay fluctuations under electromagnetic interference are continuously corrected, and the accuracy of data backhaul order and timing matching gradually improves, thereby achieving time consistency and communication stability of inspection data under interference conditions.

[0041] This invention establishes an interference log during inspections and performs time correlation analysis, enabling real-time identification and timing of Bluetooth signals affected by electromagnetic interference. By accurately identifying the start and end times of interference and tracking the Bluetooth signal return delay trajectory, it can promptly detect abnormal data return order and generate out-of-order characteristic records after interference occurs. This allows for rapid detection and correction of out-of-order issues during the data upload phase, ensuring that the inspection terminal maintains time synchronization even in electromagnetic interference environments and guaranteeing continuous and stable data collection and upload processes.

[0042] This invention establishes a time-level coordinated adjustment mechanism among inspection terminals, relay nodes, and data acquisition terminals by generating a draft time rhythm adjustment mechanism and executing dynamic adjustment operations. The Bluetooth signal transmission rhythm, echo absorption period, and data buffering order of the terminals are adjusted in real time in interference environments, effectively reducing the impact of electromagnetic interference on signal transmission. By continuously optimizing the order and matching accuracy of data feedback, the inspection data maintains complete time consistency when uploaded to the backend, thereby improving the timing accuracy and operational reliability of multi-sensor fusion inspection.

[0043] This invention provides, for example Figure 2The AR smart terminal shown supports multi-sensor fusion inspection and includes an interference information acquisition module, a time analysis module, a delay trajectory tracking module, an interference analysis and timing modeling module, and a dynamic adjustment and control module. The interference information acquisition module collects time information and electromagnetic interference signs at the inspection site, generates an interference record draft based on the collected data, and establishes a time correlation between the inspection sequence and interference events. The time analysis module performs time analysis based on the interference record draft, identifies the start and end times of electromagnetic pulse interference, generates a list of suspected out-of-order data transmissions based on the analysis results, and determines the communication periods affected by the interference. The delay trajectory tracking module tracks the return delay trajectory of Bluetooth signals based on a list of suspected out-of-order data transmissions, identifies abnormal intervals in the Bluetooth data packet return order, and generates out-of-order feature records to characterize the specific time distribution of data packet out-of-order. The interference analysis and timing modeling module analyzes the root causes of electromagnetic interference based on out-of-order characteristic records, decomposes the reflection echo time window of Bluetooth signals, calculates the change in data transmission delay, and generates a timing adjustment draft to guide timing correction. The dynamic adjustment and control module performs dynamic adjustment operations based on the time rhythm adjustment draft, controls the inspection terminal to perform Bluetooth signal transmission time slot flipping rhythm, controls the relay node to perform echo absorption period adjustment, and controls the data acquisition terminal to perform time code reverse order caching processing, continuously optimizing the data transmission order and timing matching accuracy, and realizing the time consistency and stability of inspection data in electromagnetic interference environment.

[0044] The present invention provides an AR intelligent inspection method that supports multi-sensor fusion inspection, which is implemented by the aforementioned AR intelligent terminal that supports multi-sensor fusion inspection. For details of the specific method and process of the AR intelligent terminal that supports multi-sensor fusion inspection, please refer to the aforementioned embodiment of the AR intelligent inspection method that supports multi-sensor fusion inspection, which will not be repeated here.

[0045] The foregoing has only described certain exemplary embodiments of the present invention by way of illustration. Undoubtedly, those skilled in the art can modify the described embodiments in various ways without departing from the spirit and scope of the present invention. Therefore, the foregoing drawings and descriptions are illustrative in nature and should not be construed as limiting the scope of protection of the claims of the present invention.

Claims

1. An AR intelligent inspection method supporting multi-sensor fusion inspection, characterized in that, Includes the following steps: Collect time information and electromagnetic interference signs at the inspection site, generate interference record drafts based on the collected data, and establish the time correlation between inspection time sequence and interference events; Based on the interference record draft, time analysis is performed to identify the start and end times of electromagnetic pulse interference. Based on the analysis results, a list of suspected out-of-order data transmissions is generated to determine the communication periods affected by the interference. Based on the list of suspected out-of-order data transmission, the back-transmission delay trajectory of Bluetooth signals is tracked, abnormal intervals in the back-transmission order of Bluetooth data packets are identified, and out-of-order feature records are generated. Based on the analysis of the root cause of electromagnetic interference by recording out-of-order characteristics, the reflection echo time window of Bluetooth signals is decomposed, the change in data transmission delay is calculated, and a draft of time rhythm adjustment is generated. Based on the time rhythm adjustment draft, dynamic adjustment operations are performed to control the inspection terminal to perform Bluetooth signal transmission time slot flipping rhythm, control the relay node to perform echo absorption period adjustment, and control the data acquisition terminal to perform time code reverse order caching processing to continuously optimize the data back transmission order and timing matching accuracy.

2. The AR intelligent inspection method supporting multi-sensor fusion inspection according to claim 1, characterized in that, The steps for generating the interference record draft are as follows: Initialize the time recording device and set a unified time reference; the time acquisition device continuously records the time information of the entire inspection process. Under a unified time reference, the changes in electric field strength, electric field fluctuation frequency, magnetic field direction change rate, wireless signal strength attenuation characteristics, and background noise amplitude fluctuations are detected, and interference signs are combined with time information to form a synchronized data set. Arrange the synchronized data groups in chronological order to create a timeline and divide it into interference-stable, interference-active, and interference-recovery segments. The time information and electromagnetic interference signs are summarized and organized to generate an interference record draft, which records the start time, end time, interference intensity change trend and interference impact range of the interference event.

3. The AR intelligent inspection method supporting multi-sensor fusion inspection according to claim 2, characterized in that, The steps for performing time analysis based on the interference record draft and generating a list of suspected out-of-order data for feedback are as follows: The interference events in the interference record draft are organized in chronological order, and the interference start time, interference duration node, interference end time and recovery time are extracted to construct a continuous interference timeline; Analyze the trend of interference signal strength over time on the interference time axis, determine the start time of the interference signal rising from the background level and the end time of its recovery to the background level, and record the start and end times of continuous pulse interference. By analyzing the correlation between the interference time interval and the Bluetooth communication time record, and by comparing the overlap between the communication transmission time, reception time and the interference interval, the communication period affected by interference can be identified. The communication periods affected by interference are sorted in chronological order to generate a list of suspected out-of-order data return data, which includes the interference event number, start and end time, communication transmission and reception time, delay duration, and communication delay magnitude.

4. The AR intelligent inspection method supporting multi-sensor fusion inspection according to claim 3, characterized in that, When generating a list of suspected out-of-order data transmission, the time difference between the peak time of the interference signal and the time of the increase in communication delay is recorded. The change in time difference is used as the basis for judging the characteristics of communication delay. Communication periods with continuous delay fluctuations are divided into independent suspected out-of-order segments. Based on the time correspondence between the trend of interference signal intensity change and the trend of communication delay change, the scope of the impact of out-of-order data transmission is determined.

5. The AR intelligent inspection method supporting multi-sensor fusion inspection according to claim 3, characterized in that, The steps for tracing Bluetooth signal backhaul delay trajectories and generating out-of-order feature records based on a list of suspected out-of-order data transmissions are as follows: The communication events in the suspected out-of-order data return list are unfolded in the order of transmission time, and the interference start time, interference end time, data packet transmission time, reception time, delay duration and delay recovery time are recorded to construct a continuous Bluetooth communication time chain; Based on the interference start time, the Bluetooth signal return delay trajectory is tracked segment by segment, the start time, duration and recovery time of the delay are recorded, and a delay trajectory curve is formed on the time axis. The reception times of each data packet in the delay trajectory are compared sequentially to identify the abnormal interval where the subsequent data packet is received earlier than the previous data packet, and the interference intensity, duration and data packet number involved in the abnormal interval are recorded. All abnormal intervals are summarized to generate out-of-order feature records with the time axis as the main line, recording the duration of the out-of-order sequence, the change in interference intensity, and the recovery time of the transmission order.

6. The AR intelligent inspection method supporting multi-sensor fusion inspection according to claim 5, characterized in that, The steps for analyzing the root causes of electromagnetic interference based on disordered characteristic records and generating a draft for time rhythm adjustment are as follows: The interference time distribution, disorder duration interval, delay trajectory curve and interference intensity change characteristics in the disorder feature records are sorted out to identify the root cause of electromagnetic interference and establish the time correspondence between the interference source and the delay change. The propagation process of Bluetooth signals is analyzed in a time-division manner. The time window of the reflected echo is identified based on the peak value of the received signal, and the primary reflected wave, secondary reflected wave and multiple superimposed reflected wave are distinguished. The change in data transmission delay is calculated based on the reflected echo time window, and the delay change trends during the interference rise, peak, attenuation and recovery phases are recorded. Based on the analysis results of interference time patterns, a draft time rhythm adjustment is generated and the time offset value, the time of transmission rhythm switching and the smooth period of reception rhythm are recorded.

7. The AR intelligent inspection method supporting multi-sensor fusion inspection according to claim 6, characterized in that, In the process of generating the timing adjustment draft, the timing adjustment range is determined based on the start time, peak time and end time of the interference event. By increasing the transmission interval to reduce echo overlap, shortening the data packet transmission interval to achieve stable backhaul, and extending the signal reception interval to absorb the residual effect of the echo, the backhaul start time is adjusted synchronously, so that the Bluetooth signal backhaul rhythm can achieve timing coordination and recovery stability in different interference stages.

8. The AR intelligent inspection method supporting multi-sensor fusion inspection according to claim 6, characterized in that, The dynamic adjustment steps based on the time-based adjustment draft are as follows: Based on the time rhythm adjustment draft, the inspection terminal controls the Bluetooth signal transmission time slot flipping rhythm, avoids the high-energy range of interference signals by exchanging adjacent transmission time slots, and records the flipping start time, duration and end time. Based on the interference duration and echo delay characteristics recorded in the draft time rhythm adjustment, the relay node is controlled to perform echo absorption period adjustment, which extends the absorption period in the early stage of interference, separates the reception and absorption windows in the peak stage of interference, and gradually restores the reception rhythm in the interference attenuation stage. Based on the time rhythm, the time code arrangement rules of the draft are adjusted to control the data acquisition end to perform time code reverse caching. The reverse caching restores the data transmission order and records the cache start time and output time. The timing of Bluetooth signal transmission and the order of data transmission are optimized by comparing and adjusting the time records of the terminal, relay node and acquisition end.

9. An AR smart terminal supporting multi-sensor fusion inspection, used to implement the AR smart inspection method supporting multi-sensor fusion inspection as described in any one of claims 1-8, characterized in that, It includes an interference information acquisition module, a time analysis module, a delay trajectory tracking module, an interference analysis and timing modeling module, and a dynamic adjustment and control module. The interference information acquisition module collects time information and electromagnetic interference signs at the inspection site, generates an interference record draft based on the collected data, and establishes a time correlation between the inspection sequence and interference events. The time analysis module performs time analysis based on the interference record draft, identifies the start and end times of electromagnetic pulse interference, generates a list of suspected out-of-order data transmissions based on the analysis results, and determines the communication periods affected by the interference. The delay trajectory tracking module tracks the Bluetooth signal return delay trajectory based on the list of suspected out-of-order data return, identifies abnormal intervals in the Bluetooth data packet return order, and generates out-of-order feature records. The interference analysis and timing modeling module analyzes the root causes of electromagnetic interference based on out-of-order characteristic records, decomposes the reflection echo time window of Bluetooth signals, calculates the change in data transmission delay, and generates a draft for timing adjustment. The dynamic adjustment control module performs dynamic adjustment operations based on the time rhythm adjustment draft, controls the inspection terminal to perform Bluetooth signal transmission time slot flipping rhythm, controls the relay node to perform echo absorption period adjustment, and controls the data acquisition terminal to perform time code reverse order buffering processing, continuously optimizing the data back transmission order and timing matching accuracy.

Images