Method of terminal strip field alignment intelligent system based on augmented reality

Abstract

The invention discloses a method of a terminal strip field alignment intelligent system based on augmented reality. The system collects a terminal strip image / video in real time through a mobile device, identifies a terminal number and a wire sleeve label by using an AI algorithm of an edge server, and compares the terminal number and the wire sleeve label with a structured CAD drawing in real time. Based on a comparison result, the system visually superposes a matching state on a real-time picture through an augmented reality technology, and supports intelligent interaction for manual correction. According to the method, high-real-time and high-accuracy alignment can be realized in a network-free environment, the efficiency is remarkably improved, and the method is suitable for a complex field environment.

Description

Technical Field

[0001] This invention relates to the field of artificial intelligence, and more particularly to a method for an intelligent on-site wiring system for terminal blocks based on augmented reality. Background Technology

[0002] In the field of electrical engineering, the correct connection of terminal blocks is crucial for the normal operation of electrical systems. Traditional terminal block wiring mainly relies on manual verification. Operators need to check the circuit numbers of each terminal one by one against CAD drawings in complex field environments. This method is not only inefficient, but also prone to errors due to human negligence, which in turn affects the safety and reliability of the electrical system.

[0003] With the development of augmented reality and artificial intelligence technologies, their applications in the industrial field are gradually gaining attention. Augmented reality technology can combine virtual information with real-world scenarios, providing users with an intuitive interactive experience. However, there is currently no augmented reality intelligent system specifically designed for on-site terminal block alignment that can efficiently compare on-site terminal block diagrams with CAD drawings and intuitively display the comparison results.

[0004] Currently, existing technologies are mainly divided into two categories: 1) Upload the image to the cloud and then recognize it. 2) Video stream recognition and real-time display of results on mobile devices. However, both of the aforementioned existing technologies suffer from the following problems: 1. Poor real-time performance The method of uploading images to the cloud for verification lacks real-time capability. Operators need to take and upload images first, then wait for cloud processing before obtaining the results. If the recognition result is incorrect, they need to return to the site to retake the images, increasing time costs and operational complexity.

[0005] 2. The display is not intuitive. Using split-screen video scanning results in a less intuitive display. When the camera moves, operators need to manually adjust the screen display to see the comparison results, which can easily affect operational efficiency due to delayed screen switching.

[0006] 3. Inconvenient interaction Current technology requires operators to frequently adjust the camera position and angle to view the correct comparison results. This interaction method is not convenient, especially in complex on-site environments, where operators may need to make multiple adjustments to obtain the desired comparison results. Furthermore, modifying and adjusting the camera is cumbersome, impacting the user experience. Summary of the Invention

[0007] The purpose of this invention is to address the shortcomings of existing technologies by proposing a method for an intelligent on-site terminal block wiring system based on augmented reality.

[0008] To achieve the above objectives, the present invention adopts the following technical solution: a method for an intelligent on-site wiring system for terminal blocks based on augmented reality, the specific steps of which are as follows: S1: Data collection by mobile device; Operators use mobile devices to capture video streams or images of the field terminal blocks in real time; The mobile device includes a smartphone, tablet, or AR glasses, equipped with a high-definition camera capable of capturing clear images of the terminal block; S2: Image transmission and processing; The video stream or images collected in step S1 are transmitted to the edge server device via a wireless network. The edge server is responsible for performing preliminary image processing, including noise reduction and contrast enhancement; S3: Terminal number and wire sleeve label identification; The AI ​​algorithm on the edge server analyzes the image processed in step S2 and automatically identifies the terminal number and wire sleeve label; The AI ​​algorithm includes OCR technology, which can extract text information from images; S4: Data filtering; The system will automatically identify and filter out the terminal numbers that have been successfully matched in step S3, thereby focusing attention on the terminals that have not been matched or require further verification. S5: Compare with CAD drawings The system will perform a detailed comparison between the identified terminal numbers and wire sleeve information and the pre-imported, structured CAD drawing data; S6: Matching Decision: The system automatically determines whether the recognition result matches the CAD drawing; If a match is found, it is marked as correct; virtual reality is marked in green. If there is no match or the result is uncertain, mark it as requiring further verification.

[0009] Preferably, in step S4 above, the terminal number also includes a terminal number library; the terminal number library centrally stores terminal numbering rules, characteristic data, and associated information.

[0010] Preferably, in step S5 above, the structured CAD drawing is a drawing that binds graphic elements and engineering attributes.

[0011] Preferably, in step S6 above, if there is no match or the result is uncertain, the virtual reality is marked in red, and if there is a match, it is marked in green.

[0012] The marking process is as follows: Correct match: Virtual reality is marked in green, and the data is stored in the terminal library.

[0013] Mismatch: The virtual reality indicator is marked in red, while the correct cable is indicated.

[0014] At the same time, manual visual inspection is used to determine whether the data is correct. If it cannot be determined, the data is sent back. If it is clearly correct, the data is stored in the terminal library. This completes the logical loop of the entire system.

[0015] Compared with the prior art, the beneficial effects of the present invention are as follows: (1) High accuracy in identification and correctable; This invention utilizes advanced image recognition technology and deep learning algorithms to accurately identify terminal block information on-site and meticulously compare it with structured data in CAD drawings. During this process, the system ensures absolute accuracy for perfectly matching cable sleeve labels; for labels with uncertain identification results, the system quickly alerts the operator, provides corrective suggestions, or allows manual marking. This mechanism, combining intelligent technology with manual intervention, not only greatly ensures the high accuracy of the identification process but also further guarantees the reliability of the final result through the crucial step of manual verification. It effectively avoids incorrect connections caused by misidentification, thereby significantly improving the overall safety and reliability of electrical systems and providing a solid technical guarantee for the efficient and stable operation of electrical engineering.

[0016] (2) It is highly adaptable to various complex environments; This invention possesses strong environmental adaptability, effectively coping with various complex working environments. Whether under different lighting conditions such as strong light, weak light, and shadow, or in environments with dense equipment layouts or interference factors such as dust and reflections, the system can operate stably. Through optimized image processing algorithms and augmented reality technology, this invention ensures high-precision recognition and comparison in various complex environments, reducing false recognitions caused by environmental factors and enhancing the system's robustness.

[0017] (3) Enhance the real-time performance of on-site alignment through intelligent means to avoid duplication; This invention utilizes intelligent technology to complete real-time identification and comparison of on-site alignment in a single operation, significantly enhancing real-time performance. The system can provide real-time feedback on the comparison results, allowing operators to immediately identify and correct errors, avoiding the problems of multiple trips to the site, repeated shooting, and verification required by traditional methods. This enhanced real-time performance not only improves work efficiency but also reduces the time and effort wasted on repetitive operations, further enhancing the overall smoothness and convenience of the operation.

[0018] (4) Excellent Interactivity with Virtual Reality: This invention combines virtual reality and augmented reality technologies, integrating virtual information with the actual scene. Operators can intuitively see the comparison results through AR devices, enhancing the intuitiveness and effectiveness of the interaction. The system supports multiple intelligent interaction methods, such as voice commands and gesture operations, allowing operators to easily control and adjust the system, ensuring that every action receives an effective response. This excellent interactivity not only improves the convenience of operation but also further enhances the user experience, enabling operators to complete online tasks more efficiently.

[0019] (5) Data recording and traceability; This invention features an automatic recording function, capable of recording in detail all operations and comparison results during the alignment process, including identification time, operator, error location, and corrective measures. This data can be stored locally or in the cloud for easy subsequent review and traceability. Through data recording, enterprises can better control quality and manage processes, ensuring that the connection of each terminal block meets design requirements. Furthermore, data recording can be used to train new employees, helping them quickly master alignment skills and further improving the overall operational efficiency of the enterprise.

[0020] Through the above five dimensions of description, the technical effects of the present invention have been fully and thoroughly demonstrated, covering key aspects such as identification accuracy, environmental adaptability, real-time performance, interactivity, data recording and traceability, ensuring the integrity and systematic nature of the technical effects. Attached Figure Description

[0021] Figure 1 This is the core method of Embodiment 1 of the present invention; Detailed Implementation

[0022] To provide a further understanding of the purpose, structure, features, and functions of the present invention, detailed descriptions are provided below with reference to specific embodiments.

[0023] A method for an intelligent on-site terminal block connection system based on augmented reality, comprising the following steps: S1: Operators use mobile devices to capture video streams or images of the field terminal blocks in real time; The mobile device includes a smartphone, tablet, or AR glasses, equipped with a high-definition camera capable of capturing clear images of the terminal block; S2: Transmit the captured video stream or images to the edge server device via wireless network; The edge server is responsible for performing preliminary image processing, including noise reduction and contrast enhancement; AI algorithms on the edge server analyze the processed images in the steps and automatically identify terminal numbers and wire sleeve labels; S3: The system will automatically identify and filter out the terminal numbers that have been successfully matched in the steps, thereby focusing attention on the terminals that have not been matched or require further verification. It offers multiple interaction methods, such as voice commands and gesture operations, enabling operators to easily re-identify or adjust incorrectly identified labels. For example, operators can use the voice command "Re-identify terminal 123" or gesture to instruct the system to rescan a specific area, and the system will respond immediately and update the comparison results.

[0024] S4: The system will perform a detailed comparison between the identified terminal number and wire sleeve information and the pre-imported, structured CAD drawing data; Through advanced image processing and recognition technology, combined with augmented reality technology, the actual status of the terminal blocks can be compared with the design information in the CAD drawings in real time on-site, and the comparison results can be displayed intuitively to the operators. This function ensures that operators can detect connection errors or deviations of the terminal blocks in the first instance, avoiding misoperation caused by delayed feedback.

[0025] S5: The system automatically determines whether the recognition result matches the CAD drawing; By utilizing augmented reality technology, virtual comparison information is directly overlaid onto the real-time image of the terminal blocks in the field. Operators can clearly see the alignment status of each terminal without switching screens or repeatedly checking drawings, significantly improving work efficiency and accuracy. The system can adapt to various complex field environments, including different lighting conditions and space constraints, ensuring the stability and reliability of real-time comparison, and accurately displaying the alignment effect even in dimly lit or densely populated environments. S6: If there is no match or the result is uncertain, the virtual reality indicator is red; if there is a match, it is green. The marking process is as follows: Correct match: Virtual reality is marked in green, and the data is stored in the terminal library.

[0026] Mismatch: The virtual reality indicator is red, and the correct cable is indicated. Simultaneously, a manual visual inspection is conducted to determine correctness. If the error cannot be determined, the data is fed back; if the error is clearly correct, the data is stored in the terminal library.

[0027] Preferably, in step S4 above, the terminal number also includes a terminal number library; the terminal number library centrally stores terminal numbering rules, characteristic data, and associated information.

[0028] Preferably, in step S5 above, the structured CAD drawing is a drawing that binds graphic elements and engineering attributes.

[0029] Preferably, in step S6 above, if there is no match or the result is uncertain, the virtual reality is marked in red, and if there is a match, it is marked in green.

[0030] This invention not only improves the accuracy and efficiency of on-site wiring, but also provides an intuitive interactive experience through virtual reality technology, enabling operators to quickly identify and correct errors, thereby significantly improving the safety and reliability of electrical systems.

[0031] The present invention has been described in the above-described embodiments; however, these embodiments are merely examples for implementing the present invention. It must be noted that the disclosed embodiments do not limit the scope of the present invention. Conversely, any modifications and refinements made without departing from the spirit and scope of the present invention are within the scope of patent protection of the present invention.

Claims

1. A method for an intelligent on-site wiring system for terminal blocks based on augmented reality, characterized in that: The specific steps are as follows: S1: Data collection by mobile device; Operators use mobile devices to capture video streams or images of the terminal blocks in real time; the mobile devices include smartphones, tablets, or AR glasses, equipped with high-definition cameras that can capture clear images of the terminal blocks; S2: Image transmission and processing; The video stream or images collected in step S1 are transmitted to the edge server device via a wireless network. The edge server is responsible for performing preliminary image processing, including noise reduction and contrast enhancement; S3: Terminal number and wire sleeve label identification; The AI ​​algorithm on the edge server analyzes the image processed in step S2 and automatically identifies the terminal number and wire sleeve label; The AI ​​algorithm includes OCR technology, which can extract text information from images; S4: Data filtering; The system will automatically identify and filter out the terminal numbers that have been successfully matched in step S3, thereby focusing attention on the terminals that have not been matched or require further verification. S5: Compare with CAD drawings The system will perform a detailed comparison between the identified terminal numbers and wire sleeve information and the pre-imported, structured CAD drawing data; S6: Matching Decision: The system automatically determines whether the recognition result matches the CAD drawing; If a match is found, it is marked as correct; virtual reality is marked in green. If there is no match or the result is uncertain, mark it as requiring further verification.

2. The method for an intelligent on-site wiring system for terminal blocks based on augmented reality as described in claim 1, characterized in that: In step S4, the terminal number also includes a terminal number library; the terminal number library centrally stores terminal numbering rules, characteristic data and associated information.

3. The method for an intelligent on-site wiring system for terminal blocks based on augmented reality as described in claim 1, characterized in that: In step S5, the structured CAD drawing is a drawing that binds graphic elements and engineering attributes.

4. The method for an intelligent on-site wiring system for terminal blocks based on augmented reality as described in claim 1, characterized in that: In step S6, if there is no match or the result is uncertain, the virtual reality marker is red; if there is a match, it is marked green. The marking process is as follows: S6-1: Correct Match: The virtual reality is marked in green, and the data is stored in the terminal library as described in claim 2. S6-2: Mismatch: The virtual reality indicator is red, and the correct cable is indicated. Simultaneously, a manual visual inspection is performed to determine if it is correct. If the error cannot be determined, the data is fed back to S2; if it is clearly correct, the data is stored in the terminal library; this completes the system logic loop.

Images