Workshop inspection method and device and electronic equipment

By automatically organizing inspection points and using wearable intelligent inspection equipment to automatically obtain and visualize workshop inspection data, the problems of inconvenient information access and data errors in traditional workshop inspection systems are solved, and inspection efficiency and accuracy are improved enhances the intuitiveness and interactivity of the inspection process.

CN118945292APending Publication Date: 2024-11-12SHANGHAI MEGALIN SOFTWARE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411050622.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Traditional workshop inspection systems rely on handheld devices, which are inconvenient to access information and are difficult to quickly obtain equipment data in emergencies, resulting in delays in troubleshooting, and manual entry increases the risk of data errors and reduces inspection accuracy.

Method used

By automatically organizing inspection points and determining the optimal inspection path, wearable intelligent inspection equipment is used to automatically obtain equipment data when it arrives at the inspection points, visual inspections are completed, human errors are reduced, and data accuracy is improved.

Benefits of technology

It greatly improves the efficiency and data accuracy of the inspection, ensures the comprehensiveness and accuracy of the inspection, enhances the intuitiveness and interactivity of the inspection process, and promptly solves the problems of insufficient professional knowledge on site or difficulty in judgment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945292A_ABST
    Figure CN118945292A_ABST
Patent Text Reader

Abstract

The invention provides a workshop inspection method and device and electronic equipment, and relates to the technical field of automatic inspection, and the method comprises the steps: obtaining an inspection work order; routing inspection point locations are automatically arranged based on the routing inspection work order, and an optimal routing inspection path is determined; carrying out routing inspection according to the optimal routing inspection path, and when the routing inspection point location is reached, superposing the equipment data into the real scene of the equipment to complete visual routing inspection; and completing an inspection report based on the visual inspection data. According to the invention, invalid movement of inspection personnel is reduced, and the inspection efficiency is greatly improved; meanwhile, by means of the wearable intelligent inspection equipment, inspection personnel can automatically obtain and display standard parameters and inspection key points of the equipment when arriving at an inspection point location, the possibility of human errors is reduced, and the accuracy of inspection data is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of automatic inspection technology, and in particular to a workshop inspection method, device and electronic equipment. Background Art

[0002] In modern industrial production, workshop inspection is an important part of ensuring the normal operation of equipment, improving production efficiency, and ensuring employee safety and product quality. With the rapid development of information technology, traditional workshop inspection systems have gradually integrated modern technical means such as mobile terminals, barcode or QR code scanning, and wireless transmission to achieve real-time monitoring and management of workshop equipment status, production environment, and operation processes. However, although these systems have improved inspection efficiency and quality to a certain extent, there are still many technical defects and deficiencies that need to be improved and optimized.

[0003] At present, traditional workshop inspection systems mainly rely on handheld devices or mobile workstations for inspection operations. Equipment data is queried by scanning the identification code on the equipment, which reduces the convenience of information access to a certain extent. Especially in emergency situations, when staff need to quickly obtain equipment maintenance records or historical fault data, if the system cannot provide real-time or the records are not detailed enough, it will seriously delay the fault handling time and thus affect the production schedule. In addition, manual input also increases the risk of data errors and reduces the accuracy of inspection work.

[0004] Therefore, a workshop inspection method, device and electronic equipment are proposed. Summary of the invention

[0005] This specification provides a workshop inspection method, device and electronic equipment, which reduces the ineffective movement of inspection personnel and greatly improves the inspection efficiency; at the same time, using wearable intelligent inspection equipment, inspection personnel can automatically obtain and display the standard parameters and inspection points of the equipment when arriving at the inspection point, reducing the possibility of human error and improving the accuracy of inspection data.

[0006] This manual provides a workshop inspection method, including:

[0007] Get the inspection work order;

[0008] Automatically arrange inspection points based on the inspection work order and determine the optimal inspection path;

[0009] Perform inspections according to the optimal inspection path, and when arriving at the inspection point, superimpose the device data onto the real scene of the device to complete the visual inspection;

[0010] Complete inspection reports based on visualized inspection data.

[0011] Optionally, the automatically arranging inspection points based on the inspection work order and determining the optimal inspection path includes:

[0012] The inspection work order is converted to obtain the device ID and its device location and device weight;

[0013] The inspection points are automatically arranged based on the device ID, the device location and the device weight, and the inspection points are optimized by a path algorithm to obtain an inspection path.

[0014] Optionally, the performing path optimization on the inspection points by using a path algorithm to obtain an inspection path includes:

[0015] The inspection points include source points and other nodes, and the other nodes include a first node and a second node;

[0016] Find the first shortest path from the source point to the other nodes by Diikstra algorithm, and store the first shortest path in the inspection path set; wherein the first shortest path includes the path from the source point to the first node;

[0017] Finding a second shortest path from the source point through the first node to the remaining other nodes by using the Diikstra algorithm, and storing the second shortest path in the inspection path set; wherein the second shortest path includes from the source point through the first node to the second node;

[0018] The Diikstra algorithm is used to find the third shortest path from the source point through the first node, the second node and the remaining other nodes in sequence, until the other nodes are all optimized, thereby obtaining the optimal inspection path.

[0019] Optionally, the inspection is performed according to the optimal inspection path, and when the inspection point is reached, the device data is superimposed on the real scene of the device to complete the visual inspection, including:

[0020] The inspection personnel wearing the wearable intelligent inspection device arrive at the inspection point according to the virtual arrow indication and / or the highlighted guidance of the optimal inspection path;

[0021] The wearable intelligent inspection device automatically displays standard parameters and inspection key points of the equipment at the inspection point in front of the inspection personnel;

[0022] Overlay device data onto the real scene of the device to complete visual inspection.

[0023] Optionally, the device data is superimposed onto the real scene of the device to complete the visual inspection, including:

[0024] Acquire three-dimensional data of the real scene of the device in real time;

[0025] Generate a three-dimensional model based on the three-dimensional data using 3D modeling software, and optimize the three-dimensional model using surface reduction tools and mapping technology in the 3D modeling software;

[0026] The optimized three-dimensional model is rendered through a drawing protocol, and the virtual and real data are superimposed in front of the inspectors through the wearable intelligent inspection device to complete the visual inspection.

[0027] Optionally, the step of superimposing the device data onto the real scene of the device to complete the visual inspection further includes:

[0028] When the device data is superimposed on the real scene of the device, the inspection personnel call for remote assistance through the wearable intelligent inspection device;

[0029] The remote personnel assist the inspection personnel in completing the visual inspection through the real scene of the equipment returned by the wearable intelligent inspection device.

[0030] Optionally, after completing the inspection report based on the visual inspection data, the following is obtained:

[0031] Store visual inspection data in chronological order, obtain the changing trend of equipment parameters over time, and formulate maintenance strategies.

[0032] This specification provides a workshop inspection device, including:

[0033] Acquisition module, used to obtain inspection work orders;

[0034] An arrangement module is used to automatically arrange inspection points based on the inspection work order and determine the optimal inspection path;

[0035] A superposition module is used to perform inspections according to the optimal inspection path, and when arriving at the inspection point, the device data is superimposed on the real scene of the device to complete the visual inspection;

[0036] The completion module is used to complete the inspection report based on the visual inspection data.

[0037] Optionally, the automatically arranging inspection points based on the inspection work order and determining the optimal inspection path includes:

[0038] The inspection work order is converted to obtain the device ID and its device location and device weight;

[0039] The inspection points are automatically arranged based on the device ID, the device location and the device weight, and the inspection points are optimized by a path algorithm to obtain an inspection path.

[0040] Optionally, the performing path optimization on the inspection points by using a path algorithm to obtain an inspection path includes:

[0041] The inspection points include source points and other nodes, and the other nodes include a first node and a second node;

[0042] Find the first shortest path from the source point to the other nodes by Diikstra algorithm, and store the first shortest path in the inspection path set; wherein the first shortest path includes the path from the source point to the first node;

[0043] Finding a second shortest path from the source point through the first node to the remaining other nodes by using the Diikstra algorithm, and storing the second shortest path in the inspection path set; wherein the second shortest path includes from the source point through the first node to the second node;

[0044] The Diikstra algorithm is used to find the third shortest path from the source point through the first node, the second node and the remaining other nodes in sequence, until the other nodes are all optimized, thereby obtaining the optimal inspection path.

[0045] Optionally, the inspection is performed according to the optimal inspection path, and when the inspection point is reached, the device data is superimposed on the real scene of the device to complete the visual inspection, including:

[0046] The inspection personnel wearing the wearable intelligent inspection device arrive at the inspection point according to the virtual arrow indication and / or the highlighted guidance of the optimal inspection path;

[0047] The wearable intelligent inspection device automatically displays standard parameters and inspection key points of the equipment at the inspection point in front of the inspection personnel;

[0048] Overlay device data onto the real scene of the device to complete visual inspection.

[0049] Optionally, the device data is superimposed onto the real scene of the device to complete the visual inspection, including:

[0050] Acquire three-dimensional data of the real scene of the device in real time;

[0051] Generate a three-dimensional model based on the three-dimensional data using 3D modeling software, and optimize the three-dimensional model using surface reduction tools and mapping technology in the 3D modeling software;

[0052] The optimized three-dimensional model is rendered through a drawing protocol, and the virtual and real data are superimposed in front of the inspectors through the wearable intelligent inspection device to complete the visual inspection.

[0053] Optionally, the step of superimposing the device data onto the real scene of the device to complete the visual inspection further includes:

[0054] When the device data is superimposed on the real scene of the device, the inspection personnel call for remote assistance through the wearable intelligent inspection device;

[0055] The remote personnel assist the inspection personnel in completing the visual inspection through the real scene of the equipment returned by the wearable intelligent inspection device.

[0056] Optionally, after completing the inspection report based on the visual inspection data, the following is obtained:

[0057] Store visual inspection data in chronological order, obtain the changing trend of equipment parameters over time, and formulate maintenance strategies.

[0058] This specification also provides an electronic device, wherein the electronic device includes:

[0059] processor; and,

[0060] A memory storing computer executable instructions, which when executed cause the processor to perform any of the above methods.

[0061] The present specification also provides a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, any of the above methods is implemented.

[0062] The present invention reduces the ineffective movement of inspectors and greatly improves the inspection efficiency by automatically arranging inspection points and determining the optimal inspection path. At the same time, the determination of the optimal path avoids duplication or omission of inspection points and ensures the comprehensiveness of the inspection. Using wearable intelligent inspection equipment, inspectors can automatically obtain and display the standard parameters and inspection points of the equipment when arriving at the inspection point, reducing the possibility of human error and improving the accuracy of inspection data. The equipment data is superimposed on the real scene of the equipment to complete the visual inspection, making the inspection process more intuitive and easy to understand. This not only helps inspectors to quickly identify the status of the equipment, but also improves the fun and interactivity of the inspection, and enhances the participation and concentration of the inspectors. During the visual inspection process, inspectors can call for remote assistance through wearable intelligent inspection equipment. Remote personnel can view the real scene of the equipment in real time and provide guidance, effectively solving the problem of insufficient professional knowledge or difficult judgment that may be encountered in on-site inspections. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0064] Figure 1 A schematic diagram of the principle of a workshop inspection method provided in an embodiment of this specification;

[0065] Figure 2 A path and weight value diagram of a workshop inspection method provided in an embodiment of this specification;

[0066] Figure 3 A table diagram of the final weight values ​​of each path of a workshop inspection method provided in an embodiment of this specification;

[0067] Figure 4 A schematic diagram of the structure of a workshop inspection device provided in an embodiment of this specification;

[0068] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of this specification;

[0069] Figure 6 A schematic diagram of a computer-readable medium provided for an embodiment of this specification. DETAILED DESCRIPTION

[0070] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art can think of other obvious variations. The basic principles of the present invention defined in the following description can be applied to other embodiments, variations, improvements, equivalents, and other technical solutions that do not deviate from the spirit and scope of the present invention.

[0071] The following is combined with Figure 1-6 The exemplary embodiments of the present invention are described more fully. However, the exemplary embodiments can be implemented in various forms, and it should not be understood that the present invention is limited to the embodiments set forth herein. On the contrary, providing these exemplary embodiments can make the present invention more comprehensive and complete, and it is more convenient to fully convey the inventive concept to those skilled in the art. The same reference numerals in the figures represent the same or similar elements, components or parts, and thus their repeated description will be omitted.

[0072] Under the premise of being consistent with the technical concept of the present invention, the features, structures, characteristics or other details described in a specific embodiment do not exclude that they can be combined in one or more other embodiments in a suitable manner.

[0073] In the description of specific embodiments, the features, structures, characteristics or other details described in the present invention are intended to enable those skilled in the art to fully understand the embodiments. However, it does not exclude that those skilled in the art can practice the technical solutions of the present invention without one or more of the specific features, structures, characteristics or other details.

[0074] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0075] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0076] The term "and / or" or "and / or" includes all combinations of any one or more of the associated listed items.

[0077] Figure 1 A schematic diagram of a workshop inspection method provided in an embodiment of this specification, the method may include:

[0078] S110: Obtain inspection work order;

[0079] S120: Automatically arrange inspection points based on the inspection work order and determine the optimal inspection path;

[0080] Optionally, the S120 includes:

[0081] The inspection work order is converted to obtain the device ID and its device location and device weight;

[0082] The inspection points are automatically arranged based on the device ID, the device location and the device weight, and the inspection points are optimized by a path algorithm to obtain an inspection path.

[0083] In the specific implementation of this specification, after receiving the inspection work order, the inspection work order is converted into an inspection equipment list, and the equipment ID and its equipment location, equipment weight, standard inspection location, inspection point process and other related information are obtained by calling the equipment ledger query service of the enterprise data center. According to factors such as equipment importance, frequency of use, and degree of impact on production, all equipment is weighted and calculated to obtain the weight value of each equipment. The higher the weight value, the higher the ranking.

[0084] Optionally, the performing path optimization on the inspection points by using a path algorithm to obtain an inspection path includes:

[0085] The inspection points include source points and other nodes, and the other nodes include a first node and a second node;

[0086] Find the first shortest path from the source point to the other nodes by Diikstra algorithm, and store the first shortest path in the inspection path set; wherein the first shortest path includes the path from the source point to the first node;

[0087] Finding a second shortest path from the source point through the first node to the remaining other nodes by using the Diikstra algorithm, and storing the second shortest path in the inspection path set; wherein the second shortest path includes from the source point through the first node to the second node;

[0088] The Diikstra algorithm is used to find the third shortest path from the source point through the first node, the second node and the remaining other nodes in sequence, until the other nodes are all optimized, thereby obtaining the optimal inspection path.

[0089] In the specific implementation of this specification, Figure 2 and Figure 3 As shown in the figure, assuming A1 is the source node, find the shortest path from A1 to other nodes. Set S is used to store the shortest paths that have been found. The path from A1 to itself is obviously the shortest, so it is the initial shortest path.

[0090] First round: Starting from A1, calculate the distance from A1 to other nodes (if they cannot be connected, use the "infinity" symbol). Find the minimum path value and find that the shortest distance from A1 to A6 is 5. Add a shortest path A1-A6 to S.

[0091] Second round: Starting from A1-A6, calculate the distance from A1 to other nodes through A6. It is known that the distance from A1 to A6 is 5; A6 can reach A2, A4, and A5; therefore, the distance from A1 to other nodes through A6 is 5+n, where n is the distance from A6 to each node. Figure 3 Find the minimum value in the table (column A6 has been deleted). At this time, 7 is the minimum value, corresponding to the path A1-A6-A5. Add the shortest path A1-A6-A5, and column A5 is no longer considered.

[0092] Round 3: Starting from A1-A6-A5, calculate the distance from A1 to other nodes through A6 and A5. It is known that the length of A1-A6-A5 is 7, and A5 cannot reach any other existing node, so the distances are all "infinite". View Figure 3The table (A5 and A6 have been deleted) finds the minimum value 8, and the corresponding path is A1-A6-A2. Add the shortest path A1-A6-A2, and the A2 column is no longer considered.

[0093] Round 4: Starting from A1-A6-A2, calculate the distance from A1 to other nodes through A6 and A2. Figure 3 The table (A2, A5 and A6 have been deleted) finds the minimum value 10, and the corresponding path is A1-A6-A4. Add the shortest path A1-A6-A4, and the A4 column is no longer considered.

[0094] Round 5: Starting from A1-A6-A4, calculate the distance from A1 to other nodes through A6 and A4, and check Figure 3 The table finds the minimum value 13, corresponding to the shortest path A1-A6-A2-A3. Add the shortest path A1-A6-A2-A3, and no longer consider the A3 column. Since all the location columns have been deleted, the traversal ends.

[0095] S130: Perform inspection according to the optimal inspection path, and when arriving at the inspection point, superimpose the device data onto the real scene of the device to complete the visual inspection;

[0096] Optionally, the S130 includes:

[0097] The inspection personnel wearing the wearable intelligent inspection device arrive at the inspection point according to the virtual arrow indication and / or the highlighted guidance of the optimal inspection path;

[0098] The wearable intelligent inspection device automatically displays standard parameters and inspection key points of the equipment at the inspection point in front of the inspection personnel;

[0099] Overlay device data onto the real scene of the device to complete visual inspection.

[0100] In a specific implementation of this specification, when the inspector approaches the equipment at the inspection point, the system automatically displays the standard parameters and inspection points of the equipment. Specifically, the method includes: using the AreaTargets function in Vuforia for environmental tracking, which can track and enhance areas and spaces in the real world. By using 3D scanning technology, a three-dimensional point cloud model of a workshop space is created, and then a regional target equipment database is generated. This database can apply augmented reality effects to stationary objects in the workshop, so that virtual elements can be integrated with the surrounding real environment. Virtual elements can be used as interactive panels, navigation routes and spatial instructions. Set up virtual collision objects near specific equipment. When the inspector encounters the virtual object, the inspection points and real-time data panel of the equipment are triggered.

[0101] At the same time, virtual arrows or highlights are used to guide inspectors to pay attention to specific parts or operating steps.

[0102] Optionally, the device data is superimposed onto the real scene of the device to complete the visual inspection, including:

[0103] Acquire three-dimensional data of the real scene of the device in real time;

[0104] Generate a three-dimensional model based on the three-dimensional data using 3D modeling software, and optimize the three-dimensional model using surface reduction tools and mapping technology in the 3D modeling software;

[0105] The optimized three-dimensional model is rendered through a drawing protocol, and the virtual and real data are superimposed in front of the inspectors through the wearable intelligent inspection device to complete the visual inspection.

[0106] In a specific implementation of this specification, the wearable intelligent inspection device includes AR glasses. By wearing AR glasses, inspectors can see real-time data information superimposed on real-world objects, such as displaying the maintenance information and historical performance data of the machine directly on the machine, helping inspectors to quickly locate problems and perform maintenance. In the maintenance of complex equipment or large machinery, AR glasses can make the internal structure and related data transparent, allowing inspectors to see parts that are usually invisible and gain an in-depth understanding of the working principle and current status of the equipment.

[0107] Specifically, according to the characteristics of the production line equipment and the experience of the production line inspectors, jointly determine the key parameters of the equipment, monitoring factors, and the improvement or monitoring effects expected to be achieved through visualization. Collect real-time data of relevant equipment through the original industrial protocol of the equipment, the industrial Internet platform interface, or the addition of sensors, and store the data on the back-end server for AR glasses to retrieve and display at any time. Using tools such as the Unity native editor, AR content can be created simply and quickly, and packaged locally or distributed in the cloud. After the system is installed on AR glasses, inspectors can see real-time equipment data through AR glasses and interact with the data as needed. When the inspectors wear AR glasses and the model equipment is blocked and inconvenient to view, they can turn on the hidden equipment for viewing. They can view the operation of the equipment based on real-time data, reduce errors and rework caused by invisible hidden projects, save costs and shorten inspection time.

[0108] Import from existing CAD models or use 3D scanning technology to capture the shape of the device to ensure accurate 3D data. Choose appropriate 3D modeling software such as Blender, Maya or 3ds Max according to your needs. These tools support advanced modeling functions and optimization options. Use advanced features of these tools, such as subdivision surfaces, sculpting mode, etc. to refine the details of the model. Use the face reduction tool in the 3D modeling software, which can automatically simplify the model and maintain high visual accuracy. Reduce texture resolution and use compressed texture formats to reduce video memory usage and increase loading speed. Use mapping techniques such as normal mapping or parallax mapping to simulate high-precision details with low-resolution models and reduce dependence on the number of polygons. Choose appropriate sensors such as encoders, torque sensors or vision systems according to the control requirements of the robotic arm to obtain the position, speed and external force information of each joint of the robotic arm. Preprocess the received data, including filtering, denoising and format conversion, to extract accurate motion parameters. In Unity, you can control the rotation angle and speed of each joint by writing scripts, so that it can make precise movements according to the real-time data received. Use the WebGL framework to create a 3D scene for the digital twin, import the 3D model, and set parameters such as lighting, camera, and background. Implement user interaction functions such as rotating, scaling, panning the scene, selecting objects, etc., and process user input through the API or other JavaScript libraries provided by the WebGL framework. Use the rendering function provided by the WebGL framework to render the 3D scene of the equipment in the workshop in real time to ensure that the rendering effect is smooth and meets the user experience requirements. Optimize the system performance to ensure that it can run well under various devices and network conditions, which may involve scene optimization, texture compression, loading optimization, etc.

[0109] Optionally, the step of superimposing the device data onto the real scene of the device to complete the visual inspection further includes:

[0110] When the device data is superimposed on the real scene of the device, the inspection personnel call for remote assistance through the wearable intelligent inspection device;

[0111] The remote personnel assist the inspection personnel in completing the visual inspection through the real scene of the equipment returned by the wearable intelligent inspection device.

[0112] In the specific implementation of this specification, when on-site inspectors encounter problems that cannot be solved, they can call remote experts for assistance. The inspectors initiate remote collaboration from the AR glasses, and the remote experts can provide live audio and video guidance through mobile phones, computers, tablets and other terminals. The specific process is as follows:

[0113] The patrol personnel click the initiate collaboration button through the gesture menu, and then enter the call room. They can conduct remote collaboration by clicking on the relevant members in the member list. The calling member receives the invitation notification, clicks to answer and enters the remote collaboration call room. If necessary, other experts can be invited to provide remote assistance. Remote assistance can achieve real-time audio and video communication, and 3D annotation can be performed in space, or 3D annotation can be used. If you encounter a file that cannot be opened by AR glasses, you can use the remote desktop function to share the expert interface. By using the above functions, experts can remotely collaborate to guide on-site equipment maintenance and form corresponding collaboration records.

[0114] Depending on the application scenario, different types of equipment can be selected for data collection. Laser scanners (LiDAR) are suitable for large-scale outdoor scene measurements and can provide high-precision point cloud data. Depth cameras such as Kinect are suitable for indoor environments, with low cost and easy operation. Binocular cameras capture images through two cameras and calculate the three-dimensional coordinates of points through the principle of triangulation. They are suitable for indoor and outdoor environments but are limited by the baseline length.

[0115] S140: Complete the inspection report based on the visualized inspection data.

[0116] Optionally, after completing the inspection report based on the visual inspection data, the following is obtained:

[0117] Store visual inspection data in chronological order, obtain the changing trend of equipment parameters over time, and formulate maintenance strategies.

[0118] In the specific implementation of this specification, the inspection data is tracked over a long period of time to analyze the changing trends of equipment parameters over time. This helps predict possible problems with the equipment in the future and take measures in advance. For example, if the vibration level of a certain equipment continues to rise, it may indicate an impending failure. Statistical methods such as regression analysis and variance analysis are used to explore the relationship between different factors and find out the main factors affecting equipment performance. This helps to develop more effective maintenance plans and operation strategies.

[0119] For large amounts of complex data, machine learning algorithms can be applied for pattern recognition and anomaly detection. These algorithms can learn from historical data and automatically identify abnormal conditions, thereby providing early warning of potential equipment problems.

[0120] The analysis results are displayed in the form of charts, dashboards, etc., so that management and maintenance teams can intuitively understand the equipment status and maintenance effects. This helps to improve the efficiency and accuracy of decision-making. According to the analysis results, the inspection plan and maintenance strategy are adjusted and improvement measures are implemented. Then, data collection and analysis continue to form a continuous improvement cycle. This helps to continuously improve the performance and reliability of equipment.

[0121] Use sensors and data acquisition systems to collect equipment operating data in real time, including parameters such as temperature, pressure, vibration, and current. These data are the basis for fault prediction. Preprocess the collected data to remove noise and outliers to ensure data quality. Extract features that are helpful for fault prediction from the cleaned data, such as mean, variance, and frequency domain characteristics.

[0122] Select an appropriate prediction model based on data characteristics and prediction objectives. Commonly used models include machine learning algorithms (such as support vector machines, decision trees, random forests) and deep learning networks (such as convolutional neural networks, recurrent neural networks). Use historical data to train the selected model and adjust model parameters until the model can accurately predict known faults. Evaluate the generalization ability of the model through methods such as cross-validation to ensure that the model not only performs well on training data, but also can effectively predict on new data.

[0123] Deploy the trained model to the actual monitoring system to monitor the operating status of the equipment in real time and predict possible failures. When the model predicts a potential failure, further analyze the failure type and cause to provide guidance for maintenance. Based on the prediction results, formulate a preventive maintenance plan to replace or repair parts that are about to have problems in advance to avoid more serious failures.

[0124] Collect equipment data after maintenance, analyze successful and failed prediction cases, and continuously optimize models and feature selection. Update prediction models and algorithms as technology develops, and use the latest research results to improve the accuracy and efficiency of predictions. Share prediction experience, models, and best practices with other similar equipment to improve the maintenance level of the entire organization or industry.

[0125] Multimodal inspection reports reduce the need to manually write and organize reports, saving a lot of time and human resources. The system can quickly process and analyze inspection data, so that equipment status updates and problem notifications can be carried out almost in real time. Managers can arrange maintenance plans and resource allocation more reasonably based on automatically generated reports to avoid wasting resources.

[0126] Use AR glasses to collect on-site images and videos to ensure that every detail is covered. Use microphones to collect the sound of equipment during operation for subsequent abnormal sound identification. Use AR glasses to record operation logs, maintenance records, etc., and then transmit them to the back-end server through the network for storage and analysis.

[0127] Ensure that all data is arranged in chronological order to facilitate subsequent synchronous analysis. Merge data from different sources and formats to create a unified database. Use computer vision techniques such as edge detection and object recognition to analyze anomalies in images. Apply acoustic signal processing techniques such as spectrum analysis to identify possible equipment failure sounds. Use natural language processing techniques to extract key information from logs and maintenance records, such as fault codes and operating errors.

[0128] Train machine learning models to learn how to identify potential problems from new multimodal data based on historical data. Combined with professional knowledge base, logical reasoning is performed on the preliminary results output by the model to improve the accuracy of decision-making.

[0129] Develop or use existing automated reporting tools that can automatically generate complete reports containing text, charts, and statistics based on analysis results. Customize report content according to user needs and support real-time data update functions to ensure the timeliness and practicality of reports. Establish a feedback loop from users to developers and continuously collect feedback and suggestions during use to improve system performance and user experience.

[0130] The present invention reduces the ineffective movement of inspectors and greatly improves the inspection efficiency by automatically arranging inspection points and determining the optimal inspection path. At the same time, the determination of the optimal path avoids duplication or omission of inspection points and ensures the comprehensiveness of the inspection. Using wearable intelligent inspection equipment, inspectors can automatically obtain and display the standard parameters and inspection points of the equipment when arriving at the inspection point, reducing the possibility of human error and improving the accuracy of inspection data. The equipment data is superimposed on the real scene of the equipment to complete the visual inspection, making the inspection process more intuitive and easy to understand. This not only helps inspectors to quickly identify the status of the equipment, but also improves the fun and interactivity of the inspection, and enhances the participation and concentration of the inspectors. During the visual inspection process, inspectors can call for remote assistance through wearable intelligent inspection equipment. Remote personnel can view the real scene of the equipment in real time and provide guidance, effectively solving the problem of insufficient professional knowledge or difficult judgment that may be encountered in on-site inspections.

[0131] Figure 4 A schematic diagram of a workshop inspection device provided in an embodiment of this specification may include:

[0132] The acquisition module 10 is used to obtain the inspection work order;

[0133] An arrangement module 20 is used to automatically arrange inspection points based on the inspection work order and determine the optimal inspection path;

[0134] The superposition module 30 is used to perform inspection according to the optimal inspection path, and when reaching the inspection point, the device data is superimposed on the real scene of the device to complete the visual inspection;

[0135] The completion module 40 is used to complete the inspection report based on the visualized inspection data.

[0136] Optionally, the arrangement module 20 includes:

[0137] The inspection work order is converted to obtain the device ID and its device location and device weight;

[0138] The inspection points are automatically arranged based on the device ID, the device location and the device weight, and the inspection points are optimized by a path algorithm to obtain an inspection path.

[0139] Optionally, the performing path optimization on the inspection points by using a path algorithm to obtain an inspection path includes:

[0140] The inspection points include source points and other nodes, and the other nodes include a first node and a second node;

[0141] Find the first shortest path from the source point to the other nodes by Diikstra algorithm, and store the first shortest path in the inspection path set; wherein the first shortest path includes the path from the source point to the first node;

[0142] Finding a second shortest path from the source point through the first node to the remaining other nodes by using the Diikstra algorithm, and storing the second shortest path in the inspection path set; wherein the second shortest path includes from the source point through the first node to the second node;

[0143] The Diikstra algorithm is used to find the third shortest path from the source point through the first node, the second node and the remaining other nodes in sequence, until the other nodes are all optimized, thereby obtaining the optimal inspection path.

[0144] Optionally, the superposition module 30 includes:

[0145] The inspection personnel wearing the wearable intelligent inspection device arrive at the inspection point according to the virtual arrow indication and / or the highlighted guidance of the optimal inspection path;

[0146] The wearable intelligent inspection device automatically displays standard parameters and inspection key points of the equipment at the inspection point in front of the inspection personnel;

[0147] Overlay device data onto the real scene of the device to complete visual inspection.

[0148] Optionally, the superposition module 30 includes:

[0149] Acquire three-dimensional data of the real scene of the device in real time;

[0150] Generate a three-dimensional model based on the three-dimensional data using 3D modeling software, and optimize the three-dimensional model using surface reduction tools and mapping technology in the 3D modeling software;

[0151] The optimized three-dimensional model is rendered through a drawing protocol, and the virtual and real data are superimposed in front of the inspectors through the wearable intelligent inspection device to complete the visual inspection.

[0152] Optionally, the superposition module 30 further includes:

[0153] When the device data is superimposed on the real scene of the device, the inspection personnel call for remote assistance through the wearable intelligent inspection device;

[0154] The remote personnel assist the inspection personnel in completing the visual inspection through the real scene of the equipment returned by the wearable intelligent inspection device.

[0155] Optionally, after completing module 40, the following is obtained:

[0156] Store visual inspection data in chronological order, obtain the changing trend of equipment parameters over time, and formulate maintenance strategies.

[0157] The functions of the device in the embodiment of the present invention have been described in the above method embodiment, so for details not provided in the description of this embodiment, please refer to the relevant description in the above embodiment, and no further description will be given here.

[0158] Based on the same inventive concept, an embodiment of this specification also provides an electronic device.

[0159] The following describes an electronic device embodiment of the present invention, which can be regarded as a specific physical implementation of the method and device embodiments of the present invention. The details described in the electronic device embodiment of the present invention should be regarded as a supplement to the above method or device embodiments; details not disclosed in the electronic device embodiment of the present invention can be implemented with reference to the above method or device embodiments.

[0160] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this specification. Figure 5 The electronic device 300 according to the embodiment of the present invention is described. Figure 5 The electronic device 300 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0161] like Figure 5 As shown, the electronic device 300 is in the form of a general computing device. The components of the electronic device 300 may include, but are not limited to: at least one processing unit 310, at least one storage unit 320, a bus 330 connecting different system components (including the storage unit 320 and the processing unit 310), a display unit 340, etc.

[0162] The storage unit stores program codes, which can be executed by the processing unit 310, so that the processing unit 310 performs the steps according to various exemplary embodiments of the present invention described in the above processing method section of this specification. For example, the processing unit 310 can perform the following steps: Figure 1 Steps shown.

[0163] The storage unit 320 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 3201 and / or a cache memory unit 3202 , and may further include a read-only memory unit (ROM) 3203 .

[0164] The storage unit 320 may also include a program / utility 3204 having a set (at least one) of program modules 3205, such program modules 3205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each of which or some combination may include the implementation of a network environment.

[0165] Bus 330 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0166] The electronic device 300 may also communicate with one or more external devices 400 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable viewers to interact with the electronic device 300, and / or any device that enables the electronic device 300 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 350. Furthermore, the electronic device 300 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 360. The network adapter 360 may communicate with other modules of the electronic device 300 through the bus 330. It should be understood that although Figure 5Not shown, other hardware and / or software modules may be used in conjunction with the electronic device 300, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0167] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the exemplary embodiments described in the present invention can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation method of the present invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.) or on a network, including a number of instructions to enable a computing device (which can be a personal computer, server, or network device, etc.) to execute the above method according to the present invention. When the computer program is executed by a data processing device, the computer-readable medium can implement the above method of the present invention, that is: Figure 1 The method shown.

[0168] Figure 6 A schematic diagram of a computer-readable medium provided for an embodiment of this specification.

[0169] accomplish Figure 1 The computer program of the method shown can be stored on one or more computer readable media. The computer readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0170] The computer readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by an instruction execution system, an apparatus, or a device or used in combination with it. The program code contained on the readable storage medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

[0171] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the viewer computing device, partially on the viewer device, as a stand-alone software package, partially on the viewer computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the viewer computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0172] In summary, the present invention can be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that general data processing devices such as microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some or all of the components in the embodiments of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing the present invention can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0173] The specific embodiments described above further describe the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the present invention is not inherently related to any specific computer, virtual device or electronic device, and various general devices can also implement the present invention. The above description is only a specific embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

[0174] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

[0175] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A workshop inspection method, characterized in that: include: Get the inspection work order; Automatically arrange inspection points based on the inspection work order and determine the optimal inspection path; Perform inspections according to the optimal inspection path, and when arriving at the inspection point, superimpose the device data onto the real scene of the device to complete the visual inspection; Complete inspection reports based on visualized inspection data.

2. The workshop inspection method according to claim 1, characterized in that: The automatic arrangement of inspection points based on the inspection work order and determination of the optimal inspection path include: The inspection work order is converted to obtain the device ID and its device location and device weight; The inspection points are automatically arranged based on the device ID, the device location and the device weight, and the inspection points are optimized by a path algorithm to obtain an inspection path.

3. The workshop inspection method according to claim 2, characterized in that: The step of optimizing the inspection points by a path algorithm to obtain an inspection path includes: The inspection points include source points and other nodes, and the other nodes include a first node and a second node; Find the first shortest path from the source point to the other nodes by Diikstra algorithm, and store the first shortest path in the inspection path set; wherein the first shortest path includes the path from the source point to the first node; Finding a second shortest path from the source point through the first node to the remaining other nodes by using the Diikstra algorithm, and storing the second shortest path in the inspection path set; wherein the second shortest path includes from the source point through the first node to the second node; The Diikstra algorithm is used to find the third shortest path from the source point through the first node, the second node and the remaining other nodes in sequence, until the other nodes are all optimized, thereby obtaining the optimal inspection path.

4. The workshop inspection method according to claim 3, characterized in that: The inspection is performed according to the optimal inspection path, and when the inspection point is reached, the device data is superimposed on the real scene of the device to complete the visual inspection, including: The inspection personnel wearing the wearable intelligent inspection device arrive at the inspection point according to the virtual arrow indication and / or the highlighted guidance of the optimal inspection path; The wearable intelligent inspection device automatically displays standard parameters and inspection key points of the equipment at the inspection point in front of the inspection personnel; Overlay device data onto the real scene of the device to complete visual inspection.

5. The workshop inspection method according to claim 4, characterized in that: The device data is superimposed on the real scene of the device to complete the visual inspection, including: Acquire three-dimensional data of the real scene of the device in real time; Generate a three-dimensional model based on the three-dimensional data using 3D modeling software, and optimize the three-dimensional model using surface reduction tools and mapping technology in the 3D modeling software; The optimized three-dimensional model is rendered through a drawing protocol, and the virtual and real data are superimposed in front of the inspectors through the wearable intelligent inspection device to complete the visual inspection.

6. The workshop inspection method according to claim 5, characterized in that: The device data is superimposed onto the real scene of the device to complete the visual inspection, and further includes: When the device data is superimposed on the real scene of the device, the inspection personnel call for remote assistance through the wearable intelligent inspection device; The remote personnel assist the inspection personnel in completing the visual inspection through the real scene of the equipment returned by the wearable intelligent inspection device.

7. The workshop inspection method according to claim 6, characterized in that: After completing the inspection report based on the visual inspection data, we get: Store visual inspection data in chronological order, obtain the changing trend of equipment parameters over time, and formulate maintenance strategies.

8. A workshop inspection device, characterized in that: include: Acquisition module, used to obtain inspection work orders; An arrangement module is used to automatically arrange inspection points based on the inspection work order and determine the optimal inspection path; A superposition module is used to perform inspections according to the optimal inspection path, and when arriving at the inspection point, the device data is superimposed on the real scene of the device to complete the visual inspection; The completion module is used to complete the inspection report based on the visual inspection data.

9. An electronic device, wherein: The electronic device includes: processor; and, A memory storing computer executable instructions which, when executed, cause the processor to perform a method according to any one of claims 1-7.

10. A computer-readable storage medium, wherein: The computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the method of any one of claims 1 to 7 is implemented.