Intelligent inspection device
By designing an intelligent inspection device, the automatic path guidance function is used to solve the problems of manual missing and route failure in the existing inspection mechanism, and the effect of inspectors accurately reaching the task position is achieved.
Patent Information
- Application Number
- CN202311542638.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-17
- Publication Date
- 2025-05-20
AI Technical Summary
The existing inspection mechanism has the problem of manual negligence, and new employees are not familiar with the inspection work, which leads to inaccurate inspections and is difficult to find the shortest route in complex workplaces, resulting in the risk of inability to operate normally.
An intelligent inspection device is designed, including positioning modules, input components, display components and operating components. Through the automatic path guidance function, the inspection personnel can accurately reach the task position.
Automatic path guidance is realized to ensure that inspectors can accurately reach the task position, improve the efficiency and accuracy of inspections, and reduce the risk of manual loss.
Smart Images
Figure CN120020491A_ABST
Abstract
Description
Technical Field
[0001] This application relates to patrol inspection and artificial intelligence, and particularly to an intelligent patrol inspection device. Background Art
[0002] Patrol inspection operation is an important part of the normal operation of a factory. Each device and machine in the factory needs to be regularly inspected by patrol inspectors and reported on its status to ensure that each device and machine can exert its due production efficiency.
[0003] However, the existing patrol inspection mechanism has problems of human errors. Since new employees are not familiar with the patrol inspection operation, the patrol inspection operation is not accurate enough. Although patrol inspectors can know what their current tasks are, for complex work areas, they often cannot immediately find the shortest route to reach the task location. In addition, considering that everyone has a different sense of direction, even if a route map is provided, it still cannot guarantee that patrol inspectors can smoothly reach the route location according to the route map in the intricate work area. The unimplemented patrol inspection operation may lead to the abnormal operation of the factory. Summary of the Invention
[0004] In view of this, this application proposes an intelligent patrol inspection device to solve the above problems.
[0005] An intelligent patrol inspection device according to an embodiment of this application includes a positioning module, an input component, a display component, and an operating element. The positioning module is used to generate device position information. The input component is used to obtain task instructions. The operating element is connected to the positioning module, the input component, and the display component. The operating element is used to generate target position information according to the task instructions, generate a path direction according to the device position information, default layout information, and target position information, and present a virtual environment model corresponding to the default layout information and the path direction through the display component.
[0006] In summary, the intelligent patrol inspection device proposed by an embodiment of this application has the function of automatic path guidance, which can ensure that personnel arrive at the job site and guide patrol inspectors to the task location.
[0007] The above description of the disclosure content and the following description of the embodiments are used to demonstrate and explain the spirit and principle of this application, and provide a further explanation of the scope of the patent application of this application. Brief Description of the Drawings
[0008] Figure 1 It shows a block architecture diagram of the intelligent patrol inspection device illustrated in the first embodiment of this application.
[0009] Figure 2 It shows a block architecture diagram of the positioning module of the intelligent patrol inspection device according to an embodiment of this application.
[0010] Figure 3 A schematic diagram showing an example of the task information, personnel information, and tool information of the present application.
[0011] Figure 4 A block diagram of the intelligent inspection device shown in the second embodiment of the present application.
[0012] Figure 5 A block diagram of the intelligent inspection device shown in the third embodiment of the present application.
[0013] Element label description
[0014] 1 Inertial positioning component
[0015] 3 Wireless signal positioning component
[0016] 5 Processing component
[0017] 10 Positioning module
[0018] 20 Input component
[0019] 30 Display component
[0020] 50 Operating element
[0021] 70 Photography component
[0022] 90 Prompt component
[0023] 100, 200, 300 Intelligent inspection device
[0024] B1 Task information
[0025] B2 Personnel information
[0026] B3 Tool information Detailed implementation manners
[0027] The detailed features and advantages of the present application are described in detail in the following implementation manners. The content is sufficient for any person skilled in the relevant art to understand the technical content of the present application and implement it accordingly. And according to the content disclosed in this specification, the scope of the patent application, and the drawings, any person skilled in the relevant art can easily understand the relevant objectives and advantages of the present application. The following embodiments further illustrate the viewpoints of the present application in detail, but do not limit the scope of the present application in any way.
[0028] Please refer to Figure 1 and Figure 2 . Figure 1 A block diagram of the intelligent inspection device shown in the first embodiment of the present application, and Figure 2 A block diagram of the positioning module of the intelligent inspection device shown in an embodiment of the present application. As Figure 1As shown, the intelligent inspection device 100 includes a positioning module 10, an input component 20, a display component 30, and an operating element 50. The operating element 50 is connected to the positioning module 10, the input component 20, and the display component 30. In one embodiment, the intelligent inspection device 100 can adopt one of the following examples: a smart phone, a tablet computer, a smart wearable device such as a smart glasses (such as Microsoft HoloLens), a smart watch. The present application does not limit the hardware type of the intelligent inspection device 100.
[0029] The positioning module 10 is used to generate device position information. As Figure 2 shown, the positioning module 10 includes an inertial positioning component 1, a wireless signal positioning component 3, and a processing component 5. The processing component 5 is connected to the inertial positioning component 1 and the wireless signal positioning component 3.
[0030] The inertial positioning component 1 is used to generate inertial positioning information. In one embodiment, the implementation of the inertial positioning component 1 can adopt at least one of the following examples: a gyroscope, an accelerometer, and a magnetometer.
[0031] The wireless signal positioning component 3 is used to generate wireless signal positioning information. In one embodiment, the wireless communication standards supported by the wireless signal positioning component 3 can adopt at least one of the following examples: the fifth generation mobile network (5G), Bluetooth, Wi-Fi, ZigBee, low power wide area network (LPWAN, such as Lora, Sigfox, NB-IoT, etc.).
[0032] The processing component 5 is used to generate device position information according to the inertial positioning information and the wireless signal positioning information. Specifically, the positioning and tracking technology of the positioning module 10 adopts a combination of signal positioning and inertial positioning. The positioning operation engine can automatically adjust the positioning algorithm according to the situation and the device state, which can reduce the dependence on hard devices and improve the user experience. Signal positioning uses the signal strength and time delay and other characteristics of existing wireless facilities (such as Wi-Fi, Bluetooth) to locate, and inertial positioning uses built-in sensors such as accelerometers, gyroscopes, and magnetometers to track the user's position and actions. Combining these two positioning methods can provide accurate indoor positioning. Therefore, the intelligent inspection device 100 of the first embodiment of the present application can generate accurate device position information, such as coordinates and azimuth angles, through the positioning module.
[0033] In system implementation, the positioning and tracking technology may include the following procedures: signal acquisition, artificial intelligence (AI) model building, inertial, signal positioning information fusion, digital twins, positioning system integration, and construction of a positioning device information linkage system.
[0034] The input component 20 is used to obtain task instructions. Specifically, the inspection personnel can input the tasks to be performed through the input component 20, or the inspection personnel can input personnel information through the input component 20, and the personnel information is associated with a specific task. In one embodiment, the input component 20 and the display component 30 can be integrated into a touch screen. In another embodiment, the input component 20 and the display component 30 can be respectively an independently provided operation interface (such as a mouse, a keyboard, etc.) and a display screen.
[0035] The operation element 50 is used to generate a target position information according to the task instruction, generate a path direction according to the device position information, the default layout information, and the target position information, and present a virtual environment model corresponding to the default layout information and the path direction through the display component 30. Further, the operation element 50 can pre-establish a virtual space of an applicable work field, including steps such as icon embedding, virtual environment positioning, message code compilation, event process definition, etc., to obtain a virtual environment model.
[0036] In one embodiment, the operation element 50 and the processing component 5 can be implemented by at least one of the following examples: a personal computer, a network server, a microcontroller (MCU), an application processor (AP), a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system-on-a-chip (SOC), a deep learning accelerator, or any electronic device including similar functions, but the present application does not limit the hardware types of the operation element 50 and the processing component 5.
[0037] In one embodiment, the default layout information includes a plurality of shielding position information corresponding to a plurality of obstacles in the work field, and the direction of the shortest path excluding the plurality of shielding position information between the path direction indicating device position information and the target position information. Specifically, the operating element 50 can be used to implement automatic path planning and automatic route generation. The AI module algorithm is used to calculate the best route from point A to point B. By integrating the virtual icon elements and data information of the automatic path planning with the Augmented Reality (AR) technology into the visual scene of the real world, the user can see the virtual navigation route and arrow in the real world, guiding the user to move forward along the predetermined route.
[0038] In system implementation, it can include the following procedures: icon design, positioning system integration, map data system integration, AI model construction, and AR linkage system construction.
[0039] In one embodiment, the operating element 50 stores a plurality of candidate position information corresponding to a plurality of candidate tasks respectively, and the operating element 50 selects one corresponding to the target task indicated by the task instruction from the plurality of candidate position information as the target position information. In another embodiment, in addition to storing the plurality of candidate position information of the plurality of candidate tasks, the operating element 50 also stores one or more tasks corresponding to each of the plurality of personnel information. The operating element 50 can determine the tasks corresponding to the inspection personnel according to the personnel information input by the inspection personnel through the input component 20, and select the candidate position information corresponding to the tasks from the plurality of candidate position information as the target position information.
[0040] In one embodiment, the operating element 50 is further used to determine whether the device position information falls within a legal position range and output a judgment result. Thereby, the intelligent inspection device 100 can locate and track personnel to ensure that the personnel on duty comply with the operation procedures.
[0041] In one embodiment, the operating element 50 is further used to present at least one of task information, personnel information, and tool information through the display component 10. Please refer to Figure 3 . Figure 3 It shows a schematic diagram of a digital twin visualization operation platform, including examples of task information B1, personnel information B2, and tool information B3. The path direction is as Figure 3 indicated by the arrow direction marked on the field.
[0042] Specifically, the three-dimensional (3D) visualization technology integrates the actual production line environment and equipment into the backend console system, enabling management personnel to observe and analyze various aspects of the plant site in a virtual 3D environment. They can freely move and browse the entire plant, observing the operating status of equipment on the production line, material flow, layout and configuration of work areas, etc. In addition, the technology can also provide interactive functions, such as clicking on specific equipment to obtain more detailed information, or simulating the production process under different scenarios.
[0043] In system implementation, it can include the following procedures: environmental field modeling, equipment modeling, establishing a model database, constructing a virtual space, and integrating virtual and real to adjust the tolerances of the real field.
[0044] Please refer to Figure 4 。 Figure 4 It shows the block architecture diagram of the intelligent inspection device illustrated in the second embodiment of this application. As Figure 3 shown, compared with the intelligent inspection device 100 of the first embodiment, the intelligent inspection device 200 of the second embodiment further includes a photography component 70. The photography component 70 is connected to the operation element 50.
[0045] The photography component 70 is used to photograph the target object to generate an image. The operation element 50 is also used to analyze the image to determine at least one of the type, value, and status of the target object. The operation element 50 is used to analyze the image to determine the type of the target object, determine whether the value or status of the target object meets a preset condition corresponding to the type, and output a judgment result. The types of the target object include, for example, a digital meter head presented in numbers and an analog meter head presented in a pointer. The preset condition is, for example, that the read value is within a safe range. The judgment result includes, for example, a prompt message of "normal meter head data" or "abnormal meter head data".
[0046] Specifically, the intelligent inspection device 200 of the second embodiment automatically interprets various meter head data in the factory through AI technology. The AI automatic interpretation combines image processing technology to achieve efficient meter head reading, barcode reading, and defect detection. Through deep learning and computer vision algorithms, AI can accurately identify meter head information, such as numbers and characters, to achieve automated data collection. At the same time, AI technology can also quickly identify and decode barcodes, improving the efficiency of material tracking and inventory management. Most importantly, AI can detect defects on the surface of products on the production line, such as cracks, uneven colors, and wear, etc., to achieve the automation of quality control and reduce the defective rate. The combination of these technologies effectively improves the automation level and production quality of the production line, creating higher benefits and competitiveness for enterprises.
[0047] In system implementation, it may include the following procedures: AI model construction, AI model training, data linkage system construction, AR system integration, and AR linkage system construction.
[0048] In addition, the patrol personnel can use the intelligent patrol device 200 for production management of comprehensive operation monitoring and video monitoring technology. Among them, operation monitoring can track the production status in real time by monitoring the key data and indicators of the production process in real time, and make timely adjustments to achieve the best efficiency and quality. At the same time, through the photography component 70 of the intelligent patrol device 200, the production site can be monitored. The above monitoring can also be carried out by the management personnel remotely connecting to the intelligent patrol device 200 and even linking other data management systems. Thereby, the management personnel can better grasp the production situation, respond to problems in a timely manner, improve production efficiency, and ensure product quality and employee safety. Further, the above digital monitoring may include the following procedures: production management system integration, video management system integration, Internet of Things system integration, data interface application program interface design, and data linkage system construction.
[0049] Please refer to Figure 5 。 Figure 5 It shows the block architecture diagram of the intelligent patrol device illustrated in the third embodiment of the present application. Compared with the intelligent patrol device 100 of the first embodiment, the intelligent patrol device 300 of the third embodiment further includes a prompt component 90. The prompt component 90 is connected to the operation element 50.
[0050] In one embodiment, the operation element 50 is further configured to control the prompt component 90 to output a prompt signal when it is determined that the device position information does not fall within the legal position range. The prompt component 90 is, for example, a speaker, a vibration device, or integrated into the display component 10 to present a visual prompt signal.
[0051] Specifically, the intelligent patrol device 300 of the third embodiment can implement a mobile abnormal alarm mechanism. The intelligent patrol device 300 combines abnormal dynamic alarms and real-time message browsing, and is equipped with a simple reporting mechanism, bringing a convenient intelligent experience to users and improving work efficiency. If the intelligent patrol device 300 is implemented using a smart watch, the sensing technology included in the smart watch itself can be integrated to real-time monitor the physiological data and movement of the patrol personnel. When an abnormal dynamic is detected, an alarm is sent to notify the user in real time, which helps to ensure the health and safety of the user. It not only improves the safety of equipment and workplaces, but also enables enterprises to more effectively prevent problems, reduce risks, and at the same time improve work efficiency and product quality.
[0052] In terms of system implementation, it may include the following procedures: signal bridging system construction, information interface application programming interface (API) construction, positioning system integration, AR system integration, and AR linkage system construction.
[0053] In addition, the intelligent inspection device proposed in the foregoing embodiments of the present application can also be linked to other management systems to implement task management that combines equipment inspection, area inspection, and sensor inspection. The management system may include a production management system, a video management system, and / or an Internet of Things system. The equipment inspection includes regular inspection and maintenance to ensure the normal operation of the equipment, thereby improving production efficiency and reliability. The area inspection covers the inspection of safety, environment, etc. in each area within the factory area to ensure that the working environment meets the standards. The sensor inspection focuses on the monitoring of sensing technologies to ensure accurate data and smooth system operation. Further, the above task management may include the following procedures: digitization of paper-based operation procedures, form system construction, database system construction, digital hierarchy form construction, and form linkage system construction.
[0054] In summary, the intelligent inspection device proposed in an embodiment of the present application includes the function of automatic path guidance, which can ensure that personnel arrive at the job site and guide the inspection personnel to the task location. In addition, the intelligent inspection devices of other embodiments of the present application also include the function of AI interpretation, which can automatically interpret the data of the equipment header and perform system binding, so that the data obtained from the inspection cannot be tampered with, ensuring the credibility of the information. The intelligent inspection devices of other embodiments of the present application also include the function of positioning and tracking. By tracking the movement of people and combining AI-assisted identification, it is ensured that the inspection personnel comply with the operation procedures when on duty. The intelligent inspection devices of other embodiments of the present application also include the function of data digitization. Through the digital management of materials, equipment, and production information, real-time status tracking and task management are realized. The intelligent inspection devices of other embodiments of the present application also include the function of dynamic alarm, which can realize instant message browsing and status reporting.
[0055] Although the present application is disclosed as above with the foregoing embodiments, it is not intended to limit the present application. Without departing from the spirit and scope of the present application, any changes and modifications are within the scope of the patent protection of the present application. Regarding the scope of protection defined by the present application, please refer to the scope of the appended claims.
Claims
1. An intelligent inspection device, characterized in that: Include: a positioning module, used to generate device location information; An input component, used to obtain a task instruction; a display assembly; and An operating element is connected to the positioning module, the input component and the display component, and is used to generate a target position information according to the task instruction, generate a path direction according to the device position information, a default layout information and the target position information, and present a virtual environment model corresponding to the default layout information and the path direction through the display component.
2. The intelligent inspection device according to claim 1, characterized in that: The default arrangement information includes a plurality of shielding position information corresponding to a plurality of obstacles in a work field, and the path direction indicates the direction of the shortest path between the device position information and the target position information excluding the plurality of shielding position information.
3. The intelligent inspection device according to claim 1, characterized in that: The operating element stores a plurality of candidate position information respectively corresponding to a plurality of candidate tasks, and the operating element selects one corresponding to the target task indicated by the task instruction as the target position information from the plurality of candidate position information.
4. The intelligent inspection device according to claim 1, characterized in that: The operating element is also used to determine whether the device location information falls within a legal location range and output a determination result.
5. The intelligent inspection device according to claim 4, characterized in that: Also includes: a prompting component connected to the operating element; The operating element is also used to control the prompt component to output a prompt signal when it is determined that the device location information does not fall within the legal location range.
6. The intelligent inspection device according to claim 1, characterized in that: Also includes: A photographing component, connected to the operating element, for photographing a target object to generate an image; The operating element is further used to analyze the image to determine at least one of the type, value and state of the target object.
7. The intelligent inspection device according to claim 6, characterized in that: The operating element is used to analyze the image to determine the type of the target object, determine whether the value or state of the target object meets a preset condition corresponding to the type, and output a determination result.
8. The intelligent inspection device according to claim 7, characterized in that: Also includes: a prompting component connected to the operating element; The operating element is also used to control the prompt component to output a prompt signal when it is determined that the value or the state of the target object does not meet the preset condition.
9. The intelligent inspection device according to claim 1, characterized in that: The positioning module comprises: An inertial positioning component, used to generate inertial positioning information; A wireless signal positioning component, used to generate wireless signal positioning information; and A processing component is connected to the inertial positioning component and the wireless signal positioning component, and is used to generate the device location information according to the inertial positioning information and the wireless signal positioning information.
10. The intelligent inspection device according to claim 1, characterized in that: The operating element is also used to present at least one of task information, personnel information and tool information through the display component.