Intelligent tool management method and device based on fusion of AR vision and RFID

Abstract

The invention discloses an intelligent tool management method and device based on fusion of AR vision and RFID. The method relates to the technical field of power system asset management and Internet of Things application, and comprises the following steps: querying a preset standard operation library based on a received work task to obtain a tool list corresponding to the work task; receiving video stream data obtained by selecting tools by the target user according to the work task by adopting AR visual equipment; identifying the video stream data to obtain guide paths used for acquiring different tools in the tool list, so as to guide the path of the target user based on the guide paths, the different tools carrying tags; and receiving label data of different tools read by a reader-writer, and managing the tools according to the label data and list information of different tools in the tool list. According to the method, the inspection efficiency can be improved, and the equipment management safety is improved.

Description

Technical Field

[0001] This invention relates to the field of power system asset management and Internet of Things application technology, and in particular to a method, device and equipment for intelligent management of tools based on the fusion of AR vision and RFID. Background Technology

[0002] In grassroots teams within the power industry, such as power supply stations and maintenance centers, the management of tools and equipment is fundamental to ensuring the safe and efficient operation of daily maintenance and emergency repairs. However, current management models generally suffer from the following shortcomings: Low efficiency in location and identification: The variety and specifications of tools and equipment in warehouses make it difficult for new employees to quickly find and accurately identify the required tools. Preparation is time-consuming, severely impacting work efficiency, especially during emergency response to faults, where delays can lead to greater losses. Outdated management methods and inaccurate information recording: The widespread use of paper ledgers for manual registration results in problems such as untimely recording, illegible handwriting, easy loss, and easy alteration. Inventory, calibration, and maintenance information for tools and equipment form "data silos," hindering effective digital asset management. Human error in safety control: Manual verification cannot ensure that the tools and equipment used (especially safety tools such as voltage detectors, grounding wires, and insulated operating rods) completely match the work order requirements, and it is impossible to verify in real time whether they are within their validity period. Using substandard or expired tools poses a serious operational safety hazard. A gap exists in the lifecycle management of tools and equipment: the entire process from procurement, warehousing, issuance, calibration, maintenance to disposal cannot be automatically and continuously recorded. Managers cannot perform accurate data analysis, lifespan prediction, and cost control, resulting in inefficient management. While existing technologies include standalone RFID asset management systems or QR code-based material management systems, they lack intuitive spatial guidance capabilities and cannot solve the problem of "difficulty in finding tools." Meanwhile, simple AR applications lack automatic, batch data collection capabilities. Summary of the Invention

[0003] In view of this, the present invention provides a method, device, storage medium and electronic device for intelligent management of tools and equipment based on the integration of AR vision and RFID. The main purpose is to solve the problems of difficult tool and equipment addressing, low verification efficiency, weak security control and imprecise management.

[0004] To address the aforementioned problems, this application provides a method for intelligent management of tools and equipment based on the fusion of AR vision and RFID, comprising: Based on the received work task, a preset standard operation library is queried to obtain a list of tools and equipment corresponding to the work task, and the work task bound to the list of tools and equipment is dispatched to the target user. Receive video stream data of the target user selecting tools according to the work task using an AR vision device; The video stream data is identified to obtain a guidance path for acquiring different tools in the tool list, so as to provide path guidance to the target user based on the guidance path. Different tools carry RFID tags. The system receives tag data from different tools and implements that are read by an RFID reader, and manages the tools and implements based on the tag data and the list information of different tools and implements in the tool and implements list.

[0005] Optionally, before querying a preset standard operation library based on the received work task to obtain a list of tools and equipment corresponding to the work task, the method further includes: constructing a standard operation library; The construction of the standard operation library specifically includes: Define each work task; Determine the basic information of each work task and the list of tools and equipment corresponding to each work task; The mapping relationship between the basic information and the tool list for the same work task is constructed to obtain the standard operation library.

[0006] Optionally, the step of identifying the video stream data to obtain a guiding path for acquiring different tools in the tool list specifically includes: Target identification is performed on the video stream data to obtain at least one target tool from the tool list; Use any one of the following methods to generate a guide path for the target tool: virtual highlighted arrows, halos, or 3D paths. When the distance between the AR vision device worn by the target person and the target tool is less than or equal to a preset threshold, the tool information of the target tool is superimposed and displayed in the field of view of the AR vision device.

[0007] Optionally, the step of managing the tools based on the tag data and the list information of different tools in the tool list specifically includes: The label data and the list information of different tools in the tool list are compared to obtain the first detection result; The validity period of the tool is verified to obtain a second test result; The tools and equipment are verified based on the first and second test results, and managed according to the verification results.

[0008] Optionally, the step of verifying the tool based on the first detection result and the second detection result, and managing the tool based on the verification result, specifically includes: When the first detection result is that the tag data matches the list information of different tools in the tool list and all the tools are within their validity period, the inspection is passed, and the intelligent gate is opened, allowing the target personnel to carry different tools from the tool list out of the warehouse.

[0009] Optionally, the method of verifying based on the first detection result and the second detection result, and managing the device based on the verification result, further includes: When the first detection result is that the label data and the list information of different tools in the tool list do not match, or the tools in the tool list are not valid, the inspection fails and an alarm message for the reason for the inspection failure is generated. The alarm information indicating the reason for the inspection failure is displayed in the field of view of the AR vision device to prompt the target personnel to re-acquire the tools according to the alarm information indicating the reason for the inspection failure. The intelligent gate is controlled to close, preventing the target personnel from taking different tools from the tool list out of the warehouse.

[0010] Optionally, the method further includes: Update the inventory status of the tools and equipment in the tool and equipment list; Electronic records are generated based on the entry / exit timestamps, the target personnel, the work tasks, and the tool identifiers of the tools.

[0011] To address the aforementioned problems, this application provides a tool management device based on the fusion of AR vision and RFID, comprising: The query module is used to query a preset standard operation library based on the received work task, obtain a list of tools and equipment corresponding to the work task, and dispatch the work task bound to the list of tools and equipment to the target user. The receiving module is used to receive video stream data of the target user selecting tools according to the work task using an AR vision device; The identification module is used to identify the video stream data to obtain a guidance path for acquiring different tools in the tool list, so as to provide path guidance to the target user based on the guidance path, wherein different tools carry RFID tags; The management module is used to receive tag data of different tools and implements that are read by an RFID reader and implement, and to manage the tools and implements based on the tag data and the list information of different tools and implements in the tool and implements list.

[0012] To address the aforementioned issues, this application provides a storage medium storing a computer program that, when executed by a processor, implements the steps of the aforementioned tool management method based on the fusion of AR vision and RFID.

[0013] To address the aforementioned problems, this application provides an electronic device, comprising at least a memory and a processor. The memory stores a computer program, and the processor, when executing the computer program in the memory, implements the steps of the aforementioned tool management method based on the fusion of AR vision and RFID.

[0014] The beneficial effects of this application are as follows: This application obtains a list of tools and equipment corresponding to a received work task by querying a preset standard operation library, and assigns the work task bound to the tool and equipment list to the target user; it receives video stream data of the target user selecting tools and equipment according to the work task using an AR vision device; it identifies the video stream data to obtain guidance paths for acquiring different tools and equipment in the tool and equipment list, and provides path guidance to the target user based on the guidance paths, wherein different tools and equipment carry RFID tags; it receives tag data of different tools and equipment by reading the RFID tags using an RFID reader and manages the tools and equipment according to the tag data and the list information of different tools and equipment in the tool and equipment list. Through AR spatial navigation, new employees can quickly locate tools like experienced employees, which is expected to shorten preparation time by more than 50%. Through mandatory real-time comparison of "item-order", a "digital checkpoint" is established before the goods are dispatched, eliminating the safety hazard of mistakenly taking unqualified tools and equipment from the source. Seamless data collection throughout the entire process enables real-time transparency of asset status and full lifecycle traceability, providing data support for scientific decision-making. It reduces manpower investment in warehouse management, improves inventory efficiency, and optimizes procurement and disposal strategies for tools and equipment through data analysis.

[0015] The above description is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of the present invention more apparent and understandable, specific embodiments of the present invention are described below. Attached Figure Description

[0016] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings: Figure 1The illustration shows a flowchart of an intelligent tool management method based on the fusion of AR vision and RFID provided in an embodiment of this application; Figure 2 This illustration shows a flowchart of a tool intelligent management method based on the fusion of AR vision and RFID, according to another embodiment of this application. Figure 3 The diagram shows a structural block diagram of a tool intelligent management device based on the fusion of AR vision and RFID, according to another embodiment of this application. Detailed Implementation

[0017] Various embodiments and features of this application are described herein with reference to the accompanying drawings.

[0018] It should be understood that various modifications can be made to the embodiments described herein. Therefore, the above description should not be considered as limiting, but merely as an example of embodiments. Other modifications within the scope and spirit of this application will be apparent to those skilled in the art.

[0019] The accompanying drawings, which are included in and form part of this specification, illustrate embodiments of the present application and, together with the general description of the present application given above and the detailed description of the embodiments given below, serve to explain the principles of the present application.

[0020] These and other features of this application will become apparent from the following description of preferred forms of embodiments given as non-limiting examples, with reference to the accompanying drawings.

[0021] It should also be understood that although this application has been described with reference to some specific examples, those skilled in the art can certainly implement many other equivalent forms of this application.

[0022] The above and other aspects, features and advantages of this application will become more apparent when taken in conjunction with the accompanying drawings and in view of the following detailed description.

[0023] Specific embodiments of this application are described thereafter with reference to the accompanying drawings; however, it should be understood that the claimed embodiments are merely examples of this application, which can be implemented in various ways. Well-known and / or repeated functions and structures are not described in detail to avoid unnecessary or redundant details that could obscure the application. Therefore, the specific structural and functional details claimed herein are not intended to be limiting, but merely serve as the basis and representative basis for the claims to teach those skilled in the art to use this application in a variety of substantially any suitable detailed structures.

[0024] This specification may use the phrases “in one embodiment,” “in another embodiment,” “in yet another embodiment,” or “in other embodiments,” all of which may refer to one or more of the same or different embodiments according to this application.

[0025] This application provides a method for intelligent management of tools and equipment based on the fusion of AR vision and RFID, such as... Figure 1 As shown, it includes: Step S101: Based on the received work task, query the preset standard operation library to obtain the tool list corresponding to the work task, and dispatch the work task bound to the tool list to the target user; In this step, the received work task is used to query a pre-built standard operation library to obtain a list of tools and equipment corresponding to the work task. The standard operation library pre-builds a mapping relationship between each work task and the list of tools and equipment. The work task can be obtained by querying the mapping relationship in the standard operation library according to the work task, so as to dispatch the work task bound to the list of tools and equipment to the target user.

[0026] Step S102: Receive video stream data of the target user selecting tools according to the work task using an AR vision device; In the specific implementation process of this step, the operator enters the warehouse, starts the application through the AR smart terminal and selects the current work task; by receiving the video stream data of the target user selecting tools according to the work task using the AR vision device, the approximate location of the tools is perceived, and the location of the target tools is dynamically guided in the AR field of view in the form of virtual highlighted arrows, halos or 3D paths.

[0027] Step S103: Identify the video stream data to obtain a guidance path for acquiring different tools in the tool list, so as to provide path guidance to the target user based on the guidance path, wherein different tools carry RFID tags; In this step, target recognition is performed on the video stream data to obtain at least one target tool from the tool list; a guiding path is generated for the target tool using any one of the following methods: virtual highlight arrow, halo, and 3D path; when the distance between the AR vision device worn by the target person and the target tool is less than or equal to a preset threshold, the tool information of the target tool is superimposed and displayed in the field of view of the AR vision device.

[0028] Step S104: Receive tag data of different tools and implements using an RFID reader to read the RFID tags, and manage the tools and implements based on the tag data and the list information of different tools and implements in the tool and implements list.

[0029] In this step, the label data and the list information of different tools in the tool list are compared to obtain a first detection result; the validity period of the tools is verified to obtain a second detection result; verification is performed based on the first and second detection results, and the tools are managed according to the verification results. The system compares the scanned tool ID list with the work order requirement list in real time and verifies the validity period of safety tools; if the match is successful, it is released and recorded; if the match fails, a visual and voice alarm is issued through the AR terminal, and the release is prevented until the error is corrected.

[0030] This application obtains a list of tools and equipment corresponding to a received work task by querying a preset standard operation library, and then assigns the work task bound to the tool and equipment list to the target user. It receives video stream data of the target user selecting tools and equipment according to the work task using an AR vision device; identifies the video stream data to obtain guidance paths for acquiring different tools and equipment in the tool and equipment list, and provides path guidance to the target user based on these paths. Different tools and equipment carry RFID tags. It receives tag data of different tools and equipment by reading the RFID tags using an RFID reader and manages the tools and equipment based on the tag data and the list information of different tools and equipment in the tool and equipment list. Through AR spatial navigation, new employees can quickly locate tools like experienced employees, which is expected to shorten preparation time by more than 50%. Through mandatory real-time comparison of "item-order," a "digital checkpoint" is established before outbound shipment, eliminating the safety hazard of mistakenly taking unqualified tools and equipment from the source. Seamless data collection throughout the entire process enables real-time transparency of asset status and full lifecycle traceability, providing data support for scientific decision-making. It reduces manpower investment in warehouse management, improves inventory efficiency, and optimizes procurement and disposal strategies for tools and equipment through data analysis.

[0031] Another embodiment of this application provides a different tool management method based on the fusion of AR vision and RFID, such as... Figure 2 As shown, it includes: Step S201: Build a standard operation library; In this step, the specific implementation process involves determining each work task; identifying the basic information of each work task and the corresponding tool and equipment list; and constructing a mapping relationship between the basic information and the tool and equipment list for the same work task to obtain the standard operation library. The standard operation library contains a database of standard tools, quantities, and specifications required for various work tasks. A work task can be a "surge arrester replacement work order," and the tool and equipment list corresponding to this work order includes one 10kV voltage detector, one insulating operating rod, and one safety helmet. The standard operation library can be constructed using source document analysis methods, collecting data through safety regulations and work instructions, technical standards and drawings, historical work orders and work permits, etc. Specifically, this involves consulting industry and company internal documents such as the "XXX Power Safety Work Regulations" and "XXX Standardized Work Instructions." These documents specify the necessary safety tools and protective equipment for completing a specific task. The maintenance manuals and technical drawings provided by the equipment manufacturer are reviewed to determine if special tools are required. Past work records are analyzed to understand the commonly used tool combinations in actual operations. Data can also be collected through on-site experience extraction methods, such as expert interviews and seminars, on-site observation, and questionnaires. Specifically, interview meetings with experienced employees can be organized to discuss each specific task (e.g., "replacing surge arresters on a 10kV line"). Follow experienced work teams to observe and record the tools, quantities, and order of use they actually employ. Design structured forms for frontline employees to fill out lists of tools required for different tasks. Finally, the collected data can be structured and modeled to obtain the aforementioned standard operating procedure library.

[0032] Step S202: Based on the received work task, query the preset standard operation library to obtain the tool list corresponding to the work task, and dispatch the work task bound to the tool list to the target user; In this step, the received work task is used to query a pre-built standard operation library to obtain a list of tools and equipment corresponding to the work task. The standard operation library pre-builds a mapping relationship between each work task and the list of tools and equipment. The work task can be obtained by querying the mapping relationship in the standard operation library according to the work task, so as to dispatch the work task bound to the list of tools and equipment to the target user.

[0033] Step S203: Receive video stream data of the target user selecting tools according to the work task using an AR vision device; In this step, employees enter the warehouse, wear AR vision devices, and launch the application to select their current work task. The AR vision devices move with the target user's location and perform target detection on the tools and equipment within the current field of view. When any tool or equipment from the tool and equipment list is present within the field of view, the current video stream data is collected.

[0034] Step S204: Identify the video stream data to obtain the guiding path for acquiring different tools in the tool list; In this step, target recognition is performed on the video stream data to obtain at least one target tool from the tool list. A deep learning-based target recognition method can be used, such as the YOLO (You Only Look Once) single-stage algorithm model or a Transformer-based detection algorithm. The target recognition model of this application can be configured according to actual needs, using any one of virtual highlighted arrows, halos, or 3D paths to generate a guide path for the target tool. This guide path then directs the target user to select the target tool according to the direction of the virtual highlighted arrow, the position of the halo, or the 3D path.

[0035] Step S205: Provide path guidance to the target user based on the guidance path, wherein different tools are equipped with RFID tags; In this step, the guidance path is used to guide the target user to select the target tool according to the direction of the virtual highlighted arrow, the halo position, or the 3D path. For example, target person Zhang San receives a work task on his mobile terminal: "Replace the surge arrester on pole #15 of 10kV XX line". He enters the tool library, puts on AR glasses, and selects the work task. The glasses interface immediately displays a virtual highlighted arrow, guiding him to the shelf storing "10kV voltage detectors" and "insulated operating rods". When the target person reaches the shelf, the AR glasses' field of view scans the tools, and each tool's basic information is displayed floating on it. The target person picks up an insulated operating rod, and the glasses, by recognizing its shape, announce in voice: "Insulated operating rod, qualified, verification period until June 30, 2025". The RFID tag includes name, specifications, and status information.

[0036] Step S206: Compare the tag data with the list information of different tools in the tool list to obtain the first detection result; In this step, the tool ID list obtained by scanning the tag data is compared with the tool list required by the work task in real time. When the tool ID list matches the tool list, the comparison result is the first detection result that the tool ID list matches the tool list; when the tool ID list does not match the tool list, the comparison result is the first detection result that the tool ID list does not match the tool list.

[0037] Step S207: Verify the validity period of the tool to obtain a second test result; In the specific implementation process of this step, when the tool is within the validity period, a second test result of "validity period qualified" is obtained; when the tool is not within the validity period, a second test result of "validity period unqualified" is obtained.

[0038] Step S208: Verify the results based on the first and second detection results, and manage the tools based on the verification results.

[0039] In this step, when the first detection result shows that the tag data matches the list information of different tools in the tool list and all tools are valid, the inspection passes, and the smart gate opens, allowing the target personnel to take different tools from the tool list out of the warehouse. When the first detection result shows that the tag data does not match the list information of different tools in the tool list, or the tools in the tool list are not valid, the inspection fails, and an inspection failure alarm is generated. The inspection failure alarm is displayed in the field of view of the AR vision device to prompt the target personnel to re-acquire the tools according to the inspection failure alarm. The smart gate closes, preventing the target personnel from taking different tools from the tool list out of the warehouse. The inventory status of the tools in the tool list is updated; an electronic record is generated based on the entry / exit timestamp, the target personnel, the work task, and the tool identifier of the tool.

[0040] This application constructs a standard operating procedure (SOP) library; based on received work tasks, it queries a preset SOP library to obtain a list of tools and equipment corresponding to the work tasks, and assigns the work tasks bound to the tool and equipment list to target users; it receives video stream data of the target users selecting tools and equipment according to the work tasks using AR vision devices; it identifies the video stream data to obtain guidance paths for acquiring different tools and equipment in the tool and equipment list; it provides path guidance to the target users based on the guidance paths, and different tools and equipment carry RFID tags; it compares the tag data with the list information of different tools and equipment in the tool and equipment list to obtain a first detection result; it verifies the validity period of the tools and equipment to obtain a second detection result; it verifies based on the first detection result and the second detection result, and manages the tools and equipment based on the verification results. This application uses AR spatial navigation to enable new employees to quickly locate tools like experienced employees, which is expected to shorten preparation time by more than 50%. Through mandatory real-time comparison of "items and orders," a "digital checkpoint" is established before outbound delivery, eliminating the safety hazard of mistakenly taking unqualified tools and equipment from the source. Seamless data collection throughout the entire process enables real-time transparency of asset status and full lifecycle traceability, providing data support for scientific decision-making. It reduces manpower investment in warehouse management, improves inventory efficiency, and optimizes procurement and disposal strategies for tools and equipment through data analysis.

[0041] Another embodiment of this application provides a tool management device based on the fusion of AR vision and RFID, such as... Figure 3 As shown, it includes: Query module 1 is used to query a preset standard operation library based on the received work task, obtain a list of tools and equipment corresponding to the work task, and dispatch the work task bound to the list of tools and equipment to the target user. Receiving module 2 is used to receive video stream data of the target user selecting tools according to the work task using an AR vision device; Identification module 3 is used to identify the video stream data to obtain a guidance path for acquiring different tools in the tool list, so as to provide path guidance to the target user based on the guidance path, wherein different tools carry RFID tags; Management module 4 is used to receive tag data of different tools and implements that are read by an RFID reader and implement, and to manage the tools and implements according to the tag data and the list information of different tools and implements in the tool and implements list.

[0042] In specific implementation, the device further includes a standard operation library construction module, which is specifically used to: determine each work task; determine the basic information of each work task and the tool list corresponding to each work task; construct the mapping relationship between the basic information and the tool list of the same work task to obtain the standard operation library.

[0043] In the specific implementation process, the recognition module 3 is specifically used to perform target recognition on the video stream data to obtain at least one target tool in the tool list; to generate a guide path for the target tool using any one of the following methods: virtual highlight arrow, halo, and 3D path; and when the distance between the AR vision device worn by the target person and the target tool is less than or equal to a preset threshold, the tool information of the target tool is controlled to be superimposed and displayed in the field of view area of ​​the AR vision device.

[0044] In the specific implementation process, the management module 4 is specifically used to: compare the label data with the list information of different tools in the tool list to obtain a first detection result; verify the validity period of the tools to obtain a second detection result; verify according to the first detection result and the second detection result, and manage the tools according to the verification result.

[0045] In the specific implementation process, the management module 4 is also used to: when the first detection result is that the tag data and the list information of different tools in the tool list match and all the tools are within their validity period, the inspection is passed, and the intelligent gate is opened to allow the target personnel to take different tools from the tool list out of the warehouse.

[0046] In the specific implementation process, the management module 4 is also used to: when the first detection result is that the tag data and the list information of different tools in the tool list do not match, or the tools in the tool list are not valid, the inspection fails and an inspection failure reason alarm message is generated; the inspection failure reason alarm message is displayed through the field of view of the AR vision device to prompt the target personnel to re-acquire the tools according to the inspection failure reason alarm message; and control the intelligent gate to close, preventing the target personnel from taking different tools in the tool list out of the warehouse.

[0047] In the specific implementation process, the management module 4 is also used to: update the inventory status of the tools in the tool list; and generate electronic records based on the entry and exit timestamps, the target personnel, the work tasks, and the tool identifiers of the tools.

[0048] This application obtains a list of tools and equipment corresponding to a received work task by querying a preset standard operation library, and then assigns the work task bound to the tool and equipment list to the target user. It receives video stream data of the target user selecting tools and equipment according to the work task using an AR vision device; identifies the video stream data to obtain guidance paths for acquiring different tools and equipment in the tool and equipment list, and provides path guidance to the target user based on these paths. Different tools and equipment carry RFID tags. It receives tag data of different tools and equipment by reading the RFID tags using an RFID reader and manages the tools and equipment based on the tag data and the list information of different tools and equipment in the tool and equipment list. Through AR spatial navigation, new employees can quickly locate tools like experienced employees, which is expected to shorten preparation time by more than 50%. Through mandatory real-time comparison of "item-order," a "digital checkpoint" is established before outbound shipment, eliminating the safety hazard of mistakenly taking unqualified tools and equipment from the source. Seamless data collection throughout the entire process enables real-time transparency of asset status and full lifecycle traceability, providing data support for scientific decision-making. It reduces manpower investment in warehouse management, improves inventory efficiency, and optimizes procurement and disposal strategies for tools and equipment through data analysis.

[0049] Another embodiment of this application provides a storage medium storing a computer program, which, when executed by a processor, implements the following method steps: Step 1: Based on the received work task, query the preset standard operation library to obtain the tool list corresponding to the work task, and dispatch the work task bound to the tool list to the target user. Step 2: Receive video stream data of the target user selecting tools according to the work task using an AR vision device; Step 3: Identify the video stream data to obtain the guidance path for acquiring different tools in the tool list, so as to provide path guidance to the target user based on the guidance path. Different tools carry RFID tags. Step 4: Receive tag data from different tools and implements using an RFID reader to read the RFID tags, and manage the tools and implements based on the tag data and the list information of different tools and implements in the tool and implements list.

[0050] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0051] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is used as an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0052] The specific implementation process of the above method steps can be found in any of the above embodiments of the tool management method based on the fusion of AR vision and RFID, and will not be repeated here.

[0053] This application obtains a list of tools and equipment corresponding to a received work task by querying a preset standard operation library, and then assigns the work task bound to the tool and equipment list to the target user. It receives video stream data of the target user selecting tools and equipment according to the work task using an AR vision device; identifies the video stream data to obtain guidance paths for acquiring different tools and equipment in the tool and equipment list, and provides path guidance to the target user based on these paths. Different tools and equipment carry RFID tags. It receives tag data of different tools and equipment by reading the RFID tags using an RFID reader and manages the tools and equipment based on the tag data and the list information of different tools and equipment in the tool and equipment list. Through AR spatial navigation, new employees can quickly locate tools like experienced employees, which is expected to shorten preparation time by more than 50%. Through mandatory real-time comparison of "item-order," a "digital checkpoint" is established before outbound shipment, eliminating the safety hazard of mistakenly taking unqualified tools and equipment from the source. Seamless data collection throughout the entire process enables real-time transparency of asset status and full lifecycle traceability, providing data support for scientific decision-making. It reduces manpower investment in warehouse management, improves inventory efficiency, and optimizes procurement and disposal strategies for tools and equipment through data analysis.

[0054] Another embodiment of this application provides an electronic device, which can be a server. The electronic device includes a processor, a memory, a network interface, and a database connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile and / or volatile storage media and internal memory. The non-volatile storage media stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface is used to communicate with external clients via a network connection. When the program is executed by the processor, it implements the functions or steps of a server-side tool management method based on AR vision and RFID fusion.

[0055] In one embodiment, an electronic device is provided, which can be a client. The electronic device includes a processor, memory, a network interface, a display screen, and an input device connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface is used to communicate with an external server via a network connection. When the program is executed by the processor, it implements client-side functions or steps of a tool management method based on AR vision and RFID fusion.

[0056] Another embodiment of this application provides an electronic device, including at least a memory and a processor. The memory stores a computer program, and the processor, when executing the computer program in the memory, performs the following method steps: Step 1: Based on the received work task, query the preset standard operation library to obtain the tool list corresponding to the work task, and dispatch the work task bound to the tool list to the target user. Step 2: Receive video stream data of the target user selecting tools according to the work task using an AR vision device; Step 3: Identify the video stream data to obtain the guidance path for acquiring different tools in the tool list, so as to provide path guidance to the target user based on the guidance path. Different tools carry RFID tags. Step 4: Receive tag data from different tools and implements using an RFID reader to read the RFID tags, and manage the tools and implements based on the tag data and the list information of different tools and implements in the tool and implements list.

[0057] The specific implementation process of the above method steps can be found in any of the above embodiments of the tool management method based on the fusion of AR vision and RFID, and will not be repeated here.

[0058] This application obtains a list of tools and equipment corresponding to a received work task by querying a preset standard operation library, and then assigns the work task bound to the tool and equipment list to the target user. It receives video stream data of the target user selecting tools and equipment according to the work task using an AR vision device; identifies the video stream data to obtain guidance paths for acquiring different tools and equipment in the tool and equipment list, and provides path guidance to the target user based on these paths. Different tools and equipment carry RFID tags. It receives tag data of different tools and equipment by reading the RFID tags using an RFID reader and manages the tools and equipment based on the tag data and the list information of different tools and equipment in the tool and equipment list. Through AR spatial navigation, new employees can quickly locate tools like experienced employees, which is expected to shorten preparation time by more than 50%. Through mandatory real-time comparison of "item-order," a "digital checkpoint" is established before outbound shipment, eliminating the safety hazard of mistakenly taking unqualified tools and equipment from the source. Seamless data collection throughout the entire process enables real-time transparency of asset status and full lifecycle traceability, providing data support for scientific decision-making. It reduces manpower investment in warehouse management, improves inventory efficiency, and optimizes procurement and disposal strategies for tools and equipment through data analysis.

[0059] The above embodiments are merely exemplary embodiments of this application and are not intended to limit this application. The scope of protection of this application is defined by the claims. Those skilled in the art can make various modifications or equivalent substitutions to this application within its substance and scope of protection, and such modifications or equivalent substitutions should also be considered to fall within the scope of protection of this application.

Claims

1. An AR vision and RFID fusion-based tool management method, characterized by, include: Based on the received work task, a preset standard operation library is queried to obtain a list of tools and equipment corresponding to the work task, and the work task bound to the list of tools and equipment is dispatched to the target user. Receive video stream data of the target user selecting tools according to the work task using an AR vision device; The video stream data is identified to obtain a guidance path for acquiring different tools in the tool list, so as to provide path guidance to the target user based on the guidance path. Different tools carry RFID tags. The system receives tag data from different tools and implements that are read by an RFID reader, and manages the tools and implements based on the tag data and the list information of different tools and implements in the tool and implements list.

2. The method of claim 1, wherein, Before querying a preset standard operation library based on the received work task to obtain a list of tools and equipment corresponding to the work task, the method further includes: constructing a standard operation library; The construction of the standard operation library specifically includes: Define each work task; Determine the basic information of each work task and the list of tools and equipment corresponding to each work task; The mapping relationship between the basic information and the tool list for the same work task is constructed to obtain the standard operation library.

3. The method of claim 1, wherein, The step of identifying the video stream data to obtain a guidance path for acquiring different tools in the tool list specifically includes: Target identification is performed on the video stream data to obtain at least one target tool from the tool list; Use any one of the following methods to generate a guide path for the target tool: virtual highlighted arrows, halos, or 3D paths. When the distance between the AR vision device worn by the target person and the target tool is less than or equal to a preset threshold, the tool information of the target tool is superimposed and displayed in the field of view of the AR vision device.

4. The method as described in claim 3, characterized in that, The management of the tools based on the tag data and the list information of different tools in the tool list specifically includes: The label data and the list information of different tools in the tool list are compared to obtain the first detection result; The validity period of the tool is verified to obtain a second test result; The tools and equipment are verified based on the first and second test results, and managed according to the verification results.

5. The method as described in claim 4, characterized in that, The step of verifying the tools based on the first and second detection results, and managing the tools based on the verification results, specifically includes: When the first detection result is that the tag data matches the list information of different tools in the tool list and all the tools are within their validity period, the inspection is passed, and the intelligent gate is opened, allowing the target personnel to carry different tools from the tool list out of the warehouse.

6. The method as described in claim 4, characterized in that, The method further includes verifying the tools based on the first and second detection results and managing them according to the verification results. When the first detection result is that the label data and the list information of different tools in the tool list do not match, or the tools in the tool list are not valid, the inspection fails and an alarm message for the reason for the inspection failure is generated. The alarm information indicating the reason for the inspection failure is displayed in the field of view of the AR vision device to prompt the target personnel to re-acquire the tools according to the alarm information indicating the reason for the inspection failure. The intelligent gate is controlled to close, preventing the target personnel from taking different tools from the tool list out of the warehouse.

7. The method as described in claim 5, characterized in that, The method further includes: Update the inventory status of the tools and equipment in the tool and equipment list; Electronic records are generated based on the entry / exit timestamps, the target personnel, the work tasks, and the tool identifiers of the tools.

8. A tool management device based on the fusion of AR vision and RFID, characterized in that, include: The query module is used to query a preset standard operation library based on the received work task, obtain a list of tools and equipment corresponding to the work task, and dispatch the work task bound to the list of tools and equipment to the target user. The receiving module is used to receive video stream data of the target user selecting tools according to the work task using an AR vision device; The identification module is used to identify the video stream data to obtain a guidance path for acquiring different tools in the tool list, so as to provide path guidance to the target user based on the guidance path, wherein different tools carry RFID tags; The management module is used to receive tag data of different tools and implements that are read by an RFID reader and implement, and to manage the tools and implements based on the tag data and the list information of different tools and implements in the tool and implements list.

9. A storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the steps of the tool management method based on the fusion of AR vision and RFID as described in any one of claims 1-7.

10. An electronic device, characterized in that, It includes at least a memory and a processor, wherein the memory stores a computer program, and the processor, when executing the computer program in the memory, implements the steps of the tool management method based on the fusion of AR vision and RFID as described in any one of claims 1-7.

Images