Intelligent tool missing detection method and system, electronic device and storage medium

Abstract

The present invention provides an intelligent tool missing detection method and system, electronic device and storage medium, the method comprising: based on an RFID reader, reading the RFID tag of a first-category tool; based on a camera, acquiring an image of a second-category tool; based on a data processor, obtaining a current tool list according to the RFID tag of the first-category tool and the image of the second-category tool; based on a data storage device, comparing the current tool list with a pre-stored initial tool list to determine whether there are missing tools; wherein, the first-category tool is provided with an RFID tag; the second-category tool is not provided with an RFID tag; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is the RFID tag of the first-category tool or the image of the second-category tool. Radio frequency identification technology and image recognition technology are used to intelligently identify whether there are missing tools when operators return them, thereby avoiding safety problems caused by missing tools.

Description

Technical Field

[0001] The present invention relates to the field of radio frequency identification technology, and in particular to an intelligent tool missing detection method and system, electronic equipment and storage medium. Background Art

[0002] Maintenance of large equipment requires operators to carry maintenance tools to the site for maintenance, inspection and other operations, and take the tools away from the site after the operation to prevent safety hazards on site due to missing tools.

[0003] Especially in application scenarios such as airports, where there are a large number of maintenance personnel and a large number of types of tools. Usually, there are about 400-500 maintenance personnel at an airport. According to their different maintenance contents, the maintenance personnel carry the required maintenance tools to the work site for maintenance. Each person is equipped with an average of about 80 tools, which they carry with them during the maintenance process. All maintenance tools should be taken away after each maintenance, and the maintenance tools must not be left on the aircraft or in the airport.

[0004] Among the maintenance tools of these aircraft, the smallest tools, such as split pins, are basically difficult to find once they fall into a joint or slot. Lost tools not only need to be replaced, but also pose potential threats during flight. For example, during high-speed flight, if a missing tool detaches and hits the cabin from the inside, it will have a serious impact on the safety of the aircraft.

[0005] Although maintenance personnel will count the maintenance tools after the maintenance work is completed, the inventory can only avoid the omission of maintenance tools as much as possible, but cannot completely eliminate the situation that maintenance tools are missed. There are still cases where maintenance tools are missed due to negligence of personnel. For example, there are several cases of maintenance tools being left on the aircraft every year.

[0006] Therefore, how to provide an intelligent tool missing detection method and system, electronic equipment and storage medium, use scientific and information-based safety management methods, intelligently identify whether there are any missing tools when operators return them and remind them, so as to avoid safety problems caused by missing tools, has become an urgent problem to be solved. Summary of the invention

[0007] In view of the deficiencies in the prior art, embodiments of the present invention provide an intelligent tool missing detection method and system, an electronic device and a storage medium.

[0008] The present invention provides a smart tool missing detection method, comprising:

[0009] Based on the RFID reader / writer, the RFID tag of the first type of tool is read;

[0010] Based on the camera, an image of the second type of tool is obtained;

[0011] Based on the data processor, obtaining a current tool list according to the RFID tags of the first-category tools and the images of the second-category tools;

[0012] Based on the data storage device, the current tool list is compared with the previously stored initial tool list to determine whether there are any missing tools;

[0013] Among them, the first category of tools are provided with RFID tags; the second category of tools are not provided with RFID tags; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is the RFID tag of the first category of tools or the image of the second category of tools.

[0014] According to the intelligent tool missing detection method provided by the present invention,

[0015] The data processor obtains a current tool list according to the RFID tags of the first-category tools and the images of the second-category tools, specifically including:

[0016] Based on the mapping relationship between the RFID tags of the first category of tools and the tools, a first tool list is obtained;

[0017] Based on the mapping relationship between the image of the second type of tool and the tool, a second tool list is obtained;

[0018] The current tool list is obtained according to the first tool list and the second tool list.

[0019] According to the intelligent tool missing detection method provided by the present invention,

[0020] Before the step of comparing the current tool list with the previously stored initial tool list based on the data storage device to determine whether there are any missing tools, the method further includes: generating the initial tool list;

[0021] The generating of the initial tool list specifically includes:

[0022] Get the storage location information and attribute information of all initial tools;

[0023] Classifying all the initial tools into first-category tools and second-category tools according to a preset classification rule;

[0024] Based on the RFID reader / writer, the RFID tag of the first type of initial tool is read;

[0025] Based on the camera, an image of the second type of initial tool is obtained;

[0026] Based on the data processor, the RFID tags of the first type of initial tools are mapped and bound with the storage location information and the attribute information to generate a first initial tool list;

[0027] Binding the image of the second type of initial tool with the storage location information and the attribute information mapping to generate a second initial tool list;

[0028] The initial tool list is obtained according to the first initial tool list and the second initial tool list.

[0029] According to the intelligent tool missing detection method provided by the present invention,

[0030] Also included: updating said initial tool list;

[0031] The updating of the initial tool list specifically includes:

[0032] Release the mapping binding relationship of the tools that need to be replaced in the original initial tool list;

[0033] Get the storage location and property information of the newly added tool;

[0034] Mapping and binding the electronic tag information of each newly added tool with the storage location information and attribute information to establish a mapping and binding relationship of the newly added tools;

[0035] The electronic tag information includes: the RFID tag of the first type of tool and the image information of the second type of tool.

[0036] According to the intelligent tool missing detection method provided by the present invention,

[0037] Before the steps of reading the RFID tag of the first type of tool based on the RFID reader / writer and acquiring the image of the second type of tool based on the camera, the method further includes:

[0038] Based on the identity recognition device, the user's identity information is obtained to determine whether the user has the lending authority;

[0039] If it is determined that the user has the lending authority, the user is allowed to lend the tool;

[0040] An initial tool list corresponding to the tools lent by the user is stored.

[0041] According to the intelligent tool missing detection method provided by the present invention,

[0042] After the step of comparing the current tool list with the initial tool list stored in advance based on the data storage to determine whether there are any missing tools, the method further includes:

[0043] If it is determined that there are missing tools, a reminder message will be sent and the user who borrowed the tool will be marked as having a bad record until the missing tool is found.

[0044] According to the intelligent tool missing detection method provided by the present invention,

[0045] After the step of allowing the user to lend the tool if it is determined that the user has the lending authority, the method further includes:

[0046] Based on the controller, the tools allowed to be lent by the user are locked, and the corresponding tools are no longer lent before the user returns all the lent tools.

[0047] The present invention also provides an intelligent tool missing detection system, comprising:

[0048] A first acquisition module, used for reading the RFID tag of the first category of tools based on the RFID reader;

[0049] A second acquisition module is used to acquire an image of the second type of tool based on a camera;

[0050] A data processing module, configured to obtain a current tool list based on a data processor according to the RFID tags of the first-category tools and the images of the second-category tools;

[0051] A data storage module, configured to compare the current tool list with a previously stored initial tool list based on a data storage device to determine whether there are any missing tools;

[0052] Among them, the first category of tools are provided with RFID tags; the second category of tools are not provided with RFID tags; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is the RFID tag of the first category of tools or the image of the second category of tools.

[0053] The present invention also provides an electronic device, comprising a memory and a processor, wherein the processor and the memory communicate with each other via a bus; the memory stores program instructions executable by the processor, and the processor calls the program instructions to execute the various steps of the above-mentioned intelligent tool missing detection method.

[0054] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the various steps of the above-mentioned intelligent tool missing detection method are implemented.

[0055] The intelligent tool missing detection method and system, electronic device and storage medium provided by the present invention use radio frequency identification technology and adopt scientific and information-based safety management measures to intelligently identify whether any tools are missing when operators return them and provide reminders, thereby avoiding safety problems caused by missing tools. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0057] Figure 1 A flow chart of a smart tool missing detection method provided by an embodiment of the present invention;

[0058] Figure 2 A flow chart for generating an initial tool list provided in an embodiment of the present invention;

[0059] Figure 3 A schematic diagram of the external structure of a tool cart provided by an embodiment of the present invention;

[0060] Figure 4 A flow chart of smart tool missing detection provided by an embodiment of the present invention;

[0061] Figure 5 A schematic diagram of the structure of an intelligent tool missing detection system provided by an embodiment of the present invention;

[0062] Figure 6 It is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention.

[0063] Reference numerals:

[0064] 11: Cabinet; 12: Drawer;

[0065] 13: RFID reader; 14: Camera;

[0066] 15: Display screen; 16: Universal wheel. DETAILED DESCRIPTION

[0067] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0068] Due to the large number and variety of maintenance tools, the same tool has different models and sizes, which can easily cause confusion and irregular on-site management. In order to manage and count factory maintenance tools more conveniently, efficiently and quickly, high-precision positioning management of maintenance tools is required.

[0069] Under the current management method, there is a possibility that maintenance personnel may leave maintenance tools at the work site due to lack of attention, fatigue, weak risk awareness, and negligence in inventory, thus creating potential safety hazards.

[0070] Figure 1 A flow chart of the intelligent tool missing detection method provided by an embodiment of the present invention, such as Figure 1 As shown, the method includes:

[0071] Step S1, reading the RFID tag of the first type of tool based on the RFID reader;

[0072] Step S2, acquiring an image of the second type of tool based on the camera;

[0073] Step S3, based on the data processor, obtaining a current tool list according to the RFID tags of the first category tools and the images of the second category tools;

[0074] Step S4, based on the data storage device, comparing the current tool list with the previously stored initial tool list to determine whether there are any missing tools;

[0075] Among them, the first category of tools are provided with RFID tags; the second category of tools are not provided with RFID tags; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is the RFID tag of the first category of tools or the image of the second category of tools.

[0076] Specifically, due to the different shapes (including round, square and irregular, etc.), sizes and materials (including metal, plastic and wood, etc.) of tools, some tools cannot be managed by adding RFID tags due to their small size or shape.

[0077] According to whether an RFID tag can be added, the tools are divided into the first category of tools and the second category of tools. The first category of tools is provided with an RFID tag, while the second category of tools is not provided with an RFID tag.

[0078] When performing the smart tool missing detection, in step S1, for a first type of tag provided with an RFID tag, the RFID tag of the first type of tool is read based on an RFID reader / writer.

[0079] In step S2, for the second type of tools that are not equipped with RFID tags, an image of the second type of tools is captured by a camera (or a video is recorded).

[0080] Furthermore, it is understood that, in addition to using image recognition technology to identify the tools of the second category label, a barcode or other mark can be attached to the second category tool to achieve the marking and identification of the second category tool. In specific applications, it can be selected according to the actual situation, or it can be further divided into more detailed categories and marked and identified using different methods.

[0081] In step S3, the RFID tag of the first category tool or the image of the second category tool read in step S1 and step S2 is used as the tool identification of the corresponding tool. Based on the data processor, the mapping and binding of the tool and the tool mark are realized according to the RFID tag of the first category tool and the image of the second category tool. The one-to-one correspondence between the tool and the tool mark is realized according to the mapping relationship, and the mapping relationship is recorded to obtain the current tool list.

[0082] In order to facilitate the inventory and management of tools, when storing tools in advance, the corresponding label information of the tools will be stored according to the corresponding methods for different types of tools, and an initial tool list will be generated based on the stored tools.

[0083] Current tools generally refer to all tools returned by maintenance personnel after using them for maintenance. Or, when management personnel need to check and count the tools, all tools stored in the current tool library.

[0084] In step S4, based on the data storage device, the current tool list obtained in step S3 is compared with the initial tool list stored in advance to determine whether there are any missing tools (for example, for this tool box, the initial tool list contains 25 tools, but after reading and identifying, the current tool list obtained contains only 23 tools, that is, it is determined that two tools are missing).

[0085] Further, a prompt message is issued according to the comparison result to remind the staff (maintenance personnel or management personnel, etc.) that there are missing tools. Based on the data storage device, the current tool list is compared with the initial tool list stored in advance to determine whether there are missing tools.

[0086] The intelligent tool missing detection method provided by the embodiment of the present invention uses radio frequency identification technology and image recognition technology to classify tools according to their characteristics. Corresponding signs and identification methods are adopted for different categories to achieve "one tool, one sign", improve the accuracy of tool inventory, adopt scientific and information-based safety management measures, improve the accuracy of tool inventory, intelligently identify whether there are any omissions when operators return tools and provide reminders to avoid safety problems caused by missing tools.

[0087] Based on the above embodiment, optionally, in the intelligent tool missing detection method, the data processor obtains the current tool list according to the RFID tags of the first category tools and the images of the second category tools, specifically including:

[0088] Based on the mapping relationship between the RFID tags of the first category of tools and the tools, a first tool list is obtained;

[0089] Based on the mapping relationship between the image of the second type of tool and the tool, a second tool list is obtained;

[0090] The current tool list is obtained according to the first tool list and the second tool list.

[0091] Specifically, based on the data processor, one-to-one binding of tools and tool tags is achieved.

[0092] For the first category of tools, a first tool list is obtained based on the mapping relationship between the RFID tags of the first category of tools and the tools.

[0093] For the second category of tools, a second tool list is obtained based on the mapping relationship between the images of the second category of tools and the tools.

[0094] A current tool list is obtained according to the first tool list and the second tool list.

[0095] For example, tools are numbered according to how often they are used (the most commonly used tool is numbered 1, and so on), and tools are divided into first-category tools and second-category tools according to whether RFID tags can be added. Based on the data processor, the numbers of the first-category tools are mapped and bound to the RFID tags to obtain a first tool list; the numbers of the second-category tools are mapped and bound to the images to obtain a second tool list.

[0096] In combination with the first tool list and the second tool list, the list contents are rearranged according to the arrangement of the tool numbers from small to large to obtain the current tool list.

[0097] It should be noted that numbering the tools according to their common usage and rearranging the list contents according to the size relationship of the tool numbers is only used as an example to illustrate the embodiment of the present invention. The coding and arrangement methods can be adjusted according to actual conditions, and this embodiment does not limit this.

[0098] On the basis of the above-mentioned embodiments, the embodiments of the present invention use image recognition technology to identify unset RFID tags, and combine radio frequency identification technology and image recognition technology to solve the technical problem that some tags cannot be identified by RFID tags due to their shape and size, and are difficult to find and locate when lost. By generating a tool list, it facilitates the inventory and missing detection of tools, improves the intelligent management capabilities of tools, and the convenience and accuracy of tool inventory.

[0099] Based on the above embodiment, optionally, in the intelligent tool missing detection method, before the step of comparing the current tool list with the initial tool list stored in advance based on the data storage device to determine whether there are missing tools, the method further includes: generating the initial tool list;

[0100] The generating of the initial tool list specifically includes:

[0101] Get the storage location information and attribute information of all initial tools;

[0102] Classifying all the initial tools into first-category tools and second-category tools according to a preset classification rule;

[0103] Based on the RFID reader / writer, the RFID tag of the first type of initial tool is read;

[0104] Based on the camera, an image of the second type of initial tool is obtained;

[0105] Based on the data processor, the RFID tags of the first type of initial tools are mapped and bound with the storage location information and the attribute information to generate a first initial tool list;

[0106] Binding the image of the second type of initial tool with the storage location information and the attribute information mapping to generate a second initial tool list;

[0107] The initial tool list is obtained according to the first initial tool list and the second initial tool list.

[0108] Specifically, for occasions such as airport maintenance, there are many types and quantities of tools. Generally speaking, tools are stored and managed according to their uses and types. In order to achieve subsequent tool management and missing detection, an initial tool list needs to be generated for all tools in advance.

[0109] The storage location information and attribute information of all initial tools are obtained, and the tools are divided into first-category tools and second-category tools according to whether RFID tags can be set. Based on the RFID reader, the RFID tags of the first-category initial tools are read; based on the camera, the images of the second-category initial tools are obtained. Based on the data processor, the storage location information and attribute information of each tool in the first category of tools are mapped and bound to its corresponding RFID tag to generate a first initial tool list.

[0110] The images of the second category of tools are collected, and the storage location information and attribute information of each tool in the second category of tools are bound to the corresponding tool image mapping to generate a second initial tool list.

[0111] The first initial tool list and the second initial tool list are combined to obtain an initial tool list.

[0112] It should be noted that, for the second type of tools, in addition to directly using the image of the tool as the tool's logo, the tool's features can also be extracted based on the image (or video) and the features can be used as the tool's logo.

[0113] It is understandable that before obtaining the storage location information and attribute information of all the initial tools, the tools need to be screened to determine whether the tools are the tools on the supply order and whether the tools have any quality problems.

[0114] It should be noted that the storage location information of the tool can be the warehouse where the tool is stored, the tool cabinet where the tool is specifically stored, the drawer location in the tool cabinet where the tool is specifically stored, etc. The attribute information can be the name, purpose, specifications, manufacturer and time of the tool itself, etc., which can be set according to actual needs, and this embodiment does not limit this.

[0115] Figure 2 The initial tool list generation flow chart provided in the embodiment of the present invention is as follows: Figure 2 As shown, the initial tool list generation includes the following steps:

[0116] Step 1: After the tools arrive at the warehouse, check whether the quantity information of the tools is consistent with the supply order and determine whether the tools are qualified. If the quantity information is consistent with the quantity on the supply order and the tools are qualified, electronic tags are issued, otherwise they are returned.

[0117] Step 2: Initialize the unique identifier of the tool:

[0118] 1. Establish tool coding rules, and encode the tools according to the location information to be stored according to the coding rules; for example (the tool storage location is coded with 6 as the number, where the first two digits represent the storage room, the middle two digits represent the storage tool cart, and the last two digits represent the storage tool cart drawer).

[0119] 2. Classify the tags into first-category tools (RFID tags can be set) and second-category tools (RFID tags cannot be set).

[0120] For the first type of tools: read the label surface information through the RFID handheld device: automatically generate the label's Electronic Product Code (EPC), write it into the EPC area of ​​the RFID label, complete the card number initialization work, and store the tool code;

[0121] For the second type of tools: the image of the tool is obtained through the camera and stored corresponding to the code of the tool.

[0122] 3. Obtain the attribute information of the tool (such as tool name, tool specification, warehouse number, manufacturer, annual inspection date, annual inspection validity period, annual inspection certificate, whether it is a consumable, etc.) and report it to the platform, and use the data processor to map and bind the attribute information of the tool with the tool code.

[0123] Step 3: For the first type of tools, the tool attribute information is mapped and bound to the RFID electronic tag; for the second type of tools, the tool attribute information is mapped and bound to the corresponding tool image. The bound mapping relationship and data information (storage location information and attribute information) are entered into the table to generate an initial tool list.

[0124] Tools come in different shapes, sizes and materials. For tools of normal and larger sizes, we select three sizes of tags: 10*3*4mm, 12*7*3mm and 13*9*3mm. For metal tools, we use anti-metal material labels to identify them, solving the problem that electronic tags cannot be attached to metal surfaces.

[0125] It should be noted that the specific selection and setting method of the RFID tag can be selected according to actual conditions, and this embodiment does not limit this.

[0126] Step 4: Use an RFID card issuer to encode the tool information and write it into the RFID electronic tag, then install the RFID electronic tag on the tool to complete the binding.

[0127] It should be noted that the above embodiment is only used as a specific example to explain the steps of generating an initial tool list based on the initial tools. In actual application, the tool screening method, the input type of tool information, etc. can be adjusted according to actual conditions, and this embodiment does not limit this.

[0128] On the basis of the above-mentioned embodiments, this embodiment uses radio frequency identification technology and image recognition technology to set a corresponding tool mark for each tool, and maps the storage location information and attribute information of the tool with the corresponding tool mark, and generates an initial tool list according to the corresponding mapping relationship and information, thereby providing a basis for the subsequent intelligent management of the tools.

[0129] Based on the above embodiment, optionally, in the intelligent tool missing detection method, it further includes: updating the initial tool list;

[0130] The updating of the initial tool list specifically includes:

[0131] Release the mapping binding relationship of the tools that need to be replaced in the original initial tool list;

[0132] Get the storage location and property information of the newly added tool;

[0133] Mapping and binding the electronic tag information of each newly added tool with the storage location information and attribute information to establish a mapping and binding relationship of the newly added tools;

[0134] The electronic tag information includes: the RFID tag of the first type of tool and the image information of the second type of tool.

[0135] Specifically, in the process of using tools, it is inevitable that the tools will be damaged, lost, etc. and need to be replaced. When replacing tools, there are two types: tools that need to be replaced and new tools that need to be added.

[0136] For newly added tools, the steps for classifying and binding mapping relationships are the same as the steps for generating the initial tool list, which will not be repeated here.

[0137] For tools that need to be replaced, the corresponding storage information needs to be deleted from the original initial tool list.

[0138] Specifically, the mapping relationship between the tool mark of the tool that needs to be replaced and the corresponding storage location information and attribute information is released.

[0139] Delete the data information corresponding to the tools that need to be replaced in the original initial tool list, and generate a new initial tool list based on the data information of the newly added tools.

[0140] The update of the initial tool list facilitates the management of tools, timely reflects the status of tool updates, and can query the historical information of all tools, thereby improving the level of intelligent tool missing detection. Based on the above embodiment, optionally, in the intelligent tool missing detection method, before the steps of reading the RFID tag of the first type of tool based on the RFID reader and obtaining the image of the second type of tool based on the camera, the method further includes:

[0141] Based on the identity recognition device, the user's identity information is obtained to determine whether the user has the lending authority;

[0142] If it is determined that the user has the lending authority, the user is allowed to lend the tool;

[0143] An initial tool list corresponding to the tools lent by the user is stored.

[0144] Specifically, in order to realize the intelligent management of tools, it is further necessary to manage the maintenance personnel, record the information of the personnel who lend the tools and the information of the borrowed tools, determine the flow of tools by recording the tool borrowing and returning information, and be able to quickly lock the maintenance personnel who lend the tools when the tools are lost, and further quickly determine the location where the tools are lost, thereby improving the efficiency of finding lost property, effectively improving management efficiency, and shortening working time.

[0145] When a user (maintenance personnel or management personnel, etc.) needs to borrow a tool, the user's identity information is obtained based on the identity recognition device to determine whether the user has borrowing authority. If it is determined that the user does not have borrowing authority, the tool is locked (the device that stores the tool is locked, or the tool storage warehouse is refused to open, etc.), and it is not allowed to be borrowed.

[0146] If it is determined that the user has the lending authority, the user is allowed to lend the tool, and the identity information of the user lending the tool and the initial tool list corresponding to the user's lending tool are stored.

[0147] Furthermore, the time when the user lent out the tool, the purpose of the user lending out the tool, etc. can also be stored. In addition, the identity recognition device can be an RFID card reader, which can be used with an employee card to identify personnel, so as to obtain user information and determine permissions. In addition, the above functions can also be realized using a software platform, a mobile APP software, or a small program, etc., which is not limited in this embodiment.

[0148] Based on the above embodiment, optionally, in the intelligent tool missing detection method, after the step of comparing the current tool list with the initial tool list stored in advance based on the data storage device to determine whether there are missing tools, the method further includes:

[0149] If it is determined that there are missing tools, a reminder message will be sent and the user who borrowed the tool will be marked as having a bad record until the missing tool is found.

[0150] Specifically, take the example of maintenance personnel lending and returning tools. When the maintenance personnel lends tools, a tool list (initial tool list) lent by the maintenance personnel and the identity information of the maintenance personnel are stored accordingly.

[0151] When the maintenance personnel returns the tools, the identity information of the maintenance personnel is read based on the identity recognition device, and the initial tool list stored in advance is retrieved and compared with the current tool list obtained by reading the returned tools to determine whether there are any missing tools. Furthermore, when it is determined that there are missing tools, relevant information about the missing tools can also be retrieved.

[0152] If it is determined that there are missing tools, a reminder message is sent to the maintenance personnel (management personnel or management platform, etc.), and the maintenance personnel who lent the tools are marked as having a bad record until the missing tools are found. It should be noted that the method of sending the reminder message can be selected according to the actual situation, and this embodiment does not limit this.

[0153] Maintenance personnel can use handheld RFID handsets to find tools with RFID tags, conduct detection and regional positioning, narrow the search range, and improve search efficiency. The handheld RIFD identifier has RFID reading and writing functions, and can read RFID tags. It is a PDA (portable mobile hardware) with specific functions. The frequency bands that the handheld RIFD identifier can read and write include low frequency, high frequency, ultra-high frequency, active, etc.

[0154] The intelligent tool missing detection method provided in this embodiment can automatically identify tools when maintenance personnel return tools and determine whether there are missing tools. It can also determine whether the maintenance personnel have a bad record based on whether the tools are missing when they are returned, which helps maintenance personnel develop good work habits and reduce the occurrence of tool loss after maintenance work. It can also realize corresponding intelligent management and control of tools and personnel based on the storage of loan information, and realize rapid query of tool flow when tools are lost, thereby improving the efficiency of finding lost tools.

[0155] Based on the above embodiment, optionally, in the intelligent tool missing detection method, after the step of allowing the user to lend the tool if it is determined that the user has the lending authority, the method further includes:

[0156] Based on the controller, the tools allowed to be lent by the user are locked, and the corresponding tools are no longer lent before the user returns all the lent tools.

[0157] Specifically, maintenance personnel can log in to the management platform according to the management platform software or mobile APP software to view tool inventory information, make reservations for required tools, view tool cart information, and perform other operations.

[0158] The maintenance personnel can check in advance on the platform whether the required tools are borrowed. If the tools are not borrowed and the maintenance personnel have the authority to borrow the tools, they can make a reservation for the tools.

[0159] When a tool is reserved, the tool is locked based on the controller (for example: locking the universal wheels of the tool cart so that it cannot be pushed out; locking the combination lock of the tool box so that it cannot be opened; locking the cabinet door of the storage tool box so that the tool box cannot be taken out, etc.), and the tool is determined on the platform that it cannot be borrowed until the maintenance personnel who borrowed the tool returns all borrowed tools.

[0160] This embodiment adds a tool reservation function. Maintenance personnel can predict whether there are the tools they need in the car without turning on the smart car, and can reserve the tool car they need, which improves the convenience of user operation and the intelligence of smart tool missing detection, further reduces the burden of smart tool missing detection personnel, and reduces the labor cost of tool management. On the other hand, it can improve work efficiency and safety, and ensure the safety of large-scale transportation vehicles such as aircraft. The following is an example of the specific workflow of smart tool missing detection to illustrate the embodiment of the present invention:

[0161] Figure 3 A schematic diagram of the external structure of a tool vehicle provided by an embodiment of the present invention, Figure 4 The smart tool missing detection flow chart provided by the embodiment of the present invention is as follows: Figure 3 and Figure 4 shown.

[0162] The tool cart includes a rectangular cabinet 11, four universal wheels 16 arranged at the bottom of the cabinet, and a plurality of drawers 12 arranged on the cabinet. An RFID antenna is arranged at the bottom of the drawer. A trapezoidal protrusion is arranged on the top of the cabinet, an integrated touch display screen 15 is arranged on the trapezoidal slope, a small integrated camera 14 is arranged on the upper end of the display screen 15, an RFID reader 13 is arranged on the top of the trapezoidal slope, a voice player is installed behind the display screen 15, and handles are arranged on both sides of the cabinet to facilitate operators to move the tool cart.

[0163] The cabinet 11 is made of a solid steel shell with an anti-static powder coating on the surface, which is durable, fireproof and anti-theft. The drawer 12 is electronically controlled. When locked by the system, the lock on the top of the drawer pops out and presses against the cabinet, making it impossible to pull out. The universal wheel 16 is an electronically controlled universal wheel with two states: locked and unlocked. When locked by the system, the universal wheel is fixed and cannot rotate freely.

[0164] The display screen 15 is convenient for operators to view tool information in the trolley and perform confirmation operations. The camera is used to obtain image information of the tool. The RFID reader 13 is used to read the RFID tag information set on the tool received by the RFID antenna. The RFID reader 13 is also used to identify the employee card, read the employee information and the permission to take and put the tool. The voice player is used to play prompt sounds and alarm information.

[0165] Furthermore, each drawer is provided with a different tool mold tray, and a gravity sensor is provided at the bottom of each mold tray. The shape of the mold tray can be customized according to actual needs. The gravity sensor is used to sense whether the corresponding tool is placed in the mold tray according to the gravity. If the operator puts the wrong tool into the mold tray, there may be a weight mismatch or a height mismatch. When the weight does not match, the gravity sensor senses that the tool is placed incorrectly and issues a voice prompt; when the height of the tool exceeds the height of the mold tray, the drawer cannot be closed and a voice prompt is issued.

[0166] The use of gravity sensors combined with radio frequency identification technology and image recognition technology improves the accuracy of intelligent tool missing detection, and can accurately determine in which drawer the lost tool was stored in advance.

[0167] The operation process of maintenance personnel using the intelligent tool cart is as follows:

[0168] The first step is to reserve a tool cart. Maintenance personnel log in to the APP through their mobile phones and bind their employee card information. They view the tool cart information and tool information in the maintenance room through the APP, select the tool cart according to the tools required for the maintenance work, and make a reservation.

[0169] The second step is to borrow the tool cart. The maintenance personnel put the employee card in front of the RFID reader of the tool cart. The system reads the personnel information and tool tags, including the type and quantity of tools, and enters them into the background. After the information is entered, the RFID antenna in the drawer is activated to read the tags of each layer of items. When the number of tag information read reaches the specified value, the voice broadcast prompts that the item detection is over.

[0170] The display shows the number of tools that should be available, the actual number of tools, and the tool information is automatically uploaded to the backend, and a list is generated. At the same time, the system determines whether the tool cart has the borrowing authority. If so, the tool cart is unlocked, the universal wheels can move freely, the drawer can be opened, and the maintenance personnel push the unlocked tool cart to the work point. If you forget to bring your employee card, you can unlock the tool cart and borrow it by clicking the unlock button on the APP.

[0171] The third step is to return the tool cart. The maintenance personnel put the employee card in front of the RFID reader of the tool cart. The system reads the personnel information and tool tags (if there are tools without RFID tags, the maintenance personnel need to manually enter the image of the tool through the camera), and automatically compares it with the list generated upon entry. The display screen shows the number of tools that should be there, the actual number of tools, and what items are missing (specific information about the items). If there are missing items, it will be recorded as unqualified, and the system will alarm to generate a bad record. The staff will confirm the operation on the display screen.

[0172] If a tool is lost, it is necessary to retrieve the lost tool and put it back into the smart tool cart for inspection. After the inspection is completed, you can leave. (Until the tool is completely found, the system automatically deletes the bad record, otherwise it will remain.) When the maintenance personnel enter the maintenance room, the system only needs to record the number and type of tools when entering; and when leaving the hangar, not only the tool information of the hangar must be recorded, but also the two inspection information must be compared.

[0173] When a tool is lost, maintenance personnel use a handheld RFID handset to detect and locate the area, narrowing the search area and improving search efficiency.

[0174] The process for managers to conduct tool inventory is as follows:

[0175] The administrator uses the system to view the tool information in each tool cart and generate a list. The system compares the current list with the initial tool list. Missing tools are marked with a red background and correct tools are marked with a white background, allowing the administrator to intuitively grasp the tool inventory information.

[0176] It should be noted that the above specific example is only used as an example to illustrate the present invention. The type of tool storage device used and the specific application method can be adjusted according to actual conditions, and this embodiment does not limit this.

[0177] Figure 5 A schematic diagram of the structure of an intelligent tool missing detection system provided by an embodiment of the present invention is shown in FIG. Figure 5 As shown, the intelligent tool missing detection system includes:

[0178] A first acquisition module 510 is used to read the RFID tag of the first type of tool based on the RFID reader;

[0179] A second acquisition module 520 is used to acquire an image of a second type of tool based on a camera;

[0180] A data processing module 530, configured to obtain a current tool list based on a data processor according to the RFID tags of the first-category tools and the images of the second-category tools;

[0181] A data storage module 540, for comparing the current tool list with a previously stored initial tool list based on a data storage device to determine whether there are any missing tools;

[0182] Among them, the first category of tools are provided with RFID tags; the second category of tools are not provided with RFID tags; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is the RFID tag of the first category of tools or the image of the second category of tools.

[0183] Specifically, due to the different shapes (including round, square and irregular, etc.), sizes and materials (including metal, plastic and wood, etc.) of tools, some tools cannot be managed by adding RFID tags due to their small size or shape.

[0184] According to whether an RFID tag can be added, the tools are divided into the first category of tools and the second category of tools. The first category of tools is provided with an RFID tag, while the second category of tools is not provided with an RFID tag.

[0185] When performing the missing detection of the smart tool, the first acquisition module 510 is used to read the RFID tag of the first type of tool based on the RFID reader / writer for the first type of tag provided with the RFID tag.

[0186] The second acquisition module 520 is used to collect images (or record videos) of the second type of tools that are not equipped with RFID tags through a camera,

[0187] Furthermore, it is understood that, in addition to using image recognition technology to identify the tools of the second category label, a barcode or other mark can be attached to the second category tool to achieve the marking and identification of the second category tool. In specific applications, it can be selected according to the actual situation, or it can be further divided into more detailed categories and marked and identified using different methods.

[0188] The data processing module 530 is used to use the RFID tag of the first category tool or the image of the second category tool read by the first acquisition module 510 and the second acquisition module 520 as the tool identification of the corresponding tool. Based on the data processor, the mapping and binding of the tool and the tool mark are realized according to the RFID tag of the first category tool and the image of the second category tool, and the one-to-one correspondence between the tool and the tool mark is realized according to the mapping relationship, and the mapping relationship is recorded to obtain the current tool list.

[0189] In order to facilitate the inventory and management of tools, when storing tools in advance, the corresponding label information of the tools will be stored according to the corresponding methods for different types of tools, and an initial tool list will be generated based on the stored tools.

[0190] Current tools generally refer to all tools returned by maintenance personnel after using them for maintenance. Or, when management personnel need to check and count the tools, all tools stored in the current tool library.

[0191] The data storage module 540 is used to compare the current tool list obtained in step S3 with the initial tool list stored in advance based on the data storage device to determine whether there are any missing tools (for example, for the tool box, the initial tool list contains 25 tools, but after reading and identifying, the current tool list obtained contains only 23 tools, that is, it is determined that two tools are missing).

[0192] Furthermore, a prompt message is issued based on the comparison result to remind the staff (maintenance personnel or management personnel, etc.) that there are missing tools. Based on the data storage device, the current tool list is compared with the initial tool list stored in advance to determine whether there are any missing tools. The intelligent tool missing detection system provided by the embodiment of the present invention uses radio frequency identification technology and image recognition technology to classify tools according to their characteristics. For different categories, corresponding signs and identification methods are adopted to achieve "one tool, one sign", improve the accuracy of tool inventory, adopt scientific and information-based safety management methods, improve the accuracy of tool inventory, and intelligently identify whether there are any omissions when the operator returns the tools and remind them to avoid safety problems caused by missing tools.

[0193] It should be noted that the intelligent tool missing detection system provided in the embodiment of the present invention is used to execute the above-mentioned intelligent tool missing detection method, and its specific implementation method is consistent with the method implementation method, which will not be repeated here.

[0194] Figure 6 A schematic diagram of the physical structure of an electronic device provided by an embodiment of the present invention, such as Figure 6 As shown, the electronic device may include: a processor 610, a communication interface 620, a memory 630 and a communication bus 640, wherein the processor 610, the communication interface 620 and the memory 630 communicate with each other through the communication bus 640. The processor 610 may call the logic instructions in the memory 630 to execute the above-mentioned intelligent tool missing detection method, including: based on the RFID reader, reading the RFID tag of the first type of tool; based on the camera, obtaining the image of the second type of tool; based on the data processor, according to the RFID tag of the first type of tool and the image of the second type of tool, obtaining the current tool list; based on the data memory, comparing the current tool list with the initial tool list stored in advance to determine whether there is a missing tool; wherein the first type of tool is provided with an RFID tag; the second type of tool is not provided with an RFID tag; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is the RFID tag of the first type of tool or the image of the second type of tool.

[0195] In addition, the logic instructions in the above-mentioned memory 630 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0196] On the other hand, an embodiment of the present invention further provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the intelligent tool missing detection method provided by the above-mentioned method embodiments, the method including: based on an RFID reader, reading the RFID tag of a first category of tools; based on a camera, acquiring an image of a second category of tools; based on a data processor, obtaining a current tool list according to the RFID tag of the first category of tools and the image of the second category of tools; based on a data storage device, comparing the current tool list with an initial tool list stored in advance to determine whether there are missing tools; wherein, the first category of tools are provided with RFID tags; the second category of tools are not provided with RFID tags; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is the RFID tag of the first category of tools or the image of the second category of tools.

[0197] On the other hand, an embodiment of the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the intelligent tool missing detection method provided in the above-mentioned embodiments, the method comprising: based on an RFID reader, reading the RFID tag of a first category of tools; based on a camera, acquiring an image of a second category of tools; based on a data processor, obtaining a current tool list according to the RFID tag of the first category of tools and the image of the second category of tools; based on a data storage device, comparing the current tool list with an initial tool list stored in advance to determine whether there are any missing tools; wherein, the first category of tools are provided with RFID tags; the second category of tools are not provided with RFID tags; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is the RFID tag of the first category of tools or the image of the second category of tools.

[0198] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0199] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0200] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for detecting missing intelligent tools, characterized in that: include: Based on the RFID reader / writer, the RFID tag of the first type of tool is read; Based on the camera, an image of the second type of tool is obtained; Based on the data processor, obtaining a current tool list according to the RFID tags of the first-category tools and the images of the second-category tools; Based on the data storage device, the current tool list is compared with the previously stored initial tool list to determine whether there are any missing tools; The first type of tools are provided with RFID tags; the second type of tools are not provided with RFID tags; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is an RFID tag of the first type of tools or an image of the second type of tools; the first type of tools and the second type of tools are distinguished according to whether RFID tags can be added; The data processor obtains a current tool list according to the RFID tags of the first-category tools and the images of the second-category tools, specifically including: Based on the mapping relationship between the RFID tags of the first category of tools and the tools, a first tool list is obtained; Based on the mapping relationship between the images of the second type of tools and the tools, a second tool list is obtained; Obtaining the current tool list according to the first tool list and the second tool list; Before the step of comparing the current tool list with the previously stored initial tool list based on the data storage device to determine whether there are any missing tools, the method further includes: generating the initial tool list; The generating of the initial tool list specifically includes: obtaining storage location information and attribute information of all initial tools; classifying all initial tools into first-category tools and second-category tools according to preset classification rules; reading RFID tags of the first-category initial tools based on an RFID reader; obtaining images of the second-category initial tools based on a camera and then performing feature extraction to obtain features of the second-category initial tools; mapping and binding the RFID tags of the first-category initial tools with the storage location information and the attribute information based on a data processor to generate a first initial tool list; mapping and binding the images of the second-category initial tools with the storage location information and the attribute information to generate a second initial tool list; obtaining the initial tool list based on the first initial tool list and the second initial tool list; wherein the storage location information includes the warehouse, tool cabinet and drawer position of the tool storage cabinet, and the attribute information includes the tool name, tool purpose, tool specification, manufacturer, production time, annual inspection validity period, annual inspection certificate and consumables identification, wherein the consumables identification indicates whether the tool is a consumable; Before the steps of reading the RFID tag of the first type of tool based on the RFID reader and writer and acquiring the image of the second type of tool based on the camera, the method further includes: acquiring the identity information of the user based on the identity recognition device and determining whether the user has the lending authority; if it is determined that the user has the lending authority, allowing the user to lend the tool; and storing the initial tool list corresponding to the user's lending tool; After the step of allowing the user to lend tools if it is determined that the user has the lending authority, the method further includes: based on a controller, locking the tools that the user is allowed to lend, and not lending the corresponding tools again before the user returns all the lent tools; The locking of the tools allowed to be borrowed by the user includes: locking the universal wheels of the tool cart, locking the combination lock of the tool box, and locking the cabinet door of the storage tool box.

2. The method for detecting missing smart tools according to claim 1, characterized in that: Also included: updating said initial tool list; The updating of the initial tool list specifically includes: Release the mapping binding relationship of the tools that need to be replaced in the original initial tool list; Get the storage location and property information of the newly added tool; Mapping and binding the electronic tag information of each newly added tool with the storage location information and attribute information to establish a mapping and binding relationship of the newly added tools; The electronic tag information includes: the RFID tag of the first type of tool and the image information of the second type of tool.

3. The method for detecting missing smart tools according to claim 1, characterized in that: After the step of comparing the current tool list with the initial tool list stored in advance based on the data storage to determine whether there are any missing tools, the method further includes: If it is determined that there are missing tools, a reminder message will be sent and the user who borrowed the tool will be marked as having a bad record until the missing tool is found.

4. An intelligent tool missing detection system, characterized in that: The method for detecting missing smart tools according to claim 1 comprises: A first acquisition module, used for reading the RFID tag of the first category of tools based on the RFID reader; A second acquisition module is used to acquire an image of the second type of tool based on a camera; A data processing module, configured to obtain a current tool list based on a data processor according to the RFID tags of the first-category tools and the images of the second-category tools; A data storage module, configured to compare the current tool list with a previously stored initial tool list based on a data storage device to determine whether there are any missing tools; The first type of tools are provided with RFID tags; the second type of tools are not provided with RFID tags; the tool list includes a mapping relationship between tools and tool identifiers; the tool identifier is an RFID tag of the first type of tools or an image of the second type of tools; the first type of tools and the second type of tools are distinguished according to whether RFID tags can be added; The data processor obtains a current tool list according to the RFID tags of the first-category tools and the images of the second-category tools, specifically including: Based on the mapping relationship between the RFID tags of the first category of tools and the tools, a first tool list is obtained; Based on the mapping relationship between the image of the second type of tool and the tool, a second tool list is obtained; The current tool list is obtained according to the first tool list and the second tool list.

5. An electronic device, characterized in that: It includes a memory and a processor, and the processor and the memory communicate with each other through a bus; the memory stores program instructions that can be executed by the processor, and the processor calls the program instructions to execute the intelligent tool missing detection method as described in any one of claims 1 to 3.

6. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the intelligent tool missing detection method as described in any one of claims 1 to 3 is implemented.

Images