Tool management method and system, electronic equipment and computer program product

Abstract

The invention discloses a tool management method and system, electronic equipment and a computer program product, and relates to the field of intellectualization, and the method comprises the steps: responding to a tool selection operation of a user after the user logs in a tool management system, and determining a target tool selected by the user at this time and the model of the target tool; a box door of the tool box is popped open; in response to a box door closing signal sent by an inductive switch on a box door, collecting a current placement image of a tool in the tool box; identifying the current placement image, and determining the model of a change tool of which the toolbox is changed; comparing the model of the target tool with the model of the change tool, and if the model of the target tool is consistent with the model of the change tool, recording the model of the change tool, the change information of the change tool and the information of the user; and if the model of the target tool is inconsistent with the model of the change tool, alarm information is sent to prompt a user that the tool operation is wrong. Whether the tool change is wrong or not is determined through image recognition, and the situation that the tool access record in the tool box is not real is reduced.

Description

Technical Field

[0001] This application relates to the field of intelligent technology, and in particular to a tool management method, system, electronic device and computer program product. Background Technology

[0002] Tools are an indispensable material and technological foundation in the production process of an enterprise. Like machinery and equipment, they are a component of the enterprise's productivity. Tools come in a variety of categories, including various cutting tools, measuring tools, jigs, molds, grinding tools, assembly tools, and auxiliary tools.

[0003] Currently, most companies rely on dedicated personnel to manage tools, including registration, storage, and distribution. However, manual management can lead to inaccurate tool entry and exit records due to negligence or misoperation by management personnel, and tools in the toolbox are prone to being lost. Summary of the Invention

[0004] In view of the above problems, this application provides a tool management method, system, electronic device, and computer program product to reduce the occurrence of lost tools in toolboxes. The specific solution is as follows:

[0005] The first aspect of this application provides a tool management method, applied to a tool management system, the tool management method comprising:

[0006] After a user logs into the tool management system, in response to the user's tool selection operation, the system determines the target tool selected by the user and the model of the target tool.

[0007] The toolbox door is opened, allowing the user to operate the tools inside the toolbox;

[0008] In response to a door closing signal emitted by a sensor switch located on the door, an image of the current placement of tools in the toolbox is acquired;

[0009] Identify the currently placed image and determine the model of the modified tool in the toolbox that has been changed;

[0010] The model of the target tool is compared with the model of the modified tool. If the model of the target tool is the same as the model of the modified tool, the model of the modified tool, the modification information of the modified tool, and the user's information are recorded. If the model of the target tool is different from the model of the modified tool, an alarm message is issued to prompt the user that the tool operation is incorrect.

[0011] In one possible implementation, the toolbox has a placement template with multiple tool placement slots, the shapes of which correspond to tool models; the step of identifying the current placement image and determining the model of the modified tool in the toolbox includes:

[0012] Read and compare the image data of the currently placed image with the image data of the historically placed images to determine whether a tool change has occurred in the toolbox;

[0013] If there is a target image region where the image data of the currently placed image and the image data of the historically placed image differ, then it is determined that a tool change has occurred in the toolbox;

[0014] Identify the target image region and determine the model of the modified tool in the toolbox that has been changed. The target image region includes the image region where the modified tool is located in the placement slot of the toolbox.

[0015] In one possible implementation, the historical placement image is: an image of the tool placement in the toolbox taken after the previous tool change;

[0016] or

[0017] The historical placement image is the initial placement image of the tools in the toolbox.

[0018] One possible implementation also includes:

[0019] In response to the user's tool selection operation, after determining the target tool and its model selected by the user, the location of the target tool in the toolbox is displayed to the user.

[0020] One possible implementation also includes:

[0021] When the tool management system issues an alarm, the toolbox door pops open.

[0022] In one possible implementation, the tool management system has multiple process modes, each process mode corresponding to a process and at least one tool required for the process, and the tool management method further includes:

[0023] In response to the user's target process selection operation, determine the target location of the tool required for the target process in the toolbox, and display the target location to the user;

[0024] The toolbox door is opened to allow the user to retrieve the tools required for the target process;

[0025] In response to a door closing signal emitted by a sensor switch located on the door, a target placement image of the tools in the toolbox is acquired, and the image area where the target position is located in the target placement image is identified, so as to determine whether the user has taken the tool required for the target process.

[0026] A second aspect of this application provides a tool management system, the tool management system comprising:

[0027] The selection unit is used to determine the target tool selected by the user and the model of the target tool in response to the user's tool selection operation after the user logs into the tool management system.

[0028] A control unit is used to open the toolbox door, allowing the user to operate the tools inside the toolbox;

[0029] The acquisition unit is used to acquire an image of the current placement of tools in the toolbox in response to a door closing signal emitted by a sensor switch installed on the door.

[0030] The identification unit is used to identify the currently placed image and determine the model of the modified tool in the toolbox that has been changed;

[0031] The comparison unit is used to compare whether the model of the target tool is consistent with the model of the modified tool. If the model of the target tool is consistent with the model of the modified tool, the recording unit is executed; if the model of the target tool is inconsistent with the model of the modified tool, the prompting unit is executed.

[0032] The recording unit is used to record the model of the modification tool, the modification information of the modification tool, and the user's information;

[0033] The notification unit is used to issue an alarm message to notify the user that the tool operation was incorrect.

[0034] In one possible implementation, the toolbox has a placement template with multiple tool placement slots, the shapes of which correspond to the tool models. The identification unit is specifically configured as follows:

[0035] The image data of the currently placed image and the image data of the historically placed image are read and compared to determine whether a tool change has occurred in the toolbox. If there is a target image area where the image data of the currently placed image and the image data of the historically placed image are different, then it is determined that a tool change has occurred in the toolbox. The target image area is identified, and the model of the changed tool in the toolbox is determined. The target image area includes the image area where the changed tool is located in the placement slot of the toolbox.

[0036] A third aspect of this application provides an electronic device, comprising at least one processor and a memory connected to the processor, wherein:

[0037] The memory is used to store computer programs;

[0038] The processor is used to execute the computer program so that the electronic device can implement the tool management method of the first aspect or any implementation thereof.

[0039] A fourth aspect of this application provides a computer program product including computer-readable instructions that, when executed on an electronic device, cause the electronic device to implement the tool management method described in the first aspect or any implementation thereof.

[0040] Based on the above technical solution, this application provides a tool management method, system, electronic device, and computer program product. The method is applied to a tool management system. After a user logs in, the tool management system determines the target tool selected by the user through tool selection operations and obtains the model number of the target tool. After determining the user's target tool, the tool management system opens the toolbox door, allowing the user to change the tool. When the user closes the door, a sensor switch on the door is triggered to send a door-closing signal. Upon receiving the door-closing signal, the tool management system acquires an image of the current placement of tools in the toolbox and determines the model number of the changed tool by recognizing the current placement image. It then compares the model number of the target tool with the model number of the changed tool to determine if the user has changed the desired target tool. If the model number of the target tool matches the model number of the changed tool, the model number of the changed tool, the change information of the changed tool, and the user's information are recorded. If the model number of the target tool does not match the model number of the changed tool, an alarm message is issued, prompting the user that the wrong tool was selected. This method uses image recognition to determine the model of the tool being changed by the user and compares it with the model of the target tool the user expects to change to. This determines whether the user has made an error in changing the tool, which can reduce the problem of inaccurate tool entry and exit records caused by negligence or misoperation of management personnel and avoid the loss of tools in the toolbox. Attached Figure Description

[0041] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0042] Figure 1 This is a schematic diagram of the appearance of an operator machine provided in an embodiment of this application;

[0043] Figure 2 This is a schematic diagram of the appearance of a display device provided in an embodiment of this application;

[0044] Figure 3 A flowchart illustrating a tool management method provided in an embodiment of this application;

[0045] Figure 4 This is a schematic diagram of the appearance of a toolbox provided in an embodiment of this application;

[0046] Figure 5 A schematic diagram of the structure of a toolbox provided in an embodiment of this application;

[0047] Figure 6 A schematic diagram of a display image provided in an embodiment of this application;

[0048] Figure 7 A schematic diagram of the structure of a tool management system provided in an embodiment of this application;

[0049] Figure 8 This is a hardware structure block diagram of an electronic device provided in an embodiment of this application.

[0050] Figure label:

[0051] 1-Manipulator; 2-Display; 3-Industrial computer; 4-Camera; 5-Light source controller; 6-Light source. Detailed Implementation

[0052] The embodiments of this application are described below with reference to the accompanying drawings. The terminology used in the implementation section of this application is for explaining specific embodiments only and is not intended to limit the scope of this application.

[0053] The embodiments of this application will now be described with reference to the accompanying drawings. Those skilled in the art will recognize that, with technological advancements and the emergence of new scenarios, the technical solutions provided in the embodiments of this application are equally applicable to similar technical problems.

[0054] The terms "first," "second," etc., used in the specification and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate; this is merely a way of distinguishing objects with the same attributes in the embodiments of this application. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, so that a process, method, system, product, or apparatus that comprises a series of units is not necessarily limited to those units, but may include other units not explicitly listed or inherent to those processes, methods, products, or apparatuses.

[0055] Tools are an indispensable material and technological foundation in the production process of an enterprise. Like machinery and equipment, they are a component of the enterprise's productivity. Tools come in a variety of categories, including various cutting tools, measuring tools, jigs, molds, grinding tools, assembly tools, and auxiliary tools.

[0056] Regarding tool storage, some methods involve haphazardly storing all tools together. However, due to the wide variety of tool types and sizes, finding the right tool from a large multitude is time-consuming and labor-intensive. This includes tools required for loading NAC-STC type spent fuel transport containers. Alternatively, dedicated personnel are assigned to manage tool registration, storage, distribution, and usage. This method is labor-intensive, inefficient, and lacks digitalization. It is also prone to misuse or inaccurate inventory records due to human error or negligence, potentially leading to lost tools at the work site and serious safety hazards.

[0057] To manage tool information more accurately and conveniently, maximize the use of existing tools, and reduce the manual burden of warehouse management, this application provides a tool management method. Users can select the target tools they need on the tool management system without having to search for tools among many. Furthermore, before and after the user operates on the tools, image recognition is used to determine whether the tools in the toolbox have been changed correctly, reducing the improper use of tools or inaccurate inventory due to human negligence or misoperation, and achieving standardization of tool management.

[0058] This application provides a tool management method that is applied to a tool management system.

[0059] The tool management system can consist of a manipulator, a display, and an industrial control computer. The manipulator and display can be located on the outside of the toolbox, while the industrial control computer can be located on the inside of the toolbox.

[0060] like Figure 1 The schematic diagram of the operator unit shown indicates that the operator unit can be an industrial-grade tablet computer equipped with an operating system, an interactive display screen, a camera, and a card reader. It can support wireless connections (such as Wi-Fi) and wired connections (such as Ethernet connections), and transmit data with the industrial control computer through the Ethernet port.

[0061] like Figure 2 The schematic diagram of the display unit shown illustrates that it also features an interactive display screen, as well as serial ports, USB interfaces, etc. Data transmission between the display and the industrial control computer is primarily achieved via a VGA cable.

[0062] The industrial PC can interact with both the operator computer and the display. An industrial PC can be an industrial-grade computer host equipped with an operating system and vision processing software. Specific parameters of this industrial-grade computer host may include: 16GB of RAM, a 512GB solid-state drive, four USB 3.0 ports, and a gigabit Ethernet port. Of course, the parameters of the industrial PC can be selected according to actual needs.

[0063] The vision processing software is a program that uses machine vision for image processing. Because the tools in this embodiment are diverse in shape and specification, a single detection parameter is insufficient to distinguish specific tool models. Therefore, this embodiment uses vision processing software to collect multiple parameters for fusion and judgment. Machine vision enables vision processing software to mimic the functions of the human eye and brain, recognizing, analyzing, and understanding images. The vision processing software converts the target into an image signal through image acquisition and sends it to the image processing section for digital conversion. This involves processing information such as pixel distribution, brightness, and color. Various algorithms are used to calculate the digitized signal, extracting the target's features, such as size, shape, and color, and outputting the calculation results, such as whether the target is qualified or its model.

[0064] The following is a detailed description of a tool management method according to an embodiment of this application, with reference to the accompanying drawings. Figure 3 , Figure 3 A flowchart illustrating a tool management method provided in an embodiment of this application is shown below. Figure 3 As shown, the tool management method may include steps S10 to S16, which are described in detail below.

[0065] S10. After the user logs into the tool management system, in response to the user's tool selection operation, determine the target tool and the model of the target tool selected by the user this time;

[0066] S11. Open the toolbox door to allow the user to operate the tools inside the toolbox;

[0067] S12. In response to a door closing signal emitted by a sensor switch located on the door, acquire an image of the current placement of tools in the toolbox.

[0068] In this embodiment, users must log in to the tool management system before they can operate the tools in the toolbox. This embodiment also includes a tool change notification to the user, facilitating tracing in case of tool loss. Users can interact with the control unit to log in to the tool management system. Specifically, since the control unit has an interactive display screen, camera, and card reader, users can log in to the tool management system using any of the following methods: account password, card swipe, or facial recognition. Of course, users must register on the tool management system before logging in; user registration can also be done using an account password, card swipe, or facial recognition.

[0069] The target tool is the tool that the user needs to borrow or return. The tool's model number refers to its specific specifications. In this embodiment, the tool's model number can be determined based on its size, shape, and color. Tool size is a crucial characteristic and can be used to distinguish most tool models. Tool size can be the overall dimensions of the tool, such as length and width, or it can be a partial dimension, such as the head or tail of a socket or the opening of a wrench. Tool shape is another characteristic. Since different tool models exhibit different outlines (overall or partial outlines), the tool's shape can also be used to identify the tool model. Tool color is also another characteristic. In this embodiment, the user-oriented HSV color model can be used to identify tools with color differences, assisting in determining the tool's model number. In the HSV color model, H represents the hue of the color, that is, the type of color, such as red, green, and blue. In this HSV color model, hue is represented by an angle from 0 to 360 degrees. 0 degrees and 360 degrees both represent red, followed by yellow (60 degrees), green (120 degrees), cyan (180 degrees), blue (240 degrees), and magenta (300 degrees). S represents color saturation (the purity or vividness of a color), ranging from 0% to 100%, where 0% represents gray (no color) and 100% represents a fully saturated color. V represents color lightness or brightness (the lightness or darkness of a color), also ranging from 0% to 100%, where 0% represents black and 100% represents the brightest state of the color.

[0070] Users can borrow and return tools directly from the operator console. Specifically, when a user needs to borrow or return a tool, they must first log in to the tool management system, and then select the tool to be borrowed or returned on the interactive display screen of the operator console. The operator console then receives the user's tool selection from the display screen. In response to the user's tool selection, the operator console can determine the target tool and its model.

[0071] After the user selects a target tool, the operator can control the switch on the toolbox door to open the door, allowing the user to operate the tool (take the target tool out of the toolbox or place the target tool in the toolbox). Alternatively, after determining the user's selected target tool and its model, the location of the target tool in the toolbox can be displayed on a screen, making it easy for the user to retrieve it. The toolbox can have a single, unified tool storage space where all tools can be placed, or the unified tool storage space can be divided into multiple drawers, each containing a separate tool. When the toolbox has a single, unified tool storage space, this embodiment uses a sensor switch to control the opening and closing of the toolbox door lock; when the toolbox has multiple drawers, this embodiment uses a lock control panel to control the opening and closing of each drawer.

[0072] After the user operates on a tool in the toolbox and closes the toolbox door, a sensor switch on the toolbox door is triggered. The sensor switch sends a door-closed signal to the tool management system, which then captures an image of the current placement of the tools in the toolbox. This current placement image is the image of the toolbox after the user closes the door, and it can contain multiple tools, each with a corresponding image area.

[0073] Specifically, in this embodiment, an image acquisition device (such as a high-resolution camera) can be set in the toolbox, and the industrial control computer can control the image acquisition device to acquire the currently placed image. To acquire a clearer image, this embodiment can also additionally set a light source (such as an LED) in the toolbox, allowing the image acquisition device to acquire clear and rich image data of the currently placed image under sufficient light conditions, thereby improving the accuracy of the visual recognition system. Of course, the tool management system can also adjust the parameters of the image acquisition device. When a light source is set in the toolbox, the industrial control computer can control the light source to turn on and off through a light source controller. Alternatively, this embodiment can also be equipped with an image acquisition device that can acquire image data even in dim environments, thus eliminating the need for an additional light source and light source controller.

[0074] S13. Identify the currently placed image and determine the model of the modification tool that has been changed in the toolbox;

[0075] S14. Compare whether the model of the target tool is consistent with the model of the changed tool; if the model of the target tool is consistent with the model of the changed tool, proceed to step S15; if the model of the target tool is inconsistent with the model of the changed tool, proceed to step S16.

[0076] S15. Record the model of the change tool, the change information of the change tool, and the user's information;

[0077] S16. Issue an alarm message to notify the user that the tool operation was incorrect.

[0078] In this embodiment, the current placement image can be processed using vision processing software in an industrial control computer. A changed tool refers to a tool in the toolbox that has changed after the user has operated on it. Since the toolbox has a placement template with multiple tool placement slots, and the characteristics of these slots correspond to the tool models, the current placement image can include the tool and the area of ​​the tool placement slot (where the tool has been removed). This embodiment can identify the changed tool and its model by recognizing the current placement image. The specific process can be shown in steps one through three below:

[0079] Step 1: Read and compare the image data of the currently placed image with the image data of historically placed images to determine if any tools in the toolbox have changed;

[0080] Step 2: If there are target image regions where the image data of the currently placed image and the image data of the historically placed images differ, then it is determined that a tool change has occurred in the toolbox;

[0081] Step 3: Identify the target image area and determine the model of the modification tool that has been changed in the toolbox. The target image area includes the image area where the modification tool is located in the toolbox's placement slot.

[0082] The historical placement image refers to an image of the toolbox taken at the moment preceding the current placement image. Specifically, in this embodiment, the historical placement image can be: an image of the tools in the toolbox after the previous tool change (i.e., the placement image taken before the current placement image), or an initial placement image of the tools in the toolbox. The initial placement image is the raw data of tool placement stored in the tool management system. In this embodiment, multiple photographs of the tools in different storage slots in the toolbox are taken using an image acquisition device to establish this raw data. This raw data may include data such as the tool's location, storage posture, and the number of pixels occupied by the tool's shape.

[0083] This embodiment first compares the image data of the currently placed image with the image data of the historically placed images to determine whether the tools in the toolbox have changed. If the user selects the target tool but the image data of the currently placed image is the same as the image data of the historically placed image, it means that the user has not operated on the tools in the toolbox and the tools in the toolbox have not changed. In this embodiment, an alarm message can be issued to prompt the user to perform the operation again.

[0084] When the image data of the currently placed image differs from the image data of historically placed images, a target image region can be determined within the currently placed image. The target image region is the area where the image data of the current placement image differs from that of historically placed images. Since the image region containing the changed tool in the toolbox includes the image of the tool's placement slot, but not the tool itself, and the image data of the tool's placement slot differs from the image data of the tool, the target image region can include the image region where the changed tool is located in its toolbox placement slot. By identifying the image data of the tool's placement slot, the changed tool and its model can be determined.

[0085] Furthermore, after a user lends or returns a tool, the tool management system can select the location of the changed tool on the display screen. Specifically, when a user takes a tool, the system can select the location where the taken tool should be placed on the display screen; when a user places a tool, the system can select the location where the returned tool should be placed on the display screen.

[0086] Each time a user takes or returns a tool, the image acquisition device is triggered to capture an image of the currently placed tool each time the toolbox door is closed. The tool management system can compare the image data of the currently placed tool with the original data or the image data obtained from the last capture to determine the image area where the changed tool is located (the image area where the image data is different), identify the image area where the changed tool is located, and determine the model of the changed tool.

[0087] Once this embodiment determines the model of the modified tool in the toolbox, it compares the model of the target tool with that of the modified tool to determine if the user has taken the correct tool or placed it back in the correct slot. If the target tool's model matches the modified tool's model, the user's operation is considered correct, and the modified tool's model, modification information, and user information are recorded for real-time monitoring and tracking of tool usage. If the target tool's model does not match the modified tool's model, the user's operation is considered incorrect (wrong tool taken or incorrectly placed). An alarm is issued to the user, and the area with the incorrect image data is highlighted on the display screen, indicating the error. The toolbox door is then opened, allowing the user to operate the tools again. Each user's borrowing or returning of a tool generates an operation record, which can be viewed on the record page, showing the user's actions, time, and the tool used.

[0088] Furthermore, since this embodiment can obtain the fixed position of the tools placed in the toolbox in the image when creating the original data, that is, a fixed image area in the captured image can represent a fixed tool, when the user selects the target tool, this embodiment can directly identify the fixed image area of ​​the target tool in the currently placed image. By using the image data in this fixed image area, it can determine whether the target tool has changed, thereby determining whether the user should take or return the target tool. For example, (x, y, w, h) = 50, 25, 100, 100 is the position of a tool in the image. This means that in the captured image, the image area with the top left pixel coordinates (x, y) = (50, 25), a length of 100 pixels, and a width of 100 pixels is the fixed image area of ​​the tool in the captured image. Then, when the user needs to take or return the tool, this embodiment can capture the currently placed image and directly identify the image data (x, y, w, h) = 50, 25, 100, 100 in the currently placed image to determine whether the tool has changed.

[0089] This application provides a tool management method applied to a tool management system. After a user logs in, the system determines the target tool selected by the user through tool selection operations and obtains the target tool's model number. After determining the target tool, the system opens the toolbox door, allowing the user to change the tool. When the user closes the door, a sensor switch on the door is triggered, sending a door-closing signal. Upon receiving the signal, the system captures an image of the tools' current placement in the toolbox and identifies the model of the changed tool by recognizing the image. It then compares the target tool's model with the changed tool's model to determine if the user has changed the desired tool. If the target tool's model matches the changed tool's model, the system records the changed tool's model, the change information, and the user's information. If the target tool's model does not match the changed tool's model, an alarm is issued, alerting the user that the wrong tool was selected. This method uses image recognition to determine the model of the tool being changed by the user and compares it with the model of the target tool the user expects to change to. This determines whether the user has made an error in changing the tool, which can reduce the problem of inaccurate tool entry and exit records caused by negligence or misoperation of management personnel and avoid the loss of tools in the toolbox.

[0090] In one possible implementation, the tool management system can be configured with multiple process modes, each process mode corresponding to a process and at least one tool required for the process. The tool management method may also include steps four through six:

[0091] Step 4: In response to the user's selection of the target process, determine the target location of the tool required for the target process in the toolbox and display the target location to the user;

[0092] Step 5: Open the toolbox door to allow the user to retrieve the tools needed for the target process;

[0093] Step Six: In response to the door closing signal emitted by the sensor switch set on the door, acquire the target placement image of the tools in the toolbox, and identify the image area where the target position is located in the target placement image to determine whether the user has taken the tool required for the target process.

[0094] The tool management system can pre-set multiple process modes and the required tool models and quantities for each tool in the system backend. Users can access the process selection function on the operator console, choose the desired process mode, and then the tool management system displays the required tools on the screen. After user confirmation, the toolbox door opens. The user takes the tool and closes the door, triggering a sensor switch to capture a placement image. The tool management system identifies the fixed image area corresponding to the tool in the placement image to determine if the user has taken the correct tool.

[0095] Therefore, a specific embodiment is provided to illustrate the above implementation process. In this embodiment, as... Figure 4 The diagram showing the appearance of the toolbox and Figure 5 The diagram shows the structure of the toolbox. Outside the toolbox are a manipulator 1 and a display 2. Inside the toolbox are an industrial control computer 3, a camera 4, a light source controller 5, and a light source 6. The industrial control computer 3 is loaded with vision processing software. Of course, the manipulator 1, display 2, and industrial control computer 3 can be integrated into a single main controller.

[0096] After the operator 1, display 2, and industrial computer 3 are powered on, the main interface of the vision processing software in industrial computer 3 is displayed through display 2. The vision processing software in industrial computer 3 runs automatically and connects to the light source controller 5 and camera 4.

[0097] After logging in on the operator computer 1, the user enters the function interface for borrowing or returning tools. On the interface, the user browses and selects the tools needed and adds them to the shopping cart. After clicking "confirm" on the shopping cart page, the operator computer 1 responds to the user's operation command to take or return the tool. The operator computer 1 determines the target tool and its model, and sends the target tool, its model, and the operation command to the industrial control computer 3.

[0098] After receiving the target tool, its model, and operation command from the operator 1, the vision processing software in the industrial control computer 3 marks the target tool and displays it to the user through the display image on the display unit 2. After the user clicks "confirm" on the operator 1, the operator 1 sends a confirmation signal to the industrial control computer 3. The operator 1 then controls the sensor switch to open the toolbox door. The industrial control computer 3 sends a command to turn on the light source to the light source controller 5. The light source controller 5 turns on the light source 6, allowing the user to borrow or return the tool.

[0099] After a user borrows or returns a tool, they close the toolbox door, triggering a sensor switch. The sensor switch sends a door-closed signal to operator 1, which then sends a command to industrial control computer 3.

[0100] Industrial PC 3 controls camera 4 to take pictures of the toolbox's interior in a well-lit environment, obtaining a complete image of the toolbox's internal layout. This image is then sent back to the vision processing software, which subsequently sends a command to light source controller 5 to turn off the light source 6. The vision processing software performs algorithmic processing on the image data to determine the model of the tool that has been changed inside the toolbox. This model is then sent to operator PC 1. Operator PC 1 compares the model of the changed tool with the model of the target tool. If they match, the changed tool, its model, and user information are recorded in the database. If they do not match, an alarm is issued on operator PC 1 to prompt the user to resume normal operation, and a signal is sent to industrial PC 3. Operator PC 1 then reopens the toolbox door, and industrial PC 3 sends another command to light source controller 5 to turn on the light source 6. Each user's borrowing or returning of a tool generates an operation record, which can be viewed on the record page, showing the user's actions, time, and the tool used.

[0101] The main interface of the vision processing software in the industrial control computer 3 can be displayed on the display unit 2, such as... Figure 6 The schematic diagram of the display image of display unit 2 shown can be divided into an image display window inside the box, a check log window, and a system status button area. The image display window inside the box can display images of tools inside the box taken by camera 4, and the empty slots of the tools can be marked in the window, for example, by using a red outline. The check log window can display detailed operation steps in real time, along with the operation time; the system status button area can include a camera 4 on / off status button, a start and run button, a TCP communication status button, a light source setting button, a template reset button, a view image inside the box button, and a button to turn off all light sources.

[0102] After the industrial control computer 3 is powered on, it needs to wait for the setup of the TCP communication server, the connection of the light source controller 5, and the connection of the camera 4 to be completed, and then output the inspection log in the displayed image. The corresponding button lights of each part can be changed accordingly; a green status light indicates normal operation, and a black status light indicates abnormal operation.

[0103] After the TCP communication server, light source controller 5, and camera 4 (which can be divided into camera 1-1, camera 1-2, camera 2-1, and camera 2-2) are successfully connected, the status lights for TCP communication, camera 1-1, camera 1-2, camera 2-1, camera 2-2, and light source settings will all be green. Furthermore, after the log displays "TCP: Server initialization successful," you can click the "Start and Run" button to open the image processing and command response threads of the industrial control computer 3. Once successfully opened, the log window will display "System started." Additionally, after powering on the industrial control computer 3, you should wait approximately 15 seconds. Any parts that fail to start during this time can be manually started afterward.

[0104] The above describes a tool management method provided by an embodiment of this application. The following will describe a system that implements the above tool management method.

[0105] Please see Figure 7 , Figure 7 This is a schematic diagram of a tool management system provided in an embodiment of this application. Figure 7 As shown, the tool manages the system, including:

[0106] Selection unit 100 is used to determine the target tool and its model selected by the user in response to the user's tool selection operation after the user logs into the tool management system.

[0107] Control unit 110 is used to open the toolbox door, allowing the user to operate the tools inside the toolbox;

[0108] The acquisition unit 120 is used to acquire an image of the current placement of tools in the toolbox in response to a door closing signal emitted by a sensor switch set on the door.

[0109] The identification unit 130 is used to identify the currently placed image and determine the model of the modification tool that has been changed in the toolbox;

[0110] The comparison unit 140 is used to compare whether the model of the target tool is consistent with the model of the changed tool. If the model of the target tool is consistent with the model of the changed tool, the recording unit 150 is executed. If the model of the target tool is inconsistent with the model of the changed tool, the prompting unit 160 is executed.

[0111] Recording unit 150 is used to record the model of the change tool, the change information of the change tool, and the user's information;

[0112] The prompting unit 160 is used to issue an alarm message to notify the user that the tool operation was incorrect.

[0113] In one possible implementation, the toolbox has a placement template with multiple tool placement slots, the shapes of which correspond to the tool models. The aforementioned identification unit 130 can be specifically configured as follows:

[0114] Read and compare the image data of the currently placed image with the image data of the historically placed images to determine whether a tool change has occurred in the toolbox. If there is a target image area where the image data of the currently placed image and the image data of the historically placed image are different, then it is determined that a tool change has occurred in the toolbox. Identify the target image area and determine the model of the changed tool in the toolbox. The target image area contains the image area where the changed tool is located in the placement slot of the toolbox.

[0115] In one possible implementation, in the aforementioned identification unit 130, the historical placement image is: the placement image of the tools in the toolbox acquired after the previous tool change;

[0116] or

[0117] The historical placement image is the initial placement image of the tools in the toolbox.

[0118] In one possible implementation, the tool management system may also include an interaction unit:

[0119] When responding to the user's tool selection action, after determining the target tool and its model selected by the user, the interaction unit is triggered;

[0120] The display unit is used to show the user the location of the target tool in the toolbox.

[0121] In one possible implementation, the control unit 110 described above can also be configured as follows:

[0122] When the tool management system issues an alarm, the toolbox door pops open.

[0123] In one possible implementation, the tool management system has multiple process modes, each process mode corresponding to a process and at least one tool required for the process. The tool management system can also be configured as follows:

[0124] In response to the user's selection of a target process, the system determines the target location of the tool required for that process in the toolbox, displays the target location to the user, and opens the toolbox door to allow the user to retrieve the tool required for the target process. In response to the door closing signal emitted by the sensor switch located on the door, the system acquires an image of the target placement of the tool in the toolbox and identifies the image area where the target location is located in the target placement image to determine whether the user has retrieved the tool required for the target process.

[0125] This application also provides an electronic device in its embodiments. (See reference...) Figure 8 The diagram illustrates a structural schematic suitable for implementing the electronic device in the embodiments of this application. The electronic device in the embodiments of this application may include, but is not limited to, fixed terminals such as mobile phones, laptops, PDAs (personal digital assistants), PADs (tablet computers), desktop computers, etc. Figure 8 The electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0126] like Figure 8 As shown, the electronic device may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. When the electronic device is powered on, the RAM 803 also stores various programs and data required for the operation of the electronic device. The processing unit 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0127] Typically, the following devices can be connected to I / O interface 805: input devices 806 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 807 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 808 including, for example, memory cards, hard drives, etc.; and communication devices 809. Communication device 809 allows electronic devices to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 8 Electronic devices with various devices are shown, but it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0128] This application also provides a computer program product including computer-readable instructions, which, when executed on an electronic device, cause the electronic device to implement any of the tool management methods provided in this application.

[0129] This application also provides a computer-readable storage medium that carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any of the tool management methods provided in this application.

[0130] It should also be noted that the system embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. In addition, in the system embodiment drawings provided in this application, the connection relationship between modules indicates that they have a communication connection, which can be implemented as one or more communication buses or signal lines.

[0131] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware, or it can be implemented by special-purpose hardware including application-specific integrated circuits, special-purpose CPUs, special-purpose memory, special-purpose components, etc. Generally, any function performed by a computer program can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be diverse, such as analog circuits, digital circuits, or special-purpose circuits. However, for this application, software program implementation is more often the preferred implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk, or optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, training equipment, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0132] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product.

[0133] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, training device, or data center to another website, computer, training device, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)).

[0134] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0135] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0136] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A tool management method, characterized in that, Applied to a tool management system, the tool management method includes: After a user logs into the tool management system, in response to the user's tool selection operation, the system determines the target tool selected by the user and the model of the target tool. The toolbox door is opened, allowing the user to operate the tools inside the toolbox; In response to a door closing signal emitted by a sensor switch located on the door, an image of the current placement of tools in the toolbox is acquired; Identify the currently placed image and determine the model of the modified tool in the toolbox that has been changed; The model of the target tool is compared with the model of the modified tool. If the model of the target tool is the same as the model of the modified tool, the model of the modified tool, the modification information of the modified tool, and the user's information are recorded. If the model of the target tool is different from the model of the modified tool, an alarm message is issued to prompt the user that the tool operation is incorrect.

2. The tool management method according to claim 1, characterized in that, The toolbox contains a placement template with multiple tool placement slots, the shapes of which correspond to the tool models. The step of identifying the current placement image and determining the model of the changed tool in the toolbox includes: Read and compare the image data of the currently placed image with the image data of the historically placed images to determine whether a tool change has occurred in the toolbox; If there is a target image region where the image data of the currently placed image and the image data of the historically placed image differ, then it is determined that a tool change has occurred in the toolbox; Identify the target image region and determine the model of the modified tool in the toolbox that has been changed. The target image region includes the image region where the modified tool is located in the placement slot of the toolbox.

3. The tool management method according to claim 2, characterized in that, The historical placement image refers to the placement image of the tools in the toolbox taken after the previous tool change. or The historical placement image is the initial placement image of the tools in the toolbox.

4. The tool management method according to claim 1, characterized in that, Also includes: In response to the user's tool selection operation, after determining the target tool and its model selected by the user, the location of the target tool in the toolbox is displayed to the user.

5. The tool management method according to claim 1, characterized in that, Also includes: When the tool management system issues an alarm, the toolbox door pops open.

6. The tool management method according to claim 1, characterized in that, The tool management system has multiple process modes, each process mode corresponding to a process and at least one tool required for the process. The tool management method further includes: In response to the user's target process selection operation, determine the target location of the tool required for the target process in the toolbox, and display the target location to the user; The toolbox door is opened to allow the user to retrieve the tools required for the target process; In response to a door closing signal emitted by a sensor switch located on the door, a target placement image of the tools in the toolbox is acquired, and the image area where the target position is located in the target placement image is identified, so as to determine whether the user has taken the tool required for the target process.

7. A tool management system, characterized in that, The tool management system includes: The selection unit is used to determine the target tool selected by the user and the model of the target tool in response to the user's tool selection operation after the user logs into the tool management system. A control unit is used to open the toolbox door, allowing the user to operate the tools inside the toolbox; The acquisition unit is used to acquire an image of the current placement of tools in the toolbox in response to a door closing signal emitted by a sensor switch installed on the door. The identification unit is used to identify the currently placed image and determine the model of the modified tool in the toolbox that has been changed; The comparison unit is used to compare whether the model of the target tool is consistent with the model of the modified tool. If the model of the target tool is consistent with the model of the modified tool, the recording unit is executed; if the model of the target tool is inconsistent with the model of the modified tool, the prompting unit is executed. The recording unit is used to record the model of the modification tool, the modification information of the modification tool, and the user's information; The notification unit is used to issue an alarm message to notify the user that the tool operation was incorrect.

8. The tool management system according to claim 7, characterized in that, The toolbox contains a placement template with multiple tool placement slots. The shape of each tool placement slot corresponds to a tool model. The identification unit is specifically configured as follows: The image data of the currently placed image and the image data of the historically placed image are read and compared to determine whether a tool change has occurred in the toolbox. If there is a target image area where the image data of the currently placed image and the image data of the historically placed image are different, then it is determined that a tool change has occurred in the toolbox. The target image area is identified, and the model of the changed tool in the toolbox is determined. The target image area includes the image area where the changed tool is located in the placement slot of the toolbox.

9. An electronic device, characterized in that, It includes at least one processor and a memory connected to the processor, wherein: The memory is used to store computer programs; The processor is used to execute the computer program to enable the electronic device to implement the tool management method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that, It includes computer-readable instructions that, when executed on an electronic device, cause the electronic device to implement the tool management method as described in any one of claims 1 to 6.

Images