Article detection method and device, storage equipment, electronic equipment and medium

Abstract

The invention provides an article detection method and device, storage equipment, electronic equipment and a readable medium, and relates to the technical field of detection. The method comprises the following steps: acquiring a first image of an article placement area of an article storage unit; the article placing area is provided with at least two storage positions, and corresponding article label information is displayed at different storage positions; according to the first image, obtaining label identification information corresponding to an area where the article label information is located; and determining a first borrowing state of the article stored in the storage position according to the tag identification information. The storage state of the article in the article storage unit can be judged through the tag identification information. According to the technical scheme of the invention, the method can meet the detection requirements of more abundant types of articles, can be well matched with articles of various shapes and sizes, facilitates the improvement of the detection accuracy of articles in the article storage unit, and is higher in recognition rate and recognition speed through the detection of the article storage tag instead of the article body.

Description

Technical Field

[0001] The present application relates to the field of detection technology, and in particular to an object detection method, device, storage device, electronic device and readable medium. Background Art

[0002] All walks of life have the need to accurately manage items (such as various tools, materials, etc.). In order to accurately manage items, storage devices that can detect the storage status of items are usually used to store items, so that users can understand the access status of items and reduce the occurrence of lost items.

[0003] In the related art, in order to accurately detect the storage and access status of items, it is usually necessary to make a corresponding electronic tag (such as a contactless electronic tag) for each item that needs to be stored, and then install the electronic tag on the corresponding item. The internal radio frequency signal is read by the electronic tag reader / writer mounted on the storage device, so as to identify the electronic tag in the storage device and determine whether the item corresponding to the electronic tag exists in the storage device, thereby achieving the purpose of accurate management of the items.

[0004] However, not all items are suitable for installing electronic tags. As a result, in the actual implementation of the relevant technology, items without electronic tags or items with damaged electronic tags are often stored in storage devices, resulting in the inability to properly identify these items, causing the above-mentioned related technologies to have poor accuracy in detecting items. Summary of the invention

[0005] In view of the above problems, the embodiments of the present application provide an object detection method, apparatus, storage device, electronic device and readable medium to solve the problem of poor accuracy in object detection.

[0006] In order to solve the above problems, the present application discloses an object detection method, including:

[0007] Acquire a first image of an item placement area of ​​an item storage unit; the item placement area has at least two storage locations, and different storage locations display corresponding item label information;

[0008] According to the first image, obtaining label identification information corresponding to the area where the item label information is located;

[0009] A first borrowing status of the item stored at the storage location is determined according to the tag identification information.

[0010] The embodiment of the present application discloses a storage device, including: a control unit, at least one object storage unit, and a camera corresponding to the object storage unit;

[0011] The camera is used to collect a first image of an item placement area of ​​the item storage unit;

[0012] The control unit is used to execute the above-mentioned object detection method.

[0013] The present application embodiment discloses an object detection device, comprising:

[0014] An image acquisition module, used to acquire a first image of an item placement area of ​​an item storage unit; the item placement area has at least two storage locations, and different storage locations display corresponding item label information;

[0015] An information acquisition module, used to acquire label identification information corresponding to the area where the item label information is located according to the first image;

[0016] The first status module is used to determine a first borrowing status of the item stored in the storage location according to the tag identification information.

[0017] Accordingly, an embodiment of the present application further discloses an electronic device, including:

[0018] Processor and memory;

[0019] The processor stores executable codes, and when the executable codes are executed, the processor executes the above method.

[0020] Correspondingly, the embodiments of the present application also disclose one or more machine-readable media on which executable codes are stored, which, when executed by one or more processors, enable the processors to execute the above method.

[0021] The embodiments of the present application include the following advantages:

[0022] In the embodiment of the present application, by acquiring a first image of an item placement area of ​​an item storage unit; the item placement area has at least two storage positions, and different storage positions display corresponding item label information; according to the first image, the label identification information corresponding to the area where the item label information is located is acquired; according to the label identification information, the first borrowing status of the item stored in the storage position is determined. The image of the item placement area in the item storage unit can be detected, and the label identification information identifying the item information can be extracted from it, and the storage status of the item in the item storage unit can be determined by the label identification information. By adopting the item detection method provided in the embodiment of the present application, no additional electronic tags can be added to the item body to be stored, and there is no need to consider the compatibility of the item body and the electronic tag. It can be applicable to the detection needs of more abundant types of items, and can be well adapted to items of various shapes and sizes, which helps to improve the accuracy of detecting items in the item storage unit. In addition, since the detection and recognition process of the label is relatively efficient and has a high accuracy rate, by detecting the item storage label instead of the item body, it has a high recognition rate and recognition speed, which also helps to improve the efficiency and accuracy of item detection to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a storage device provided by an embodiment of the present application;

[0024] Figure 2 is a structural diagram of an item storage unit provided by an embodiment of the present application;

[0025] Figure 3 This is a flow chart of using a storage device provided by an embodiment of the present application;

[0026] Figure 4 This is a schematic diagram of opening an item storage unit provided by an embodiment of the present application;

[0027] Figure 5 is a flowchart of a method for detecting an object provided by an embodiment of the present application;

[0028] Figure 6 This is a top view of an item placement area provided by an embodiment of the present application;

[0029] Figure 7 is a first image schematic diagram provided by an embodiment of the present application;

[0030] Figure 8 is a flowchart of another method for detecting an object provided by an embodiment of the present application;

[0031] Fig. 9 This is a schematic diagram of the structure of an item placement area provided by an embodiment of the present application;

[0032] Fig.10 is a side cross-sectional schematic diagram of a storage device provided by an embodiment of the present application;

[0033] Fig.11 is a device connection relationship diagram of a storage device provided by an embodiment of the present application;

[0034] Fig.12 is a structural schematic diagram of an object detection device provided in one embodiment of the present application;

[0035] Fig.13 It is a structural schematic diagram of a device provided in another embodiment of the present application. DETAILED DESCRIPTION

[0036] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0037] In the embodiments of the present application, since all walks of life usually have the need for accurate management of items, for example, for the aviation industry, it is necessary to accurately manage aviation maintenance-related tools / materials; for the CNC field, it is necessary to accurately manage CNC machine tool-related parts / tools. If accurate management of items can be achieved, the efficiency of product maintenance / product updates can be ensured. In order to meet the demand for accurate management of items, the present application designs a method for item detection and a device for storing items.

[0038] In order to enable those skilled in the art to better understand the present application, the concepts involved in the present application are explained below:

[0039] Storage device: A device that can be used to store items. The storage device can be composed of one or more item storage units. For example, the storage device can be a tool storage cart, a tool storage cabinet, etc. The storage device can also include an interaction unit and an identity authentication unit. The storage device can obtain the user's identity information through the identity authentication unit, and allow the user to lend or return the items stored in the storage device if the user's identity information matches the preset identity information; the lending, returning, opening, closing and other functions of the item storage unit can be operated through the interaction unit, and the preset identity information and the storage item information of each item storage unit can also be set and adjusted through the interaction unit.

[0040] Reference Figure 1 , Figure 1 A storage device provided in an embodiment of the present application is shown. Figure 1As shown, the storage device may be composed of a control unit 11, at least one item storage unit 12, and a camera corresponding to the item storage unit 12. The control unit 11 obtains an image of the item storage unit 12 through the camera, and determines the borrowing status of the item stored in the storage location corresponding to the item storage unit 12 through the image. In order to improve the convenience of using the storage device, the storage device may also include an interaction unit, such as Figure 1 In order to improve the safety of the storage device, the storage device may also include an input device, such as Figure 1 In order to improve the mobility of the storage device, the storage device may further include a mobile unit, such as Figure 1 The universal wheel 17 shown in FIG.

[0041] Item storage unit: An independent space that can be used to store items. Users can set the storage item information for each item storage unit, and the item storage unit can control the items stored therein. One or more item storage units can form a storage device, and the item storage units in each storage device can be independently controlled (for example, unlocked or locked). An RFID reader can be provided in the item storage unit to read the RFID tags corresponding to the items in the item storage unit, so as to detect the items stored in the item storage unit; a camera can also be provided in the item storage unit to capture images in the item storage unit, and detect the items stored in the item storage unit based on the images.

[0042] It should be noted that various types of item storage units can be set in the storage device, which may include a visual detection storage unit that is equipped with a camera and performs item detection through a first image taken by the camera; it may include a radio frequency detection storage unit that is equipped with a radio frequency reader or an antenna connected to the radio frequency reader and performs item detection based on a radio frequency tag; it may also include a hybrid detection storage unit that is equipped with a camera and a radio frequency reader or an antenna connected to the radio frequency reader.

[0043] Reference Figure 2 , Figure 2 A structural diagram of an article storage unit provided in an embodiment of the present application is shown. Figure 2As shown, the item storage unit may include a bottom plate 21 and a camera 22 disposed above the bottom plate 21, and the side of the bottom plate 21 facing the camera 22 includes at least one item label information 23. In order to improve the convenience of users placing items in the item storage unit, an item limiting layer 24 may be further disposed on the side of the bottom plate facing the camera, and the item limiting layer 24 may include storage positions 25 corresponding to the item label information one by one, and each storage position 25 coincides with the vertical projection of the corresponding item label information 23 on the bottom plate, so that the camera 22 can capture the item label information 23 set on the bottom plate through the storage position 25. In order to improve the clarity of the image captured by the camera 22, a fill light 26 may be further disposed in the item storage unit, and the camera 22 and the fill light 26 may be disposed on the side of the top plate 27 of the item storage unit facing the bottom plate 21. In order to protect the bottom plate 21 and the label 23, a transparent protective layer 28 may be further disposed between the bottom plate 21 and the limiting layer 24. Among them, the top plate 27 of an item storage unit may be the bottom plate of another item storage unit disposed above the item storage unit.

[0044] Item placement area: An area in an item storage unit for placing items. Storage locations for storing items may be provided in the item placement area. Each storage location corresponds to corresponding item label information and items. Users can store items in the corresponding storage locations. The item storage area may be the entire bottom area of ​​the item storage unit, or may be a partial area of ​​the entire bottom area of ​​the item storage unit. It may be flexibly set by technical personnel according to actual item storage needs. Among them, the item placement area may be composed of a bottom plate and an item limiting layer above the bottom plate. The bottom plate is used to display item label information. When the item limiting layer is set, the storage location may be set in the item limiting layer by digging a storage slot in the item limiting layer. The storage location may pass through the above-mentioned item limiting layer so that the surface of the above-mentioned bottom plate serves as the bottom of the storage location.

[0045] The base plate can be a display panel with active information display function (such as an ink screen, an electronic screen), or a hard plate without active information display function (such as a metal plate, a wooden board, a plastic board, etc.). When the information base plate has the active information display function, the item label information can be directly displayed through the base plate. When the base plate does not have the active information display function, the item label information can be displayed on the information base plate by drawing a graphic or setting (such as pasting or placing) a mark on the information base plate. The base plate can be used as the base plate of the item storage unit to form an item placement area for supporting the items in the item storage unit.

[0046] The shape of the storage location can match the shape of the item to be placed in the storage location, so as to improve the convenience of the user placing the corresponding item and improve the stability of the item in the item storage unit; the storage location can be determined by the user by digging the item limiting layer according to the shape of the item to be stored in the item storage unit.

[0047] A transparent protective layer may be provided between the bottom plate and the article limiting layer to protect the bottom plate and / or the article label information from damage by the articles placed thereon, thereby improving the durability of the bottom plate and / or the article label information. The material of the protective layer may include, but is not limited to, glass, transparent plastic, transparent rubber, etc. The protective layer may completely cover the first surface of the bottom plate, or may only cover the area corresponding to the storage position on the first surface of the bottom plate, thereby saving the cost of providing the protective layer.

[0048] First image: an image obtained by photographing the item placement area through a camera in the item storage unit. The field of view of the camera set in the item storage unit can be greater than or equal to the item placement area in the corresponding item storage unit, so that the first image obtained by photographing the item placement area through the camera can include the complete item placement area.

[0049] Item tag information: information that can be used to identify and distinguish different items. Different items can have different item tag information, so that by identifying an item tag information, the specific item corresponding to the item tag information can be known. Item tag information can include but is not limited to character strings, patterns, barcodes, etc., and barcodes can include but are not limited to one-dimensional barcodes, two-dimensional barcodes, etc.

[0050] Radio Frequency Reader / Writer: An information reading and writing device that uses radio frequency identification (RFID) technology. Radio Frequency Reader / Writer can also be called RFID Reader / Writer. It can identify specific targets and read and write related data through radio signals without contact.

[0051] Radio frequency tag: A data carrier of wireless radio frequency identification technology, also known as RFID tag or electronic tag. It consists of a coupling element and a chip. Each radio frequency tag has a unique electronic code and can communicate with a radio frequency reader through radio signals to realize tag content recognition and tag content setting.

[0052] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0053] Reference Figure 3 , Figure 3A flow chart for using a storage device provided in an embodiment of the present application is shown, in which step 31 can be executed to initialize the radio frequency reader; step 32 sets the information required for image detection, such as item tag information, the correspondence between item tag information and item information, etc.; step 33 lends the storage device and records the borrowing user; step 34 the user opens the item storage unit to borrow or return items; step 35 closes the item storage unit and detects the items in the item storage unit; step 36 the user returns the storage device; step 37 determines the integrity of the items in the storage device.

[0054] Before using the storage device, the user sets storage locations for the item placement areas of each item storage unit, as well as item label information corresponding to each storage location, pastes or displays the item label information at the corresponding storage locations in the item placement areas, and sets the correspondence between the item label information and the item storage units in the storage device, as well as association information corresponding to each storage location, wherein the association information may include usage status information of the storage location (e.g., in use, vacant), naming information (e.g., item name), etc.

[0055] The user can also enter or import preset identity information, such as passwords, fingerprints, identification card information, etc., into the storage device in advance through the interactive unit carried by the storage device. In addition, the use parameters such as the permission and use time of the preset identity information can be set, thereby realizing personalized management of different users. Specifically, the fingerprint information can be entered as the preset identity information through the fingerprint collector carried by the storage device, and the identification card information can also be entered as the preset identity information through the card reader carried by the storage device. It should be noted that in order to improve the accuracy of identity authentication, a preset identity information can contain multiple information items, such as fingerprint information and identification card information.

[0056] When using a storage device, the user can input identity information through the input device, and the control unit matches the identity information with the preset identity information, and determines whether the user is a legitimate user based on the matching result. If the user is determined to be a legitimate user, the second borrowing state of the storage device can be adjusted to allow borrowing, and the preset identity information corresponding to the user is used as the borrowing identity information, waiting for the borrowing user to operate the storage device. When the borrowing user needs to borrow or return tools from the storage device, the identity information can be entered again through the input device, and identity authentication is performed again. This verification determines whether the identity information of the current user matches the borrowing identity information. If it matches, it is determined that the identity information verification has passed, and the borrowing and returning operations can be responded to; if it does not match, it is determined that the identity information verification has failed, indicating that the current user is not a borrowing user, and the borrowing and returning operations can be ignored, so as to prevent the storage device from being used by others without the knowledge of the borrowing user, which helps to improve the safety of the storage device.

[0057] When the storage device is lent, the control unit can capture a first image of the item placement area through a camera, obtain the tag identification information corresponding to the area where the item tag information is located from the first image, and compare the tag identification information with the preset tag information stored in the database, so as to determine the initial borrowing status of the items stored in the storage location corresponding to each preset tag information. If a preset tag information does not match the corresponding tag identification information, it can be determined that the initial borrowing status of the items stored in the storage location corresponding to the preset tag information is not lent out; if a preset tag information matches the corresponding tag identification information, it can be determined that the initial borrowing status of the items stored in the storage location corresponding to the preset tag information is lent out. According to the initial borrowing status corresponding to the items in each storage location, the initial item information of each item storage unit can be determined, so that when the user returns the storage device, the complete status of the items in each item storage unit can be determined according to the initial item information, wherein the initial item information can include item information whose initial borrowing status is not lent out. It should be noted that the initial item information corresponding to the above-mentioned item storage unit can also be obtained when the item storage unit is locked last time.

[0058] After the user passes the identity authentication, the storage item information of the storage device can be displayed to the user through the interactive unit. The user can specify the target item to be taken or returned according to the storage item information, and the control unit controls the electronic lock of the item storage unit corresponding to the target item to open, so that the user can borrow or return the target item. The item storage unit information of the storage device can also be directly displayed to the user through the interactive unit. The user can specify the target item storage unit according to the item storage unit information, and the control unit controls the electronic lock of the target item storage unit to open, so that the user can borrow or return the item in the target item storage unit.

[0059] Reference Figure 4 , Figure 4 A schematic diagram of opening an article storage unit provided in an embodiment of the present application is shown. Figure 4 As shown, the item storage unit 41 can be opened in a pull-out manner, and the user can pull the bottom of the item storage unit 41 out from the storage device to open the item storage unit 41. After the item storage unit 41 is unlocked, the user can open the item storage unit 41 and take out the items placed in the item placement area. The item storage unit 41 can be opened in a manner including, but not limited to, a pull-out manner, a door-opening manner, etc., which is not specifically limited in the embodiments of the present application.

[0060] After the user takes the item from the item storage unit, the item storage unit can be closed. After the control unit detects that the item storage unit is closed, the electronic lock of the item storage unit is locked, the fill light in the item storage unit is turned on, and the camera in the item storage unit is controlled to capture the image of the item placement area of ​​the item storage unit to obtain a first image. If the item in a storage location is taken by the user, since the item no longer blocks the item label information at the bottom of the storage location, the first image will contain the item label information corresponding to the storage location; correspondingly, if the item in a storage location is not taken by the user, the existence of the item will block the item label information at the bottom of the storage location, so the first image will not contain the item label information corresponding to the storage location, or the item label information corresponding to the storage location is incomplete.

[0061] The control unit can perform image recognition on the item label information based on the first image, obtain the label identification information corresponding to the area where the item label information is located from the first image, and compare the label identification information with the preset label information stored in the database, so as to determine the first borrowing status of the items stored in the storage location corresponding to each preset label information. If a preset label information does not match the corresponding label identification information, it can be determined that the borrowing status of the item stored in the storage location corresponding to the preset label information is a non-borrowed status; if a preset label information matches the corresponding label identification information, it can be determined that the borrowing status of the item stored in the storage location corresponding to the preset label information is a borrowed status.

[0062] It should be noted that, in the process of obtaining the label identification information corresponding to the area where the object label information is located from the first image, the usage status information corresponding to each storage location can be obtained from the database, and the label identification information of the storage location with the usage status information being in use is obtained, while the identification operation of the object label information of the storage location with the usage status information being vacant is stopped, thereby reducing the amount of calculation required to obtain the label identification information and improving the efficiency of obtaining the label identification information.

[0063] After determining the borrowing status of the items stored in each storage location in the item storage unit, the item information corresponding to the item storage unit can be generated according to the borrowing status, the item information corresponding to each item storage unit can be displayed through the interactive unit, and the item information can also be sent to a remote terminal through a network so that the user can remotely detect the storage device.

[0064] The item label information may also carry the item information of the corresponding item, so that the item information of the item storage unit may be obtained directly by reading the first label information in the first image. For example, the item label information may be a character string "No. 12 wrench" that describes the item information, and the item label may also be a barcode that records the item information. The embodiment of the present application does not specifically limit the way in which the item label information records the item information. Specifically, the image content of the first image may be identified based on the information type of the item label information, and the information of the corresponding information type may be extracted from the first image as the first label information. In the actual extraction process, the unobstructed item label information in the item placement area will be fully imaged in the first image, so the corresponding first label information can be identified from the first image; and the obstructed image label information in the item placement area will not be fully imaged in the first image, so the corresponding first label information does not exist in the first image.

[0065] It should be noted that the various information, signal or data processes used in the embodiments of the present application are all carried out in compliance with the relevant data protection laws and policies of the country where they are located and with the authorization given by the owner of the corresponding device.

[0066] The object detection method involved in this application is described in detail below.

[0067] Reference Figure 5 , shows a flowchart of the steps of an object detection method of the present application, which may include:

[0068] Step 101: Acquire a first image of an item placement area of ​​an item storage unit; the item placement area has at least two storage locations, and different storage locations display corresponding item label information.

[0069] In the embodiments of the present application, since all walks of life usually have the need for accurate management of items, for example, for the aviation industry, it is necessary to accurately manage aviation maintenance-related tools / materials; for the CNC field, it is necessary to accurately manage CNC machine tool-related parts / tools. If accurate management of items can be achieved, the efficiency of product maintenance / product updates can be ensured. In order to meet the demand for accurate management of items, the present application designs a method for item detection.

[0070] In an embodiment of the present application, items can be stored in an item placement area of ​​an item storage unit; wherein the item storage unit can be set in a storage device for managing items, and any number of item storage units can be set in one storage device. The existence form of the item storage unit in the device can be understood as a drawer, cabinet, etc., which is not limited in the embodiment of the present application.

[0071] A storage device can be provided with any number of item storage units, and different item storage units can store items of different categories. However, for an item storage unit, although each item placement area inside it can store items of the same category. However, there may be complex and diverse models among items of the same category. For example, items that all belong to the category of wrenches may also have different models, such as model A wrenches corresponding to different sizes, and model B wrenches corresponding to different sizes. In order to cope with the above situation, one or more item placement areas may be included in an item storage unit.

[0072] For application scenarios where an item storage unit includes only one item placement area, the item placement area may include at least two storage positions, each of which may be used to store one item. For application scenarios where an item storage unit includes multiple item placement areas, each item placement area may be used to store items of different models / types. For example, if an item storage unit includes an item placement area A and an item placement area B, then each storage position of the item placement area A may store model A wrenches of different sizes, and each storage position of the item placement area B may store model B wrenches of different sizes.

[0073] Based on the above introduction to the item storage unit, a first image of the item placement area of ​​the item storage unit can be obtained, wherein the first image can be triggered to be captured based on the state of the storage device (e.g., the item storage unit is open, the item storage unit is closed), and the device for capturing the first image can be a camera module built into the item storage unit, and the camera module can include one or more cameras. If multiple cameras are included, the types of the multiple cameras (e.g., a telephoto camera, a short-focus camera, etc.) may or may not be consistent. For different item storage units, their built-in camera modules may be the same or different, and the embodiments of the present application are not limited thereto.

[0074] In addition, it should be noted that, since different storage locations display corresponding item label information, the first image can contain any number of item label information, and the number of item label information contained depends on whether the item corresponding to the item label information is loaned out. If loaned out, the item label information cannot be blocked by the corresponding item, so the first image contains the item label information; if not loaned out, the item label information will be blocked by the corresponding item, so the first image does not contain the item label information; wherein the item label information can be used to uniquely identify the corresponding item, and the item label information may include but is not limited to the following: character strings, patterns, barcodes, etc., wherein the character strings may include item names, item models, item categories, etc., the patterns may include but are not limited to item photos, item outlines, item trademarks, etc., and the barcodes may include but are not limited to one-dimensional barcodes, two-dimensional barcodes, etc.

[0075] Step 102: Obtain label identification information corresponding to the area where the item label information is located based on the first image.

[0076] In the embodiment of the present application, the first image includes an item storage area, that is, the first image includes unobstructed item storage labels in the item storage area. If an item in a storage location is taken by a user, the item no longer obstructs the item label information at the bottom of the corresponding storage location, so the first image will include the item label information corresponding to the storage location; correspondingly, if an item in a storage location is not taken by a user, the existence of the item will obstruct the item label information at the bottom of the storage location, so the first image will not include the item label information corresponding to the storage location, or the item label information corresponding to the storage location is incomplete. In summary, the label identification information corresponding to the area where the item label information is located can be extracted from the item storage area by performing image recognition on the first image.

[0077] It should be noted that the label identification information corresponding to the area where the item label information is located represents information obtained based on image recognition of the item label information in the first image. Therefore, the label identification information corresponding to the area where the item label information is located may be the same information as the item label information.

[0078] Since the item label information may include multiple types, different methods may be used to extract the corresponding label identification information from the first image for different types of item label information. For example, in the case where the item label information is of image type, the item label information may be used as reference information, and the item label information may be matched in the first image to determine the imaging area corresponding to the item label information. The imaging area is then extracted to obtain a local image corresponding to the imaging area as label identification information, or the item label information matched to the corresponding imaging area in the first image is used as label identification information; in the case where the item label information is of barcode type, the barcode position may be determined from the first image, and the barcode in the first image may be read to obtain the information recorded in the barcode as label identification information.

[0079] Taking a two-dimensional code as an example, the specific method for reading barcode information from the first image may be: using an optical character recognition (OCR) algorithm to process the first image and find the positioning corner points of the two-dimensional code in the first image. Specifically, the first image can be smoothed and binarized to obtain an image to be detected, and computer vision technologies such as OpenCV are used to search for contour graphics in the image to be detected. Contour graphics with two sub-contours are screened out from these contour graphics to be determined as the contour of the two-dimensional code, and three sub-contours with the closest areas in the two-dimensional code contour are determined as the positioning corner points of the two-dimensional code. A triangle is constructed based on the three positioning corner points, and the positioning corner point corresponding to the maximum inner angle of the triangle is determined as the first positioning corner point of the two-dimensional code (usually the positioning corner point at the upper left of the two-dimensional code), and then based on the angle difference between the two adjacent sides of the first positioning corner point in the triangle, the second positioning corner point (usually the positioning corner point at the lower left of the two-dimensional code) and the third positioning corner point (usually the positioning corner point at the upper right of the two-dimensional code) are determined, and then the two-dimensional code information is parsed based on the above-mentioned first positioning corner point, second positioning corner point and third positioning corner point to obtain label identification information.

[0080] The control unit can perform image recognition on the item label information based on the first image, obtain the label identification information corresponding to the area where the item label information is located from the first image, and compare the label identification information with the preset label information stored in the database, so as to determine the first borrowing status of the items stored in the storage location corresponding to each preset label information. If a preset label information does not match the corresponding label identification information, it can be determined that the borrowing status of the item stored in the storage location corresponding to the preset label information is a non-borrowed status; if a preset label information matches the corresponding label identification information, it can be determined that the borrowing status of the item stored in the storage location corresponding to the preset label information is a borrowed status.

[0081] Optionally, in some cases, not all storage locations in the item storage unit may be used. For example, an item storage unit includes 10 storage locations, but the user only needs to store 5 items in the item storage unit. Therefore, in the embodiment of the present application, corresponding usage status information can also be set for each storage location in the item storage unit to indicate whether to detect the storage location. During the detection process, unused storage locations can be ignored through the following sub-steps 1021 to 1023.

[0082] Sub-step 1021, obtaining the usage status information of the storage location.

[0083] In an embodiment of the present application, the usage status information may include "in use" and "vacant", where "in use" indicates that the corresponding storage location has been enabled and has the corresponding item; "vacant" indicates that the corresponding storage location has not been enabled and does not have the corresponding item.

[0084] Optionally, the usage status information corresponding to each storage location can be set through the following sub-steps 10211 to 10212.

[0085] Sub-step 10211, receiving the setting operation for the storage location.

[0086] In an embodiment of the present application, a user may enter a management interface of a storage device through an interactive unit carried by the storage device or a remote device, select a storage location to be set in the management interface, and input setting operations for the storage location.

[0087] Sub-step 10212, in response to the setting operation, setting the associated information of the storage location, the associated information including the usage status information.

[0088] Before using the storage device, the user sets storage locations for the item placement areas of each item storage unit, as well as item label information corresponding to each storage location, pastes or displays the item label information at the corresponding storage locations in the item placement areas, and sets the correspondence between the item label information and the item storage units in the storage device, as well as association information corresponding to each storage location, wherein the association information may include usage status information of the storage location, naming information (such as item name), etc.

[0089] Sub-step 1022, when the usage status information is in use, execute the step of acquiring the label identification information corresponding to the area where the item label information is located according to the first image.

[0090] Sub-step 1023, when the usage status information is vacant, stop identifying the item tag information corresponding to the storage location.

[0091] In the above process of obtaining the label identification information corresponding to the area where the object label information is located from the first image, the usage status information corresponding to each storage location can be obtained from the database, and the label identification information of the storage location with the usage status information being in use is obtained, while the identification operation of the object label information of the storage location with the usage status information being vacant is stopped, thereby reducing the amount of calculation required to obtain the label identification information and improving the efficiency of obtaining the label identification information.

[0092] Optionally, the object placement area is provided with a display panel, and in order to improve the efficiency and success rate of object detection, the object label information can be displayed through the following sub-steps 1024 to 1025.

[0093] Sub-step 1024, when the usage status information is in use, displaying the item label information in an area corresponding to the storage location in the display panel.

[0094] Reference Figure 6 , Figure 6 FIG. 4 shows a top view of an article placement area provided in an embodiment of the present application. Figure 6 As shown, the usage status information of storage location 61 and storage location 62 is in use, and the usage status information of storage location 63 and storage location 64 is vacant. The display panel can display the item storage label 611 corresponding to storage location 61 in the display area corresponding to storage location 61, and display the item storage label 621 corresponding to storage location 62 in the display area corresponding to storage location 62.

[0095] Sub-step 1025, when the use status information is vacant, displaying stop use information or not displaying item label information in the area corresponding to the storage location in the display panel.

[0096] In an embodiment of the present application, the stop use information can be flexibly set by the user according to actual needs, and the embodiment of the present application does not make any specific limitations. For example, the stop use information may include "suspend use", "stop use", "do not use", "do not prevent items", etc.

[0097] like Figure 6 As shown, since the usage status information of storage location 63 and storage location 64 is vacant, the stop use information can be displayed in the display area corresponding to storage location 63 or the item label information can be not displayed, and the stop use information can be displayed in the display area corresponding to storage location 64 or the item label information can be not displayed.

[0098] By displaying the item label information in the area corresponding to the storage location in the display panel when the usage status information is in use, and displaying the stop use information or not displaying the item label information in the area corresponding to the storage location in the display panel when the usage status information is vacant, the user can be prompted to operate the storage location to a certain extent, reducing the probability of the user putting the item in the wrong place, thereby improving the accuracy of subsequent item detection.

[0099] Step 103: Determine a first borrowing status of the item stored in the storage location according to the tag identification information.

[0100] In an embodiment of the present application, if the imaging of the item label information in the first image is incomplete or absent, the label identification information corresponding to the item label information cannot be obtained from the first image. Since the unborrowed items in the item storage unit obstruct the corresponding item storage labels, their corresponding label identification information cannot be obtained from the first image. Therefore, the first borrowing status of the items in each storage location in the item storage unit can be determined by detecting the label identification information.

[0101] Specifically, the first borrowing status may include a borrowed status and a non-borrowed status. The first borrowing status of an item corresponding to the tag identification information may be determined as a borrowed status, and the first borrowing status of an item without corresponding tag identification information may be determined as a non-borrowed status.

[0102] Reference Figure 7 , Figure 7 A first image schematic diagram provided by an embodiment of the present application is shown, in which an item storage area of ​​an item storage unit includes storage locations corresponding to four tools (tool 1 to tool 4), and when tool 1 and tool 3 are borrowed, and tool 2 and tool 4 are not borrowed, the camera corresponding to the item storage unit can capture the following image: Figure 7 The first image is shown. The first image contains four storage positions 71 to 74, wherein no tools are placed in storage position 71 and storage position 73. Therefore, the item storage label corresponding to storage position 71 is not blocked, and the item storage label corresponding to storage position 73 is not blocked. The label identification information 711 of tool 1 corresponding to storage position 71 can be obtained from the first image, and the label identification information 731 of tool 3 corresponding to storage position 73 can be obtained from the first image. However, tool 2 in storage position 72 has not been borrowed, and tool 4 in storage position 74 has not been borrowed either. Therefore, the label identification information of tool 2 corresponding to storage position 72 cannot be obtained from the first image, and the label identification information of tool 4 corresponding to storage position 74 cannot be obtained from the first image. By Figure 7 The first image shown can extract label identification information 711 and label identification information 731, so that the first borrowing status of tool 1 corresponding to placement position 71 can be determined as a borrowed status, the first borrowing status of tool 2 corresponding to placement position 72 can be determined as a non-borrowed status, the first borrowing status of tool 3 corresponding to placement position 73 can be determined as a borrowed status, and the first borrowing status of tool 4 corresponding to placement position 74 can be determined as a non-borrowed status.

[0103] In summary, the article detection method provided by the embodiment of the present application obtains the first image of the article placement area of ​​the article storage unit; the article placement area has at least two storage positions, and different storage positions display corresponding article label information; according to the first image, the label identification information corresponding to the area where the article label information is located is obtained; according to the label identification information, the first borrowing status of the article stored in the storage position is determined. The image of the article placement area in the article storage unit can be detected, and the label identification information identifying the article information can be extracted from it, and the storage status of the article in the article storage unit can be determined by the label identification information. Using the article detection method provided by the embodiment of the present application, the object body to be stored can be detected without adding any additional electronic tags, and there is no need to consider the compatibility of the object body and the electronic tag. It can be applicable to the detection needs of more types of articles, and can be well adapted to articles of various shapes and sizes, which helps to improve the accuracy of detecting articles in the article storage unit. In addition, since the detection and recognition process of the label is relatively efficient and has a high accuracy rate, by detecting the object storage label instead of the object body, it has a high recognition rate and recognition speed, which also helps to improve the efficiency and accuracy of article detection to a certain extent.

[0104] Reference Figure 8 , shows a flowchart of another method for detecting an object of the present application, which may include:

[0105] Step 201, detecting the locking state of the item storage unit; wherein the locking state includes unlocked and locked.

[0106] In an embodiment of the present application, in order to improve the stability and accuracy of acquiring the first image, the timing of acquiring the first image can be set to after the item storage unit is locked. After the item storage unit is locked, the internal items will be in a stable state, which will help improve the accuracy of acquiring the first image.

[0107] Specifically, the locking state of the item storage unit can be detected in real time, and the locking state can include unlocked and locked. The locking state of the item storage unit can be determined by the working state of the electronic lock set in the item storage unit, for example, when the working state of the electronic lock of the item storage unit is unlocked, the locking state of the item storage unit is determined to be locked; the locking state of the item storage unit can also be determined by the pressure value of the pressure sensor set in the unit door of the item storage unit, for example, when the unit door of the item storage unit is closed, the pressure sensor set in the unit door receives a larger pressure and outputs a higher pressure value, and when the unit door of the item storage unit is opened, the pressure sensor set in the unit door receives a smaller pressure and outputs a lower pressure value, and the above pressure value can be matched with the preset pressure value in real time, and when the above pressure value is greater than or equal to the preset pressure value, the locking state of the item storage unit can be determined to be unlocked, and when the above pressure value is less than the preset pressure value, the locking state of the item storage unit can be determined to be locked.

[0108] Step 202, after the locking state is changed from the unlocked state to the locked state, the step of acquiring a first image of the object placement area of ​​the object storage unit is performed.

[0109] In an embodiment of the present application, the jump of the locking state of the item storage unit can be detected. After detecting that the locking state of the item storage unit changes from unlocked to locked, it means that the item storage unit has been closed, and the step of obtaining a first image of the item placement area of ​​the item storage unit can be executed.

[0110] By detecting the locking state of the item storage unit, and after the locking state changes from unlocked to locked, the step of acquiring the first image of the item placement area of ​​the item storage unit is performed. The first image can be taken when the item storage unit is locked and the items inside are in a stable state, thereby helping to improve the success rate of acquiring the first image and the accuracy of subsequent item detection based on the first image.

[0111] Optionally, before executing the step of acquiring the first image of the item placement area of ​​the item storage unit, the user identity may be verified through the following steps A1 to A3:

[0112] Step A1, receiving identity information.

[0113] In the embodiment of the present application, the user's identity information may be received. The identity information may include but is not limited to a password, a fingerprint, an identification card information, etc. The user may perform identity authentication through the identity information.

[0114] The user may input identity information through an input device, wherein the input device may include but is not limited to one or more of a keyboard, a card reader, a fingerprint collector, a face collector, and a voiceprint collector.

[0115] For example, a user can input an account name and a corresponding password through a keyboard, and input fingerprint information through a fingerprint collector to obtain identity information consisting of the password and fingerprint information.

[0116] Step A2: verifying the identity information.

[0117] In the embodiment of the present application, the identity information input by the user can be verified. Specifically, the identity information input by the user can be matched with the preset identity information, and whether the identity information of the user is verified can be determined according to the matching result. If the determination result is a match, the identity information is verified, and if the determination result is a mismatch, the identity information is not verified.

[0118] It should be noted that users can pre-enter or import preset identity information, such as preset passwords, preset fingerprints, preset identification card information, etc. In addition, the use parameters such as the use rights and usage time of the preset identity information can be set to achieve personalized management of different users. For example, fingerprint information can be entered as preset identity information through a fingerprint collector carried by a storage device, and identification card information can also be entered as preset identity information through a card reader carried by a storage device. It should be noted that in order to improve the accuracy of identity authentication, a preset identity information can contain multiple information items, such as fingerprint information and identification card information.

[0119] Step A3, when the identity identification information is verified, the electronic lock of the item storage unit is unlocked according to the borrowing record of the identity identification information.

[0120] In an embodiment of the present application, when the user's identity information is verified, the borrowing record corresponding to the identity information can be obtained, and it can be determined whether to unlock the electronic lock of the item storage unit according to the borrowing record, that is, whether to allow the user to continue to borrow items from the item storage unit. The borrowing record may include information about items that the user has borrowed but not returned. If the borrowing record corresponding to the user indicates that there are still unreturned items, the user's current borrowing request can be rejected, and a prompt message to return the borrowed items can be displayed to the user; if the borrowing record corresponding to the user indicates that there are no unreturned items, the electronic lock of the item storage unit can be unlocked.

[0121] Furthermore, multiple storage devices can form a storage device cluster, and each storage device in the storage device cluster can share borrowing records with each other. When a user borrows an item from any storage device in the storage device cluster, it can be determined whether the user has no unreturned items in the borrowing records corresponding to each storage device. If it is determined that the user has no unreturned items in the borrowing records corresponding to each storage device, the electronic lock of the storage unit of the item to be borrowed by the user can be unlocked; otherwise, the user's borrowing request can be rejected.

[0122] By receiving the identity information, verifying the identity information, and unlocking the electronic lock of the item storage unit according to the borrowing record of the identity information when the identity information verification is passed, it can prevent the user from borrowing items again without fully returning the borrowed items, which helps to improve the safety of items in the storage device.

[0123] Optionally, at least one storage unit may constitute a storage device. In an embodiment of the present application, a corresponding second borrowing status may be set for the storage device, and the user identity may be verified in combination with the second borrowing status of the storage device, which may specifically include the following steps B1 to B3.

[0124] Step B1, obtaining a second borrowing status of a storage device; wherein the storage device includes at least one of the storage units.

[0125] In the embodiment of the present application, the second borrowing status of the storage device can be used to indicate whether the storage device is allowed to be used, and the second borrowing status can be set by the administrator. The second borrowing status of the storage device can also be used to indicate whether the current storage device has been occupied by a borrowing user. If the second borrowing status is to allow borrowing, the storage device has been occupied, and the storage device can only be unlocked by the borrowing user. If the second borrowing status is to prohibit borrowing, the storage device has not been occupied, and the storage device can set the corresponding borrowing user.

[0126] Step B2: when the second borrowing status is that borrowing is allowed, executing a step of verifying the identity information.

[0127] In an embodiment of the present application, when the second borrowing status of the storage device is used to indicate whether the storage device is allowed to be used, if the second borrowing status corresponding to the storage device is allowing borrowing, the above-mentioned step of verifying the identity information can be performed to verify the identity information entered by the user.

[0128] In the case where the second borrowing status of the storage device is used to indicate whether the current storage device has been occupied by a borrowing user, if the second borrowing status corresponding to the storage device is allowing borrowing, the above-mentioned step of verifying the identity information can be performed to match the identity information entered by the user with the preset identity information of the borrowing user.

[0129] Step B3: when the second borrowing status is borrowing prohibited, stop borrowing.

[0130] In an embodiment of the present application, when the second borrowing status of the storage device is used to indicate whether the storage device is allowed to be used, if the second borrowing status corresponding to the storage device is borrowing prohibited, the user's borrowing request can be stopped from being processed and the borrowing operation can be terminated.

[0131] In the case where the second borrowing status of the storage device is used to indicate whether the current storage device has been occupied by a borrowing user, if the second borrowing status corresponding to the storage device is borrowing prohibited, the user's borrowing request can be stopped from being processed, and the function of setting the borrowing user can be jumped to prompt the user to first perform identity authentication, set the borrowing user, and adjust the second borrowing status corresponding to the storage device to allow borrowing before borrowing items in the item storage unit.

[0132] By acquiring the second borrowing status of the storage device, and executing the step of verifying the identity information when the second borrowing status indicates that borrowing is allowed, and stopping borrowing when the second borrowing status indicates that borrowing is prohibited, the storage device can be prevented from being unlocked by the user in the borrowing prohibited state, thereby further improving the security of the items stored in the storage device.

[0133] Optionally, in the embodiment of the present application, the following steps C1 to C4 may be used to update the borrowing record corresponding to the item storage unit.

[0134] Step C1: when the first borrowing status corresponding to any item is the borrowed status, the item tag information corresponding to the item is compared with the item tag information recorded in the borrowing record.

[0135] In an embodiment of the present application, the borrowing record may record information on items in the item storage unit that have been borrowed but not returned. When the first borrowing status corresponding to any item in the item storage unit is a borrowed status, the item label information corresponding to the item may be compared with the item label information recorded in the borrowing record to determine whether the item exists in the borrowing record.

[0136] Optionally, when the first borrowing status corresponding to any target storage location is a lent status, the first borrowing status of the target storage location recorded last time can be obtained. When the first borrowing status of the target storage location recorded last time is not lent, confirm that the target item of the target storage location is lent, and record the lending information for the target storage location in the borrowing record of the identity information. When the first borrowing status corresponding to any target storage location is not lent, obtain the lending information in the borrowing record of the identity information. When the lending information includes the target item information of the target storage location, confirm that the target item of the target storage location is returned and record the return information. After confirming that the target item of the target storage location is returned and recording the return information, the item storage unit can be locked. Among them, the lending information may include but is not limited to at least one of the storage location information, item information, lending time information, etc. It should be noted that each time the item storage unit is closed, the first image can be re-photographed, and the first borrowing status of each item in the item storage unit can be updated based on the first image.

[0137] Step C2: if the item tag information does not exist in the borrowing record, confirm that the item is borrowed and add the item tag information corresponding to the item to the borrowing record.

[0138] In an embodiment of the present application, if it is determined that there is no item in the borrowing record whose first borrowing status is the borrowed status, it can be confirmed that the item has been borrowed and has not been returned, and the item tag information corresponding to the item can be added to the borrowing record to obtain an updated borrowing record.

[0139] In order to remind the user to return the item, a reminder message can also be sent based on the updated borrowing record. The reminder message can be displayed on a storage device or on a remote terminal, where the remote terminal can include but is not limited to a management server, a mobile terminal of a user corresponding to the identity information of the borrowing record, etc. The method of transmitting the reminder message to the remote terminal can include but is not limited to text messages, instant messaging messages, etc., which are not specifically limited in the embodiments of the present application.

[0140] Furthermore, the borrowing time corresponding to each item in the borrowing record can be determined based on the borrowing time and the current time of the item, and the items with a borrowing time exceeding the preset time can be screened out from the borrowing record to generate the above-mentioned prompt information to prompt the user to return the overdue items as soon as possible.

[0141] Step C3: when the first borrowing status corresponding to any item is not borrowed, compare the item tag information corresponding to the item with the item tag information recorded in the borrowing record.

[0142] In an embodiment of the present application, when the first borrowing status corresponding to any item in the item storage unit is not borrowed, the item tag information corresponding to the item can be compared with the item tag information recorded in the borrowing record to determine whether the item exists in the borrowing record.

[0143] Step C4: if the item tag information exists in the borrowing record, confirm that the item is returned and record the return information.

[0144] In the embodiment of the present application, if it is determined that there is an item in the borrowing record that is not borrowed in the first borrowing status, it can be confirmed that the item has been returned by the user, and the return information corresponding to the item can be recorded, wherein the return information can include the return time, the item label information corresponding to the returned item, the return user information, etc. In addition, the item can also be deleted from the borrowing record to obtain an updated borrowing record.

[0145] By timely detecting the first borrowing status corresponding to each item in the item storage unit and updating the borrowing record based on the first borrowing status, it can be ensured that the borrowing record matches the actual situation, which helps to improve the efficiency and accuracy of managing items in the item storage unit.

[0146] Step 203, obtaining a first image of an item placement area of ​​the item storage unit; the item placement area has at least two storage locations, and different storage locations display corresponding item label information.

[0147] This step can refer to the above-mentioned step 101, and will not be described in detail in this embodiment of the present application.

[0148] Optionally, when the item label information is displayed through the display panel, in order to accurately display the item label information in the storage position, a preset image (such as a solid color image, an image containing positioning coordinates, etc.) can be displayed through the display panel. When the display panel displays the preset image, a second image acquired by the camera of the item placement area is obtained, and based on the difference between the second image and the preset image, the display position and display size of the displayed item label information are determined. This avoids the user from manually setting the display position and display size of the item label information, thereby improving the efficiency of displaying the item label information.

[0149] Step 204: Identify the area where the item tag information is located and determine the shielding status of the item tag information.

[0150] In the embodiment of the present application, in order to improve the efficiency of object detection, the area information corresponding to each object tag information can also be recorded, and the corresponding area in the first image can be identified based on the area information corresponding to each object tag information, so as to obtain the occlusion state corresponding to the object tag information. The above area information can represent the display area corresponding to the object tag information in the object storage area, and can also represent the imaging area of ​​the object tag information in the first image.

[0151] It should be noted that, when the area information is the above-mentioned display area, the above-mentioned display area can be transformed into the corresponding imaging area in the first image based on the intrinsic parameters and extrinsic parameters of the camera, and then the imaging area in the first image is identified to determine the occlusion state of the corresponding object label information.

[0152] Specifically, the integrity of the item label information in the imaging area can be checked. If complete item label information can be detected in the imaging area, the occlusion state of the item label information corresponding to the item in the imaging area is determined to be unoccluded. If incomplete item label information is detected in the imaging area or the item label information cannot be detected, the occlusion state of the item label information corresponding to the item in the imaging area is determined to be obstructed.

[0153] Step 205: When the item tag information is in a blocked state, determine that the tag identification information is blocked tag information.

[0154] In the embodiment of the present application, if an item in a storage location has not been borrowed, the item storage tag in the storage location is in a blocked state, and the tag identification information corresponding to the area where the item tag is located can be determined as blocked tag information. It can be further determined that the first borrowing state of the item stored in the storage location is a non-borrowed state.

[0155] For the label information of objects whose label information has been blocked, the recognition and extraction operations do not need to be performed, thereby saving computing resources and improving the efficiency of object detection.

[0156] Step 206: When the item tag information is in an unobstructed state, the item tag information is identified and the identification result is used as the tag identification information.

[0157] In the embodiment of the present application, for the item label information in an unobstructed state, the item label information can be identified from the first image, and the identification result is used as the label identification information. The identification result may include image feature information, text information, etc. obtained by identifying the item label information in the first image.

[0158] Furthermore, recognition may be performed on the image in the imaging area corresponding to the item label information, thereby improving the efficiency of recognizing the item label information from the first image.

[0159] Since the area occupied by the object label information in the first image is usually small, while the area of ​​the first image is usually large, the present application can determine the occlusion status of each object label information by detecting the area where the object label information is located, thereby reducing the amount of calculation for judging the occlusion status of the object label information, thereby improving the efficiency of object detection to a certain extent.

[0160] Step 207: When the tag identification information is the blocked tag information, determine that the first borrowing state of the item stored in the storage location is a non-borrowed state.

[0161] In an embodiment of the present application, the tag identification information corresponds to the storage location, that is, each storage location contains corresponding tag identification information. When the tag identification information corresponding to the storage location is the obscured tag information, it can be determined that the first borrowing status of the item stored in the storage location is the unborrowed status.

[0162] Step 208: When the tag identification information is the identification result, determine that the first borrowing status of the item stored in the storage location is a borrowed status.

[0163] In an embodiment of the present application, if the item label information corresponding to a storage location is in an unobstructed state, the item label information corresponding to the storage location will be identified, and the identification result will be used as the label identification information corresponding to the storage location.

[0164] For the label identification information whose label identification information is the identification result, the preset label information of the storage location of the label identification information can be identified to obtain the preset identification result, and then the identification result in the label identification information is matched with the preset identification result. If the matching result is consistent, it can be explained that the item label information corresponding to the storage location is identified from the first image and the identification result is correct, and it can be determined that the first borrowing status of the item stored in the storage location is the borrowed status.

[0165] In an embodiment of the present application, when the tag identification information is the obscured tag information, it can be determined that the first borrowing status of the item stored at the storage location is the unborrowed status; when the tag identification information is the recognition result, it can be determined that the first borrowing status of the item stored at the storage location is the borrowed status. Since the recognition result is extracted based on the item tag information, when the item tag information is correctly recognized, the recognition result is unique. Therefore, determining the first borrowing status of the item through the recognition result has high stability, and can reduce the impact of the shooting differences of the first image (such as shooting light differences, shooting resolution differences, etc.) on the item detection results to a certain extent, which helps to improve the accuracy of item detection.

[0166] Optionally, the items in the item storage unit may also be provided with corresponding radio frequency tags, and a radio frequency reader or an antenna connected to the radio frequency reader may also be provided in the item storage unit, so that the radio frequency information of the items can be read by collecting the radio frequency signal in the item storage unit, and the first borrowing status of the items stored in the storage location in the item storage unit can be determined based on the radio frequency information and the tag identification information.

[0167] Specifically, the tag identification borrowing status of the items in the item storage unit can be determined based on the tag identification information, and the RFID borrowing status of the items in the item storage unit can be determined based on the RFID information. Then, the tag identification borrowing status and the RFID borrowing status are mutually verified to obtain the first borrowing status of the items in the item storage unit.

[0168] Step 209, in response to a return operation on the storage device, determining the item integrity status of the item storage unit based on the preset item information of the item storage unit and the item information of the item; wherein the storage device includes at least one of the storage units.

[0169] In the embodiment of the present application, in response to the return operation on the storage device, the item information of the items currently stored in the item storage unit can be determined based on the first borrowing status of each item in the item storage unit that has been recently acquired, and the item completeness status of the item storage unit can be determined based on the matching result by matching the preset item information of the item storage unit with the item information of the items stored in the item storage unit. If the matching result is consistent, the item completeness status of the item storage unit can be determined to be complete, and if the matching result is inconsistent, the item completeness status of the item storage unit can be determined to be incomplete.

[0170] Furthermore, since the items stored in the storage device may differ from the preset item information when the storage device is lent, a first image of the item placement area may be captured by a camera when the storage device is lent, and the initial borrowing status of the items stored in the storage locations corresponding to the preset tag information may be determined based on the first image. According to the initial borrowing status corresponding to the items in the above-mentioned storage locations, the initial item information of the item storage unit may be determined, and the initial item information of the item storage unit may be matched with the item information of the items stored in the item storage unit, and the item integrity status of the item storage unit may be determined according to the matching result. If the matching result is consistent, it may be determined that the item integrity status of the item storage unit is complete, and if the matching result is inconsistent, it may be determined that the item integrity status of the item storage unit is incomplete. It should be noted that the initial item storage list corresponding to the above-mentioned item storage unit may also be obtained when the item storage unit is locked last time.

[0171] Step 210: When the item integrity status of the item storage unit of the storage device is intact, the second borrowing status of the storage device is adjusted to prohibiting borrowing.

[0172] When the item integrity status of the item storage unit of the storage device is intact, the operation of returning the storage device can be performed, and the second borrowing status of the storage device can be adjusted to prohibit borrowing. When the item integrity status of the item storage unit of the storage device is intact, the operation of returning the storage device can be performed, and the second borrowing status of the storage device can be adjusted to prohibit borrowing.

[0173] In summary, the article detection method provided by the embodiment of the present application obtains the first image of the article placement area of ​​the article storage unit; the article placement area has at least two storage positions, and different storage positions display corresponding article label information; according to the first image, the label identification information corresponding to the area where the article label information is located is obtained; according to the label identification information, the first borrowing status of the article stored in the storage position is determined. The image of the article placement area in the article storage unit can be detected, and the label identification information identifying the article information can be extracted from it, and the storage status of the article in the article storage unit can be determined by the label identification information. Using the article detection method provided by the embodiment of the present application, the object body to be stored can be detected without adding any additional electronic tags, and there is no need to consider the compatibility of the object body and the electronic tag. It can be applicable to the detection needs of more types of articles, and can be well adapted to articles of various shapes and sizes, which helps to improve the accuracy of detecting articles in the article storage unit. In addition, since the detection and recognition process of the label is relatively efficient and has a high accuracy rate, by detecting the object storage label instead of the object body, it has a high recognition rate and recognition speed, which also helps to improve the efficiency and accuracy of article detection to a certain extent.

[0174] In the embodiments of the present application, since all walks of life usually have the need for accurate management of items, for example, for the aviation industry, it is necessary to accurately manage aviation maintenance-related tools / materials; for the CNC field, it is necessary to accurately manage CNC machine tool-related parts / tools. If accurate management of items can be achieved, the efficiency of product maintenance / product updates can be ensured. In order to meet the demand for accurate management of items, the present application designs a storage device for storing items.

[0175] Reference Figure 1 , shows a storage device provided by an embodiment of the present application, such as Figure 1 As shown, the storage device includes a control unit 11, at least one item storage unit 12, and a camera corresponding to the item storage unit 12. The item storage unit 12 can have different sizes. For example, 5 item storage units with lower heights and 3 item storage units with higher heights can be set in the storage device to meet the storage needs of items of various sizes. The item storage unit 12 is used to store items, wherein the items may include tools (such as wrenches, screwdrivers, etc.), parts (such as screws, nuts, etc.), etc. The embodiment of the present application does not specifically limit the types of items. The camera is used to capture a first image of the item placement area of ​​the item storage unit.

[0176] The control unit can obtain a first image of an item placement area of ​​the item storage unit; the item placement area has at least two storage locations, and different storage locations display corresponding item label information; based on the first image, obtain label identification information corresponding to the area where the item label information is located; based on the label identification information, determine a first borrowing status of the item stored in the storage location.

[0177] Furthermore, since the height of the item storage unit may be relatively low, in order to enable the first image to include the complete item placement area, multiple corresponding cameras may be set for one item storage unit, and different parts of the item placement area may be photographed by multiple cameras, and the images photographed by the multiple cameras may be spliced ​​to obtain the first image including the complete item placement area. In addition, the camera may also use a wide-angle or ultra-wide-angle lens so that the camera's field of view covers a larger area of ​​the item placement area, thereby improving the accuracy of item detection through the storage device.

[0178] It should be noted that various types of item storage units can be set in the storage device, which may include a visual detection storage unit that is equipped with a camera and performs item detection through a first image taken by the camera; it may include a radio frequency detection storage unit that is equipped with a radio frequency reader or an antenna connected to the radio frequency reader and performs item detection based on a radio frequency tag; it may also include a hybrid detection storage unit that is equipped with a camera and a radio frequency reader or an antenna connected to the radio frequency reader.

[0179] In the case where the storage device includes a radio frequency detection storage unit and / or a hybrid detection storage unit for performing object detection based on radio frequency tags, the storage device may also be provided with a radio frequency reader / writer, which is connected to the antennas corresponding to each radio frequency detection storage unit and / or hybrid detection storage unit and reads the radio frequency signal in the object detection unit through the antenna.

[0180] like Figure 2 As shown, the item storage unit 12 may include a bottom plate 21. An item limiting layer 24 is provided near the first surface (top) of the bottom plate 21, and a storage position 25 is provided at the edge area of ​​the item limiting layer 24. The shape of the storage position 25 may match the shape of the item corresponding to the storage position, and the edge area is the area of ​​the exposed part of the item limiting layer close to the bottom plate 21. The bottom plate 21 may be a display panel (such as an ink screen, an electronic screen) with an active information display function, or may be a hard plate (such as a metal plate, a wooden board, a plastic board, etc.) without an active information display function. The material of the item limiting layer 24 may include but is not limited to sponge, foam, silicone, plastic, wood, metal, etc., and the embodiment of the present application does not make specific restrictions. The item limiting layer 24 is provided with a storage position 25 that passes through the upper and lower surfaces of the item limiting layer, and the item limiting layer 24 and the storage position 25 therein may be produced by additive processing (such as 3D printing) or subtractive processing (such as cutting, etching).

[0181] Alternatively, if Figure 2 As shown, a fill light 26 may also be provided in the item storage unit 12, and the fill light 26 may include but is not limited to an incandescent lamp, a fluorescent lamp, a light-emitting diode (LED), etc., and the present embodiment of the application does not limit this. The fill light 26 in the item storage unit 12 may be controlled in conjunction with the camera 22 in the item storage unit 12. When taking a picture through the camera 22, the fill light 26 corresponding to the camera 22 is turned on for fill light, so as to obtain a first image with sufficient illumination, which helps to improve the accuracy of item detection based on the first image.

[0182] Reference Fig. 9 , Fig. 9 A schematic structural diagram of an article placement area provided in an embodiment of the present application is shown. The article placement area may be composed of a bottom plate 21 , a protective layer 28 , a support layer 29 and an article limiting layer 24 .

[0183] Alternatively, if Fig. 9As shown, in the case where the bottom plate 21 is a display panel, a support layer 29 may be further provided on the second side (bottom) of the display panel to support and install the bottom plate 21 through the support layer 29, so as to avoid damage to the display panel under the gravity of the object and improve the durability of the display panel. The object limiting layer 24 may be adjacent to the display panel, and the height of the object limiting layer 24 may be greater than the height of the display panel, so as to machine a storage slot in the object limiting layer. It should be noted that the size and shape of the storage position 25 set in the object limiting layer 24 may be different.

[0184] Alternatively, if Fig. 9 As shown, a transparent protective layer 28 may be provided on the first surface of the bottom plate 21 to protect the bottom plate 21 and / or the item label information 23 from damage from the items placed thereon, and to improve the durability of the bottom plate 21 and / or the item label information 23. The protective layer 28 may be provided between the bottom plate 21 and the item limiting layer 24. The material of the protective layer 28 may include, but is not limited to, glass, transparent plastic, transparent rubber, and the like.

[0185] Optionally, the protective layer 28 may cover the entire first surface of the base plate 21, or may only cover the non-contact area on the first surface of the base plate 21 with the object limiting layer 24; when the base plate 21 is a display panel, the protective layer 28 may cover the entire display area of ​​the display panel, or may only cover the non-contact area in the display area of ​​the display panel with the object limiting layer 24, thereby saving the cost of laying the protective layer 28.

[0186] Reference Fig.10 , Fig.10 A side cross-sectional schematic diagram of a storage device provided in an embodiment of the present application is shown. Fig.10 The storage device is shown to include two stacked item storage units, including an upper item storage unit 91 and a lower item storage unit 92.

[0187] Alternatively, if Fig.10 As shown, when there are at least two item storage units and they are stacked, the camera is arranged at the bottom of the item storage unit, wherein the camera may not be arranged at the bottom of the storage unit close to the ground. Multiple item storage units in the storage device may be stacked, so that when the lower item storage unit 92 is in a closed state, the bottom 93 of the upper item storage unit 91 may cover the lower item storage unit 92, and the bottom 93 of the upper item storage unit 91 may serve as the top of the lower item storage unit 92. Therefore, the camera 94 corresponding to the lower item storage unit 92 may be arranged on the side of the bottom 93 of the upper item storage unit 91 facing the lower item storage unit 92, thereby saving the cost of camera deployment.

[0188] Optionally, the storage device may further include a pressure sensor corresponding to each item storage unit, and the closed state of the item storage unit may be detected by the pressure sensor, and the automatic locking function may be realized when the user closes the item storage unit. The storage device may further include a power supply module, which may be a power conversion module or a power supply module including a storage function, so as to meet the needs of mobile use of the storage device.

[0189] Reference Fig.11 , Fig.11 FIG. 4 shows a device connection diagram of a storage device provided in an embodiment of the present application. Fig.11 As shown, the operation screen, card reader, fingerprint collector, electronic lock, pressure sensor, camera, radio frequency reader and power module are all connected to the control unit, the antenna is connected to the radio frequency reader, and the power module can also be connected to the radio frequency reader.

[0190] Reference Fig.12 , shows a schematic diagram of the structure of an object detection device of the present application, the device comprising:

[0191] An image acquisition module 301 is used to acquire a first image of an item placement area of ​​an item storage unit; the item placement area has at least two storage locations, and different storage locations display corresponding item label information;

[0192] An information acquisition module 302 is used to acquire label identification information corresponding to the area where the item label information is located according to the first image;

[0193] The first status module 303 is used to determine the first borrowing status of the item stored in the storage location according to the tag identification information.

[0194] Optionally, the information acquisition module includes:

[0195] The occlusion state submodule is used to identify the area where the item tag information is located and determine the occlusion state of the item tag information;

[0196] A blocked state submodule, used for determining that the tag identification information is blocked tag information when the item tag information is in a blocked state;

[0197] The unobstructed state submodule is used to identify the item tag information when the item tag information is in an unobstructed state and use the identification result as the tag identification information.

[0198] Optionally, according to the first state module includes:

[0199] A non-borrowed state submodule, configured to determine that the first borrowed state of the item stored in the storage location is a non-borrowed state when the tag identification information is the blocked tag information;

[0200] The borrowed status submodule is used to determine that the first borrowing status of the item stored in the storage location is the borrowed status when the tag identification information is the identification result.

[0201] Optionally, the device further comprises:

[0202] A status information acquisition module, used to acquire the usage status information of the storage location;

[0203] A first state information determination module, configured to, when the use state information is in use, execute the step of acquiring the label identification information corresponding to the area where the item label information is located according to the first image;

[0204] The second status information determination module is used to stop identifying the item tag information corresponding to the storage location when the usage status information is vacant.

[0205] Optionally, the device further comprises:

[0206] An operation receiving module, used for receiving a setting operation for the storage location;

[0207] An operation response module is used to set the associated information of the storage location in response to the setting operation, wherein the associated information includes the use status information.

[0208] Optionally, the item placement area is provided with a display panel, and the item label information is displayed on the display panel; the device further comprises:

[0209] A first display module, configured to display the item label information in an area corresponding to the storage position on the display panel when the use status information is in use;

[0210] The second display module displays the stop use information or does not display the item label information in the area corresponding to the storage position in the display panel when the use status information is vacant.

[0211] Optionally, the device further comprises:

[0212] A locking state module, used to detect the locking state of the item storage unit; wherein the locking state includes unlocked and locked;

[0213] The locking state determination module is used to execute the step of acquiring a first image of the article placement area of ​​the article storage unit after the locking state changes from the unlocked state to the locked state.

[0214] Optionally, the device further comprises:

[0215] An identity information module, used for receiving identity information;

[0216] An identity verification module, used to verify the identity information;

[0217] The unlocking module is used to unlock the electronic lock of the item storage unit according to the borrowing record of the identity identification information when the identity identification information is verified.

[0218] Optionally, the device further comprises:

[0219] A first comparison module, configured to compare the item label information corresponding to any item with the item label information recorded in the borrowing record when the first borrowing status corresponding to any item is the borrowed status;

[0220] a record adding module, configured to confirm that the item is borrowed and add the item label information corresponding to the item to the borrowing record if the item label information does not exist in the borrowing record;

[0221] A second comparison module is used to compare the item label information corresponding to any item with the item label information recorded in the borrowing record when the first borrowing status corresponding to any item is not borrowed;

[0222] The return record module is used to confirm that the item is returned and record the return information when the item label information exists in the borrowing record.

[0223] Optionally, the device further comprises:

[0224] A second state module, used to obtain a second borrowing state of a storage device; wherein the storage device includes at least one of the storage units;

[0225] A borrowing status determination module, configured to execute a step of verifying the identity information when the second borrowing status is that borrowing is allowed;

[0226] The borrowing stopping module is used to stop borrowing when the second borrowing state is borrowing prohibited.

[0227] Optionally, the device further comprises:

[0228] a complete status module, configured to determine the complete status of the item in the item storage unit in response to a return operation on the storage device, based on the preset item information of the item storage unit and the item information of the item; wherein the storage device includes at least one of the storage units;

[0229] The second status adjustment module is used to adjust the second borrowing status of the storage device to borrowing prohibited when the item integrity status of the item storage unit of the storage device is intact.

[0230] In the embodiment of the present application, the above-mentioned article detection device can detect the image of the article placement area in the article storage unit, extract the label identification information that identifies the article information, and determine the storage status of the article in the article storage unit by the label identification information. By adopting the article detection method provided in the embodiment of the present application, no additional electronic tags can be added to the object body to be stored, and there is no need to consider the compatibility between the object body and the electronic tag. It can be applicable to the detection needs of a richer type of objects, and can be well adapted to objects of various shapes and sizes, which helps to improve the accuracy of detecting objects in the article storage unit. In addition, since the detection and identification process of the label is relatively efficient and has a high accuracy rate, by detecting the object storage label instead of the object body, it has a high recognition rate and recognition speed, which also helps to improve the efficiency and accuracy of object detection to a certain extent. .

[0231] As for the system embodiment and the device embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0232] Fig.13 is a schematic diagram of the structure of a device provided in an embodiment of the present application. Fig.13 , the electronic device 900 can be used to implement the object detection method provided in the above embodiment. The electronic device 900 may have relatively large differences due to different configurations or performances, and may include one or more processors (central processing units, CPU) 922 (for example, one or more processors) and memory 932, one or more storage media 930 (for example, one or more mass storage devices) storing application programs 942 or data 944. Among them, the memory 932 and the storage medium 930 can be temporarily stored or permanently stored. The program stored in the storage medium 930 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the processor 922 can be configured to communicate with the storage medium 930 to execute a series of instruction operations in the storage medium 930 on the electronic device 900.

[0233] The electronic device 900 may further include one or more power supplies 923, one or more wired or wireless network interfaces 950, one or more input / output interfaces 958, one or more keyboards 956, and / or one or more operating systems 941. The processor 922 may perform any operation in the above-mentioned object detection method on the electronic device 900.

[0234] The present application provides an electronic device, a processor and a memory; an executable code is stored on the processor, and when the executable code is executed, the processor executes the above method.

[0235] The present application also provides one or more machine-readable media on which executable codes can be stored. When executed by one or more processors, the processors can perform the above-mentioned method.

[0236] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0237] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, devices, or computer program products. Therefore, the present application may be provided in the form of a complete hardware embodiment, a complete software embodiment, or a combination of software and hardware embodiments. Moreover, the present application may be provided in the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM (Compact Disc Read Only Memory, read-only optical disk), optical storage, etc.) containing computer-usable program codes.

[0238] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0239] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0240] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0241] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0242] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0243] The method and device provided by the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. For general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for detecting an object, characterized in that: include: Acquire a first image of an item placement area of ​​an item storage unit; the item placement area has at least two storage locations, and different storage locations display corresponding item label information; According to the first image, obtaining label identification information corresponding to the area where the item label information is located; A first borrowing status of the item stored at the storage location is determined according to the tag identification information.

2. The method according to claim 1, characterized in that The acquiring, according to the first image, label identification information corresponding to the area where the item label information is located includes: Identify the area where the item tag information is located, and determine the shielding status of the item tag information; In the case where the item tag information is in a blocked state, determining that the tag identification information is blocked tag information; When the item tag information is in an unobstructed state, identifying the item tag information and using the identification result as the tag identification information; Determining the first borrowing status of the item stored in the storage location according to the tag identification information includes: In a case where the tag identification information is the blocked tag information, determining that the first borrowing state of the item stored in the storage location is a non-borrowed state; When the tag identification information is the identification result, it is determined that the first borrowing state of the item stored in the storage location is a borrowed state.

3. The method according to claim 1, characterized in that The method further comprises: Acquire usage status information of the storage location; When the usage status information is in use, performing a step of acquiring label identification information corresponding to the area where the item label information is located according to the first image; When the usage status information is vacant, the identification of the item tag information corresponding to the storage location is stopped.

4. The method according to claim 3, characterized in that The item placement area is provided with a display panel, and the item label information is displayed on the display panel; the method further includes: When the use status information is in use, displaying the item label information in an area corresponding to the storage position on the display panel; When the use status information is "vacant", a stop use information is displayed in an area corresponding to the storage position on the display panel or the item label information is not displayed.

5. The method according to claim 1, characterized in that The method further comprises: Detecting the locking state of the item storage unit; wherein the locking state includes unlocked and locked; After the locking state changes from the unlocked state to the locked state, identity identification information is received and verified. If the identity identification information is verified, the electronic lock of the item storage unit is unlocked according to the borrowing record of the identity identification information, and the step of acquiring a first image of the item placement area of ​​the item storage unit is performed.

6. The method according to claim 5, characterized in that The method further comprises: When the first borrowing status corresponding to any item is the borrowed status, comparing the item tag information corresponding to the item with the item tag information recorded in the borrowing record; If the item label information does not exist in the borrowing record, confirm that the item is borrowed and add the item label information corresponding to the item to the borrowing record; When the first borrowing status corresponding to any item is not borrowed, comparing the item tag information corresponding to the item with the item tag information recorded in the borrowing record; In the case where the item tag information exists in the borrowing record, it is confirmed that the item is returned and the return information is recorded.

7. A storage device, characterized in that: include: A control unit, at least one object storage unit, and a camera corresponding to the object storage unit; The camera is used to collect a first image of an item placement area of ​​the item storage unit; The control unit is used to execute the method according to any one of claims 1 to 6.

8. An object detection device, characterized in that: include: An image acquisition module, used to acquire a first image of an item placement area of ​​an item storage unit; the item placement area has at least two storage locations, and different storage locations display corresponding item label information; An information acquisition module, used to acquire label identification information corresponding to the area where the item label information is located according to the first image; The first status module is used to determine a first borrowing status of the item stored in the storage location according to the tag identification information.

9. An electronic device, characterized in that: include: Processor and memory; An executable code is stored on the processor, and when the executable code is executed, the processor executes the method according to any one of claims 1 to 6.

10. One or more machine-readable media, characterized in that An executable code is stored thereon, and when the executable code is executed, the processor is caused to execute the method according to any one of claims 1 to 6.

Images