Warehouse management method, system, device, server, terminal and storage medium

Abstract

Embodiments of the present application disclose a warehouse management method, system, device, server, terminal and storage medium. The method applied to the server can include: receiving current multimedia data of an article to be managed by the warehouse sent by a client, and obtaining first article information by recognizing the current multimedia data; querying second article information based on the first article information, and returning the second article information to the client to display the second article information through the client; receiving a verification result sent by the client, and managing the article based on the verification result, wherein the verification result is a result input into the client to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second article information and the article. The technical scheme of the embodiments of the present application can realize the automatic warehouse management process of the article without pasting a bar code on the article.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of warehousing and logistics technology, and in particular to a warehousing management method, system, device, server, terminal and storage medium. Background Technology

[0002] Currently, warehouse management systems (WMS) primarily rely on barcodes affixed to items for warehouse storage management.

[0003] However, in practical applications, some items are simply packaged and do not have barcodes affixed to them. For these barcode-free items, the following two solutions are currently mainly used for warehouse management: one is to affix barcodes to the items, thereby enabling warehouse management based on the barcodes; the other is to implement warehouse management manually.

[0004] In the process of realizing this invention, the inventors discovered the following technical problems in the prior art: the cost of consumables is too high and the accuracy and efficiency of warehouse management are difficult to guarantee. Summary of the Invention

[0005] This invention provides a warehouse management method, system, device, server, terminal, and storage medium to achieve automated warehouse management of goods without the need to affix barcodes to the goods.

[0006] According to one aspect of the present invention, a warehouse management method is provided, applied to a server, and may include:

[0007] Receive current multimedia data of items to be managed in the warehouse sent by the client, and obtain the first item information by identifying the current multimedia data;

[0008] The second item information is retrieved based on the first item information and returned to the client so that the second item information can be displayed on the client.

[0009] The system receives the verification result sent by the client and performs warehouse management on the items based on the verification result. The verification result is input into the client to indicate the accuracy of the current multimedia data recognition. The accuracy is determined by the matching between the second item information and the item.

[0010] According to another aspect of the present invention, a warehouse management method is provided, applied to a client, and may include:

[0011] Obtain the current multimedia data of the items to be stored and manage, and send the current multimedia data to the server so that the server can obtain the first item information by recognizing the current multimedia data, and return the second item information queried based on the first item information;

[0012] Receive information about the second item and display that information.

[0013] The system receives the verification result for the displayed second item information and sends the verification result to the server so that the server can perform warehouse management of the item based on the verification result. The verification result is used to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item.

[0014] According to another aspect of the present invention, a warehouse management system is provided, which may include: a client and a server; wherein,

[0015] The client is used to obtain the current multimedia data of the items to be managed in the warehouse and send the current multimedia data to the server.

[0016] The server is used to obtain the first item information by recognizing the received current multimedia data, and return the second item information queried based on the first item information to the client;

[0017] The client is also used to display the received second item information, receive the verification result input for the displayed second item information, and send the verification result to the server. The verification result is used to indicate the accuracy of the current multimedia data recognition. The accuracy is determined by the matching between the second item information and the item.

[0018] The server-side component is also used for warehouse management of items based on the received verification results.

[0019] According to another aspect of the present invention, a warehouse management device is provided, configured on a server, and may include:

[0020] The first item information acquisition module is used to receive the current multimedia data of the items to be managed in the warehouse sent by the client, and to obtain the first item information by recognizing the current multimedia data;

[0021] The second item information return module is used to query the second item information based on the first item information and return the second item information to the client so that the client can display the second item information.

[0022] The warehouse management module is used to receive the verification results sent by the client and perform warehouse management on the items based on the verification results. The verification results are input into the client to indicate the accuracy of the current multimedia data recognition. The accuracy is determined by the matching between the second item information and the item.

[0023] According to another aspect of the present invention, a warehouse management device is provided, configured on a client side, and may include:

[0024] The current multimedia data sending module is used to acquire the current multimedia data of the items to be stored and managed in the warehouse, and send the current multimedia data to the server so that the server can obtain the first item information by recognizing the current multimedia data, and return the second item information queried based on the first item information;

[0025] The second item information display module is used to receive and display the second item information.

[0026] The verification result sending module is used to receive the verification result input for the displayed second item information and send the verification result to the server so that the server can perform warehouse management of the item based on the verification result. The verification result is used to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item.

[0027] According to another aspect of the present invention, a server is provided, which may include:

[0028] At least one processor; and

[0029] A memory that is communicatively connected to at least one processor; wherein,

[0030] The memory stores a computer program that can be executed by at least one processor, such that when the at least one processor executes the program, it implements the warehouse management method provided in any embodiment of the present invention.

[0031] According to another aspect of the present invention, a terminal is provided, which may include:

[0032] At least one processor; and

[0033] A memory that is communicatively connected to at least one processor; wherein,

[0034] The memory stores a computer program that can be executed by at least one processor, such that when the at least one processor executes the program, it implements the warehouse management method provided in any embodiment of the present invention.

[0035] According to another aspect of the present invention, a computer-readable storage medium is provided having computer instructions stored thereon for causing a processor to execute and implement the warehouse management method provided in any embodiment of the present invention.

[0036] The technical solution of this invention involves the server receiving current multimedia data of items to be managed in the warehouse from the client, and identifying the current multimedia data to obtain first item information. Whether the first item information is indeed the item information, or whether the current multimedia data has been correctly identified, needs to be verified. The server then queries for second item information that matches the first item information and returns the second item information to the client. This allows relevant personnel to verify whether the current multimedia data has been correctly identified by determining whether the displayed second item information matches the item, and the verification result is input into the client. The server receives the verification result from the client and can then perform warehouse management based on the verification result. This technical solution automates the warehouse management process without requiring barcodes to be affixed to the items, thereby reducing consumable costs and ensuring the accuracy and efficiency of warehouse management.

[0037] It should be understood that the description in this section is not intended to identify key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0038] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0039] Figure 1 This is a flowchart of a warehouse management method provided according to an embodiment of the present invention;

[0040] Figure 2 This is a flowchart of another warehouse management method provided according to an embodiment of the present invention;

[0041] Figure 3 This is a timing diagram of an optional example of another warehouse management method provided according to an embodiment of the present invention;

[0042] Figure 4 This is a flowchart of another warehouse management method provided by an embodiment of the present invention;

[0043] Figure 5This is a structural block diagram of a warehouse management system provided according to an embodiment of the present invention;

[0044] Figure 6 This is a timing diagram of an optional example in a warehouse management system provided according to an embodiment of the present invention;

[0045] Figure 7 This is an interactive diagram of an optional example in a warehouse management system provided according to an embodiment of the present invention;

[0046] Figure 8 This is a structural block diagram of a warehouse management device provided according to an embodiment of the present invention;

[0047] Figure 9 This is a structural block diagram of another warehouse management device provided according to an embodiment of the present invention;

[0048] Figure 10 This is a schematic diagram of the structure of a server or terminal that implements the warehouse management method of this invention. Detailed Implementation

[0049] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0050] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. The same applies to "target," "original," etc., and will not be repeated here. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0051] Figure 1This is a flowchart of a warehouse management method provided in an embodiment of the present invention. This embodiment is applicable to situations where automated warehouse management of goods is achieved without the need to affix barcodes to the goods. The method can be executed by the warehouse management device provided in this embodiment of the present invention, which can be implemented in software and / or hardware and can be integrated into a server.

[0052] See Figure 1 The method of this invention specifically includes the following steps:

[0053] S110: Receive the current multimedia data of the items to be managed in the warehouse sent by the client, and obtain the first item information by identifying the current multimedia data.

[0054] Specifically, for items to be managed in the warehouse, the current multimedia data can be multimedia data collected from the item to achieve automated warehouse management. In practical applications, the current multimedia data can optionally be directly captured video, images obtained by segmenting directly captured video into frames, or directly captured images, etc., without specific limitations.

[0055] The client sends the acquired current multimedia data to the server. Upon receiving the current multimedia data, the server can identify it to obtain the first item information. In practical applications, the first item information can optionally be at least one of the following: item name, item number, item style, and item color; of course, it can also be other item information, depending on the specific application scenario, and no specific limitation is made here. It should be noted that whether the first item information is indeed the item information of the item to be managed in the warehouse cannot be guaranteed, because the first item information is only considered the item information if the current multimedia data is correctly identified.

[0056] S120. Query the information of the second item based on the information of the first item, and return the information of the second item to the client so that the client can display the information of the second item.

[0057] After obtaining the first item information, the server can query the second item information that matches it. In practical applications, the second item information can optionally be completely different from the first item information, partially the same, or have an inclusion relationship. For example, if the first item information is the item name, the second item information can be the item name, item number, and historical multimedia data obtained after collecting data from the first sample corresponding to the first item information. In this case, the two item information have an inclusion relationship.

[0058] It should be noted that, as mentioned above, since it cannot be guaranteed whether the first item information is indeed the item information of the aforementioned item, it is also impossible to guarantee whether the second item information retrieved based on the first item information is indeed the item information of the aforementioned item. Therefore, in order to determine the matching between these two item information and the item, that is, to determine the accuracy of the current multimedia data recognition, the second item information can be sent to the client and displayed through the client. This allows relevant personnel to verify whether the displayed second item information matches the item, thereby determining the accuracy of the current multimedia data recognition.

[0059] Based on this, it should be emphasized that, in light of the application scenarios that may be involved in the embodiments of the present invention, the above-mentioned items themselves or their packaging may not have any identification information for identifying the items. Therefore, it is impossible to automatically verify the accuracy of the current multimedia data identification by automatically identifying the identification information. This is precisely why manual verification is performed by relevant personnel rather than automatic verification.

[0060] S130. Receive the verification result sent by the client, and perform warehouse management on the items based on the verification result. The verification result is input into the client to indicate the accuracy of the current multimedia data recognition. The accuracy is determined by the matching between the second item information and the item.

[0061] The verification result can be the result entered into the client by relevant personnel after determining whether the current multimedia data has been correctly identified. For example, if the displayed second item information matches the item, and the relevant personnel determine that the current multimedia data has been correctly identified, the verification result can be "correct identification"; otherwise, if the relevant personnel determine that the current multimedia data has not been correctly identified, the verification result can be "incorrect identification". In practical applications, the verification result can optionally be entered into the client in various ways. For example, relevant personnel can enter the corresponding verification result into the client by triggering the correct or incorrect identification control displayed on the client; or by entering the verification result into the verification result input control displayed on the client; and so on.

[0062] After receiving the verification result from the client, the server can determine the accuracy of the current multimedia data recognition, that is, whether the information of the first and second items matches the aforementioned items. Therefore, the server can implement item storage management based on the verification result. The specific storage management method can be inbound management, in-stock management, or outbound management, etc., depending on the actual situation, and no specific limitation is made here.

[0063] In practical applications, the process of managing goods in the warehouse based on verification results can be implemented in various ways. For example, if the verification result determines that the second item information matches the item, the warehouse management is performed based on the second item information. As another example, if the verification result determines that the second item information does not match the item, third item information sent by the client can be received, and the warehouse management is performed based on this third item information. This third item information includes the item information entered into the client for the item. In other words, since the second item information is not the item information for the item to be managed in the warehouse, it means that the warehouse management process for this item cannot be implemented based on it. Therefore, relevant personnel can manually enter the third item information for the item through the client, and then the server, after receiving the third item information sent by the client, can perform warehouse management based on this third item. Of course, this warehouse management process can also be implemented using other methods, which are not specifically limited here.

[0064] The technical solution of this invention involves the server receiving current multimedia data of items to be managed in the warehouse from the client, and identifying the current multimedia data to obtain first item information. Whether the first item information is indeed the item information, or whether the current multimedia data has been correctly identified, needs to be verified. The server then queries for second item information that matches the first item information and returns the second item information to the client. This allows relevant personnel to verify whether the current multimedia data has been correctly identified by determining whether the displayed second item information matches the item, and the verification result is input into the client. The server receives the verification result from the client and can then perform warehouse management based on the verification result. This technical solution automates the warehouse management process without requiring barcodes to be affixed to the items, thereby reducing consumable costs and ensuring the accuracy and efficiency of warehouse management.

[0065] Another optional technical solution, retrieving second item information based on first item information, may include: retrieving a first storage address based on the first item information, wherein the first storage area represented by the first storage address stores historical multimedia data, which is obtained by pre-collecting a first sample corresponding to the first item information; retrieving the historical multimedia data from the first storage area based on the first storage address, and using the historical multimedia data as the second item information. The first item information may be the item information of the first sample. If the current multimedia data is correctly identified, the first sample and the item are completely identical, such as two identical pieces of clothing; conversely, if the current multimedia data is incorrectly identified, the first sample and the item are not completely identical, such as two pieces of clothing with similar styles. It should be noted that, to achieve automated warehousing management of the item corresponding to the first sample, historical multimedia data can be pre-collected from the first sample before warehousing management. The data type of this historical multimedia data may be the same as or different from the current multimedia data, such as both being videos or images, or one being a video and the other an image. The historical multimedia data is stored in a first storage area, and the first storage address of this first storage area can be retrieved based on the first item information. Therefore, after obtaining the first item information, the corresponding first storage address can be queried, and then the historical multimedia data can be obtained from the first storage area represented by the first storage address and used as the second item information, thereby achieving the effect of effectively querying the second item information.

[0066] Figure 2 This is a flowchart of another warehouse management method provided in this embodiment of the invention. This embodiment is based on and optimized from the above-described technical solutions. In this embodiment, optionally, obtaining the first item information by recognizing the current multimedia data may include: inputting the current multimedia data into a trained data recognition model, and obtaining the first item information based on the output of the data recognition model. The explanations of terms that are the same as or corresponding to those in the above embodiments will not be repeated here.

[0067] See Figure 2 The method in this embodiment may specifically include the following steps:

[0068] S210: Receive the current multimedia data of the items to be managed in the warehouse sent by the client.

[0069] S220. Input the current multimedia data into the trained data recognition model, and obtain the first item information based on the output of the data recognition model.

[0070] The data recognition model can be a pre-trained model used to identify the current multimedia data to obtain the information of the first item. Since the recognition process can be understood as a classification or detection process—that is, determining the first item information that matches the current multimedia data from multiple first item information sources—this data recognition model can be trained based on a model capable of classification or detection, such as a deep learning model built on the YOLO algorithm, a Region Convolutional Neural Network (R-CNN) model, or a Support Vector Machine (SVM), etc., without specific limitations. It should be noted that the data recognition model built on the YOLO algorithm has a high data recognition speed and is very suitable for applications requiring real-time data recognition. The current multimedia data is input into the data recognition model, and the first item information is obtained based on the output of the data recognition model. In practical applications, optionally, when the current multimedia data is video, it can first be divided into frames to obtain at least one frame of image, and then these images can be input into the data recognition model for recognition; alternatively, it can be directly input into the data recognition model, and the frame division network in the data recognition model can divide it into frames, and then the recognition network in the data recognition model can recognize the at least one frame of image obtained by frame division; and so on, without specific limitations.

[0071] S230. Based on the first item information, query the second item information and return the second item information to the client so that the client can display the second item information.

[0072] S240. Receive the verification result sent by the client, and perform warehouse management on the items based on the verification result. The verification result is input into the client to indicate the accuracy of the current multimedia data recognition. The accuracy is determined by the matching between the second item information and the item.

[0073] The technical solution of this invention involves inputting current multimedia data into a data recognition model, and then obtaining the first item information based on the output of the data recognition model, thereby achieving the effective recognition effect of the data recognition model.

[0074] An optional technical solution involves pre-training a data recognition model through the following steps: acquiring sample multimedia data and labeled item information of a second sample corresponding to the item, wherein the labeled item information is of the same type as the first item information, and the sample multimedia data is of the same type as the current multimedia data; using the sample multimedia data and labeled item information as first training samples, and training the original recognition model based on the first training samples to obtain the data recognition model. The second sample is identical to the item and can be understood as the sample needed to train a data recognition model capable of recognizing the current multimedia data of the item. The sample multimedia data can be understood as the multimedia data obtained after collecting the second sample, which is of the same type as the current multimedia data, such as both being images or videos. The labeled item information can be manually labeled item information of the same type as the first item information, for example, if the first item information is an item name, the labeled item information is also an item name. Based on this, the sample multimedia data and labeled item information are used as the first training samples, and the original recognition model is trained based on the first training samples to obtain a data recognition model capable of data recognition. Currently, the same approach can be used to train the model for other items, thereby obtaining a data recognition model capable of identifying various items in the current multimedia data. It should be noted that since the first item information is not necessarily the item information for the item to be stored, the first sample corresponding to the first item information and the second sample corresponding to that item may be completely identical or quite similar. This depends on the actual situation and is not specifically limited here.

[0075] Optionally, the data recognition model can be retrained using the following steps: If the verification results indicate an error in the current multimedia data recognition, the current multimedia data and the labeled item information are used as second training samples; the data recognition model is then retrained based on the second training samples, and updated according to the retraining results. Specifically, if the verification results indicate an error in the current multimedia data recognition, this means the accuracy of the data recognition model for that multimedia data needs improvement, or that it cannot accurately obtain the first item information corresponding to that multimedia data. Therefore, the current multimedia data and the labeled item information can be used as second training samples, and the data recognition model can be retrained based on these second training samples to improve the accuracy of the data recognition model in recognizing the current multimedia data corresponding to that item.

[0076] Alternatively, the above-mentioned warehouse management method may further include: storing the sample multimedia data corresponding to the labeled item information in a second storage area, and recording the second storage address of the second storage area. In this way, after obtaining the first item information based on the data recognition model, for the labeled item information matching the first item information among the labeled item information of different second samples involved in the model training process, the second storage address corresponding to the labeled item information can be used as a medium to obtain the sample multimedia data from the corresponding second storage area. This sample multimedia data is the historical multimedia data mentioned above, i.e., the multimedia data pre-collected from the first sample corresponding to the first item information. It should be noted that, as mentioned above, since the first sample and the second sample may be the same or different samples, the second storage area here may also be the same or different storage area from the first storage area mentioned above. Under the condition that the current multimedia data is correctly identified, the first sample and the second sample are the same sample, and the first storage area and the second storage area are the same storage area.

[0077] To better understand the various technical solutions involved in model training, specific examples are provided below for illustration. See also Figure 3 Relevant personnel obtain in advance a second sample or a sample image of the uncoded product to be initially stored (i.e., the example of sample multimedia data mentioned above). If a second sample is obtained, a high-definition camera is used to record video of it from all angles. The recorded video is then segmented into frames to obtain sample images. Based on this, the directly obtained or segmented sample images are input into the sample creation module to label the sample images with the product name, thereby training the original recognition model built based on the YOLO algorithm to obtain an image recognition model. Then, the sample images, product names, and image recognition model are uploaded to the WMS server, which then uploads the sample images to the image storage server, generates the corresponding image storage address, and returns the image storage address to the WMS server. Next, the WMS server queries the product master data table in the database based on the product name. If multiple product numbers (i.e., product SKUs, where SKU is short for Stock Keeping Unit) are retrieved, a list of product numbers consisting of these multiple product numbers is returned to the WMS server. The WMS server then displays this list to the WMS terminal for relevant personnel to select the correct product number. The WMS server updates the image storage address field in the corresponding product master data table in the database based on the selected product number. After a successful update, the sample production is complete, enabling automated warehouse management of the aforementioned uncoded products.

[0078] Figure 4 This is a flowchart of a warehouse management method provided in an embodiment of the present invention. This embodiment is applicable to situations where automated warehouse management of goods is achieved without the need to affix barcodes to the goods. The method can be executed by the warehouse management device provided in this embodiment of the present invention, which can be implemented by software and / or hardware and can be integrated into a terminal.

[0079] See Figure 4 The method of this invention specifically includes the following steps:

[0080] S310. Obtain the current multimedia data of the items to be stored and managed, and send the current multimedia data to the server so that the server can obtain the first item information by recognizing the current multimedia data, and return the second item information queried based on the first item information.

[0081] The current multimedia data can be data collected from the items using a data acquisition device and input into the client. This data acquisition device can be a camera, video camera, or camcorder, etc., without specific limitations. After obtaining the current multimedia data, the client can send it to the server. The server then identifies the received multimedia data to obtain the first item information and retrieves the second item information that matches the first item information. In practical applications, assuming the first item information is the item information of a first sample, then the second item information is also the item information of that first sample.

[0082] S320: Receive the information of the second item and display the information of the second item.

[0083] After receiving the second item information returned by the server, the client displays the second item information so that relevant personnel can verify whether the displayed second item information matches the aforementioned item, and then input the verification result into the client.

[0084] S330. Receive the verification result for the displayed second item information input, and send the verification result to the server so that the server can perform warehouse management of the item based on the verification result. The verification result is used to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item.

[0085] In this process, the client sends the received verification result to the server. The server can then determine whether the previously identified first item information is correct based on the received verification result, and thus determine how to manage the aforementioned item in the warehouse, thereby achieving an automated warehouse management process.

[0086] The technical solution of this invention involves a client acquiring current multimedia data of an item to be managed in the warehouse and sending this data to a server. The server then identifies the received multimedia data to obtain first item information and returns second item information retrieved based on the first item information. Whether the first and second item information are the correct information for the item, or whether the current multimedia data has been correctly identified, needs to be verified. The client receives and displays the second item information returned by the server, allowing relevant personnel to verify whether the displayed second item information matches the item, thus confirming the correct identification of the multimedia data. The verification result is then input into the client. The client then sends the received verification result to the server, enabling the server to manage the item's warehouse based on the received verification result. This technical solution automates the warehouse management process without requiring barcodes to be affixed to the items, thereby reducing material costs and ensuring the accuracy and efficiency of warehouse management.

[0087] An optional technical solution, the aforementioned information matching method, may further include: receiving third item information input for an item, and sending the third item information to the server; enabling the server to perform warehouse management on the item based on the verification result, which may include: enabling the server to perform warehouse management on the item based on the third item information when the verification result determines that the second item information does not match the item. Wherein, when relevant personnel determine that the displayed second item information does not match the aforementioned item, in addition to inputting the verification result to the client, the third item information of the item can also be input to the client. This third item information can be an item code or an item name, etc. In this way, the client can send the received third item information and the verification result together to the server. Then, if the server determines that the previously identified first item information is incorrect based on the received verification result, it can perform warehouse management based on the matched third item information, thereby ensuring the effectiveness of warehouse management.

[0088] Figure 5 This is a structural block diagram of a warehouse management system provided in an embodiment of the present invention. This embodiment is applicable to situations where automated warehouse management of goods is achieved without the need to affix barcodes to the goods. See also... Figure 5The warehouse management system of this invention may include: a client 410 and a server 420; wherein, the client 410 is used to acquire current multimedia data of the items to be managed in the warehouse and send the current multimedia data to the server 420; the server 420 is used to obtain first item information by recognizing the received current multimedia data and return second item information queried based on the first item information to the client 410; the client 410 is also used to display the received second item information, receive the verification result input for the displayed second item information, and send the verification result to the server 420, wherein the verification result is used to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item; the server 420 is also used to perform warehouse management on the items based on the received verification result. The client and server in the above warehouse management system cooperate with each other to realize the automated warehouse management process of items without affixing barcodes to the items, thereby reducing consumable costs and ensuring the accuracy and efficiency of warehouse management.

[0089] To better understand the overall operation of the warehouse management system described above, a specific example is provided below. For an example, see [link to example]. Figure 6To improve image recognition accuracy, warehouse operators place uncoded goods separately on a clutter-free workbench during on-site operations. They then use a camera on their terminal to scan the uncoded goods, sending the scanned video to the video module in the WMS server via an Application Programming Interface (API). The scanned video is then framed into the current image (as shown in the example of current multimedia data above), and this current image is returned. The current image is then sent to the image recognition module via the API. The image recognition module reads the image recognition model and recognizes the current image, returning the identified product name to the WMS server. The WMS server then queries the product master data table based on the product name, warehouse number, and owner information. It returns the retrieved product name and number, along with historical images obtained from the image storage address (as shown in the example of historical multimedia data above), to the terminal for display. This allows the warehouse operator to verify whether the displayed historical images match the uncoded goods, thus confirming the correct recognition of the current image. If the image recognition is verified to be correct, subsequent warehouse management can proceed directly; otherwise, the product number is manually entered, and subsequent warehouse management is based on the entered product number. It should be noted that in the event of an error, a data acquisition task can be created based on the manually entered product number, and the acquired image can be returned as a sample image to the quality control personnel. This allows the quality control personnel to create corresponding samples using the sample creation module to retrain the image recognition model.

[0090] As another example, now Figure 3 The example shown and Figure 6 The examples shown are used in combination to illustrate this. For details, see [link to relevant documentation]. Figure 7The acquired sample images are uploaded to the sample creation module via the image recognition module. This allows the product names to be labeled on the sample images for model training, resulting in an image recognition model. The image recognition model is stored in the WMS server. When personnel scan uncoded products using the WMS terminal's camera, the video module segments the captured video frame by frame to obtain the current image. The stored image recognition model then identifies the product name from this image. Further, the system queries the product master data table based on the product name and other information, returning the retrieved product name, product code, and historical images to the WMS terminal for verification. If the recognition is correct, clicking the "Correct Recognition" button allows continued WMS operations. If the recognition is incorrect, clicking the "Incorrect Recognition" button prompts manual input of the product number, allowing continued WMS operations. Alternatively, the incorrectly recognized image can be transmitted to the sample creation module to create a sample, thereby improving the accuracy of image recognition. The above technical solution uses image recognition to identify barcode-free products, thereby achieving warehouse management of barcode-free products without the need for affixing barcodes, thus improving the efficiency of on-site operations and achieving energy conservation and emission reduction.

[0091] Figure 8 This is a structural block diagram of a warehouse management device provided in an embodiment of the present invention. This device is used to execute the warehouse management method provided in any of the above embodiments. This device and the warehouse management methods of the above embodiments belong to the same inventive concept. Details not described in detail in the embodiments of the warehouse management device can be found in the embodiments of the above warehouse management methods. See also... Figure 8 The device is configured on the server side and may specifically include: a first item information acquisition module 510, a second item information return module 520, and a warehouse management module 530.

[0092] The first item information acquisition module 510 is used to receive the current multimedia data of the item to be stored and managed by the client, and to obtain the first item information by recognizing the current multimedia data.

[0093] The second item information return module 520 is used to query the second item information based on the first item information and return the second item information to the client so that the second item information can be displayed through the client.

[0094] The warehouse management module 530 is used to receive the verification results sent by the client and perform warehouse management on the items based on the verification results. The verification results are input into the client to indicate the accuracy of the current multimedia data recognition. The accuracy is determined by the matching between the second item information and the item.

[0095] Optionally, the warehouse management module 530 may include:

[0096] The first warehouse management unit is used to perform warehouse management of items based on the second item information when it is determined that the second item information matches the item based on the verification results.

[0097] And / or,

[0098] The second warehouse management unit is used to receive third item information sent by the client when the verification results determine that the second item information does not match the item, and to perform warehouse management on the item based on the third item information. The third item information includes the item information entered into the client for the item.

[0099] Optionally, the second item information return module 520 may include:

[0100] The first storage address query unit is used to query the first storage address based on the first item information, wherein the first storage address represents the first storage area where historical multimedia data is stored, and the historical multimedia data is obtained by pre-collecting the first sample corresponding to the first item information;

[0101] The second item information obtaining unit is used to obtain historical multimedia data from the first storage area based on the first storage address, and use the historical multimedia data as the second item information.

[0102] Optionally, the first item information acquisition module 510 may include:

[0103] The first item information obtaining unit is used to input the current multimedia data into the trained data recognition model and obtain the first item information based on the output of the data recognition model.

[0104] Based on this, optionally, the data recognition model can be pre-trained using the following modules:

[0105] The labeled item information acquisition module is used to acquire the sample multimedia data of the second sample corresponding to the item and the labeled item information, wherein the sample multimedia data is of the same type as the current multimedia data, and the labeled item information is of the same type as the first item information;

[0106] The data recognition model acquisition module is used to take sample multimedia data and labeled item information as the first training samples, and train the original recognition model based on the first training samples to obtain the data recognition model.

[0107] Based on this, optionally, the data recognition model can be retrained using the following modules:

[0108] The second training sample acquisition module is used to use the current multimedia data and the labeled item information as the second training sample when it is determined that the current multimedia data is incorrect based on the verification results.

[0109] The data recognition model update module is used to retrain the data recognition model based on the second training sample and update the data recognition model according to the retraining results.

[0110] Alternatively, the aforementioned data identification device may further include:

[0111] The second storage address recording module is used to store the sample multimedia data corresponding to the labeled item information in the second storage area and record the second storage address of the second storage area.

[0112] The warehouse management device provided in this embodiment of the invention includes a server that receives current multimedia data of items to be managed in the warehouse from a client via a first item information acquisition module. The server identifies the current multimedia data to obtain first item information, verifying whether the first item information is indeed the item information, or whether the current multimedia data has been correctly identified. The server then retrieves second item information matching the first item information via a second item information return module and returns the second item information to the client. This allows relevant personnel to verify whether the displayed second item information matches the item, thus confirming the correct identification of the current multimedia data. The verification result is then input into the client. The server receives the verification result from the client via a warehouse management module, enabling warehouse management based on the verification result. This device automates the warehouse management process without requiring barcodes to be affixed to the items, thereby reducing consumable costs and ensuring accuracy and efficiency in warehouse management.

[0113] The warehouse management device provided in the embodiments of the present invention can execute the warehouse management method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the method.

[0114] It is worth noting that in the above embodiments of the warehouse management device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of the present invention.

[0115] Figure 9This is a structural block diagram of a warehouse management device provided in an embodiment of the present invention. This device is used to execute the warehouse management method provided in any of the above embodiments. This device and the warehouse management methods of the above embodiments belong to the same inventive concept. Details not described in detail in the embodiments of the warehouse management device can be found in the embodiments of the above warehouse management methods. See also... Figure 9 The device is configured on the client side and may specifically include: a current multimedia data sending module 610, a second item information display module 620, and a verification result sending module 630.

[0116] The current multimedia data sending module 610 is used to acquire the current multimedia data of the items to be stored and managed, and send the current multimedia data to the server so that the server can obtain the first item information by recognizing the current multimedia data and return the second item information queried based on the first item information.

[0117] The second item information display module 620 is used to receive and display the second item information.

[0118] The verification result sending module 630 is used to receive the verification result input for the displayed second item information and send the verification result to the server so that the server can perform warehouse management of the item based on the verification result. The verification result is used to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item.

[0119] Optionally, the aforementioned warehouse management device may further include:

[0120] The third item information sending module is used to receive the third item information input for the item and send the third item information to the server.

[0121] The verification result sending module 630 may include:

[0122] The third warehouse management unit enables the server to manage the warehouse of items based on the third item information when the verification results determine that the second item information does not match the item.

[0123] The warehouse management device provided in this embodiment of the invention involves a client acquiring current multimedia data of an item to be managed in the warehouse through a current multimedia data sending module. This current multimedia data is then sent to a server, which identifies the received data to obtain first item information and returns second item information retrieved based on the first item information. Whether the first and second item information are the correct information for the item, or whether the current multimedia data has been correctly identified, needs to be verified. The client receives and displays the second item information returned by the server through a second item information display module, allowing relevant personnel to verify whether the displayed second item information matches the item, thus confirming the correct identification of the current multimedia data. The verification result is then input into the client. Finally, the client sends the received verification result to the server through a verification result sending module, enabling the server to manage the warehouse based on the received verification result. This device automates the warehouse management process without requiring barcodes to be affixed to the items, thereby reducing consumable costs and ensuring accuracy and efficiency in warehouse management.

[0124] The warehouse management device provided in the embodiments of the present invention can execute the warehouse management method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the method.

[0125] It is worth noting that in the above embodiments of the warehouse management device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of the present invention.

[0126] Figure 10 A schematic diagram of a server or terminal (hereinafter collectively referred to as electronic device 10) that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0127] like Figure 10As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded into the RAM 13 from storage unit 18. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0128] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0129] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as warehouse management methods.

[0130] In some embodiments, the warehouse management method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the warehouse management method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the warehouse management method by any other suitable means (e.g., by means of firmware).

[0131] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0132] Computer programs used to implement the methods of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The computer programs can be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0133] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0134] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0135] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0136] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0137] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0138] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A warehouse management method, characterized in that, Applied to the server side, the method includes: Receive current multimedia data of items to be managed in the warehouse sent by the client, and obtain first item information by identifying the current multimedia data; Based on the first item information, a first storage address is retrieved, wherein the first storage address represents a first storage area that stores historical multimedia data, which is obtained by pre-collecting a first sample corresponding to the first item information. Based on the first storage address, the historical multimedia data is obtained from the first storage area, and the historical multimedia data is returned to the client as the second item information so that the second item information can be displayed through the client; The client receives a verification result, wherein the verification result is input into the client to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item. If, based on the verification result, it is determined that the second item information does not match the item, the third item information sent by the client is received, and the item is managed in the warehouse based on the third item information, wherein the third item information includes item information input into the client for the item.

2. The method according to claim 1, characterized in that, Also includes: If, based on the verification results, it is determined that the second item information matches the item, then warehouse management is performed on the item based on the second item information.

3. The method according to claim 1, characterized in that, The step of obtaining first item information by identifying the current multimedia data includes: The current multimedia data is input into the trained data recognition model, and the first item information is obtained based on the output of the data recognition model.

4. The method according to claim 3, characterized in that, The data recognition model is pre-trained through the following steps: Obtain sample multimedia data and labeled item information of the second sample corresponding to the item, wherein the sample multimedia data is of the same type as the current multimedia data, and the labeled item information is of the same type as the first item information; The sample multimedia data and the labeled item information are used as the first training samples, and the original recognition model is trained based on the first training samples to obtain the data recognition model.

5. The method according to claim 4, characterized in that, The data recognition model is retrained through the following steps: If the verification results indicate that the current multimedia data is incorrectly identified, the current multimedia data and the labeled item information will be used as the second training sample. The data recognition model is retrained based on the second training sample, and then updated based on the retraining results.

6. The method according to claim 4, characterized in that, Also includes: The sample multimedia data corresponding to the labeled item information is stored in the second storage area, and the second storage address of the second storage area is recorded.

7. A warehouse management method, characterized in that, Applied to a client, the method includes: The system acquires the current multimedia data of the items to be stored and manages, and sends the current multimedia data to the server so that the server can obtain the first item information by recognizing the current multimedia data, and return the second item information queried based on the first item information. Receive the information about the second item and display the information about the second item; The system receives a verification result for the displayed second item information and sends the verification result to the server so that the server can perform warehouse management on the item based on the verification result. The verification result is used to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item. The information about the second item was obtained in the following way: Based on the first item information, a first storage address is retrieved, wherein the first storage address represents a first storage area that stores historical multimedia data, which is obtained by pre-collecting a first sample corresponding to the first item information. Based on the first storage address, the historical multimedia data is obtained from the first storage area, and the historical multimedia data is used as the second item information; The warehouse management is carried out in the following manner: if it is determined based on the verification result that the second item information does not match the item, the third item information sent by the client is received, and the warehouse management of the item is carried out based on the third item information, wherein the third item information includes item information input into the client for the item.

8. The method according to claim 7, characterized in that, Also includes: Receive third item information input for the item, and send the third item information to the server; The step of enabling the server to perform warehouse management on the items based on the verification result includes: This enables the server to perform warehouse management on the item based on the third item information if it determines, based on the verification result, that the second item information does not match the item.

9. A warehouse management system, characterized in that, Including client and server sides; among which, The client is used to obtain the current multimedia data of the items to be managed in the warehouse, and send the current multimedia data to the server. The server is configured to obtain first item information by identifying the received current multimedia data, and return second item information queried based on the first item information to the client; The client is also configured to display the received second item information, receive the verification result input for the displayed second item information, and send the verification result to the server, wherein the verification result is used to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item; The server is further configured to receive third item information sent by the client when it is determined, based on the received verification result, that the second item information does not match the item, and to perform warehouse management on the item based on the third item information, wherein the third item information is item information input into the client for the item; The second item information is obtained by the server through the following method: Based on the first item information, a first storage address is retrieved, wherein the first storage address represents a first storage area that stores historical multimedia data, which is obtained by pre-collecting a first sample corresponding to the first item information. Based on the first storage address, the historical multimedia data is obtained from the first storage area, and the historical multimedia data is used as the second item information.

10. A warehouse management device, characterized in that, Configured on the server side, the device includes: The first item information acquisition module is used to receive the current multimedia data of the item to be stored and managed by the client, and to obtain the first item information by recognizing the current multimedia data; The second item information return module is used to query the second item information based on the first item information and return the second item information to the client so that the second item information can be displayed through the client. The warehouse management module is used to receive the verification result sent by the client and perform warehouse management on the item based on the verification result. The verification result is input into the client to indicate the accuracy of the current multimedia data recognition. The accuracy is determined by the matching between the second item information and the item. The second item information return module includes: The first storage address query unit is used to query the first storage address based on the first item information, wherein the first storage address represents a first storage area that stores historical multimedia data, and the historical multimedia data is obtained by pre-collecting a first sample corresponding to the first item information. The second item information obtaining unit is used to obtain the historical multimedia data from the first storage area based on the first storage address, and use the historical multimedia data as the second item information; The warehouse management module includes: The second warehouse management unit is used to receive third item information sent by the client when it is determined based on the verification result that the second item information does not match the item, and to perform warehouse management on the item based on the third item information, wherein the third item information is the item information input into the client for the item.

11. A warehouse management device, characterized in that, Configured on a client, the device includes: The current multimedia data sending module is used to acquire the current multimedia data of the items to be stored and managed in the warehouse, and send the current multimedia data to the server so that the server can obtain the first item information by recognizing the current multimedia data, and return the second item information queried based on the first item information; The second item information display module is used to receive the second item information and display the second item information. The verification result sending module is used to receive the verification result input for the displayed second item information and send the verification result to the server so that the server can perform warehouse management of the item based on the verification result. The verification result is used to indicate the accuracy of the current multimedia data recognition, and the accuracy is determined by the matching between the second item information and the item. The information about the second item was obtained in the following way: Based on the first item information, a first storage address is retrieved, wherein the first storage address represents a first storage area that stores historical multimedia data, which is obtained by pre-collecting a first sample corresponding to the first item information. Based on the first storage address, the historical multimedia data is obtained from the first storage area, and the historical multimedia data is used as the second item information; The warehouse management is carried out in the following manner: if it is determined based on the verification result that the second item information does not match the item, the third item information sent by the client is received, and the warehouse management of the item is carried out based on the third item information, wherein the third item information includes item information input into the client for the item.

12. A server, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor to cause the at least one processor to perform the warehouse management method as described in any one of claims 1-6.

13. A terminal, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor to cause the at least one processor to perform the warehouse management method as described in any one of claims 7-8.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute and implement the warehouse management method as described in any one of claims 1-8.

Images