Data processing method, system and electronic equipment

Automatically obtaining and confirming material attribute information through image recognition technology, solving the problems of material identification errors and low efficiency in the manufacturing industry, and achieving rapid, accurate and digital processing of material management.

CN113298453BActive Publication Date: 2024-12-20ALIBABA GROUP HOLDING LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202010890179.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-08-28
Publication Date
2024-12-20
Estimated Expiration
2040-08-28

AI Technical Summary

Technical Problem

In the manufacturing industry, in the process of material procurement and receipt management, the existing technology relies on manual identification, which is prone to identification errors and low efficiency, making it difficult to meet the fast and accurate needs of intelligent manufacturing.

Method used

By obtaining material images, determining the attribute information of the material, and obtaining the target document information associated with the material, performing processing tasks for the material, and using image recognition technology to automatically complete the acquisition and confirmation of the material's attribute information, reducing manual recognition and entry operations.

Benefits of technology

It improves the processing efficiency of processing tasks such as material storage, reduces the error rate, and realizes the rapid, accurate and digitalization of material management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113298453B_ABST
    Figure CN113298453B_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide a data processing method, system and electronic device. Among them, the method includes: obtaining a material image; determining the attribute information of the material based on the material image; obtaining the target document information associated with the material; and executing the processing task for the material according to the target document information and the attribute information. By adopting the technical solution provided by this embodiment, there is no need for personnel to identify and enter material-related documents, nor is there any need to manually identify the material. The attribute information of the material can be determined directly based on the material image, and the acquisition and confirmation of the target document information and material attribute information corresponding to the material can be completed quickly and accurately, effectively improving the processing efficiency of processing tasks such as material warehousing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to data processing methods, systems and electronic devices. Background Art

[0002] With the development of computers and related intelligent technologies, more and more intelligent manufacturing technologies and intelligent manufacturing systems are being applied to the manufacturing process. For example, in response to the supply-side reform, an intelligent logistics supply chain is being built to realize the construction of a small-order, quick-response, and extremely flexible supply chain.

[0003] In the manufacturing industry, material procurement and receipt management are directly related to whether manufacturing can proceed smoothly. In the existing technology, materials are circulated in the form of bills of materials from procurement to receipt and then to management. The warehousing, storage and delivery of materials are mainly managed offline. Among them, the receipt and warehousing link mainly relies on manual material identification, which is prone to identification errors and has low identification efficiency, making it difficult to meet the needs of fast and accurate response of intelligent manufacturing. Summary of the invention

[0004] In order to solve or improve the problems existing in the prior art, the embodiments of the present application provide a data processing method, system and electronic device.

[0005] In one embodiment of the present application, a data processing method is provided. The method comprises:

[0006] Get material images;

[0007] Determining attribute information of the material based on the material image;

[0008] Obtain target document information associated with the material;

[0009] According to the target document information and the attribute information, a processing task for the material is executed.

[0010] In another embodiment of the present application, another data processing method is provided. The method includes:

[0011] Generate document information based on the document image;

[0012] Determine the material's attribute information based on the material image;

[0013] According to the attribute information and the document information, a processing task for the material is executed.

[0014] In one embodiment of the present application, a data processing system is provided. The system includes:

[0015] The client device is used to obtain a material image; obtain attribute information of a material corresponding to the material image from a server device; obtain target document information associated with the material; and execute a processing task for the material according to the target document information and the attribute information;

[0016] The server device has an image search function, which is used to search and feedback the attribute information of the corresponding material according to the material image sent by the client device.

[0017] In another embodiment of the present application, another data processing system is provided. The system includes:

[0018] The client device is used to generate document information according to the document image; send the material image to the server device to obtain the attribute information of the material corresponding to the material image from the server device; and execute the processing task for the material according to the attribute information and the document information;

[0019] The server device has an image search function, which is used to search and feedback the attribute information of the corresponding material according to the material image sent by the client device.

[0020] In one embodiment of the present application, a data processing method is provided. The method comprises:

[0021] Get the material image of the material to be put into storage;

[0022] Acquiring management data related to the material to be stored according to the material image;

[0023] The management data is displayed to wait for the warehousing processing of the materials to be stored.

[0024] In one embodiment of the present application, a data processing method is provided. The method comprises:

[0025] Determine the attribute information of the material to be stored according to the material image of the material to be stored;

[0026] Determine the warehouse entry order information according to the warehouse entry order image of the material to be warehoused;

[0027] The attribute information and the warehouse entry order information are displayed in association to wait for warehouse entry processing of the material to be warehoused.

[0028] In one embodiment of the present application, an electronic device is provided. The electronic device includes: a memory and a processor; wherein:

[0029] The memory is used to store programs;

[0030] The processor is coupled to the memory and is configured to execute the program stored in the memory to:

[0031] Get material images;

[0032] Determining attribute information of the material based on the material image;

[0033] Obtain target document information associated with the material;

[0034] According to the target document information and the attribute information, a processing task for the material is executed.

[0035] In another embodiment of the present application, an electronic device is provided. The electronic device includes: a memory and a processor; wherein:

[0036] The memory is used to store programs;

[0037] The processor is coupled to the memory and is configured to execute the program stored in the memory to:

[0038] Generate document information based on the document image;

[0039] Determine the material's attribute information based on the material image;

[0040] According to the attribute information and the document information, a processing task for the material is executed.

[0041] In another embodiment of the present application, an electronic device is provided. The electronic device includes: a memory, a processor and a display; wherein:

[0042] The memory is used to store programs;

[0043] The processor is coupled to the memory and is configured to execute the program stored in the memory to:

[0044] Get the material image of the material to be put into storage;

[0045] Acquiring management data related to the material to be stored according to the material image;

[0046] The display is instructed to display the management data to wait for the warehousing processing of the material to be warehousing.

[0047] In another embodiment of the present application, an electronic device is provided. The electronic device includes: a memory, a processor and a display; wherein:

[0048] The memory is used to store programs;

[0049] The processor is coupled to the memory and is configured to execute the program stored in the memory to:

[0050] Determine the attribute information of the material to be stored according to the material image of the material to be stored;

[0051] Determine the warehouse entry order information according to the warehouse entry order image of the material to be warehoused;

[0052] The instruction associates and displays the attribute information and the warehouse entry order information to wait for warehouse entry processing of the material to be warehoused.

[0053] The technical solution provided in the embodiment of the present application, after acquiring the image of the material to be put into storage, determines the attribute information corresponding to the material by means of image recognition; at the same time, the target document information associated with the material can also be acquired; and then, according to the target document information and the attribute information of the material, the processing tasks for the material, such as storage processing or verification processing, etc., are executed. By adopting the technical solution provided in this embodiment, there is no need for personnel to identify and enter the material-related documents, nor is there any need to manually identify the material. The attribute information of the material can be determined directly based on the material image, and the acquisition and confirmation of the target document information and material attribute information corresponding to the material can be completed quickly and accurately, effectively improving the processing efficiency of processing tasks such as material storage. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0055] Figure 1a A flowchart of a data processing method provided in one embodiment of the present application;

[0056] Figure 1b A schematic diagram of an interactive interface provided by an embodiment of the present application;

[0057] Figure 1c A schematic diagram of the material image displayed after the user triggers and confirms taking a photo through the interactive interface;

[0058] Figure 2 A schematic diagram of an interface for confirming receipt information provided in an embodiment of the present application;

[0059] Figure 3 A schematic diagram showing multiple candidate images on an interactive interface;

[0060] Figure 4A schematic diagram of a flow chart of a method for determining a target image provided in an embodiment of the present application;

[0061] Figure 5 A flowchart of a method for obtaining target document information provided by an embodiment of the present application;

[0062] Figure 6 A flowchart of another method for obtaining target document information provided by an embodiment of the present application;

[0063] Figure 7 A flowchart of another data processing method provided in one embodiment of the present application;

[0064] Figure 8 A flowchart of a method for generating document information provided in one embodiment of the present application;

[0065] Fig. 9 A schematic diagram of document information provided in an embodiment of the present application;

[0066] Fig.10 A schematic diagram of signaling interaction provided in an embodiment of the present application;

[0067] Fig.11 A schematic diagram of a client operation process provided in an embodiment of the present application;

[0068] Fig.12 A flowchart of a data processing method provided by another embodiment of the present application;

[0069] Fig.13 A flowchart of a data processing method provided in yet another embodiment of the present application;

[0070] Fig.14 A schematic diagram of a graph search link for a delivery scenario provided in an embodiment of the present application;

[0071] Fig.15 A schematic diagram of a pre-sorting scene graph search link provided in an embodiment of the present application;

[0072] Fig.16 A schematic diagram of the structure of a data processing device provided in one embodiment of the present application;

[0073] Fig.17 A schematic diagram of the structure of a data processing device provided in another embodiment of the present application;

[0074] Fig.18 A schematic diagram of the structure of a data processing device provided in yet another embodiment of the present application;

[0075] Fig.19 A schematic diagram of the structure of a data processing device provided in yet another embodiment of the present application;

[0076] Fig. 20 A schematic diagram of the structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0077] In the existing procurement and receiving process, the purchaser and the consignee do not work closely together. For example, the purchaser generates a purchase entry order and a corresponding purchase list through the purchaser's system. The supplier delivers the goods to the consignee according to the purchase list. When the goods arrive at the consignee's warehouse, the warehouse staff needs to operate on the warehouse management system after getting the purchase list (such as entering the purchase order number to find the corresponding entry order), and then manually verify the name, code, quantity, color and other information of the incoming goods. When the information of the incoming goods is consistent with the entry order information, the confirmation operation for the entry order can be triggered on the system. After the confirmation operation, the corresponding status of the entry order changes from "not received" to "received". During the whole process, the staff needs to manually enter the order number and find the corresponding entry order; they also need to identify the attribute information of the goods (such as color, shape, size, etc.). In this process, the staff mainly relies on material identification, which is prone to identification errors and low identification efficiency.

[0078] To this end, the present application provides the following embodiments to solve or partially solve the problems existing in the prior art. In order to enable people in the technical field to better understand the present application scheme, the technical scheme in the embodiment of the present application will be clearly and completely described below in conjunction with the drawings in the embodiment of the present application.

[0079] In some processes described in the specification, claims and the above-mentioned figures of the present application, multiple operations appearing in a specific order are included, and these operations may not be executed or executed in parallel in the order in which they appear in this article. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit "first" and "second" to different types. In addition, the embodiments described below are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of this application.

[0080] like Figure 1aA flowchart of a data processing method provided in an embodiment of the present application. The execution subject of the method may be a client device, which may be a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a smart wearable device, etc., which is not specifically limited in this embodiment. Specifically, the method comprises the following steps:

[0081] 101. Obtain material image;

[0082] 102. Determine attribute information of the material based on the material image;

[0083] 103. Obtain target document information associated with the material;

[0084] 104. Execute a processing task for the material according to the target document information and the attribute information.

[0085] In the above 101, the material image can be acquired through an image acquisition device (such as a camera). The image acquisition device has the function of taking pictures or videos, and can be but not limited to: a camera, a video recorder, a camera, etc. The execution subject of the method of this embodiment may be provided with an image acquisition device, and the user may trigger the image acquisition device to work through the controls on the touch device or through voice control and the like to acquire the material image. Alternatively, the image acquisition device and the execution subject of the method of this embodiment are two independent devices, and the two devices are communicatively connected. The user may send corresponding control instructions to the image acquisition device through the execution subject of the method of this embodiment to control the image acquisition device to work and acquire the material image. Figure 1b In the interactive interface 1 shown, the user can trigger taking a photo of the material by clicking the "Confirm Photo" control. Of course, the material image can also be input or imported by the user. That is, this step 101 "obtaining the material image" can specifically include the following steps: in response to the user's input operation, obtaining the material image input by the user; or in response to the image acquisition instruction triggered by the user, acquiring the material image. Figure 1c As shown, the collected material image can be displayed on the interactive interface 1. If the user is not satisfied with the material image, the user can click the "re-photograph" control to trigger a re-photograph of the material.

[0086] It should be added that determining the property information of a material based on images taken at only one angle may result in low accuracy. For example, due to light factors, the color recognition of the material may be wrong. To this end, images of the material at multiple angles can be collected, or videos can be collected. The video can be collected continuously from different angles of the material.

[0087] In the above 102, the material attribute information may include but is not limited to at least one of the following: material shape, material color, material name, material code, material storage quantity (or purchase quantity), etc. For the storage material, the material attribute information may be the SKU (stock keep unit) of the material. SKU is the smallest physically indivisible inventory unit.

[0088] In the above 103, the target document information associated with the material may have different forms or names in different application scenarios. In the material procurement scenario, the document information is the purchase order information, which contains the attribute information (such as SKU) of at least one material to be purchased. The material to be purchased here is associated with the purchase order information. In the material warehousing scenario, the document information is the warehousing order information, which contains the attribute information (such as SKU) of at least one material to be stored; similarly, the material to be stored is associated with the warehousing order information.

[0089] In actual applications, there can be more than one target document information associated with a material. For example, if a batch of buttons with the same SKU is put into storage twice, there will be two corresponding entry orders. In this case, there will be two target document information associated with the button.

[0090] The methods for obtaining the target document information in step 103 of this embodiment may include but are not limited to the following two methods: one is to use the attribute information of the material to search for the associated target document information from the document library; the premise of adopting this method is that the document information corresponding to the material has been stored in the document library. Another method is to generate the target document information based on the document image. Taking the warehousing scenario as an example, usually the incoming materials and the incoming orders are delivered to the warehouse together. When the warehouse staff receives the incoming materials, in addition to seeing the physical objects, they can also see the paper incoming orders. At this time, the image of the incoming order can be collected, and then the content of the incoming order can be identified through recognition technology to generate the target document information associated with the incoming materials that arrived together.

[0091] If the method provided in this embodiment is applied in a warehouse management scenario, the processing task for the material in the above 104 can be specifically: after the staff completes the SKU verification of the material, the warehousing operation is confirmed for the material, and the state of the target document information corresponding to the material is converted to "warehoused". That is, the staff can complete the warehousing of the material by operating the "warehouse entry" operation on the display interface. That is, step 104 "execute the processing task for the material according to the target document information and the attribute information" can be specifically:

[0092] 1041. Display the target document information and at least part of the attribute information;

[0093] 1042. In response to a confirmation operation triggered by the user on the displayed content, confirmation processing is performed on the target document information to modify a status corresponding to the target document information.

[0094] Through the above embodiment, after obtaining the target document information and attribute information associated with the material, at least part of the information is displayed on the client. Figure 2 A schematic diagram of an interface for confirming the receipt information provided for an embodiment of the present application. In this interface, material images, target document information (such as source document number), and attribute information (such as: receipt type, supplier information, receipt time, material model, material color, etc.) are displayed. The receiving personnel checks the above information item by item. If there is no problem with the check, the receipt can be confirmed, and the document information related to the material will become received or put into storage. In the above process, there is no need to manually fill in the warehouse entry form, the attribute information of the material, etc., thereby reducing the risk of errors in manual filling.

[0095] The technical solution provided in this embodiment, after obtaining the image of the material to be received, determines the attribute information corresponding to the material by means of image recognition; at the same time, it can also obtain the target document information associated with the material; then, according to the target document information and the attribute information of the material, execute the processing tasks for the material, such as warehousing processing or verification processing. With the technical solution provided in this embodiment, there is no need for personnel to identify and enter the material-related documents, nor is there any need to manually identify the material. The attribute information of the material can be directly determined based on the material image, and the acquisition and confirmation of the target document information and material attribute information corresponding to the material can be completed quickly and accurately, effectively improving the processing efficiency of processing tasks such as material warehousing.

[0096] In an achievable technical solution, the embodiment 102 “determining the attribute information of the material based on the material image” may specifically include the following steps:

[0097] 1021. Determine a target image matching the material image according to the material image;

[0098] 1022. Obtain attribute information of the material corresponding to the target image.

[0099] In the above 1021, the image search technology can be used to search for the target image that matches the material image. For example, after the execution subject of the method of this embodiment obtains the material image, the image search technology is used to search for the target image that matches the material image from the local gallery. This requires that the image of the material is pre-stored locally. Of course, the searched images that match the material image (hereinafter collectively referred to as candidate images) can be one or more. Among them, the image search is a technology that searches for images that meet the matching requirements in the gallery by searching image text or visual features. The image search technology is generally divided into three parts: feature extraction, retrieval engine, and search result sorting. Specifically, the feature information of the material image is extracted; then the feature information is sent to the retrieval engine, and at least one candidate image that meets the matching requirements is retrieved from the established retrieval results through the retrieval engine; assuming that there are multiple candidate images retrieved, the multiple candidate images will be sorted. Among them, the sorting rules depend on the specific design needs, and this embodiment does not limit this.

[0100] In an achievable technical solution, this step 1021 may specifically be:

[0101] Display at least one candidate image that meets the matching requirement with the material image;

[0102] In response to a confirmation operation triggered by a user on a candidate image, the candidate image confirmed by the user is used as the target image.

[0103] See also Figure 3 In the example shown, three candidate images that meet the matching requirements with the material image 2 are displayed on the interactive interface 1. The user can complete the entire confirmation process by clicking the selection operation key corresponding to the corresponding candidate image and then clicking the "Confirm" control on the interactive interface 1. Figure 3 In the example shown, the user clicks the click operation key on the left side of the first candidate image 3, and the click operation key changes color. Then the user can click the "Confirm" control to confirm the first candidate image 3 as the target image. After the user confirms, he can jump to Figure 2 The "Please select confirmation receipt information" page is shown. If the user clicks the "Result does not match" control, it will jump to the blank document information creation page, and the user needs to manually create the corresponding document information. This process is conveniently the same as the prior art. If the user clicks the "Return" control, it will return to the specified page, such as the document list management page of the document management system, which is not specifically limited in this embodiment.

[0104] In addition to local search, the material image can also be sent to the server for search. The server can be a server, a server cluster, a virtual server or a cloud device, etc., which is not specifically limited in this embodiment. Figure 4As shown, the above step 1021 may specifically include the following steps:

[0105] S11, sending the material image to a server, so that the server searches for at least one candidate image that meets the matching requirement with the material image;

[0106] S12, acquiring and displaying the at least one candidate image;

[0107] S13: In response to a confirmation operation triggered by a user on a candidate image, taking the candidate image confirmed by the user as the target image.

[0108] The "meeting the matching requirements" mentioned above may specifically mean that the matching value (or similarity value) of the two images is greater than a threshold value. For example, the solution of this embodiment is applied to a warehousing scenario, and the above-mentioned server may be connected to a procurement system. For example, the image of the purchased material stored in the procurement system may be obtained from the corresponding device of the procurement system. In addition, in order to improve the calculation accuracy, reduce the search range of the server, and reduce the amount of calculation, the server may bring together all the purchased materials that the current purchaser has ordered but has not completed receiving, to form a set of purchased material images; the server only searches in this set. If the number of candidate images is relatively large, in order to reduce the difficulty of user confirmation operations and improve the efficiency of confirmation operations, all candidate images may be sorted according to the matching degree, and the top 10 or top 5 candidate images may be screened out and displayed to the user through the client.

[0109] Furthermore, it is mentioned above that there are multiple ways to obtain the target document information associated with the material. Figure 5 The schematic diagram of the first method for obtaining target document information is shown. Figure 5 As can be seen in the figure, step 103 "obtaining target document information associated with the material" may include the following steps:

[0110] 1031. Perform text recognition on the material document associated with the material to obtain a recognition result;

[0111] 1032. Determine the target document information according to the recognition result.

[0112] In specific implementation, the above step 1031 can be specifically as follows: in response to the acquisition and identification indication triggered by the user, the acquisition and identification device is triggered to start, so as to perform text recognition on the material document in the acquisition area to obtain the recognition result. For example, the user clicks the acquisition and identification control on the client, the acquisition and identification device of the client device is started, and an identification box is displayed on the interface of the client device. The user can point the acquisition end of the client device to the material document, and move the client device so that the image of the material document is in the identification box. The acquisition and identification device of the client device identifies the material document in the identification box to obtain the recognition result. Alternatively, the image of the document is acquired by the image acquisition device of the client device or the image acquisition device connected to the client device for communication, and then the OCR (Optical Character Recognition) technology is used to perform text recognition on the document image to obtain the recognition result.

[0113] Through the above embodiment, when obtaining the target document information, there is no need for the receiving personnel to manually identify the document or manually enter the document information such as the order number, which simplifies the personnel work flow, avoids personnel operation errors, and improves the work efficiency and material document recognition accuracy during the receiving operation.

[0114] In specific implementation, the user can also place the material and its associated documents together for image acquisition. For example, place the material next to the document, start the client device or the image acquisition device connected to the client device, and collect images containing the material and the document. Then use the image segmentation technology to segment the image to obtain the material image and document image mentioned above. Among them, the image segmentation technology is a technology and process for dividing the image into several specific areas with unique properties and proposing targets of interest. Regarding how to use image segmentation technology to segment the material image and the document image, this embodiment does not specifically limit this, and reference can be made to the corresponding description in the prior art.

[0115] Document information is created by text recognition, eliminating the need for manual creation by users, reducing user workload and the chance of errors.

[0116] Figure 6 A flowchart of the second method for obtaining target document information is shown. Figure 6 As can be seen in the figure, step 103 "obtaining target document information associated with the material" may include the following steps:

[0117] 1031'. According to the attribute information, query the document database for at least one candidate document information that meets the association requirements with the material.

[0118] 1032': Display the at least one candidate document information.

[0119] 1033': In response to a selection operation triggered by a user on at least one candidate document information, a candidate document information selected by the user is used as the target document information.

[0120] In the above 1031', the document library can be stored locally or on the server side. If the document library is stored locally, the execution subject of the method of this embodiment (such as a client device) can search for at least one candidate document information in the locally stored document library according to the attribute information after obtaining the attribute information. Then, the at least one document information found is displayed on the display interface of the client, and then the user performs a selection operation on the at least one candidate document information to select the target document information. If the document library is stored on the server side, the client device needs to send the attribute information to the server side, and the server side queries and feeds back the at least one candidate document information associated with the material found.

[0121] In the above 1032', when there are multiple candidate document information, the display mode of the multiple candidate document information can be a list or a drop-down menu mode.

[0122] Through the above solution, the document information corresponding to the material can be directly queried based on the material's attribute information. The user does not need to manually enter the search and other tasks, which reduces the user's workload, improves work efficiency, and effectively reduces the user's error probability.

[0123] Furthermore, the solution provided in this embodiment also provides the user with a function of modifying target document information and / or attribute information. That is, the method provided in this embodiment may also include the following steps:

[0124] 105. Display the target document information and the attribute information;

[0125] 106. In response to a user's modification operation on at least one of the target document information and the attribute information, determine the modified target document information and / or the attribute information.

[0126] The user has modified it, indicating that there is a deviation in the automatic recognition process, resulting in errors in the final target document information and / or material attribute information. Therefore, the data modified by the user can be used as a learning sample to optimize the algorithm involved in this embodiment. That is, the method provided in this embodiment can also include the following steps:

[0127] Using the modified target document information and / or the attribute information as a learning sample to optimize the corresponding algorithm;

[0128] The algorithm includes: a first algorithm for performing image-based recognition of material attributes in an image and / or a second algorithm for performing text recognition on a material document associated with the material.

[0129] In specific implementation, the first algorithm may be an image classification model, a feature generation model, an image feature extraction model, etc., which may be involved in the image search technology. These models, such as the image classification model, the feature generation model, and the image feature extraction model, may be implemented based on machine learning technology (such as a neural network model). The second algorithm may be a text recognition model, which may also be implemented based on machine learning technology (such as a neural network model).

[0130] The machine learning model (such as a neural network model) needs to be trained so that its output accuracy can meet the set requirements. The target document information and / or the attribute information modified by the user can be used as a sample to optimize the corresponding algorithm (or model).

[0131] By using the statistics of actual usage data and the solution provided in this embodiment, the accuracy of at least one attribute information (such as SKU) determined based on the material image can reach more than 55%. Of course, the larger the amount of subsequent sample data, the higher the accuracy of each model, and the final accuracy can be greatly improved.

[0132] From the above content, it can be seen that the solution provided in the embodiment of the present application involves the use of material images to detect materials to obtain the SKU information of the materials; OCR text recognition can also be used to identify paper documents or electronic document images to obtain document information; the corresponding data can be quickly matched; there is no need for too much manual operation by the user, which improves the efficiency of warehousing or material sorting.

[0133] The technical solution provided in this embodiment is applicable to non-standard materials. Such materials do not have barcodes (difficult to digitize). The current sales process is highly medical and requires manual offline communication of document information and manual identification of the SKU of received or sorted materials, which is inefficient. With the solution provided in this embodiment, the staff takes a photo of the material and uploads it through hardware, the system recognizes the image, and then pushes at least one candidate SKU. The user confirms the material information and associates the source document to sell the material. The overall efficiency is significantly improved, which can be increased from the current average of 2 minutes per batch of materials for manual identification to 30 seconds. In addition, the technical solution provided in this embodiment is highly replicable and has the technical conditions for warehouse opening and replication without great difficulty. If the solution provided in this embodiment is applicable to the warehouse management of clothing accessories, the solution provided in this solution can support all categories, such as: clothing washing and hanging categories, buttons, zippers, decorations, etc.

[0134] like Figure 7A flowchart of another data processing method provided in an embodiment of the present application. The execution subject of the method may be a client device. Specifically, the method comprises the following steps:

[0135] 701. Generate document information according to the document image;

[0136] 702. Determine the attribute information of the material according to the material image;

[0137] 703. Execute a processing task for the material according to the attribute information and the document information.

[0138] In the above 701 and 702, the document image and the material image can be respectively acquired by the image acquisition device on the client device, or can be input by the user. Of course, the document image and the material image can also be segmented from one image. For example, as mentioned above, when acquiring the image, the user can place the material and the document together to acquire one image; then use the image segmentation technology to segment the document image and the material image.

[0139] In one feasible technical solution, Figure 8 A flowchart of a method for generating document information provided by an embodiment of the present application. Figure 8 As can be seen from the figure, the above step 701 "generating document information according to the document image" specifically includes the following steps:

[0140] 7011. Recognize the document image by using an optical character recognition method to obtain a recognition result;

[0141] 7012. Generate the document information based on the recognition result.

[0142] In the above 7012, the document information can be generated in the preset template according to the recognition result. Fig. 9 An example is shown, using optical character recognition technology to Fig. 9 The recognition result obtained by recognizing the document image on the left includes basic information such as document number, material type, and material quantity. Then, the information in the recognition result is generated according to the preset template as follows Fig. 9 Document information on the right.

[0143] In an achievable technical solution, the above step 702 "determining the attribute information of the material according to the material image" may include the following steps: determining a target image matching the material image according to the material image; and acquiring the attribute information corresponding to the target image.

[0144] Furthermore, the step of "determining a target image that matches the material image based on the material image" may include: sending the material image to a server, so that the server searches for at least one candidate image that meets the matching requirements with the material image; acquiring and displaying the at least one candidate image; and in response to a confirmation operation triggered by a user for a candidate image, using the candidate image confirmed by the user as the target image.

[0145] It should be noted that: for more detailed contents of steps 702 and 703, please refer to the corresponding description in the above embodiment, which will not be described here. In addition, the method provided in this embodiment may include other steps in the above embodiment in addition to the above steps.

[0146] To facilitate understanding, one of the data processing processes is described below in conjunction with a specific scenario. Fig.10 An interactive flow chart provided for an embodiment of the present application, Fig.11 A schematic diagram of the client operation process provided in one embodiment of the present application.

[0147] Assume that the client device 100 is provided with or connected to hardware facilities for image acquisition, such as a camera. The specific process is as follows:

[0148] Combination Fig.10 and Fig.11 To illustrate, after the supplier delivers the goods to the warehouse, the consignee's staff unpacks and takes out a piece of goods (for example, a button), puts it within the effective shooting range of the image acquisition device, and after adjusting the appropriate angle and light, the staff clicks the photo control in the display interface to issue a photo start instruction to the image acquisition device. At this time, the staff can see the photo window containing the material image (that is, the button image) through the client device 100. If it is confirmed that the current angle and light meet the photo conditions, the staff confirms the photo. The client device 100 sends a photo instruction to the image acquisition device, and the image acquisition device executes the photo action and sends the obtained material image to the client device 100. The client device 100 sends the material image to the server device 200. Specifically, the server device can be a cloud device, and the cloud device can include a first service node, a second service node, a third service node, etc. Each node can be a physical server or a virtual server, and this embodiment does not specifically limit this. Among them, the second service node stores a gallery. The third service node is used to perform a picture search task.

[0149] After receiving the material image, the first service node preprocesses the material image and then sends a request to the second service node to obtain the gallery. The preprocessing of the material image may include but is not limited to filtering, enhancing, sharpening, etc. to enhance the recognition of the material image. Of course, the preprocessing of the material image may also be completed by the client device 100. The second service node returns the gallery to the first service node. The first service node sends the material image and the gallery to the third service node. The third service node searches for candidate images that meet the matching requirements from the gallery based on the material image, and sends the candidate images to the first service node. Specifically, the third service node compares the material image with the images in the gallery to query the candidate images whose comparison results meet the requirements. The first service node packages at least one candidate image after sorting and screening and the corresponding attribute information to the client device 100. The staff can select a candidate image as the target image from the image list showing at least one candidate image through the client device 100. Subsequently, the client device 100 obtains and displays at least one document information associated with the target image and the material attribute information corresponding to the target object. Fig.11 As shown, the client device 100 can obtain the document information from the device 300 corresponding to the procurement system. The staff selects the document information matching the material in the list window showing the document information on the client. The confirmation of the target image and the document information is completed, and the goods are received.

[0150] The present application embodiment provides a data processing system. Fig.11 As shown, the system includes a client device 100 and a server device 200.

[0151] The client device 100 is used to obtain a material image; obtain attribute information of a material corresponding to the material image from a server device; obtain target document information associated with the material; and execute a processing task for the material according to the target document information and the attribute information;

[0152] The server device 200 has an image search function, which is used to search and feedback the attribute information of the corresponding material according to the material image sent by the client device.

[0153] Furthermore, the server device 200 is used to search for at least one candidate image that meets the matching requirements with the material image and the attribute information of the material corresponding to the candidate image according to the material image; and send the at least one candidate image and the attribute information of the material corresponding to the candidate image to the client device. The client device 100 is also used to display the at least one candidate image, and in response to a confirmation operation triggered by a user for a candidate image, use the attribute information of the material corresponding to the candidate image confirmed by the user as the attribute information of the material corresponding to the material image.

[0154] Specifically, the working process of the client device and the server device in the system can refer to the corresponding content in the above method embodiment, which will not be repeated here. It should be noted that the server device here can be a cloud server or a server cluster, and one server device can correspond to multiple client devices.

[0155] The present application embodiment provides another data processing system. Fig.11 The structure shown in the figure comprises:

[0156] The client device 100 is used to generate document information according to the document image; send the material image to the server device to obtain the attribute information of the material corresponding to the material image from the server device; and execute the processing task for the material according to the attribute information and the document information;

[0157] The server device 200 has an image search function, which is used to search and feedback the attribute information of the corresponding material according to the material image sent by the client device.

[0158] Specifically, the working process of the client and server in the system can refer to the corresponding content in the above method embodiment, which will not be repeated here. It should be noted that the server device here can be a cloud server or a server cluster, and one server device can correspond to multiple client devices.

[0159] It should be noted that the technical solutions provided by the embodiments of the present application can be widely applied to various fields, and there are fields where physical objects need to be digitally managed. For example, digital management of goods in supermarket warehouses, digital management of goods by warehouse operators, digital management of products in factory warehouses, etc. For example, when a batch of goods are put into the warehouse of a supermarket warehouse, the staff can take pictures of the goods to be put into the warehouse through the camera of the client device or use the client device to trigger the camera to take pictures. The client can send the captured product image to the server, and the server uses the image search technology to search for at least one candidate image that meets the matching requirements with the product image. The client device displays at least one candidate image fed back by the server on the user interface. The user can select a candidate image from them for confirmation. In this way, the client device can obtain the management data of the product based on the selected candidate image (i.e., the target image), such as the SKU of the product, the warehouse entry order information of the product, etc. The client device displays the management data of the product, and after completing the verification of the management data, the user can operate the management data through the corresponding controls on the interactive interface, such as confirmation operation.

[0160] The following embodiments are provided below, which will be described by taking the storage of materials as an example.

[0161] Fig.12 FIG. 2 is a flow chart of a data processing method provided by another embodiment of the present application. Fig.12 As shown, the method includes:

[0162] 801. Obtaining a material image of a material to be stored;

[0163] 802. Acquire management data related to the material to be stored according to the material image;

[0164] 803. Display the management data to wait for the warehousing processing of the materials to be stored.

[0165] For more detailed content of the above step 801, please refer to the corresponding description in the above embodiments, which will not be repeated here.

[0166] In the above 802, the management data may include but is not limited to: SKU of the material, warehouse entry order information, etc. Specifically, the step 802 may be implemented by the following steps:

[0167] 8021. Perform image recognition on the material image to obtain a recognition result;

[0168] 8022. According to the identification result, obtain management data related to the material to be stored.

[0169] In a specific feasible solution, the above step 8021 may specifically include:

[0170] A. searching, according to the material image, for at least one candidate image that meets the matching degree requirement with the material image;

[0171] B. displaying the at least one candidate image;

[0172] C. determining a selected candidate image in response to a user's selection operation on the at least one candidate image;

[0173] D. Determine management data related to the material to be stored based on the selected candidate image.

[0174] The step of searching for candidate images in step A can also be implemented by the server. That is, the above step A can be specifically: sending the material image to the server, so that the server searches for at least one candidate image that meets the matching requirements with the material image based on the material image; and receiving the at least one candidate image fed back by the server.

[0175] In the above step D, the attribute information of the selected candidate image may be obtained first, and then the warehousing order information related to the material to be warehousing is obtained according to the attribute information of the selected image.

[0176] Furthermore, the method provided in this embodiment may also include the following steps:

[0177] 804. In response to the user's operation on the management data, update the management data according to the user operation data.

[0178] Specifically, updates to the management data may include, but are not limited to: updates to the warehousing status (such as already in stock or not in stock), updates to the material's attribute information (such as when the on-site verified material quantity is different from the quantity on the warehousing receipt, the user modifies it to the actual verified quantity), etc.

[0179] It should be noted that: for the contents of some steps in this embodiment that are not detailed, please refer to the corresponding description in the above embodiment, and no further description is given here. In addition, the method provided in this embodiment may include other steps in the above embodiment in addition to the above steps.

[0180] Above Fig.12The embodiment shown is a scheme for obtaining the management data of the materials to be stored (such as attribute information and storage order information) by using material images. In fact, the storage order information of the materials to be stored can also be obtained by image recognition. That is, in the specific implementation, the warehouse staff can collect material images and storage order images in sequence, or collect images containing the materials to be stored and the storage order at one time, and then identify the material's attribute information and storage order information through image recognition technology, and then display the attribute information and storage order information in association, so that the staff can verify and / or make corresponding operations. For details, see Fig.13 As shown, the data processing method provided in this embodiment includes:

[0181] 901. Determine attribute information of the material to be stored according to the material image of the material to be stored;

[0182] 902. Determine the warehouse entry order information according to the warehouse entry order image of the material to be warehoused;

[0183] 903. The attribute information and the warehouse entry order information are displayed in association with each other to wait for warehouse entry processing of the material to be warehoused.

[0184] In the above 901, the image search technology can be used to first search for a target image that meets the matching requirements with the material image, and then obtain the attribute information of the data to be stored according to the target image.

[0185] In the above 902, text recognition technology, such as optical character recognition, may be used to recognize the text on the warehouse entry form to obtain the warehouse entry form information.

[0186] For more detailed contents of the above steps 901 and 902, please refer to the corresponding descriptions in the above embodiments, which will not be repeated here.

[0187] Furthermore, the method provided in this embodiment may also include the following steps:

[0188] 904. In response to the image acquisition operation of the user, acquire an acquired image containing the material to be stored and the storage order;

[0189] 903. Segment the collected image to obtain the material graphic and the warehouse entry order image.

[0190] For the image segmentation technology, please refer to the related contents in the prior art, which will not be elaborated in this article.

[0191] Similarly, for the contents of some steps in this embodiment that are not detailed, please refer to the corresponding description in the above embodiment, and no further description will be given here. In addition, the method provided in this embodiment may include other steps in the above embodiment in addition to the above steps.

[0192] It can be seen from the contents of the above embodiments that the technical solution provided by the present application utilizes image processing technology (specifically, image recognition technology) to manage the entry of materials into the warehouse, thereby realizing the digital management of the entry of materials into the warehouse; there is no need for personnel to identify and enter material-related documents (such as entry orders), nor is there any need to manually identify the materials. The attribute information of the materials can be directly determined based on the material images, and the acquisition and confirmation of the target document information and material attribute information corresponding to the materials can be completed quickly and accurately, effectively improving the processing efficiency of processing tasks such as the entry of materials into the warehouse. In short, the technical solution provided by the embodiments of the present application reduces the error rate of many links (such as material identification, manual entry of entry orders, etc.), the material management data is more accurate, and the allocation of materials is more flexible.

[0193] In fact, the technical solution provided by this application is also optimized in the operation interface, and the operation is simple. The interface operation process corresponding to the solution provided by this embodiment will be described below from two specific scenarios.

[0194] See also Fig.14 The scene shown is a graph search link for a delivery scene. Fig.14 The first interface 11 shown in the figure has some prompt information displayed on it, such as "Please place the material at the designated shooting position", "Align the material to avoid angles", "The target length ratio needs to be more than 50%", etc. The user can click the "Confirm to shoot" control in the first interface 11 to trigger a shooting event for the material. The first interface 11 can be displayed in a window of the user interface.

[0195] After taking photos to obtain the material image, the system will push at least one SKU based on the material image; Fig.14 The second interface 12 in FIG. 1 (the second interface 12 may also be a window displayed on the user interface). Fig.14 As shown, at least one candidate SKU (such as top 5 candidate SKUs) obtained based on the material image by using image search technology is displayed on the second interface 12.

[0196] If the user sees that there is a matching SKU displayed on the second interface 12, the user can click the "Confirm Match" control on the second interface 12, and then jump to display the third interface 13; the third interface 13 displays the associated information corresponding to the matching target SKU selected by the user (such as the source order number). The user can click the "Confirm" control on the third interface 13 to enter the fourth interface 14. The fourth interface 14 is used to maintain new product information. The user can maintain the new product information through the fourth interface 14, such as filling in the corresponding content according to the filling box on the fourth interface 14, such as first-class classification, second-class classification, third-class classification, whether the weight can be referenced, weight, weighing weight, weighing quantity, material image, etc. After the user completes the filling, click the "Confirm" control to complete the warehousing of the new product material.

[0197] If the user does not find a matching SKU among all the SKUs displayed on the second interface 12, the user can click the "unmatched" control on the second interface 12 to enter the fifth interface 15. In the fifth interface 15, multiple filling boxes are displayed, and the user can manually fill in the content corresponding to each filling box, such as "receipt type", "supplier name", "source order number", etc. After completing the filling and clicking "Confirm", the system will obtain at least one candidate SKU based on the content filled in by the user. At least one candidate SKU is displayed on the sixth interface 16, and after the user selects a SKU, the fourth interface 14 is entered.

[0198] It should be noted here that: the third interface, the fourth interface, the fifth interface, and the sixth interface mentioned above can all be windows of corresponding user interfaces.

[0199] See also Fig.15 The scene shown is a pre-sorting scene graph search link. Users can first enter Fig.15 The user can use the "photo recognition" control on the pre-sorting and putting on the shelf interface 17 to call up the following Fig.15 The process from the first interface 11, through the second interface 12 and the third interface 14, to the fourth interface 14 is the same as described above, and will not be repeated here.

[0200] In addition, Fig.15 In the pre-sorting scene graph search link shown, the user can also edit the receipt quantity, single-room weight, etc. of the pre-sorting shelving materials (such as auxiliary materials - buttons) through the "Edit" control on the pre-sorting shelving interface 17.

[0201] Fig.16 FIG. 1 is a schematic diagram showing the structure of a data processing device provided by an embodiment of the present application. Fig.16As shown, the data processing device includes: a first acquisition module 131, a determination module 132, a second acquisition module 133 and an execution module 134. The first acquisition module 131 is used to acquire a material image. The determination module 132 is used to determine the attribute information of the material based on the material image. The second acquisition module 133 is used to acquire the target document information associated with the material. The execution module 134 is used to execute the processing task for the material according to the target document information and the attribute information.

[0202] Furthermore, the determination module 132 is used to determine a target image matching the material image based on the material image; and obtain attribute information corresponding to the target image.

[0203] Furthermore, the determination module 132 is also used to send the material image to the server, so that the server can search for at least one candidate image that meets the matching requirements with the material image; obtain and display the at least one candidate image; and in response to a confirmation operation triggered by a user for a candidate image, use the candidate image confirmed by the user as the target image.

[0204] The first acquisition module 131 is used to respond to the user's input operation to acquire the material image input by the user; or, in response to the image acquisition instruction triggered by the user, trigger the image acquisition device to work so as to acquire the material image.

[0205] Furthermore, the second acquisition module 133 is used to perform text recognition on the material document associated with the material to obtain a recognition result; and determine the target document information according to the recognition result.

[0206] Furthermore, the second acquisition module 133 is also used to trigger the start of the acquisition and identification device in response to the acquisition and identification instruction triggered by the user, so as to perform text recognition on the material documents in the acquisition area to obtain the recognition result.

[0207] Furthermore, the second acquisition module 133 is used to query at least one candidate document information that meets the association requirements with the material in the document library based on the attribute information; display the at least one candidate document information; and in response to a selection operation triggered by a user for at least one candidate document information, use the candidate document information selected by the user as the target document information.

[0208] Furthermore, the execution module 134 is used to display the target document information and at least part of the content of the attribute information; in response to a confirmation operation triggered by the user for the displayed content, the target document information is confirmed to modify the state corresponding to the target document information.

[0209] The technical solution provided in this embodiment, after obtaining the image of the material to be received, determines the attribute information corresponding to the material by means of image recognition; at the same time, it can also obtain the target document information associated with the material; then, according to the target document information and the attribute information of the material, execute the processing tasks for the material, such as warehousing processing or verification processing. With the technical solution provided in this embodiment, there is no need for personnel to identify and enter the material-related documents, nor is there any need to manually identify the material. The attribute information of the material can be directly determined based on the material image, and the acquisition and confirmation of the target document information and material attribute information corresponding to the material can be completed quickly and accurately, effectively improving the processing efficiency of processing tasks such as material warehousing.

[0210] It should be noted here that: the information processing device provided in the above embodiment can implement the technical solution described in the above corresponding method embodiment. The specific implementation principles and beneficial effects of the above modules or units can be found in the corresponding contents in the above corresponding method embodiment, which will not be repeated here.

[0211] Fig.17 FIG. 1 is a schematic diagram showing the structure of a data processing device provided by an embodiment of the present application. Fig.17 As shown, the data processing device includes: a generating module 141, a determining module 142 and an executing module 143. The generating module 141 is used to generate document information according to the document image. The determining module 142 is used to determine the attribute information of the material according to the material image. The executing module 143 is used to execute the processing task for the material according to the attribute information and the document information.

[0212] Furthermore, the generating module 141 is used to recognize the document image by optical character recognition to obtain a recognition result; based on the recognition result, the document information is generated. The determining module 142 is used to determine a target image matching the material image according to the material image; and obtain attribute information corresponding to the target image.

[0213] Furthermore, the determination module 142 is also used to send the material image to the server, so that the server can search for at least one candidate image that meets the matching requirements with the material image; obtain and display the at least one candidate image; and in response to a confirmation operation triggered by a user for a candidate image, use the candidate image confirmed by the user as the target image.

[0214] Furthermore, the data processing device provided in this embodiment also includes an acquisition module 144, which is used to acquire a captured image containing materials and documents; and segment the captured image to obtain the document image and the material image.

[0215] It should be noted here that: the data processing device provided in the above embodiment can implement the technical solution described in the above corresponding method embodiment. The specific implementation principles and beneficial effects of the above modules or units can be found in the corresponding contents in the above corresponding method embodiment, which will not be repeated here.

[0216] The technical solution provided in this embodiment can obtain the attribute information and document information corresponding to the material directly based on the material image and the document image; then, based on the document information and the attribute information of the material, execute the processing tasks for the material, such as warehousing processing or verification processing. With the technical solution provided in this embodiment, there is no need for personnel to identify and enter the material-related documents, nor is there any need to manually identify the material. The attribute information of the material can be determined directly based on the material image, and the acquisition and confirmation of the target document information and material attribute information corresponding to the material can be completed quickly and accurately, effectively improving the processing efficiency of processing tasks such as material warehousing.

[0217] Fig.18 FIG. 1 is a schematic diagram showing the structure of a data processing device provided by an embodiment of the present application. Fig.18 As shown, the data processing device includes: an acquisition module 161 and a display module 162. The acquisition module 161 is used to acquire a material image of the material to be stored; and according to the material image, to acquire management data related to the material to be stored. The display module 162 is used to display the management data to wait for the storage processing of the material to be stored.

[0218] Furthermore, the device provided in this embodiment further includes an updating module. The updating module is used to update the management data according to user operation data in response to the user's operation on the management data.

[0219] Furthermore, when the acquisition module 161 acquires the management data related to the material to be stored based on the material image, it is specifically used to: perform image recognition on the material image to obtain a recognition result; and acquire the management data related to the material to be stored based on the recognition result.

[0220] Furthermore, when the acquisition module 161 acquires the management data related to the material to be stored according to the material image, it is specifically used to:

[0221] Searching, according to the material image, for at least one candidate image that meets a matching degree requirement with the material image;

[0222] displaying the at least one candidate image;

[0223] In response to a user's selection operation on the at least one candidate image, determining a selected candidate image;

[0224] Management data related to the material to be stored is determined according to the selected candidate image.

[0225] Furthermore, when searching for at least one candidate image that meets the matching requirement with the material image based on the material image, the acquisition module 161 is specifically used to: send the material image to the server, so that the server searches for at least one candidate image that meets the matching requirement with the material image based on the material image; and receive the at least one candidate image fed back by the server.

[0226] Furthermore, the management data includes: the warehouse entry order information of the material to be warehoused, and the attribute information of the material to be warehoused.

[0227] It should be noted here that: the data processing device provided in the above embodiment can implement the technical solution described in the above corresponding method embodiment. The specific implementation principles and beneficial effects of the above modules or units can be found in the corresponding contents in the above corresponding method embodiment, which will not be repeated here.

[0228] Fig.19 FIG. 1 is a schematic diagram showing the structure of a data processing device provided by an embodiment of the present application. Fig.19 As shown, the data processing device includes: a determination module 171 and a display module 172. The determination module 171 is used to determine the attribute information of the material to be stored according to the material image of the material to be stored; and to determine the storage order information according to the storage order image of the material to be stored. The display module 172 is used to associate and display the attribute information and the storage order information to wait for the storage processing of the material to be stored.

[0229] Furthermore, when determining the warehouse entry order information according to the warehouse entry order image of the material to be warehoused, the determination module 171 is specifically used to: perform text recognition on the warehouse entry order image to obtain the warehouse entry order information.

[0230] Furthermore, the device provided in this embodiment may also include an acquisition module and a segmentation module. The acquisition module is used to respond to the user's image acquisition operation to acquire a captured image containing the material to be stored and the storage order. The segmentation module is used to segment the captured image to obtain the material image and the storage order image.

[0231] It should be noted here that: the data processing device provided in the above embodiment can implement the technical solution described in the above corresponding method embodiment. The specific implementation principles and beneficial effects of the above modules or units can be found in the corresponding contents in the above corresponding method embodiment, which will not be repeated here.

[0232] Fig. 20FIG. 1 is a schematic diagram showing the structure of an electronic device provided by an embodiment of the present application. Fig. 20 As shown, the electronic device includes a memory 1101 and a processor 1102. The memory 1101 can be configured to store various other data to support operations on the electronic device. Examples of these data include instructions for any application or method for operating on the electronic device. The memory 1101 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk or an optical disk.

[0233] Specifically, the memory 1101 is used to store a program; the processor 1102 is coupled to the memory and is used to execute the program stored in the memory 1101, so as to:

[0234] Get material images;

[0235] Determining attribute information of the material based on the material image;

[0236] Obtain target document information associated with the material;

[0237] According to the target document information and the attribute information, a processing task for the material is executed.

[0238] In particular, when the processor 1102 executes the program in the memory 1101, in addition to the above functions, other functions may also be implemented, and details may be referred to the description of the previous embodiments.

[0239] Further, if Fig. 20 As shown, the electronic device also includes: a communication component 1103, a display 1104, a power component 1105, an audio component 1106, an image acquisition device 1107 and other components. Fig. 20 Only some components are shown schematically, which does not mean that the electronic device only includes Fig. 20 Components shown.

[0240] Another embodiment of the present application provides another electronic device. The structure of the electronic device is similar to Fig. 20 Specifically, the electronic device includes a memory and a processor; wherein,

[0241] The memory is used to store programs;

[0242] The processor is coupled to the memory and is configured to execute the program stored in the memory to:

[0243] Generate document information based on the document image;

[0244] Determine the material's attribute information based on the material image;

[0245] According to the attribute information and the document information, a processing task for the material is executed.

[0246] In particular, when the processor executes the program in the memory, in addition to the above functions, other functions may also be implemented, for details, please refer to the description of the previous embodiments.

[0247] Another embodiment of the present application provides another electronic device. The structure of the electronic device is similar to Fig.18 Specifically, the electronic device includes a memory, a processor and a display; wherein,

[0248] The memory is used to store programs;

[0249] The processor is coupled to the memory and is configured to execute the program stored in the memory to:

[0250] Get the material image of the material to be put into storage;

[0251] Acquiring management data related to the material to be stored according to the material image;

[0252] The display is instructed to display the management data to wait for the warehousing processing of the material to be warehousing.

[0253] In particular, when the processor executes the program in the memory, in addition to the above functions, other functions may also be implemented, for details, please refer to the description of the previous embodiments.

[0254] Another embodiment of the present application provides another electronic device. The structure of the electronic device is similar to Fig.18 Specifically, the electronic device includes a memory, a processor and a display; wherein,

[0255] The memory is used to store programs;

[0256] The processor is coupled to the memory and is configured to execute the program stored in the memory to:

[0257] Determine the attribute information of the material to be stored according to the material image of the material to be stored;

[0258] Determine the warehouse entry order information according to the warehouse entry order image of the material to be warehoused;

[0259] The instruction associates and displays the attribute information and the warehouse entry order information to wait for warehouse entry processing of the material to be warehoused.

[0260] Accordingly, an embodiment of the present application further provides a computer-readable storage medium storing a computer program, and when the computer program is executed by a computer, the steps or functions of the data processing method provided in the above embodiments can be implemented.

[0261] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be separated in material, and the components displayed as units may or may not be material units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative labor.

[0262] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0263] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A data processing method, characterized in that: include: Get material images; Based on the material image, using image search technology to search for at least one candidate image that meets the matching degree requirement with the material image; displaying the at least one candidate image; If a confirmation operation triggered by the user for a candidate image is obtained, in response to the confirmation operation, the candidate image confirmed by the user is used as a target image matched with the material image, the stock keeping unit SKU of the material corresponding to the target image is obtained, and according to the SKU, at least one candidate document information including the SKU in the SKU of the desired material in the document library is queried, and the at least one candidate document information is displayed. In response to a selection operation triggered by the user for at least one candidate document information, the candidate document information selected by the user is used as the target document information, and at least part of the content in the target document information and the SKU is displayed. In response to a confirmation operation triggered by the user for the displayed content, the status of the material corresponding to the SKU in the target document information is converted to warehoused. If a trigger operation of the user on the control for indicating that the at least one candidate image does not match is obtained, the page is jumped to the page for creating blank document information so that the user can manually create corresponding document information.

2. The method according to claim 1, characterized in that According to the material image, at least one candidate image that meets the matching requirement with the material image is searched by using an image search technology, including: Sending the material image to a server, so that the server can use image search technology to search for at least one candidate image that meets the matching degree requirement with the material image; The at least one candidate image is acquired.

3. The method according to claim 1, characterized in that Get material images, including: In response to an input operation of a user, acquiring the material image input by the user; or In response to an image acquisition instruction triggered by a user, the material image is acquired.

4. The method according to claim 1, characterized in that: Also includes: Display the target document information; In response to a user's modification operation on at least one item of the target document information, the modified target document information is determined.

5. The method according to claim 4, characterized in that Also includes: Using the modified target document information as a learning sample to optimize the corresponding algorithm; The algorithm includes: a first algorithm for performing image-based recognition of material attributes in an image and / or a second algorithm for performing text recognition on a material document associated with the material.

6. A data processing system, characterized in that: include: The client device is used to obtain the material image and send the material image to the server; Acquire and display at least one candidate image; if a confirmation operation triggered by a user for a candidate image is acquired, in response to the confirmation operation, use the candidate image confirmed by the user as a target image matched with the material image, acquire the stock keeping unit (SKU) of the material corresponding to the target image, query the document library for at least one candidate document information including the SKU in the SKU of the desired material according to the SKU, display the at least one candidate document information, in response to a selection operation triggered by the user for at least one candidate document information, use the candidate document information selected by the user as the target document information, display the target document information and at least part of the content in the SKU, and in response to a confirmation operation triggered by the user for the displayed content, convert the status of the material corresponding to the SKU in the target document information to already in stock; And, if a trigger operation of the user on the control for indicating that the at least one candidate image does not match is obtained, jumping to a page for creating blank document information so that the user can manually create corresponding document information; The server-side device is used to use the image search technology to search for at least one candidate image that meets the matching requirements with the material image, and feed back the at least one candidate image.

7. An electronic device, characterized in that: comprising a memory and a processor; wherein, The memory is used to store programs; The processor is coupled to the memory and is configured to execute the program stored in the memory to: Get material images; Based on the material image, using image search technology to search for at least one candidate image that meets the matching degree requirement with the material image; displaying the at least one candidate image; If a confirmation operation triggered by the user for a candidate image is obtained, in response to the confirmation operation, the candidate image confirmed by the user is used as a target image matched with the material image, the stock keeping unit SKU of the material corresponding to the target image is obtained, and according to the SKU, at least one candidate document information including the SKU in the SKU of the desired material in the document library is queried, and the at least one candidate document information is displayed. In response to a selection operation triggered by the user for at least one candidate document information, the candidate document information selected by the user is used as the target document information, and at least part of the content in the target document information and the SKU is displayed. In response to a confirmation operation triggered by the user for the displayed content, the status of the material corresponding to the SKU in the target document information is converted to warehoused. If a trigger operation of the user on the control for indicating that the at least one candidate image does not match is obtained, the page is jumped to the page for creating blank document information so that the user can manually create corresponding document information.

Citation Information

Patent Citations

  • Inspection processing device, inspection system, inspection processing method and program

    JP2017081708A

  • Article management system, warehousing terminal, and article management method

    WO2019207801A1