Method, device, storage medium and electronic device for generating operation instruction document

Abstract

The present application discloses a method, device, storage medium and electronic device for generating an operation instruction document, wherein the method includes: collecting product barcode information of a target product, obtaining a bill of materials and a product layout diagram corresponding to the target product from a database based on the product barcode information, collecting a video of the operation action of the target product during the production process, determining a target material corresponding to the target product under the current operation action based on the operation action video, and adding the material information of the target material to a column of a designated template of the operation instruction document based on the bill of materials, the product layout diagram and the target material corresponding to the target product under the current operation action. By adopting the present application, the automatic filling of the operation instruction document is completed by identifying the bill of materials and the product layout diagram corresponding to the target product and the operation action video of the target product during the production process, thereby saving labor costs and reducing the probability of errors.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a method, device, storage medium, and electronic device for generating an operation instruction document. Background Art

[0002] When professional engineering technicians edit the operating instructions of a product on a computer, they often need to conduct a large amount of query work on the relevant information of the product and copy the relevant information into the designated template field of the operating instructions.

[0003] Nowadays, most of the work instruction documents are still edited manually, and manual search and copying of relevant reference materials is too time-consuming and labor-intensive, inefficient, and prone to errors. Summary of the Invention

[0004] The present invention provides a method, device, storage medium, and electronic device for generating a work instruction document. By identifying the bill of materials and product layout corresponding to the target product, as well as a video of the target product's work actions during the production process, the work instruction document can be automatically filled out, saving labor costs and reducing the probability of error. The technical solution is as follows:

[0005] In a first aspect, an embodiment of the present application provides a method for generating a work instruction document, the method comprising:

[0006] Collect product barcode information of target products;

[0007] Based on the product barcode information, obtaining a bill of materials and a product layout diagram corresponding to the target product from a database;

[0008] Collecting a video of the target product's operation during the production process, and determining a target material corresponding to the target product under the current operation based on the video of the operation;

[0009] Based on the bill of materials corresponding to the target product, the product layout diagram, and the target material corresponding to the target product under the current operation action, the material information of the target material is added to the column of the designated template of the operation instruction document.

[0010] In a second aspect, an embodiment of the present application provides a device for generating a work instruction document, the device comprising:

[0011] Information collection module, used to collect product barcode information of target products;

[0012] An information acquisition module, configured to acquire a bill of materials and a product layout diagram corresponding to the target product from a database based on the barcode information of the target product;

[0013] A target material determination module is used to collect operation action videos during the production process of the target product, and determine the target material corresponding to the target product under the current operation action based on the operation action videos;

[0014] The information adding module is used to add the material information of the target material to the column of the designated template of the operation instruction document based on the material list, product layout diagram and target material corresponding to the target product under the current operation action.

[0015] In a third aspect, an embodiment of the present application provides a computer storage medium, which stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the above-mentioned method steps.

[0016] In a fourth aspect, an embodiment of the present application provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the above-mentioned method steps.

[0017] The beneficial effects of the technical solutions provided in the embodiments of the present application include at least:

[0018] In an embodiment of the present application, a mobile terminal collects product barcode information of a target product through a camera, obtains a bill of materials and a product layout diagram corresponding to the target product from a database based on the product barcode information, collects a video of the target product's operation during the production process, determines the target material corresponding to the target product under the current operation based on the video of the operation, and then adds the material information of the target material to a column of a designated template of an operation instruction file based on the bill of materials corresponding to the target product, the product layout diagram, and the target material corresponding to the target product under the current operation, thereby generating an operation instruction file. By identifying the bill of materials and the product layout diagram corresponding to the target product and the video of the target product's operation during the production process, the operation instruction file is automatically filled in, saving labor costs and reducing the probability of errors. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0020] Figure 1a This is a schematic diagram of the system architecture of a method for generating a work instruction document provided in an embodiment of the present application;

[0021] Figure 1b This is a schematic diagram of the system architecture of another method for generating a work instruction document provided in an embodiment of the present application;

[0022] Figure 2 This is a flowchart of a method for generating an operation instruction document provided in an embodiment of the present application;

[0023] Figure 3 This is a flowchart of a method for generating an operation instruction document provided in an embodiment of the present application;

[0024] Figure 4 This is an example diagram of enabling the function of generating a work instruction document provided in an embodiment of the present application;

[0025] Figure 5 This is another example schematic diagram of enabling the work instruction file generation function provided in an embodiment of the present application;

[0026] Figure 6 This is an example diagram of a prompt information display interface provided in an embodiment of the present application;

[0027] Figure 7 This is an example diagram of a prompt information display interface provided in an embodiment of the present application;

[0028] Figure 8 This is an example diagram of a prompt information display interface provided in an embodiment of the present application;

[0029] Figure 9 This is a structural diagram of a device for generating a work instruction document provided in an embodiment of the present application;

[0030] Figure 10 This is a structural diagram of a device for generating a work instruction document provided in an embodiment of the present application;

[0031] Figure 11 This is a schematic diagram of the structure of a target material determination module provided in an embodiment of the present application;

[0032] Figure 12 This is a structural diagram of an information adding module provided in an embodiment of the present application;

[0033] Figure 13 This is a structural diagram of an information inspection module provided in an embodiment of the present application;

[0034] Figure 14 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0036] When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of devices and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0037] In the description of this application, it should be understood that the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific circumstances. In addition, in the description of this application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0038] The present application is described in detail below with reference to specific embodiments.

[0039] The method can be implemented by a computer program and can be run on an operation instruction file generation device based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application. Among them, the operation instruction file generation device in the embodiment of the present application can be a mobile terminal, including but not limited to: a smart interactive tablet, a personal computer, a tablet computer, a handheld device, a computing device or other processing device connected to a wireless modem. In different networks, the user terminal can be called different names, such as: user equipment, access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent or user device, cellular phone, cordless phone, personal digital assistant (PDA), 5G network or terminal equipment in future evolution network, etc.

[0040] See Figure 1a, a schematic diagram of the system architecture of a method for generating work instruction documents provided in an embodiment of the present application. The system includes a camera and a mobile terminal. The camera is mounted on the camera, and the mobile terminal can also be mounted on the camera. The camera can be a device that communicates with the mobile terminal via wireless or wired means. Wireless means for communication between the mobile terminal and the camera include, but are not limited to, cellular networks, wireless local area networks, infrared networks, near-field communication networks, or Bluetooth networks, and wired means include, but are not limited to, Universal Serial Bus (USB).

[0041] The user triggers the camera to turn on, and the camera scans the product barcode information on the target product and transmits the collected product barcode information to the mobile terminal. The mobile terminal searches and obtains the material list and product layout diagram of the target product in the database based on the product barcode information, determines the target material of the target product under the current operation action based on the collected operation action video, and determines the material information of the target material based on the material list and product layout diagram and the target material corresponding to the target product under the current operation action, thereby adding the material information of the target material to the column of the specified template of the operation instruction document, and automatically generating the operation instruction document.

[0042] See Figure 1b , a schematic diagram of the system architecture of another method for generating work instruction documents provided in an embodiment of the present application. The method includes a mobile terminal equipped with a camera. Users can directly access the camera when needed, and the content captured by the camera is directly processed within the mobile terminal.

[0043] The user triggers to open the camera on the mobile terminal, and the camera scans the product barcode information on the target product. The mobile terminal searches and obtains the material list and product layout diagram of the target product in the database based on the collected product barcode information, determines the target material of the target product under the current operation action based on the collected operation action video, and determines the material information of the target material based on the material list and product layout diagram and the target material corresponding to the target product under the current operation action, thereby adding the material information of the target material to the column of the specified template of the operation instruction document, and automatically generating the operation instruction document.

[0044] See Figure 2 , which is a flow chart of a method for generating an operation instruction document provided in an embodiment of the present application.

[0045] In the embodiment of the present application, the execution subject is a mobile terminal. Figure 1a Taking the system architecture diagram shown in FIG. 1 as an example, the method for generating a work instruction file may include the following steps:

[0046] S101, collecting product barcode information of the target product;

[0047] The target product can be any hardware product, such as a camera, mobile phone, or smart glasses. The target product is a standalone device that can be composed of multiple materials arranged in a specific layout. A product barcode is affixed to the target product. This barcode can be any barcode used to identify the product.

[0048] The barcode information may be any type of graphic identifier with an identification function, such as a QR code, a barcode, etc.

[0049] Specifically, the product barcode information pasted on the target product can be scanned by aiming the camera at the product barcode information. The camera can be a camera independent of the mobile terminal or a camera installed on the mobile terminal.

[0050] The embodiment of the present application is described using an example in which the camera is a camera on a camera independent of the mobile terminal. When the user triggers to turn on the camera, the camera scans the product barcode information on the product and transmits the collected product barcode information to the mobile terminal, which receives the product barcode information.

[0051] S102, based on the product barcode information, obtaining a bill of materials and a product layout diagram corresponding to the target product from a database;

[0052] The database can be any data set storing a large amount of information, such as a server storage database, Network Attached Storage (NAS), or a dedicated storage space within a mobile terminal for storing product information. In this embodiment, the database stores information such as the identification number, bill of materials, and product layout diagram of at least one product to be edited. Table 1 shows a possible storage method.

[0053] Table 1

[0054]

[0055] The bill of materials may include the type, specification, quantity, and number of materials required for the production of the product.

[0056] The product layout diagram can be a product structure diagram such as the product's structural layout, material connection method, etc. For example, it can be a layout diagram of the product's internal structure such as a circuit board, or it can be a layout diagram of the product's external shape structure.

[0057] Specifically, after receiving the product barcode information captured by the camera, the mobile terminal identifies the identification number corresponding to the product barcode information, such as the product name, product ID, etc., and searches the database for the identification number to determine the bill of materials and product layout corresponding to the target product. For example, if the searched identification number is 1, the corresponding bill of materials is List 1, and the corresponding product layout is Visio 1.

[0058] S103, collecting an operation action video of the target product during the production process, and determining a target material corresponding to the target product under the current operation action based on the operation action video;

[0059] The operation action video may be a video of the operation action during the process of manual or machine production of the target product.

[0060] The operation action can be an action performed by a human or machine during the production of the target product, such as a robotic arm installing the keycap labeled "esc" in the upper left corner of a keyboard during assembly. It should be noted that during the production process of the target product, different timestamps indicate different materials and corresponding operation actions.

[0061] Specifically, the operation action video during the production process of the target product can be collected by a camera. The camera can be a camera independent of the mobile terminal or a camera installed on the mobile terminal.

[0062] Taking a camera that is independent of a mobile terminal as an example, the camera collects operation action videos of the target product during the production process, and sends the operation action videos to the mobile terminal wirelessly or wiredly. The mobile terminal then analyzes the collected operation action videos using a visual algorithm to determine the target material corresponding to the operation action at the current timestamp, that is, the target material currently being operated.

[0063] Taking a camera installed on a mobile terminal as an example, the mobile terminal is placed in an area where the production process of the target product can be captured. The camera is turned on to capture the operation action video and the visual algorithm is directly used to identify the operation action at the current timestamp in the operation action video, and determine the target material corresponding to the operation action.

[0064] For example, if the current timestamp operation is that the robot arm places a keycap printed with the ESC logo on the upper left corner of a keyboard being assembled, the mobile terminal uses a visual algorithm to analyze and determine that the target material corresponding to the current operation is an ESC keycap with the position number cn1.

[0065] S104, based on the bill of materials corresponding to the target product, the product layout diagram, and the target material corresponding to the target product under the current operation action, adding the material information of the target material to the column of the designated template of the operation instruction document;

[0066] Through steps S101-S103, the material list, product layout diagram and target materials corresponding to different operating actions in the production process of the target product can be obtained. Based on the material list, product layout diagram and target materials corresponding to different operating actions in the production process of the target product, the material number, material specification, position number and installation quantity of the target material corresponding to each operating action can be obtained, and this is used as the material information of the target material. The material information of the target material is added to the column of the specified template of the operation instruction document, thereby completing the generation of the operation instruction document.

[0067] For example: Based on the obtained bill of materials, the material number of the target material is 004,036,0001500, and the material specification is 2x20Pm / without pm6 socket. Based on the product layout diagram and the analysis of the current operation action, the material position number corresponding to the target material under the current operation action is CN7, and the installation quantity is 1. This information is used as the material information of the target material under the current operation action and added to the column of the specified template of the operation instruction file. As shown in Table 2, the operation instruction file with some material information added is obtained.

[0068] Table 2

[0069]

[0070] Among them, the process of adding the material information of the target material to the work instruction file is done automatically through the mobile terminal, and there is no need to manually add the information to the column of the designated template of the work instruction file.

[0071] In an embodiment of the present application, a mobile terminal collects product barcode information of a target product, obtains a bill of materials and a product layout diagram of the target product from a database based on the barcode information, then collects a video of the target product's operation action during the production process, determines the target material corresponding to the target product under the current operation action based on the operation action video, obtains the material number, material specification, position number and installation quantity of the target material corresponding to each operation action based on the bill of materials, product layout diagram of the target product and the target material corresponding to different operation actions during the production process of the target product, and uses this as the material information of the target material, and adds the material information of the target material to the column of the designated template of the operation instruction file, thereby realizing the automatic generation of the operation instruction file. The technical solution provided in the embodiment of the present application completes the automatic filling of the operation instruction file by identifying the bill of materials and product layout diagram corresponding to the target product and the operation action video of the target product during the production process, saving labor costs and reducing the probability of errors.

[0072] See Figure 3 , provides a flow chart of a method for generating an operation instruction document in an embodiment of the present application.

[0073] In this embodiment of the application, the execution subject is a mobile terminal. Figure 1a Taking the system architecture diagram shown in FIG. 1 as an example, the method for generating a work instruction file may include the following steps:

[0074] S201, determining at least one product to be edited, and storing the bill of materials and product layout corresponding to each of the products to be edited in a database;

[0075] The product to be edited can be any hardware product, such as a camera, mobile phone, or keyboard. It is a standalone device composed of multiple materials arranged in a specific layout. The product to be edited is a product for which work instructions are being prepared, and a corresponding bill of materials and product layout diagram are already available.

[0076] The database can be any device with data storage capabilities that stores a large amount of information, such as a server storage database or Network Attached Storage (NAS). It can also be a dedicated storage space within a mobile terminal for storing product information. In this embodiment, the database stores information such as the identification number, bill of materials, and product layout diagram of the product to be edited. One possible storage method is shown in Table 1.

[0077] The identification number may be information that identifies the product, such as the product name, product ID, etc.

[0078] The bill of materials can be the material type, material specifications, material quantity, material number and other related information required in the production process of the product;

[0079] The product layout diagram can be a product structure diagram such as the product's structural layout, material connection method, etc. For example, it can be a layout diagram of the product's internal structure such as a circuit board, or it can be a layout diagram of the product's external shape structure.

[0080] Specifically, at least one product to be edited is identified, and the corresponding identification number, bill of materials, and product layout diagram for each product to be edited is stored in a database. The information in the database is stored by product. To search for a product, simply search for the product's identification number to obtain the bill of materials and product layout diagram corresponding to that product's identification number. For example, in Table 1, if the searched identification number is 1, the corresponding bill of materials is List 1, and the corresponding product layout diagram is Visio 1.

[0081] S202, when producing the target product for the first time, enable the work instruction file generation function and enter the collection mode;

[0082] The collection mode may be a mode in which the mobile terminal starts an information collection state. The mobile terminal in the collection state turns on the camera to collect the product barcode information of the target product.

[0083] Specifically, when the target product is produced for the first time, an instruction to start the operation instruction file generation function is input into the mobile terminal, and the mobile terminal outputs a prompt message to prompt the user whether to confirm whether to start the operation instruction file generation function. After the user confirms to start, the mobile terminal starts the operation instruction file generation function and then enters the collection mode.

[0084] Among them, the method of inputting the instruction to start the work instruction file generation function in the mobile terminal can be to use the mouse to open the software in the mobile terminal, such as Figure 4 As shown; you can also generate instructions for the work instruction file by using keyboard shortcuts, such as Figure 5 shown.

[0085] The prompt information may be output in the form of audio, text, or animation, or in multiple forms in parallel, and the specific form and content are not limited.

[0086] like Figure 6 As shown, a feasible prompt method can be a text box prompt, which pops up a text box with the content of "whether to enable the work instruction file generation function".

[0087] S203, collecting product barcode information of the target product;

[0088] For details, please refer to step S101, which will not be described here in detail.

[0089] S204, based on the product barcode information, obtaining a bill of materials and a product layout diagram corresponding to the target product from a database;

[0090] For details, please refer to step S102, which will not be described here in detail.

[0091] S205, collecting an operation action video of the target product during the production process, and determining a target material corresponding to the target product under the current operation action based on the operation action video;

[0092] For details, please refer to step S103, which will not be described here in detail.

[0093] S206, based on the bill of materials corresponding to the target product, the product layout diagram, and the target material corresponding to the target product under the current operation action, adding the material information of the target material to the column of the designated template of the operation instruction document;

[0094] Through step S204, the material number and material specifications of the target material can be obtained based on the bill of materials of the target product; through steps S204 and S205, based on the product layout diagram and the analysis of the current operation action, the material position number corresponding to the target material and the installation quantity of the material position number are obtained, and the obtained material number, material specification, material position number and installation quantity are added as material information to the column of the designated template of the operation instruction file to obtain the operation instruction file with some material information added as shown in Table 2.

[0095] Among them, the process of adding the material information of the target material to the work instruction file is done automatically through the mobile terminal, and there is no need to manually add the information to the column of the designated template of the work instruction file.

[0096] S207, counting the total installed quantities of all materials in the column of the designated template, and checking whether the total installed quantities are consistent with the total material quantities of the target product;

[0097] Specifically, after adding the material information of the target material corresponding to the target product to the specified template of the operation instruction file, in order to confirm whether there is an error in the process of the mobile terminal searching and obtaining material information and filling in the operation instruction file, it is necessary to check the completed operation instruction file, count the total installation quantity of all materials in the completed operation instruction file, and compare it with the data of the material list of the target product obtained from the database to check whether the total installation quantity is consistent with the total material quantity of the target product. If they are consistent, it indicates that there is no problem in filling in the material installation quantity information part of the generated operation instruction file, and the material installation quantity information part of the operation instruction file is completed. If they are inconsistent, it indicates that an error occurred in the generation process of the operation instruction file, and the operation instruction file needs to be generated again or manually checked.

[0098] S208, checking whether the position numbers of the materials in the product layout diagram are consistent with the position numbers of the materials in the columns of the designated template;

[0099] Specifically, after adding the material information of the target material corresponding to the target product to the designated template of the operation instruction file, in order to confirm whether there is an error in the process of searching and obtaining the material information and filling in the operation instruction file by the mobile terminal, it is necessary to check the completed operation instruction file, and compare the position number of each material in the product layout diagram with the position number of each material in the column of the designated template to check whether the position number of each material in the product layout diagram can find the corresponding material position number in the column of the designated template. If the corresponding position number can be found, it indicates that there is no problem in filling in the material position number information part of the generated operation instruction file, the material position number information part of the operation instruction file is completed, and the operation instruction file is generated. If the corresponding position number cannot be found, it indicates that an error occurred in the generation process of the operation instruction file, and the operation instruction file needs to be generated again or manually checked.

[0100] S209, output the inspection result;

[0101] Through step S207 and step S208, the result of checking the content of the generated work instruction file can be obtained and output. The check result can be used to verify whether there is an error in the process of generating the work instruction file.

[0102] It can be understood that the inspection results may include the following situations: the sum of the installed quantities is consistent with the sum of the material quantities of the target product, and the position numbers of each material in the product layout diagram are consistent with the position numbers of each material in the column of the specified template; the inspection results indicate that the sum of the installed quantities is inconsistent with the sum of the material quantities of the target product, and / or the position numbers of each material in the product layout diagram are inconsistent with the position numbers of each material in the column of the specified template.

[0103] S210, if the inspection result indicates that the sum of the installed quantities is consistent with the sum of the material quantities of the target product, and the position numbers of the materials in the product layout diagram are consistent with the position numbers of the materials in the columns of the designated template, outputting a prompt message indicating that the file has been generated, wherein the prompt message is used to inform the user that the work instruction file has been generated;

[0104] Specifically, if the inspection result indicates that the total installation quantity is consistent with the total material quantity of the target product, and the position number of each material in the product layout diagram is consistent with the position number of each material in the column of the specified template, it can be considered that there is no error in the process of searching and obtaining material information and filling in the operation instruction document by the mobile terminal, and a prompt message indicating that the operation instruction document generation is completed is output to prompt the user that the operation instruction document has been generated.

[0105] The prompt information may be output in the form of audio, text, or animation, or in multiple forms in parallel, and the specific form and content are not limited.

[0106] like Figure 7 As shown, a feasible prompt method can be a text box prompt, in which a text box pops up, and the content of the text box is "The operation instruction file has been generated."

[0107] S211: If the check result indicates that the sum of the installed quantities is inconsistent with the sum of the material quantities of the target product, and / or the position numbers of the materials in the product layout are inconsistent with the position numbers of the materials in the columns of the designated template, then outputting an error message indicating a file error, wherein the error message is used to prompt the user to check the work instruction file;

[0108] Specifically, if the inspection result indicates that the total installation quantity is inconsistent with the total material quantity of the target product, and / or the position number of each material in the product layout diagram is inconsistent with the position number of each material in the column of the specified template, it can be considered that an error occurred in the process of the computer searching and obtaining material information and filling in the operation instruction file, and an error message indicating that the operation instruction file is wrong is output to prompt the user to check the problems in the generation process of the operation instruction file.

[0109] Among them, the problems that exist in the process of generating the work instruction document may include multiple aspects, such as: an error occurs when collecting the product barcode information of the target product and searching the database, and it is mistakenly identified as another product; or an error occurs when determining the target material corresponding to the current work action based on the work action video, and it is mistakenly identified as another material; it may also be an error when adding material information to the specified template of the work instruction document, such as filling in the information in the wrong place.

[0110] The prompt information may be output in the form of audio, text, or animation, or in multiple forms in parallel, and the specific form and content are not limited.

[0111] like Figure 8 As shown, a feasible prompt method can be a text box prompt, in which a text box pops up, and the content of the text box is "An error occurred during the generation of the work instruction file."

[0112] In an embodiment of the present application, by pre-storing the bill of materials, product layout diagram and other information of each product to be edited in the database, it is convenient to call it up later when searching. By identifying the bill of materials and product layout diagram corresponding to the target product and the operation action video of the target product during the production process, the automatic filling of the operation instruction file is completed, saving labor costs and reducing the probability of error. Furthermore, the generated operation instruction file is checked for errors, and a corresponding prompt message is output based on the inspection results to prompt the user whether there are any problems with the generated operation instruction file, so as to ensure that the final generated operation instruction file is accurate.

[0113] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0114] See Figure 9 , which shows a schematic diagram of the structure of a work instruction document generation device provided by an exemplary embodiment of the present application. The work instruction document generation device can be implemented in whole or in part as a terminal through software, hardware, or a combination of both. The device 1 includes an information collection module 11, an information acquisition module 12, a target material determination module 13, and an information addition module 14.

[0115] The information collection module 11 is used to collect the product barcode information of the target product;

[0116] An information acquisition module 12 is configured to acquire a bill of materials and a product layout diagram corresponding to the target product from a database based on the barcode information of the target product;

[0117] A target material determination module 13 is configured to collect a video of an operation action during the production process of the target product, and determine a target material corresponding to the target product under the current operation action based on the video of the operation action;

[0118] The information adding module 14 is used to add the material information of the target material to the column of the designated template of the operation instruction file based on the material list, product layout diagram and target material corresponding to the target product under the current operation action.

[0119] Optional, such as Figure 10As shown, the device 1 also includes:

[0120] An information storage module 15 is configured to determine at least one product to be edited, and store the bill of materials and product layout corresponding to each of the products to be edited in a database;

[0121] The information checking module 16 is used to check whether the content added to the specified template is correct.

[0122] Optional, such as Figure 11 As shown, the target material determination module 13 includes:

[0123] The video acquisition unit 131 is used to obtain a video of the target product's operation during the production process captured in real time by a camera;

[0124] The target material determination unit 132 is used to use a visual algorithm to identify the operating action in the operating action video at the current timestamp, and determine the target material corresponding to the operating action based on the correspondence between different operating actions and different materials of the target product.

[0125] Optional, such as Figure 12 As shown, the information adding module 14 includes:

[0126] A list determination unit 141 is used to determine the material number and material specifications of the target material in the material list;

[0127] A layout determining unit 142, configured to determine the position number and installation quantity of the target material in the product layout diagram;

[0128] An information determining unit 143 is configured to use the material number, material specification, position number, and installation quantity of the target material as the material information of the target material;

[0129] The information filling unit 144 is used to call the specified template of the work instruction file and add the material information of the target material into the column of the specified template.

[0130] Optional, such as Figure 13 As shown, the information checking module 16 includes:

[0131] a quantity checking unit 161 for counting the total installed quantities of all materials in the column of the designated template, and checking whether the total installed quantities are consistent with the total material quantities of the target product;

[0132] A position number checking unit 162 is used to check whether the position number of each material in the product layout diagram is consistent with the position number of each material in the column of the designated template;

[0133] The result output unit 163 is used to output the inspection result.

[0134] Optional, such as Figure 13 As shown, the information checking module 16 further includes:

[0135] The prompt information output unit 164 is used to:

[0136] If the inspection result indicates that the sum of the installed quantities is consistent with the sum of the material quantities of the target product, and the position numbers of the materials in the product layout diagram are consistent with the position numbers of the materials in the columns of the designated template, a prompt message indicating that the file is completed is output, and the prompt message is used to inform the user that the work instruction file has been generated;

[0137] If the inspection result indicates that the sum of the installed quantities is inconsistent with the sum of the material quantities of the target product, and / or the position numbers of the materials in the product layout diagram are inconsistent with the position numbers of the materials in the columns of the designated template, an error message indicating a file error is output, and the error message is used to prompt the user to check the operation instruction file.

[0138] In an embodiment of the present application, by pre-storing the bill of materials, product layout diagram and other information of each product to be edited in the database, it is convenient to call it up later when searching. By identifying the bill of materials and product layout diagram corresponding to the target product and the operation action video of the target product during the production process, the automatic filling of the operation instruction file is completed, saving labor costs and reducing the probability of error. Furthermore, the generated operation instruction file is checked for errors, and a corresponding prompt message is output based on the inspection results to prompt the user whether there are any problems with the generated operation instruction file, so as to ensure that the final generated operation instruction file is accurate.

[0139] It should be noted that the above-described embodiment of the work instruction document generation device, when executing the work instruction document generation method, only uses the division of the above-described functional modules as an example. In actual applications, the above-described functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the work instruction document generation device provided in the above-described embodiment and the work instruction document generation method embodiment are based on the same concept. The implementation process is detailed in the method embodiment and will not be repeated here.

[0140] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0141] The present application also provides a computer storage medium that can store multiple instructions, which are suitable for being loaded and executed by a processor as described above. Figure 1a-Figure 8 The method steps of the embodiment shown, the specific execution process can be found in Figure 1a-Figure 8 The detailed description of the illustrated embodiment will not be repeated here.

[0142] The present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor. Figure 1a-Figure 8 The detailed description of the illustrated embodiment will not be repeated here.

[0143] See Figure 14 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 14 As shown, the mobile terminal 1000 may include: at least one processor 1001 , at least one network interface 1004 , a user interface 1003 , a memory 1005 , and at least one communication bus 1002 .

[0144] The communication bus 1002 is used to implement the connection and communication between these components.

[0145] The user interface 1003 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 1003 may also include a standard wired interface and a wireless interface.

[0146] The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0147] The processor 1001 may include one or more processing cores. The processor 1001 utilizes various interfaces and circuits to connect various components within the electronic device 1000. It executes instructions, programs, code sets, or instruction sets stored in the memory 1005, and accesses data stored in the memory 1005 to perform various functions and process data within the electronic device 1000. Optionally, the processor 1001 may be implemented in hardware using at least one of a digital signal processing (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor 1001 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. The CPU primarily processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing content displayed on the display; and the modem handles wireless communications. It is understood that the modem may also be implemented independently of the processor 1001 and implemented on a separate chip.

[0148] Among them, the memory 1005 may include a random access memory (RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 1005 includes a non-transitory computer-readable storage medium. The memory 1005 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1005 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1005 may also optionally be at least one storage device located away from the aforementioned processor 1001. As Figure 14 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program for generating a work instruction file.

[0149] exist Figure 14In the mobile terminal 1000 shown, the user interface 1003 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 1001 can be used to call the application for generating a work instruction file stored in the memory 1005 and specifically perform the following operations:

[0150] Collect product barcode information of target products;

[0151] Based on the product barcode information, obtaining a bill of materials and a product layout diagram corresponding to the target product from a database;

[0152] Collecting a video of the target product's operation during the production process, and determining a target material corresponding to the target product under the current operation based on the video of the operation;

[0153] Based on the bill of materials corresponding to the target product, the product layout diagram, and the target material corresponding to the target product under the current operation action, the material information of the target material is added to the column of the designated template of the operation instruction document.

[0154] In one embodiment, the processor 1001 further performs the following operations before collecting the product barcode information of the target product:

[0155] At least one product to be edited is determined, and a bill of materials and a product layout diagram corresponding to each of the products to be edited are stored in a database.

[0156] In one embodiment, the processor 1001 further performs the following operations before collecting the product barcode information of the target product:

[0157] When producing the target product for the first time, enable the work instruction file generation function and enter the collection mode.

[0158] In one embodiment, when the processor 1001 collects the operation action video of the target product during the production process and determines the target material corresponding to the target product under the current operation action based on the operation action video, the processor 1001 specifically performs the following operations:

[0159] Obtaining a video of the target product's operation during the production process captured in real time by a camera;

[0160] A visual algorithm is used to identify the operating action in the operating action video at the current timestamp, and based on the correspondence between different operating actions and different materials of the target product, the target material corresponding to the operating action is determined.

[0161] In one embodiment, when the processor 1001 adds the material information of the target material to the column of the designated template of the operation instruction document based on the bill of materials corresponding to the target product, the product layout diagram, and the target material corresponding to the target product under the current operation action, the processor 1001 specifically performs the following operations:

[0162] Determining the material number and material specifications of the target material in the bill of materials;

[0163] Determine the location number and installation quantity of the target material in the product layout diagram;

[0164] The material number, material specification, position number and installation quantity of the target material are used as the material information of the target material;

[0165] The designated template of the work instruction file is called, and the material information of the target material is added to the column of the designated template.

[0166] In one embodiment, after executing the call of the designated template of the work instruction file and adding the material information of the target material to the field of the designated template, the processor 1001 further performs the following operations:

[0167] Check whether the content added to the specified template is correct.

[0168] In one embodiment, when checking whether the content added to the specified template is incorrect, the processor 1001 specifically performs the following operations:

[0169] Counting the total installed quantity of all materials in the column of the specified template, and checking whether the total installed quantity is consistent with the total material quantity of the target product;

[0170] Check whether the position numbers of each material in the product layout diagram are consistent with the position numbers of each material in the column of the designated template;

[0171] Output the inspection results.

[0172] In one embodiment, after outputting the inspection result, the processor 1001 further performs the following operations:

[0173] If the inspection result indicates that the sum of the installed quantities is consistent with the sum of the material quantities of the target product, and the position numbers of the materials in the product layout diagram are consistent with the position numbers of the materials in the columns of the designated template, a prompt message indicating that the file is completed is output, and the prompt message is used to inform the user that the work instruction file has been generated;

[0174] If the inspection result indicates that the sum of the installed quantities is inconsistent with the sum of the material quantities of the target product, and / or the position numbers of the materials in the product layout diagram are inconsistent with the position numbers of the materials in the columns of the designated template, an error message indicating a file error is output, and the error message is used to prompt the user to check the operation instruction file.

[0175] In an embodiment of the present application, by pre-storing the bill of materials, product layout diagram and other information of each product to be edited in the database, it is convenient to call it up later when searching. By identifying the bill of materials and product layout diagram corresponding to the target product and the operation action video of the target product during the production process, the automatic filling of the operation instruction file is completed, saving labor costs and reducing the probability of error. Furthermore, the generated operation instruction file is checked for errors, and a corresponding prompt message is output based on the inspection results to prompt the user whether there are any problems with the generated operation instruction file, so as to ensure that the final generated operation instruction file is accurate.

[0176] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing related hardware through a computer program. The program can be stored in a computer-readable storage medium, and when executed, the program can include the processes in the above-described method embodiments. The storage medium can be a magnetic disk, an optical disk, a read-only memory, or a random access memory.

[0177] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A method for generating a work instruction document, characterized in that: include: Collect product barcode information of target products; Based on the product barcode information, obtaining a bill of materials and a product layout diagram corresponding to the target product from a database; Obtaining a video of the target product's operation during the production process captured in real time by a camera; Using a visual algorithm to identify the operation action in the operation action video at the current timestamp, and based on the correspondence between different operation actions and different materials of the target product, determining the target material corresponding to the operation action; Determining the material number and material specifications of the target material in the bill of materials; Determine the location number and installation quantity of the target material in the product layout diagram; The material number, material specification, position number and installation quantity of the target material are used as the material information of the target material; The designated template of the work instruction file is called, and the material information of the target material is added to the column of the designated template.

2. The method according to claim 1, characterized in that Before collecting the product barcode information of the target product, the method further includes: At least one product to be edited is determined, and a bill of materials and a product layout diagram corresponding to each of the products to be edited are stored in a database.

3. The method according to claim 1, characterized in that Before collecting the product barcode information of the target product, the method further includes: When producing the target product for the first time, enable the work instruction file generation function and enter the collection mode.

4. The method according to claim 1, wherein After calling the designated template of the work instruction file and adding the material information of the target material into the column of the designated template, the method further includes: Check whether the content added to the specified template is correct.

5. The method according to claim 4, characterized in that The checking whether the content added to the specified template is correct includes: Counting the total installed quantity of all materials in the column of the specified template, and checking whether the total installed quantity is consistent with the total material quantity of the target product; Check whether the position numbers of each material in the product layout diagram are consistent with the position numbers of each material in the column of the designated template; Output the inspection results.

6. The method according to claim 5, characterized in that After outputting the inspection result, the method further includes: If the inspection result indicates that the sum of the installed quantities is consistent with the sum of the material quantities of the target product, and the position numbers of the materials in the product layout diagram are consistent with the position numbers of the materials in the columns of the designated template, a prompt message indicating that the file is completed is output, and the prompt message is used to inform the user that the work instruction file has been generated; If the inspection result indicates that the sum of the installed quantities is inconsistent with the sum of the material quantities of the target product, and / or the position numbers of the materials in the product layout diagram are inconsistent with the position numbers of the materials in the columns of the designated template, an error message indicating a file error is output, and the error message is used to prompt the user to check the operation instruction file.

7. A device for generating a work instruction document, characterized in that: include: Information collection module, used to collect product barcode information of target products; An information acquisition module, configured to acquire a bill of materials and a product layout diagram corresponding to the target product from a database based on the barcode information of the target product; The target material determination module includes a video acquisition unit for acquiring a video of the target product's operation during the production process captured in real time by a camera; The target material determination module further includes a target material determination unit for identifying the operation action in the operation action video at the current timestamp using a visual algorithm, and determining the target material corresponding to the operation action based on the correspondence between different operation actions and different materials of the target product; The information adding module includes a list determination unit for determining the material number and material specifications of the target material in the material list; The information adding module further includes a layout determining unit for determining the position number and installation quantity of the target material in the product layout diagram; The information adding module further includes an information determining unit for using the material number, material specification, position number and installation quantity of the target material as the material information of the target material; The information adding module further includes an information filling unit, which is used to call a designated template of the work instruction file and add the material information of the target material into a column of the designated template.

8. A computer storage medium, characterized in that The computer storage medium contains a plurality of instructions, which are suitable for being loaded by a processor and executing the method steps according to any one of claims 1 to 6.

9. An electronic device, characterized in that: include: A processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for the processor to load and execute the method steps according to any one of claims 1 to 6.

Images